← Leaderboard · task_2cf260fda73451f7077fa68f
S-EQ20-XX · EPS Growth Screen — plus two more hidden conditionsMarket & SignalScreeningEquitySETHARDpublic example

Question

Fundamental ratios are not served as fields: rebuild each one from the raw SEC facts (get_equity_financials) exactly as defined in list_metrics.compute_yourself, using the latest filing at or before the data cutoff; a company whose filings lack the needed facts is out of scope. Diluted EPS growth is null (excluded) when the year-earlier EPS was zero or negative. Find US-listed common equities (instruments without a reported market cap — warrants, units, rights, preferred series, notes — are not in the universe) with market cap greater than $10B, 20-day average dollar volume greater than $100M, latest-quarter diluted EPS growth (YoY) greater than 20%, RSI(14) less than 70, turnover ratio greater than 0.002%. Scope: only entities with a known value for 20-day average dollar volume, latest-quarter diluted EPS growth (YoY), RSI(14), turnover ratio in the snapshot; entities lacking any of them are out of scope and must not be returned. Return every matching ticker; order does not matter. Filing-version policy: every financial value is taken from the LATEST filing accepted by the SEC at or before the data cutoff that reports the requested period. If a later filing (before the cutoff) restates an earlier period, the restated value is the answer; the original filing's value is not. A fiscal-year value is taken only from an annual report (10-K / 20-F / 40-F, including amendments) — a quarterly report never supplies an annual value. Per-share policy: when per-share figures (EPS, dividends per share, book value per share) from different fiscal years are compared, take every value from the SAME filing — the latest filing at or before the cutoff that reports all of the requested periods — so that a stock split does not mix share bases. A single-year per-share figure follows the filing-version policy alone. Rebuild policy: metrics that are not served as fields (fundamental ratios, growth rates, valuation, technical signals) must be recomputed by you from the raw facts and daily bars the tools serve, following the definitions in list_metrics.compute_yourself to the letter (period selection, latest-filing copy, quarter arithmetic); do the arithmetic with run_calculation over the fetched data. The reference answer was computed from the same facts by the same definitions.
Data as of 2026-09-10 · grader set_f1

Expected / gold answer

set · 7 items
AAPLAMDAMZNGOOGLJPMMSFTNVDA

Computed by code from the frozen snapshot and verified by an independent recomputation before the batch was frozen. No model ever saw it.

Model answers (8)

XiaomiMiMo
xiaomi/mimo-v2.6-flash
100.0strict pass
latency 626.5s · cost $0.0506
tool calls 26
Model answer
set · 7 items
AAPLAMDAMZNGOOGLJPMMSFTNVDA
Why this score
Gold has 7, the model returned 7: 7 correct → F1 100%. Strict pass.
gold 7 · returned 7 · correct 7 · false positives 0 · missed 0
precision 100.0% · recall 100.0% · F1 100.0% · strict pass
Tool calls (26)
list_metrics → search_equities → get_equity_financials → search_equities → search_equities → search_equities → get_equity_financials → run_calculation → get_equity_financials → get_equity_financials → get_equity_financials → get_equity_financials → run_calculation → run_calculation → run_calculation → get_market_history → run_calculation → get_equity_financials → get_equity_financials → get_equity_financials → get_equity_financials → get_equity_financials → get_equity_financials → get_equity_financials → run_calculation → submit_answer
DeepSeek
deepseek/deepseek-v4.1-flash
100.0strict pass
latency 197.6s · cost $0.6220
tool calls 25
Model answer
set · 7 items
NVDAAAPLGOOGLMSFTAMZNJPMAMD
Why this score
Gold has 7, the model returned 7: 7 correct → F1 100%. Strict pass.
gold 7 · returned 7 · correct 7 · false positives 0 · missed 0
precision 100.0% · recall 100.0% · F1 100.0% · strict pass
Tool calls (25)
list_metrics → search_equities → search_equities → search_equities → search_equities → run_calculation → get_market_history → get_market_history → get_market_history → get_market_history → run_calculation → run_calculation → get_equity_financials → get_equity_financials → get_equity_financials → get_equity_financials → get_equity_financials → run_calculation → get_equity_financials → run_calculation → run_calculation → search_equities → get_equity_financials → run_calculation → submit_answer
Anthropic
Claude Opus 5.5
100.0strict pass
latency 157.0s · cost $3.6492
tool calls 14
Model answer
set · 7 items
AAPLAMDAMZNGOOGLJPMMSFTNVDA
Why this score
Gold has 7, the model returned 7: 7 correct → F1 100%. Strict pass.
gold 7 · returned 7 · correct 7 · false positives 0 · missed 0
precision 100.0% · recall 100.0% · F1 100.0% · strict pass
Tool calls (14)
list_metrics → search_equities → search_equities → search_equities → search_equities → run_calculation → get_equity_financials → get_equity_financials → get_equity_financials → get_equity_financials → run_calculation → get_market_history → run_calculation → submit_answer
Qwen
qwen/qwen3.8-flash
100.0strict pass
latency 437.5s · cost $0.0475
tool calls 20
Model answer
set · 7 items
AAPLAMDAMZNGOOGLJPMMSFTNVDA
Why this score
Gold has 7, the model returned 7: 7 correct → F1 100%. Strict pass.
gold 7 · returned 7 · correct 7 · false positives 0 · missed 0
precision 100.0% · recall 100.0% · F1 100.0% · strict pass
Tool calls (20)
list_metrics → search_equities → search_equities → search_equities → search_equities → get_equity_financials → get_equity_financials → get_equity_financials → get_equity_financials → get_equity_financials → run_calculation → get_market_history → run_calculation → run_calculation → run_calculation → run_calculation → get_equity_metrics → run_calculation → run_calculation → submit_answer
Gemini
google/gemini-3.8-flash
100.0strict pass
latency 286.4s · cost $0.6502
tool calls 33
Model answer
set · 7 items
AAPLAMDAMZNGOOGLJPMMSFTNVDA
Why this score
Gold has 7, the model returned 7: 7 correct → F1 100%. Strict pass.
gold 7 · returned 7 · correct 7 · false positives 0 · missed 0
precision 100.0% · recall 100.0% · F1 100.0% · strict pass
Tool calls (33)
list_metrics → search_equities → search_equities → get_market_history → get_equity_financials → run_calculation → search_equities → search_equities → search_equities → run_calculation → run_calculation → get_market_history → get_market_history → get_market_history → get_market_history → run_calculation → run_calculation → get_equity_financials → get_equity_financials → run_calculation → get_equity_financials → run_calculation → get_equity_financials → run_calculation → get_equity_financials → run_calculation → get_equity_financials → get_equity_financials → run_calculation → run_calculation✗ → run_calculation → run_calculation → submit_answer
Z.ai
z-ai/glm-5.3-flash
100.0strict pass
latency 1328.2s · cost $0.0581
tool calls 14
Model answer
set · 7 items
AAPLAMDAMZNGOOGLJPMMSFTNVDA
Why this score
Gold has 7, the model returned 7: 7 correct → F1 100%. Strict pass.
gold 7 · returned 7 · correct 7 · false positives 0 · missed 0
precision 100.0% · recall 100.0% · F1 100.0% · strict pass
Tool calls (14)
list_metrics → search_equities → search_equities → search_equities → search_equities → get_equity_financials → get_equity_financials → get_equity_financials → get_equity_financials → get_equity_financials → run_calculation → get_market_history → run_calculation → submit_answer
Grok
x-ai/grok-4.7
100.0strict pass
latency 97.0s · cost $0.5951
tool calls 13
Model answer
set · 7 items
AAPLAMDAMZNGOOGLJPMMSFTNVDA
Why this score
Gold has 7, the model returned 7: 7 correct → F1 100%. Strict pass.
gold 7 · returned 7 · correct 7 · false positives 0 · missed 0
precision 100.0% · recall 100.0% · F1 100.0% · strict pass
Tool calls (13)
list_metrics → search_equities → search_equities → search_equities → search_equities → get_equity_financials → get_equity_financials → get_equity_financials → get_equity_financials → run_calculation → get_market_history → run_calculation → submit_answer
Minimax
MiniMax M3
60.0not a strict pass
latency 1335.8s · cost $0.2920
tool calls 31
Model answer
set · 3 items
AAPLAMDAMZN
Why this score
Gold has 7, the model returned 3: 3 correct, 4 missed → F1 60%. Not a strict pass.
gold 7 · returned 3 · correct 3 · false positives 0 · missed 4
precision 100.0% · recall 42.9% · F1 60.0% · not a strict pass
−GOOGL−JPM−MSFT−NVDA
Tool calls (31)
list_metrics → search_equities → run_calculation → search_equities → search_equities → search_equities → run_calculation → get_market_history → get_market_history → get_market_history → get_market_history → get_market_history → get_market_history → get_market_history → get_market_history → run_calculation → run_calculation → get_equity_financials✗ → get_equity_financials → get_equity_financials✗ → get_equity_financials✗ → get_equity_financials✗ → get_equity_financials✗ → get_equity_financials✗ → run_calculation → get_equity_financials → get_equity_financials → get_equity_financials → run_calculation → run_calculation → submit_answer