← Leaderboard · task_53b187cfb46ad017707289b9
S-EQ25-XX · Growth + Valuation (trailing P/E as a proxy for EV/Sales) — plus two more hidden conditionsMarket & SignalScreeningEquitySETHARDproxy of PRD S-EQ25 growth + EV/Sales valuation screenpublic example
Question
Fundamental ratios are not served as fields: rebuild each one from the raw SEC facts (get_equity_financials) exactly as defined in list_metrics.compute_yourself, using the latest filing at or before the data cutoff; a company whose filings lack the needed facts is out of scope. P/E here is market cap divided by trailing-twelve-month net income — the sum of the four latest single fiscal quarters of net_income from the filings (latest filing copy per quarter, consecutive quarters); names whose TTM net income is not positive have no P/E and are excluded. Find US-listed common equities (instruments without a reported market cap — warrants, units, rights, preferred series, notes — are not in the universe) with market cap greater than $10B, 20-day average dollar volume greater than $100M, latest-quarter revenue growth (YoY) greater than 20%, P/E (market cap / trailing-twelve-month net income from the filings) less than 30, 60-day return greater than 0%, turnover ratio greater than 0.002%. Scope: only entities with a known value for 20-day average dollar volume, latest-quarter revenue growth (YoY), P/E (market cap / trailing-twelve-month net income from the filings), 60-day return, turnover ratio in the snapshot; entities lacking any of them are out of scope and must not be returned. Return every matching ticker; order does not matter.
Filing-version policy: every financial value is taken from the LATEST filing accepted by the SEC at or before the data cutoff that reports the requested period. If a later filing (before the cutoff) restates an earlier period, the restated value is the answer; the original filing's value is not. A fiscal-year value is taken only from an annual report (10-K / 20-F / 40-F, including amendments) — a quarterly report never supplies an annual value.
Rebuild policy: metrics that are not served as fields (fundamental ratios, growth rates, valuation, technical signals) must be recomputed by you from the raw facts and daily bars the tools serve, following the definitions in list_metrics.compute_yourself to the letter (period selection, latest-filing copy, quarter arithmetic); do the arithmetic with run_calculation over the fetched data. The reference answer was computed from the same facts by the same definitions.
Data as of 2026-09-10 · grader set_f1
Expected / gold answer
set · 21 items
AMCRARBLKBROCDECEGCPAYEOGEQTETEXEGENINCYKKRMETANEMNVDAPTCSMCITWVG
Computed by code from the frozen snapshot and verified by an independent recomputation before the batch was frozen. No model ever saw it.
Model answers (8)
Model answer
set · 21 items
AMCRARBLKBROCDECEGCPAYEOGEQTETEXEGENINCYKKRMETANEMNVDAPTCSMCITWVG
Why this score
Gold has 21, the model returned 21: 21 correct → F1 100%. Strict pass.
gold 21 · returned 21 · correct 21 · false positives 0 · missed 0
precision 100.0% · recall 100.0% · F1 100.0% · strict pass
precision 100.0% · recall 100.0% · F1 100.0% · strict pass
Tool calls (26)
list_metrics → search_equities → search_equities → search_equities → search_equities → run_calculation → get_market_history → run_calculation → get_equity_financials → get_equity_financials → run_calculation → get_equity_financials → run_calculation✗ → run_calculation✗ → run_calculation → run_calculation → run_calculation → run_calculation → search_equities → search_equities → run_calculation → run_calculation → run_calculation✗ → run_calculation → get_equity_financials → submit_answer
Model answer
set · 21 items
AMCRARBLKBROCDECEGCPAYEOGEQTETEXEGENINCYKKRMETANEMNVDAPTCSMCITWVG
Why this score
Gold has 21, the model returned 21: 21 correct → F1 100%. Strict pass.
gold 21 · returned 21 · correct 21 · false positives 0 · missed 0
precision 100.0% · recall 100.0% · F1 100.0% · strict pass
precision 100.0% · recall 100.0% · F1 100.0% · strict pass
Tool calls (27)
list_metrics → search_equities → search_equities → search_equities → search_equities → get_market_history → get_equity_financials → get_equity_financials → get_equity_financials → get_equity_financials → run_calculation → run_calculation → run_calculation✗ → run_calculation → get_equity_financials✗ → get_equity_financials → get_equity_financials → get_equity_financials → get_equity_financials → run_calculation → run_calculation → run_calculation → list_metrics → run_calculation → run_calculation → run_calculation → submit_answer
Model answer
set · 21 items
AMCRARBLKBROCDECEGCPAYEOGEQTETEXEGENINCYKKRMETANEMNVDAPTCSMCITWVG
Why this score
Gold has 21, the model returned 21: 21 correct → F1 100%. Strict pass.
gold 21 · returned 21 · correct 21 · false positives 0 · missed 0
precision 100.0% · recall 100.0% · F1 100.0% · strict pass
precision 100.0% · recall 100.0% · F1 100.0% · strict pass
Tool calls (16)
list_metrics → search_equities → search_equities → search_equities → search_equities → get_market_history → run_calculation → run_calculation → get_market_history → get_market_history → run_calculation → run_calculation → get_equity_financials → get_equity_financials → run_calculation → submit_answer
qwen/qwen3.8-flash
tool calls 33
100.0strict pass
budget exhausted → forced answer
latency 1015.0s · cost $0.1036tool calls 33
Model answer
set · 21 items
ARBLKBROCDECEGCPAYEOGEQTETEXEGENINCYKKRMETANEMNVDAPTCSMCITWVGAMCR
Why this score
Budget ran out and the answer was forced. Gold has 21, the model returned 21: 21 correct → F1 100%. Strict pass.
gold 21 · returned 21 · correct 21 · false positives 0 · missed 0
precision 100.0% · recall 100.0% · F1 100.0% · strict pass
precision 100.0% · recall 100.0% · F1 100.0% · strict pass
Tool calls (33)
list_metrics → search_equities → search_equities → search_equities → search_equities → get_equity_financials → get_equity_financials → run_calculation → run_calculation → get_market_history → run_calculation → get_market_history → run_calculation → get_equity_financials✗ → get_equity_financials✗ → get_equity_financials → run_calculation → search_equities → search_equities → search_equities → run_calculation✗ → run_calculation → get_equity_financials → get_equity_financials → run_calculation✗ → run_calculation✗ → run_calculation → run_calculation → run_calculation → run_calculation → run_calculation → run_calculation → submit_answer
Model answer
set · 21 items
AMCRARBLKBROCDECEGCPAYEOGEQTETEXEGENINCYKKRMETANEMNVDAPTCSMCITWVG
Why this score
Gold has 21, the model returned 21: 21 correct → F1 100%. Strict pass.
gold 21 · returned 21 · correct 21 · false positives 0 · missed 0
precision 100.0% · recall 100.0% · F1 100.0% · strict pass
precision 100.0% · recall 100.0% · F1 100.0% · strict pass
Tool calls (44)
list_metrics → search_equities → search_equities → search_equities → search_equities → run_calculation → get_market_history → run_calculation → run_calculation → run_calculation → run_calculation → get_equity_financials✗ → get_equity_financials✗ → get_equity_financials✗ → run_calculation✗ → run_calculation → run_calculation → get_equity_financials → get_equity_financials → run_calculation → run_calculation → run_calculation → run_calculation → get_equity_financials → run_calculation → get_equity_financials → run_calculation → run_calculation → run_calculation → get_equity_financials → get_equity_financials → run_calculation → run_calculation → run_calculation → run_calculation → run_calculation → run_calculation → get_equity_financials → run_calculation → run_calculation → run_calculation → run_calculation → run_calculation → submit_answer
Model answer
set · 20 items
AMCRARBLKBROCDECEGCPAYEOGEQTETEXEGENINCYKKRMETANEMPTCSMCITWVG
Why this score
Gold has 21, the model returned 20: 20 correct, 1 missed → F1 98%. Not a strict pass.
gold 21 · returned 20 · correct 20 · false positives 0 · missed 1
precision 100.0% · recall 95.2% · F1 97.6% · not a strict pass
precision 100.0% · recall 95.2% · F1 97.6% · not a strict pass
−NVDA
Tool calls (33)
list_metrics → search_equities → get_market_history → search_equities → search_equities → search_equities → run_calculation → search_equities → search_equities → search_equities → search_equities → search_equities → search_equities → search_equities → run_calculation → run_calculation → get_market_history → get_market_history → get_market_history → get_market_history → run_calculation → run_calculation✗ → run_calculation → get_equity_financials → get_equity_financials → get_equity_financials → run_calculation → run_calculation✗ → run_calculation → run_calculation → get_equity_metrics → run_calculation → submit_answer
Model answer
set · 20 items
AMCRARBLKBROCDECEGCPAYEOGEQTETEXEGENINCYKKRMETANEMPTCSMCITWVG
Why this score
Gold has 21, the model returned 20: 20 correct, 1 missed → F1 98%. Not a strict pass.
gold 21 · returned 20 · correct 20 · false positives 0 · missed 1
precision 100.0% · recall 95.2% · F1 97.6% · not a strict pass
precision 100.0% · recall 95.2% · F1 97.6% · not a strict pass
−NVDA
Tool calls (17)
list_metrics → search_equities → search_equities → search_equities → search_equities → run_calculation → get_market_history → run_calculation → get_equity_financials → get_equity_financials✗ → get_equity_financials✗ → get_equity_financials → get_equity_financials → run_calculation → run_calculation → run_calculation → submit_answer
Model answer
set · 20 items
AMCRARBLKBROCDECEGCPAYEOGEQTETEXEGENINCYKKRMETANEMPTCSMCITWVG
Why this score
Gold has 21, the model returned 20: 20 correct, 1 missed → F1 98%. Not a strict pass.
gold 21 · returned 20 · correct 20 · false positives 0 · missed 1
precision 100.0% · recall 95.2% · F1 97.6% · not a strict pass
precision 100.0% · recall 95.2% · F1 97.6% · not a strict pass
−NVDA
Tool calls (13)
list_metrics → search_equities → search_equities → search_equities → search_equities → get_equity_financials → get_equity_financials → get_equity_financials → get_equity_financials → run_calculation → get_market_history → run_calculation → submit_answer