← Leaderboard · task_06625840f1226d3d46e560e3
S-EQ05-X · First Breakout 20D — plus one more hidden conditionMarket & SignalSignal detectionEquitySETHARDpublic example
Question
A first breakout means today's close is above the highest high of the previous 20 complete sessions AND yesterday's close was not above its own previous 20-session high (split-adjusted). Find US-listed common equities (instruments without a reported market cap — warrants, units, rights, preferred series, notes — are not in the universe) with market cap greater than $10B, 20-day average dollar volume greater than $50M, the first close above the previous 20-day high (yesterday was not), relative volume (today / 20-day average) greater than 1.5, net margin (latest fiscal year) greater than 10%. Scope: only entities with a known value for 20-day average dollar volume, the first close above the previous 20-day high (yesterday was not), relative volume (today / 20-day average), net margin (latest fiscal year) in the snapshot; entities lacking any of them are out of scope and must not be returned. Return every matching ticker; order does not matter.
Filing-version policy: every financial value is taken from the LATEST filing accepted by the SEC at or before the data cutoff that reports the requested period. If a later filing (before the cutoff) restates an earlier period, the restated value is the answer; the original filing's value is not. A fiscal-year value is taken only from an annual report (10-K / 20-F / 40-F, including amendments) — a quarterly report never supplies an annual value.
Rebuild policy: metrics that are not served as fields (fundamental ratios, growth rates, valuation, technical signals) must be recomputed by you from the raw facts and daily bars the tools serve, following the definitions in list_metrics.compute_yourself to the letter (period selection, latest-filing copy, quarter arithmetic); do the arithmetic with run_calculation over the fetched data. The reference answer was computed from the same facts by the same definitions.
Data as of 2026-09-10 · grader set_f1
Expected / gold answer
set · 1 items
DVN
Computed by code from the frozen snapshot and verified by an independent recomputation before the batch was frozen. No model ever saw it.
Model answers (8)
Model answer
set · 1 items
DVN
Why this score
Gold has 1, the model returned 1: 1 correct → F1 100%. Strict pass.
gold 1 · returned 1 · correct 1 · false positives 0 · missed 0
precision 100.0% · recall 100.0% · F1 100.0% · strict pass
precision 100.0% · recall 100.0% · F1 100.0% · strict pass
Tool calls (15)
list_metrics → search_equities → search_equities → search_equities → search_equities → search_equities → run_calculation → get_market_history → run_calculation✗ → run_calculation → run_calculation → get_equity_financials → run_calculation → run_calculation → submit_answer
Model answer
set · 1 items
DVN
Why this score
Gold has 1, the model returned 1: 1 correct → F1 100%. Strict pass.
gold 1 · returned 1 · correct 1 · false positives 0 · missed 0
precision 100.0% · recall 100.0% · F1 100.0% · strict pass
precision 100.0% · recall 100.0% · F1 100.0% · strict pass
Tool calls (13)
list_metrics → search_equities → search_equities → search_equities → search_equities → search_equities → run_calculation → get_market_history → get_market_history → run_calculation → get_equity_financials → run_calculation → submit_answer
Model answer
set · 1 items
DVN
Why this score
Gold has 1, the model returned 1: 1 correct → F1 100%. Strict pass.
gold 1 · returned 1 · correct 1 · false positives 0 · missed 0
precision 100.0% · recall 100.0% · F1 100.0% · strict pass
precision 100.0% · recall 100.0% · F1 100.0% · strict pass
Tool calls (12)
list_metrics → search_equities → search_equities → search_equities → search_equities → search_equities → run_calculation → get_market_history → get_market_history → run_calculation → get_equity_financials → submit_answer
Model answer
set · 1 items
DVN
Why this score
Gold has 1, the model returned 1: 1 correct → F1 100%. Strict pass.
gold 1 · returned 1 · correct 1 · false positives 0 · missed 0
precision 100.0% · recall 100.0% · F1 100.0% · strict pass
precision 100.0% · recall 100.0% · F1 100.0% · strict pass
Tool calls (16)
list_metrics → search_equities → search_equities → search_equities → search_equities → search_equities → get_market_history → get_market_history → run_calculation → run_calculation → get_equity_financials → run_calculation → run_calculation → run_calculation → run_calculation → submit_answer
Model answer
set · 1 items
DVN
Why this score
Gold has 1, the model returned 1: 1 correct → F1 100%. Strict pass.
gold 1 · returned 1 · correct 1 · false positives 0 · missed 0
precision 100.0% · recall 100.0% · F1 100.0% · strict pass
precision 100.0% · recall 100.0% · F1 100.0% · strict pass
Tool calls (36)
list_metrics → search_equities → search_equities → search_equities → search_equities → search_equities → search_equities → run_calculation → get_market_history✗ → run_calculation → run_calculation✗ → run_calculation → run_calculation → run_calculation → run_calculation → get_market_history → run_calculation → run_calculation → run_calculation → get_market_history✗ → get_market_history → run_calculation → get_market_history → run_calculation → get_market_history → run_calculation → get_market_history → run_calculation → get_market_history → run_calculation → get_equity_metrics → get_equity_financials → run_calculation → run_calculation → get_equity_metrics → submit_answer
Model answer
set · 1 items
DVN
Why this score
Gold has 1, the model returned 1: 1 correct → F1 100%. Strict pass.
gold 1 · returned 1 · correct 1 · false positives 0 · missed 0
precision 100.0% · recall 100.0% · F1 100.0% · strict pass
precision 100.0% · recall 100.0% · F1 100.0% · strict pass
Tool calls (12)
list_metrics → search_equities → search_equities → search_equities → search_equities → search_equities → get_market_history → get_market_history → run_calculation → get_equity_financials → run_calculation → submit_answer
Model answer
set · 1 items
DVN
Why this score
Gold has 1, the model returned 1: 1 correct → F1 100%. Strict pass.
gold 1 · returned 1 · correct 1 · false positives 0 · missed 0
precision 100.0% · recall 100.0% · F1 100.0% · strict pass
precision 100.0% · recall 100.0% · F1 100.0% · strict pass
Tool calls (17)
list_metrics → search_equities → search_equities → search_equities → search_equities → search_equities → run_calculation → get_market_history → run_calculation✗ → run_calculation → get_equity_financials → run_calculation → run_calculation → run_calculation → run_calculation✗ → run_calculation → submit_answer
Model answer
set · 2 items
DVNELV
Why this score
Gold has 1, the model returned 2: 1 correct, 1 false positive → F1 67%. Not a strict pass.
gold 1 · returned 2 · correct 1 · false positives 1 · missed 0
precision 50.0% · recall 100.0% · F1 66.7% · not a strict pass
precision 50.0% · recall 100.0% · F1 66.7% · not a strict pass
+ELV
Tool calls (14)
list_metrics → search_equities → search_equities → search_equities → search_equities → search_equities → get_market_history → get_market_history → get_market_history → get_market_history → get_market_history → run_calculation → get_equity_financials → submit_answer