← Leaderboard · task_1e6987c2909e9cb00bd90e10
S-EQ09-X · Moving Average Cross (EMA20 above EMA50 today) — plus one more hidden conditionMarket & SignalSignal detectionEquitySETHARDpublic example
Question
A cross means EMA20 > EMA50 today while EMA20 <= EMA50 on the previous session (EMAs on split-adjusted closes, SMA-seeded). Find US-listed common equities (instruments without a reported market cap — warrants, units, rights, preferred series, notes — are not in the universe) with market cap greater than $1B, 20-day average dollar volume greater than $20M, EMA20 crossing above EMA50 today, 60-day return greater than 0%. Scope: only entities with a known value for 20-day average dollar volume, EMA20 crossing above EMA50 today, 60-day return in the snapshot; entities lacking any of them are out of scope and must not be returned. Return every matching ticker; order does not matter.
Rebuild policy: metrics that are not served as fields (fundamental ratios, growth rates, valuation, technical signals) must be recomputed by you from the raw facts and daily bars the tools serve, following the definitions in list_metrics.compute_yourself to the letter (period selection, latest-filing copy, quarter arithmetic); do the arithmetic with run_calculation over the fetched data. The reference answer was computed from the same facts by the same definitions.
Data as of 2026-09-10 · grader set_f1
Expected / gold answer
set · 1 items
META
Computed by code from the frozen snapshot and verified by an independent recomputation before the batch was frozen. No model ever saw it.
Model answers (8)
Model answer
set · 1 items
META
Why this score
Gold has 1, the model returned 1: 1 correct → F1 100%. Strict pass.
gold 1 · returned 1 · correct 1 · false positives 0 · missed 0
precision 100.0% · recall 100.0% · F1 100.0% · strict pass
precision 100.0% · recall 100.0% · F1 100.0% · strict pass
Tool calls (26)
list_metrics → search_equities → search_equities → search_equities → search_equities → search_equities → search_equities → search_equities → search_equities → search_equities → search_equities → run_calculation → get_market_history → get_market_history → get_market_history → get_market_history → get_market_history → get_market_history → run_calculation → run_calculation → run_calculation → run_calculation → run_calculation → run_calculation → run_calculation → submit_answer
deepseek/deepseek-v4.1-flash
tool calls 29
100.0strict pass
budget exhausted → forced answer
latency 313.6s · cost $0.0175tool calls 29
Model answer
set · 1 items
META
Why this score
Budget ran out and the answer was forced. Gold has 1, the model returned 1: 1 correct → F1 100%. Strict pass.
gold 1 · returned 1 · correct 1 · false positives 0 · missed 0
precision 100.0% · recall 100.0% · F1 100.0% · strict pass
precision 100.0% · recall 100.0% · F1 100.0% · strict pass
Tool calls (29)
list_metrics → search_equities → search_equities → search_equities → search_equities → search_equities → search_equities → search_equities → search_equities → search_equities → search_equities → search_equities → get_market_history → get_market_history → get_market_history → search_equities → get_market_history → get_market_history → get_market_history → get_market_history → get_market_history → run_calculation → run_calculation → run_calculation → run_calculation → run_calculation → run_calculation → run_calculation → submit_answer
Model answer
set · 1 items
META
Why this score
Gold has 1, the model returned 1: 1 correct → F1 100%. Strict pass.
gold 1 · returned 1 · correct 1 · false positives 0 · missed 0
precision 100.0% · recall 100.0% · F1 100.0% · strict pass
precision 100.0% · recall 100.0% · F1 100.0% · strict pass
Tool calls (20)
list_metrics → search_equities → search_equities → search_equities → search_equities → search_equities → search_equities → search_equities → search_equities → search_equities → search_equities → run_calculation → get_market_history → get_market_history → get_market_history → get_market_history → get_market_history → get_market_history → run_calculation → submit_answer
Model answer
set · 1 items
META
Why this score
Gold has 1, the model returned 1: 1 correct → F1 100%. Strict pass.
gold 1 · returned 1 · correct 1 · false positives 0 · missed 0
precision 100.0% · recall 100.0% · F1 100.0% · strict pass
precision 100.0% · recall 100.0% · F1 100.0% · strict pass
Tool calls (28)
get_equity_metrics → list_metrics → search_equities → get_market_history → search_equities → search_equities → search_equities → search_equities → search_equities → search_equities → search_equities → search_equities → search_equities → search_equities → get_market_history → get_market_history → get_market_history → get_market_history → get_market_history → get_market_history → get_market_history → get_market_history → get_market_history → get_market_history → run_calculation → run_calculation → get_equity_metrics → submit_answer
google/gemini-3.8-flash
tool calls 42
100.0strict pass
budget exhausted → forced answer
latency 305.7s · cost $0.5997tool calls 42
Model answer
set · 1 items
META
Why this score
Budget ran out and the answer was forced. Gold has 1, the model returned 1: 1 correct → F1 100%. Strict pass.
gold 1 · returned 1 · correct 1 · false positives 0 · missed 0
precision 100.0% · recall 100.0% · F1 100.0% · strict pass
precision 100.0% · recall 100.0% · F1 100.0% · strict pass
Tool calls (42)
list_metrics → search_equities → search_equities → run_calculation → get_market_history → get_market_history → run_calculation → search_equities → get_equity_metrics → get_market_history → run_calculation → get_market_history → run_calculation → search_equities → run_calculation → search_equities → search_equities → run_calculation✗ → run_calculation → search_equities → get_market_history → search_equities → search_equities → search_equities → search_equities → search_equities → run_calculation → get_market_history → run_calculation → run_calculation → get_market_history → run_calculation → get_market_history → run_calculation → get_market_history → run_calculation → get_market_history → run_calculation → get_market_history → run_calculation → get_equity_metrics → submit_answer
Model answer
set · 1 items
META
Why this score
Gold has 1, the model returned 1: 1 correct → F1 100%. Strict pass.
gold 1 · returned 1 · correct 1 · false positives 0 · missed 0
precision 100.0% · recall 100.0% · F1 100.0% · strict pass
precision 100.0% · recall 100.0% · F1 100.0% · strict pass
Tool calls (22)
list_metrics → search_equities → search_equities → search_equities → search_equities → search_equities → search_equities → search_equities → search_equities → search_equities → search_equities → run_calculation → get_market_history → get_market_history → get_market_history → get_market_history → get_market_history → run_calculation → run_calculation → run_calculation → run_calculation → submit_answer
Model answer
set · 1 items
META
Why this score
Gold has 1, the model returned 1: 1 correct → F1 100%. Strict pass.
gold 1 · returned 1 · correct 1 · false positives 0 · missed 0
precision 100.0% · recall 100.0% · F1 100.0% · strict pass
precision 100.0% · recall 100.0% · F1 100.0% · strict pass
Tool calls (28)
list_metrics → search_equities → search_equities → search_equities → search_equities → search_equities → search_equities → search_equities → search_equities → search_equities → search_equities → run_calculation → run_calculation → get_market_history✗ → get_market_history✗ → get_market_history✗ → get_market_history✗ → run_calculation → get_market_history → get_market_history → get_market_history → get_market_history → get_market_history → get_market_history → run_calculation → run_calculation → run_calculation → submit_answer
Model answer
set · 3 items
CRCSIGHLF
Why this score
Gold has 1, the model returned 3: 0 correct, 3 false positives, 1 missed → F1 0%. Not a strict pass.
gold 1 · returned 3 · correct 0 · false positives 3 · missed 1
precision 0.0% · recall 0.0% · F1 0.0% · not a strict pass
precision 0.0% · recall 0.0% · F1 0.0% · not a strict pass
+CRC+SIG+HLF−META
Tool calls (26)
list_metrics → search_equities → search_equities → search_equities → search_equities → search_equities → search_equities → search_equities → search_equities → search_equities → search_equities → run_calculation → get_market_history → run_calculation → get_market_history → run_calculation → run_calculation✗ → run_calculation → get_market_history → run_calculation → get_market_history → run_calculation → run_calculation → run_calculation → get_equity_metrics → submit_answer