← Leaderboard · task_50ff2f62c2f7a890dd6ba1f9
S-EQ11-A · RSI Range — count, mean and median of a rebuilt metric over the matchesMarket & SignalDerived metricEquitySTRUCTURED_FIELDSHARDpublic example

Question

RSI is the 14-session Wilder RSI on split-adjusted closes. Find US-listed common equities (instruments without a reported market cap — warrants, units, rights, preferred series, notes — are not in the universe) with market cap greater than $10B, 20-day average dollar volume greater than $300M, sector equal to Energy, RSI(14) between 60 and 65. Scope: only entities with a known value for 20-day average dollar volume, sector, RSI(14) in the snapshot; entities lacking any of them are out of scope and must not be returned. For the set of ALL entities that match the conditions above, report three numbers: count = how many match; mean = the arithmetic mean of RSI 14 (Wilder relative strength index over 14 sessions (SMA seed, then Wilder smoothing).) across them; median = its median (middle value, or the mean of the two middle values for an even count). Give mean and median as a plain number in the metric's unit (index). Every matching entity's value must be rebuilt exactly — one wrong value moves the mean. Rebuild policy: metrics that are not served as fields (fundamental ratios, growth rates, valuation, technical signals) must be recomputed by you from the raw facts and daily bars the tools serve, following the definitions in list_metrics.compute_yourself to the letter (period selection, latest-filing copy, quarter arithmetic); do the arithmetic with run_calculation over the fetched data. The reference answer was computed from the same facts by the same definitions.
Data as of 2026-09-10 · grader structured_fields

Expected / gold answer

count4 (4 count)
mean62.04 (62.04337860914674 index)
median61.51 (61.50949564570341 index)

Computed by code from the frozen snapshot and verified by an independent recomputation before the batch was frozen. No model ever saw it.

Model answers (8)

XiaomiMiMo
xiaomi/mimo-v2.6-flash
100.0strict pass
latency 172.3s · cost $0.0030
tool calls 5
Model answer
count4 (4)
mean62.04 (62.04337848093638)
median61.51 (61.509495389282705)
Why this score
All 3 fields correct.
passed weight 3 / 3
fieldweightmust passresultdetail
count1✓
expected 4 · got 4 · error 0.0% · within tolerance
mean1✓
expected 62.04337860914674 · got 62.04337848093638 · error 0.0% · within tolerance
median1✓
expected 61.50949564570341 · got 61.509495389282705 · error 0.0% · within tolerance
Tool calls (5)
list_metrics → search_equities → get_market_history → run_calculation → submit_answer
DeepSeek
deepseek/deepseek-v4.1-flash
100.0strict pass
latency 23.5s · cost $0.0304
tool calls 6
Model answer
count4 (4)
mean62.04 (62.04337848093638)
median61.51 (61.509495389282705)
Why this score
All 3 fields correct.
passed weight 3 / 3
fieldweightmust passresultdetail
count1✓
expected 4 · got 4 · error 0.0% · within tolerance
mean1✓
expected 62.04337860914674 · got 62.04337848093638 · error 0.0% · within tolerance
median1✓
expected 61.50949564570341 · got 61.509495389282705 · error 0.0% · within tolerance
Tool calls (6)
list_metrics → search_equities → get_market_history → run_calculation → run_calculation → submit_answer
Anthropic
Claude Opus 5.5
100.0strict pass
latency 25.4s · cost $0.3928
tool calls 5
Model answer
count4 (4)
mean62.04 (62.04337848093638)
median61.51 (61.509495389282705)
Why this score
All 3 fields correct.
passed weight 3 / 3
fieldweightmust passresultdetail
count1✓
expected 4 · got 4 · error 0.0% · within tolerance
mean1✓
expected 62.04337860914674 · got 62.04337848093638 · error 0.0% · within tolerance
median1✓
expected 61.50949564570341 · got 61.509495389282705 · error 0.0% · within tolerance
Tool calls (5)
list_metrics → search_equities → get_market_history → run_calculation → submit_answer
Qwen
qwen/qwen3.8-flash
100.0strict pass
latency 118.2s · cost $0.0051
tool calls 6
Model answer
count4 (4)
mean62.04 (62.04337848093638)
median61.51 (61.509495389282705)
Why this score
All 3 fields correct.
passed weight 3 / 3
fieldweightmust passresultdetail
count1✓
expected 4 · got 4 · error 0.0% · within tolerance
mean1✓
expected 62.04337860914674 · got 62.04337848093638 · error 0.0% · within tolerance
median1✓
expected 61.50949564570341 · got 61.509495389282705 · error 0.0% · within tolerance
Tool calls (6)
list_metrics → search_equities → get_market_history → run_calculation → run_calculation → submit_answer
Gemini
google/gemini-3.8-flash
100.0strict pass
latency 35.9s · cost $0.0544
tool calls 8
Model answer
median61.51 (61.5094953892827)
mean62.04 (62.0433784809364)
count4 (4)
Why this score
All 3 fields correct.
passed weight 3 / 3
fieldweightmust passresultdetail
count1✓
expected 4 · got 4 · error 0.0% · within tolerance
mean1✓
expected 62.04337860914674 · got 62.0433784809364 · error 0.0% · within tolerance
median1✓
expected 61.50949564570341 · got 61.5094953892827 · error 0.0% · within tolerance
Tool calls (8)
list_metrics → search_equities → get_market_history → run_calculation → get_market_history → run_calculation → run_calculation → submit_answer
Z.ai
z-ai/glm-5.3-flash
100.0strict pass
latency 77.8s · cost $0.0055
tool calls 6
Model answer
count4 (4)
mean62.04 (62.04146145369506)
median61.51 (61.50722203368299)
Why this score
All 3 fields correct.
passed weight 3 / 3
fieldweightmust passresultdetail
count1✓
expected 4 · got 4 · error 0.0% · within tolerance
mean1✓
expected 62.04337860914674 · got 62.04146145369506 · error 0.0% · within tolerance
median1✓
expected 61.50949564570341 · got 61.50722203368299 · error 0.0% · within tolerance
Tool calls (6)
list_metrics → search_equities → get_market_history → run_calculation → run_calculation → submit_answer
Grok
x-ai/grok-4.7
100.0strict pass
latency 16.6s · cost $0.0700
tool calls 5
Model answer
count4 (4)
mean62.04 (62.04337848093638)
median61.51 (61.509495389282705)
Why this score
All 3 fields correct.
passed weight 3 / 3
fieldweightmust passresultdetail
count1✓
expected 4 · got 4 · error 0.0% · within tolerance
mean1✓
expected 62.04337860914674 · got 62.04337848093638 · error 0.0% · within tolerance
median1✓
expected 61.50949564570341 · got 61.509495389282705 · error 0.0% · within tolerance
Tool calls (5)
list_metrics → search_equities → get_market_history → run_calculation → submit_answer
Minimax
MiniMax M3
100.0strict pass
latency 20.9s · cost $0.0107
tool calls 5
Model answer
count4 (4)
mean62.04 (62.04146145369506)
median61.51 (61.50722203368299)
Why this score
All 3 fields correct.
passed weight 3 / 3
fieldweightmust passresultdetail
count1✓
expected 4 · got 4 · error 0.0% · within tolerance
mean1✓
expected 62.04337860914674 · got 62.04146145369506 · error 0.0% · within tolerance
median1✓
expected 61.50949564570341 · got 61.50722203368299 · error 0.0% · within tolerance
Tool calls (5)
list_metrics → search_equities → get_market_history → run_calculation → submit_answer