← Leaderboard · task_05f9688417911b0ad6882501
S-CR18-A · Perp RSI Range + Positive Trend — count, mean and median of a rebuilt metric over the matchesMarket & SignalDerived metricCrypto / PerpSTRUCTURED_FIELDSHARDpublic example

Question

Perpetual technicals use COMPLETED UTC daily bars only (Hyperliquid 1d candles). "The session" below means the last closed UTC session — its date is the row attribute last_closed_bar — never the bar still forming at snapshot time. RSI = 14-day Wilder RSI on daily closes, as of the session; trend alignment = the session's close > EMA20 > EMA50 (EMAs of daily closes). Open interest (USD) is taken at snapshot time, not at the session close. Find Hyperliquid perpetual markets with open interest greater than $20M, perp rsi 14 between 55 and 70, perp trend alignment. Scope: only entities with a known value for perp rsi 14, perp trend alignment in the snapshot; entities lacking any of them are out of scope and must not be returned. For the set of ALL entities that match the conditions above, report three numbers: count = how many match; mean = the arithmetic mean of Perp RSI14 (14-day Wilder RSI on daily closes.) across them; median = its median (middle value, or the mean of the two middle values for an even count). Give mean and median as a plain number in the metric's unit (index). Every matching entity's value must be rebuilt exactly — one wrong value moves the mean. Rebuild policy: metrics that are not served as fields (fundamental ratios, growth rates, valuation, technical signals) must be recomputed by you from the raw facts and daily bars the tools serve, following the definitions in list_metrics.compute_yourself to the letter (period selection, latest-filing copy, quarter arithmetic); do the arithmetic with run_calculation over the fetched data. The reference answer was computed from the same facts by the same definitions.
Data as of 2026-09-10 · grader structured_fields

Expected / gold answer

count16 (16 count)
mean59.46 (59.458603264900766 index)
median60.07 (60.06722393736296 index)

Computed by code from the frozen snapshot and verified by an independent recomputation before the batch was frozen. No model ever saw it.

Model answers (8)

XiaomiMiMo
xiaomi/mimo-v2.6-flash
100.0strict pass
latency 164.4s · cost $0.0070
tool calls 9
Model answer
count16 (16)
mean59.46 (59.458603264900766)
median60.07 (60.06722393736296)
Why this score
All 3 fields correct.
passed weight 3 / 3
fieldweightmust passresultdetail
count1✓
expected 16 · got 16 · error 0.0% · within tolerance
mean1✓
expected 59.458603264900766 · got 59.458603264900766 · error 0.0% · within tolerance
median1✓
expected 60.06722393736296 · got 60.06722393736296 · error 0.0% · within tolerance
Tool calls (9)
list_metrics → search_perps → get_perp_history → run_calculation → run_calculation → run_calculation → run_calculation → get_perp_history → submit_answer
DeepSeek
deepseek/deepseek-v4.1-flash
100.0strict pass
latency 43.0s · cost $0.0340
tool calls 6
Model answer
count16 (16)
mean59.46 (59.458603264900766)
median60.07 (60.06722393736296)
Why this score
All 3 fields correct.
passed weight 3 / 3
fieldweightmust passresultdetail
count1✓
expected 16 · got 16 · error 0.0% · within tolerance
mean1✓
expected 59.458603264900766 · got 59.458603264900766 · error 0.0% · within tolerance
median1✓
expected 60.06722393736296 · got 60.06722393736296 · error 0.0% · within tolerance
Tool calls (6)
list_metrics → search_perps → get_perp_history → run_calculation → run_calculation → submit_answer
Anthropic
Claude Opus 5.5
100.0strict pass
latency 27.7s · cost $0.3149
tool calls 5
Model answer
count16 (16)
mean59.46 (59.4586)
median60.07 (60.0672)
Why this score
All 3 fields correct.
passed weight 3 / 3
fieldweightmust passresultdetail
count1✓
expected 16 · got 16 · error 0.0% · within tolerance
mean1✓
expected 59.458603264900766 · got 59.4586 · error 0.0% · within tolerance
median1✓
expected 60.06722393736296 · got 60.0672 · error 0.0% · within tolerance
Tool calls (5)
list_metrics → search_perps → get_perp_history → run_calculation → submit_answer
Qwen
qwen/qwen3.8-flash
100.0strict pass
latency 74.6s · cost $0.0064
tool calls 7
Model answer
count16 (16)
mean59.46 (59.458603264900766)
median60.07 (60.06722393736296)
Why this score
All 3 fields correct.
passed weight 3 / 3
fieldweightmust passresultdetail
count1✓
expected 16 · got 16 · error 0.0% · within tolerance
mean1✓
expected 59.458603264900766 · got 59.458603264900766 · error 0.0% · within tolerance
median1✓
expected 60.06722393736296 · got 60.06722393736296 · error 0.0% · within tolerance
Tool calls (7)
list_metrics → search_perps → get_perp_history → run_calculation → run_calculation✗ → run_calculation → submit_answer
Gemini
google/gemini-3.8-flash
100.0strict pass
latency 40.1s · cost $0.0580
tool calls 9
Model answer
count16 (16)
mean59.46 (59.4586032649008)
median60.07 (60.067223937363)
Why this score
All 3 fields correct.
passed weight 3 / 3
fieldweightmust passresultdetail
count1✓
expected 16 · got 16 · error 0.0% · within tolerance
mean1✓
expected 59.458603264900766 · got 59.4586032649008 · error 0.0% · within tolerance
median1✓
expected 60.06722393736296 · got 60.067223937363 · error 0.0% · within tolerance
Tool calls (9)
list_metrics → search_perps → get_perp_history → run_calculation → get_perp_history → run_calculation → run_calculation → run_calculation → submit_answer
Z.ai
z-ai/glm-5.3-flash
100.0strict pass
latency 249.0s · cost $0.0109
tool calls 6
Model answer
count16 (16)
mean59.46 (59.4586)
median60.07 (60.0672)
Why this score
All 3 fields correct.
passed weight 3 / 3
fieldweightmust passresultdetail
count1✓
expected 16 · got 16 · error 0.0% · within tolerance
mean1✓
expected 59.458603264900766 · got 59.4586 · error 0.0% · within tolerance
median1✓
expected 60.06722393736296 · got 60.0672 · error 0.0% · within tolerance
Tool calls (6)
list_metrics → search_perps → get_perp_history → run_calculation → run_calculation → submit_answer
Grok
x-ai/grok-4.7
100.0strict pass
latency 49.0s · cost $0.1307
tool calls 7
Model answer
count16 (16)
mean59.46 (59.458603264900766)
median60.07 (60.06722393736296)
Why this score
All 3 fields correct.
passed weight 3 / 3
fieldweightmust passresultdetail
count1✓
expected 16 · got 16 · error 0.0% · within tolerance
mean1✓
expected 59.458603264900766 · got 59.458603264900766 · error 0.0% · within tolerance
median1✓
expected 60.06722393736296 · got 60.06722393736296 · error 0.0% · within tolerance
Tool calls (7)
list_metrics → search_perps → get_perp_history → run_calculation → get_perp_history → run_calculation → submit_answer
Minimax
MiniMax M3
100.0strict pass
latency 28.1s · cost $0.0091
tool calls 6
Model answer
count16 (16)
mean59.46 (59.458603264900766)
median60.07 (60.06722393736296)
Why this score
All 3 fields correct.
passed weight 3 / 3
fieldweightmust passresultdetail
count1✓
expected 16 · got 16 · error 0.0% · within tolerance
mean1✓
expected 59.458603264900766 · got 59.458603264900766 · error 0.0% · within tolerance
median1✓
expected 60.06722393736296 · got 60.06722393736296 · error 0.0% · within tolerance
Tool calls (6)
list_metrics → search_perps → get_perp_history → run_calculation → run_calculation → submit_answer