← Leaderboard · task_4779a1375d7aa96256182d9a
F15 · Peer Comparison (growth ranking)Financial AnalysisComparison / TrendFinancial filingsRANKED_SETHARDpublic example

Question

Rank NVDA, AMD, CRWD, PANW, TSLA, META from highest to lowest full-year revenue growth from fiscal year 2024 to fiscal year 2025. Answer with the tickers in order, best first. Filing-version policy: every financial value is taken from the LATEST filing accepted by the SEC at or before the data cutoff that reports the requested period. If a later filing (before the cutoff) restates an earlier period, the restated value is the answer; the original filing's value is not. A fiscal-year value is taken only from an annual report (10-K / 20-F / 40-F, including amendments) — a quarterly report never supplies an annual value.
Data as of 2026-09-10 · grader ranking_match

Expected / gold answer

ranked · 6 items
1. NVDA2. AMD3. CRWD4. META5. PANW6. TSLA

Computed by code from the frozen snapshot and verified by an independent recomputation before the batch was frozen. No model ever saw it.

Model answers (8)

XiaomiMiMo
xiaomi/mimo-v2.6-flash
100.0strict pass
latency 156.1s · cost $0.0017
tool calls 4
Model answer
ranked · 6 items
1. NVDA2. AMD3. CRWD4. META5. PANW6. TSLA
Why this score
Order graded by pairwise over the top 6: 1.00.
method pairwise · k 6 · value 1.000
gold order: NVDA › AMD › CRWD › META › PANW › TSLA
got order: NVDA › AMD › CRWD › META › PANW › TSLA
Tool calls (4)
list_metrics → get_equity_financials → run_calculation → submit_answer
DeepSeek
deepseek/deepseek-v4.1-flash
100.0strict pass
latency 17.6s · cost $0.0121
tool calls 4
Model answer
ranked · 6 items
1. NVDA2. AMD3. CRWD4. META5. PANW6. TSLA
Why this score
Order graded by pairwise over the top 6: 1.00.
method pairwise · k 6 · value 1.000
gold order: NVDA › AMD › CRWD › META › PANW › TSLA
got order: NVDA › AMD › CRWD › META › PANW › TSLA
Tool calls (4)
list_metrics → get_equity_financials → run_calculation → submit_answer
Anthropic
Claude Opus 5.5
100.0strict pass
latency 13.5s · cost $0.0992
tool calls 2
Model answer
ranked · 6 items
1. NVDA2. AMD3. CRWD4. META5. PANW6. TSLA
Why this score
Order graded by pairwise over the top 6: 1.00.
method pairwise · k 6 · value 1.000
gold order: NVDA › AMD › CRWD › META › PANW › TSLA
got order: NVDA › AMD › CRWD › META › PANW › TSLA
Tool calls (2)
get_equity_financials → submit_answer
Qwen
qwen/qwen3.8-flash
100.0strict pass
latency 38.5s · cost $0.0024
tool calls 5
Model answer
ranked · 6 items
1. NVDA2. AMD3. CRWD4. META5. PANW6. TSLA
Why this score
Order graded by pairwise over the top 6: 1.00.
method pairwise · k 6 · value 1.000
gold order: NVDA › AMD › CRWD › META › PANW › TSLA
got order: NVDA › AMD › CRWD › META › PANW › TSLA
Tool calls (5)
get_equity_financials → list_metrics → get_equity_financials → run_calculation → submit_answer
Gemini
google/gemini-3.8-flash
100.0strict pass
latency 13.8s · cost $0.0142
tool calls 3
Model answer
ranked · 6 items
1. NVDA2. AMD3. CRWD4. META5. PANW6. TSLA
Why this score
Order graded by pairwise over the top 6: 1.00.
method pairwise · k 6 · value 1.000
gold order: NVDA › AMD › CRWD › META › PANW › TSLA
got order: NVDA › AMD › CRWD › META › PANW › TSLA
Tool calls (3)
get_equity_financials → run_calculation → submit_answer
Z.ai
z-ai/glm-5.3-flash
100.0strict pass
latency 58.1s · cost $0.0026
tool calls 3
Model answer
ranked · 6 items
1. NVDA2. AMD3. CRWD4. META5. PANW6. TSLA
Why this score
Order graded by pairwise over the top 6: 1.00.
method pairwise · k 6 · value 1.000
gold order: NVDA › AMD › CRWD › META › PANW › TSLA
got order: NVDA › AMD › CRWD › META › PANW › TSLA
Tool calls (3)
get_equity_financials → run_calculation → submit_answer
Grok
x-ai/grok-4.7
100.0strict pass
latency 11.8s · cost $0.0404
tool calls 4
Model answer
ranked · 6 items
1. NVDA2. AMD3. CRWD4. META5. PANW6. TSLA
Why this score
Order graded by pairwise over the top 6: 1.00.
method pairwise · k 6 · value 1.000
gold order: NVDA › AMD › CRWD › META › PANW › TSLA
got order: NVDA › AMD › CRWD › META › PANW › TSLA
Tool calls (4)
list_metrics → get_equity_financials → run_calculation → submit_answer
Minimax
MiniMax M3
66.7not a strict pass
latency 86.1s · cost $0.0113
tool calls 10
Model answer
ranked · 5 items
1. NVDA2. AMD3. CRWD4. META5. PANW
Why this score
Order graded by pairwise over the top 6: 0.67.
method pairwise · k 6 · value 0.667
gold order: NVDA › AMD › CRWD › META › PANW › TSLA
got order: NVDA › AMD › CRWD › META › PANW
Tool calls (10)
list_metrics → get_equity_financials → get_equity_financials → get_equity_financials → run_calculation✗ → run_calculation✗ → run_calculation✗ → run_calculation → run_calculation → submit_answer
Status
FeedbackTwitterTelegram