← Leaderboard · task_46205c1336677ef0c065e6a6
F05-R10 · CAGR — ten companies rankedFinancial AnalysisCalculationFinancial filingsRANKED_SETHARDpublic example

Question

For each of these ten companies — MSFT, META, JPM, GOOGL, PANW, NVDA, TSLA, AAPL, AMZN, COST — answer the same question: "What was the compound annual growth rate (CAGR) of the company's full-year revenue from fiscal year 2022 to fiscal year 2024 (2-year span)? Answer as a decimal ratio." Then rank the ten tickers by that value, highest first (all ten have the required filings). Return the ten tickers in order; order is graded. Filing-version policy: every financial value is taken from the LATEST filing accepted by the SEC at or before the data cutoff that reports the requested period. If a later filing (before the cutoff) restates an earlier period, the restated value is the answer; the original filing's value is not. A fiscal-year value is taken only from an annual report (10-K / 20-F / 40-F, including amendments) — a quarterly report never supplies an annual value.
Data as of 2026-09-10 · grader ranking_match

Expected / gold answer

ranked · 10 items
1. NVDA2. PANW3. META4. JPM5. AMZN6. GOOGL7. MSFT8. TSLA9. COST10. AAPL

Computed by code from the frozen snapshot and verified by an independent recomputation before the batch was frozen. No model ever saw it.

Model answers (8)

XiaomiMiMo
xiaomi/mimo-v2.6-flash
100.0strict pass
latency 195.4s · cost $0.0028
tool calls 4
Model answer
ranked · 10 items
1. NVDA2. PANW3. META4. JPM5. AMZN6. GOOGL7. MSFT8. TSLA9. COST10. AAPL
Why this score
Order graded by pairwise over the top 10: 1.00.
method pairwise · k 10 · value 1.000
gold order: NVDA › PANW › META › JPM › AMZN › GOOGL › MSFT › TSLA › COST › AAPL
got order: NVDA › PANW › META › JPM › AMZN › GOOGL › MSFT › TSLA › COST › AAPL
Tool calls (4)
list_metrics → get_equity_financials → run_calculation → submit_answer
DeepSeek
deepseek/deepseek-v4.1-flash
100.0strict pass
latency 15.7s · cost $0.0131
tool calls 4
Model answer
ranked · 10 items
1. NVDA2. PANW3. META4. JPM5. AMZN6. GOOGL7. MSFT8. TSLA9. COST10. AAPL
Why this score
Order graded by pairwise over the top 10: 1.00.
method pairwise · k 10 · value 1.000
gold order: NVDA › PANW › META › JPM › AMZN › GOOGL › MSFT › TSLA › COST › AAPL
got order: NVDA › PANW › META › JPM › AMZN › GOOGL › MSFT › TSLA › COST › AAPL
Tool calls (4)
list_metrics → get_equity_financials → run_calculation → submit_answer
Anthropic
Claude Opus 5.5
100.0strict pass
latency 16.7s · cost $0.1314
tool calls 2
Model answer
ranked · 10 items
1. NVDA2. PANW3. META4. JPM5. AMZN6. GOOGL7. MSFT8. TSLA9. COST10. AAPL
Why this score
Order graded by pairwise over the top 10: 1.00.
method pairwise · k 10 · value 1.000
gold order: NVDA › PANW › META › JPM › AMZN › GOOGL › MSFT › TSLA › COST › AAPL
got order: NVDA › PANW › META › JPM › AMZN › GOOGL › MSFT › TSLA › COST › AAPL
Tool calls (2)
get_equity_financials → submit_answer
Qwen
qwen/qwen3.8-flash
100.0strict pass
latency 40.4s · cost $0.0035
tool calls 5
Model answer
ranked · 10 items
1. NVDA2. PANW3. META4. JPM5. AMZN6. GOOGL7. MSFT8. TSLA9. COST10. AAPL
Why this score
Order graded by pairwise over the top 10: 1.00.
method pairwise · k 10 · value 1.000
gold order: NVDA › PANW › META › JPM › AMZN › GOOGL › MSFT › TSLA › COST › AAPL
got order: NVDA › PANW › META › JPM › AMZN › GOOGL › MSFT › TSLA › COST › AAPL
Tool calls (5)
list_metrics → get_equity_financials → get_equity_financials → run_calculation → submit_answer
Gemini
google/gemini-3.8-flash
100.0strict pass
latency 31.7s · cost $0.0306
tool calls 5
Model answer
ranked · 10 items
1. NVDA2. PANW3. META4. JPM5. AMZN6. GOOGL7. MSFT8. TSLA9. COST10. AAPL
Why this score
Order graded by pairwise over the top 10: 1.00.
method pairwise · k 10 · value 1.000
gold order: NVDA › PANW › META › JPM › AMZN › GOOGL › MSFT › TSLA › COST › AAPL
got order: NVDA › PANW › META › JPM › AMZN › GOOGL › MSFT › TSLA › COST › AAPL
Tool calls (5)
get_equity_financials → run_calculation → run_calculation✗ → run_calculation → submit_answer
Z.ai
z-ai/glm-5.3-flash
100.0strict pass
latency 55.0s · cost $0.0030
tool calls 3
Model answer
ranked · 10 items
1. NVDA2. PANW3. META4. JPM5. AMZN6. GOOGL7. MSFT8. TSLA9. COST10. AAPL
Why this score
Order graded by pairwise over the top 10: 1.00.
method pairwise · k 10 · value 1.000
gold order: NVDA › PANW › META › JPM › AMZN › GOOGL › MSFT › TSLA › COST › AAPL
got order: NVDA › PANW › META › JPM › AMZN › GOOGL › MSFT › TSLA › COST › AAPL
Tool calls (3)
get_equity_financials → run_calculation → submit_answer
Grok
x-ai/grok-4.7
100.0strict pass
latency 11.5s · cost $0.0449
tool calls 4
Model answer
ranked · 10 items
1. NVDA2. PANW3. META4. JPM5. AMZN6. GOOGL7. MSFT8. TSLA9. COST10. AAPL
Why this score
Order graded by pairwise over the top 10: 1.00.
method pairwise · k 10 · value 1.000
gold order: NVDA › PANW › META › JPM › AMZN › GOOGL › MSFT › TSLA › COST › AAPL
got order: NVDA › PANW › META › JPM › AMZN › GOOGL › MSFT › TSLA › COST › AAPL
Tool calls (4)
list_metrics → get_equity_financials → run_calculation → submit_answer
Minimax
MiniMax M3
80.0not a strict pass
latency 327.5s · cost $0.0597
tool calls 18
Model answer
ranked · 9 items
1. NVDA2. PANW3. META4. JPM5. AMZN6. GOOGL7. MSFT8. COST9. AAPL
Why this score
Order graded by pairwise over the top 10: 0.80.
method pairwise · k 10 · value 0.800
gold order: NVDA › PANW › META › JPM › AMZN › GOOGL › MSFT › TSLA › COST › AAPL
got order: NVDA › PANW › META › JPM › AMZN › GOOGL › MSFT › COST › AAPL
Tool calls (18)
get_equity_financials → get_equity_financials → get_equity_metrics → run_calculation → get_equity_financials → get_equity_financials → get_equity_financials → get_equity_financials → get_equity_financials → get_equity_financials → get_equity_financials → get_equity_financials → get_equity_financials → search_equities → get_equity_financials → run_calculation → search_equities → submit_answer
Status
FeedbackTwitterTelegram