← Leaderboard · task_2ca7b35e177c58467ab3b914
F08-R · EPS Growth (diluted) — six companies rankedFinancial AnalysisCalculationFinancial filingsRANKED_SETHARDpublic example

Question

For each of these six companies — TSLA, AAPL, AMZN, COST, AMD, CRWD — answer the same question: "By what percentage did the company's full-year DILUTED earnings per share grow from fiscal year 2024 to fiscal year 2025? Use diluted EPS as reported in the annual filing (not basic EPS). Answer as a decimal ratio." Then rank the six tickers by that value, highest first (all six have the required filings). Return the six tickers in order; order is graded. Filing-version policy: every financial value is taken from the LATEST filing accepted by the SEC at or before the data cutoff that reports the requested period. If a later filing (before the cutoff) restates an earlier period, the restated value is the answer; the original filing's value is not. A fiscal-year value is taken only from an annual report (10-K / 20-F / 40-F, including amendments) — a quarterly report never supplies an annual value. Per-share policy: when per-share figures (EPS, dividends per share, book value per share) from different fiscal years are compared, take every value from the SAME filing — the latest filing at or before the cutoff that reports all of the requested periods — so that a stock split does not mix share bases. A single-year per-share figure follows the filing-version policy alone.
Data as of 2026-09-10 · grader ranking_match

Expected / gold answer

ranked · 6 items
1. AMD2. AMZN3. AAPL4. COST5. TSLA6. CRWD

Computed by code from the frozen snapshot and verified by an independent recomputation before the batch was frozen. No model ever saw it.

Model answers (8)

XiaomiMiMo
xiaomi/mimo-v2.6-flash
100.0strict pass
latency 47.0s · cost $0.0016
tool calls 4
Model answer
ranked · 6 items
1. AMD2. AMZN3. AAPL4. COST5. TSLA6. CRWD
Why this score
Order graded by pairwise over the top 6: 1.00.
method pairwise · k 6 · value 1.000
gold order: AMD › AMZN › AAPL › COST › TSLA › CRWD
got order: AMD › AMZN › AAPL › COST › TSLA › CRWD
Tool calls (4)
list_metrics → get_equity_financials → run_calculation → submit_answer
DeepSeek
deepseek/deepseek-v4.1-flash
100.0strict pass
latency 26.5s · cost $0.0285
tool calls 6
Model answer
ranked · 6 items
1. AMD2. AMZN3. AAPL4. COST5. TSLA6. CRWD
Why this score
Order graded by pairwise over the top 6: 1.00.
method pairwise · k 6 · value 1.000
gold order: AMD › AMZN › AAPL › COST › TSLA › CRWD
got order: AMD › AMZN › AAPL › COST › TSLA › CRWD
Tool calls (6)
list_metrics → list_metrics → get_equity_financials → run_calculation → run_calculation → submit_answer
Anthropic
Claude Opus 5.5
100.0strict pass
latency 18.9s · cost $0.1001
tool calls 2
Model answer
ranked · 6 items
1. AMD2. AMZN3. AAPL4. COST5. TSLA6. CRWD
Why this score
Order graded by pairwise over the top 6: 1.00.
method pairwise · k 6 · value 1.000
gold order: AMD › AMZN › AAPL › COST › TSLA › CRWD
got order: AMD › AMZN › AAPL › COST › TSLA › CRWD
Tool calls (2)
get_equity_financials → submit_answer
Qwen
qwen/qwen3.8-flash
100.0strict pass
latency 84.5s · cost $0.0051
tool calls 8
Model answer
ranked · 6 items
1. AMD2. AMZN3. AAPL4. COST5. TSLA6. CRWD
Why this score
Order graded by pairwise over the top 6: 1.00.
method pairwise · k 6 · value 1.000
gold order: AMD › AMZN › AAPL › COST › TSLA › CRWD
got order: AMD › AMZN › AAPL › COST › TSLA › CRWD
Tool calls (8)
list_metrics → get_equity_financials✗ → get_equity_financials → run_calculation → run_calculation✗ → run_calculation → run_calculation → submit_answer
Gemini
google/gemini-3.8-flash
100.0strict pass
latency 47.9s · cost $0.0484
tool calls 8
Model answer
ranked · 6 items
1. AMD2. AMZN3. AAPL4. COST5. TSLA6. CRWD
Why this score
Order graded by pairwise over the top 6: 1.00.
method pairwise · k 6 · value 1.000
gold order: AMD › AMZN › AAPL › COST › TSLA › CRWD
got order: AMD › AMZN › AAPL › COST › TSLA › CRWD
Tool calls (8)
get_equity_financials → get_equity_financials → run_calculation → run_calculation → get_equity_financials → run_calculation → run_calculation → submit_answer
Z.ai
z-ai/glm-5.3-flash
100.0strict pass
latency 164.0s · cost $0.0064
tool calls 8
Model answer
ranked · 6 items
1. AMD2. AMZN3. AAPL4. COST5. TSLA6. CRWD
Why this score
Order graded by pairwise over the top 6: 1.00.
method pairwise · k 6 · value 1.000
gold order: AMD › AMZN › AAPL › COST › TSLA › CRWD
got order: AMD › AMZN › AAPL › COST › TSLA › CRWD
Tool calls (8)
get_equity_financials → run_calculation✗ → run_calculation✗ → run_calculation → run_calculation✗ → run_calculation → run_calculation → submit_answer
Grok
x-ai/grok-4.7
100.0strict pass
latency 20.0s · cost $0.0543
tool calls 4
Model answer
ranked · 6 items
1. AMD2. AMZN3. AAPL4. COST5. TSLA6. CRWD
Why this score
Order graded by pairwise over the top 6: 1.00.
method pairwise · k 6 · value 1.000
gold order: AMD › AMZN › AAPL › COST › TSLA › CRWD
got order: AMD › AMZN › AAPL › COST › TSLA › CRWD
Tool calls (4)
list_metrics → get_equity_financials → run_calculation → submit_answer
Minimax
MiniMax M3
6.7not a strict pass
latency 95.1s · cost $0.0340
tool calls 30
Model answer
ranked · 2 items
1. AAPL2. TSLA
Why this score
Order graded by pairwise over the top 6: 0.07.
method pairwise · k 6 · value 0.067
gold order: AMD › AMZN › AAPL › COST › TSLA › CRWD
got order: AAPL › TSLA
Tool calls (30)
list_metrics → get_equity_financials✗ → get_equity_financials → get_equity_financials → get_equity_financials → get_equity_financials → get_equity_financials → get_equity_financials → get_equity_financials → get_equity_financials → get_equity_financials → search_equities → get_equity_financials✗ → get_equity_financials → get_equity_financials → get_equity_financials → get_equity_financials → get_equity_financials → get_equity_financials → get_equity_financials → get_equity_financials → get_equity_financials → get_equity_financials → get_equity_financials → get_equity_financials → get_equity_financials → get_equity_financials → get_equity_financials → run_calculation → submit_answer