← Leaderboard · task_3f381f53aae6bab980a4a3f5
F29 · Trailing-twelve-month revenueFinancial AnalysisCalculationFinancial filingsNUMBERMEDIUMpublic example

Question

What was PANW's trailing-twelve-month revenue as of Q2 FY2026 — the sum of the four single fiscal quarters ending with that quarter (Q3 FY2025, Q4 FY2025, Q1 FY2026, Q2 FY2026)? Use SINGLE-quarter values (Q4 = the fiscal-year value minus the first three quarters, as served by get_equity_financials with period 'Q'); for each quarter take the copy from the latest filing at or before the data cutoff. Answer in absolute USD. Filing-version policy: every financial value is taken from the LATEST filing accepted by the SEC at or before the data cutoff that reports the requested period. If a later filing (before the cutoff) restates an earlier period, the restated value is the answer; the original filing's value is not. A fiscal-year value is taken only from an annual report (10-K / 20-F / 40-F, including amendments) — a quarterly report never supplies an annual value.
Data as of 2026-09-10 · grader numeric_tolerance

Expected / gold answer

9.89B (9893500000 USD)

Computed by code from the frozen snapshot and verified by an independent recomputation before the batch was frozen. No model ever saw it.

Model answers (8)

XiaomiMiMo
xiaomi/mimo-v2.6-flash
100.0strict pass
latency 85.8s · cost $0.0054
tool calls 4
Model answer
9.89B (9893500000 USD)
Why this score
Expected 9.89B, got 9.89B (0% off) — within tolerance.
expected 9893500000 · got 9893500000 · error 0.0% · within tolerance
Tool calls (4)
get_equity_financials → get_equity_financials → run_calculation → submit_answer
DeepSeek
deepseek/deepseek-v4.1-flash
100.0strict pass
latency 19.7s · cost $0.0255
tool calls 5
Model answer
9.89B (9893500000 USD)
Why this score
Expected 9.89B, got 9.89B (0% off) — within tolerance.
expected 9893500000 · got 9893500000 · error 0.0% · within tolerance
Tool calls (5)
list_metrics → get_equity_financials → get_equity_financials → run_calculation → submit_answer
Anthropic
Claude Opus 5.5
100.0strict pass
latency 10.8s · cost $0.0778
tool calls 2
Model answer
9.89B (9893500000 USD)
Why this score
Expected 9.89B, got 9.89B (0% off) — within tolerance.
expected 9893500000 · got 9893500000 · error 0.0% · within tolerance
Tool calls (2)
get_equity_financials → submit_answer
Qwen
qwen/qwen3.8-flash
100.0strict pass
latency 110.3s · cost $0.0090
tool calls 8
Model answer
9.89B (9893500000 USD)
Why this score
Expected 9.89B, got 9.89B (0% off) — within tolerance.
expected 9893500000 · got 9893500000 · error 0.0% · within tolerance
Tool calls (8)
list_metrics → get_equity_financials → run_calculation → get_equity_financials → get_equity_financials → get_equity_financials → run_calculation → submit_answer
Gemini
google/gemini-3.8-flash
100.0strict pass
latency 47.5s · cost $0.0840
tool calls 9
Model answer
9.89B (9893500000 USD)
Why this score
Expected 9.89B, got 9.89B (0% off) — within tolerance.
expected 9893500000 · got 9893500000 · error 0.0% · within tolerance
Tool calls (9)
get_equity_financials → run_calculation → get_equity_financials → get_equity_financials → get_equity_financials → run_calculation → run_calculation✗ → run_calculation → submit_answer
Z.ai
z-ai/glm-5.3-flash
100.0strict pass
latency 80.9s · cost $0.0028
tool calls 4
Model answer
9.89B (9893000000 USD)
Why this score
Expected 9.89B, got 9.89B (0% off) — within tolerance.
expected 9893500000 · got 9893000000 · error 0.0% · within tolerance
Tool calls (4)
get_equity_financials → get_equity_financials → run_calculation → submit_answer
Grok
x-ai/grok-4.7
100.0strict pass
latency 36.5s · cost $0.0874
tool calls 8
Model answer
9.89B (9893000000 USD)
Why this score
Expected 9.89B, got 9.89B (0% off) — within tolerance.
expected 9893500000 · got 9893000000 · error 0.0% · within tolerance
Tool calls (8)
list_metrics → get_equity_financials → get_equity_financials → get_equity_financials → run_calculation✗ → run_calculation → run_calculation → submit_answer
Minimax
MiniMax M3
0.0not a strict pass
latency 45.7s · cost $0.0032
tool calls 5
Model answer
0 (0 USD)
Why this score
Expected 9.89B, got 0 (1.00 off) — outside tolerance.
expected 9893500000 · got 0 · error 1.0000 · outside tolerance
Tool calls (5)
get_equity_financials → get_equity_financials → list_metrics → get_equity_financials → submit_answer