← Leaderboard · task_2a414f517b1ba65e34d747fa

F09 · Free Cash FlowFinancial AnalysisCalculationFinancial filingsNUMBERMEDIUMpublic example

Question

What was AMD's free cash flow for fiscal year 2023, defined as operating cash flow minus capital expenditures (FCF definition v1)? Answer in absolute USD. Filing-version policy: every financial value is taken from the LATEST filing accepted by the SEC at or before the data cutoff that reports the requested period. If a later filing (before the cutoff) restates an earlier period, the restated value is the answer; the original filing's value is not. A fiscal-year value is taken only from an annual report (10-K / 20-F / 40-F, including amendments) — a quarterly report never supplies an annual value.

Data as of 2026-09-10 · grader numeric_tolerance

Expected / gold answer

1.12B (1121000000 USD)

Computed by code from the frozen snapshot and verified by an independent recomputation before the batch was frozen. No model ever saw it.

Model answers (8)

xiaomi/mimo-v2.6-flash

100.0strict pass

latency 19.3s · cost $0.0022
tool calls 3

Model answer

1.12B (1121000000 USD)

Why this score

Expected 1.12B, got 1.12B (0% off) — within tolerance.

expected 1121000000 · got 1121000000 · error 0.0% · within tolerance

Tool calls (3)

list_metrics → get_equity_financials → submit_answer

deepseek/deepseek-v4.1-flash

100.0strict pass

latency 17.0s · cost $0.0192
tool calls 7

Model answer

1.12B (1121000000 USD)

Why this score

Expected 1.12B, got 1.12B (0% off) — within tolerance.

expected 1121000000 · got 1121000000 · error 0.0% · within tolerance

Tool calls (7)

list_metrics → get_equity_financials✗ → get_equity_financials → get_equity_financials → get_equity_financials → run_calculation → submit_answer

Claude Opus 5.5

100.0strict pass

latency 9.8s · cost $0.0857
tool calls 2

Model answer

1.12B (1121000000 USD)

Why this score

Expected 1.12B, got 1.12B (0% off) — within tolerance.

expected 1121000000 · got 1121000000 · error 0.0% · within tolerance

Tool calls (2)

get_equity_financials → submit_answer

qwen/qwen3.8-flash

100.0strict pass

latency 37.5s · cost $0.0059
tool calls 7

Model answer

1.12B (1121000000 USD)

Why this score

Expected 1.12B, got 1.12B (0% off) — within tolerance.

expected 1121000000 · got 1121000000 · error 0.0% · within tolerance

Tool calls (7)

list_metrics → get_equity_financials → get_equity_financials✗ → get_equity_financials → get_equity_financials → run_calculation → submit_answer

google/gemini-3.8-flash

100.0strict pass

latency 14.1s · cost $0.0359
tool calls 4

Model answer

1.12B (1121000000 USD)

Why this score

Expected 1.12B, got 1.12B (0% off) — within tolerance.

expected 1121000000 · got 1121000000 · error 0.0% · within tolerance

Tool calls (4)

get_equity_financials → run_calculation → list_metrics → submit_answer

z-ai/glm-5.3-flash

100.0strict pass

latency 49.3s · cost $0.0010
tool calls 3

Model answer

1.12B (1121000000 USD)

Why this score

Expected 1.12B, got 1.12B (0% off) — within tolerance.

expected 1121000000 · got 1121000000 · error 0.0% · within tolerance

Tool calls (3)

get_equity_financials → get_equity_financials → submit_answer

x-ai/grok-4.7

100.0strict pass

latency 15.2s · cost $0.0327
tool calls 4

Model answer

1.12B (1121000000 USD)

Why this score

Expected 1.12B, got 1.12B (0% off) — within tolerance.

expected 1121000000 · got 1121000000 · error 0.0% · within tolerance

Tool calls (4)

list_metrics → get_equity_financials → get_equity_financials → submit_answer

MiniMax M3

0.0not a strict pass

latency 74.2s · cost $0.0078
tool calls 10

Model answer

1.14B (1141000000 USD)

Why this score

Expected 1.12B, got 1.14B (2% off) — outside tolerance.

expected 1121000000 · got 1141000000 · error 1.8% · outside tolerance

Tool calls (10)

list_metrics → get_equity_financials✗ → get_equity_financials → get_equity_financials → get_equity_financials → search_equities → get_equity_financials → get_equity_financials → list_metrics → submit_answer