← Leaderboard · task_37235a52fe29fce217bd1758
S-EQ33 · Market-cap Bucket RankingMarket & SignalRanking / Top-KEquityGROUPED_RANKEDHARDpublic example
Question
Buckets: SMALL < $2B, MID $2B–$10B, LARGE > $10B by market cap at the cutoff (row attribute `market_cap_bucket`); return over 20 sessions = adjusted close today / adjusted close 20 sessions ago − 1. Find US-listed common equities (instruments without a reported market cap — warrants, units, rights, preferred series, notes — are not in the universe) with 20-day average dollar volume greater than $100M; within each market-cap bucket (SMALL < $2B, MID $2B–$10B, LARGE > $10B) take the top 5 by 20-day return descending. Scope: only entities with a known value for 20-day average dollar volume, 20-day return, market-cap bucket (SMALL < $2B, MID $2B–$10B, LARGE > $10B) in the snapshot; entities lacking any of them are out of scope and must not be returned. Return the picks grouped by the group value exactly as it appears in the data, each group's list in the requested order (best first); group membership and order are graded.
Rebuild policy: metrics that are not served as fields (fundamental ratios, growth rates, valuation, technical signals) must be recomputed by you from the raw facts and daily bars the tools serve, following the definitions in list_metrics.compute_yourself to the letter (period selection, latest-filing copy, quarter arithmetic); do the arithmetic with run_calculation over the fetched data. The reference answer was computed from the same facts by the same definitions.
Data as of 2026-09-10 · grader grouped_topk
Expected / gold answer
grouped · 3 groups
LARGE1. MRNA2. MSTR3. BMNR4. XP5. CRCL
MID1. ASST2. PURR3. HTFL4. ARX5. AMLX
SMALL1. GPRO2. TE3. WOLF4. JBLU5. FCEL
Computed by code from the frozen snapshot and verified by an independent recomputation before the batch was frozen. No model ever saw it.
Model answers (8)
Model answer
grouped · 3 groups
SMALL1. GPRO2. TE3. WOLF4. JBLU5. FCEL
MID1. ASST2. PURR3. HTFL4. ARX5. AMLX
LARGE1. MRNA2. MSTR3. BMNR4. XP5. CRCL
Why this score
3 groups; every group exact. Strict pass.
3 groups · strict pass
| group | gold | correct | false + | missed | order | score |
|---|---|---|---|---|---|---|
| LARGE | 5 | 5 | 0 | 0 | 100.0% | 100 |
| MID | 5 | 5 | 0 | 0 | 100.0% | 100 |
| SMALL | 5 | 5 | 0 | 0 | 100.0% | 100 |
Tool calls (12)
list_metrics → search_equities → search_equities → search_equities → search_equities → search_equities → run_calculation → get_market_history → get_market_history → run_calculation → run_calculation → submit_answer
Model answer
grouped · 3 groups
LARGE1. MRNA2. MSTR3. BMNR4. XP5. CRCL
MID1. ASST2. PURR3. HTFL4. ARX5. AMLX
SMALL1. GPRO2. TE3. WOLF4. JBLU5. FCEL
Why this score
3 groups; every group exact. Strict pass.
3 groups · strict pass
| group | gold | correct | false + | missed | order | score |
|---|---|---|---|---|---|---|
| LARGE | 5 | 5 | 0 | 0 | 100.0% | 100 |
| MID | 5 | 5 | 0 | 0 | 100.0% | 100 |
| SMALL | 5 | 5 | 0 | 0 | 100.0% | 100 |
Tool calls (14)
list_metrics → search_equities → search_equities → search_equities → search_equities → search_equities → run_calculation → run_calculation → get_market_history → get_market_history → run_calculation → run_calculation → search_equities → submit_answer
Model answer
grouped · 3 groups
SMALL1. GPRO2. TE3. WOLF4. JBLU5. FCEL
MID1. ASST2. PURR3. HTFL4. ARX5. AMLX
LARGE1. MRNA2. MSTR3. BMNR4. XP5. CRCL
Why this score
3 groups; every group exact. Strict pass.
3 groups · strict pass
| group | gold | correct | false + | missed | order | score |
|---|---|---|---|---|---|---|
| LARGE | 5 | 5 | 0 | 0 | 100.0% | 100 |
| MID | 5 | 5 | 0 | 0 | 100.0% | 100 |
| SMALL | 5 | 5 | 0 | 0 | 100.0% | 100 |
Tool calls (7)
list_metrics → search_equities → search_equities → search_equities → get_market_history → run_calculation → submit_answer
Model answer
grouped · 3 groups
SMALL1. GPRO2. TE3. WOLF4. JBLU5. FCEL
MID1. ASST2. PURR3. HTFL4. ARX5. AMLX
LARGE1. MRNA2. MSTR3. BMNR4. XP5. CRCL
Why this score
3 groups; every group exact. Strict pass.
3 groups · strict pass
| group | gold | correct | false + | missed | order | score |
|---|---|---|---|---|---|---|
| LARGE | 5 | 5 | 0 | 0 | 100.0% | 100 |
| MID | 5 | 5 | 0 | 0 | 100.0% | 100 |
| SMALL | 5 | 5 | 0 | 0 | 100.0% | 100 |
Tool calls (15)
list_metrics → search_equities → search_equities → search_equities → search_equities → search_equities → search_equities → search_equities → search_equities → search_equities → search_equities → get_market_history → run_calculation✗ → run_calculation → submit_answer
Model answer
grouped · 3 groups
SMALL1. GPRO2. TE3. WOLF4. JBLU5. FCEL
MID1. ASST2. PURR3. HTFL4. ARX5. AMLX
LARGE1. MRNA2. MSTR3. BMNR4. XP5. CRCL
Why this score
3 groups; every group exact. Strict pass.
3 groups · strict pass
| group | gold | correct | false + | missed | order | score |
|---|---|---|---|---|---|---|
| LARGE | 5 | 5 | 0 | 0 | 100.0% | 100 |
| MID | 5 | 5 | 0 | 0 | 100.0% | 100 |
| SMALL | 5 | 5 | 0 | 0 | 100.0% | 100 |
Tool calls (17)
list_metrics → search_equities → search_equities → search_equities → search_equities → get_market_history → run_calculation → run_calculation → get_market_history → run_calculation → search_equities → run_calculation → get_market_history → run_calculation → run_calculation → get_equity_metrics → submit_answer
Model answer
grouped · 3 groups
LARGE1. MRNA2. MSTR3. BMNR4. XP5. CRCL
MID1. ASST2. PURR3. HTFL4. ARX5. AMLX
SMALL1. GPRO2. TE3. WOLF4. JBLU5. FCEL
Why this score
3 groups; every group exact. Strict pass.
3 groups · strict pass
| group | gold | correct | false + | missed | order | score |
|---|---|---|---|---|---|---|
| LARGE | 5 | 5 | 0 | 0 | 100.0% | 100 |
| MID | 5 | 5 | 0 | 0 | 100.0% | 100 |
| SMALL | 5 | 5 | 0 | 0 | 100.0% | 100 |
Tool calls (11)
list_metrics → search_equities → search_equities → search_equities → search_equities → search_equities → run_calculation → get_market_history → get_market_history → run_calculation → submit_answer
Model answer
grouped · 3 groups
LARGE1. MRNA2. MSTR3. BMNR4. XP5. CRCL
MID1. ASST2. PURR3. HTFL4. ARX5. AMLX
SMALL1. GPRO2. TE3. WOLF4. JBLU5. FCEL
Why this score
3 groups; every group exact. Strict pass.
3 groups · strict pass
| group | gold | correct | false + | missed | order | score |
|---|---|---|---|---|---|---|
| LARGE | 5 | 5 | 0 | 0 | 100.0% | 100 |
| MID | 5 | 5 | 0 | 0 | 100.0% | 100 |
| SMALL | 5 | 5 | 0 | 0 | 100.0% | 100 |
Tool calls (11)
list_metrics → search_equities → search_equities → search_equities → search_equities → search_equities → run_calculation → get_market_history → get_market_history → run_calculation → submit_answer
Model answer
grouped · 3 groups
SMALL1. GPRO2. TE3. WOLF4. JBLU5. FCEL
MID1. ASST2. PURR3. HTFL4. ARX5. AMLX
LARGE1. MRNA2. MSTR3. BMNR4. XP5. CRCL
Why this score
3 groups; every group exact. Strict pass.
3 groups · strict pass
| group | gold | correct | false + | missed | order | score |
|---|---|---|---|---|---|---|
| LARGE | 5 | 5 | 0 | 0 | 100.0% | 100 |
| MID | 5 | 5 | 0 | 0 | 100.0% | 100 |
| SMALL | 5 | 5 | 0 | 0 | 100.0% | 100 |
Tool calls (11)
list_metrics → search_equities → search_equities → search_equities → search_equities → search_equities → get_market_history → get_market_history → run_calculation → run_calculation → submit_answer