Search-SWE
BENCHMARK RESULTS

Leaderboard

How well can coding agents build search engines?
Compare results. Follow the code. Read the evidence.

Evaluation snapshot2026-10-31Fixed snapshot ↗
Model leaderboard
RankModelAgentTasks
1GPT-6 Luna (max) Codex (v0.164.0)16.4 47 / 471.07B$20.51
2DeepSeek V4.1 Flash 1017 (max) Codex (v0.164.0)15.5 47 / 472.42B$20.92
3MiMo-V2.6-Flash (high) Codex (v0.164.0)4.7 47 / 47528.4M$9.76
All 47 tasks · one selected evaluation per model and taskDownload results JSON ↓

Score: equal-weight task average (0–100). Tokens: total coding input (including cache) + output.

Cost is estimated from recorded agent tokens at official API rates in USD (2026-11-01; DeepSeek off-peak pricing).