LiveBench
Agentic coding
points- 2 Claudeclaude-opus-5-5-max-effort −5.6 71.7
- 3 qwen3.8-max −12.6 64.6
Independent benchmark snapshots
Scores remain separated by source and metric. They are evidence to inspect, not a universal model ranking.
Filter by scenarioSnapshots refresh daily. A failed source never overwrites the last valid data. Exact model versions, test setup, and original leaderboard links are retained for each result.
Retrieved: Oct 12, 2026, 1:34 AM · 2 official sources · 663 records
The gold panel marks the top scorer of that official test category, with the gap to the runner-ups shown beside each score. It is not an overall ranking: scores from different benchmarks cannot be combined.
Rank · Model family · Exact model version · Score
LiveBench
LiveBench
LiveBench
LiveBench
LiveBench
LiveBench
LiveBench
SWE-bench Verified
The same comparison with the numbers left in: each cell is that family’s score and rank in that test, and the highest score in each column is highlighted. Counts beside a family name show how many tests it appears in and how many it tops. The dots are tests the family has no public result for — not zeros.
| Model family | Agenticpoints | Codingpoints | Mathpoints | Reasoningpoints | Datapoints | Instructpoints | Languagepoints | SWE-bench% |
|---|---|---|---|---|---|---|---|---|
| Claude8/84× | 71.7#2 | 91.4#1 | 97.1#1 | 92.2#3 | 80.5#6 | 75.8#6 | 90.7#1 | 79.2%#1 |
| ChatGPT8/82× | 57.3#21 | 83.9#7 | 96.8#3 | 92.7#1 | 83.0#1 | 75.6#8 | 90.1#2 | 74.6%#17 |
| DeepSeek8/81× | 77.3#1 | 80.0#22 | 95.1#16 | 86.7#31 | 79.5#13 | 71.0#26 | 82.1#26 | 70.0%#46 |
| Gemini8/81× | 58.3#19 | 78.9#29 | 93.5#21 | 89.3#18 | 78.5#23 | 81.4#1 | 87.8#7 | 77.4%#4 |
| GLM8/8 | 60.9#15 | 79.7#24 | 89.8#37 | 85.8#35 | 76.4#34 | 69.3#33 | 79.9#31 | 72.8%#25 |
| Kimi8/8 | 62.2#11 | 81.4#15 | 84.4#56 | 90.7#9 | 78.7#21 | 71.4#23 | 85.5#11 | 71.2%#35 |
| Doubao1/8 | · | · | · | · | · | · | · | 78.8%#3 |
| Qwen1/8 | · | · | · | · | · | · | · | 40.6%#137 |
Each row is a model family, sorted by most first places. A cell shows where that family lands in the test column — only top-3 finishes are marked, and every column keeps its own benchmark’s score.
| Model family | Agentic | Coding | Math | Reasoning | Data | Instruct | Language | SWE-bench |
|---|---|---|---|---|---|---|---|---|
| Claude4 3 | 2 | 1 | 1 | 2 | 2 | · | 1 | 1 |
| ChatGPT2 3 | · | 2 | 2 | 1 | 1 | · | 2 | · |
| Gemini1 2 | · | · | · | · | · | 1 | 3 | 3 |
| DeepSeek1 | 1 | · | · | · | · | · | · | · |
| muse-spark-1.3-xhigh1 1 | · | · | 3 | · | · | 2 | · | · |
| Doubao1 | · | · | · | · | · | · | · | 2 |
| smaug-agentic2 | · | 3 | · | · | 3 | · | · | · |
| Kimi1 | · | · | · | 3 | · | · | · | · |
| qwen3.8-flash-next1 | · | · | · | · | · | 3 | · | · |
| qwen3.8-max1 | 3 | · | · | · | · | · | · | · |
Each bar is the best-scoring configuration per model family in that test, so one vendor with many agent setups does not crowd out the others. Expand the original leaderboard for every row.
LiveBench publishes independently scored, frequently refreshed objective tasks. Category scores shown here are the arithmetic mean of the official per-subtask scores for the selected release, computed locally; each category is displayed separately.
This result concerns an agent configuration and repository issue resolution, not generic chat coding.
Refresh notes: arena/text: 429 https://api.wulong.dev/arena-ai-leaderboards/v1/leaderboard?name=text | arena/search: 429 https://api.wulong.dev/arena-ai-leaderboards/v1/leaderboard?name=search | arena/code: 429 https://api.wulong.dev/arena-ai-leaderboards/v1/leaderboard?name=code
LiveBench reports category scores on objective tasks. Arena reports blind human-preference Elo. SWE-bench Verified reports the rate at which an agent configuration resolves real repository issues.
Scores from different benchmarks cannot be added together. The everyday-life view uses a preference proxy because no general authoritative benchmark covers that scenario.