| 64,3% |
| 58,6% |
| ~21,4%* |
| ~19,4%* |
| ~18,1%* |
| SWE-Bench Verified | ~83% (estimasi) | 87,6% | 85,0% | 82,1% | 81,0% | 80,6% |
| Terminal-Bench 2.0/2.1 | 74,6% | 66,1–69,4% | 78,2–82,7% | 76,2% | 68,5% | 65,0% |
| OSWorld-Verified (Computer Use) | 83,4% | 82,8% | 78,7% | 75,0% | 72,1% | 70,5% |
| GDPval-AA (Knowledge Work / Agentic Elo) | 1890 | 1753 | 1620–1769 | 1656 | 1500–1570 | 1550 |
| Humanity's Last Exam (dengan tools) | 57,9% | 54,7% | — | — | — | — |
| Humanity's Last Exam (tanpa tools) | 49,8% | — | — | — | — | — |
| GPQA Diamond | ~94% (estimasi) | 94,2% | 96,0% | 92,4% | 90,1–91,5% | 95,1% |
| ARC-AGI-2 | ~80% (estimasi) | 80,2% | 85,0% | 75,8% | 76,1% | 74,0% |
| MCP Atlas (Keandalan Penggunaan Tools) | — | 77,3% | 79,1% | 83,6% | 74,2% | 71,5% |
| AA Intelligence Index (v4.0) | ~59–60 (est) | 59 | 60 | 57 | 53 | 55 |
| Finance Agent v2 | 53,9% | 51,5% | — | — | — | — |
| LiveCodeBench (Pass@1) | — | — | ~91–92% (est) | — | — | 93,5% |
| Codeforces ELO | — | ~3050 (est) | 3168 | — | — | 3206 |
| FrontierMath Tier 1–3 | — | 43,8% | 51,7% | — | — | — |
| MMLU-Pro | — | — | — | — | — | 87,5% |
| AIME 2025 (Matematika) | — | — | 95,2% | — | — | — |
| BrowseComp | — | 79,3% | 84,4% | — | — | — |
* Skor SWE-Bench Pro untuk Gemini 3.5 Flash, Grok 4.3, dan DeepSeek V4 Pro berasal dari satu pengujian pihak ketiga — kartu model Google sendiri menunjukkan angka yang berbeda (lihat catatan di bawah).
| Metrik | Claude Opus 4.8 | Claude Opus 4.7 | GPT-5.5 | Gemini 3.5 Flash | Grok 4.3 | DeepSeek V4 Pro |
|---|---|---|---|---|---|---|
| Harga Input (per 1M token) | $5,00 | $15,00 | $5,00 | $1,50 | $1,25–1,50 | ~$0,50–2,00 (est) |
| Harga Output (per 1M token) | $25,00 | ~$75,00 (est) | $30,00 | $9,00 | ||
| Kecepatan Output (token/detik) | ~90–100 (est) | ~67–78 | ~71 | |||
| Jendela Konteks | 1 juta | 200 ribu | 400 ribu | 1 juta | ||
| Tanggal Rilis | 28 Mei 2026 | 16 Apr 2026 | 23 Apr 2026 | 19 Mei 2026 | 30 Apr 2026 | 24 Apr 2026 |
| Peringkat BenchLM (Sementara) | #2/119 | — | #5/119 | — | — | — |
| ~$6,00–8,00 (est) |
| ~$2,00–8,00 (est) |
| 289 |
| ~159–207 |
| ~80–100 (est) |
| 1 juta |
| 1 juta |