Benchmarks
Showing 35 benchmarks articles
BenchmarksREAP Explained: Real Coding Benchmarks From Live Agent Traffic
REAP mines production coding agent sessions to build execution-based benchmarks. On the Harvest benchmark it produced,...
July 5, 20267 min
211
BenchmarksScarfBench: IBM's Brutal Test for Java Migration AI
IBM Research's ScarfBench puts AI coding agents through real enterprise Java framework migrations. The results show a...
July 3, 20267 min
194
BenchmarksSenior SWE-Bench: The Benchmark That Humbles AI Agents
Snorkel AI's new Senior SWE-Bench flips the script on coding agents by testing them as senior engineers. Top models...
July 2, 20268 min
229
BenchmarksFFASR Leaderboard: ASR Benchmarked on Real-World Audio
Treble Technologies and Hugging Face just dropped the FFASR Leaderboard, a far-field ASR benchmark that exposes how...
June 27, 20268 min
259
BenchmarksDeepSWE Benchmark: 91 Repos, 5 Languages, Zero Leaks
DeepSWE is a fresh contamination-free coding benchmark spanning 91 repos and 5 languages. Here's what the numbers say...
June 25, 20268 min
303
BenchmarksRio3.5 vs Qwen3.7: Why This Viral Benchmark Smells Off
A tweet claims Rio de Janeiro's city government built an LLM that beats Qwen3.7. No paper, no leaderboard, no weights....
June 23, 20267 min
272
BenchmarksAgentic LLM Benchmark: Open Models On Real Tooling
Hugging Face's new agentic benchmark stress-tests open models against your actual toolset. The results expose a gap...
June 18, 20268 min
274
BenchmarksBilingual Voice Agents Hit a Wall: ASR Code-Switch Benchmark
Frontier ASR models stumble when customers mix two languages in one sentence. A new ServiceNow-AI benchmark exposes how...
June 10, 20268 min
274
BenchmarksITBench-AA: Top AI Models Flunk Enterprise IT Tasks
IBM and Artificial Analysis just dropped ITBench-AA, the first real test of AI agents on enterprise IT work. Every...
June 3, 20268 min
290
BenchmarksAntigravity 2.0 Tops OpenSCAD 3D Benchmark: Full Analysis
Google's Antigravity 2.0 just posted the strongest autonomous result on ModelRift's OpenSCAD LLM benchmark, beating...
May 25, 20268 min
274
BenchmarksBest AI Coding LLM in 2026: Benchmark Results Ranked
Claude Opus 4.6 reaches 81.4% on SWE-bench Verified per Anthropic, but raw HumanEval scores tell a different story. A...
May 24, 20268 min
647
BenchmarksLangChain vs LlamaIndex vs Haystack: 2026 RAG Benchmark
Aggregated 2026 benchmark data across three RAG frameworks reveals a clear split: LangChain wins ecosystem, LlamaIndex...
May 15, 20267 min
537