Benchmarks — Page 2
AI model benchmark results and analysis — 35 articles
REAP Explained: Real Coding Benchmarks From Live Agent Traffic
REAP mines production coding agent sessions to build execution-based benchmarks. On the Harvest benchmark it produced,...
ScarfBench: IBM's Brutal Test for Java Migration AI
IBM Research's ScarfBench puts AI coding agents through real enterprise Java framework migrations. The results show a...
Senior SWE-Bench: The Benchmark That Humbles AI Agents
Snorkel AI's new Senior SWE-Bench flips the script on coding agents by testing them as senior engineers. Top models...
FFASR Leaderboard: ASR Benchmarked on Real-World Audio
Treble Technologies and Hugging Face just dropped the FFASR Leaderboard, a far-field ASR benchmark that exposes how...
DeepSWE Benchmark: 91 Repos, 5 Languages, Zero Leaks
DeepSWE is a fresh contamination-free coding benchmark spanning 91 repos and 5 languages. Here's what the numbers say...
Rio3.5 vs Qwen3.7: Why This Viral Benchmark Smells Off
A tweet claims Rio de Janeiro's city government built an LLM that beats Qwen3.7. No paper, no leaderboard, no weights....
Agentic LLM Benchmark: Open Models On Real Tooling
Hugging Face's new agentic benchmark stress-tests open models against your actual toolset. The results expose a gap...
Bilingual Voice Agents Hit a Wall: ASR Code-Switch Benchmark
Frontier ASR models stumble when customers mix two languages in one sentence. A new ServiceNow-AI benchmark exposes how...
ITBench-AA: Top AI Models Flunk Enterprise IT Tasks
IBM and Artificial Analysis just dropped ITBench-AA, the first real test of AI agents on enterprise IT work. Every...
Antigravity 2.0 Tops OpenSCAD 3D Benchmark: Full Analysis
Google's Antigravity 2.0 just posted the strongest autonomous result on ModelRift's OpenSCAD LLM benchmark, beating...
Best AI Coding LLM in 2026: Benchmark Results Ranked
Claude Opus 4.6 reaches 81.4% on SWE-bench Verified per Anthropic, but raw HumanEval scores tell a different story. A...
LangChain vs LlamaIndex vs Haystack: 2026 RAG Benchmark
Aggregated 2026 benchmark data across three RAG frameworks reveals a clear split: LangChain wins ecosystem, LlamaIndex...