GPT-5.4 Lands with Computer Use and 1M Token Context
OpenAI ships GPT-5.4 with built-in computer use that beats human desktop performance, a 1 million token context window, and native Excel and Google Sheets integrations.
Articles Tagged "Benchmarks"
Corrupt Agent Scores, Memory Bottlenecks, Skill Evolution
New research exposes hidden failures in agent benchmarks, finds retrieval quality dominates memory pipeline performance, and shows evolutionary skill discovery beats manual curation.
Mercury 2 Review: 1,000 Tokens per Second, Tested
Mercury 2 by Inception Labs is the fastest reasoning LLM available, built on diffusion architecture. We tested the speed, quality, and real-world trade-offs.
Qwen3.5 MoE vs Kimi K2.5 for Coding - Price Breakdown
Kimi K2.5 leads every coding benchmark, but Qwen3.5-35B-A3B delivers 87-93% of that performance at 3-4x lower cost and runs on a single consumer GPU. Here is the full breakdown.
Mercury 2 Is 13x Faster Than Claude Haiku - Verified
Inception Labs' Mercury 2 hits 1,196 tokens per second in independent testing - a diffusion architecture that rewires how inference works.
Gemini 3.1 Pro Tops Benchmarks but Developers Can't Rely on It
Gemini 3.1 Pro leads ARC-AGI-2, LiveCodeBench, and 11 other benchmarks with 750 million users and 21.5% market share - but developers report stalled responses, leaked thinking tokens, and API outages that make it unusable for production coding and agent workflows.
Speech Turing Tests, Smart Routing, Pseudocode Agents
New research reveals no speech AI passes a Turing test, adaptive routing slashes LLM costs 82%, and pseudocode planning transforms agent reliability.
Math Olympiad AI Leaderboard - March 2026 Rankings
Rankings of AI models on competition mathematics benchmarks including AIME 2025, IMO, MathArena, and FrontierMath, measuring the cutting edge of mathematical reasoning.
China's GLM-5 Rivals GPT-5.2 on Zero Nvidia Silicon
Zhipu AI's 744B open-source model GLM-5 was trained entirely on Huawei Ascend chips and now competes with GPT-5.2 and Claude Opus on major benchmarks.
Agentic AI Benchmarks Leaderboard - GAIA, WebArena, BFCL, and Tau2-Bench
Rankings of the best AI models and agent frameworks on agentic benchmarks measuring real-world task completion, web navigation, function calling, and multi-turn tool use.
QuiverAI's Arrow 1 Hits #1 on SVG Arena With 1583 Elo - First Model to Break 1500 on Any Design Arena Leaderboard
Arrow 1, a purpose-built SVG generation model from a16z-backed QuiverAI, reached the top of SVG Arena with an Elo of 1583 one day after launch - shattering Gemini 3.1 Pro's previous record of 1421 by 162 points.
Gemini 3.1 Pro Review: Google's Reasoning Leap Is Real - With Caveats
Google's Gemini 3.1 Pro more than doubles its predecessor's reasoning scores and introduces adjustable thinking modes, but latency issues and preview-status quirks keep it from a clean sweep.
