NVIDIA's Nemotron 3.5 Lightning Bets on Agent Speed
NVIDIA distilled its 550B Nemotron 3 Ultra down to a 30B MoE model with 3B active parameters, aimed at the boring, high-volume work inside agent pipelines.
Articles Tagged "Inference"
Gemini 3.5 Flash-Lite
Google DeepMind's cheapest paid Gemini tier prices input at $0.30/M and output at $2.50/M tokens, more than doubling OSWorld-Verified and Terminal-Bench 2.1 scores over Gemini 3.1 Flash-Lite while trailing GPT-5.4 mini on raw coding benchmarks.
Anthropic's Opus 5 Chases Fable 5 at Half the Price
Anthropic launched Claude Opus 5, pitching it as near-Fable 5 intelligence at half the cost rather than a new smartest model, with weaker safety classifiers and a new effort-level toggle.
Ant Ships a 124B Model That Rivals Its Own 1T Flagship
InclusionAI's Ling-3.0-flash quietly went live with 124B parameters and 5.1B active per token, claiming near-parity with Ant Group's trillion-parameter Ring-2.6-1T flagship.
Gemini 3.6 Flash
Google DeepMind's workhorse Flash model cuts output tokens 17% versus Gemini 3.5 Flash, drops output pricing to $7.50/M, and cuts DeepSWE task tokens by 65% while trailing GPT-5.6 Luna and Grok 4.5 on raw coding scores.
Gemini 3.6 Flash Review: Faster, Cheaper, Same Brain
Google's Gemini 3.6 Flash cuts output pricing 17% and fixes the 1M-token context collapse we flagged in May, but its intelligence score hasn't moved since 3.5 Flash.
General Compute's $400M Loan Bypasses Nvidia GPUs
General Compute borrowed $400 million from Upper90 against a fleet of SambaNova SN50 inference chips, the first major AI infrastructure loan not collateralized by Nvidia hardware.
Cerebras Pushes GPT-5.6 Sol to 750 Tokens Per Second
GPT-5.6 Sol is now live on Cerebras wafer-scale hardware at 750 tokens per second - roughly 10x faster than any GPU-based frontier model deployment in production.
AI Research: Smarter Evals, Token Cuts, Agent Gates
Three papers tackle benchmark saturation, orchestration waste, and silent policy violations in tool-using agents.
SambaNova Banks $1B as Firms Move AI Off the Cloud
SambaNova closes a $1B Series F at $11B valuation with JPMorgan Chase as its flagship on-premises inference partner and SN50 chips due in H2 2026.
ZML Ships a Free LLM Server That Runs on Any Chip
ZML's LLMD inference server runs Llama, Qwen, and Mistral on Nvidia, AMD, TPU, Apple Metal, and Intel Arc from a single binary - for free.
Grok 4.1 Fast
Grok 4.1 Fast is xAI's agent-optimized model with a 2M-token context window, #1 ranking on tau-bench Telecom, and one of the lowest input prices among frontier-adjacent APIs at $0.20/M tokens.
