AORUS RTX 5090 AI BOX Review: Desktop GPU Power via Thunderbolt 5
A review of the Gigabyte AORUS RTX 5090 AI BOX - a liquid-cooled eGPU packing a full desktop RTX 5090 with 32 GB GDDR7, connecting to any laptop over Thunderbolt 5 for $2,999.
Articles Tagged "Inference"
DGX Spark Review: NVIDIA's $4,699 Desktop AI Box
A hands-on review of the NVIDIA DGX Spark - a 128 GB Grace Blackwell mini PC that promises 1 petaflop of AI performance on your desk for $4,699.
NVIDIA DGX Spark Setup and Usage Guide for 2026
A complete guide to setting up the NVIDIA DGX Spark - from unboxing and first boot to running LLM inference, fine-tuning models, and optimizing performance.
Ollama Cloud Review: From Local LLMs to Seamless Cloud Inference
Ollama Cloud extends the popular local LLM runner to the cloud, letting you push models from your laptop and serve them globally. We test latency, cold starts, pricing, and the developer experience against dedicated inference providers.
Groq Review: The Fastest Inference Engine Money Can Buy
Groq's LPU chips deliver inference speeds that make GPUs look slow - 1,200+ tokens per second on Llama 4. We benchmark latency, throughput, model availability, and pricing against the GPU-based competition.
OpenRouter Review: One API Key to Rule Them All
OpenRouter routes your API calls to 300+ models across every major provider through a single endpoint. We benchmark its routing, latency overhead, pricing, and reliability against direct API access.
Inception Ships Mercury 2 - A Diffusion LLM That Hits 1,009 Tokens Per Second
Inception Labs launches Mercury 2, the first diffusion-based reasoning language model, generating over 1,000 tokens per second on Blackwell GPUs at a fraction of the cost of conventional autoregressive models.
Qwen 3.5 FP8 Weights Drop - How to Actually Deploy a 397B Model on 8 GPUs
Alibaba releases official FP8-quantized weights for the Qwen 3.5 flagship and 27B dense model, cutting memory requirements roughly in half and enabling deployment on 8x H100 GPUs with native vLLM and SGLang support.
Programmatic GUI Agents, Faithful Chain-of-Thought, and the 1% KV Cache
Today's arXiv picks: a state-machine framework that makes GUI agents 12x cheaper, a training method that forces chain-of-thought to be honest, and a KV cache system that matches full quality at 1% the memory.
Hugging Face Absorbs llama.cpp Creator in Bid to Own the Local AI Stack
Georgi Gerganov's ggml.ai joins Hugging Face, bringing the most important local inference project under the $13.5 billion AI platform's umbrella.
Taalas Exits Stealth With $169 Million to Hardcode AI Models Into Silicon
Toronto startup Taalas raises $169M to build custom chips that permanently etch AI model weights into transistors, claiming 73x faster inference than Nvidia's H200 at a fraction of the power.
How Many Tokens Does Moltbook Burn? The Hidden Inference Cost of an AI-Only Social Network
We estimate that Moltbook's 46,000 active AI agents consume 1-4 billion tokens per day, costing up to $20,000 daily in inference and emitting as much CO2 as dozens of American homes - and 93% of those comments get zero replies.
