Groq LPU - Deterministic Inference at Scale
Groq's Language Processing Unit (LPU) is a purpose-built inference ASIC that trades HBM for 230MB of on-chip SRAM, delivering deterministic latency and record-breaking tokens-per-second for LLM serving.
Articles Tagged "Inference"
Intel Gaudi 3 - Challenging NVIDIA on Price
Intel Gaudi 3 is a TSMC 5nm AI accelerator with 128GB HBM2e and 1,835 TFLOPS FP8 performance, positioned as a cost-effective alternative to NVIDIA H100 for training and inference workloads.
NVIDIA A100 - The GPU That Built Modern AI
Complete specs, benchmarks, and analysis of the NVIDIA A100 80GB SXM - the Ampere-architecture GPU that remains the most widely deployed AI accelerator in the world.
NVIDIA B200 - Blackwell Flagship GPU
Complete specs, benchmarks, and analysis of the NVIDIA B200 - the Blackwell-architecture flagship GPU with 192GB HBM3e, 8 TB/s bandwidth, and up to 9,000 TFLOPS FP8.
NVIDIA GB200 NVL72 - Rack-Scale Blackwell
Complete specs, benchmarks, and analysis of the NVIDIA GB200 NVL72 - the 72-GPU rack-scale Blackwell system delivering 1,440 PFLOPS FP4 for trillion-parameter AI training and inference.
NVIDIA GB300 NVL72 - Blackwell Ultra Rack
Complete specs, benchmarks, and analysis of the NVIDIA GB300 NVL72 - the Blackwell Ultra rack-scale system with 288GB HBM3e per GPU, 1.5x more FP4 compute, and 2x attention performance over GB200.
NVIDIA H100 SXM - The AI Training Benchmark
Complete specs, benchmarks, and analysis of the NVIDIA H100 SXM - the Hopper-architecture GPU that defined the standard for AI training and inference performance.
NVIDIA H200 - Inference-Optimized Hopper
Complete specs, benchmarks, and analysis of the NVIDIA H200 - the HBM3e-equipped Hopper GPU that delivers 76% more memory and 43% more bandwidth than the H100 for inference workloads.
NVIDIA RTX 3090 - The Budget 24GB Value King
Full specs and benchmarks for the NVIDIA GeForce RTX 3090 - 24GB GDDR6X at 936 GB/s, Ampere architecture, and why used 3090s remain the best value option for local AI inference in 2026.
NVIDIA RTX 4090 - The Home Lab AI Standard
Full specs and benchmarks for the NVIDIA GeForce RTX 4090 - 24GB GDDR6X, 1,008 GB/s bandwidth, Ada Lovelace architecture, and why it remains the default home lab GPU for local AI inference.
NVIDIA RTX 5090 - Blackwell for the Home Lab
Full specs and benchmarks for the NVIDIA GeForce RTX 5090 - 32GB GDDR7, 1,792 GB/s bandwidth, Blackwell architecture, and what it means for local AI inference.
AORUS RTX 5090 AI BOX vs NVIDIA DGX Spark for Local AI
Two very different approaches to desktop AI hardware - a 32 GB eGPU with 1,792 GB/s bandwidth versus a 128 GB unified memory mini PC with full CUDA. Which one should you buy?
