Articles Tagged "Local AI"

EXAONE 4.5

EXAONE 4.5

LG AI Research's first open-weight vision-language model packs 33B parameters, 262K context, and STEM scores above GPT-5-mini - but ships under a non-commercial license.

Mozilla Thunderbolt Lets Enterprises Run AI Locally

Mozilla Thunderbolt Lets Enterprises Run AI Locally

MZLA Technologies launches Thunderbolt, an open-source self-hostable AI client targeting enterprises locked into Copilot, ChatGPT Enterprise, and Claude - with local SQLite storage and full model freedom.

A $900 RTX 3090 Now Beats an M5 Max at LLM Inference

A $900 RTX 3090 Now Beats an M5 Max at LLM Inference

Two researchers fused all 24 layers of Qwen 3.5-0.8B into a single CUDA kernel launch, making a five-year-old RTX 3090 deliver 1.8x the throughput of an M5 Max at equal or better efficiency. The gap was software, not silicon.

llama.cpp Lands Three Audio Models in 48 Hours

llama.cpp Lands Three Audio Models in 48 Hours

Three separate PRs merged into llama.cpp between April 11-13 add MERaLiON-2, Gemma 4's Conformer encoder, and Qwen3-Omni/ASR - making local voice AI inference practical on consumer hardware for the first time.