Bonsai 1.7B
PrismML's smallest Bonsai checkpoint compresses Qwen3-1.7B under 0.5GB, and now powers the vision-language model behind Qualcomm's Snapdragon AR1 smart glasses demo.
Articles Tagged "Edge AI"
PrismML Puts a 1-Bit AI Model on Smart Glasses
PrismML and Qualcomm demoed a 2-billion-parameter vision-language model running in 1-bit precision on Snapdragon AR1 Gen 1 smart glasses hardware at Snapdragon Summit.
Muse Glimmer
Meta's 30B open-weight agentic model distilled from Muse Spark runs on a single consumer GPU, ships under Apache 2.0, and leads Gemma4-31B and Qwen3.6-27B on 5 of 8 agentic benchmarks.
POCKET-35B
VIDRAFT quantizes its Darwin-36B-Opus MoE model into a 35B GGUF that runs on stock llama.cpp with no GPU, trading GPQA Diamond score for CPU and phone portability.
A 35B Model That Runs on Your Phone Was Bred, Not Trained
VIDRAFT compressed its leaderboard-climbing Darwin-36B-Opus into POCKET-35B, a GPU-free model for phones and CPUs, but its headline GPQA score depends on how you count.
Nvidia's Jetson Chips Are Headed to the Moon
Lunar Outpost and Firefly Aerospace will fly Nvidia Jetson modules on a lunar rover and orbiter this year, the first GPUs to run on and around the Moon.
A 27B AI Model Now Fits an iPhone - Apple Is Watching
PrismML compressed a 27B-parameter Qwen model from 54GB to under 4GB using 1-bit and ternary weights, and Apple is evaluating the technology for on-device Siri.
Bonsai 27B
Bonsai 27B compresses Alibaba's Qwen3.6-27B into 1-bit and ternary weights, shrinking a 54GB model to as little as 3.9GB so it runs on an iPhone.
Ministral 3 8B
Mistral AI's mid-tier open-weight edge model - 8B parameters, 256K context, Apache 2.0 license, built for agentic pipelines and cost-sensitive production workloads.
Google Gemma 4 QAT Fits Frontier AI in Under 1GB
Google DeepMind's new QAT checkpoints shrink the Gemma 4 E2B model to under 1GB, making serious on-device AI viable for phones and budget laptops.
NVIDIA Cosmos 3
NVIDIA Cosmos 3 is an open physical AI omnimodel with Mixture-of-Transformers architecture that natively handles text, images, video, sound, and robot actions in a single 16B or 64B model.
Ministral 3B
Mistral AI's smallest open-weight model - 3B parameters, 256K context, Apache 2.0 license, built for edge and cost-sensitive deployments.
