Articles Tagged "Edge AI"

Muse Glimmer

Muse Glimmer

Meta's 30B open-weight agentic model distilled from Muse Spark runs on a single consumer GPU, ships under Apache 2.0, and leads Gemma4-31B and Qwen3.6-27B on 5 of 8 agentic benchmarks.

POCKET-35B

POCKET-35B

VIDRAFT quantizes its Darwin-36B-Opus MoE model into a 35B GGUF that runs on stock llama.cpp with no GPU, trading GPQA Diamond score for CPU and phone portability.

Bonsai 27B

Bonsai 27B

Bonsai 27B compresses Alibaba's Qwen3.6-27B into 1-bit and ternary weights, shrinking a 54GB model to as little as 3.9GB so it runs on an iPhone.

Ministral 3 8B

Ministral 3 8B

Mistral AI's mid-tier open-weight edge model - 8B parameters, 256K context, Apache 2.0 license, built for agentic pipelines and cost-sensitive production workloads.

NVIDIA Cosmos 3

NVIDIA Cosmos 3

NVIDIA Cosmos 3 is an open physical AI omnimodel with Mixture-of-Transformers architecture that natively handles text, images, video, sound, and robot actions in a single 16B or 64B model.

Ministral 3B

Ministral 3B

Mistral AI's smallest open-weight model - 3B parameters, 256K context, Apache 2.0 license, built for edge and cost-sensitive deployments.