Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home→ Community→ Story
Community

llama : add a GPU cache for MoE experts kept in host memory by am17an · Pull Request #29887 · ggml-org/llama.cpp

Via r/LocalLlama
Wednesday, Oct 7, 2026 · 6:15PM
Summary

Potentially big speedup for MoE models that don’t fully fit in VRAM. Are you GPU Poor? Show your speedups ;)

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Related in Community
omni-d1 600M by Liquid AI running in the browser using WebGPU
r/LocalLlama
Porting LIBERO to MuJoCo Warp: 130 robot manipulation tasks on one $700 AMD GPU
r/LocalLlama
d1-3B and d1-omni from LiquidAI
r/LocalLlama
LiquidAI/d1-3B · Hugging Face
r/LocalLlama
A week in Beijing and Shanghai with the people building AI in China
r/LocalLlama
More from Best AI News
NVIDIA, Microsoft Kick Off a New Beginning for Windows PCs With RTX Spark and AI Agents
NVIDIA Blog · Models & Research
These Researchers Made AI Drive a Toyota Corolla to Get In-N-Out
Wired AI · Policy & Culture
Everything announced at Microsoft’s Surface Laptop Ultra event
The Verge AI · Industry & Money
Meta’s Muse launches on iPad just a month after its mobile debut
TechCrunch AI · Industry & Money
Back to all stories