Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home→ Community→ Story
Community

Idea: massively compress Qwen 3.8 KV cache by using a single bit for the token "wait"

Via r/LocalLlama
Tuesday, Aug 18, 2026 · 6:22PM
Summary

Not even sure if I'm joking, my thinking history is about 50% "wait".

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Related in Community
and here we are
r/LocalLlama
Ling-3.0 (BailingMoE3) lands in llama.cpp mainline - Quick benchmarks on Intel Arc B580
r/LocalLlama
Memory prices climb 500% in 12 months, up to 10x the lowest ever tracked prices - 128GB of DDR5 now $3,399
r/LocalLlama
Qwen3.8 2.4T open weights made a Call of Duty clone
r/LocalLlama
I pushed Qwen3.8-27B to 124 tps on a single request on a RTX 3090
r/LocalLlama
More from Best AI News
OpenAI says it's "pacing model development" as AI cybersecurity risks grow too dangerous
The Decoder · Industry & Money
OpenAI Overhauls Safety Protocols After Its AI Agents Went Rogue
Wired AI · Policy & Culture
New benchmark ranks search APIs for AI agents on quality, cost, and speed
The Decoder · Industry & Money
How Much Memory Does Your Agent Actually Need?
Hugging Face Blog · Models & Research
Back to all stories