Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home→ Community→ Story
Community

KV cache may affect a lot on the quality in Qwen3.8-27B-Q6_K

Via r/LocalLlama
Wednesday, Aug 19, 2026 · 7:59PM
Summary

What I found is when I use Q8/Q8 for KV cache, the model thinks a lot more than the Q4/Q4 or Q8/Q4. I also feel that the quality is a lot better when using Q8/Q8.

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories