Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home→ Community→ Story
Community

Tesla P40 - use F16 KV instead of Q8

Via r/LocalLlama
Saturday, Aug 22, 2026 · 5:48PM
Summary

If you use these cards together, you would think Q8 would be faster tps because it uses less VRAM. Well the reality is: Prompt TPS is nearly identical between the two (e.g. Q4@45k: 237.7 vs 237.6), so KV type doesn't affect prefill. The divergence is purely in generation, where every token requires

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories