Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home→ Community→ Story
Community

Improve token per second without touching quant

Via r/LocalLlama
Saturday, Oct 10, 2026 · 12:05PM
Summary

Spent the past month tweaking and experimenting with many different numbers to achieve 30tps. Hardware: -Rx6700xt 12gb vram (AMD) -2x16 ddr4 3200 ram -r5 5600x -llama.cpp vulkan sdk -window11 (no wsl switching since im not used to the environment) Im looking for any improvements to achieve maybe 40t

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories