Best AI News โ€” Updated Every 3 Hours
Story Page
← All Stories
Home→ Community→ Story
Community

First local-LLM tuning attempt: Qwen3.8-27B true Q4_K_M at 13.2 tok/s near 50-61K context on RTX 5080 16GB

Via r/LocalLlama
Wednesday, Sep 2, 2026 ยท 2:29PM
Summary

This was my first serious attempt at tuning a local LLM. I started because Qwen3.8-27B IQ3 was fast on my RTX 5080 but the coding quality disappointed me, and the Q4 profiles I tried in LM Studio were much slower than reports here. Hardware: RTX 5080 16 GB i5-14600K 64 GB DDR5-5600 (4 DIMMs) Windows

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories