Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home→ Community→ Story
Community

This draft model is OP on 16 GB cards for Qwen 3.8 27b

Via r/LocalLlama
Saturday, Sep 12, 2026 · 2:57PM
Summary

https://huggingface.co/HermiHg/Qwen3.8-27B-DFlash2-Q2_K_S-MIX-GGUF I used this draft model with https://huggingface.co/ISTA-DASLab/Qwen3.8-27B-GSQ-RCO-GGUF with the IQ3_XXS with 128k context and I saw it averaging about 60 tokens per second tg speed on the 16 GB RX 9070 XT. This is much better than

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories