Best AI News โ€” Updated Every 3 Hours
Story Page
← All Stories
Home→ Community→ Story
Community

UPDATE: Qwen3.8-Flash-Next on 2x3090 + DDR4 (Part 2): 25-29 -> 37-41 t/s decode (UD-Q4_K_XL + expert cache + MTP), plus a branch you can build

Via r/LocalLlama
Friday, Sep 4, 2026 ยท 12:21AM
Summary

This is a follow-up to my post from yesterday (17 -> 25-29 t/s with the expert cache PR). Same box: 2x RTX 3090 on PCIe 3.0, dual Xeon E5-2696 v4, 188 GB DDR4-2133 LRDIMM, llama.cpp, full 261k context, f16 KV, all 48 expert layers in host RAM, everything else on the GPUs. Since then I switched quant

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories