Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home→ Community→ Story
Community

Help me understand gguf size/ctx size

Via r/LocalLlama
Friday, Sep 4, 2026 · 9:57PM
Summary

Let's say I have 2x 16Gb GPUs and I want to run Qwen3.8 27B. Monitor is ran by the integrated GPU so both 16Gb GPUs are almost fully free. I load the UD-Q4_K_S on one card at 15.4Gb. I then load the context on the other card? Would that be the most efficient way? Or should I aim for higher quants th

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories