Best AI News โ€” Updated Every 3 Hours
Story Page
← All Stories
Home→ Community→ Story
Community

Calculate --override-tensor for llama.cpp using QWEN models and Pi for 2 GPU

Via r/LocalLlama
Sunday, Aug 30, 2026 ยท 11:25PM
Summary

When using two GPU with llama.cpp with --split-mode layer you usually provide a --tensor-split value to fit the proportion of the allocation on each GPU, say you have 16GB + 12GB something like --tensor-split 0.6,0.4 may do. That is a rough division of the models, as vRAM counts and hundreds of MB t

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories