Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home→ Community→ Story
Community

I pushed Qwen3.8-27B to 99 tps single request and 1150 tps with a batch request on a RTX 3090

Via r/LocalLlama
Monday, Aug 17, 2026 · 8:01PM
Summary

I'm back. Yesterday I released the first version of hyper-optimized Qwen3.8-27B inference engine for a RTX 3090, reaching 82 tps on single request and 672 peak. Over the last 24 hours I've been exploring how to improve it further (without a quality degredation). Yesterday we had these 3 optimization

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories