Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home→ Community→ Story
Community

Qwen3.8-27B at ~130 tok/s with full 262k context, on Kaggle's free TPU. OpenAI-compatible endpoint.

Via r/LocalLlama
Thursday, Sep 3, 2026 · 6:46PM
Summary

Spent the last week getting Qwen3.8-27B (bf16, no quant) running on Kaggle's free TPU v5e-8. It works, and it's very fast: ~130 tok/s single stream (MTP), ~78 without 10,300 tok/s prefill, a 105k-token prompt takes ~10 seconds Full native 262,144 context. A 225k-token prompt prefills in ~28s ~540 to

Continue reading the full article
Read at r/LocalLlama
www.reddit.com
Back to all stories