Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home→ Community→ Story
Community

A chunking lib in Rust that is ~20x faster [P]

Via r/MachineLearning
Monday, Oct 5, 2026 · 6:11PM
Summary

Hey, I wanted a faster chunking library for my system without affecting the overall accuracy. Did not find many options. So I've build https://github.com/d1pankarmedhi/chunkr It has most of the chunking strategies like Character, Recursive, Markdown header, Late chunking, Hierarchical chunking, etc.

Continue reading the full article
Read at r/MachineLearning
www.reddit.com
Back to all stories