Issue 2026-10-06 · Industry · 开源 · 研究

Rust chunking library Chunkr released, ~20x faster

A developer released Chunkr, a Rust chunking library that hits 2,264 MB/s on recursive chunking in M4 MacBook tests, far above LangChain's 769 MB/s and LlamaIndex's 10 MB/s; its PDF loader processes roughly 15x faster than PyPDF.

r/MachineLearning30 d ago
Read original ↗