Pattern
Chunking long inputs for models
How to split long documents or event streams into pieces a model can use, the main ways to choose boundaries, and what each choice costs in recall, context use and complexity.
Topics: chunkingretrievalcontext-window