Concepts, technologies, patterns and quick references for ML interviews and system design. Each topic gives you the short version first, goes deeper when you want it, and links to the Lessons and Problems that use it.
How to split long documents or event streams into pieces a model can use, the main ways to choose boundaries, and what each choice costs in recall, context use and complexity.
What a model's key-value cache holds during generation, how its memory grows with model shape and context length, and how that limits concurrent requests. Separates it from prompt (prefix) caching and from application-level response caching.