Concepts, technologies, patterns and quick references for ML interviews and system design. Each topic gives you the short version first, goes deeper when you want it, and links to the Lessons and Problems that use it.
How to put an interval on a pass rate, compare two versions scored on the same cases with a paired analysis, and plan how many cases a comparison needs. Covers the assumptions that make a measured gain misleading.
What a model's key-value cache holds during generation, how its memory grows with model shape and context length, and how that limits concurrent requests. Separates it from prompt (prefix) caching and from application-level response caching.