Context & Memory Management
3 Topics
1
Context Window Physics & The "Lost in the Middle"
Why 1M token windows are a trap, Attention degradation, and Needle-in-a-Haystack failures.
High - Tests practical understanding of model degradation at bounded limits.
2
Agentic Memory Architecture
Short-term buffer memory vs Long-term graph memory (Mem0, Zep).
High - System design for autonomous agents maintaining state.
3
Context Distillation & KV Compression
Compressing prompts mathematically and semantically to save KV cache VRAM bounds.
Medium - Crucial for system optimization and large-scale deployments.