Kafka Architecture Deep Dive
6 Topics
1
Kafka Core Components — Brokers, Topics, Partitions, Offsets
The anatomy of a Kafka cluster and how messages are stored.
2
Topics and Partitions — How Data is Organized
Understanding partition scaling, order guarantees, and load balancing.
3
Offsets — Kafka's Position Tracking System
How consumer offsets track reading position across partitions.
4
The Kafka Cluster — Brokers, ZooKeeper, and KRaft
How clusters coordinate metadata and coordinate partition leadership.
5
Log Segments and Retention Policies
How files are segmented on disk and cleaned up via time/size thresholds.
6
Kafka's Commit Log — Why It's Different
How append-only logs on disk achieve sequential I/O and zero-copy performance.