Apache Kafka

Master event streaming and distributed messaging — 55 topics across 12 chapters covering Kafka internals, producers, consumers, streaming, and production operations.

Start Learning View Modules

55

Topics

12

Chapters

15h

Est. Time

Progress0/55 (0%)

All Modules

Click any topic to start learning

1

Event Streaming Fundamentals

5 topics

0% done

1What is Event Streaming?2Pub/Sub Model Explained 3Message Queues vs Event Logs — Key Differences 4When to Use Kafka (and when NOT to)5Kafka vs RabbitMQ vs Kinesis — Full Comparison

2

Kafka Architecture Deep Dive

6 topics

0% done

1Kafka Core Components — Brokers, Topics, Partitions, Offsets 2Topics and Partitions — How Data is Organized 3Offsets — Kafka's Position Tracking System 4The Kafka Cluster — Brokers, ZooKeeper, and KRaft 5Log Segments and Retention Policies 6Kafka's Commit Log — Why It's Different

3

Producers & Message Delivery

5 topics

0% done

1How Kafka Producers Work 2Partitioning Strategies — Round Robin, Key-Based, Custom 3Producer Acknowledgments — acks=0, acks=1, acks=all 4Idempotent Producers and Exactly-Once Semantics 5Batching, Compression, and Throughput Optimization

4

Consumers & Consumer Groups

5 topics

0% done

1How Kafka Consumers Work 2Consumer Groups and Partition Assignment 3Offset Management — Auto-commit vs Manual commit 4Consumer Rebalancing — Causes, Types, and Impact 5Dead Letter Queues and Error Handling in Consumers

5

Kafka Internals — Storage & Replication

5 topics

0% done

1How Kafka Stores Data on Disk 2Replication — Leaders, Followers, and ISR 3Leader Election — What Happens When a Broker Dies 4Under-Replicated Partitions — Detection and Recovery 5Log Compaction — Event Sourcing Use Cases

6

Kafka Connect

4 topics

0% done

1What is Kafka Connect and Why It Exists 2Source Connectors vs Sink Connectors 3Kafka Connect Architecture — Workers, Tasks, Connectors 4Building a Real Pipeline — MySQL → Kafka

7

Kafka Streams

5 topics

0% done

1What is Kafka Streams? Stream Processing vs Batch Processing 2KStream vs KTable — Key Differences 3Stateless Operations — filter, map, flatMap 4Stateful Operations — aggregations, joins, windowing 5Building a Real-Time Analytics Pipeline with Kafka Streams

8

Schema Registry & Data Contracts

3 topics

0% done

1Why Schema Management Matters in Event-Driven Systems 2Avro, Protobuf, and JSON Schema — Which to Choose 3Schema Evolution and Compatibility Rules

9

Event-Driven Architecture Patterns

5 topics

0% done

1Event-Driven Architecture (EDA) — Core Concepts 2Event Sourcing — Rebuilding State from Events 3CQRS — Command Query Responsibility Segregation 4The Saga Pattern — Distributed Transactions Without 2PC 5Outbox Pattern — Guaranteed Event Publishing

10

Performance Tuning & Monitoring

4 topics

0% done

1Key Kafka Metrics Every Engineer Must Know 2Producer and Consumer Tuning for High Throughput 3JVM Tuning and OS-Level Configuration for Kafka 4Monitoring Kafka with Prometheus and Grafana

11

Security & Multi-Cluster Deployments

4 topics

0% done

1Kafka Security — TLS, SASL, and ACLs 2Multi-Tenant Kafka — Namespacing and Isolation 3Mirror Maker 2 — Cross-Cluster Replication 4Confluent Platform vs Apache Kafka — Differences and Trade-offs

12

Real-World System Design with Kafka

4 topics

0% done

1Designing a Ride-Sharing Event Pipeline (Uber-style)2Real-Time Fraud Detection System with Kafka Streams 3Event-Sourced Order Management System 4Kafka in a Microservices Architecture — End-to-End Design