Introduction

1. 1What is Kafka? (and the Pub-Sub idea behind it)p. 1
2. 2Events, Streaming & Where Kafka Earns Its Keepp. 2

Architecture & Brokers

1. 3Clusters, Brokers & the Wire Protocolp. 3
2. 4How Brokers Mediate Traffic + the Controllerp. 4

Topics, Partitions & Offsets

1. 5Topics & Partitions: Kafka's Filing Cabinetp. 5
2. 6Offsets, Ordering & Scaling Outp. 6

Hands-On: Local Setup & CLI

1. 7Hands-On: Boot a Broker & Send Your First Messagep. 7
2. 8Hands-On: Keyed Messages & a Real 3-Broker Clusterp. 8

Producers (Concepts)

1. 9Producers: Writing, Keys & The Idempotent Fast Lanep. 9

Hands-On: Producer API

1. 10Hands-On: Producer API — Setup, Config & Sending Messagesp. 10
2. 11Hands-On: Producer API — Keys, Partitioning & the Send Pipelinep. 11

Hands-On: Guaranteed Delivery Config

1. 12Hands-On: Guaranteed Delivery Config (acks, ISR & Idempotence)p. 12

Consumers & Consumer Groups (Concepts)

1. 13Consumers, Polling & Consumer Groupsp. 13
2. 14Offsets, __consumer_offsets & Rebalancingp. 14

Hands-On: Consumer API

1. 15Hands-On Consumer API: Setup, Config & the poll() Loopp. 15
2. 16Hands-On Consumer API: subscribe() vs assign() & auto.offset.resetp. 16

Hands-On: Consumer Groups & Rebalance

1. 17Scaling Out: Consumer Groups & the Rebalance Dancep. 17
2. 18Hands-On: Surviving Rebalance Storms (max.poll.interval.ms + Listeners)p. 18

Hands-On: Offset Management

1. 19Hands-On: Offset Management — Auto-Commit & Manual Commitsp. 19
2. 20Hands-On: Specific Offsets & At-Least-Once vs At-Most-Oncep. 20

Hands-On: seek() & Replay

1. 21Hands-On: seek() & Replayp. 21

Hands-On: Custom Serializers & Deserializers

1. 22Hands-On: Custom Serializers & Deserializersp. 22

Replication & Fault Tolerance

1. 23Replication & Leaders: Kafka's Safety Netp. 23
2. 24ISR, min.insync.replicas & Surviving a Broker Deathp. 24

Storage, Retention & Compaction

1. 25The Log, Segments & Retentionp. 25
2. 26Log Compaction & Why Kafka Fliesp. 26

Delivery Semantics

1. 27Delivery Semantics: At-Most-Once, At-Least-Once & Exactly-Oncep. 27
2. 28Exactly-Once: Idempotent Producers & Transactionsp. 28

Coordination: ZooKeeper & KRaft

1. 29Coordination: ZooKeeper & KRaftp. 29

Kafka Connect

1. 30Kafka Connect: Moving Data Without Writing Codep. 30

Kafka Streams & ksqlDB

1. 31Kafka Streams: Real-Time Processing in Plain Javap. 31
2. 32Stateful Magic: Aggregations, Windows, Joins & ksqlDBp. 32

Operations & Best Practices

1. 33Kafka Ops & Best Practices: Partitions, Lag & Survivalp. 33

Design Questions

1. 34Real-Time Activity Tracking & Analytics Pipelinep. 34