Apache Kafka

Apache Kafka Introduction

Kafka vs Traditional Messaging

Topics & Partitions

Brokers & Clusters

ZooKeeper & KRaft Mode

Replication & In-Sync Replicas (ISR)

Leaders & Followers

Offsets & Log Structure

Log Retention & Compaction

Schema Registry & Avro

Topic Configuration Properties

Kafka Producer Basics

Producer Acknowledgements (acks)

Message Keys & Partitioning Strategy

Idempotent Producer

Transactional Producer

Producer Batching & Compression

Serializers & Schema Registry

Consumer Groups

Consumer Offsets

Auto vs Manual Offset Commit

Consumer Rebalancing

Consumer Poll Loop

Consumer Lag

Consumer Rebalancing

Consumer Lag Monitoring

Dead Letter Topics (DLT)

At-Least-Once Delivery

At-Most-Once Delivery

Exactly-Once Semantics (EOS)

Exactly-Once Semantics (EOS)

Idempotent Consumer Pattern

Kafka Streams Basics

KStream & KTable

Stream Processing Topology

Windowing in Kafka Streams

State Stores & RocksDB

Interactive Queries

Kafka Streams State Stores

Kafka Streams Windowing

Kafka Connect

Source Connectors & Debezium CDC

Sink Connectors

Debezium CDC Connector

Single Message Transforms (SMT)

Log Compaction

Retention Policies

Topic Configuration & Tuning

Kafka Security (TLS & SASL)

Kafka Monitoring (JMX/Prometheus)

Kafka Security: SSL & SASL

Monitoring with Prometheus & Grafana

Consumer Group Management

Kafka with Spring Boot

@KafkaListener

Dead Letter Topic (DLT)

Message Compression

Kafka Cluster Scaling

MirrorMaker 2 for Geo-Replication

Kafka Performance Tuning

Kafka Design Patterns

Multi-Datacenter Replication (MirrorMaker 2)

Kafka Performance Tuning Playbook

Tiered Storage