Building Scalable Data Pipelines with Kafka

Description

In this course, you will learn :

• Learn the theory behind Kafka
• Interact with a Kafka cluster running in the browser-terminal

Syllabus :

1. Basics

• Introduction
• Characteristics of Distributed Systems
• Messaging Patterns
• Commit Log
• Components of Kafka
• Partitions
• Partition Rebalancer

 

2. Kafka Producer

• Producer
• Sending Messages
• Producer Configurations
• Producer Serialization

 

3. Kafka Consumer

• Consumer and Consumer Groups
• Kafka Consumer
• Consumer Configurations
• Commits and Offsets
• Offset Commit Configuration
• Handling Rebalances
• Stopping a Consumer
• Consumer Deserializer
• Running a Single Consumer

 

4. Kafka Internals

• Replication
• Kafka Controller
• Request Processing
• Partition Allocation
• Data Storage
• Reliability in Kafka
• Reliable Producers and Consumers

Show more