Trang chủ

IT & Software

Other IT & Software

Apache Kafka

Apache Kafka Masterclass [From Scratch With Hands-On]

Loại khoá học: Other IT & Software

Mastering Apache Kafka: Building Reactive Applications for Real-Time Data Processing

50.000 VND

1.299.000 VND

Đầy Đủ Bài Giảng

Học Online Tiện Lợi

Kích Hoạt Nhanh 2-5 Phút

Thanh toán tự động

Được phép tải xuống

Mô tả

** Reactive Kafka Mastery: Building Real-Time Data Processing Applications **

This comprehensive course is designed specifically for senior and staff level engineers who are eager to learn Reactive Kafka from scratch. By the end of the course, you will gain a high level of comfort and proficiency in working with Kafka.

Course Content:

Apache Kafka Fundamentals:
- Setting up Kafka in the latest KRaft mode using custom Docker images
- Bootstrap server configuration
- Kafka topic commands and options
- Console producer and consumer usage
- Understanding Kafka properties and their impact
- Message publishing and consumption in Kafka
- Serialization and deserialization mechanisms in Kafka
- Kafka log retention and management
- Offset concepts and resetting offset to consume messages from a specific time
- Message formatting in Kafka
- Scaling applications using Kafka consumer groups
- Ensuring message ordering in Kafka
Kafka With Reactive Programming
- Developing Java Kafka producer and consumer applications using reactive programming
- Exploring various producer and consumer configurations
- Auto offset reset mechanisms
- Message acknowledgment techniques
- Testing performance by emitting millions of events
- Seeking offsets for specific message retrieval
- Partition assignment strategies (cooperative sticky assignor and range assignor)
Kafka Cluster
- Understanding the working of a Kafka cluster
- Setting up a Kafka cluster using Docker Compose
- Demonstrating fault tolerance in a Kafka cluster and its impact on producer and consumer applications
Best Practices
- Implementing producer acknowledgment for message reliability
- Configuring minimum in-sync replicas
- Creating idempotent producers and consumers to handle duplicate messages
- Compression techniques for message size reduction and improved throughput
Addressing Common Questions:
- Determining the optimal number of topics, partitions, and replicas
- Batch and parallel processing of messages for better CPU utilization
- Error handling strategies, including retry mechanisms, dead letter topics, and poison pill messages
Batch and Parallel Processing:
- Efficiently consuming messages in parallel while maintaining proper order and utilizing available CPUs
Error Handling:
- Implementing retry mechanisms for handling errors in message processing
- Dead letter topics for capturing and handling failed messages
- Poison pill messages and their role in error handling
Kafka Transaction:
- Producing and consuming messages in transactional mode (similar to database transactions)
Integration Tests:
- Developing integration tests using Embedded Kafka
Kafka Security:
- Implementing security measures with plain credentials and SSL encryption
Assignment
- Applying the learned concepts to develop microservices that communicate via Kafka topics to analyze user behaviors and provide business metrics on product trending

Join this course and unlock the full potential of Apache Kafka while mastering reactive programming techniques, batch processing, parallel processing, and effective error handling strategies.

Bạn sẽ học được gì

Learn Kafka From Scratch

Spring Kafka - Event Driven Microservices

Batch & Parallel Processing

Kafka Transaction

Writing Integration Tests

Best Practices

Yêu cầu

Java Reactive Programming
Spring
Comfortable with Indian Accent

Nội dung khoá học

14 sections

Introduction

3 lectures

Introduction

02:17

Need For Event Driven Architecture / Kafka

08:03

Humble Request & Resources

00:25

Kafka Setup

3 lectures

Introduction

05:26

Custom Docker Image

05:37

Docker Compose Setup

05:49

Kafka Crash Course

32 lectures

Introduction