Apache Kafka – Solution Design (KAFKA1)

Databases, NoSQL and Big Data

This course thoroughly explores core concepts of Apache Kafka, helping participants understand the ecosystem components and evaluate the advantages and trade-offs of using Kafka for specific projects through focused explanations and practical context.

Through hands-on lessons and real-world examples you will learn to design scalable solutions, plan end-to-end system design, and apply performance and security best practices while gaining confidence to manage complex data integration challenges with Apache Kafka.

Location, current course term

Contact us

Custom

Customized Training (date, location, content, duration)

The course:

Hide detail

• Core concepts of Apache Kafka
1. Understanding distributed messaging systems
2. Working with topics, partitions and messages
3. Kafka cluster structure

• Kafka clients
1. Producers: sending messages, acknowledgement strategies, delivery guarantees
2. Consumers: receiving messages, offset concepts

• Kafka as a state store
1. Log compaction principles
2. Purpose and behavior of compacted topics

• Kafka in the real world
1. Use cases and anti-use-cases
2. Kafka versus competitors
3. Cloud deployment options

• Working with data types
1. Using a schema registry
2. Schema registry architecture
3. Schema evolution and compatibility rules

• Advanced Apache Kafka concepts
1. Delivery guarantees in detail
2. Idempotence and transactions
3. Performance tuning
4. Multi-cluster setups

• System-level data integration
1. Using Kafka Connect
2. Change Data Capture (CDC)

• Data transformation
1. Building data pipelines
2. Using Kafka Streams
3. Using ksqlDB

Assumed knowledge:

Basic knowledge of programming and messaging systems is recommended.

Schedule:

2 days (9:00 AM - 5:00 PM )

Language: