Kafka Training
Learn Kafka which is indispensable for Real Time Data Processing with Best Practices
THE GOAL OF COURSE
The purpose of the Kafka Training Program is to enable participants to consolidate their knowledge in the their minds with experience sharing, example implementations and case studies, while providing detailed information on key concepts and techniques on Kafka
WHAT YOU WILL LEARN
- Learn the terminology and basic concepts behind Kafka Architecture and its components, selection criteria and best solution designs,
- Figure out how Message Broker Systems work
- Have deep knowledge on how you should prepare your Zookeeper and Kafka architecture to production,
- Specialize in the most appropriate cluster configurations and integrations with the hardware and systems within the data center,
- Learn Broker, Topic, Producer, Consumer Concepts in detail,
- Develop technical knowledge and competencies with workshops,
- Be able to find answers to your questions at the points where your head is installed while developing after the program
WHO BENEFITS
- Employees who are doing or planning to make a career in the Big Data place
- Leading teams in technology / IT functions
- Leaders responsible for Digital Transformation.
- Data Scientists and Data Analysts
- New Graduates and University Students
Have Deep Knowledge on Kafka Distributed Streaming Platform to Process Hundreds of Thousands of Data in a Second
Theories and practices you will see throughout the program will answer your questions on Kafka Messaging System, also you will learn key techniques to develop the right strategy while implementing your projects
COURSE OUTLINE
- Module-1: Introduction to Kafka
- The History of Kafka
- Kafka Toplogy and Cluster Architecture
- Zookeper Distributed Coordination Service
- The Role of Zookeeper
- Zookeeper and Kafka Installation
- Lab: Workshop with Monolitic Architecture
- Module-2: Kafka Cluster Architecture
- The Components of Kafka Cluster
- Broker, Partition, Topic, Producer and Consumer Concepts
- Setting Up Kafka Cluster
- Understanding Kafka Producer
- Understanding Kafka Consumer
- Working with Producer and Consumer
- The Importance of Replication and Offset
- Kafka Comment Line Tools and Management Operations
- Lab: Examples on producing and consuming messages
- Module-3 Understanding The Life Cycle of Kafka
- Kafka Controller
- The Roles of Kafka Leader and Follower
- The Life Cycle of Produce Request
- The Life Cycle of Fetch Request
- Analyzing Error, Request and Controller Logs
- Understanding Indices and Control Points
- Log Compression and Management
- Module-4 Developing Kafka Applications
- Kafka Java Library
- Working with ProducerConfig and ConsumerConfig
- Creating Topic and Configuration
- Implementing Kafka Producer
- Implementing Kafka Consumer
- Consumer Modelling
- Lab: Developing Producer and Consumer with Spring Boot
- Module-5 Real Time Stream Processing With Kafka
- Use Cases of Real Time Stream Processing
- Real Time Stream Processing Methods
- Spark Streaming Integration
- Alternative Methods
- Lab: Workshop study with Twitter Data
- Module-6 Performance Optimization and Best Practices
- Building Different Architectures for Different Needs
- Optimizations on Operating Systems
- Production Setup and Performance Tips
- Case Studies
- Cluster Management
- Lab: You will learn common Kafka operations by applying lots of examples on the sample datasets