Blog

Apache Kafka

This comprehensive course is designed to provide participants with a deep understanding of Apache Kafka, a distributed streaming platform. From fundamental concepts to advanced topics, participants will gain the knowledge and practical skills needed to effectively use Kafka in real-world scenarios.

This course equips you with the skills to leverage Kafka’s distributed streaming capabilities. From setting up clusters to mastering Kafka Streams, become a Kafka pro and build robust, scalable data pipelines.


CTA Button

What you will learn

By the end of this course, participants will be able to:
  • Kafka Fundamentals and Architecture
  • Kafka Connect: Seamlessly Integrate External Systems
  • Kafka Streams: Real-time Stream Processing
  • Security Best Practices for Kafka
  • Setting Up Kafka Clusters:
  • Monitoring and Troubleshooting

Beneficial for

This course is suitable for:
  • Software Developers
  • System Administrators
  • Data Engineers
  • Enthusiasts exploring advanced data streaming

Course Pre-requisite

Participants should have a basic understanding of:
  • Basic understanding of distributed systems and familiarity with Java or Scala programming.

Course Outline

Introduction to Big Data 

Big Data Customer

Scenarios 

What is Kafka? 

Need for Kafka 

Core Concepts of Kafka 

Kafka Architecture 

Where is Kafka Used 

Understanding the components of Kafka

Cluster 

Installation of Kafka Cluster 

Configuring Kafka Cluster 

Producer of Kafka 

Consumer of Kafka 

Producer and Consumer in Action 

Offset 

Design 

Hardware 

Kafka Monitoring and Issues 

Kafka Performance Tuning 

Reading data from Kafka 

Demo-Twitter Kafka Producer 

Introduction to Scala 

Mixed Paradigm-Functional Programming 

Scala Installation & Configuration 

Scala REPL 

Scala Project Using Eclipse 

Understanding the Hadoop Cluster 

Integrating Kafka with Hadoop Cluster 

Understanding Apache Storm 

Implementing Spouts and Bolts 

Kafka with Storm Spout 

Ecosystem of Spark 

Understanding the Spark Cluster 

Integrating Kafka with Spark 

Don't Hesitate to Contact Us

Contact Us