Category: Apache Kafka

Kafka is a distributed streaming platform used for building real-time data pipelines and streaming applications. It was originally developed by LinkedIn and is now an open-source project under the Apache Software Foundation. Kafka is...

Apache Kafka – Simple Producer-Consumer Example for Insurance In this example, we’ll set up a Kafka producer and Kafka consumer for a simple insurance system. The producer will simulate sending insurance policy data (e.g.,...

Kafka Messaging: Pub-Sub vs Queue-Based Systems Kafka supports both pub-sub and queue-based messaging systems, offering a fast, reliable, persistent, fault-tolerant, and zero-downtime solution. Producers send messages to a topic, and consumers can choose the...

This explanation and provides a clearer understanding of how Kafka components interact and function. Components and Descriptions

Apache Kafka – Installation and Setup Guide Apache Kafka is a distributed event streaming platform used for building real-time data pipelines and streaming applications. Below is a step-by-step guide to install and set up...

Do we need Zookeeper for a Kafka application? The short answer is: It depends on the version of Kafka you are using. Kafka Versions Prior to 2.8.0 For versions of Apache Kafka prior to...

Running Apache Kafka with KRaft Mode (without Zookeeper) Starting from Apache Kafka 2.8.0, you can run Kafka without Zookeeper by enabling KRaft mode (Kafka Raft Metadata mode). In KRaft mode, Kafka brokers manage metadata...

In Apache Kafka, topics are the main channels through which messages are sent, and topics can be divided into partitions for scalability and parallelism. Each message in a partition has a unique offset that...