Open In App

How to Create Apache Kafka Consumer with Conduktor?

Improve
Improve
Like Article
Like
Save
Share
Report

Kafka Consumers is used to reading data from a topic and remember a topic again is identified by its name. So the consumers are smart enough and they will know which broker to read from and which partitions to read from. And in case of broker failures, the consumers know how to recover and this is again a good property of Apache Kafka. Now data for the consumers is going to be read in order within each partition. Now please refer to the below image. So if we look at a Consumer consuming from Topic-A/Partition-0, then it will first read the message 0, then 1, then 2, then 3, all the way up to message 11. If another consumer is reading from two partitions for example Partition-1 and Partition-2, is going to read both partitions in order. It could be with them at the same time but from within a partition the data is going to be read in order but across partitions, we have no way of saying which one is going to be read first or second and this is why there is no ordering across partitions in Apache Kafka

Apache Kafka Consumer

 

Note: Please read this article, Apache Kafka Consumer, to know more about Kafka Consumer.

So in this article, we are going to discuss how to Create Apache Kafka Consumer with Conduktor. Talking briefly about Conduktor, Conduktor is a full-featured native desktop application that plugs directly into Apache Kafka to bring visibility to the management of Kafka clusters, applications, and microservices. It’s eventually helping companies make the most of their existing engineering resources, and minimizing the need for deep in-house expertise.

Step by Step Implementation

Step 1: Create Apache Kafka Producer with Conduktor

Please read this article, How to Create Apache Kafka Producer with Conduktor, and create your Apache Kafka producer so that we can consume the same data.

Step 2: Open your Conduktor and click on the topic name from which you want to consume the data as shown in the below image.

 

Step 3: Now click on the Consume Data button as shown in the below image.

 

Step 4: Then a pop-up will open and here you can consume data on the basis of Time and Offset. Please refer to the below image. So it’s your choice on what basis you want to consume the data.

 

So here we are choosing Start from The beginning (earliest). And click on the Start button.

 

As you can see in the below image the data consumption from Topic has been started. 

 

And if you click on the Details button you can see all the details like the Topic name, Partition, Offset, etc. By clicking on the Stop button the consumption will be stopped.

 

You can also see the Partitions by clicking on the Show Partitions button. Please refer to the below image.

 

You can also display your data in tabular form by clicking on the icon. Please refer to the below image.

 


Last Updated : 01 Aug, 2022
Like Article
Save Article
Previous
Next
Share your thoughts in the comments
Similar Reads