Open In App
Related Articles

Spring Boot | How to consume JSON messages using Apache Kafka

Improve Article
Save Article
Like Article

Apache Kafka is a stream processing system which lets you send messages between processes, applications, and servers. In this article, we will see how to publish JSON messages on the console of a Spring boot application using Apache Kafka.

In order to learn how to create a Spring boot project, refer to this article.

Working Steps: 

  1. Go to Spring initializer and create a starter project with following dependency: 
    • Spring for Apache Kafka
  2. Open the project in an IDE and sync the dependencies. In this article, we would be creating a student model where we would be posting the student details. Therefore, create a model class Student. Add data members and create constructor and override the toString method to see the messages in JSON format. The following is the implementation of the student class:

Student Model

// Java program to implement a
// student class
// Creating a student class
public class Student {
    // Data members of the class
    int id;
    String firstName;
    String lastName;
    // Constructor of the student
    // class
    public Student()
    // Parameterized constructor of
    // the student class
    public Student(int id, String firstName,
                   String lastName)
    { = id;
        this.firstName = firstName;
        this.lastName = lastName;
    public String toString()
        return "Student{"
            + "id = " + id
            + ", firstName = '" + firstName + "'"
            + ", lastName = '" + lastName + "'"
            + "}";

  2. Create a new class Config and add annotations @Configuration and @EnableKafka. Now create beans ConsumerFactory and ConcurrentKafkaListenerContainerFactory with Student class object.

Config clas

public class Config {
    // Function to establish a connection
    // between Spring application
    // and Kafka server
    public ConsumerFactory<String, Student>
        // HashMap to store the configurations
        Map<String, Object> map
            = new HashMap<>();
        // put the host IP in the map
        // put the group ID of consumer in the map
        // return message in JSON formate
        return new DefaultKafkaConsumerFactory<>(
            map, new StringDeserializer(),
            new JsonDeserializer<>(Student.class));
    public ConcurrentKafkaListenerContainerFactory<String,
            = new ConcurrentKafkaListenerContainerFactory<>();
        return factory;

  2. Create a class KafkaService with @Service annotation. This class will contain the listener method to publish the message on the console.

KafkaService Class

public class KafkaService {
    // Annotation required to listen
    // the message from Kafka server
    @KafkaListener(topics = "JsonTopic",
                   groupId = "id", containerFactory
                                   = "studentListner")
    public void
    publish(Student student)
        System.out.println("New Entry: "
                           + student);

  2. Start zookeeper and Kafka server. Now we need to create a new topic with the name JsonTopic. To do so, open a new command prompt window and change directory to the Kafka directory.
  3. Now create a new topic using the command given below:

bin/ –create –zookeeper localhost:2181 –replication-factor 1 –partitions 1 –topic topic_name // for mac and linux
.\bin\windows\Kafka-topics.bat –create –zookeeper localhost:2181 –replication-factor 1 –partitions 1 –topic topic_name // for windows 

  2. Now to run Kafka producer console, use the command below:

bin/ –broker-list localhost:9092 –topic Kafka_Example // for mac and linux
.\bin\windows\Kafka-console-producer.bat –broker-list localhost:9092 –topic Kafka_Example // for windows 

  2. Run the application and and type message on Kafka producer and press enter.

Whether you're preparing for your first job interview or aiming to upskill in this ever-evolving tech landscape, GeeksforGeeks Courses are your key to success. We provide top-quality content at affordable prices, all geared towards accelerating your growth in a time-bound manner. Join the millions we've already empowered, and we're here to do the same for you. Don't miss out - check it out now!

Last Updated : 24 Jan, 2022
Like Article
Save Article
Similar Reads
Complete Tutorials