kafka-workshop
  • WWCode Dublin - Kafka Workshop
  • Setup your Environment
  • Start your Kafka server
  • Managing Topics
  • Producer
  • Consumer
  • Python Client - Overview
  • Producer in Python
  • Consumer in Python
Powered by GitBook
On this page
  • What is a Producer?
  • Anatomy of Producer Record
  • Let's start producing messages

Producer

On this section you will learn what is a Producer and how to work with it via Command Line

What is a Producer?

"Producers publish data to the topics of their choice. The producer is responsible for choosing which record to assign to which partition within the topic"

Producers are responsible for :

  • Create new messages ( possibly with a schema)

  • Publish messages to a Topic

  • It could address the message to a specific partition.

Anatomy of Producer Record

Producer records needs to be formed with a particular data structure. Here is how it looks

Producer Record

Description

topic

Where to send the message to

[ partition ]

On which partition we would like this message to be send to

[ key ]

used for routing, ordering and deduplication

value

the message itself

Let's start producing messages

Kafka provides a way to start producing messages by using the cli with an script called kafka-console-producer .

Kafka Console Producer Help

./kafka-console-producer.sh

Let's do send some messages. We will start producing messages by reading from standard input and writing it to a Topic in Kafka.

Execute the following command:

./kafka-console-producer --topic my-new-topic --broker-list localhost:9092

Have fun and start typing messages within the stdin

Bonus Exercise

Try to send messages with 2 different keys, so we can do routing afterwards with the consumer :-)

PreviousManaging TopicsNextConsumer

Last updated 6 years ago