kafka-workshop
  • WWCode Dublin - Kafka Workshop
  • Setup your Environment
  • Start your Kafka server
  • Managing Topics
  • Producer
  • Consumer
  • Python Client - Overview
  • Producer in Python
  • Consumer in Python
Powered by GitBook
On this page
  • Setup the Docker Way
  • Setup Locally
  • Install Python 3
  • Clone the Workshop repository

Setup your Environment

This page will help you setup your environment in case you didn't have time to do it before the workshop.

PreviousWWCode Dublin - Kafka WorkshopNextStart your Kafka server

Last updated 6 years ago

Disclaimer: Content and commands has been tested on Linux/Unix OS but not deeply on Windows.

On this workshop we will facilitate 2 ways to be ready for starting working on Kafka on your computer. Please feel free to choose the one you are most comfortable working with.

Nevertheless I strongly suggest you to use Docker since it's quicker and you can build and destroy your containers after you are done and you won't get the pain through checking if you have pre-install requirements available.

Setup the Docker Way

Requirements:

  • Install docker ( based in your OS )

    • ( Choose accordingly to your distribution )

Check your docker installation:

docker --version

The output of the previous command should look like this:

$ docker --version 
Docker version 18.06.1-ce, build e68fc7a

Install docker compose (Only for Linux )

Go to the linux tab under the section Install compose and follow the instructions provided:

Checkout your docker-compose is ok by executing

docker-compose -version

Check you are able to pull images and run your containers by executing:

docker run hello-world

( Docker only ) Pull Kafka & Zookeeper images

To save time and to prevent any wifi issues over the venue, please pull the images needed for working with Kafka by executing the following commands:

Download Zookeeper Image
docker pull wurstmeister/zookeeper:latest 
Download Kafka Image
docker pull wurstmeister/kafka:latest 

Setup Locally

Pre-Install Requirements

  • Check Java is installed.

# linux/unix OS 
[laura.uzcategui] bin $ java -version
openjdk version "1.8.0_131"
# Windows output:
C:\Users\laura> javac -version
javac 1.8.0_181

If Java is not installed, go and download JDK 8 and install it from here:

Choose according to you Operating System

Installing Kafka locally will be as easier as:

  • Extract the tar file in a directory of your preference

    • Linux / Unix systems: tar -xzf kafka_2.11-2.0.0.tgz

Install Python 3

Clone the Workshop repository

git clone https://github.com/laurauzcategui/wwcode-kafka-workshop.git

Go and download Python 3 from:

macOS
Linux
Windows
https://docs.docker.com/compose/install/#install-compose
Download Kafka here
Windows OS
https://www.python.org/downloads/
Download the Latest Java LTS Free
Logo