How to Setting Up Apache Kafka with Docker

April 30, 2025

Apache Kafka is a powerful distributed event streaming platform widely used for building real-time data pipelines and streaming applications. Installing Kafka can be complex due to its dependencies, but Docker simplifies the process by allowing you to run Kafka in isolated containers. In this guide, we'll explore how to set up Kafka using Docker images from various sources, including Apache, Bitnami, Confluent, and Ubuntu.

Why Use Docker for Kafka?

Docker provides a consistent environment for running applications, making it easier to manage dependencies and configurations. By using Docker, you can:

Quickly set up and tear down Kafka instances.
Avoid conflicts with other applications on your system.
Easily replicate environments for development, testing, and production.

Prerequisites

Before you begin, ensure you have the following installed:

Docker: Install Docker
Docker Compose (optional): Install Docker Compose

Option 1: Using Apache's Official Kafka Docker Image

The Apache Kafka project provides an official Docker image that includes Kafka and its dependencies.
Steps:

Pull the image:
```
docker pull apache/kafka
```

Run Kafka:

docker run -d --name kafka -p 9092:9092 apache/kafka

Note: This image may require additional configuration for Zookeeper and environment variables.

Option 2: Using Bitnami's Kafka Docker Image

Bitnami offers a Kafka Docker image that's easy to configure and includes both Kafka and Zookeeper.
Steps:

Pull the image:
```
docker pull bitnami/kafka
```

Run Kafka with Docker Compose: Create a docker-compose.yml file:

version: '2'
services:
  zookeeper:
    image: 'bitnami/zookeeper:latest'
    ports:
      - '2181:2181'
    environment:
      - ALLOW_ANONYMOUS_LOGIN=yes
  kafka:
    image: 'bitnami/kafka:latest'
    ports:
      - '9092:9092'
    environment:
      - KAFKA_BROKER_ID=1
      - KAFKA_ZOOKEEPER_CONNECT=zookeeper:2181
      - ALLOW_PLAINTEXT_LISTENER=yes

Then, run:

docker-compose up -d

Bitnami's image simplifies the setup process and is suitable for development and testing environments.

Option 3: Using Confluent's Kafka Docker Image

Confluent provides a comprehensive Kafka platform with additional tools and services.
Steps:

Pull the image:
```
docker pull confluentinc/cp-kafka
```

Run Kafka with Docker Compose: Create a docker-compose.yml file:

version: '2'
services:
  zookeeper:
    image: 'confluentinc/cp-zookeeper:latest'
    environment:
      ZOOKEEPER_CLIENT_PORT: 2181
      ZOOKEEPER_TICK_TIME: 2000
  kafka:
    image: 'confluentinc/cp-kafka:latest'
    depends_on:
      - zookeeper
    ports:
      - '9092:9092'
    environment:
      KAFKA_BROKER_ID: 1
      KAFKA_ZOOKEEPER_CONNECT: zookeeper:2181
      KAFKA_ADVERTISED_LISTENERS: PLAINTEXT://localhost:9092
      KAFKA_OFFSETS_TOPIC_REPLICATION_FACTOR: 1

Then, run:

docker-compose up -d

Confluent's image is ideal for those looking to leverage the full suite of Kafka tools and services.

Option 4: Using Ubuntu's Kafka Docker Image

Ubuntu provides a Kafka Docker image that's suitable for users familiar with Ubuntu environments.
Steps:

Pull the image:
```
docker pull ubuntu/kafka
```