Convert Figma logo to code with AI

provectus logokafka-ui

Open-Source Web UI for Apache Kafka Management

9,452
1,154
9,452
406

Top Related Projects

11,796

CMAK is a tool for managing Apache Kafka clusters

5,433

Kafka Web UI

3,348

Kafka GUI for Apache Kafka to manage topics, topics data, consumers group, schema registry, connect and more...

5,388

Generic command line non-JVM Apache Kafka producer and consumer

Quick Overview

Kafka-UI is an open-source web UI for Apache Kafka management. It provides a user-friendly interface for monitoring and managing Kafka clusters, topics, and messages, making it easier for developers and operations teams to work with Kafka ecosystems.

Pros

  • User-friendly interface for managing Kafka clusters
  • Supports multiple clusters in a single UI
  • Provides real-time monitoring and metrics visualization
  • Offers KSQL and Schema Registry integration

Cons

  • Limited advanced configuration options compared to native Kafka tools
  • May require additional setup and maintenance alongside Kafka infrastructure
  • Performance might be impacted when dealing with very large clusters or high message volumes

Getting Started

To run Kafka-UI using Docker:

docker run -p 8080:8080 \
    -e KAFKA_CLUSTERS_0_NAME=local \
    -e KAFKA_CLUSTERS_0_BOOTSTRAPSERVERS=kafka:9092 \
    -d provectuslabs/kafka-ui:latest

After running the container, access the UI by navigating to http://localhost:8080 in your web browser.

For more advanced configurations, you can use a YAML file:

kafka:
  clusters:
    - name: local
      bootstrapServers: kafka:9092
      schemaRegistry: http://schema-registry:8081
      ksqldbServer: http://ksqldb-server:8088

Then run the container with the config file:

docker run -p 8080:8080 \
    -v /path/to/config.yml:/etc/kafkaui/config.yml \
    -d provectuslabs/kafka-ui:latest

For more detailed instructions and configuration options, refer to the project's GitHub repository and documentation.

Competitor Comparisons

11,796

CMAK is a tool for managing Apache Kafka clusters

Pros of CMAK

  • More mature project with longer history and wider adoption
  • Offers more advanced features for cluster management and monitoring
  • Supports multiple Kafka clusters management from a single interface

Cons of CMAK

  • Less intuitive user interface compared to kafka-ui
  • Requires more setup and configuration
  • Limited support for newer Kafka features and versions

Code Comparison

CMAK (Scala):

def getClusterList: Action[AnyContent] = Action.async { implicit request: RequestHeader =>
  kafkaManager.getClusterList.map { errorOrClusterList =>
    errorOrClusterList.fold(
      error => BadRequest(views.html.common.resultOfCommand(
        views.html.navigation.defaultMenu(),
        models.navigation.Menus.clusterListMenu,
        models.navigation.QuickRoutes.clusters,
        "Error",
        error.msg
      )),
      clusterList => Ok(views.html.cluster.clusterList(clusterList))
    )
  }
}

kafka-ui (Java):

@GetMapping
public Mono<ClusterDTO> getCluster(@PathVariable String clusterName) {
    return clusterService.getCluster(clusterName)
            .map(clusterMapper::toDto);
}

The code snippets show different approaches to handling cluster-related operations, with CMAK using Scala and kafka-ui using Java with Spring WebFlux.

5,433

Kafka Web UI

Pros of Kafdrop

  • Lightweight and simple to set up
  • Supports viewing consumer group information
  • Offers a clean, minimalist interface

Cons of Kafdrop

  • Limited features compared to Kafka-UI
  • Less active development and community support
  • Lacks advanced management capabilities

Code Comparison

Kafdrop (Java):

@GetMapping("/topic/{name:.+}")
public String topicDetails(@PathVariable("name") String topicName,
                           @RequestParam(value = "view", required = false) String view,
                           Model model) {
    final var topic = kafkaMonitor.getTopic(topicName)
            .orElseThrow(() -> new TopicNotFoundException(topicName));
    model.addAttribute("topic", topic);
    model.addAttribute("consumers", kafkaMonitor.getConsumers(topic));
    return "topic-detail";
}

Kafka-UI (TypeScript):

export const fetchTopicDetails = createAsyncThunk(
  'topicDetails/fetchTopicDetails',
  async ({ clusterName, topicName }: FetchTopicDetailsParams) => {
    const response = await api.getTopicDetails({ clusterName, topicName });
    return response;
  }
);

Both repositories provide web-based UIs for Apache Kafka management, but Kafka-UI offers a more comprehensive feature set and active development. Kafdrop is simpler and may be suitable for basic monitoring needs, while Kafka-UI is better suited for advanced Kafka cluster management and monitoring.

3,348

Kafka GUI for Apache Kafka to manage topics, topics data, consumers group, schema registry, connect and more...

Pros of AKHQ

  • More extensive feature set, including advanced ACL management and KSQL integration
  • Better support for multi-cluster environments
  • More customizable UI with themes and localization options

Cons of AKHQ

  • Steeper learning curve due to more complex interface
  • Less frequent updates and potentially slower bug fixes
  • Higher resource consumption, especially for large Kafka clusters

Code Comparison

AKHQ (Kotlin):

@GetMapping("/api/cluster/{clusterId}/topic")
fun listTopics(@PathVariable clusterId: String): List<TopicDTO> {
    return kafkaModule.getTopics(clusterId)
}

Kafka-UI (Java):

@GetMapping("/api/clusters/{clusterName}/topics")
public List<TopicDTO> getAllTopics(@PathVariable String clusterName) {
    return topicService.getAllTopics(clusterName);
}

Both projects use similar RESTful API structures for retrieving topics, with AKHQ using Kotlin and Kafka-UI using Java. The main differences lie in naming conventions and parameter handling, but the overall approach is comparable.

5,388

Generic command line non-JVM Apache Kafka producer and consumer

Pros of kcat

  • Lightweight command-line tool for quick Kafka operations
  • Versatile for both producing and consuming messages
  • Supports various data formats and compression methods

Cons of kcat

  • Limited graphical interface for visualizing Kafka data
  • Lacks advanced cluster management features
  • Steeper learning curve for non-technical users

Code Comparison

kcat (producing a message):

echo "Hello, Kafka" | kcat -b localhost:9092 -t my-topic

kafka-ui (viewing topics via API):

curl -X GET "http://localhost:8080/api/clusters/{clusterId}/topics" \
     -H "accept: application/json"

Key Differences

  • kafka-ui provides a web-based GUI for Kafka management, while kcat is a command-line tool
  • kafka-ui offers more comprehensive cluster management and monitoring features
  • kcat excels in quick, scriptable Kafka operations, ideal for DevOps and automation tasks
  • kafka-ui is better suited for team collaboration and visual data exploration
  • kcat has a smaller footprint and is easier to integrate into existing workflows

Both tools serve different purposes in the Kafka ecosystem, with kcat focusing on simplicity and efficiency for command-line operations, and kafka-ui providing a more user-friendly, feature-rich interface for Kafka cluster management and monitoring.

Convert Figma logo designs to code with AI

Visual Copilot

Introducing Visual Copilot: A new AI model to turn Figma designs to high quality code using your components.

Try Visual Copilot

README

UI for Apache Kafka logo UI for Apache Kafka 

Versatile, fast and lightweight web UI for managing Apache Kafka® clusters. Built by developers, for developers.


License UI for Apache Kafka Price Free Release version Chat with us Docker pulls

DOCS • QUICK START • COMMUNITY DISCORD
AWS Marketplace • ProductHunt

UI for Apache Kafka is a free, open-source web UI to monitor and manage Apache Kafka clusters.

UI for Apache Kafka is a simple tool that makes your data flows observable, helps find and troubleshoot issues faster and deliver optimal performance. Its lightweight dashboard makes it easy to track key metrics of your Kafka clusters - Brokers, Topics, Partitions, Production, and Consumption.

DISCLAIMER

UI for Apache Kafka is a free tool built and supported by the open-source community. Curated by Provectus, it will remain free and open-source, without any paid features or subscription plans to be added in the future. Looking for the help of Kafka experts? Provectus can help you design, build, deploy, and manage Apache Kafka clusters and streaming applications. Discover Professional Services for Apache Kafka, to unlock the full potential of Kafka in your enterprise!

Set up UI for Apache Kafka with just a couple of easy commands to visualize your Kafka data in a comprehensible way. You can run the tool locally or in the cloud.

Interface

Features

  • Multi-Cluster Management — monitor and manage all your clusters in one place
  • Performance Monitoring with Metrics Dashboard — track key Kafka metrics with a lightweight dashboard
  • View Kafka Brokers — view topic and partition assignments, controller status
  • View Kafka Topics — view partition count, replication status, and custom configuration
  • View Consumer Groups — view per-partition parked offsets, combined and per-partition lag
  • Browse Messages — browse messages with JSON, plain text, and Avro encoding
  • Dynamic Topic Configuration — create and configure new topics with dynamic configuration
  • Configurable Authentification — secure your installation with optional Github/Gitlab/Google OAuth 2.0
  • Custom serialization/deserialization plugins - use a ready-to-go serde for your data like AWS Glue or Smile, or code your own!
  • Role based access control - manage permissions to access the UI with granular precision
  • Data masking - obfuscate sensitive data in topic messages

The Interface

UI for Apache Kafka wraps major functions of Apache Kafka with an intuitive user interface.

Interface

Topics

UI for Apache Kafka makes it easy for you to create topics in your browser by several clicks, pasting your own parameters, and viewing topics in the list.

Create Topic

It's possible to jump from connectors view to corresponding topics and from a topic to consumers (back and forth) for more convenient navigation. connectors, overview topic settings.

Connector_Topic_Consumer

Messages

Let's say we want to produce messages for our topic. With the UI for Apache Kafka we can send or write data/messages to the Kafka topics without effort by specifying parameters, and viewing messages in the list.

Produce Message

Schema registry

There are 3 supported types of schemas: Avro®, JSON Schema, and Protobuf schemas.

Create Schema Registry

Before producing avro/protobuf encoded messages, you have to add a schema for the topic in Schema Registry. Now all these steps are easy to do with a few clicks in a user-friendly interface.

Avro Schema Topic

Getting Started

To run UI for Apache Kafka, you can use either a pre-built Docker image or build it (or a jar file) yourself.

Quick start (Demo run)

docker run -it -p 8080:8080 -e DYNAMIC_CONFIG_ENABLED=true provectuslabs/kafka-ui

Then access the web UI at http://localhost:8080

The command is sufficient to try things out. When you're done trying things out, you can proceed with a persistent installation

Persistent installation

services:
  kafka-ui:
    container_name: kafka-ui
    image: provectuslabs/kafka-ui:latest
    ports:
      - 8080:8080
    environment:
      DYNAMIC_CONFIG_ENABLED: 'true'
    volumes:
      - ~/kui/config.yml:/etc/kafkaui/dynamic_config.yaml

Please refer to our configuration page to proceed with further app configuration.

Some useful configuration related links

Web UI Cluster Configuration Wizard

Configuration file explanation

Docker Compose examples

Misc configuration properties

Helm charts

Quick start

Building from sources

Quick start with building

Liveliness and readiness probes

Liveliness and readiness endpoint is at /actuator/health.
Info endpoint (build info) is located at /actuator/info.

Configuration options

All of the environment variables/config properties could be found here.

Contributing

Please refer to contributing guide, we'll guide you from there.