Top Related Projects
Quick Overview
Kafka-UI is an open-source web UI for Apache Kafka management. It provides a user-friendly interface for monitoring and managing Kafka clusters, topics, and messages, making it easier for developers and operations teams to work with Kafka ecosystems.
Pros
- User-friendly interface for managing Kafka clusters
- Supports multiple clusters in a single UI
- Provides real-time monitoring and metrics visualization
- Offers KSQL and Schema Registry integration
Cons
- Limited advanced configuration options compared to native Kafka tools
- May require additional setup and maintenance alongside Kafka infrastructure
- Performance might be impacted when dealing with very large clusters or high message volumes
Getting Started
To run Kafka-UI using Docker:
docker run -p 8080:8080 \
-e KAFKA_CLUSTERS_0_NAME=local \
-e KAFKA_CLUSTERS_0_BOOTSTRAPSERVERS=kafka:9092 \
-d provectuslabs/kafka-ui:latest
After running the container, access the UI by navigating to http://localhost:8080
in your web browser.
For more advanced configurations, you can use a YAML file:
kafka:
clusters:
- name: local
bootstrapServers: kafka:9092
schemaRegistry: http://schema-registry:8081
ksqldbServer: http://ksqldb-server:8088
Then run the container with the config file:
docker run -p 8080:8080 \
-v /path/to/config.yml:/etc/kafkaui/config.yml \
-d provectuslabs/kafka-ui:latest
For more detailed instructions and configuration options, refer to the project's GitHub repository and documentation.
Competitor Comparisons
CMAK is a tool for managing Apache Kafka clusters
Pros of CMAK
- More mature project with longer history and wider adoption
- Offers more advanced features for cluster management and monitoring
- Supports multiple Kafka clusters management from a single interface
Cons of CMAK
- Less intuitive user interface compared to kafka-ui
- Requires more setup and configuration
- Limited support for newer Kafka features and versions
Code Comparison
CMAK (Scala):
def getClusterList: Action[AnyContent] = Action.async { implicit request: RequestHeader =>
kafkaManager.getClusterList.map { errorOrClusterList =>
errorOrClusterList.fold(
error => BadRequest(views.html.common.resultOfCommand(
views.html.navigation.defaultMenu(),
models.navigation.Menus.clusterListMenu,
models.navigation.QuickRoutes.clusters,
"Error",
error.msg
)),
clusterList => Ok(views.html.cluster.clusterList(clusterList))
)
}
}
kafka-ui (Java):
@GetMapping
public Mono<ClusterDTO> getCluster(@PathVariable String clusterName) {
return clusterService.getCluster(clusterName)
.map(clusterMapper::toDto);
}
The code snippets show different approaches to handling cluster-related operations, with CMAK using Scala and kafka-ui using Java with Spring WebFlux.
Kafka Web UI
Pros of Kafdrop
- Lightweight and simple to set up
- Supports viewing consumer group information
- Offers a clean, minimalist interface
Cons of Kafdrop
- Limited features compared to Kafka-UI
- Less active development and community support
- Lacks advanced management capabilities
Code Comparison
Kafdrop (Java):
@GetMapping("/topic/{name:.+}")
public String topicDetails(@PathVariable("name") String topicName,
@RequestParam(value = "view", required = false) String view,
Model model) {
final var topic = kafkaMonitor.getTopic(topicName)
.orElseThrow(() -> new TopicNotFoundException(topicName));
model.addAttribute("topic", topic);
model.addAttribute("consumers", kafkaMonitor.getConsumers(topic));
return "topic-detail";
}
Kafka-UI (TypeScript):
export const fetchTopicDetails = createAsyncThunk(
'topicDetails/fetchTopicDetails',
async ({ clusterName, topicName }: FetchTopicDetailsParams) => {
const response = await api.getTopicDetails({ clusterName, topicName });
return response;
}
);
Both repositories provide web-based UIs for Apache Kafka management, but Kafka-UI offers a more comprehensive feature set and active development. Kafdrop is simpler and may be suitable for basic monitoring needs, while Kafka-UI is better suited for advanced Kafka cluster management and monitoring.
Kafka GUI for Apache Kafka to manage topics, topics data, consumers group, schema registry, connect and more...
Pros of AKHQ
- More extensive feature set, including advanced ACL management and KSQL integration
- Better support for multi-cluster environments
- More customizable UI with themes and localization options
Cons of AKHQ
- Steeper learning curve due to more complex interface
- Less frequent updates and potentially slower bug fixes
- Higher resource consumption, especially for large Kafka clusters
Code Comparison
AKHQ (Kotlin):
@GetMapping("/api/cluster/{clusterId}/topic")
fun listTopics(@PathVariable clusterId: String): List<TopicDTO> {
return kafkaModule.getTopics(clusterId)
}
Kafka-UI (Java):
@GetMapping("/api/clusters/{clusterName}/topics")
public List<TopicDTO> getAllTopics(@PathVariable String clusterName) {
return topicService.getAllTopics(clusterName);
}
Both projects use similar RESTful API structures for retrieving topics, with AKHQ using Kotlin and Kafka-UI using Java. The main differences lie in naming conventions and parameter handling, but the overall approach is comparable.
Generic command line non-JVM Apache Kafka producer and consumer
Pros of kcat
- Lightweight command-line tool for quick Kafka operations
- Versatile for both producing and consuming messages
- Supports various data formats and compression methods
Cons of kcat
- Limited graphical interface for visualizing Kafka data
- Lacks advanced cluster management features
- Steeper learning curve for non-technical users
Code Comparison
kcat (producing a message):
echo "Hello, Kafka" | kcat -b localhost:9092 -t my-topic
kafka-ui (viewing topics via API):
curl -X GET "http://localhost:8080/api/clusters/{clusterId}/topics" \
-H "accept: application/json"
Key Differences
- kafka-ui provides a web-based GUI for Kafka management, while kcat is a command-line tool
- kafka-ui offers more comprehensive cluster management and monitoring features
- kcat excels in quick, scriptable Kafka operations, ideal for DevOps and automation tasks
- kafka-ui is better suited for team collaboration and visual data exploration
- kcat has a smaller footprint and is easier to integrate into existing workflows
Both tools serve different purposes in the Kafka ecosystem, with kcat focusing on simplicity and efficiency for command-line operations, and kafka-ui providing a more user-friendly, feature-rich interface for Kafka cluster management and monitoring.
Convert designs to code with AI
Introducing Visual Copilot: A new AI model to turn Figma designs to high quality code using your components.
Try Visual CopilotREADME
UI for Apache Kafka
Versatile, fast and lightweight web UI for managing Apache Kafka® clusters. Built by developers, for developers.
DOCS â¢
QUICK START â¢
COMMUNITY DISCORD
AWS Marketplace â¢
ProductHunt
UI for Apache Kafka is a free, open-source web UI to monitor and manage Apache Kafka clusters.
UI for Apache Kafka is a simple tool that makes your data flows observable, helps find and troubleshoot issues faster and deliver optimal performance. Its lightweight dashboard makes it easy to track key metrics of your Kafka clusters - Brokers, Topics, Partitions, Production, and Consumption.
DISCLAIMER
UI for Apache Kafka is a free tool built and supported by the open-source community. Curated by Provectus, it will remain free and open-source, without any paid features or subscription plans to be added in the future. Looking for the help of Kafka experts? Provectus can help you design, build, deploy, and manage Apache Kafka clusters and streaming applications. Discover Professional Services for Apache Kafka, to unlock the full potential of Kafka in your enterprise!
Set up UI for Apache Kafka with just a couple of easy commands to visualize your Kafka data in a comprehensible way. You can run the tool locally or in the cloud.
Features
- Multi-Cluster Management â monitor and manage all your clusters in one place
- Performance Monitoring with Metrics Dashboard â track key Kafka metrics with a lightweight dashboard
- View Kafka Brokers â view topic and partition assignments, controller status
- View Kafka Topics â view partition count, replication status, and custom configuration
- View Consumer Groups â view per-partition parked offsets, combined and per-partition lag
- Browse Messages â browse messages with JSON, plain text, and Avro encoding
- Dynamic Topic Configuration â create and configure new topics with dynamic configuration
- Configurable Authentification â secure your installation with optional Github/Gitlab/Google OAuth 2.0
- Custom serialization/deserialization plugins - use a ready-to-go serde for your data like AWS Glue or Smile, or code your own!
- Role based access control - manage permissions to access the UI with granular precision
- Data masking - obfuscate sensitive data in topic messages
The Interface
UI for Apache Kafka wraps major functions of Apache Kafka with an intuitive user interface.
Topics
UI for Apache Kafka makes it easy for you to create topics in your browser by several clicks, pasting your own parameters, and viewing topics in the list.
It's possible to jump from connectors view to corresponding topics and from a topic to consumers (back and forth) for more convenient navigation. connectors, overview topic settings.
Messages
Let's say we want to produce messages for our topic. With the UI for Apache Kafka we can send or write data/messages to the Kafka topics without effort by specifying parameters, and viewing messages in the list.
Schema registry
There are 3 supported types of schemas: Avro®, JSON Schema, and Protobuf schemas.
Before producing avro/protobuf encoded messages, you have to add a schema for the topic in Schema Registry. Now all these steps are easy to do with a few clicks in a user-friendly interface.
Getting Started
To run UI for Apache Kafka, you can use either a pre-built Docker image or build it (or a jar file) yourself.
Quick start (Demo run)
docker run -it -p 8080:8080 -e DYNAMIC_CONFIG_ENABLED=true provectuslabs/kafka-ui
Then access the web UI at http://localhost:8080
The command is sufficient to try things out. When you're done trying things out, you can proceed with a persistent installation
Persistent installation
services:
kafka-ui:
container_name: kafka-ui
image: provectuslabs/kafka-ui:latest
ports:
- 8080:8080
environment:
DYNAMIC_CONFIG_ENABLED: 'true'
volumes:
- ~/kui/config.yml:/etc/kafkaui/dynamic_config.yaml
Please refer to our configuration page to proceed with further app configuration.
Some useful configuration related links
Web UI Cluster Configuration Wizard
Configuration file explanation
Helm charts
Building from sources
Quick start with building
Liveliness and readiness probes
Liveliness and readiness endpoint is at /actuator/health
.
Info endpoint (build info) is located at /actuator/info
.
Configuration options
All of the environment variables/config properties could be found here.
Contributing
Please refer to contributing guide, we'll guide you from there.
Top Related Projects
Convert designs to code with AI
Introducing Visual Copilot: A new AI model to turn Figma designs to high quality code using your components.
Try Visual Copilot