Manage your topic's configuration (partitions, replication factor, parameters), ACLs, quotas, users and get stats, without any effort with this library. It does not use the Kafka scripts and does not require ssh connection to the remote broker.
A real-time event pipeline around Kafka Ecosystem for Chicago Transit Authority.
This MLOps project productionizes a Deep Reinforcement Learning agent with a scalable, distributed data streaming infrastructure using Kafka and Ray. A thorough walkthrough of the code is described in this article on medium: https://ryanraymartin.medium.com/deep-reinforcement-learning-for-stock-trading-with-kafka-and-rllib-d738b9634675
Open-Source Apache Kafka Governance Platform
A Kafka python library for Robotframework to test events(messages) in Kafka.
Detection of DDOS Attack using Kafka and Spark Streaming
Python prometheus client for kafka logsize(Prometheus基于kafka logsize监控)
A scalable architecture for real-time log processing and visualization. Built with a Kafka-Spark ETL pipeline, DynamoDB for storing aggregate real-time metrics, and Python Dash for interactive dashboards. Designed for high-throughput log ingestion, real-time monitoring, and long-term storage.
Repo for a simple base python http server using Flask and Kafka-Python
Live sentiment analysis of tweets using Kafka
Learning Kafka Standalone and Distributed Mode
Real-time data streaming project using Python, Pandas, and Confluent Kafka to publish and consume retail data through Kafka topics, demonstrating scalability and dynamic consumer behavior.
Stream data between two databases . Supports both ddl and dml statements. Built on top of kafka and debezium in python
RealTimeIncrementalSync is a real-time data streaming system that fetches product updates from a MySQL database, serializes the data in Avro format, and streams it to Kafka. Kafka consumers deserialize the data and append it to JSON files, enabling real-time monitoring and analysis of product information.
L'objectif c'est de mettre en place des pipelines batch, streaming, et de qualité de données afin d’assurer la fiabilité, la cohérence et la fraîcheur des données pour les analyses.
A complete DataOps + AI project for streaming text analytics using Kafka, Spark Streaming, Hugging Face Transformers, Elasticsearch, Kibana, and Airflow.
(Mirror: moved to https://gitlab.esss.lu.se/ecdc/ess-dmsc/wherefore) Simple tool for listing known flatbuffer sources on a Kafka topic
A data pipeline demo that streams structured data from Kafka to TimescaleDB using Kafka Connect, ideal for real-time analytics and time-series storage.
Este projeto realiza testes em tópicos kafka (Pub/Sub).
Add a description, image, and links to the kafka-topic topic page so that developers can more easily learn about it.
To associate your repository with the kafka-topic topic, visit your repo's landing page and select "manage topics."