Explore Projects
Discover 140 open source projects
Showing 1-20 of 140 projects
pathwaycom/pathway
Python ETL framework for real-time analytics and LLM pipelines
pathwaycom/llm-app
AI pipelines for RAG, enterprise search, and document indexing with real-time data sync
DataTalksClub/data-engineering-zoomcamp
Free 9-week data engineering course with hands-on modules on pipelines, dbt, Kafka, and Spark
apache/kafka
Distributed event streaming platform for data pipelines and real-time apps
yudaocode/SpringBoot-Labs
Spring Boot and cloud ecosystem examples and tutorials
heibaiying/BigData-Notes
A comprehensive guide to big data technologies like Hadoop, Spark, Kafka, and more for developers.
influxdata/telegraf
Agent for collecting, processing, aggregating, and writing metrics, logs, and other data.
zhisheng17/flink-learning
This is a comprehensive learning resource for the Flink stream processing framework, covering concepts, principles, and real-world use cases.
aalansehaiyang/technology-talk
A comprehensive collection of Java-related resources for developers, including interview prep, architecture guides, and popular middleware.
sogou/workflow
A C++ framework for parallel computing and asynchronous networking, supporting a variety of backends like Consul, Kafka, and Redis.
debezium/debezium
An open-source framework for change data capture from various databases using Apache Kafka.
IBM/sarama
Sarama is a Go library for Apache Kafka, a distributed streaming platform for building real-time data pipelines.
yahoo/CMAK
CMAK is a tool for managing Apache Kafka clusters, a popular distributed streaming platform.
provectus/kafka-ui
An open-source web UI for managing Apache Kafka clusters, supporting developers working with event streaming.
redpanda-data/redpanda
Redpanda is a high-performance, Kafka-compatible data streaming platform for developers.
kubeshark/kubeshark
A powerful API traffic analyzer for Kubernetes, providing deep packet inspection and observability.
wangzhiwubigdata/God-Of-BigData
A comprehensive collection of resources and learning materials for big data technologies like Flink, Spark, Hadoop, and Hive.
AutoMQ/automq
A diskless Kafka on S3, offering cost-effectiveness and low latency.
ThreeDotsLabs/watermill
An open-source Go library for building event-driven applications with support for various message brokers.
risingwavelabs/risingwave
An open-source, Rust-based event streaming platform for real-time data processing and analytics.
Stay in the loop
Get weekly updates on trending AI coding tools and projects.