Explore Projects

Discover 36 open source projects

Active filters (1):
Search: stream-processingร—
Clear all

Showing 1-20 of 36 projects

pathwaycom/pathway

Python ETL framework for real-time analytics and LLM pipelines

59.5K
Active
Python
LLM Frameworks
ETL & Pipelines
Python
#etl#real-time#llm

google-ai-edge/mediapipe

Cross-platform ML framework for real-time media processing

34.0K
Active
C++
Inference
Computer Vision
MediaPipe
#ml-framework#real-time-processing#android

vectordotdev/vector

High-performance observability data pipeline for logs and metrics

21.4K
Active
Rust
Monitoring
ETL & Pipelines
#observability#data-pipeline#logs

zhisheng17/flink-learning

This is a comprehensive learning resource for the Flink stream processing framework, covering concepts, principles, and real-world use cases.

15.1K
Experimental
Java
Databases
#stream-processing#flink#kafka

oxnr/awesome-bigdata

A curated list of awesome big data frameworks, resources and other awesomeness.

14.3K
Stable
Databases
#big-data#data-analytics#data-science

madd86/awesome-system-design

A curated list of awesome System Design resources for developers working on distributed systems.

11.8K
Archived
API Frameworks
Node
#distributed-systems#microservices#nosql

redpanda-data/redpanda

Redpanda is a high-performance, Kafka-compatible data streaming platform for developers.

11.8K
Active
C++
Realtime
#streaming#real-time#kafka

ThreeDotsLabs/watermill

An open-source Go library for building event-driven applications with support for various message brokers.

9.6K
Active
Go
API Frameworks
Go
#event-driven#cqrs#event-sourcing

risingwavelabs/risingwave

An open-source, Rust-based event streaming platform for real-time data processing and analytics.

8.8K
Active
Rust
API Frameworks
Databases
Rust
#event-streaming#real-time#data-processing

redpanda-data/connect

A highly configurable, production-ready stream processing platform for building real-time data pipelines.

8.6K
Active
Go
Realtime
ETL & Pipelines
Go
#stream-processing#message-queue#data-engineering

fluent/fluent-bit

Fluent Bit is a fast and lightweight log, metrics, and traces processor for Linux, BSD, OSX, and Windows.

7.7K
Active
C
API Frameworks
ETL & Pipelines
#logging#metrics#traces

robinhood/faust

A Python library for building high-performance, event-driven microservices and stream processing applications.

6.8K
Archived
Python
API Frameworks
Realtime
Python
#streaming#event-driven#microservices

hazelcast/hazelcast

Hazelcast is a high-performance, distributed in-memory data platform for real-time insights and stream processing.

6.6K
Active
Java
Caching
Realtime
#big-data#distributed#in-memory

online-ml/river

A Python library for online machine learning, enabling incremental and real-time learning on data streams.

5.7K
Active
Python
ML Ops
Streaming
Python
#concept-drift#incremental-learning#online-learning

fluvio-community/fluvio

Fluvio is an event stream processing engine for developers to build responsive data-intensive apps.

5.2K
Active
Rust
Data Pipelines
Realtime
Rust
#streaming#real-time#data-processing

ag2ai/faststream

FastStream is an asynchronous Python framework for building services that interact with event streams like Kafka, NATS, and Redis.

5.0K
Active
Python
API Frameworks
Caching
#asyncio#distributed-systems#kafka

ArroyoSystems/arroyo

Distributed stream processing engine in Rust for building robust, high-performance data pipelines.

4.8K
Active
Rust
API Frameworks
Databases
#data-processing#stream-processing#kafka

memgraph/memgraph

Open-source graph database optimized for dynamic analytics and streaming data environments.

3.8K
Active
C++
Databases
Realtime
#graph-database#streaming#realtime

PeerDB-io/peerdb

Fast, cost-effective data replication tool from Postgres to data warehouses, queues, and storage

3.0K
Active
Go
ETL & Pipelines
Realtime
#postgres#data-replication#etl

manuzhang/awesome-streaming

A curated list of awesome streaming frameworks and applications.

3.0K
Experimental
React
#streaming#awesome-list#list
2

Stay in the loop

Get weekly updates on trending AI coding tools and projects.