Explore Projects
Discover 63 open source projects
Showing 1-20 of 63 projects
pathwaycom/pathway
Python ETL framework for real-time analytics and LLM pipelines
apache/airflow
Apache Airflow for workflow orchestration
airbytehq/airbyte
Data integration platform for ELT pipelines from APIs, databases & files to databases, warehouses & lakes
dagster-io/dagster
An open-source data orchestration platform for developing, running, and observing data pipelines and workflows.
elastic/logstash
Logstash is a powerful open-source data processing pipeline that can ingest, transform, and output data from a variety of sources.
Unstructured-IO/unstructured
Unstructured is an open-source ETL solution for transforming complex documents into structured data for language models.
risingwavelabs/risingwave
An open-source, Rust-based event streaming platform for real-time data processing and analytics.
mage-ai/mage-ai
mage-ai is a Python-based platform for building, running, and managing data pipelines and integrating/transforming data.
redpanda-data/connect
A highly configurable, production-ready stream processing platform for building real-time data pipelines.
pentaho/pentaho-kettle
Pentaho Data Integration (ETL) is a Java-based tool for building data integration and ETL pipelines.
turbot/steampipe
Steampipe is a zero-ETL, SQL-powered platform for live querying cloud APIs and infrastructure.
apache/flink-cdc
Flink CDC is a streaming data integration tool that enables real-time data pipelines and change data capture.
cloudquery/cloudquery
Data pipelines for cloud config and security data, enabling CSPM, FinOps, and vulnerability management solutions.
cocoindex-io/cocoindex
Data transformation framework for AI with ultra-fast, incremental processing capabilities.
Eventual-Inc/Daft
High-performance data engine for AI and multimodal workloads, processing images, audio, video, and structured data at scale.
jitsucom/jitsu
Open-source data pipeline engine for real-time ETL, connecting data sources to warehouses like BigQuery, Snowflake, Redshift.
rudderlabs/rudder-server
Rudder Server is a privacy-focused, Segment-alternative customer data platform written in Go and React.
apache/streampark
Easy-to-use streaming application development framework and operation platform for building ETL pipelines.
quadratichq/quadratic
A spreadsheet tool with AI capabilities for data analysis, engineering, and visualization.
Netflix/maestro
Maestro is Netflix's workflow orchestrator for building data pipelines and batch processing workflows.
Stay in the loop
Get weekly updates on trending AI coding tools and projects.