ETL & Pipelines
Explore 310 open source projects in ETL & Pipelines
Showing 21-40 of 310 projects
apache/incubator-seata
Distributed transaction solution for microservices
apache/flink
Apache Flink is a stream processing framework for real-time and batch data processing.
plotly/dash
Build interactive data apps and dashboards with Python, no JavaScript required.
dataease/dataease
Open-source BI tool for data visualization and analysis
ranaroussi/yfinance
Python library for downloading financial data from Yahoo! Finance
PrefectHQ/prefect
Workflow orchestration for resilient data pipelines in Python
recommenders-team/recommenders
Recommenders is a project for prototyping and operationalizing recommendation systems with Jupyter notebooks and best practices.
vectordotdev/vector
High-performance observability data pipeline for logs and metrics
thingsboard/thingsboard
Open-source IoT platform for device management, data collection, and visualization
huggingface/datasets
AI-powered dataset management and preprocessing library for ML projects
airbytehq/airbyte
Data integration platform for ELT pipelines from APIs, databases & files to databases, warehouses & lakes
facebook/prophet
Time series forecasting with Prophet for multiple seasonality and growth patterns.
cube-js/cube
Open-source semantic layer for AI, BI, and embedded analytics
argoproj/argo-workflows
Argo Workflows is a powerful open-source workflow engine for Kubernetes, enabling complex data processing and machine learning pipelines.
treeverse/dvc
dvc is a data versioning and ML experiments tool that helps developers manage and track data and model changes.
dagster-io/dagster
An open-source data orchestration platform for developing, running, and observing data pipelines and workflows.
andkret/Cookbook
A comprehensive cookbook for data engineers, covering best practices, big data, and data engineering concepts.
debezium/debezium
An open-source framework for change data capture from various databases using Apache Kafka.
dbt-labs/dbt-core
dbt enables data analysts and engineers to transform data using software engineering practices.
great-expectations/great_expectations
A Python library that helps ensure data quality and reliability through data profiling and testing.
Stay in the loop
Get weekly updates on trending AI coding tools and projects.