ETL & Pipelines
Explore 310 open source projects in ETL & Pipelines
Showing 1-20 of 310 projects
OpenBB-finance/OpenBB
Financial data platform for analysts, quants, and AI agents
pathwaycom/pathway
Python ETL framework for real-time analytics and LLM pipelines
pandas-dev/pandas
Core data analysis library for Python with labeled data structures and statistical functions
jakevdp/PythonDataScienceHandbook
Python Data Science Handbook in Jupyter Notebooks
apache/airflow
Apache Airflow for workflow orchestration
streamlit/streamlit
Streamlit is a Python library for building and sharing interactive data apps quickly.
apache/spark
Unified analytics engine for large-scale data processing
DataExpert-io/data-engineer-handbook
Comprehensive data engineering resource hub with learning paths, books, communities, and tools
DataTalksClub/data-engineering-zoomcamp
Free 9-week data engineering course with hands-on modules on pipelines, dbt, Kafka, and Spark
mindsdb/mindsdb
Federated query engine for AI with built-in MCP server
microsoft/qlib
AI-powered quantitative investment platform for finance and trading
pola-rs/polars
Fast DataFrame query engine in Rust with Python/Rust/Node.js/R frontends
drawdb-io/drawdb
Database diagram editor and SQL generator
SheetJS/sheetjs
SheetJS Spreadsheet Data Toolkit for data extraction and spreadsheet generation.
apache/kafka
Distributed event streaming platform for data pipelines and real-time apps
numpy/numpy
Fundamental package for scientific computing with Python
alibaba/canal
MySQL binlog incremental subscription and consumption component
CSSEGISandData/COVID-19
Real-time global and U.S. data tracking for developers and researchers.
donnemartin/data-science-ipython-notebooks
Data science Python notebooks covering deep learning, machine learning, big data, and more.
academic/awesome-datascience
Comprehensive Data Science learning and resource guide
Stay in the loop
Get weekly updates on trending AI coding tools and projects.