Explore Projects
Discover 17 open source projects
Showing 1-17 of 17 projects
apache/airflow
Apache Airflow for workflow orchestration
argoproj/argo-workflows
Argo Workflows is a powerful open-source workflow engine for Kubernetes, enabling complex data processing and machine learning pipelines.
windmill-labs/windmill
An open-source developer platform to power entire infra and turn scripts into webhooks, workflows, and UIs.
apache/dolphinscheduler
Apache DolphinScheduler is a modern data orchestration platform for creating high-performance workflows with low-code.
jghoman/awesome-apache-airflow
Curated list of resources about Apache Airflow, a popular workflow management platform.
puckel/docker-airflow
A Docker-based Apache Airflow platform for building and managing data pipelines and workflows.
WeBankFinTech/DataSphereStudio
DataSphereStudio is a one-stop data application development and management portal covering data exchange, analysis, and visualization.
elyra-ai/elyra
Elyra extends JupyterLab with an AI-centric approach for developing and deploying ML/AI pipelines.
san089/Udacity-Data-Engineering-Projects
A collection of Udacity data engineering projects showcasing various tools and technologies.
teamclairvoyant/airflow-maintenance-dags
A set of Airflow DAGs to help maintain and manage the operation of an Airflow deployment.
OBenner/data-engineering-interview-questions
This GitHub repository contains over 2,000 data engineering interview questions to help developers prepare.
san089/goodreads_etl_pipeline
An end-to-end data pipeline for building a data lake, data warehouse, and analytics platform from GoodReads data.
astronomer/dag-factory
Declaratively construct Apache Airflow DAGs with YAML configuration files, simplifying complex data pipeline management.
damklis/DataEngineeringProject
An end-to-end data engineering project example showcasing tools and technologies for building data pipelines.
gtoonstra/etl-with-airflow
This repository provides best practices and examples for building ETL (Extract, Transform, Load) pipelines using Apache Airflow.
astronomer/astronomer-cosmos
Run your dbt Core or dbt Fusion projects as Apache Airflow DAGs and Task Groups with a few lines of code.
abhishek-ch/around-dataengineering
A comprehensive knowledge hub for data engineering, machine learning, and MLOps tools and practices.
Stay in the loop
Get weekly updates on trending AI coding tools and projects.