Explore Projects

Discover 21 open source projects

Active filters (1):
Search: dagsร—
Clear all

Showing 1-20 of 21 projects

apache/airflow

Apache Airflow for workflow orchestration

44.5K
Active
Python
ETL & Pipelines
Background Jobs
Python
#airflow#data-pipelines#workflow-orchestration

marimo-team/marimo

Reactive Python notebook for data science and AI with git-friendly, deployable, and AI-native features

19.5K
Active
Python
AI Code Editors
IDE Extensions
Python
#reactive-notebook#git-friendly#ai-native

argoproj/argo-workflows

Argo Workflows is a powerful open-source workflow engine for Kubernetes, enabling complex data processing and machine learning pipelines.

16.5K
Active
Go
ETL & Pipelines
Kubernetes
#kubernetes#pipelines#workflow

dagger/dagger

Dagger is an automation engine that helps developers build, test, and ship any codebase across CI/CD pipelines.

15.5K
Active
Go
CI/CD
Go
#ci-cd#automation#devops

sogou/workflow

A C++ framework for parallel computing and asynchronous networking, supporting a variety of backends like Consul, Kafka, and Redis.

14.3K
Active
C++
API Frameworks
#parallel-computing#asynchronous-networking#consul

hatchet-dev/hatchet

Hatchet is a scalable distributed task runner for building background jobs and workflows.

6.7K
Active
Python
Background Jobs
Containerization
FastAPI
#concurrency#distributed-systems#durable-execution

antvis/X6

A powerful JavaScript diagramming library that uses SVG and HTML for rendering complex diagrams and visualizations.

6.5K
Active
TypeScript
Charts & Visualization
UI Component Libraries
React
#diagramming#visualization#erd

alibaba/butterfly

A JavaScript/React/Vue diagramming library focused on flow layout for visualizing complex diagrams and workflows.

4.7K
Archived
JavaScript
Component Libraries (React)
Component Libraries (Vue/Svelte)
React
#diagramming#flowchart#dag

Netflix/maestro

Maestro is Netflix's workflow orchestrator for building data pipelines and batch processing workflows.

3.7K
Active
Java
ETL & Pipelines
Background Jobs
Java
#data-engineering#batch-processing#workflow-orchestration

chrislusf/gleam

A fast, efficient, and scalable distributed map/reduce system for DAG execution in pure Go.

3.6K
Stable
Go
Golang
#distributed-computing#map-reduce#scalable

apache/hamilton

Hamilton is an open-source ETL framework that helps data scientists and engineers build modular, testable dataflows with lineage and metadata.

2.4K
Active
Jupyter Notebook
ETL & Pipelines
MLOps
Python
#etl#data-engineering#data-science

apache/burr

Burr is a Python-based framework for building AI-powered applications and agents that can monitor, trace, and execute on your own infrastructure.

1.9K
Active
Python
LLM Frameworks
Agents & Orchestration
Python
#chatbot#llms#mlops

teamclairvoyant/airflow-maintenance-dags

A set of Airflow DAGs to help maintain and manage the operation of an Airflow deployment.

1.8K
Archived
Python
API Frameworks
ETL & Pipelines
Apache Airflow
#airflow#maintenance#cleanup

Qiskit/rustworkx

A high-performance Python graph library implemented in Rust for efficient graph operations.

1.6K
Active
Rust
API Clients & Testing
Graph Databases
#dag#graph#graph-theory

aiceking/AppStartFaster

Android cold start optimization using a Directed Acyclic Graph (DAG) launcher.

1.6K
Archived
Java
Android
CLI Tools
Android
#android#cold-start-optimization#directed-acyclic-graph

san089/goodreads_etl_pipeline

An end-to-end data pipeline for building a data lake, data warehouse, and analytics platform from GoodReads data.

1.5K
Archived
Python
ETL & Pipelines
Background Jobs
Apache Airflow
#data-engineering#etl-pipeline#data-lake

astronomer/dag-factory

Declaratively construct Apache Airflow DAGs with YAML configuration files, simplifying complex data pipeline management.

1.4K
Active
Python
API Frameworks
ETL & Pipelines
Python
#airflow#data-pipelines#etl

DTStack/Taier

A big data development platform for submission, scheduling, operation and maintenance, and indicator information display.

1.3K
Archived
Java
API Frameworks
ETL & Pipelines
Flink
#big-data#data-pipeline#task-scheduling

bellaj/Blockchain

Comprehensive collection of blockchain and cryptocurrency resources, including whitepapers, scientific papers, and more.

1.2K
Archived
JavaScript
Cryptocurrencies
API Frameworks
#blockchain#cryptocurrencies#whitepaper

astronomer/astronomer-cosmos

Run your dbt Core or dbt Fusion projects as Apache Airflow DAGs and Task Groups with a few lines of code.

1.2K
Active
Python
API Frameworks
ETL & Pipelines
Python
#airflow#dbt#workflow
2

Stay in the loop

Get weekly updates on trending AI coding tools and projects.