Explore Projects
Discover 299 open source projects
Showing 21-40 of 299 projects
PrefectHQ/prefect
Workflow orchestration for resilient data pipelines in Python
vectordotdev/vector
High-performance observability data pipeline for logs and metrics
airbytehq/airbyte
Data integration platform for ELT pipelines from APIs, databases & files to databases, warehouses & lakes
apache/shardingsphere
Distributed SQL database middleware for sharding, scalability, and security
marimo-team/marimo
Reactive Python notebook for data science and AI with git-friendly, deployable, and AI-native features
Avaiga/taipy
Taipy is a Python library that helps developers turn data and AI algorithms into production-ready web apps quickly.
spotify/luigi
Luigi is a Python module that helps developers build complex batch job pipelines with dependency management and workflow orchestration.
argoproj/argo-workflows
Argo Workflows is a powerful open-source workflow engine for Kubernetes, enabling complex data processing and machine learning pipelines.
dagger/dagger
Dagger is an automation engine that helps developers build, test, and ship any codebase across CI/CD pipelines.
kubeflow/kubeflow
Kubeflow is a machine learning toolkit for building and deploying scalable ML pipelines on Kubernetes.
getmaxun/maxun
Turn websites into clean data pipelines & structured APIs in minutes with a low-code web scraping tool.
dagster-io/dagster
An open-source data orchestration platform for developing, running, and observing data pipelines and workflows.
llmware-ai/llmware
Unified framework for building enterprise RAG pipelines with small, specialized models
elastic/logstash
Logstash is a powerful open-source data processing pipeline that can ingest, transform, and output data from a variety of sources.
apache/dolphinscheduler
Apache DolphinScheduler is a modern data orchestration platform for creating high-performance workflows with low-code.
Unstructured-IO/unstructured
Unstructured is an open-source ETL solution for transforming complex documents into structured data for language models.
memvid/memvid
A Rust-based memory layer for AI agents, enabling serverless, single-file memory with instant retrieval and long-term storage.
CodisLabs/codis
Codis is a proxy-based Redis cluster solution that supports pipelining and dynamic scaling.
assimp/assimp
An open-source library that simplifies the process of loading 3D file formats into a unified data structure for game development and asset pipelines.
debezium/debezium
An open-source framework for change data capture from various databases using Apache Kafka.
Stay in the loop
Get weekly updates on trending AI coding tools and projects.