Explore Projects

Discover 299 open source projects

Active filters (1):
Search: pipelineร—
Clear all

Showing 1-20 of 299 projects

langgenius/dify

Dify is an open-source platform for developing LLM applications with agentic workflows, RAG pipelines, and model management.

131.3K
Active
TypeScript
MCP Servers
Agents & Orchestration
TypeScript
#agentic-workflow#RAG#LLM

Comfy-Org/ComfyUI

Visual AI engine for designing and executing advanced diffusion pipelines with a node-based interface.

104.9K
Active
Python
AI Image & Video
Visual AI Builders
PyTorch
#ai#comfyui#stable-diffusion

unclecode/crawl4ai

LLM-friendly web crawler & scraper for RAG, agents, and data pipelines

61.4K
Active
Python
RAG & Vector
CLI Tools
Python
#web-crawler#llm-ready#markdown

pathwaycom/pathway

Python ETL framework for real-time analytics and LLM pipelines

59.5K
Active
Python
LLM Frameworks
ETL & Pipelines
Python
#etl#real-time#llm

pathwaycom/llm-app

AI pipelines for RAG, enterprise search, and document indexing with real-time data sync

56.2K
Stable
Jupyter Notebook
RAG & Vector
LLM Frameworks
Jupyter Notebook
#ai-pipelines#rag#llm

apache/airflow

Apache Airflow for workflow orchestration

44.5K
Active
Python
ETL & Pipelines
Background Jobs
Python
#airflow#data-pipelines#workflow-orchestration

deepspeedai/DeepSpeed

DeepSpeed optimizes deep learning training and inference with distributed computing techniques.

41.7K
Active
Python
ML Ops
Inference
PyTorch
#deep-learning#distributed-training#inference-optimization

hpcaitech/ColossalAI

Colossal-AI optimizes large AI model training and inference with distributed computing and GPU acceleration.

41.4K
Active
Python
ML Ops
Inference
PyTorch
#ai-optimization#distributed-training#gpu-acceleration

DataTalksClub/data-engineering-zoomcamp

Free 9-week data engineering course with hands-on modules on pipelines, dbt, Kafka, and Spark

38.9K
Active
Jupyter Notebook
Tutorials & Courses
ETL & Pipelines
dbt
#data-engineering#course#dbt

nushell/nushell

Nushell is a modern shell with structured data pipelines, inspired by PowerShell and functional programming.

38.6K
Active
Rust
Shell Enhancements
#shell#rust#pipeline

google-ai-edge/mediapipe

Cross-platform ML framework for real-time media processing

34.0K
Active
C++
Inference
Computer Vision
MediaPipe
#ml-framework#real-time-processing#android

harness/harness

End-to-end DevOps platform with CI/CD, code hosting, and environments

33.9K
Active
Go
CI/CD
Build Tools
Go
#ci-cd#devops#go

apache/kafka

Distributed event streaming platform for data pipelines and real-time apps

32.1K
Active
Java
ETL & Pipelines
Realtime
Java
#kafka#event-streaming#data-pipelines

kestra-io/kestra

Event-driven orchestration platform for workflows with UI and YAML

26.5K
Active
Java
Infrastructure as Code
Visual AI Builders
Java
#event-driven#yaml#orchestration

jenkinsci/jenkins

Jenkins is a leading open-source automation server for CI/CD and DevOps workflows.

25.1K
Active
Java
CI/CD
#ci-cd#devops#java

deepset-ai/haystack

AI orchestration framework for building LLM applications with pipelines and agents

24.4K
Active
MDX
Agents & Orchestration
RAG Frameworks
Python
#ai-orchestration#llm-framework#rag-systems

gitlabhq/gitlabhq

GitLab is a comprehensive DevOps platform for managing code repositories, CI/CD pipelines, and collaboration tools.

24.2K
Active
Ruby
CI/CD
Serverless
Ruby on Rails
#gitlab#ci-cd#devops

ssloy/tinyrenderer

A hands-on computer graphics course with a software renderer in C++

23.3K
Stable
C++
Tutorials & Courses
General Utilities
C++
#computer-graphics#software-renderer#c-plus-plus

argoproj/argo-cd

Argo CD is a declarative continuous delivery tool for Kubernetes, enabling GitOps-based application deployment and lifecycle management.

22.2K
Active
Go
CI/CD
#argo-cd#continuous-delivery#kubernetes

jina-ai/serve

Build and deploy AI services with cloud-native stack

21.8K
Experimental
Python
AI Model Serving
Containerization
Python
#cloud-native#ai-serving#docker
2...15

Stay in the loop

Get weekly updates on trending AI coding tools and projects.