Vybe Guide
Sign Up

Explore Projects

Discover 68 open source projects

Active filters (1):
Search: llmopsร—
Clear all

Showing 1-20 of 68 projects

pathwaycom/llm-app

AI pipelines for RAG, enterprise search, and document indexing with real-time data sync

56.2K
Stable
Jupyter Notebook
RAG & Vector
LLM Frameworks
Jupyter Notebook
#ai-pipelines#rag#llm

BerriAI/litellm

Python SDK and Proxy Server for calling 100+ LLM APIs with cost tracking and guardrails

37.9K
Active
Python
LLM Wrappers & SDKs
API Clients & Testing
Python
#llm-sdk#ai-gateway#cost-tracking

ComposioHQ/composio

Composio provides AI agents and LLMs with 100+ integrations via function calling

27.3K
Active
TypeScript
AI Tool Connectors
Agents & Orchestration
TypeScript
#ai-agents#function-calling#developer-tools

mlflow/mlflow

MLflow is an open-source platform for building, tracking, and deploying AI/ML models with end-to-end observability and evaluation tools.

24.6K
Active
Python
ML Ops
Agent Coordination
LangChain
#mlflow#ai-models#experiment-tracking

liguodongiot/llm-action

Comprehensive LLM engineering and application resources with training, inference, compression, and deployment guides

23.4K
Stable
HTML
Fine-tuning
Inference
#llm-training#llm-inference#llm-ops

langfuse/langfuse

LLM engineering platform for observability, evaluation, and prompt management

22.7K
Active
TypeScript
LLM Frameworks
LLM Wrappers & SDKs
LangChain
#llm-observability#llm-evaluation#prompt-management

jina-ai/serve

Build and deploy AI services with cloud-native stack

21.8K
Experimental
Python
AI Model Serving
Containerization
Python
#cloud-native#ai-serving#docker

comet-ml/opik

A comprehensive library for debugging, evaluating, and monitoring LLM applications, RAG systems, and agentic workflows.

18.0K
Active
Python
LLM Frameworks
Python
#llm-evaluation#llm-observability#llm-monitoring

TransformerOptimus/SuperAGI

A developer-focused open-source framework for building and managing autonomous AI agents.

17.2K
Archived
Python
LLM Frameworks
Next.js
#ai#llm#agents

raga-ai-hub/RagaAI-Catalyst

A Python SDK for agent AI observability, monitoring, and evaluation with features like tracing, debugging, and analytics.

16.1K
Active
Python
Agents & Orchestration
Python
#agentic-ai#ai-application-debugging#ai-evaluation-tools

vibrantlabsai/ragas

A Python library that helps supercharge the evaluation of large language model applications.

12.8K
Active
Python
LLM Frameworks
Python
#llm#evaluation#testing

bentoml/OpenLLM

Deploy open-source LLMs as OpenAI-compatible API endpoints using BentoML's model serving framework.

12.1K
Active
Python
AI Model Serving
Local Inference Engines
BentoML
#llm-inference#bentoml#model-serving

dataelement/bisheng

An open LLM devops platform for building next-gen enterprise AI applications with powerful features like GenAI workflow, RAG, Agent, and model management.

11.1K
Active
TypeScript
LLM Frameworks
React
#ai#llm#genai

tensorzero/tensorzero

Open-source stack for industrial-grade LLM applications, including LLM gateway, observability, optimization, evaluation, and experimentation.

11.0K
Active
Rust
LLM Frameworks
Rust
#ai#large-language-models#llms

promptfoo/promptfoo

A framework for testing and evaluating large language models, prompts, and AI agents for security and performance.

10.8K
Active
TypeScript
LLM Frameworks
TypeScript
#llm-evaluation#prompt-engineering#red-teaming

Portkey-AI/gateway

A fast, integrated AI Gateway to route to 200+ LLMs and 50+ AI Guardrails with a friendly API.

10.8K
Active
TypeScript
LLM Frameworks
React
#ai-gateway#llm#model-router

Netflix/metaflow

Build, manage and deploy AI/ML systems with Metaflow

9.9K
Active
Python
Next.js
#metaflow#ai#ml

Arize-ai/phoenix

AI observability and evaluation tooling for developers building with large language models and AI agents.

8.8K
Active
Jupyter Notebook
LLM Frameworks
Agents & Orchestration
Jupyter Notebook
#ai-monitoring#ai-observability#llm-evaluation

bentoml/BentoML

BentoML is an easy-to-use framework for building and deploying production-ready machine learning models as APIs.

8.5K
Active
Python
LLM Frameworks
API Clients & Testing
Python
#ai-inference#llm-inference#llm-serving

evidentlyai/evidently

Evidently is an open-source ML and LLM observability framework to evaluate, test, and monitor AI-powered systems.

7.3K
Active
Jupyter Notebook
MLOps
Data Validation
Jupyter Notebook
#data-quality#data-validation#model-monitoring
234

Stay in the loop

Get weekly updates on trending AI coding tools and projects.