Explore Projects

Discover 173 open source projects

Active filters (1):
Search: servingร—
Clear all

Showing 1-20 of 173 projects

vllm-project/vllm

High-throughput LLM inference engine for developers

72.1K
Active
Python
Inference
LLM Wrappers & SDKs
Hugging Face
#llm#inference#ai

ray-project/ray

Ray is a unified framework for scaling AI and Python applications with distributed computing and ML libraries.

41.6K
Active
Python
ML Ops
Containerization
Python
#distributed-computing#ml-ops#ai-framework

lm-sys/FastChat

Open platform for training, serving, and evaluating LLM chatbots with Vicuna and Chatbot Arena

39.4K
Experimental
Python
LLM Frameworks
Inference
Python
#llm#vicuna#chatbot

invoke-ai/InvokeAI

AI-powered creative engine for visual media generation

26.8K
Active
TypeScript
AI Image & Video
Full-Stack Frameworks
React
#ai-art#image-generation#generative-art

sgl-project/sglang

High-performance serving framework for large language and multimodal models

24.1K
Active
Python
Inference
LLM Frameworks
Python
#llm#inference#serving

liguodongiot/llm-action

Comprehensive LLM engineering and application resources with training, inference, compression, and deployment guides

23.4K
Stable
HTML
Fine-tuning
Inference
#llm-training#llm-inference#llm-ops

jina-ai/serve

Build and deploy AI services with cloud-native stack

21.8K
Experimental
Python
AI Model Serving
Containerization
Python
#cloud-native#ai-serving#docker

NirDiamant/GenAI_Agents

Comprehensive GenAI agent tutorials and implementations

20.3K
Active
Jupyter Notebook
Agents & Orchestration
Tutorials & Courses
LangChain
#genai-agents#ai-tutorials#langchain

Unity-Technologies/ml-agents

An open-source toolkit for training intelligent agents using deep reinforcement learning and imitation learning in Unity games and simulations.

19.2K
Active
C#
Agents & Orchestration
Unity3D
#deep-learning#deep-reinforcement-learning#machine-learning

cocos2d/cocos2d-x

Cocos2d-x is a cross-platform game development framework used by millions of developers worldwide.

19.0K
Experimental
C++
Cross-Platform
React Native
#game-development#cross-platform#open-source

bluesky-social/social-app

Bluesky Social is a decentralized social platform built using TypeScript, focused on serving the 'vibe coder' community.

17.8K
Active
TypeScript
MCP Servers
React
#social-network#decentralized#typescript

http-party/http-server

A simple, zero-configuration command-line HTTP server for serving static files.

14.2K
Active
JavaScript
API Frameworks
Node
#http#server#static

NVIDIA/TensorRT-LLM

TensorRT LLM provides a Python API and optimizations to efficiently run large language models on NVIDIA GPUs.

13.0K
Active
Python
LLM Frameworks
PyTorch
#cuda#llm-serving#moe

d2-projects/d2-admin

An elegant dashboard that can serve as a starting point for building admin-focused web applications.

12.7K
Archived
JavaScript
Component Libraries (Vue/Svelte)
Vue
#dashboard#admin#vue

bentoml/OpenLLM

Deploy open-source LLMs as OpenAI-compatible API endpoints using BentoML's model serving framework.

12.1K
Active
Python
AI Model Serving
Local Inference Engines
BentoML
#llm-inference#bentoml#model-serving

realm/realm-java

Realm is a mobile database that serves as a replacement for SQLite and ORMs.

11.5K
Stable
Java
Databases
#database#android#mobile

jantimon/html-webpack-plugin

A webpack plugin that simplifies the creation of HTML files to serve your webpack bundles.

10.7K
Active
JavaScript
Build Tools
React
#webpack#html#bundler

cdnjs/cdnjs

A popular open-source CDN for hosting and serving front-end assets like CSS, JavaScript, and fonts.

10.7K
Stable
Web Development
#cdn#javascript#css

liu673cn/bug

This is an open-source TVbox project that serves as an empty shell for users to configure themselves.

10.5K
Archived
HTML
Full-Stack Frameworks
#tvbox#open-source#configuration

vercel/serve

Lightweight, zero-configuration HTTP server for serving static files and directory listings.

9.8K
Stable
TypeScript
Backend Frameworks
Node
#http#static-files#directory-listing
2...9

Stay in the loop

Get weekly updates on trending AI coding tools and projects.