Explore Projects
Discover 173 open source projects
Showing 61-80 of 173 projects
beclab/Olares
Olares is an open-source personal cloud platform to reclaim your data and enable local AI computing.
FedML-AI/FedML
A unified and scalable ML library for large-scale distributed training, model serving, and federated learning.
ModelTC/LightLLM
LightLLM is a high-performance, scalable Python-based framework for inference and serving of large language models.
skyzh/tiny-llm
A course on building a tiny vLLM (virtual Large Language Model) and Qwen inference serving on Apple Silicon for systems engineers.
rakyll/statik
Embed files into a Go executable, making it easy to serve static content with Go.
Lightning-AI/LitServe
A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.
undertow-io/undertow
Undertow is a high-performance, non-blocking web server written in Java, suitable for serving large-scale web apps.
HuaizhengZhang/AI-Infra-from-Zero-to-Hero
A comprehensive collection of resources and tutorials for building AI infrastructure and systems.
predibase/lorax
Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
PaddlePaddle/FastDeploy
High-performance Inference and Deployment Toolkit for LLMs and VLMs
sgl-project/mini-sglang
A compact Python implementation of SGLang to demystify modern LLM serving systems.
mellow-io/mellow
Mellow is a rule-based global transparent proxy client for Windows, macOS and Linux, serving as a Proxifier alternative.
nuwave/lighthouse
Laravel GraphQL framework for building scalable and efficient APIs
thu-pacman/chitu
High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.
TheWaWaR/simple-http-server
A simple, cross-platform HTTP server written in Rust for serving static files.
IBM/mcp-context-forge
A gateway and registry for the Model Context Protocol (MCP) that enables interoperability between AI tools and LLM applications.
unpkg/unpkg
The CDN for everything on npm, providing a simple way to serve npm packages in the browser
broccolijs/broccoli
A browser compilation library that serves as an asset pipeline for applications running in the browser.
ob-f/OpenBot
An open-source robotics platform that leverages smartphones as the brain for low-cost robot bodies.
alpa-projects/alpa
Alpa is a distributed training and serving framework for large-scale neural networks with auto-parallelization.
Stay in the loop
Get weekly updates on trending AI coding tools and projects.