Explore Projects

Discover 6 open source projects

Active filters (1):

Search: sglang×

Clear all

Showing 1-6 of 6 projects

sgl-project/sglang

High-performance serving framework for large language and multimodal models

24.1K

Active

Python

Inference

LLM Frameworks

Python

#llm#inference#serving

kvcache-ai/Mooncake

Mooncake is a serving platform for Kimi, a leading LLM service provided by Moonshot AI, focused on disaggregation, inference, and RDMA.

4.9K

Active

C++

LLM Frameworks

API Frameworks

C++

#llm#inference#rdma

gpustack/gpustack

Optimize AI inference performance on GPUs with this Python library for selecting and tuning inference engines.

4.6K

Active

Python

Inference

CLI Tools

Python

#ai-inference#gpu-acceleration#performance-optimization

sgl-project/mini-sglang

A compact Python implementation of SGLang to demystify modern LLM serving systems.

3.6K

Active

Python

LLM Frameworks

LLM Wrappers & SDKs

#llm#language-model#serving

OpenDCAI/DataFlow

LLMs-based Operators and Pipelines for data prep

2.9K

Active

Python

AI Coding Tools

Gradio

#data-science#data-agent#data-cleaning

OpenMOSS/MOSS-TTSD

An open-source speech dialogue generation model that enables expressive dialogue speech synthesis in Chinese and English.

1.2K

Stable

Python

AI Voice & Speech

API Frameworks

#speech-dialogue-generation#multi-speaker-voice-cloning#long-form-speech-generation

Stay in the loop

Get weekly updates on trending AI coding tools and projects.