Lightning-AI/LitServe

A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.

Python
AI & Machine Learning
AI Model Serving
Apache-2.0

3.8K

Stars

269

Forks

Dec 12, 2023

Created

Mar 2, 2026

Last Updated

Project Analytics

Stars Growth (1 Month)

+10

+0.3% change

Avg Daily Growth (1 Month)

+0.4

stars per day

Fork/Star Ratio (All Time)

7.1%

Normal engagement

Lifetime Growth

4.7

stars/day over 816 days

Stars Over Time

Forks Over Time

Open Issues Over Time

Pull Requests Over Time

Commits Over Time

AI-Generated Tags

ai
inference
serving
api
fastapi
python

Comments (0)

Sign in to leave a comment or vote

Sign In

No comments yet. Be the first to comment!

Stay in the loop

Get weekly updates on trending AI coding tools and projects.