ModelTC/LightLLM

LightLLM is a high-performance, scalable Python-based framework for inference and serving of large language models.

Python
AI & Machine Learning
LLM Frameworks
Apache-2.0

3.9K

Stars

304

Forks

Jul 22, 2023

Created

Mar 5, 2026

Last Updated

Project Analytics

Stars Growth (1 Month)

+45

+1.2% change

Avg Daily Growth (1 Month)

+1.6

stars per day

Fork/Star Ratio (All Time)

7.7%

Normal engagement

Lifetime Growth

4.1

stars/day over 959 days

Stars Over Time

Forks Over Time

Open Issues Over Time

Pull Requests Over Time

Commits Over Time

AI-Generated Tags

llm
model-serving
deep-learning
gpt
nlp
high-performance

Comments (0)

Sign in to leave a comment or vote

Sign In

No comments yet. Be the first to comment!

Stay in the loop

Get weekly updates on trending AI coding tools and projects.