bentoml/OpenLLM

Deploy open-source LLMs as OpenAI-compatible API endpoints using BentoML's model serving framework.

Python
AI & Machine Learning
AI Model Serving
Apache-2.0

12.1K

Stars

800

Forks

Apr 19, 2023

Created

Mar 2, 2026

Last Updated

Project Analytics

Stars Growth (1 Month)

+13

+0.1% change

Avg Daily Growth (1 Month)

+1.3

stars per day

Fork/Star Ratio (All Time)

6.6%

Normal engagement

Lifetime Growth

11.5

stars/day over 1.1K days

Stars Over Time

Forks Over Time

Open Issues Over Time

AI-Generated Tags

llm-inference
bentoml
model-serving
openai-compatible
llama
fine-tuning

Comments (0)

Sign in to leave a comment or vote

Sign In

No comments yet. Be the first to comment!

Stay in the loop

Get weekly updates on trending AI coding tools and projects.