Explore Projects

Discover 2 open source projects

Active filters (1):

Search: bentoml×

Showing 1-2 of 2 projects

Deploy open-source LLMs as OpenAI-compatible API endpoints using BentoML's model serving framework.

12.1K

Active

Python

AI Model Serving

Local Inference Engines

BentoML

#llm-inference#bentoml#model-serving

BentoML is an easy-to-use framework for building and deploying production-ready machine learning models as APIs.

8.5K

Active

Python

LLM Frameworks

API Clients & Testing

Python

#ai-inference#llm-inference#llm-serving

Get weekly updates on trending AI coding tools and projects.