Explore Projects

Discover 4 open source projects

Active filters (1):
Search: inference-serverร—
Clear all

Showing 1-4 of 4 projects

Michael-A-Kuykendall/shimmy

A free, open-source Rust inference server compatible with OpenAI-API, suitable for vibe coders

3.7K
Active
Rust
React
#authentication#inference-server#open-source

containers/ramalama

RamaLama simplifies local serving of AI models and enables their use for inference in production via containers.

2.6K
Active
Python
LLM Frameworks
Inference
Python
#ai#containers#inference-server

roboflow/inference

Turn any computer or edge device into a command center for your computer vision projects.

2.2K
Active
Python
Computer Vision
API Frameworks
Docker
#computer-vision#inference#object-detection

basetenlabs/truss

The simplest way to serve AI/ML models in production, with support for popular models like Stable Diffusion and Whisper.

1.1K
Active
Python
Inference
API Development
Flask
#artificial-intelligence#machine-learning#model-serving

Stay in the loop

Get weekly updates on trending AI coding tools and projects.