Vybe Guide
Sign Up
All Categories

Local Inference Engines

llama.cpp, whisper.cpp, GGML - inference engines for local hardware

Showing 21-22 of 22 projects

antirez/voxtral.c

Pure C inference engine for Mistral Voxtral 4B speech-to-text model with minimal dependencies

1.5K
Active
C
Local Inference Engines
Inference
C
#speech-to-text#voxtral#c-inference

RightNow-AI/picolm

Run billion-parameter LLMs on embedded devices with extreme quantization for edge inference

1.3K
Active
C
Local Inference Engines
Inference
C
#llm-inference#embedded-ai#quantization
1

Stay in the loop

Get weekly updates on trending AI coding tools and projects.