Vybe Guide
Sign Up

Explore Projects

Discover 321 open source projects

Active filters (1):
Search: inference×
Clear all

Showing 1-20 of 321 projects

huggingface/transformers

Model framework for state-of-the-art ML models in text, vision, audio, and multimodal tasks.

157.4K
Active
Python
LLM Frameworks
Agents & Orchestration
PyTorch
#transformers#huggingface#deep-learning

ggml-org/llama.cpp

Run LLMs locally in C/C++ with high performance

96.8K
Active
C++
Local Inference Engines
#llama.cpp#ggml#C++

nomic-ai/gpt4all

Run local LLMs on any device with GPT4All

77.2K
Experimental
C++
Desktop Model Runners
#llm#local-ai#model-runner

vllm-project/vllm

High-throughput LLM inference engine for developers

72.1K
Active
Python
Inference
LLM Wrappers & SDKs
Hugging Face
#llm#inference#ai

meta-llama/llama

Llama 2 inference code for running Llama models

59.2K
Archived
Python
Inference
Local Inference Engines
#llama2#inference#ai-models

facebookresearch/segment-anything

Segment Anything Model for image/video segmentation with AI prompts

53.6K
Archived
Jupyter Notebook
Computer Vision
PyTorch
#segmentation#computer-vision#ai-model

xai-org/grok-1

Open-source Grok-1 model for local inference with JAX

51.5K
Archived
Python
Inference
Local Inference Engines
JAX
#grok-1#llm#inference

ggml-org/whisper.cpp

High-performance C/C++ port of OpenAI's Whisper for speech recognition

47.2K
Active
C++
Inference
CLI Tools
#speech-to-text#c++#inference

mudler/LocalAI

Self-hosted, open-source AI alternative to OpenAI with local LLM inference, no GPU required

43.3K
Active
Go
MCP Servers
Local Inference Engines
Go
#local-ai#llm-inference#open-source

colinhacks/zod

TypeScript-first schema validation with static type inference

42.0K
Active
TypeScript
API Clients & Testing
BaaS Platforms
Next.js
#zod#typescript#schema-validation

deepspeedai/DeepSpeed

DeepSpeed optimizes deep learning training and inference with distributed computing techniques.

41.7K
Active
Python
ML Ops
Inference
PyTorch
#deep-learning#distributed-training#inference-optimization

ray-project/ray

Ray is a unified framework for scaling AI and Python applications with distributed computing and ML libraries.

41.6K
Active
Python
ML Ops
Containerization
Python
#distributed-computing#ml-ops#ai-framework

hpcaitech/ColossalAI

Colossal-AI optimizes large AI model training and inference with distributed computing and GPU acceleration.

41.4K
Active
Python
ML Ops
Inference
PyTorch
#ai-optimization#distributed-training#gpu-acceleration

2noise/ChatTTS

Generates natural speech for dialogue scenarios

38.9K
Active
Python
AI Voice & Speech
Python
#tts#speech-synthesis#ai-voice

huggingface/pytorch-image-models

A collection of PyTorch image encoders/backbones with training, evaluation, and inference scripts.

36.4K
Active
Python
LLM Frameworks
Full-Stack Frameworks
Next.js
#PyTorch#Image Models#Deep Learning

google-ai-edge/mediapipe

Cross-platform ML framework for real-time media processing

34.0K
Active
C++
Inference
Computer Vision
MediaPipe
#ml-framework#real-time-processing#android

microsoft/BitNet

1-bit LLM inference framework for CPU/GPU

28.7K
Active
Python
Inference
Local Inference Engines
bitnet.cpp
#1-bit-llm#cpu-inference#gpu-inference

svc-develop-team/so-vits-svc

Singing Voice Conversion framework using AI

28.0K
Archived
Python
AI Voice & Speech
PyTorch
#ai#audio-analysis#deep-learning

black-forest-labs/flux

Official FLUX.1 inference repo for image generation & editing

25.3K
Experimental
Python
Inference
Local Inference Engines
PyTorch
#flux#image-generation#ai-inference

gitleaks/gitleaks

Detect secrets in git repos and files

25.2K
Active
Go
Security Research
CLI Tools
#gitleaks#secret-detection#ci-cd
2...17

Stay in the loop

Get weekly updates on trending AI coding tools and projects.