Local AI & Model Runners

Desktop model runners, local inference engines, and model management

Showing 21-40 of 62 projects

The-Run-Philosophy-Organization/run

The-Run-Philosophy-Organization/run: A repository for the Run Philosophy, a global official GitHub organization focused on the philosophy and practices of the Run movement.

32.1K
Archived
LLM Frameworks
Desktop Model Runners
Next.js
#Run Philosophy#LLM Frameworks#Local AI & Model Runners

iperov/DeepFaceLive

Real-time face swap for PC streaming or video calls

30.6K
Archived
Python
Local AI & Model Runners
Frontend Frameworks
Next.js
#DeepFaceLive#Real-time face swap#Python

microsoft/BitNet

1-bit LLM inference framework for CPU/GPU

28.7K
Active
Python
Inference
Local Inference Engines
bitnet.cpp
#1-bit-llm#cpu-inference#gpu-inference

gabime/spdlog

Fast C++ logging library for AI coding agents and model runners

28.4K
Active
C++
AI Coding Agents
Desktop Model Runners
C++
#cpp#logging#spdlog

voideditor/void

A full-featured AI code editor with integrated LLM and cursor navigation.

28.3K
Stable
TypeScript
AI Code Editors
Desktop Model Runners
TypeScript
#LLM#cursor#AI Code Editor

QwenLM/Qwen3

Qwen3 is Alibaba Cloud's large language model series with enhanced reasoning and coding capabilities.

26.8K
Stable
Python
LLM Frameworks
Local Inference Engines
Hugging Face
#large-language-model#llm#alibaba-cloud

JakeChampion/fetch

A window.fetch JavaScript polyfill for VybeGuide.ai

26.1K
Archived
JavaScript
#fetch#javascript#polyfill

black-forest-labs/flux

Official FLUX.1 inference repo for image generation & editing

25.3K
Experimental
Python
Inference
Local Inference Engines
PyTorch
#flux#image-generation#ai-inference

OpenBMB/MiniCPM-o

On-device multimodal LLM for vision, speech, and live streaming on phones

24.0K
Active
Python
Inference
Local Inference Engines
llama.cpp-omni
#minicpm-o#multimodal-llm#on-device-ai

mozilla-ai/llamafile

Run LLMs locally with a single file

23.8K
Active
C
Desktop Model Runners
#llamafile#llm#local-ai

Sanster/IOPaint

AI-powered image inpainting tool for removing/erasing objects and replacing them with realistic content

22.8K
Experimental
Python
Computer Vision
Desktop Model Runners
PyTorch
#image-inpainting#stable-diffusion#object-removal

PromtEngineer/localGPT

LocalGPT enables private document interaction with GPT models on your device.

22.2K
Stable
Python
RAG & Vector
Desktop Model Runners
Python
#local-ai#document-intelligence#rag

SYSTRAN/faster-whisper

Faster Whisper transcription with CTranslate2 for efficient speech-to-text

21.3K
Stable
Python
Inference
Local Inference Engines
CTranslate2
#speech-to-text#inference#quantization

charmbracelet/crush

A repository for AI Code Editors, providing a platform for developers to write and manage code with AI assistance.

20.9K
Active
Go
AI Code Editors
Desktop Model Runners
Next.js
#tag1#tag2#tag3

krisk/Fuse

Lightweight fuzzy-search library for AI coding agents and model runners

20.0K
Experimental
JavaScript
Local AI & Model Runners
Linters & Formatters
JavaScript
#javascript#lightweight-fuzzy-search#bitap

dyad-sh/dyad

AI App Builder for Power Users

19.8K
Active
TypeScript
AI App Builders
Desktop Model Runners
Replit
#dyad#AI App Builder#Local AI

verl-project/verl

Volcano Engine Reinforcement Learning for LLMs

19.6K
Active
Python
LLM Frameworks
Desktop Model Runners
Next.js
#verl#LLM#Reinforcement Learning

brendangregg/FlameGraph

FlameGraph: Stack trace visualizer for developers

19.3K
Archived
Perl
AI Code Editors
Desktop Model Runners
#FlameGraph#Stack trace visualizer#Developer Tools

ShusenTang/Dive-into-DL-PyTorch

Deep learning implementation of Dive into Deep Learning using PyTorch

19.3K
Archived
Jupyter Notebook
LLM Frameworks
Desktop Model Runners
PyTorch
#Deep Learning#PyTorch#Dive into Deep Learning

bentoml/OpenLLM

Deploy open-source LLMs as OpenAI-compatible API endpoints using BentoML's model serving framework.

12.1K
Active
Python
AI Model Serving
Local Inference Engines
BentoML
#llm-inference#bentoml#model-serving

Stay in the loop

Get weekly updates on trending AI coding tools and projects.