Local AI & Model Runners

Desktop model runners, local inference engines, and model management

Showing 41-60 of 62 projects

AlexsJones/llmfit

Find which LLM models run on your hardware. Supports 157 models across 30 providers.

11.5K
Active
Rust
Model Management Tools
LLM Wrappers & SDKs
Rust
#llm-discovery#hardware-detection#model-runner

agentscope-ai/CoPaw

Personal AI assistant platform with multi-app chat integration and extensible capabilities for local or cloud deployment.

8.5K
Active
Python
Desktop Model Runners
LLM Wrappers & SDKs
Python
#personal-ai-assistant#multi-app-chat#extensible-capabilities

nullclaw/nullclaw

Autonomous AI assistant infrastructure in Zig—fast, minimal, self-contained runtime for building AI agents.

5.6K
Active
Zig
Local Inference Engines
LLM Frameworks
Zig
#zig-runtime#autonomous-ai#lightweight-inference

pkuliyi2015/multidiffusion-upscaler-for-automatic1111

Plugin for Stable Diffusion WebUI that optimizes large image generation through tiled diffusion and VAE techniques.

5.0K
Archived
Python
Computer Vision
Desktop Model Runners
Stable Diffusion
#stable-diffusion-plugin#tiled-diffusion#image-upscaling

ArvinLovegood/go-stock

AI-powered stock analysis tool with multi-source LLM support, sentiment analysis, and local data processing

4.8K
Active
Go
LLM Wrappers & SDKs
Desktop Model Runners
Go
#stock-analysis#multi-llm#local-inference

nearai/ironclaw

Rust implementation of OpenClaw focusing on privacy-preserving AI model execution and security hardening.

4.2K
Active
Rust
Local Inference Engines
AI SDKs & Wrappers
Rust
#privacy-preserving#rust-inference#openclaw

osaurus-ai/osaurus

Native macOS runtime for running local/cloud AI models with MCP tool sharing and always-on workflows.

4.0K
Active
Swift
MCP Servers
Desktop Model Runners
Swift
#mcp-server#edge-ai#macos-native

memovai/mimiclaw

Run Claude AI agents on ultra-low-power chips with local-first memory and privacy.

3.8K
Active
C
Desktop Model Runners
Agent Memory Systems
OpenClaw
#edge-ai-agents#local-first-memory#low-power-chips

OHF-Voice/piper1-gpl

Fast local neural text-to-speech engine for offline voice synthesis

3.1K
Active
C++
Local Inference Engines
AI Voice & Speech
C++
#text-to-speech#tts#neural

tmoroney/auto-subs

AI subtitle generator for video with DaVinci Resolve integration, speaker diarization, runs locally.

2.9K
Active
TypeScript
AI Voice & Speech
Desktop Model Runners
OpenAI
#ai-subtitles#davinci-resolve#speaker-diarization

Purfview/whisper-standalone-win

Standalone Windows executables for Whisper speech-to-text & diarization without Python setup.

2.9K
Stable
Desktop Model Runners
AI Voice & Speech
Whisper
#speech-to-text#whisper#faster-whisper

Tencent-Hunyuan/HunyuanImage-3.0

Native multimodal model for high-quality image generation with text-to-image capabilities

2.9K
Active
Python
AI Image & Video
Local Inference Engines
PyTorch
#text-to-image#diffusion-model#multimodal

mostlygeek/llama-swap

Reliable model swapping for local LLM servers - seamlessly switch between llama.cpp, vLLM, and compatible backends

2.6K
Active
Go
Local Inference Engines
LLM Wrappers & SDKs
llama.cpp
#local-llm#model-swapping#llama-cpp

ValueCell-ai/ClawX

Desktop GUI for OpenClaw AI agents - turns CLI agent orchestration into a graphical interface

2.5K
Active
TypeScript
AI Coding Agents
Agent Coordination
OpenClaw
#agent-ui#openclaw#agentic-ai

moltis-org/moltis

Personal AI assistant in Rust with multi-provider LLMs, memory, sandboxed execution & MCP tools

1.9K
Active
Rust
MCP Frameworks
Agents & Orchestration
Rust
#mcp-framework#rust-ai-assistant#sandboxed-execution

QwenLM/Qwen3.5

Large language model by Alibaba Cloud Qwen team for advanced NLP and AI applications

1.8K
Active
LLM Frameworks
Local Inference Engines
PyTorch
#large-language-model#qwen#llm

tnm/zclaw

Lightweight AI assistant for ESP32 microcontrollers with GPIO, scheduling, custom tools, and memory.

1.7K
Active
C
Local Inference Engines
Arduino & Embedded
ESP32
#esp32-ai#embedded-llm#edge-inference

OpenWhispr/openwhispr

Cross-platform voice-to-text app with local & cloud AI models, privacy-first architecture

1.6K
Active
TypeScript
Desktop Model Runners
AI Voice & Speech
Whisper
#voice-to-text#local-inference#whisper-api

antirez/voxtral.c

Pure C inference engine for Mistral Voxtral 4B speech-to-text model with minimal dependencies

1.5K
Active
C
Local Inference Engines
Inference
C
#speech-to-text#voxtral#c-inference

altic-dev/FluidVoice

macOS offline speech-to-text app using local ML—no cloud, fully private voice dictation

1.3K
Active
Swift
Desktop Model Runners
AI Voice & Speech
Swift
#offline-dictation#voice-to-text#local-inference

Stay in the loop

Get weekly updates on trending AI coding tools and projects.