Local AI & Model Runners

Desktop model runners, local inference engines, and model management

Showing 1-20 of 62 projects

open-webui/open-webui

Self-hosted AI platform with Ollama and OpenAI API support

125.9K
Active
Python
MCP Frameworks
Agents & Orchestration
Docker
#ai-platform#ollama#openai-api

Comfy-Org/ComfyUI

Visual AI engine for designing and executing advanced diffusion pipelines with a node-based interface.

104.9K
Active
Python
AI Image & Video
Visual AI Builders
PyTorch
#ai#comfyui#stable-diffusion

ggml-org/llama.cpp

Run LLMs locally in C/C++ with high performance

96.8K
Active
C++
Local Inference Engines
#llama.cpp#ggml#C++

nomic-ai/gpt4all

Run local LLMs on any device with GPT4All

77.2K
Experimental
C++
Desktop Model Runners
#llm#local-ai#model-runner

meta-llama/llama

Llama 2 inference code for running Llama models

59.2K
Archived
Python
Inference
Local Inference Engines
#llama2#inference#ai-models

zylon-ai/private-gpt

PrivateGPT enables private document interaction with GPT without data leaks.

57.1K
Archived
Python
RAG & Vector
LLM Wrappers & SDKs
Python
#private-gpt#llm#rag

FoundationAgents/OpenManus

OpenManus is a Python-based AI coding agent for building and managing models.

55.0K
Active
Python
Autonomous agents that WRITE CODE in your codebase
Desktop apps for running models locally
Next.js
#Python#AI Coding Agents#OpenManus

xai-org/grok-1

Open-source Grok-1 model for local inference with JAX

51.5K
Archived
Python
Inference
Local Inference Engines
JAX
#grok-1#llm#inference

lllyasviel/Fooocus

Offline AI image generation with minimal user input

47.8K
Stable
Python
AI Image & Video
Desktop Model Runners
#ai-image-generation#stable-diffusion#offline-ai

run-llama/llama_index

LLamaIndex framework for building LLM-powered agents

47.4K
Active
Python
Agents & Orchestration
Desktop Model Runners
LLM Frameworks
#llamaindex#agents#fine-tuning

oobabooga/text-generation-webui

Web UI for local AI with multiple backends and offline capabilities

46.1K
Active
Python
Desktop Model Runners
LLM Wrappers & SDKs
Gradio
#local-ai#llm#web-ui

mudler/LocalAI

Self-hosted, open-source AI alternative to OpenAI with local LLM inference, no GPU required

43.3K
Active
Go
MCP Servers
Local Inference Engines
Go
#local-ai#llm-inference#open-source

exo-explore/exo

Run frontier AI models locally across devices using RDMA and tensor parallelism

42.1K
Active
Python
Desktop Model Runners
Inference
MLX
#ai-inference#rdma#tensor-parallelism

zai-org/ChatGLM-6B

ChatGLM-6B is an open-source bilingual dialogue language model with 6.2B parameters, optimized for Chinese and English conversations.

41.2K
Archived
Python
LLM Frameworks
Desktop Model Runners
PyTorch
#llm#chatbot#dialogue-model

janhq/jan

Open-source ChatGPT replacement with local AI model support

40.9K
Active
TypeScript
Desktop Model Runners
LLM Wrappers & SDKs
Tauri
#chatgpt#llm#localai

code-yeongyu/oh-my-opencode

A comprehensive AI agent harness for vibe coders

37.2K
Active
TypeScript
Agents & Orchestration
Desktop Model Runners
Next.js
#Sisyphus#Agent Harness#AI Coding Agents

google/langextract

Extracts structured info from text using LLMs with source grounding

34.3K
Stable
Python
LLM Wrappers & SDKs
Local Inference Engines
Python
#llm#information-extraction#gemini

lib-pku/libpku

lib-pku/libpku: A collection of course materials and resources for vibe coders.

33.4K
Archived
TeX
Desktop Model Runners
Agents & Orchestration
#vibe-coder#course-materials#resources

thedotmack/claude-mem

Claude Code plugin for AI-powered code capture and context injection

33.0K
Active
TypeScript
Coding-specific agents
Desktop model runners
Claude
#claude-code#ai-coding-agents#local-ai-model-runners

block/goose

Extensible AI agent for code suggestions, execution, and testing with LLM

32.5K
Active
Rust
MCP Servers
Agents & Orchestration
Rust
#block/goose#AI Coding Agents#MCP

Stay in the loop

Get weekly updates on trending AI coding tools and projects.