Trending Projects

Run LLMs locally in C/C++ with high performance

Rust implementation of OpenClaw focusing on privacy-preserving AI model execution and security hardening.

Run Claude AI agents on ultra-low-power chips with local-first memory and privacy.

Run frontier AI models locally across devices using RDMA and tensor parallelism

Cross-platform voice-to-text app with local & cloud AI models, privacy-first architecture

Open-source ChatGPT replacement with local AI model support

Run billion-parameter LLMs on embedded devices with extreme quantization for edge inference

Fast local neural text-to-speech engine for offline voice synthesis

Reliable model swapping for local LLM servers - seamlessly switch between llama.cpp, vLLM, and compatible backends

Lightweight AI assistant for ESP32 microcontrollers with GPIO, scheduling, custom tools, and memory.

macOS offline speech-to-text app using local ML—no cloud, fully private voice dictation

lib-pku/libpku: A collection of course materials and resources for vibe coders.

Web UI for local AI with multiple backends and offline capabilities

Run local LLMs on any device with GPT4All

Run LLMs locally with a single file

Standalone Windows executables for Whisper speech-to-text & diarization without Python setup.

Pure C inference engine for Mistral Voxtral 4B speech-to-text model with minimal dependencies