Explore Projects

Discover 10 open source projects

Active filters (1):
Search: ggufร—
Clear all

Showing 1-10 of 10 projects

mudler/LocalAI

Self-hosted, open-source AI alternative to OpenAI with local LLM inference, no GPU required

43.3K
Active
Go
MCP Servers
Local Inference Engines
Go
#local-ai#llm-inference#open-source

KoboldAI/KoboldAI-Client

An open-source client for the KoboldAI AI language model that enables vibe coders to build with AI tools.

3.9K
Archived
Python
LLM Frameworks
AI Code Generation
Python
#ai-language-model#llm#code-generation

Michael-A-Kuykendall/shimmy

A free, open-source Rust inference server compatible with OpenAI-API, suitable for vibe coders

3.7K
Active
Rust
React
#authentication#inference-server#open-source

city96/ComfyUI-GGUF

Provides GGUF quantization support for native ComfyUI models

3.3K
Active
Python
MCP Servers
React
#quantization#ComfyUI#GGUF

janhq/cortex.cpp

A C++ library for building local AI inference platforms with support for ONNX models.

2.8K
Experimental
C++
LLM Frameworks
API Clients & Testing
#onnx#onnxruntime#llm

datawhalechina/handy-ollama

An open-source tutorial that helps developers deploy large language models (LLMs) like Ollama on CPU for production use.

2.3K
Active
Jupyter Notebook
LLM Frameworks
Tutorials & Courses
Jupyter Notebook
#large-language-models#llm#ollama

withcatai/node-llama-cpp

Run AI models like LLaMA locally on your machine with Node.js bindings for llama.cpp and enforce JSON schema on the output.

1.9K
Active
TypeScript
LLM Wrappers & SDKs
Inference
Node.js
#ai#llama#llama-cpp

sammcj/gollama

A Go-based command-line tool for managing Ollama LLM models on Linux and macOS.

1.7K
Stable
Go
LLM Frameworks
CLI Tools
#ai#llm#ggml

edwko/OuteTTS

Interface for OuteTTS models, a Python library for text-to-speech using transformer-based models.

1.4K
Experimental
Python
LLM Frameworks
AI Voice & Speech
#text-to-speech#transformers#llama

kitops-ml/kitops

An open-source DevOps tool for packaging and versioning AI/ML models, datasets, code, and configuration into an OCI Artifact.

1.3K
Active
Go
MLOps
Containerization
Go
#ai#devops#oci

Stay in the loop

Get weekly updates on trending AI coding tools and projects.