Explore Projects

Discover 199 open source projects

Active filters (1):
Search: llamaร—
Clear all

Showing 41-60 of 199 projects

tensorzero/tensorzero

Open-source stack for industrial-grade LLM applications, including LLM gateway, observability, optimization, evaluation, and experimentation.

11.0K
Active
Rust
LLM Frameworks
Rust
#ai#large-language-models#llms

getumbrel/llama-gpt

A self-hosted, offline, ChatGPT-like chatbot powered by Llama 2 with no data leaving your device.

11.0K
Archived
TypeScript
LLM Frameworks
TypeScript
#chatgpt#llama#llm

langchain4j/langchain4j

An open-source Java library that simplifies integrating LLMs into Java apps through a unified API.

11.0K
Active
Java
LLM Frameworks
Java
#llms#embeddings#vector-database

promptfoo/promptfoo

A framework for testing and evaluating large language models, prompts, and AI agents for security and performance.

10.8K
Active
TypeScript
LLM Frameworks
TypeScript
#llm-evaluation#prompt-engineering#red-teaming

yichuan-w/LEANN

A Python library for efficient RAG (Retrieval-Augmented Generation) applications with AI-powered vector database and private storage.

10.3K
Active
Python
LLM Frameworks
React
#vector-database#private-storage#RAG-applications

abetlen/llama-cpp-python

Python bindings for the llama.cpp library, enabling developers to use LLMs in their Python projects.

10.0K
Stable
Python
LLM Wrappers & SDKs
Python
#llm#language-model#python-binding

bigscience-workshop/petals

A distributed system for running large language models (LLMs) on personal devices, enabling faster fine-tuning and inference.

10.0K
Archived
Python
LLM Frameworks
PyTorch
#llm#distributed-computing#fine-tuning

xorbitsai/inference

Unified, production-ready inference API to run open-source, speech, and multimodal models on cloud, on-prem, or your laptop.

9.1K
Active
Python
LLM Frameworks
Inference
PyTorch
#artificial-intelligence#llm#inference

oumi-ai/oumi

Easily fine-tune, evaluate and deploy open-source large language models like GPT-OSS and Llama.

8.9K
Active
Python
LLM Frameworks
Inference
Python
#llms#fine-tuning#evaluation

jzhang38/TinyLlama

An open-source project to pre-train a 1.1B Llama model on 3 trillion tokens for AI coding tools and agents.

8.9K
Archived
Python
LLM Frameworks
AI Code Generation
Python
#llm#language-model#ai-coding

OpenPipe/ART

Train multi-step agents for real-world tasks using GRPO, supporting AI tools like Qwen2.5, Qwen3, and Llama.

8.9K
Active
Python
Agents & Orchestration
Reinforcement Learning
Python
#agent#reinforcement-learning#llms

Tiiny-AI/PowerInfer

High-performance C++ library for fast local deployment of large language models (LLMs) like LLaMA.

8.8K
Active
C++
LLM Frameworks
API Frameworks
#llm#llm-inference#local-inference

intel/ipex-llm

An accelerator for local LLM inference and fine-tuning on Intel XPUs, with seamless integration into popular LLM frameworks.

8.7K
Active
Python
LLM Frameworks
LLM Wrappers & SDKs
PyTorch
#llm#inference#fine-tuning

reorproject/reor

A private & local AI personal knowledge management app for high entropy people with a focus on vibe coders.

8.5K
Experimental
JavaScript
LLM Frameworks
Vector Databases
React
#ai#local-first#note-taking

LianjiaTech/BELLE

Open-source Chinese language model BELLE for building AI-powered chatbots and conversational applications.

8.3K
Archived
HTML
LLM Frameworks
Agents & Orchestration
React
#chinese-nlp#instruction-set#llama

llamastack/llama-stack

Composable building blocks for LLM apps using Python

8.3K
Active
Python
React
#LLM#composable#building blocks

zilliztech/GPTCache

Semantic cache for large language models, fully integrated with LangChain and llama_index.

8.0K
Experimental
Python
LLM Frameworks
Caching
LangChain
#llm#semantic-search#vector-search

NexaAI/nexa-sdk

A comprehensive SDK for running frontier LLMs and VLMs on multiple hardware platforms with day-0 model support.

7.8K
Active
Go
LLM Frameworks
LLM Wrappers & SDKs
#llm#vlm#on-device-ai

InternLM/lmdeploy

LMDeploy is a toolkit for compressing, deploying, and serving large language models (LLMs).

7.7K
Active
Python
LLM Frameworks
Inference
Python
#llm#inference#deployment

WangRongsheng/awesome-LLM-resources

A comprehensive collection of resources for large language models, including AI coding tools, MCP frameworks, and more.

7.6K
Active
LLM Frameworks
AI Code Generation
#large-language-models#llm#ai-coding
124...10

Stay in the loop

Get weekly updates on trending AI coding tools and projects.