Vybe Guide
Sign Up

Explore Projects

Discover 479 open source projects

Active filters (1):
Search: llmsร—
Clear all

Showing 81-100 of 479 projects

NVIDIA/TensorRT-LLM

TensorRT LLM provides a Python API and optimizations to efficiently run large language models on NVIDIA GPUs.

13.0K
Active
Python
LLM Frameworks
PyTorch
#cuda#llm-serving#moe

modelscope/ms-swift

A Python library for using and fine-tuning over 900 large language models and multimodal models for various AI tasks.

12.9K
Active
Python
LLM Frameworks
Python
#llm#multimodal#fine-tuning

wdndev/llm_interview_note

A repository that documents knowledge and interview questions for LLM (large language model) engineers.

12.8K
Experimental
HTML
LLM Frameworks
#llm#interview-preparation#documentation

ShishirPatil/gorilla

Gorilla is a Python tool for training and evaluating large language models (LLMs) for API/function calls.

12.7K
Active
Python
LLM Frameworks
#llm#api#chatgpt

eugeneyan/open-llms

A comprehensive list of open-source large language models (LLMs) available for commercial use.

12.7K
Experimental
LLM Frameworks
#large-language-models#llm#commercial-use

NevaMind-AI/memU

This open-source Python library provides memory infrastructure for large language models and AI agents.

12.6K
Active
Python
LLM Frameworks
Agents & Orchestration
Python
#agent#memory#ai-agents

567-labs/instructor

A Python library for generating structured outputs from language models like OpenAI's GPT-3.

12.5K
Active
Python
LLM Wrappers & SDKs
#openai#prompt-engineering#pydantic

MemoriLabs/Memori

A Python library that provides a SQL-native memory layer for large language models, AI agents, and multi-agent systems.

12.3K
Active
Python
LLM Frameworks
Python
#llm#memory-management#state-management

bentoml/OpenLLM

Deploy open-source LLMs as OpenAI-compatible API endpoints using BentoML's model serving framework.

12.1K
Active
Python
AI Model Serving
Local Inference Engines
BentoML
#llm-inference#bentoml#model-serving

GeeeekExplorer/nano-vllm

A powerful Python library for working with large language models (LLMs) and natural language processing tasks.

12.0K
Stable
Python
LLM Frameworks
PyTorch
#llm#nlp#deep-learning

Chainlit/chainlit

Chainlit is a Python library that makes it easy to build conversational AI applications with LLMs like ChatGPT.

11.7K
Active
Python
LLM Frameworks
Python
#chatgpt#langchain#llm

ludwig-ai/ludwig

Low-code framework for building custom LLMs, neural networks, and other AI models

11.7K
Active
Python
LLM Frameworks
PyTorch
#llm#neural-network#machine-learning

FlagOpen/FlagEmbedding

A Python repository for retrieval and retrieval-augmented LLMs

11.4K
Stable
Python
React
#embedding#retrieval-augmented-generation#sentence-embeddings

simonw/llm

A Python library to easily access large language models like OpenAI from the command-line.

11.3K
Active
Python
LLM Frameworks
Python
#llms#openai#ai

tensorzero/tensorzero

Open-source stack for industrial-grade LLM applications, including LLM gateway, observability, optimization, evaluation, and experimentation.

11.0K
Active
Rust
LLM Frameworks
Rust
#ai#large-language-models#llms

langchain4j/langchain4j

An open-source Java library that simplifies integrating LLMs into Java apps through a unified API.

11.0K
Active
Java
LLM Frameworks
Java
#llms#embeddings#vector-database

artidoro/qlora

Efficient finetuning of quantized LLMs for AI developers

10.8K
Archived
Jupyter Notebook
React
#quantized LLMs#finetuning#AI development

promptfoo/promptfoo

A framework for testing and evaluating large language models, prompts, and AI agents for security and performance.

10.8K
Active
TypeScript
LLM Frameworks
TypeScript
#llm-evaluation#prompt-engineering#red-teaming

Portkey-AI/gateway

A fast, integrated AI Gateway to route to 200+ LLMs and 50+ AI Guardrails with a friendly API.

10.8K
Active
TypeScript
LLM Frameworks
React
#ai-gateway#llm#model-router

karpathy/minbpe

Minimal, clean Python implementation of the Byte Pair Encoding (BPE) algorithm for tokenization in LLMs.

10.3K
Archived
Python
LLM Frameworks
Python
#tokenization#byte-pair-encoding#llm
1...46...24

Stay in the loop

Get weekly updates on trending AI coding tools and projects.