turboderp-org/exllamav2

A fast inference library for running large language models (LLMs) locally on modern GPUs

Python
AI & Machine Learning
LLM Frameworks
MIT

4.5K

Stars

327

Forks

Aug 30, 2023

Created

Mar 4, 2026

Last Updated

Project Analytics

Stars Growth (1 Month)

+14

+0.3% change

Avg Daily Growth (1 Month)

+0.5

stars per day

Fork/Star Ratio (All Time)

7.3%

Normal engagement

Lifetime Growth

4.8

stars/day over 920 days

Stars Over Time

Forks Over Time

Open Issues Over Time

Pull Requests Over Time

Commits Over Time

AI-Generated Tags

machine-learning
inference
llm
gpu
python
cli

Comments (0)

Sign in to leave a comment or vote

Sign In

No comments yet. Be the first to comment!

Stay in the loop

Get weekly updates on trending AI coding tools and projects.