Tiiny-AI/PowerInfer

High-performance C++ library for fast local deployment of large language models (LLMs) like LLaMA.

C++
AI & Machine Learning
LLM Frameworks
MIT

8.8K

Stars

491

Forks

Dec 15, 2023

Created

Jan 24, 2026

Last Updated

Project Analytics

Stars Growth (1 Month)

+124

+1.4% change

Avg Daily Growth (1 Month)

+4.4

stars per day

Fork/Star Ratio (All Time)

5.6%

Normal engagement

Lifetime Growth

10.8

stars/day over 813 days

Stars Over Time

Forks Over Time

Open Issues Over Time

Pull Requests Over Time

Commits Over Time

AI-Generated Tags

llm
llm-inference
local-inference
high-performance
c++

Comments (0)

Sign in to leave a comment or vote

Sign In

No comments yet. Be the first to comment!

Stay in the loop

Get weekly updates on trending AI coding tools and projects.