flashinfer-ai/flashinfer
A Python library for serving large language models (LLMs) with high performance, including GPU acceleration and distributed inference.
Python
AI & Machine Learning
LLM Frameworks
Apache-2.0
5.1K
Stars
760
Forks
Jul 22, 2023
Created
Mar 5, 2026
Last Updated
Project Analytics
Stars Growth (1 Month)
+206
+4.2% change
Avg Daily Growth (1 Month)
+7.4
stars per day
Fork/Star Ratio (All Time)
15.0%
Good engagement
Lifetime Growth
5.3
stars/day over 959 days
Stars Over Time
Forks Over Time
Open Issues Over Time
Pull Requests Over Time
Commits Over Time
AI-Generated Tags
llm
inference
cuda
distributed
gpu
pytorch
Similar Projects
EbookFoundation/free-programming-books
Free programming books repository with AI-powered features
383.6K
Python
jwasham/coding-interview-university
A comprehensive computer science study plan for software engineers, with a focus on coding interviews and AI-related topics.
337.6K
vinta/awesome-python
Awesome Python framework and resource collection
285.7K
Python
openclaw/openclaw
Personal AI assistant for messaging platforms, self-hosted and multi-channel
265.0K
TypeScript
Comments (0)
Sign in to leave a comment or vote
Sign InNo comments yet. Be the first to comment!
Stay in the loop
Get weekly updates on trending AI coding tools and projects.