FasterDecoding/Medusa

A simple framework for accelerating LLM generation with multiple decoding heads

Jupyter Notebook
AI & Machine Learning
LLM Frameworks
Apache-2.0

2.7K

Stars

194

Forks

Sep 10, 2023

Created

Jun 25, 2024

Last Updated

Project Analytics

Stars Growth (1 Month)

+14

+0.5% change

Avg Daily Growth (1 Month)

+0.5

stars per day

Fork/Star Ratio (All Time)

7.1%

Normal engagement

Lifetime Growth

3.0

stars/day over 909 days

Stars Over Time

Forks Over Time

Open Issues Over Time

Pull Requests Over Time

Commits Over Time

AI-Generated Tags

llm
generation
inference
decoding
jupyter
python

Comments (0)

Sign in to leave a comment or vote

Sign In

No comments yet. Be the first to comment!

Stay in the loop

Get weekly updates on trending AI coding tools and projects.