hao-ai-lab/LookaheadDecoding

A Python library that breaks the sequential dependency of LLM inference using lookahead decoding for faster AI model inference.

Python
AI & Machine Learning
LLM Frameworks
Apache-2.0

1.3K

Stars

80

Forks

Nov 21, 2023

Created

Mar 6, 2025

Last Updated

Project Analytics

Stars Growth (1 Month)

+1

+0.1% change

Avg Daily Growth (1 Month)

+0.0

stars per day

Fork/Star Ratio (All Time)

6.1%

Normal engagement

Lifetime Growth

1.6

stars/day over 837 days

Stars Over Time

Forks Over Time

Open Issues Over Time

Pull Requests Over Time

Commits Over Time

AI-Generated Tags

large-language-models
inference-optimization
performance-improvement
autoregressive-decoding
research-paper

Comments (0)

Sign in to leave a comment or vote

Sign In

No comments yet. Be the first to comment!

Stay in the loop

Get weekly updates on trending AI coding tools and projects.