karpathy/minbpe

Minimal, clean Python implementation of the Byte Pair Encoding (BPE) algorithm for tokenization in LLMs.

Python
AI & Machine Learning
LLM Frameworks
MIT

10.3K

Stars

1.0K

Forks

Feb 16, 2024

Created

Jul 1, 2024

Last Updated

Project Analytics

Stars Growth (1 Month)

+53

+0.5% change

Avg Daily Growth (1 Month)

+1.9

stars per day

Fork/Star Ratio (All Time)

9.8%

Normal engagement

Lifetime Growth

13.8

stars/day over 749 days

Stars Over Time

Forks Over Time

Open Issues Over Time

Pull Requests Over Time

Commits Over Time

AI-Generated Tags

tokenization
byte-pair-encoding
llm
language-model
cli-tool
python-library

Comments (0)

Sign in to leave a comment or vote

Sign In

No comments yet. Be the first to comment!

Stay in the loop

Get weekly updates on trending AI coding tools and projects.