openai/tiktoken
A fast BPE tokenizer for use with OpenAI's language models in Python.
Python
AI & Machine Learning
LLM Wrappers & SDKs
MIT
17.5K
Stars
1.4K
Forks
Dec 1, 2022
Created
Feb 8, 2026
Last Updated
Project Analytics
Stars Growth (1 Month)
+279
+1.6% change
Avg Daily Growth (1 Month)
+10.0
stars per day
Fork/Star Ratio (All Time)
8.0%
Normal engagement
Lifetime Growth
14.7
stars/day over 1.2K days
Stars Over Time
Forks Over Time
Open Issues Over Time
Pull Requests Over Time
Commits Over Time
AI-Generated Tags
tokenizer
bpe
openai
language-model
python-library
Similar Projects
EbookFoundation/free-programming-books
Free programming books repository with AI-powered features
383.6K
Python
jwasham/coding-interview-university
A comprehensive computer science study plan for software engineers, with a focus on coding interviews and AI-related topics.
337.6K
vinta/awesome-python
Awesome Python framework and resource collection
285.7K
Python
openclaw/openclaw
Personal AI assistant for messaging platforms, self-hosted and multi-channel
265.0K
TypeScript
Comments (0)
Sign in to leave a comment or vote
Sign InNo comments yet. Be the first to comment!
Stay in the loop
Get weekly updates on trending AI coding tools and projects.