Explore Projects

Discover 4 open source projects

Active filters (1):

Search: tiktoken×

Showing 1-4 of 4 projects

A fast BPE tokenizer for use with OpenAI's language models in Python.

17.5K

Stable

Python

LLM Wrappers & SDKs

Python

#tokenizer#bpe#openai

Java SDK for ChatGPT with support for streaming output, plugins, and offline mode, providing access to OpenAI's APIs.

3.5K

Archived

Java

LLM Wrappers & SDKs

API Clients & Testing

#chatgpt#openai-api#gpt-35-turbo

A tool that makes it easy to scrape and ingest content from various sources like GitHub, arXiv, and YouTube for use with large language models.

1.9K

Stable

Python

LLM Frameworks

CLI Tools

Python

#llm#text-extraction#data-ingestion

Online playground for OpenAPI tokenizers, focused on the Tiktoken library used by ChatGPT.

1.5K

Experimental

TypeScript

LLM Frameworks

API Clients & Testing

Next.js

#chatgpt#openai#tokenizer

Get weekly updates on trending AI coding tools and projects.