Explore Projects

Discover 3 open source projects

Active filters (1):
Search: speculative-decodingร—
Clear all

Showing 1-3 of 3 projects

SafeAILab/EAGLE

Official implementation of EAGLE, a framework for developing AI-powered coding tools and language models.

2.2K
Active
Python
LLM Frameworks
AI Code Generation
Python
#large-language-models#llm-inference#speculative-decoding

intel/intel-extension-for-transformers

A Python library that provides SOTA compression techniques and efficient LLM inference on Intel platforms to build chatbots quickly.

2.2K
Archived
Python
LLM Frameworks
Inference
Python
#chatbot#llm-inference#compression

aphrodite-engine/aphrodite-engine

A large-scale LLM inference engine built in C++ with support for various AI hardware accelerators.

1.7K
Active
C++
LLM Frameworks
Inference
#machine-learning#inference-engine#cuda

Stay in the loop

Get weekly updates on trending AI coding tools and projects.