Vybe Guide
Sign Up

Explore Projects

Discover 6 open source projects

Active filters (1):
Search: speculationร—
Clear all

Showing 1-6 of 6 projects

SafeAILab/EAGLE

Official implementation of EAGLE, a framework for developing AI-powered coding tools and language models.

2.2K
Active
Python
LLM Frameworks
AI Code Generation
Python
#large-language-models#llm-inference#speculative-decoding

intel/intel-extension-for-transformers

A Python library that provides SOTA compression techniques and efficient LLM inference on Intel platforms to build chatbots quickly.

2.2K
Archived
Python
LLM Frameworks
Inference
Python
#chatbot#llm-inference#compression

NVIDIA/Model-Optimizer

A Python library for optimizing deep learning models for faster inference on deployment platforms like TensorRT.

2.1K
Active
Python
Inference
CLI Tools
#deep-learning#model-optimization#quantization

aphrodite-engine/aphrodite-engine

A large-scale LLM inference engine built in C++ with support for various AI hardware accelerators.

1.7K
Active
C++
LLM Frameworks
Inference
#machine-learning#inference-engine#cuda

jkbrzt/cointrol

A Python-based Bitcoin trading bot with a real-time dashboard for the Bitstamp exchange.

1.5K
Archived
Python
Date & Time
API Frameworks
Python
#bitcoin#trading#automation

hemingkx/SpeculativeDecodingPapers

A curated collection of must-read papers and blogs on speculative decoding techniques for developers.

1.1K
Active
LLM Frameworks
Tutorials & Courses
#speculative-decoding#machine-learning#natural-language-processing

Stay in the loop

Get weekly updates on trending AI coding tools and projects.