Explore Projects

Discover 46 open source projects

Active filters (1):
Search: quantizationร—
Clear all

Showing 41-46 of 46 projects

RightNow-AI/picolm

Run billion-parameter LLMs on embedded devices with extreme quantization for edge inference

1.3K
Active
C
Local Inference Engines
Inference
C
#llm-inference#embedded-ai#quantization

open-edge-platform/training_extensions

Train, evaluate, optimize, and deploy computer vision models with OpenVINO, a toolkit for accelerating deep learning on edge devices.

1.2K
Active
Python
Computer Vision
API Frameworks
PyTorch
#computer-vision#openvino#deep-learning

GaParmar/clean-fid

A PyTorch library for calculating the Frechet Inception Distance (FID) with proper image resizing and quantization steps.

1.1K
Experimental
Python
Computer Vision
API Frameworks
PyTorch
#fid#fid-calculation#computer-vision

openvinotoolkit/nncf

Neural Network Compression Framework for enhanced OpenVINOโ„ข inference

1.1K
Active
Python
Inference
Computer Vision
PyTorch
#openvino#quantization#pruning

huggingface/optimum-quanto

A PyTorch quantization backend for Optimum, a library for deploying and accelerating AI models.

1.0K
Stable
Python
Inference
API Frameworks
PyTorch
#model-optimization#quantization#inference-acceleration

Gumpest/YOLOv5-Multibackbone-Compression

A compression toolkit for YOLOv5 with support for various backbones, modules, and deployment options.

1.0K
Archived
Python
Computer Vision
Build Tools
PyTorch
#yolov5#object-detection#compression

Stay in the loop

Get weekly updates on trending AI coding tools and projects.