Inference

Explore 351 open source projects in Inference

Showing 281-300 of 351 projects

ModelTC/Qwen-Image-Lightning

This Python library speeds up the Qwen-Image model using distillation, a technique for AI model optimization.

1.3K
Stable
Python
LLM Frameworks
Inference
PyTorch
#model-distillation#computer-vision#inference-optimization

facebookresearch/llm-transparency-tool

An open-source toolkit for analyzing the internal workings of Transformer-based language models.

1.2K
Archived
Python
LLM Frameworks
CLI Tools
React
#language-models#transformer#analysis

tianweiy/DMD2

A high-performance image synthesis model with improved distribution matching distillation.

1.2K
Experimental
Python
Computer Vision
Inference
Python
#image-synthesis#distribution-matching#distillation

alibaba/Tora

A diffusion-based video generation model for trajectory-oriented video synthesis.

1.2K
Experimental
Python
Computer Vision
Inference
Python
#video-generation#diffusion-model#trajectory-oriented

Tencent/FeatherCNN

FeatherCNN is a high-performance inference engine for convolutional neural networks.

1.2K
Archived
C++
Inference
API Frameworks
#convolutional-neural-networks#inference-engine#android

zju3dv/MatchAnything

Cross-modal image matching framework with large-scale pre-training for AI-powered coding tools.

1.2K
Stable
Computer Vision
Inference
PyTorch
#cross-modal-matching#computer-vision#ai-powered-coding

chengzeyi/Comfy-WaveSpeed

An all-in-one inference optimization solution for ComfyUI, a universal, flexible, and fast tool for vibe coders.

1.2K
Experimental
Python
Inference
AI App Builders
Python
#comfyui#inference-optimization#ai-tools

KMnP/vpt

A Python library for fine-tuning and evaluating large language models with visual prompts.

1.2K
Archived
Python
Fine-tuning
Inference
Python
#visual-prompts#language-models#fine-tuning

google-research/fixmatch

A simple semi-supervised learning method with limited data, useful for AI/ML developers.

1.2K
Archived
Python
Fine-tuning
Inference
Python
#machine-learning#computer-vision#semi-supervised-learning

OpenRouterTeam/openrouter-runner

Deprecated inference engine for AI-powered developer tools and workflows.

1.2K
Stable
Python
Inference
CLI Tools
Python
#ai#inference#deprecated

yeyupiaoling/Whisper-Finetune

Fine-tune and deploy the Whisper speech recognition model with accelerated inference and support for various platforms.

1.2K
Stable
C
Fine-tuning
Inference
PyTorch
#speech-recognition#whisper#fine-tune

stylegan-human/StyleGAN-Human

A data-centric approach to generating photorealistic human images using StyleGAN, a powerful generative AI model.

1.2K
Archived
Python
Computer Vision
Inference
PyTorch
#generative-ai#computer-vision#image-generation

microsoft/MInference

A Python library that speeds up inference for large language models by up to 10x with dynamic sparse attention

1.2K
Stable
Python
LLM Frameworks
Inference
Python
#large-language-models#inference-optimization#sparse-attention

VoltaML/voltaML

A lightweight library to convert and run ML/DL models in high-performance inference runtimes like TensorRT, TorchScript, ONNX, and TVM.

1.2K
Archived
Python
Inference
API Frameworks
Python
#machine-learning#deep-learning#inference

toshas/torch-fidelity

High-fidelity performance metrics for generative models in PyTorch

1.2K
Stable
Python
Inference
Metrics
PyTorch
#generative-models#evaluation#reproducibility

zkonduit/ezkl

ezkl is a Rust-based engine for doing inference on deep learning models and computational graphs in zero-knowledge.

1.2K
Active
Rust
Inference
Cryptography
#zero-knowledge#cryptography#inference

gpleiss/temperature_scaling

A simple tool to calibrate neural networks and improve their performance.

1.2K
Experimental
Python
Inference
Testing
PyTorch
#calibration#deep-learning#neural-networks

xtreme1-io/xtreme1

An all-in-one data labeling and annotation platform for multimodal data training, supporting 3D LiDAR, images, and language models.

1.2K
Experimental
TypeScript
Computer Vision
Inference
TypeScript
#3d-annotation#annotation-tool#lidar-annotation

kubeai-project/kubeai

An AI inference operator for Kubernetes that makes it easy to serve ML models in production.

1.2K
Active
Go
Inference
BaaS Platforms
#ai#kubernetes#inference

ermongroup/SDEdit

A PyTorch library for image synthesis and editing using stochastic differential equations.

1.2K
Archived
Python
Computer Vision
Inference
PyTorch
#image-generation#image-editing#computer-vision
1...1416...18

Stay in the loop

Get weekly updates on trending AI coding tools and projects.