Inference
Explore 351 open source projects in Inference
Showing 101-120 of 351 projects
open-edge-platform/anomalib
An open-source anomaly detection library with state-of-the-art algorithms and features like experiment management and edge inference.
NVIDIA/tacotron2
A PyTorch implementation of Tacotron 2, a state-of-the-art text-to-speech model, with faster-than-realtime inference.
flashinfer-ai/flashinfer
A Python library for serving large language models (LLMs) with high performance, including GPU acceleration and distributed inference.
xlite-dev/Awesome-LLM-Inference
A curated list of awesome papers and code for optimizing LLM/VLM inference performance
NVlabs/Sana
SANA is an efficient high-resolution image synthesis library using a linear diffusion transformer.
h2oai/h2o-llmstudio
H2O LLM Studio is a no-code GUI framework for fine-tuning large language models (LLMs) like GPT-3, LLAMA, and ChatGPT.
NVIDIA-AI-IOT/torch2trt
An easy-to-use PyTorch to TensorRT converter for optimizing AI model inference on NVIDIA Jetson devices.
shibing624/MedicalGPT
This repository allows developers to train their own medical language models using the ChatGPT training pipeline.
thunlp/OpenPrompt
An open-source framework for prompt-learning, a powerful technique for fine-tuning language models.
facebookincubator/AITemplate
AITemplate is a Python framework for rendering neural networks into high-performance CUDA/HIP C++ code, optimized for GPU inference.
gpustack/gpustack
Optimize AI inference performance on GPUs with this Python library for selecting and tuning inference engines.
huggingface/text-embeddings-inference
A blazing fast inference solution for text embeddings models built with Rust.
lightvector/KataGo
KataGo is an open-source Go engine and self-play learning platform for AI research and development.
huawei-noah/Efficient-AI-Backbones
Efficient AI model backbones developed by Huawei's Noah's Ark Lab, including GhostNet, TNT, and MLP.
xlite-dev/lite.ai.toolkit
A lite C++ AI toolkit with 100+ models for computer vision tasks like detection, segmentation, and image generation.
showlab/Tune-A-Video
Tune-A-Video is a one-shot text-to-video generation tool that fine-tunes image diffusion models.
openvinotoolkit/open_model_zoo
A collection of pre-trained deep learning models and demos optimized for high performance using the OpenVINO toolkit.
OpenNMT/CTranslate2
Fast C++ inference engine for Transformer models, supporting CUDA, MKL, and other optimizations.
VectorSpaceLab/OmniGen
OmniGen is a unified image generation library that supports diffusion models, multi-modal and multi-task learning.
Tencent-Hunyuan/HunyuanDiT
A powerful multi-resolution diffusion transformer for fine-grained Chinese text understanding and generation.
Stay in the loop
Get weekly updates on trending AI coding tools and projects.