Explore Projects

Discover 46 open source projects

Active filters (1):
Search: tensorrt×
Clear all

Showing 1-20 of 46 projects

NVIDIA/TensorRT-LLM

TensorRT LLM provides a Python API and optimizations to efficiently run large language models on NVIDIA GPUs.

13.0K
Active
Python
LLM Frameworks
PyTorch
#cuda#llm-serving#moe

NVIDIA/TensorRT

NVIDIA TensorRT is an SDK for high-performance deep learning inference on NVIDIA GPUs.

12.7K
Active
C++
Inference
#deep-learning#gpu-acceleration#inference

Megvii-BaseDetection/YOLOX

YOLOX is a high-performance anchor-free YOLO model for object detection

10.4K
Experimental
Python
React
#object-detection#deep-learning#yolox

dusty-nv/jetson-inference

A guide to deploying deep-learning inference networks and computer vision primitives with NVIDIA Jetson hardware and TensorRT.

8.7K
Stable
C++
Computer Vision
Inference
#computer-vision#deep-learning#nvidia

mikel-brostrom/boxmot

A powerful multi-object tracking library with modular SOTA tracking modules for segmentation, detection, and pose estimation.

8.0K
Active
Python
Computer Vision
CLI Tools
Python
#multi-object-tracking#segmentation#object-detection

wang-xinyu/tensorrtx

TensorRT implementation of popular deep learning networks for efficient inference on GPUs

7.7K
Active
C++
Computer Vision
API Frameworks
#computer-vision#tensorrt#deep-learning

xlite-dev/Awesome-LLM-Inference

A curated list of awesome papers and code for optimizing LLM/VLM inference performance

5.0K
Active
Python
LLM Frameworks
LLM Wrappers & SDKs
#llm#inference#optimization

NVIDIA-AI-IOT/torch2trt

An easy-to-use PyTorch to TensorRT converter for optimizing AI model inference on NVIDIA Jetson devices.

4.9K
Archived
Python
Inference
API Frameworks
PyTorch
#pytorch#tensorrt#jetson

TingsongYu/PyTorch-Tutorial-2nd

A tutorial repository for learning PyTorch, covering computer vision, NLP, and deep learning model deployment.

4.4K
Archived
Jupyter Notebook
Computer Vision
LLM Frameworks
PyTorch
#pytorch#computer-vision#nlp

xlite-dev/lite.ai.toolkit

A lite C++ AI toolkit with 100+ models for computer vision tasks like detection, segmentation, and image generation.

4.4K
Active
C++
Computer Vision
Inference
#computer-vision#inference#cli

collabora/WhisperLive

A nearly-live implementation of OpenAI's Whisper, a powerful speech recognition and translation tool.

3.9K
Active
Python
LLM Frameworks
AI Voice & Speech
Python
#whisper#speech-recognition#translation

NVIDIA/GenerativeAIExamples

Collection of generative AI reference workflows optimized for accelerated infrastructure and microservice architecture.

3.8K
Active
Jupyter Notebook
LLM Frameworks
Inference
React
#gpu-acceleration#large-language-models#microservice

onnx/onnx-tensorrt

ONNX-TensorRT is a C++ library that provides a TensorRT backend for the ONNX deep learning framework.

3.2K
Stable
C++
Inference
API Frameworks
#deep-learning#nvidia#onnx

tinyvision/DAMO-YOLO

A fast and accurate object detection method with new technologies like NAS backbones and efficient RepGFPN.

3.1K
Archived
Python
Computer Vision
API Frameworks
PyTorch
#object-detection#deep-learning#nas

lucasjinreal/yolov7_d2

A powerful object detection and instance segmentation library built on top of YOLOv7 and transformers, with TensorRT acceleration.

3.1K
Archived
Python
Computer Vision
API Frameworks
PyTorch
#object-detection#instance-segmentation#transformers

NVIDIA/ChatRTX

A developer reference project for creating Retrieval Augmented Generation (RAG) chatbots on Windows using TensorRT-LLM.

3.1K
Active
Python
LLM Frameworks
RAG & Vector
Python
#chatbots#retrieval-augmented-generation#tensorrt

open-mmlab/mmdeploy

OpenMMLab's model deployment framework for optimizing and deploying computer vision models across various backends.

3.1K
Archived
Python
Computer Vision
Model Serving
PyTorch
#computer-vision#deep-learning#deployment

pytorch/TensorRT

PyTorch compiler for NVIDIA GPUs using TensorRT, enabling efficient deep learning inference on CUDA hardware.

3.0K
Active
Python
ML Ops
API Frameworks
PyTorch
#deep-learning#cuda#nvidia

enpeizhao/CVprojects

A collection of computer vision and AI projects in Python, C++, and embedded systems for developers.

2.6K
Stable
Jupyter Notebook
Computer Vision
Backend Frameworks
Python
#computer-vision#deep-learning#embedded-systems

jolibrain/deepdetect

A C++ API and server for deep learning that supports popular frameworks like PyTorch, TensorFlow, and XGBoost.

2.5K
Active
C++
Computer Vision
API Clients & Testing
#deep-learning#computer-vision#object-detection

Stay in the loop

Get weekly updates on trending AI coding tools and projects.