Explore Projects
Discover 10 open source projects
Showing 1-10 of 10 projects
triton-lang/triton
Triton is a development repository for a domain-specific programming language and compiler focused on machine learning and AI workloads.
triton-inference-server/server
An optimized cloud and edge inference solution for deploying and running machine learning models.
ModelTC/LightLLM
LightLLM is a high-performance, scalable Python-based framework for inference and serving of large language models.
NVIDIA/GenerativeAIExamples
Collection of generative AI reference workflows optimized for accelerated infrastructure and microservice architecture.
thu-ml/SageAttention
Quantized attention that achieves 2-5x speedup over FlashAttention for language, image, and video models.
ELS-RD/kernl
Kernl is a library that lets you run PyTorch transformer models several times faster on GPU with a single line of code.
ByteDance-Seed/Triton-distributed
Distributed compiler based on Triton for parallel systems, focused on AI and high-performance computing.
TritonDataCenter/triton
Triton DataCenter is a cloud management platform with first-class support for containers.
chengzeyi/stable-fast
Best inference performance optimization framework for HuggingFace Diffusers on NVIDIA GPUs.
TritonDataCenter/containerpilot
A Go-based service for auto-discovery and configuration of applications running in containers.
Stay in the loop
Get weekly updates on trending AI coding tools and projects.