Explore Projects

Discover 2 open source projects

Active filters (1):

Search: openai-triton×

Showing 1-2 of 2 projects

LightLLM is a high-performance, scalable Python-based framework for inference and serving of large language models.

3.9K

Active

Python

LLM Frameworks

API Frameworks

#llm#model-serving#deep-learning

Best inference performance optimization framework for HuggingFace Diffusers on NVIDIA GPUs.

1.3K

Experimental

Python

Inference

Performance Optimizations

PyTorch

#cuda#deeplearning#diffusers

Get weekly updates on trending AI coding tools and projects.