Explore Projects

Discover 5 open source projects

Active filters (1):

Search: rdma×

Clear all

Showing 1-5 of 5 projects

exo-explore/exo

Run frontier AI models locally across devices using RDMA and tensor parallelism

42.1K

Active

Python

Desktop Model Runners

Inference

MLX

#ai-inference#rdma#tensor-parallelism

kvcache-ai/Mooncake

Mooncake is a serving platform for Kimi, a leading LLM service provided by Moonshot AI, focused on disaggregation, inference, and RDMA.

4.9K

Active

C++

LLM Frameworks

API Frameworks

C++

#llm#inference#rdma

NVIDIA/gdrcopy

A fast GPU memory copy library based on NVIDIA GPUDirect RDMA technology, useful for developers working with GPU-accelerated applications.

1.4K

Stable

C++

API Frameworks

Containerization

#gpu-memory#gpudirect-rdma#kernel-mode-driver

uccl-project/uccl

Efficient communication library for GPUs, covering collectives, P2P, and EP for AI/ML workloads

1.2K

Active

C++

GPU Frameworks

API Frameworks

C++

#ai#gpu#hpc

microsoft/demikernel

A kernel-bypass LibOS architecture for high-performance networking and IO on Linux.

1.2K

Stable

Rust

API Frameworks

Containerization

#networking#kernel-bypass#high-performance

Stay in the loop

Get weekly updates on trending AI coding tools and projects.