Explore Projects

Discover 7 open source projects

Active filters (1):

Search: inference-engine×

Clear all

Showing 1-7 of 7 projects

FedML-AI/FedML

A unified and scalable ML library for large-scale distributed training, model serving, and federated learning.

4.0K

Stable

Python

ML Ops

Inference

React

#ai#machine-learning#federated-learning

hyperjumptech/grule-rule-engine

A powerful rule engine implementation in Go that enables developers to build rule-based applications.

2.5K

Stable

API Frameworks

CLI Tools

#rule-engine#inference-engine#golang

siliconflow/onediff

OneDiff: An out-of-the-box acceleration library for diffusion models.

2.0K

Stable

Jupyter Notebook

AI Code Generation

React

#diffusion-models#acceleration#out-of-the-box

aphrodite-engine/aphrodite-engine

A large-scale LLM inference engine built in C++ with support for various AI hardware accelerators.

1.7K

Active

C++

LLM Frameworks

Inference

#machine-learning#inference-engine#cuda

chengzeyi/stable-fast

Best inference performance optimization framework for HuggingFace Diffusers on NVIDIA GPUs.

1.3K

Experimental

Python

Inference

Performance Optimizations

PyTorch

#cuda#deeplearning#diffusers

Tencent/FeatherCNN

FeatherCNN is a high-performance inference engine for convolutional neural networks.

1.2K

Archived

C++

Inference

API Frameworks

#convolutional-neural-networks#inference-engine#android

PaddlePaddle/Paddle.js

Paddle.js is a web project for the Baidu PaddlePaddle deep learning framework, enabling browser-based inference.

1.1K

Archived

JavaScript

Inference

Frontend Frameworks

React

#deep-learning#inference-engine#paddlepaddle

Stay in the loop

Get weekly updates on trending AI coding tools and projects.