Explore Projects

Discover 321 open source projects

Active filters (1):
Search: inferenceร—
Clear all

Showing 281-300 of 321 projects

VoltaML/voltaML

A lightweight library to convert and run ML/DL models in high-performance inference runtimes like TensorRT, TorchScript, ONNX, and TVM.

1.2K
Archived
Python
Inference
API Frameworks
Python
#machine-learning#deep-learning#inference

zkonduit/ezkl

ezkl is a Rust-based engine for doing inference on deep learning models and computational graphs in zero-knowledge.

1.2K
Active
Rust
Inference
Cryptography
#zero-knowledge#cryptography#inference

run-house/kubetorch

Distribute and run AI workloads on Kubernetes with a Python-based infrastructure toolkit like PyTorch.

1.2K
Active
Python
ML Ops
Containerization
PyTorch
#kubernetes#distributed-computing#data-science

StarlightSearch/EmbedAnything

Highly performant, modular, and production-ready inference, ingestion, and indexing library built in Rust for AI-powered applications.

1.2K
Active
Rust
LLM Frameworks
Search-as-a-Service
Rust
#ai#indexing#inference

kubeai-project/kubeai

An AI inference operator for Kubernetes that makes it easy to serve ML models in production.

1.2K
Active
Go
Inference
BaaS Platforms
#ai#kubernetes#inference

NVlabs/Deep_Object_Pose

A Python library for deep learning-based object pose estimation, with ROS inference capabilities.

1.2K
Stable
Python
Computer Vision
API Frameworks
Python
#computer-vision#object-detection#pose-estimation

ardha27/AI-Song-Cover-RVC

An all-in-one tool for AI-powered song cover creation, including YouTube audio download, vocal separation, audio splitting, training, and inference.

1.1K
Archived
Jupyter Notebook
LLM Frameworks
Computer Vision
Jupyter Notebook
#ai#rvc#song-cover

frotms/PaddleOCR2Pytorch

A PyTorch-based implementation of the PaddleOCR optical character recognition model, enabling developers to leverage state-of-the-art AI for text detection and recognition.

1.1K
Stable
Python
Computer Vision
Inference
PyTorch
#ocr#text-detection#text-recognition

GradientHQ/parallax

Parallax is a distributed model serving framework that lets you build your own AI cluster anywhere.

1.1K
Active
Python
LLM Frameworks
API Frameworks
PyTorch
#distributed-systems#decentralized-inference#llm-serving

eBay/bayesian-belief-networks

A Python library for creating and performing exact inference on Bayesian Belief Networks.

1.1K
Archived
Python
Inference
API Frameworks
#bayesian-networks#probabilistic-modeling#machine-learning

character-ai/prompt-poet

Streamlines prompt design for developers and non-technical users with a low-code approach.

1.1K
Stable
Python
LLM Frameworks
Prompt Engineering
Python
#llm#prompt-design#prompt-engineering

huggingface/search-and-learn

Recipes to scale inference-time compute of open models for AI/ML developers.

1.1K
Experimental
Python
Inference
API Frameworks
Python
#ai-models#model-optimization#inference-speed

openvinotoolkit/nncf

Neural Network Compression Framework for enhanced OpenVINOโ„ข inference

1.1K
Active
Python
Inference
Computer Vision
PyTorch
#openvino#quantization#pruning

basetenlabs/truss

The simplest way to serve AI/ML models in production, with support for popular models like Stable Diffusion and Whisper.

1.1K
Active
Python
Inference
API Development
Flask
#artificial-intelligence#machine-learning#model-serving

PriesiaMioShirakana/DragonianVoice

A C++ inference library for various SVC/TTS models, including DiffSinger, DiffSVC, HiFiGAN, and VITS.

1.1K
Experimental
C
AI Voice & Speech
API Frameworks
#speech-synthesis#text-to-speech#voice-conversion

pymc-labs/CausalPy

A Python package for causal inference in quasi-experimental settings

1.1K
Active
Python
Causal Inference
#causal-inference#quasi-experimental#pymc

snap-research/EfficientFormer

EfficientFormer is a deep learning model for efficient image segmentation and object detection.

1.1K
Archived
Python
PyTorch
#deep-learning#efficient-inference#transformer

horseee/LLM-Pruner

A tool for structurally pruning large language models like LLaMA, BLOOM, and Vicuna to reduce their size and inference time.

1.1K
Archived
Python
LLM Frameworks
Inference
Python
#compression#pruning#large-language-models

huawei-noah/trustworthyAI

Open-source projects related to trustworthy AI, including causal discovery, causal inference, and causality.

1.1K
Stable
Python
Causal Inference
Causal Discovery
Python
#causality#causal-inference#causal-discovery

matteocourthoud/awesome-causal-inference

A curated list of causal inference libraries, resources, and applications for developers.

1.1K
Stable
LLM Frameworks
CLI Tools
#causal-inference#machine-learning#data-science
1...141617

Stay in the loop

Get weekly updates on trending AI coding tools and projects.