Inference

Explore 351 open source projects in Inference

Showing 41-60 of 351 projects

pytorch/examples

PyTorch examples in vision, text, and reinforcement learning

23.8K
Stable
Python
Computer Vision
Inference
PyTorch
#pytorch#machine-learning#computer-vision

liguodongiot/llm-action

Comprehensive LLM engineering and application resources with training, inference, compression, and deployment guides

23.4K
Stable
HTML
Fine-tuning
Inference
#llm-training#llm-inference#llm-ops

facebookresearch/audiocraft

AudioCraft is a PyTorch library for audio generation with deep learning models like MusicGen and AudioGen.

23.0K
Experimental
Jupyter Notebook
AI Voice & Speech
Inference
PyTorch
#audio-generation#deep-learning#music-generation

Tencent/ncnn

High-performance mobile-optimized neural network inference framework for deploying AI models on mobile devices

22.9K
Active
C++
Inference
Cross-Platform
#deep-learning#mobile-ai#ios

deepseek-ai/DeepSeek-OCR

DeepSeek-OCR for visual-text compression and OCR tasks

22.6K
Active
Python
Computer Vision
Inference
vLLM
#ocr#computer-vision#inference

Dao-AILab/flash-attention

Optimized attention mechanism for deep learning

22.5K
Active
Python
Inference
Computer Vision
PyTorch
#flash-attention#deep-learning#pytorch

harvard-edge/cs249r_book

ML Systems textbook and hands-on learning stack for building real-world AI systems

22.1K
Active
JavaScript
Books & Guides
ML Ops
#machine-learning-systems#ai-engineering#ml-ops

mlc-ai/mlc-llm

High-performance LLM deployment engine for cross-platform AI model execution

22.1K
Active
Python
Inference
MCP Frameworks
TVM
#llm-compilation#cross-platform-inference#mlc-engine

SYSTRAN/faster-whisper

Faster Whisper transcription with CTranslate2 for efficient speech-to-text

21.3K
Stable
Python
Inference
Local Inference Engines
CTranslate2
#speech-to-text#inference#quantization

bee-san/Ciphey

Automated decryption/decoding/cracking tool using AI and NLP

21.1K
Experimental
Python
Inference
CLI Tools
#decryption#ai#nlp

nautechsystems/nautilus_trader

High-performance algorithmic trading platform with AI-first design for backtesting and live trading

20.9K
Active
Rust
Inference
Realtime
Rust
#algorithmic-trading#event-driven#rust

karpathy/nn-zero-to-hero

Neural networks course from basics to advanced concepts

20.7K
Archived
Jupyter Notebook
Inference
Tutorials & Courses
#neural-networks#machine-learning#ai-course

mementum/backtrader

Python library for backtesting trading strategies

20.6K
Archived
Python
Inference
#backtesting#trading#python

QwenLM/Qwen

Qwen is a large language model series by Alibaba Cloud with multiple variants and capabilities.

20.6K
Active
Python
LLM Frameworks
Inference
Hugging Face
#large-language-model#alibaba-cloud#qwen

onnx/onnx

Open standard for ML interoperability and model exchange

20.4K
Active
Python
Inference
#onnx#machine-learning#ai

fengdu78/deeplearning_ai_books

深度学习课程笔记及资源,涵盖Python和TensorFlow应用

20.3K
Archived
HTML
Tutorials & Courses
Computer Vision
TensorFlow
#deeplearning-ai#python#tensorflow

facebook/prophet

Time series forecasting with Prophet for multiple seasonality and growth patterns.

20.0K
Active
Python
Inference
ETL & Pipelines
Python
#forecasting#time-series#data-science

openai/gpt-oss

OpenAI's open-weight language models for powerful reasoning and agentic tasks.

19.9K
Stable
Python
Inference
Agent Coordination
Hugging Face
#llm#inference#agentic-ai

FunAudioLLM/CosyVoice

Multilingual voice generation model with full-stack capabilities for TTS, training, and deployment

19.8K
Active
Python
AI Voice & Speech
Fine-tuning
PyTorch
#tts#voice-generation#multilingual

quantopian/zipline

Zipline is a Pythonic algorithmic trading library for backtesting and live trading.

19.5K
Archived
Python
Inference
Testing
Python
#algorithmic-trading#backtesting#pandas
124...18

Stay in the loop

Get weekly updates on trending AI coding tools and projects.