Inference

Explore 351 open source projects in Inference

Showing 21-40 of 351 projects

vnpy/vnpy

vn.py is an open-source quantitative trading platform development framework based on Python.

37.3K
Stable
Python
Inference
Python
#quantitative-trading#python-framework#financial-analysis

openai/gym

Reinforcement learning toolkit for developing and comparing algorithms.

37.1K
Archived
Python
Inference
Testing
Python
#reinforcement-learning#gym#ai-research

karpathy/LLM101n

Course on building a Storyteller AI LLM from scratch in Python, C, and CUDA

36.4K
Archived
Tutorials & Courses
Inference
PyTorch
#llm#ai#deep learning

BVLC/caffe

Caffe is a fast deep learning framework for vision and machine learning tasks.

34.8K
Archived
C++
Computer Vision
ML Ops
C++
#deep-learning#machine-learning#vision

1Panel-dev/1Panel

1Panel is a modern, open-source Linux server management panel with AI integration and container management.

34.0K
Active
Go
Containerization
MCP Servers
Go
#1panel#linux-server-management#docker-ui

google-ai-edge/mediapipe

Cross-platform ML framework for real-time media processing

34.0K
Active
C++
Inference
Computer Vision
MediaPipe
#ml-framework#real-time-processing#android

lllyasviel/ControlNet

ControlNet adds conditional control to diffusion models for precise image generation.

33.7K
Archived
Python
Computer Vision
Inference
Stable Diffusion
#diffusion-models#control-net#computer-vision

huggingface/diffusers

State-of-the-art diffusion models for image, audio, and video generation in PyTorch.

32.9K
Active
Python
Computer Vision
AI Image & Video
PyTorch
#diffusion-models#image-generation#video-generation

tinygrad/tinygrad

tinygrad is a lightweight deep learning framework combining PyTorch-like ergonomics with compiler visibility and JIT execution.

31.5K
Active
Python
Inference
Computer Vision
PyTorch
#deep-learning#autograd#compiler

Lightning-AI/pytorch-lightning

PyTorch Lightning simplifies deep learning training and deployment at scale.

30.9K
Active
Python
ML Ops
Inference
PyTorch
#pytorch#deep-learning#ml-ops

microsoft/BitNet

1-bit LLM inference framework for CPU/GPU

28.7K
Active
Python
Inference
Local Inference Engines
bitnet.cpp
#1-bit-llm#cpu-inference#gpu-inference

CamDavidsonPilon/Probabilistic-Programming-and-Bayesian-Methods-for-Hackers

Bayesian methods and probabilistic programming in Python with PyMC

28.4K
Archived
Jupyter Notebook
Inference
Books & Guides
PyMC
#bayesian-methods#data-science#pymc

facebookresearch/fastText

fastText for efficient text representation and classification

26.5K
Archived
HTML
Inference
CLI Tools
#fastText#text-classification#NLP

ageron/handson-ml

Deprecated ML book repo with Jupyter notebooks for learning fundamentals

25.8K
Archived
Jupyter Notebook
Books & Guides
Inference
Jupyter Notebook
#machine-learning#deep-learning#scikit-learn

modular/modular

Modular Platform for AI development with MAX and Mojo

25.7K
Active
Mojo
Inference
Containerization
Mojo
#ai#machine-learning#modular

black-forest-labs/flux

Official FLUX.1 inference repo for image generation & editing

25.3K
Experimental
Python
Inference
Local Inference Engines
PyTorch
#flux#image-generation#ai-inference

haotian-liu/LLaVA

LLaVA is a visual instruction tuning framework for large language and vision models, enabling GPT-4 level capabilities.

24.5K
Archived
Python
Computer Vision
LLM Frameworks
PyTorch
#llava#gpt-4#instruction-tuning

ml-explore/mlx

MLX is a machine learning array framework for Apple silicon with Python, C++, and Swift APIs.

24.2K
Active
C++
Inference
LLM Frameworks
Apple Silicon
#ml-framework#apple-silicon#array-computing

sgl-project/sglang

High-performance serving framework for large language and multimodal models

24.1K
Active
Python
Inference
LLM Frameworks
Python
#llm#inference#serving

OpenBMB/MiniCPM-o

On-device multimodal LLM for vision, speech, and live streaming on phones

24.0K
Active
Python
Inference
Local Inference Engines
llama.cpp-omni
#minicpm-o#multimodal-llm#on-device-ai
13...18

Stay in the loop

Get weekly updates on trending AI coding tools and projects.