Inference

Explore 351 open source projects in Inference

Showing 261-280 of 351 projects

microsoft/edgeai-for-beginners

This course teaches beginners about Edge AI, including concepts, models, inference, optimization, and developing intelligent Edge AI agents.

1.3K
Active
Jupyter Notebook
LLM Frameworks
Inference
Jupyter Notebook
#edge-ai#machine-learning#computer-vision

ebhy/budgetml

Deploy a lightweight ML inference service with a budget-friendly setup in just a few lines of code.

1.3K
Archived
Python
Inference
API Frameworks
FastAPI
#machine-learning#mlops#deployment

NervanaSystems/ngraph

nGraph is an open-source deep learning compiler framework that optimizes performance for various AI/ML models and runtimes.

1.3K
Archived
C++
Inference
ML Ops
Caffe2
#deep-learning#neural-network#compiler

huggingface/finetrainers

Scalable, memory-optimized training of diffusion models for AI-powered applications.

1.3K
Experimental
Python
Diffusion Models
Fine-tuning
PyTorch
#ai#diffusion#machine-learning

lxtGH/OMG-Seg

Official codebase for OMG-LLaVA and OMG-Seg, state-of-the-art computer vision models presented at CVPR-24 and NeurIPS-24.

1.3K
Stable
Python
Computer Vision
LLM Frameworks
Python
#computer-vision#llm#inference

lightly-ai/lightly-train

All-in-one training for vision models with pretraining, fine-tuning, and distillation capabilities.

1.3K
Active
Python
Computer Vision
Fine-tuning
PyTorch
#computer-vision#deep-learning#pretrained-models

SHI-Labs/Versatile-Diffusion

A versatile diffusion model for text, image, and variation generation in a single model.

1.3K
Archived
Python
Computer Vision
Inference
PyTorch
#diffusion-model#text-to-image#image-generation

wyhuai/DDNM

Zero-shot image restoration using a denoising diffusion model that can remove various types of noise and artifacts.

1.3K
Archived
Python
Computer Vision
Diffusion Models
PyTorch
#image-restoration#zero-shot#diffusion-models

hao-ai-lab/LookaheadDecoding

A Python library that breaks the sequential dependency of LLM inference using lookahead decoding for faster AI model inference.

1.3K
Experimental
Python
LLM Frameworks
Inference
Python
#large-language-models#inference-optimization#performance-improvement

Capsize-Games/airunner

Offline AI-powered inference engine for art, chatbots, and automated workflows focused on privacy and self-hosting

1.3K
Stable
Python
Inference
AI Image & Video
PyGame
#ai#image-generation#chatbot

chengzeyi/stable-fast

Best inference performance optimization framework for HuggingFace Diffusers on NVIDIA GPUs.

1.3K
Experimental
Python
Inference
Performance Optimizations
PyTorch
#cuda#deeplearning#diffusers

Uminosachi/sd-webui-inpaint-anything

An extension for Stable Diffusion web UI that performs inpainting using Segment Anything model.

1.3K
Archived
Python
Computer Vision
Inference
Gradio
#stable-diffusion#inpainting#segment-anything

justinpinkney/awesome-pretrained-stylegan2

A collection of pre-trained StyleGAN 2 models for AI-powered generative art and image synthesis.

1.3K
Archived
Python
Computer Vision
Inference
Python
#generative-art#image-synthesis#pre-trained-models

tucan9389/awesome-ml-demos-with-ios

A collection of demo projects for running machine learning models on iOS using CoreML, TensorFlow Lite, and ML Kit.

1.3K
Archived
Python
Inference
iOS
#machine-learning#coreml#tensorflow-lite

leofan90/Awesome-World-Models

A comprehensive list of papers on World Models, a technique for general video generation, embodied AI, and autonomous driving.

1.3K
Active
Agents & Orchestration
Computer Vision
#world-models#video-prediction#autonomous-driving

LinXueyuanStdio/LaTeX_OCR_PRO

A powerful math formula OCR tool that supports handwritten, Chinese-mixed formulas and simple symbol reasoning.

1.3K
Archived
Jupyter Notebook
Computer Vision
OCR
Jupyter Notebook
#ocr#math-formulas#handwritten

ali-vilab/TeaCache

A Python library for accelerating inference of video diffusion models using timestep embedding caching.

1.3K
Experimental
Python
Inference
Computer Vision
Python
#video-generation#diffusion-models#inference-acceleration

TencentQQGYLab/ELLA

ELLA: A Python library that equips diffusion models with large language models for enhanced semantic alignment.

1.3K
Archived
Python
LLM Frameworks
Fine-tuning
Python
#diffusion-models#large-language-models#semantic-alignment

RightNow-AI/picolm

Run billion-parameter LLMs on embedded devices with extreme quantization for edge inference

1.3K
Active
C
Local Inference Engines
Inference
C
#llm-inference#embedded-ai#quantization

Tencent-Hunyuan/SRPO

A Python library that aligns the full diffusion trajectory with human preferences for fine-grained control of AI models.

1.3K
Stable
Python
LLM Frameworks
Fine-tuning
Python
#diffusion#preference-alignment#llm
1...1315...18

Stay in the loop

Get weekly updates on trending AI coding tools and projects.