Inference

Explore 351 open source projects in Inference

Showing 61-80 of 351 projects

microsoft/onnxruntime

High-performance ML inferencing and training accelerator

19.5K

Active

C++

Inference

ML Ops

PyTorch

#ai-framework#deep-learning#machine-learning

apple/ml-stable-diffusion

Stable Diffusion model for generating images on Apple Silicon devices using Core ML.

17.8K

Experimental

Python

Inference

Python

#stable-diffusion#computer-vision#image-generation

divamgupta/diffusionbee-stable-diffusion-ui

Diffusion Bee is an easy-to-use app for running Stable Diffusion AI models locally on M1 Macs.

13.5K

Archived

JavaScript

Inference

Electron

#stable-diffusion#ai-tools#computer-vision

plasma-umass/scalene

High-performance, high-precision CPU, GPU, and memory profiler for Python with AI-powered optimization proposals

13.3K

Active

JavaScript

Inference

Python

#cpu-profiling#gpu-profiling#memory-profiling

NVIDIA/TensorRT

NVIDIA TensorRT is an SDK for high-performance deep learning inference on NVIDIA GPUs.

12.7K

Active

C++

Inference

#deep-learning#gpu-acceleration#inference

lllyasviel/stable-diffusion-webui-forge

A web UI for the Stable Diffusion AI text-to-image generation model, enabling developers to create and customize AI-powered image generation.

12.3K

Experimental

Python

Inference

React

#ai-image-generation#stable-diffusion#text-to-image

triton-inference-server/server

An optimized cloud and edge inference solution for deploying and running machine learning models.

10.4K

Active

Python

Inference

#machine-learning#deep-learning#gpu

Const-me/Whisper

High-performance GPGPU inference of OpenAI's Whisper automatic speech recognition (ASR) model

10.2K

Archived

C++

Inference

#speech-recognition#whisper#asr

openvinotoolkit/openvino

OpenVINO is an open-source toolkit for optimizing and deploying AI inference on a variety of hardware.

9.8K

Active

C++

Inference

#ai#computer-vision#deep-learning

xorbitsai/inference

Unified, production-ready inference API to run open-source, speech, and multimodal models on cloud, on-prem, or your laptop.

9.1K

Active

Python

LLM Frameworks

Inference

PyTorch

#artificial-intelligence#llm#inference

oumi-ai/oumi

Easily fine-tune, evaluate and deploy open-source large language models like GPT-OSS and Llama.

8.9K

Active

Python

LLM Frameworks

Inference

Python

#llms#fine-tuning#evaluation

dusty-nv/jetson-inference

A guide to deploying deep-learning inference networks and computer vision primitives with NVIDIA Jetson hardware and TensorRT.

8.7K

Stable

C++

Computer Vision

Inference

#computer-vision#deep-learning#nvidia

OptimalScale/LMFlow

An extensible toolkit for finetuning and inference of large language models, enabling 'large models for all'.

8.5K

Active

Python

LLM Frameworks

Fine-tuning

PyTorch

#chatgpt#language-model#transformer

facebookresearch/sam3

The repository provides code and tools for running inference and fine-tuning with the Meta Segment Anything Model 3 (SAM 3).

8.0K

Active

Python

Inference

Fine-tuning

Python

#computer-vision#image-segmentation#model-serving

deep-floyd/IF

An AI-powered image generation tool that can create high-quality images from text prompts.

7.8K

Archived

Python

LLM Frameworks

Inference

Python

#text-to-image#diffusion-model#image-generation

XavierXiao/Dreambooth-Stable-Diffusion

This is an implementation of the Dreambooth technique for fine-tuning Stable Diffusion models.

7.8K

Archived

Jupyter Notebook

Fine-tuning

Inference

PyTorch

#stable-diffusion#text-to-image#machine-learning

google-deepmind/alphafold3

AlphaFold 3 is a Python-based inference pipeline for protein structure prediction using deep learning.

7.7K

Active

Python

Inference

Computer Vision

#protein-structure-prediction#deep-learning#computer-vision

InternLM/lmdeploy

LMDeploy is a toolkit for compressing, deploying, and serving large language models (LLMs).

7.7K

Active

Python

LLM Frameworks

Inference

Python

#llm#inference#deployment

cloneofsimo/lora

A library for fine-tuning diffusion models like Stable Diffusion using Low-Rank Adaptation (LoRA) for quick and efficient model personalization.

7.5K

Archived

Jupyter Notebook

Fine-tuning

Inference

Jupyter Notebook

#diffusion#stable-diffusion#fine-tuning

bigcode-project/starcoder

StarCoder is a Python library for fine-tuning and inference of large language models.

7.5K

Archived

Python

LLM Frameworks

Fine-tuning

Python

#llm#fine-tuning#inference

1...35...18

Stay in the loop

Get weekly updates on trending AI coding tools and projects.