Explore Projects

Discover 173 open source projects

Active filters (1):
Search: servingร—
Clear all

Showing 141-160 of 173 projects

tensorlakeai/indexify

A realtime serving engine for Data-Intensive Generative AI Applications built in Rust.

1.3K
Active
Rust
LLM Frameworks
Realtime
#llm#machine-learning#retrieval

unum-cloud/UCall

A high-performance web server and RPC framework for developers, offering 50x lower latency and 70x higher bandwidth than FastAPI.

1.3K
Stable
C
FastAPI
#high-performance#web-server#RPC

kitops-ml/kitops

An open-source DevOps tool for packaging and versioning AI/ML models, datasets, code, and configuration into an OCI Artifact.

1.3K
Active
Go
MLOps
Containerization
Go
#ai#devops#oci

docling-project/docling-serve

Docling is an API service for running Docling, a platform for building AI-powered applications.

1.3K
Active
Python
LLM Frameworks
API Frameworks
Flask
#llm#api#ml-ops

charlesXu86/Chatbot_CN

A chatbot framework for the finance and legal domains, with NLU, NLG, and knowledge graph capabilities.

1.3K
Archived
NLU
NLG
#chatbot#nlp#knowledge-graph

logicalclocks/hopsworks

Hopsworks is a feature store and MLOps platform for data-intensive AI and machine learning applications.

1.3K
Experimental
Java
ML Ops
Feature Store
#feature-store#mlops#machine-learning

wq/django-rest-pandas

Serves up Pandas dataframes via the Django REST Framework for use in client-side visualizations and offline analysis.

1.3K
Experimental
Python
Charts & Visualization
API Frameworks
Django
#chart#csv#dataviz

codefuse-ai/codefuse-chatbot

An intelligent assistant that helps developers throughout the software development lifecycle, powered by a Multi-Agent Framework.

1.3K
Archived
Python
AI Coding Agents
LLM Frameworks
Python
#aiops#chatbot#code-repo-analysis

regenrek/deepwiki-mcp

Fetches and serves the latest knowledge from deepwiki.com using a MCP server

1.3K
Active
TypeScript
React
#authentication#streaming#real-time

ray-project/ray-llm

RayLLM is a framework for serving large language models (LLMs) on the Ray distributed computing platform.

1.3K
Experimental
LLM Frameworks
API Frameworks
#llm#distributed-computing#ray

ShannonAI/service-streamer

Boosts the deployment and serving of deep learning models and web services.

1.2K
Archived
Python
Model Serving
API Frameworks
PyTorch
#deep-learning#model-deployment#web-services

Emupedia/emupedia.github.io

An open-source project that aims to digitally collect, archive, and preserve retro games and software.

1.2K
Stable
JavaScript
Frontend Frameworks
Databases
JavaScript
#video-game-preservation#emulation#retrogaming

emikulic/darkhttpd

darkhttpd is a lightweight and fast web server written in C, useful for quick web serving needs.

1.2K
Active
C
API Frameworks
#lightweight#fast#web-server

archagon/tasty-imitation-keyboard

A custom iOS keyboard built with Swift and Apple's latest technologies, serving as a tasty imitation of the default Apple keyboard.

1.2K
Archived
Swift
Component Libraries (Swift)
Swift
#keyboard#custom-ui#swift

lukeed/sirv

An optimized middleware and CLI application for serving static files efficiently.

1.2K
Stable
JavaScript
Backend Frameworks
CLI Tools
Node
#static-files#middleware#optimization

kubeai-project/kubeai

An AI inference operator for Kubernetes that makes it easy to serve ML models in production.

1.2K
Active
Go
Inference
BaaS Platforms
#ai#kubernetes#inference

tiangolo/dockerswarm.rocks

A Docker Swarm toolkit that makes it easy to deploy production-ready, distributed, HTTPS served clusters.

1.1K
Active
Python
Containerization
Infrastructure as Code
Docker
#docker#docker-swarm#https

punica-ai/punica

A Python library serving multiple LoRA finetuned large language models (LLMs) as one.

1.1K
Archived
Python
LLM Frameworks
API Frameworks
#large-language-models#llm#lora

GradientHQ/parallax

Parallax is a distributed model serving framework that lets you build your own AI cluster anywhere.

1.1K
Active
Python
LLM Frameworks
API Frameworks
PyTorch
#distributed-systems#decentralized-inference#llm-serving

koajs/static

A static file server middleware for the Koa.js web framework, useful for serving static assets.

1.1K
Stable
JavaScript
API Frameworks
Backend Frameworks
Koa.js
#middleware#static-files#web-server
1...79

Stay in the loop

Get weekly updates on trending AI coding tools and projects.