lm-sys/RouteLLM

Framework for routing LLM requests to optimize costs while maintaining response quality

Python
AI & Machine Learning
LLM Frameworks
Apache-2.0

4.7K

Stars

360

Forks

Jun 3, 2024

Created

Aug 10, 2024

Last Updated

Project Analytics

Stars Growth (1 Month)

+1

+0.0% change

Avg Daily Growth (1 Month)

+0.5

stars per day

Fork/Star Ratio (All Time)

7.7%

Normal engagement

Lifetime Growth

7.3

stars/day over 642 days

Stars Over Time

Forks Over Time

Open Issues Over Time

AI-Generated Tags

llm-router
cost-optimization
inference-framework
model-serving
llm-evaluation
request-routing

Comments (0)

Sign in to leave a comment or vote

Sign In

No comments yet. Be the first to comment!

Stay in the loop

Get weekly updates on trending AI coding tools and projects.