LiteLLM Releases Autorouter SDK for Python-Based Model Routing

Key Info

LiteLLM introduced the Autorouter SDK, a Python library for choosing the right model for every prompt across agents, with no proxy required.

Highlights

• Classify prompts using heuristics, an LLM, or custom code
• Map any tiers to any models
• Mix providers, pin sessions, and escalate on stalls
• Runs entirely in Python without a proxy