Key Info

LiteLLM announced four updates to its AutoRouter, aimed at tuning routing to production traffic, automatically configuring the best router for available models, and preventing truncated responses with per-model output limits.

Highlights

  • Custom routing dimensions let you tune AutoRouter to match your production traffic patterns.
  • Auto-configuration picks the best router setup based on the models you have available.
  • Per-model output limits help prevent truncated responses.
  • Updated presets cover the latest models.