Key Info

OpenRouter released its largest provider router upgrade since the company was founded, changing how traffic is allocated among inference providers. Previously the router prioritized mostly on price; the new router rewards the best-quality inference for the actual cost of a request.

Highlights

  • Routing now weighs quality of inference against the real cost of each request, not price alone.
  • The stated goal is requests that stay cheap while also being fast and reliable.
  • Providers delivering more value automatically win more traffic, creating an incentive to keep improving.
  • OpenRouter says improvements from any provider translate into better inference for its users.
  • A longer write-up of the approach is linked in the thread.