Key Info
OpenRouter released its largest provider router upgrade since the company was founded, changing how traffic is allocated among inference providers. Previously the router prioritized mostly on price; the new router rewards the best-quality inference for the actual cost of a request.
Highlights
- Routing now weighs quality of inference against the real cost of each request, not price alone.
- The stated goal is requests that stay cheap while also being fast and reliable.
- Providers delivering more value automatically win more traffic, creating an incentive to keep improving.
- OpenRouter says improvements from any provider translate into better inference for its users.
- A longer write-up of the approach is linked in the thread.