Key Info

LiteLLM introduced Customer Management, which tracks usage and spend per customer across organizations, teams, and members, addressing cases where a $100 customer can cost more than $100 in agent usage.

Highlights

  • Usage and spend are tracked per customer at organization, team, and member levels.
  • One supported pricing model is premium model tiers: a premium model is sold only on higher plans with its own allowance on the customer's key.
  • When that allowance is exhausted, requests fall back to a lower-cost model so the customer keeps working.
  • LiteLLM is hosting a live walkthrough on Nov 20 at 10am PT.