Key Info

OpenRouter states that models can write up to 1M tokens in a single response with long decode, using continuation tokens to run past the per-request output limit.

Highlights

  • Single responses can reach up to 1M tokens of output
  • Uses long decode to sustain generation
  • Continuation tokens allow running past the per-request output limit
  • A migration guide is provided for details