Key Info

Ollama now supports Jev-like decision models entirely locally, starting with Nimble, for practical tasks such as ticket triaging, model routing, and content moderation. The models are exposed through a new local /v1/systemone API that allows real-time decision-making.

Highlights

  • Users can install a decision model with ollama pull nimble
  • Target use cases: ticket triaging, model routing, content moderation
  • New local /v1/systemone API enables real-time decision-making in apps
  • Demonstrated via a game (Ollama racer) making live decisions