Key Info

ggerganov announced that decision models are now available in llama.cpp, with a new /v1/systemone endpoint shipped in recent builds for running Jev-style inference locally.

Highlights

  • New /v1/systemone endpoint added to latest llama.cpp builds
  • Supports local, efficient, and private Jev-style inference
  • Multiple open models supported, with more planned