Key Info

Hugging Face's transformers serve now includes a /v1/systemone endpoint that converts any of 250 supported LLM and VLM models into a JEV-like decision model, scoring a set of decisions using the model's logits without generating text.

Highlights

  • New /v1/systemone endpoint in transformers serve
  • Works with any of 250 LLM & VLM models
  • Scores decisions directly from logits, skipping text generation
  • Described as a JEV-like decision model; standardization is coming soon
  • Attributed to @art_zucker for the standardization work