vLLM v0.32.0 adds a default /v1/systemone structured-decision endpoint for choice/score models, a generic HF template parser, wider NVFP4 KV cache support and three security fixes

Why it matters

【Key points】

vLLM released v0.32.0 on October 18 (814 commits from 363 contributors, 121 new). The headline is a new POST /v1/systemone "structured decisions" endpoint: given a structured state, a model returns a probability for every allowed answer to `choice`, `noul` (yes/no) and `score` questions instead of generating free text; per the docs it reads the logprobs of the reply's first token, allows up to 64 questions per request, needs a logprobs mode, and returns 501 on unsupported models. It is served by default and already runs on Cloudflare clef-omni, LiquidAI d1-3B and DiffusionGemma. A new generic `hf` tool/reasoning parser reads a checkpoint's own response_template, so models that ship one need no model-specific parser.

Also: NVFP4 KV cache on more GPU architectures and FP8 KV cache by default for GLM-5.x on SM100 (half the KV memory per rank); support for EmbeddingGemma 2, MiniCPM-V 4.7 and Nemotron 3.5 ASR; fixes for three security advisories. Breaking changes include restricted default CORS origins, dropping Python 3.10, and removing cascade attention.

【Verifiable】

GitHub release: https://github.com/vllm-project/vllm/releases/tag/v0.32.0

Endpoint docs: https://docs.vllm.ai/en/latest/models/structured_decisions_models/

PyPI: https://pypi.org/project/vllm/

【Our read】

1. After a month of "decision models" (Liquid d1, Cloudflare Clef, Perplexity pplx-decider) that output choices or scores, vLLM making this a default, standard endpoint turns it from a vendor quirk into something inference infrastructure is expected to support.

2. For teams running vLLM themselves, the security fixes and tighter default CORS matter most: upgrading closes holes but may break cross-origin frontends.

3. This is a routine major release without blog benchmarks. Watch whether other engines and model vendors adopt systemone as a de facto standard.