vLLM fixes cross-request output constraint vulnerability caused by residual request state
vLLM:请求状态残留影响后续输出完整性
AI summary
When the vLLM V1 engine reuses batch slots, it can retain the allowed_token_ids mask from the previous request, causing subsequent requests to inherit output vocabulary constraints set by others, even when HTTP 200 is returned. This vulnerability affects cross-request output integrity and is vocabulary steering, not arbitrary text replacement; the advisory does not report confidentiality or availability impact. The GitHub advisory marks affected versions as < 0.31.0 and the fixed version as 0.31.0.
Why it was selected
The announcement disclosed a cross-request output constraint issue caused by batch slot reuse in vLLM, and provided the fix PR and affected versions for those running self-hosted inference services to investigate.
Read original