Untriaged
Vllm: a completions api request with an empty prompt will crash the vllm api server.
A flaw was found in the vLLM library. A completions API request with an empty prompt will crash the vLLM API server, resulting in a denial of service.
Affected products
vllm
- <0.5.5
rhelai1/bootc-nvidia-rhel9
rhelai1/instructlab-nvidia-rhel9
Matching in nixpkgs
pkgs.vllm
High-throughput and memory-efficient inference and serving engine for LLMs
-
nixos-unstable -
- nixpkgs-unstable 0.10.1.1
pkgs.python312Packages.vllm
High-throughput and memory-efficient inference and serving engine for LLMs
-
nixos-unstable -
- nixpkgs-unstable 0.10.1.1
Package maintainers
-
@happysalada Raphael Megzari <raphael@megzari.com>
-
@CertainLach Yaroslav Bolyukin <iam@lach.pw>