Skip to content

Installation

Important

vLLM-Omni is released against the matching upstream vLLM major/minor version. The vLLM-Omni 0.30.x release line uses vLLM 0.30.x; the source-install instructions pin vLLM 0.30.0.

vLLM-Omni supports the following hardware platforms: