Skip to content

vllm_omni.entrypoints.serve.omni_control.protocol

Request models for Omni server control routes.

OmniSleepRequest

Bases: BaseModel

level class-attribute instance-attribute 

level: int = Field(default=2, ge=0)

stage_ids class-attribute instance-attribute 

stage_ids: list[int] = Field(..., min_length=1)

OmniWakeupRequest

Bases: BaseModel

stage_ids class-attribute instance-attribute 

stage_ids: list[int] = Field(..., min_length=1)