Skip to content

vllm_omni.model_executor.common

Model-neutral helpers shared between model packages.

audio and request_outputs carry no duplex vocabulary and may be used from any model. duplex builds on the duplex framework contracts and is imported only from a model's duplex package.

Modules:

Name Description
audio

Generic audio helpers shared between model packages.

duplex

Shared building blocks for DuplexModelPlugin implementations.

request_outputs

Reading a vLLM RequestOutput the way model-side projection code needs to.