Skip to content

vllm_omni.worker_v2

Modules:

Name Description
delivery
first_audio_sender

Deliver in-stage first audio as soon as its device copy completes.

model_states

Omni-aware init_model_state factory.

native_output_worker

Materialize native producer output independently of scheduler consumption.

omni_ar_model_runner

OmniARModelRunner — autoregressive stage runner on MR V2.

omni_data_plane
omni_generation_model_runner

OmniGenerationModelRunner — non-autoregressive stage runner on MR V2.

omni_model_runner

Omni v2 GPU model runner hooks.

omni_sampler

One sampler registration contract for token and post-sampling audio output.

output_snapshot

Compatibility imports for the shared model/runner output snapshot contract.

streaming_audio

Request-owned PCM accumulation for a stage that decodes audio in place.