vllm_omni.tokenizers.yue2_tokenizer ¶

Minimal YuE2 text tokenizer (frozen tiktoken BPE), vendored from upstream.

Used by the offline driver to build token-id prompts; the audio codec tokens never pass through it.

merge_file = Path(merge_file)

decode(ids)

encode(text)