Skip to content

vllm.v1.worker.gpu.sample.output

SamplerOutput dataclass

Source code in vllm/v1/worker/gpu/sample/output.py 
10
11
12
13
14
@dataclass
class SamplerOutput:
    sampled_token_ids: torch.Tensor
    logprobs_tensors: LogprobsTensors | None
    num_nans: torch.Tensor | None

logprobs_tensors instance-attribute 

logprobs_tensors: LogprobsTensors | None

num_nans instance-attribute 

num_nans: Tensor | None

sampled_token_ids instance-attribute 

sampled_token_ids: Tensor

__init__ 

__init__(
    sampled_token_ids: Tensor,
    logprobs_tensors: LogprobsTensors | None,
    num_nans: Tensor | None,
) -> None