Decoding Strategies and Output Control

A chapter covers nine decoding strategies for language models, including greedy decoding, temperature sampling, top-k sampling, nucleus sampling, repetition penalties, beam search, stop conditions, and structured output constraints. The model returns a vector of logits for every position in the input sequence.