AIantirezover 2 years ago
First Token Cutoff LLM sampling
8 min read
Top-p sampling, a form of nucleus sampling, collects top-scoring tokens up to a total probability sum of p. This balances LLM creativity while preserving adherence to context, unlike deterministic highest-probability token selection.
Level
Hype check
Tap to vote and see what everyone thinks.