Nucleus Sampling / Top-p / Nucleus Sampling
Top-p
Top-p, also called nucleus sampling, is a method for choosing the next token that only considers the most likely candidates up to a defined probability threshold. It complements or replaces temperature control to vary output deliberately without allowing wildly implausible continuations.