Glossary › LLM

Top-p (Nucleus Sampling)

Sampling method that only considers tokens within the smallest set whose cumulative probability exceeds p (e.g. 0.9). Filters out unlikely tokens while preserving diversity. Often combined with temperature.

Where this is taught

• Sampling Methods — Phase 2: Probability & Statistics
• Pre-Training a Mini GPT (124M Parameters) — Phase 3: LLM Architecture

Related terms

Temperature

More in LLM

Hallucination · Temperature · Token · Context Window · In-Context Learning · System Prompt · Function Calling

Learn this by building

DeVenture Academy teaches AI engineering through projects, with hands-on labs you run on your own machine using real tools.

Create a free account — the opening phases of 29 of 35 courses are free, no credit card. Or see Pro pricing.

All courses · Pricing · About · FAQ · Glossary