Autoregressive Next-Token Sampling: Temperature & Top-p
Concept 02 Demo
PROMPT SEQUENCE:
The autonomous robot turned toward the reef and decided to
🎲 Generate Next Token
Reset
Temperature (T):
0.70
Top-p (Nucleus Cutoff):
0.90
Last Sampled Token
"score"
Active Nucleus Size (Top-p)
3 Candidates
Sampling Mode
Balanced Natural Dialogue