04 · How Models Run

Temperature

A sampling randomness control

A parameter that reshapes token probabilities before sampling. Lower values concentrate probability on likely tokens; higher values flatten the distribution. Exact behavior and allowed ranges vary by model and API.

Concrete example

Use a lower temperature for repeatable extraction and a higher one when exploring many creative phrasings.