Case & CodeA FIELD GUIDE TO AI
Start learning
Intermediate

Temperature

In plain words

A setting that affects how varied the output may be. Lower values often make it less varied. They do not ensure the same answer each time.

Same question, different dice
Low temperature

Always picks the most likely next word. Ask twice, get the same answer twice.

High temperature

Sometimes picks a less likely word. Ask twice, get two different answers.

Neither setting makes the answer more true. Low temperature makes mistakes repeatable; high temperature makes them varied.

The fuller definition

Temperature is a sampling parameter that changes the relative spread of token probabilities before selection. Lower values generally concentrate choices; higher values can increase variation.

Go deeper

Choosing the next token after “We expect to”
deliver0.46
complete0.24
ship0.15
finalize0.09
other0.06

Invented probabilities. Always picking the top candidate gives the same wording every run; sampling sometimes picks a lower one. Neither setting checks whether the sentence is true.

A concrete example

You compare a more restrained and a more varied continuation of a fictional sentence.

The distinction that matters

Temperature is not a truth setting, and zero does not guarantee identical results across all systems.

Related terms

Where it is taught

How models learn from examples

Source and further reading

Hugging Face · LLM course

The definition and example are written for this library. The link gives background, official documentation or legal authority as labelled. Legal scope depends on the jurisdiction and current text; product features depend on release and settings.

Lessons, terms, practical guides and sources ESC