What happens when you raise a language model's temperature setting?
Output gets more random. Lower temperature makes it more predictable.
- The model runs faster
- The output gets more random ✔
- The model gets more accurate
Why: Temperature reshapes the probabilities of the next token before one is picked. High values flatten them so unlikely tokens get chosen more often; low values make the top choice win almost every time.
Huh, didn't know that: Temperature is a hyperparameter you set when generating, not something the model learns.
I set my chatbot's temperature to high. Now it writes poems about my toaster.
References
Answer: The output gets more random. Temperature reshapes the probabilities of the next token before one is picked. High values flatten them so unlikely tokens get chosen more often; low values make the top choice win almost every time.
- Google Machine Learning Glossary: Generative AI (temperature) developers.google.com/machine-learning/glossary/generative
Higher temperatures result in more random output, while lower temperatures result in less random output.
Checked 2026-10-10.
Think this answer is wrong? Tap "Challenge this answer" on the card in the game and tell us why.
More stuff everyone should know
That's stuff everyone should know.