26 Apr 2023

Temperature in Natural Language Processing

Increases or decreases the “confidence” a model has in its most likely response.

High temperature means the model will have high confidence in other responses too, not just the one it deems the most correct.

→ High Temperature = More Creative Model

→ Low Temperature = Less Creative Model