What Is Temperature in AI? (And How to Stop Getting Poetry When You Asked for a Grocery List)
What Is Temperature in AI? (And How to Stop Getting Poetry When You Asked for a Grocery List) Remember Magic 8-Balls? Those plastic oracles you'd shake for life advice, only to get "Reply hazy, try again" when you asked if your crush liked you back? Imagine someone added a little dial on the bottom. Turn it all the way to zero and the thing becomes painfully predictable, only ever offering "Yes" or "Most likely." Crank it all the way up and suddenly it's inventing answers that never appeared in the original twenty options, things like "Ask your neighbor's cat" and "The moon suggests Thursday." That dial is temperature, and every AI language model has one. How the dial works Temperature is a setting, usually ranging from 0 to 2, that tells an AI model how much risk to take when picking the next word. The model calculates the probability of every possible next word, then has to pick one. At low temperatures, it plays it safe and picks the most probable option almost every time. At high temperatures, it's willing to gamble on unlikely choices further down the list. This is why you can ask ChatGPT the exact same question twice and get a straightforward answer on Monday and what appears to be surrealist fiction on Tuesday. When you ask ChatGPT to write a professional email at temperature zero, you'll get "Dear Sir or Madam, I am writing to follow up on our previous correspondence..." every single time you hit enter. Set temperature to 1.5 and it might open with "Greetings, fellow traveler of the inbox wilderness" because that phrasing, while statistically improbable, is now in play. Why boring is sometimes good At temperature zero, you get the most boring dinner guest imaginable. It always picks the single most likely next token (the technical term for a chunk of text, usually a word or part of one). No variety, no surprises, just the statistical favorite every single time. This turns out to be perfect when you need factual accuracy, code that actually compiles, or data