- cross-posted to:
- [email protected]
- cross-posted to:
- [email protected]
cross-posted from: https://hexbear.net/post/2609634
Hmmmm… I don’t remember that Beatles song
cross-posted from: https://hexbear.net/post/2609634
Hmmmm… I don’t remember that Beatles song
Yeah, it’s kind of a measure of randomness for LLM responses. A low temperature makes the LLM more consistent and more reliable, a higher temperature makes it more “creative”. Same prompt on low temperature is more likely to be repeatable, high temperature introduces a higher risk of hallucinations, etc.
Presumably Google’s “search suggestions” are done on a very low temperature, but that doesn’t prevent hallucinations, just makes it less likely.