• assaultpotato
    link
    fedilink
    arrow-up
    5
    arrow-down
    1
    ·
    edit-2
    7 months ago

    Depends on the temperature in the LLM/context, which I’m assuming google will have set quite low for this.

      • assaultpotato
        link
        fedilink
        arrow-up
        5
        ·
        7 months ago

        Yeah, it’s kind of a measure of randomness for LLM responses. A low temperature makes the LLM more consistent and more reliable, a higher temperature makes it more “creative”. Same prompt on low temperature is more likely to be repeatable, high temperature introduces a higher risk of hallucinations, etc.

        Presumably Google’s “search suggestions” are done on a very low temperature, but that doesn’t prevent hallucinations, just makes it less likely.