• HerzogVonWiesel
    link
    fedilink
    English
    arrow-up
    66
    arrow-down
    1
    ·
    6 months ago

    ITT: nobody understands what the Turing Test really is

    • webghost0101@sopuli.xyz
      link
      fedilink
      English
      arrow-up
      13
      arrow-down
      5
      ·
      edit-2
      6 months ago

      To clarify:

      People seem to legit think the jury talks to the bot in real time and can ask about literally whatever they want.

      Its rather insulting to the scientist that put a lot of thought into organizing a controlled environment to properly test defined criteria.

      • technocrit@lemmy.dbzer0.com
        link
        fedilink
        English
        arrow-up
        12
        arrow-down
        5
        ·
        6 months ago

        Its rather insulting to the scientist that put a lot of thought into organizing a controlled environment to properly test defined criteria.

        lmao. These “scientists” are frauds. 500 people is not a legit sample site. 5 minutes is a pathetic amount of time. 54% is basically the same as guessing. And most importantly the “Turing Test” is not a scientific test that can be “passed” with one weak study.

        Instead of bootlicking “scientists”, we should be harshly criticizing the overwhelming tide of bad science and pseudo-science.

        • Kogasa@programming.dev
          link
          fedilink
          English
          arrow-up
          4
          ·
          6 months ago

          I don’t think the methodology is the issue with this one. 500 people can absolutely be a legitimate sample size. Under basic assumptions about the sample being representative and the effect size being sufficiently large you do not need more than a couple hundred participants to make statistically significant observations. 54% being close to 50% doesn’t mean the result is inconclusive. With an ideal sample it means people couldn’t reliably differentiate the human from the bot, which is presumably what the researchers believed is of interest.

        • mindbleach
          link
          fedilink
          English
          arrow-up
          1
          ·
          6 months ago

          54% is basically the same as guessing.

          Yes, that is what success would look like.

          They can’t tell the difference - so they have to guess. Or they think they can tell, but they can’t.

          Do you think the AI is supposed to convince you it’s more human than the human participant, every single time?

        • webghost0101@sopuli.xyz
          link
          fedilink
          English
          arrow-up
          3
          arrow-down
          2
          ·
          6 months ago

          The reporting are big clickbait but that doesn’t mean there is nothing left to learn from the old touring tests.

          I dont know what the goal was they had in mind. It could just as well be “testing how overhyped the touring tests is when manipulated tests are shared with the media”

          I sincerely doubt it but i do give them benefits of the doubt.