Experts are worried that books produced by ChatGPT for sale on Amazon, which target beginner foragers, could end up killing someone.

cross-posted from: https://beehaw.org/post/7458945

Many mushroom identification and foraging books being sold on Amazon are likely generated by AI with no human authorship. These books could provide dangerous misinformation and potentially lead to deaths if people eat poisonous mushrooms based on the AI’s inaccurate descriptions. Two New York mushroom societies have warned about the risks of AI-generated foraging guides. Experts note that safely identifying wild mushrooms requires careful research and experience that an AI system does not have. Amazon has since removed some books flagged as AI-generated, but more may exist. Detecting AI-generated books and authors can be difficult as the systems can fabricate author bios and images. Relying on multiple credible sources, as well as guidance from local foraging groups, is advised for safely pursuing mushroom foraging.

  • Shdwdrgn@mander.xyzEnglish
    42·
    1 year ago

    I can’t wait the see the slew of lawsuits that include Amazon as a co-conspirator.

    • alternative_factor@kbin.social
      18·
      1 year ago

      That’s wild that this article popped up on my feed this instant, I saw an ad for AI plant identification through your camera lens. The first thought I had was “holy shit so many people are going to die when Alexa misidentifies water hemlock as cow parsnip”.

      • d3m0nr4v3r@feddit.deM
        1·
        1 year ago

        Tbf the same thing exists for mushrooms, there are various apps. It’s dangerous to rely on them but I use them for a first idea of what I might be looking at and then go from there. Quite useful sometimes

        • alternative_factor@kbin.social
          1·
          1 year ago

          Yeah I have nothing against the idea itself, I just know there are people out there who will trust an app 100% and never try to go from there. It’s super sad really, if some people had just a little more discernment I wouldn’t instantly have thought about people dying from it.

    • warbond@lemmy.world
      4·
      1 year ago

      Holy shit, I hadn’t even thought of that. Does Amazon have a responsibility to ensure the information it sells is at least, “commonly thought to be true”(or whatever)? What would the metric be? Who could claim jurisprudence?

      IANAL, but I love the implications of case law.

      • Shdwdrgn@mander.xyzEnglish
        8·
        1 year ago

        Probably not because they can afford good lawyers, but they SHOULD bear some responsibility. I think if someone actually dies because of this we might see the limits of the laws tested.