Andrea Campos struggled with depression for years before founding Yana, a mental health care app, in 2017. The app’s chatbot provides users emotional companionship in Spanish. Although she was reluctant at first, Campos began using generative artificial intelligence for the Yana chatbot after ChatGPT launched in 2022. Yana, which recently launched its English-language version, has 15 million users, and is available in Latin America and the U.S.
Even if it’s being run by the most morally upstanding people who only want to help, the AI can still hallucinate and start telling people to self harm.