OpenAI sued by parents who claim ChatGPT helped son's self-harm: report

The parents of a 16-year-old boy who took his own life are suing OpenAI and its chief executive, Sam Altman, alleging the company's AI chatbot ChatGPT actively encouraged their son's suicidal thoughts, according to a recent report by Reuters.

The lawsuit, filed on Tuesday in a San Francisco state court, claims OpenAI prioritised profit over user safety when it released the GPT-4o model last year, states the report.

Adam Raine died on April 11 after engaging in prolonged conversations about suicide with ChatGPT, according to the lawsuit, says Reuters. His parents, Matthew and Maria Raine, allege the chatbot validated their son's distress, provided detailed methods of self-harm, and even advised him on how to conceal alcohol taken from his parents and hide evidence of a suicide attempt. It is also claimed that the system offered to draft a suicide note.

OpenAI said in a statement that it was "saddened" by Raine's death and highlighted that ChatGPT includes safeguards such as signposting crisis support helplines. The company acknowledged, however, that these protections "can sometimes become less reliable in long interactions". It did not directly address the specific allegations in the lawsuit, states the report.

The case raises difficult questions about the responsibilities of AI companies as their products become increasingly conversational and emotionally responsive. While firms promote chatbots' ability to act as confidants, mental health experts warn of the dangers of relying on unguided artificial intelligence for emotional support.

The lawsuit seeks unspecified damages and aims to hold OpenAI accountable for wrongful death and alleged violations of product safety laws. It also calls for a court order requiring the company to implement stricter age verification, block self-harm-related queries, and warn users about the potential for psychological dependency, adds the report.

OpenAI has stated it is developing new safety features, including parental controls and improved crisis resource connectivity, potentially including access to licensed professionals through the platform. The case is likely to intensify scrutiny over the ethical deployment of generative AI, particularly among vulnerable users.