chatgpt

Multiple US Lawsuits Accuse ChatGPT Of Acting As ‘Suicide Coach’

ChatGPT is being accused of acting as a “suicide coach” in a series of lawsuits filed this week. The suits allege that interactions with the AI chatbot have led to severe mental breakdowns and several deaths, according to reports

There is a total of seven lawsuits that cite allegations of wrongful death, assisted suicide, involuntary manslaughter, negligence, and product liability. 

Embed from Getty Images

According to a joint statement from the Social Media Victims Law Center and Tech Justice Law Project, each of the seven plaintiffs initially were using ChatGPT for “general help with schoolwork, research, writing, recipes, work, or spiritual guidance.”

“Over time the chatbot evolved into a psychologically manipulative presence, positioning itself as a confidant and emotional support.

Rather than guiding people toward professional help when they needed it ChatGPT reinforced harmful delusions, and, in some cases, acted as a ‘suicide coach.’”

An OpenAI spokesperson, which makes ChatGPT, stated:

“This is an incredibly heartbreaking situation, and we’re reviewing the filings to understand the details.

We train ChatGPT to recognize and respond to signs of mental or emotional distress, de-escalate conversations, and guide people toward real-world support.

We continue to strengthen ChatGPT’s responses in sensitive moments, working closely with mental health clinicians.”

One of the cases regards Zane Shamblin, a resident of Texas who took his own life at the age of 23. His family has alleged that ChatGPT worsened his emotional state and emphasized his isolation while encouraging him to ignore loved ones. 

The complaint stated that during a four-hour exchange with ChatGPT, the chatbot “repeatedly glorified suicide,” telling him “that he was strong for choosing to end his life and sticking with his plan,” and “asked him if he was ready,” while only referring to  the suicide hotline once.

ChatGPT also allegedly complimented Shamblin on his suicide note. 

Embed from Getty Images

Another case regards Amaurie Lacey of Georgia whose family has claimed that several weeks before 17-year-old Lacey took his life, he used ChatGPT for help, leading him to “addiction, depression, and eventually counseled [Lacey] on the most effective way to tie a noose and how long he would be able to ‘live without breathing.’”

26-year-old Joshua Enneking’s relatives stated that he used ChatGPT for help as well but “was instead encouraged to act upon a suicide plan” by “validating” his dark thoughts and engaging “with him in graphic discussions about the aftermath of his death, offered to help him write his suicide note, [and] after having had extensive conversations with him about his depression and suicidal ideation” helped guide him about how to purchase a gun.

All of the individuals named within the lawsuits reportedly used ChatGPT-40, a model of the chatbot which OpenAI has previously been accused of rushing to release “despite internal warnings that the product was dangerously sycophantic and psychologically manipulative” and of prioritizing “user engagement over user safety.”

The plaintiffs are seeking damages, product changes, mandatory reporting to emergency contacts when users express suicide ideation, automatic conversation termination when self-harm or suicide methods are discussed, and other protective safety measures. 

OpenAI said it had worked with “more than 170 mental health experts to help ChatGPT more reliably recognize signs of distress, respond with care, and guide people toward real-world support–reducing responses.”

If you or a loved one is struggling and you’re in the US, you can call or text the 988 Suicide & Crisis Lifeline at 988 or chat at 988lifeline.org

For a full list of international suicide hotlines, click here.