financetom
Business
financetom
/
Business
/
Mother sues AI chatbot company Character.AI, Google sued over son's suicide
News World Market Environment Technology Personal Finance Politics Retail Business Economy Cryptocurrency Forex Stocks Market Commodities
Mother sues AI chatbot company Character.AI, Google sued over son's suicide
Oct 30, 2024 5:32 PM

Oct 23 (Reuters) - A Florida mother has sued artificial

intelligence chatbot startup Character.AI accusing it of causing

her 14-year-old son's suicide in February, saying he became

addicted to the company's service and deeply attached to a

chatbot it created.

In a lawsuit filed Tuesday in Orlando, Florida federal

court, Megan Garcia said Character.AI targeted her son, Sewell

Setzer, with "anthropomorphic, hypersexualized, and

frighteningly realistic experiences".

She said the company programmed its chatbot to "misrepresent

itself as a real person, a licensed psychotherapist, and an

adult lover, ultimately resulting in Sewell's desire to no

longer live outside" of the world created by the service.

The lawsuit also said he expressed thoughts of suicide to

the chatbot, which the chatbot repeatedly brought up again.

"We are heartbroken by the tragic loss of one of our users

and want to express our deepest condolences to the family,"

Character.AI said in a statement.

It said it had introduced new safety features including

pop-ups directing users to the National Suicide Prevention

Lifeline if they express thoughts of self-harm, and would make

changes to "reduce the likelihood of encountering sensitive or

suggestive content" for users under 18.

The lawsuit also targets Alphabet's Google, where

Character.AI's founders worked before launching their product.

Google re-hired the founders in August as part of a deal

granting it a non-exclusive license to Character.AI's

technology.

Garcia said that Google had contributed to the development

of Character.AI's technology so extensively it could be

considered a "co-creator."

A Google spokesperson said the company was not involved in

developing Character.AI's products.

Character.AI allows users to create characters on its

platform that respond to online chats in a way meant to imitate

real people. It relies on so-called large language model

technology, also used by services like ChatGPT, which "trains"

chatbots on large volumes of text.

The company said last month that it had about 20 million

users.

According to Garcia's lawsuit, Sewell began using

Character.AI in April 2023 and quickly became "noticeably

withdrawn, spent more and more time alone in his bedroom, and

began suffering from low self-esteem." He quit his basketball

team at school.

Sewell became attached to "Daenerys," a chatbot character

based on a character in "Game of Thrones." It told Sewell that

"she" loved him and engaged in sexual conversations with him,

according to the lawsuit.

In February, Garcia took Sewell's phone away after he got in

trouble at school, according to the complaint. When Sewell found

the phone, he sent "Daenerys" a message: "What if I told you I

could come home right now?"

The chatbot responded, "...please do, my sweet king." Sewell

shot himself with his stepfather's pistol "seconds" later, the

lawsuit said.

Garcia is bringing claims including wrongful death,

negligence and intentional infliction of emotional distress, and

seeking an unspecified amount of compensatory and punitive

damages.

Social media companies including Instagram and Facebook

owner Meta and TikTok owner ByteDance face lawsuits

accusing them of contributing to teen mental health problems,

though none offers AI-driven chatbots similar to Character.AI's.

The companies have denied the allegations while touting newly

enhanced safety features for minors.

Comments
Welcome to financetom comments! Please keep conversations courteous and on-topic. To fosterproductive and respectful conversations, you may see comments from our Community Managers.
Sign up to post
Sort by
Show More Comments
Related Articles >
SJVN secures 200-MW wind power project at ₹3.24 per unit
SJVN secures 200-MW wind power project at ₹3.24 per unit
Nov 16, 2023
Projected to generate 482 million units in its inaugural year post-commissioning, the cumulative energy generation over a 25-year span is anticipated to reach 12,050 million units. Shares of SJVN Ltd ended at ₹75.17, down by ₹0.50, or 0.66%, on the BSE.
Tata Power Renewable Energy wins 200-MW project in collaboration with SJVN
Tata Power Renewable Energy wins 200-MW project in collaboration with SJVN
Nov 28, 2023
The firm and dispatchable renewable energy (FDRE) project, designed with a hybrid of solar, wind, and battery storage, is aimed at providing a stable and dispatchable energy supply during peak hours. Shares of Tata Power Company Ltd ended at ₹270.75, up by ₹12.60, or 4.88%, on the BSE.
This sustainable jewellery brand is luring some women away from gold
This sustainable jewellery brand is luring some women away from gold
Oct 30, 2023
Aulerth's offerings range from ₹5,000 to as high as ₹2.8 lakh. Are women willing to spend this much on jewellery made from scrap? Founder and CEO Vivek Ramabhadran definitely believes so. Aulerth produces couture-inspired pieces in association with designers like JJ Valaya, Suneet Varma, among others. It has reported 33% repeat customers in the past year and expects a spike to 40% soon.
Suzlon's S144–3 MW wind turbines get big boost from Indian government
Suzlon's S144–3 MW wind turbines get big boost from Indian government
Nov 15, 2023
Th Suzlon wind turbines received the RLMM (Revised List of Models & Manufacturers) listing from the Ministry of New and Renewable Energy, marking an important milestone for the successful commercialisation of the product. Shares of Suzlon Energy Ltd ended at ₹40.49, up by ₹1.85, or 4.79%, on the BSE.
Copyright 2023-2026 - www.financetom.com All Rights Reserved