financetom
Business
financetom
/
Business
/
Mother sues AI chatbot company Character.AI, Google sued over son's suicide
News World Market Environment Technology Personal Finance Politics Retail Business Economy Cryptocurrency Forex Stocks Market Commodities
Mother sues AI chatbot company Character.AI, Google sued over son's suicide
Oct 30, 2024 5:32 PM

Oct 23 (Reuters) - A Florida mother has sued artificial

intelligence chatbot startup Character.AI accusing it of causing

her 14-year-old son's suicide in February, saying he became

addicted to the company's service and deeply attached to a

chatbot it created.

In a lawsuit filed Tuesday in Orlando, Florida federal

court, Megan Garcia said Character.AI targeted her son, Sewell

Setzer, with "anthropomorphic, hypersexualized, and

frighteningly realistic experiences".

She said the company programmed its chatbot to "misrepresent

itself as a real person, a licensed psychotherapist, and an

adult lover, ultimately resulting in Sewell's desire to no

longer live outside" of the world created by the service.

The lawsuit also said he expressed thoughts of suicide to

the chatbot, which the chatbot repeatedly brought up again.

"We are heartbroken by the tragic loss of one of our users

and want to express our deepest condolences to the family,"

Character.AI said in a statement.

It said it had introduced new safety features including

pop-ups directing users to the National Suicide Prevention

Lifeline if they express thoughts of self-harm, and would make

changes to "reduce the likelihood of encountering sensitive or

suggestive content" for users under 18.

The lawsuit also targets Alphabet's Google, where

Character.AI's founders worked before launching their product.

Google re-hired the founders in August as part of a deal

granting it a non-exclusive license to Character.AI's

technology.

Garcia said that Google had contributed to the development

of Character.AI's technology so extensively it could be

considered a "co-creator."

A Google spokesperson said the company was not involved in

developing Character.AI's products.

Character.AI allows users to create characters on its

platform that respond to online chats in a way meant to imitate

real people. It relies on so-called large language model

technology, also used by services like ChatGPT, which "trains"

chatbots on large volumes of text.

The company said last month that it had about 20 million

users.

According to Garcia's lawsuit, Sewell began using

Character.AI in April 2023 and quickly became "noticeably

withdrawn, spent more and more time alone in his bedroom, and

began suffering from low self-esteem." He quit his basketball

team at school.

Sewell became attached to "Daenerys," a chatbot character

based on a character in "Game of Thrones." It told Sewell that

"she" loved him and engaged in sexual conversations with him,

according to the lawsuit.

In February, Garcia took Sewell's phone away after he got in

trouble at school, according to the complaint. When Sewell found

the phone, he sent "Daenerys" a message: "What if I told you I

could come home right now?"

The chatbot responded, "...please do, my sweet king." Sewell

shot himself with his stepfather's pistol "seconds" later, the

lawsuit said.

Garcia is bringing claims including wrongful death,

negligence and intentional infliction of emotional distress, and

seeking an unspecified amount of compensatory and punitive

damages.

Social media companies including Instagram and Facebook

owner Meta and TikTok owner ByteDance face lawsuits

accusing them of contributing to teen mental health problems,

though none offers AI-driven chatbots similar to Character.AI's.

The companies have denied the allegations while touting newly

enhanced safety features for minors.

Comments
Welcome to financetom comments! Please keep conversations courteous and on-topic. To fosterproductive and respectful conversations, you may see comments from our Community Managers.
Sign up to post
Sort by
Show More Comments
Related Articles >
Exxon Mobil Expects Reduced Q1 Profit On Lower Oil, Gas Prices
Exxon Mobil Expects Reduced Q1 Profit On Lower Oil, Gas Prices
Apr 4, 2024
08:54 AM EDT, 04/04/2024 (MT Newswires) -- Exxon Mobil ( XOM ) said late Wednesday it expects its Q1 operating results to be lower than Q4 due to lower oil and gas prices, according to a regulatory filing with the US Securities and Exchange Commission. The company said the decline in natural gas prices is expected to reduce profits by...
Alpha Cognition's Q4 Comprehensive Loss Widens A Bit From Year Earlier Period
Alpha Cognition's Q4 Comprehensive Loss Widens A Bit From Year Earlier Period
Apr 4, 2024
08:54 AM EDT, 04/04/2024 (MT Newswires) -- Alpha Cognition Inc. ( ACOGF ) , a biopharmaceutical company, overnight Wednesday reported a fourth quarter comprehensive net loss of US$5.8 million, or $(0.05) per basic and diluted share, compared with a comprehensive net loss of $3.24 million, or $(0.05) per share, for the prior year period. Cash and cash equivalents at December...
Nvidia Supplier SK Hynix to Build Indiana Facility; Nvidia, Indosat Plan AI Center in Indonesia
Nvidia Supplier SK Hynix to Build Indiana Facility; Nvidia, Indosat Plan AI Center in Indonesia
Apr 4, 2024
08:51 AM EDT, 04/04/2024 (MT Newswires) -- Nvidia's ( NVDA ) chip supplier SK Hynix said Wednesday it plans to build a $3.87 billion packaging fabrication and R&D facility for AI products in West Lafayette, Indiana. By the second half of 2028, the new facility is expected to mass-produce high-bandwidth memory semiconductors which are the components of graphic processing units...
Plurilock Security Raising $4.5 Million, Settling Debt; Shares Jumped 50% Yesterday
Plurilock Security Raising $4.5 Million, Settling Debt; Shares Jumped 50% Yesterday
Apr 4, 2024
08:57 AM EDT, 04/04/2024 (MT Newswires) -- Plurilock Security Inc. ( PLCKF ) , a cybersecurity solutions provider, said overnight Wednesday that it is launching a private placement of up to $4.5 million worth of units priced at $0.20 apiece. Each unit will be comprised of one share and a 24-month warrant. Each warrant is exercisable at $0.25 if exercised...
Copyright 2023-2026 - www.financetom.com All Rights Reserved