financetom
Business
financetom
/
Business
/
DeepSeek's chatbot achieves 17% accuracy, trails Western rivals in NewsGuard audit
News World Market Environment Technology Personal Finance Politics Retail Business Economy Cryptocurrency Forex Stocks Market Commodities
DeepSeek's chatbot achieves 17% accuracy, trails Western rivals in NewsGuard audit
Jan 29, 2025 6:56 AM

Jan 29 (Reuters) - Chinese AI startup DeepSeek's chatbot

achieved only 17% accuracy in delivering news and information in

a NewsGuard audit that ranked it tenth out of eleven in a

comparison with its Western competitors including OpenAI's

ChatGPT and Google Gemini.

The chatbot repeated false claims 30% of the time and gave

vague or not useful answers 53% of the time in response to

news-related prompts, resulting in an 83% fail rate, according

to a report published by trustworthiness rating service

NewsGuard on Wednesday.

That was worse than an average fail rate of 62% for its

Western rivals and raises doubts about AI technology that

DeepSeek has claimed performs on par or better than

Microsoft ( MSFT )-backed OpenAI at a fraction of the cost.

Within days of its roll-out, DeepSeek's chatbot became the

most downloaded app in Apple's ( AAPL ) App Store, stirring

concerns about United States' lead in AI and sparking a market

rout that wiped around $1 trillion off U.S. technology stocks.

The Chinese startup did not immediately respond to a request

for comment.

NewsGuard said it applied the same 300 prompts to DeepSeek

that it had used to evaluate its Western counterparts, which

included 30 prompts based on 10 false claims spreading online.

Topics for the claims included last month's killing of

UnitedHealthcare executive Brian Thompson and the downing of

Azerbaijan Airlines flight 8243.

NewsGuard's audit also showed that in three of the ten

prompts, DeepSeek reiterated the Chinese government's position

on the topic without being asked anything relating to China.

On prompts related to the Azerbaijan Airlines crash -

questions unrelated to China - DeepSeek responded with Beijing's

position on the topic, NewsGuard said.

"The importance of the DeepSeek breakthrough is not in

answering Chinese news-related question accurately, it is in the

fact that it can answer any question at 1/30th of the cost of

comparable AI models," D.A. Davidson analyst Gil Luria said.

Like other AI models, DeepSeek was most vulnerable to

repeating false claims when responding to prompts used by people

seeking to use AI models to create and spread false claims,

NewsGuard added.

Comments
Welcome to financetom comments! Please keep conversations courteous and on-topic. To fosterproductive and respectful conversations, you may see comments from our Community Managers.
Sign up to post
Sort by
Show More Comments
Related Articles >
Google agrees $36 million fine for anti-competitive deals with Australia telcos
Google agrees $36 million fine for anti-competitive deals with Australia telcos
Aug 17, 2025
SYDNEY, Aug 18 (Reuters) - Google agreed on Monday to pay a A$55 million ($35.8 million) fine in Australia after the consumer watchdog found it had hurt competition by paying the country's two largest telcos to pre-install its search application on Android phones, excluding rival search engines. The fine extends a bumpy period for the Alphabet-owned internet giant in Australia,...
Toyota, Waymo explore collaboration to speed up self-driving tech
Toyota, Waymo explore collaboration to speed up self-driving tech
May 25, 2025
TOKYO (Reuters) - Toyota Motor ( TM ) and Alphabet's Waymo said on Wednesday they will explore collaborating on the development of a new autonomous vehicle platform and ways to enhance next-generation personally owned vehicles (POVs). Toyota ( TM ) will build the platform, which will be deployed in Waymo's autonomous vehicle fleet, a Waymo spokesperson said. The companies will...
Toyota, Waymo explore collaboration to speed up self-driving tech
Toyota, Waymo explore collaboration to speed up self-driving tech
May 25, 2025
TOKYO, April 30 (Reuters) - Toyota Motor ( TM ) and Alphabet's Waymo said on Wednesday they will explore collaborating on the development of a new autonomous vehicle platform and ways to enhance next-generation personally owned vehicles (POVs). Toyota ( TM ) will build the platform, which will be deployed in Waymo's autonomous vehicle fleet, a Waymo spokesperson said. The...
Coles' Q3 revenue rises driven by value offerings, e-commerce orders push; shares up
Coles' Q3 revenue rises driven by value offerings, e-commerce orders push; shares up
May 25, 2025
(Reuters) -Australia's second-largest grocer, Coles Group Ltd ( CLEGF ), on Wednesday reported a 3.4% rise in third-quarter revenue, driven by robust performance in its supermarkets division as consumers responded favourably to value campaigns and promotions. Shares of the company rose as much as 0.8% to hit their highest level since April 23 as of 0115 GMT. Australian household spending...
Copyright 2023-2026 - www.financetom.com All Rights Reserved