financetom
Business
financetom
/
Business
/
EXPLAINER-What risks do advanced AI models pose in the wrong hands?
News World Market Environment Technology Personal Finance Politics Retail Business Economy Cryptocurrency Forex Stocks Market Commodities
EXPLAINER-What risks do advanced AI models pose in the wrong hands?
May 9, 2024 8:02 PM

WASHINGTON, May 9 (Reuters) - The Biden administration

is poised to open up a new front in its effort to safeguard U.S.

AI from China and Russia with preliminary plans to place

guardrails around the most advanced AI models, Reuters reported

on Wednesday.

Government and private sector researchers worry U.S.

adversaries could use the models, which mine vast amounts of

text and images to summarize information and generate content,

to wage aggressive cyber attacks or even create potent

biological weapons.

Here are some threats posed by AI:

DEEPFAKES AND MISINFORMATION

Deepfakes - realistic yet fabricated videos created by AI

algorithms trained on copious online footage - are surfacing on

social media, blurring fact and fiction in the polarized world

of U.S. politics.

While such synthetic media has been around for several

years, it's been turbocharged over the past year by a slew of

new "generative AI" tools such as Midjourney that make it cheap

and easy to create convincing deepfakes.

Image creation tools powered by artificial intelligence from

companies including OpenAI and Microsoft ( MSFT ), can be used

to produce photos that could promote election or voting-related

disinformation, despite each having policies against creating

misleading content, researchers said in a report in March.

Some disinformation campaigns simply harness the ability of

AI to mimic real news articles as a means of disseminating false

information.

While major social media platforms like Facebook, Twitter,

and YouTube have made efforts to prohibit and remove deepfakes,

their effectiveness at policing such content varies.

For example, last year, a Chinese government-controlled news

site using a generative AI platform pushed a previously

circulated false claim that the United States was running a lab

in Kazakhstan to create biological weapons for use against

China, the Department of Homeland Security (DHS) said in its

2024 homeland threat assessment.

National Security Advisor Jake Sullivan, speaking at an

AI event in Washington on Wednesday, said the problem has no

easy solutions because it combines the capacity of AI with "the

intent of state, non-state actors, to use disinformation at

scale, to disrupt democracies, to advance propaganda, to shape

perception in the world."

"Right now the offense is beating the defense big time," he

said.

BIOWEAPONS

The American intelligence community, think tanks and

academics are increasingly concerned about risks posed by

foreign bad actors gaining access to advanced AI capabilities.

Researchers at Gryphon Scientific and Rand Corporation noted

that advanced AI models can provide information that could help

create biological weapons.

Gryphon studied how large language models (LLM) - computer

programs that draw from massive amounts of text to generate

responses to queries - could be used by hostile actors to cause

harm in the domain of life sciences and found they "can provide

information that could aid a malicious actor in creating a

biological weapon by providing useful, accurate and detailed

information across every step in this pathway."

They found, for example, that an LLM could provide

post-doctoral level knowledge to trouble-shoot problems when

working with a pandemic-capable virus.

Rand research showed that LLMs could help in the planning

and execution of a biological attack. They found an LLM could

for example suggest aerosol delivery methods for botulinum

toxin.

CYBERWEAPONS

DHS said cyber actors would likely use AI to "develop new

tools" to "enable larger-scale, faster, efficient, and more

evasive cyber attacks" against critical infrastructure including

pipelines and railways, in its 2024 homeland threat assessment.

China and other adversaries are developing AI

technologies that could undermine U.S. cyber defenses, DHS said,

including generative AI programs that support malware attacks.

Microsoft ( MSFT ) said in a February report that it had tracked

hacking groups affiliated with the Chinese and North Korean

governments as well as Russian military intelligence, and Iran's

Revolutionary Guard, as they tried to perfect their hacking

campaigns using large language models.

NEW EFFORTS TO ADDRESS THREATS

A bipartisan group of lawmakers unveiled a bill late

Wednesday that would make it easier for the Biden administration

to impose export controls on AI models, in a bid to safeguard

the prized U.S. technology against foreign bad actors.

The bill, sponsored by House Republicans Michael McCaul and

John Molenaar and Democrats Raja Krishnamoorthi and Susan Wild,

would also give the Commerce Department express authority to bar

Americans from working with foreigners to develop AI systems

that pose risks to U.S. national security.

Tony Samp, an AI policy advisor in Washington, said

policymakers in Washington are trying to "foster innovation and

avoid heavy-handed regulation that stifles innovation" as they

seek to address the many risks posed by the technology.

But he warned that "cracking down on AI development through

regulation could inhibit potential breakthroughs in areas like

drug discovery, infrastructure, national security, and others,

and cede ground to competitors overseas."

Comments
Welcome to financetom comments! Please keep conversations courteous and on-topic. To fosterproductive and respectful conversations, you may see comments from our Community Managers.
Sign up to post
Sort by
Show More Comments
Related Articles >
GCI Liberty's Q4 Revenue Declines
GCI Liberty's Q4 Revenue Declines
Mar 11, 2026
09:12 AM EST, 02/11/2026 (MT Newswires) -- GCI Liberty ( GLIBA ) reported revenue for Q4 ended Dec. 31 of $262 million, compared with $263 million a year earlier. One analyst surveyed by FactSet expected $264 million. The company was spun off from Liberty Broadband (LBRDA, LBRDK) in July 2025. ...
What's Going On With Chefs' Warehouse Stock Wednesday?
What's Going On With Chefs' Warehouse Stock Wednesday?
Mar 11, 2026
The Chefs’ Warehouse, Inc. stock fell on Wednesday after the company reported fourth-quarter fiscal 2025 results. The specialty food distributor posted fourth-quarter adjusted earnings per share of 68 cents, surpassing the analyst estimate of 63 cents. Quarterly sales reached $1.143 billion (up 10.5%), beating the $1.098 billion consensus estimate. Organic sales increased 9.7% versus the prior year quarter.  Gross profit...
Stoke Therapeutics Initiates Early-Stage Study for Genetic Vision Loss Treatment
Stoke Therapeutics Initiates Early-Stage Study for Genetic Vision Loss Treatment
Mar 11, 2026
09:12 AM EST, 02/11/2026 (MT Newswires) -- Stoke Therapeutics ( STOK ) said Wednesday that the first patient has received a dose in an early-stage trial of STK-002 for the treatment of Autosomal Dominant Optic Atrophy, an inherited vision loss condition. The open-label study's primary objective will be to evaluate the safety and tolerability of the investigational medicine in patients...
Sector Update: Consumer Stocks Mixed Premarket Wednesday
Sector Update: Consumer Stocks Mixed Premarket Wednesday
Mar 11, 2026
09:11 AM EST, 02/11/2026 (MT Newswires) -- Consumer stocks were mixed premarket Wednesday, with the State Street Consumer Staples Select Sector SPDR ETF (XLP) 0.3% lower and the State Street Consumer Discretionary Select Sector SPDR ETF (XLY) up 0.4%. Shopify ( SHOP ) shares were up more than 12% after the company posted Q4 net income and revenue that topped...
Copyright 2023-2026 - www.financetom.com All Rights Reserved