financetom
Business
financetom
/
Business
/
Anthropic thwarts hacker attempts to misuse Claude AI for cybercrime
News World Market Environment Technology Personal Finance Politics Retail Business Economy Cryptocurrency Forex Stocks Market Commodities
Anthropic thwarts hacker attempts to misuse Claude AI for cybercrime
Aug 27, 2025 3:34 AM

Aug 27 (Reuters) - Anthropic said on Wednesday it had

detected and blocked hackers attempting to misuse its Claude AI

system to write phishing emails, create malicious code and

circumvent safety filters.

The company's findings, published in a report, highlight

growing concerns that AI tools are increasingly exploited in

cybercrime, intensifying calls for tech firms and regulators to

strengthen safeguards as the technology spreads.

Anthropic's report said its internal systems had stopped the

attacks and it was sharing the case studies - showing how

attackers had attempted to use Claude to produce harmful content

- to help others understand the risks.

The report cited attempts to use Claude to draft tailored

phishing emails, write or fix snippets of malicious code and

sidestep safeguards through repeated prompting.

It also described efforts to script influence campaigns by

generating persuasive posts at scale and helping low-skill

hackers with step-by-step instructions.

The company, backed by Amazon.com ( AMZN ) and Alphabet

, did not publish technical indicators such as IPs or

prompts, but said it had banned the accounts involved and

tightened its filters after detecting the activity.

Experts say criminals are increasingly turning to AI to make

scams more convincing and to speed up hacking attempts. These

tools can help write realistic phishing messages, automate parts

of malware development and even potentially assist in planning

attacks.

Security researchers warn that as AI models become more

powerful, the risk of misuse will grow unless companies and

governments act quickly.

Anthropic said it follows strict safety practices, including

regular testing and outside reviews, and plans to keep

publishing reports when it finds major threats.

Microsoft ( MSFT ) and SoftBank-backed OpenAI and

Google have faced similar scrutiny over fears their AI models

could be exploited for hacking or scams, prompting calls for

stronger safeguards.

Governments are also moving to regulate the technology, with

the European Union moving forward with its Artificial

Intelligence Act and the United States pushing for voluntary

safety commitments from major developers.

Comments
Welcome to financetom comments! Please keep conversations courteous and on-topic. To fosterproductive and respectful conversations, you may see comments from our Community Managers.
Sign up to post
Sort by
Show More Comments
Related Articles >
Enphase Stock Surges Amid Biden's Tariff Boost On Chinese Solar Imports
Enphase Stock Surges Amid Biden's Tariff Boost On Chinese Solar Imports
May 24, 2024
Shares of Enphase Energy, Inc. ( ENPH ) are trading higher on Friday afternoon, possibly driven by President Joe Biden's recent announcement of increased tariffs on Chinese imports, which includes a significant hike on solar cells. What To Know: The Biden administration imposed a 50% tariff on Chinese solar cells this year, up from the previous 25%. This move aims...
Wrap Technologies Gets Nasdaq Noncompliance Notice For Late Filing
Wrap Technologies Gets Nasdaq Noncompliance Notice For Late Filing
May 24, 2024
02:07 PM EDT, 05/24/2024 (MT Newswires) -- Wrap Technologies ( WRAP ) said Friday it has received a noncompliance notice from Nasdaq for failing to file its quarterly report on Form 10-Q for the quarter ended March 31 with the Securities and Exchange Commission on time. In April, the firm also got a noncompliance notice because it has not yet...
--Boeing, NASA to Reportedly Launch Starliner Despite Helium Leak
--Boeing, NASA to Reportedly Launch Starliner Despite Helium Leak
May 24, 2024
02:06 PM EDT, 05/24/2024 (MT Newswires) -- Price: 174.39, Change: +2.18, Percent Change: +1.27 ...
Spanish Mountain Gold Partners With Austrian Tech Company Andritz to Cut Emissions
Spanish Mountain Gold Partners With Austrian Tech Company Andritz to Cut Emissions
May 24, 2024
02:03 PM EDT, 05/24/2024 (MT Newswires) -- Spanish Mountain Gold ( SPAZF ) on Tuesday said it partnered with Austrian technology group Andritz and BC Hydro (British Columbia's utility company) to reduce the carbon intensity of its proposed Spanish Mountain Gold ( SPAZF ) project in the Cariboo Gold Corridor near Likely, B.C. through the use of simulation software. Andritz's...
Copyright 2023-2026 - www.financetom.com All Rights Reserved