financetom
Business
financetom
/
Business
/
Anthropic says AI labs need coordinated plan to halt development if risks rise
News World Market Environment Technology Personal Finance Politics Retail Business Economy Cryptocurrency Forex Stocks Market Commodities
Anthropic says AI labs need coordinated plan to halt development if risks rise
Jun 4, 2026 5:01 PM

June 4 (Reuters) - Anthropic said on Thursday frontier AI developers should establish a coordinated, verifiable way to slow down or temporarily pause development if advanced systems begin improving themselves faster than society can manage the risks.

AI that can build itself would be a major development in the history of technology, but "full recursive self-improvement also might increase the risks of humans losing control over AI systems," the AI startup said.

"If systems are capable of fully building their own successors, the ways we secure them, monitor them, and shape their behavior all grow much more important."

As an example, Anthropic said that as of May, more than 80% of the code merged into its codebase was authored by Claude.

It would be "good for the world to have the option to slow or temporarily pause frontier AI development to enable societal structures and alignment research to keep up with the advance of the technology," the company said.

However, it cautioned that unilateral or poorly coordinated slowdowns could backfire if less cautious actors continue advancing, potentially reducing overall safety.

It highlighted that a meaningful pause would require agreement among "multiple well-resourced labs" operating at the technological frontier, as well as rules on what conditions would trigger or lift such a pause and who would oversee it.

A unilateral pause by a single company would be easier to implement, Anthropic added, but would have limited impact, primarily shifting leadership rather than fostering broader global deliberation.

Its research arm, Anthropic Institute, plans to study and help build systems that would be necessary to support a slowdown.

In the coming months, Anthropic plans to convene discussions involving policymakers, researchers, civil society groups and other AI firms to examine key questions.

These questions include how to manage AI-related risks such as recursive self-improvement and how to improve mechanisms for coordination.

Last month, Anthropic concluded a fundraising round that valued the company at $965 billion and confidentially filed for a U.S. initial public offering on Monday.

Comments
Welcome to financetom comments! Please keep conversations courteous and on-topic. To fosterproductive and respectful conversations, you may see comments from our Community Managers.
Sign up to post
Sort by
Show More Comments
Related Articles >
Sector Update: Consumer Stocks Lean Lower Premarket Tuesday
Sector Update: Consumer Stocks Lean Lower Premarket Tuesday
Sep 30, 2025
09:13 AM EDT, 09/30/2025 (MT Newswires) -- Consumer stocks were leaning lower premarket Tuesday, with the Consumer Staples Select Sector SPDR Fund ( XLP ) slightly declining and the Consumer Discretionary Select Sector SPDR Fund ( XLY ) down 0.2%. United Natural Foods ( UNFI ) shares were up more than 5% after the company reported a narrower fiscal Q4...
United Natural Foods CEO Says Company Effectively Navigated Cyber Incident, Eyes Growth Ahead
United Natural Foods CEO Says Company Effectively Navigated Cyber Incident, Eyes Growth Ahead
Sep 30, 2025
United Natural Foods Inc. ( UNFI ) stock traded higher on Tuesday after posting fiscal fourth-quarter 2025 results that beat analyst forecasts despite weaker year-over-year sales. The wholesale distributor reported net sales for the quarter of $7.70 billion, surpassing Wall Street’s estimate of $7.64 billion, which fell 5.6% from $8.16 billion a year earlier. UNFI’s fourth-quarter results were heavily affected...
Astra Exploration Announced C$5 Million Private Placement
Astra Exploration Announced C$5 Million Private Placement
Sep 30, 2025
09:13 AM EDT, 09/30/2025 (MT Newswires) -- Astra Exploration ( ATEPF ) , which lost 8% yesterday, overnight Monday announced a bought deal private placement for aggregate gross proceeds of near C$5 million. The company said it entered into an agreement with a syndicate investment dealers that has agreed to purchase 8.065 million shares at C$0.62 each. It also granted...
Vaxcyte to Expand Fill-Finish Manufacturing Capacity in US; Shares Up Pre-Bell
Vaxcyte to Expand Fill-Finish Manufacturing Capacity in US; Shares Up Pre-Bell
Sep 30, 2025
09:12 AM EDT, 09/30/2025 (MT Newswires) -- Vaxcyte ( PCVX ) said Tuesday that Thermo Fisher Scientific ( TMO ) will provide custom commercial fill-finish capacity for Vaxcyte's ( PCVX ) broad-spectrum pneumococcal conjugate vaccines at its North Carolina facility. The company said its new agreement with Thermo Fisher is a key element of its long-term commercial supply strategy in...
Copyright 2023-2026 - www.financetom.com All Rights Reserved