financetom
Technology
financetom
/
Technology
/
Nvidia chips make gains in training largest AI systems, new data shows
News World Market Environment Technology Personal Finance Politics Retail Business Economy Cryptocurrency Forex Stocks Market Commodities
Nvidia chips make gains in training largest AI systems, new data shows
Jun 4, 2025 9:02 AM

SAN FRANCISCO, June 4 (Reuters) - Nvidia's ( NVDA )

newest chips have made gains in training large artificial

intelligence systems, new data released on Wednesday showed,

with the number of chips required to train large language models

dropping dramatically.

MLCommons, a nonprofit group that publishes benchmark

performance results for AI systems, released new data about

chips from Nvidia ( NVDA ) and Advanced Micro Devices ( AMD ), among

others, for training, in which AI systems are fed large amounts

of data to learn from. While much of the stock market's

attention has shifted to a larger market for AI inference, in

which AI systems handle questions from users, the number of

chips needed to train the systems is still a key competitive

concern. China's DeepSeek claims to create a competitive chatbot

using far fewer chips than U.S. rivals.

The results were the first that MLCommons has released about

how chips fared at training AI systems such as Llama 3.1 405B,

an open-source AI model released by Meta Platforms ( META ) that

has a large enough number of what are known as "parameters" to

give an indication of how the chips would perform at some of the

most complex training tasks in the world, which can involve

trillions of parameters.

Nvidia ( NVDA ) and its partners were the only entrants that submitted

data about training that large model, and the data showed that

Nvidia's ( NVDA ) new Blackwell chips are, on a per-chip basis, more than

twice as fast as the previous generation of Hopper chips.

In the fastest results for Nvidia's ( NVDA ) new chips, 2,496

Blackwell chips completed the training test in 27 minutes. It

took more than three times that many of Nvidia's ( NVDA ) previous

generation of chips to get a faster time, according to the data.

In a press conference, Chetan Kapoor, chief product officer

for CoreWeave ( CRWV ), which collaborated with Nvidia ( NVDA ) to produce some of

the results, said there has been a trend in the AI industry

toward stringing together smaller groups of chips into

subsystems for separate AI training tasks, rather than creating

homogenous groups of 100,000 chips or more.

"Using a methodology like that, they're able to continue to

accelerate or reduce the time to train some of these crazy,

multi-trillion parameter model sizes," Kapoor said.

Comments
Welcome to financetom comments! Please keep conversations courteous and on-topic. To fosterproductive and respectful conversations, you may see comments from our Community Managers.
Sign up to post
Sort by
Show More Comments
Related Articles >
Trump says Qatar will invest $10 billion in US airbase
Trump says Qatar will invest $10 billion in US airbase
May 26, 2025
* Preliminary agreement would allow US chip imports * Gulf region aims to become among top three global AI centers * President visits US troops in Middle East * Qatar to invest in US airbase, says Trump By Gram Slattery, Andrew Mills and Federico Maccioni DOHA, May 15 (Reuters) - U.S. President Donald Trump said on Thursday that Qatar will...
China accuses US of 'abusing' export control measures in Huawei AI chip curb
China accuses US of 'abusing' export control measures in Huawei AI chip curb
May 26, 2025
BEIJING (Reuters) -China on Thursday accused the United States of abusing export control measures and urged Washington to correct its practices after the U.S. issued guidance warning companies not to use Huawei's Ascend AI chips. The guidance threatens the stability of global semiconductor supply chains, Chinese commerce ministry spokesperson He Yongqian told a regular press conference, adding that China will...
Cisco Is Targeting A Multi-Billion-Dollar Security Shake-Up—And It Starts With Killing The Firewall
Cisco Is Targeting A Multi-Billion-Dollar Security Shake-Up—And It Starts With Killing The Firewall
May 26, 2025
Networking and communications giant Cisco Systems Inc. ( CSCO ) is laying the groundwork to upend a core pillar of enterprise cybersecurity, that is, the humble firewall. What Happened: During its third quarter earnings call on Wednesday, the company signaled a radical shift in the architecture of its products by embedding security directly into the network infrastructure. Cisco's ( CSCO...
Factbox-Foreign companies eye US expansion to lessen fallout from tariffs
Factbox-Foreign companies eye US expansion to lessen fallout from tariffs
May 26, 2025
(Reuters) -Some non-U.S. companies have said they are looking at expanding their presence or setting up shop in the United States to mitigate the impact of President Donald Trump's sweeping tariffs. Below are some of the plans flagged by those companies. BARRY CALLEBAUT The chocolate maker is planning to increase its U.S.-based production to fend off effects of the disruptive...
Copyright 2023-2025 - www.financetom.com All Rights Reserved