financetom
Technology
financetom
/
Technology
/
Nvidia chips make gains in training largest AI systems, new data shows
News World Market Environment Technology Personal Finance Politics Retail Business Economy Cryptocurrency Forex Stocks Market Commodities
Nvidia chips make gains in training largest AI systems, new data shows
Jun 4, 2025 9:02 AM

SAN FRANCISCO, June 4 (Reuters) - Nvidia's ( NVDA )

newest chips have made gains in training large artificial

intelligence systems, new data released on Wednesday showed,

with the number of chips required to train large language models

dropping dramatically.

MLCommons, a nonprofit group that publishes benchmark

performance results for AI systems, released new data about

chips from Nvidia ( NVDA ) and Advanced Micro Devices ( AMD ), among

others, for training, in which AI systems are fed large amounts

of data to learn from. While much of the stock market's

attention has shifted to a larger market for AI inference, in

which AI systems handle questions from users, the number of

chips needed to train the systems is still a key competitive

concern. China's DeepSeek claims to create a competitive chatbot

using far fewer chips than U.S. rivals.

The results were the first that MLCommons has released about

how chips fared at training AI systems such as Llama 3.1 405B,

an open-source AI model released by Meta Platforms ( META ) that

has a large enough number of what are known as "parameters" to

give an indication of how the chips would perform at some of the

most complex training tasks in the world, which can involve

trillions of parameters.

Nvidia ( NVDA ) and its partners were the only entrants that submitted

data about training that large model, and the data showed that

Nvidia's ( NVDA ) new Blackwell chips are, on a per-chip basis, more than

twice as fast as the previous generation of Hopper chips.

In the fastest results for Nvidia's ( NVDA ) new chips, 2,496

Blackwell chips completed the training test in 27 minutes. It

took more than three times that many of Nvidia's ( NVDA ) previous

generation of chips to get a faster time, according to the data.

In a press conference, Chetan Kapoor, chief product officer

for CoreWeave ( CRWV ), which collaborated with Nvidia ( NVDA ) to produce some of

the results, said there has been a trend in the AI industry

toward stringing together smaller groups of chips into

subsystems for separate AI training tasks, rather than creating

homogenous groups of 100,000 chips or more.

"Using a methodology like that, they're able to continue to

accelerate or reduce the time to train some of these crazy,

multi-trillion parameter model sizes," Kapoor said.

Comments
Welcome to financetom comments! Please keep conversations courteous and on-topic. To fosterproductive and respectful conversations, you may see comments from our Community Managers.
Sign up to post
Sort by
Show More Comments
Related Articles >
SoftBank first to receive new Nvidia chips for supercomputer
SoftBank first to receive new Nvidia chips for supercomputer
Nov 12, 2024
TOKYO, Nov 13 (Reuters) - SoftBank's Japanese telecoms unit will receive the first chips using Nvidia's ( NVDA ) latest Blackwell design for its supercomputer, the California-based chip designer said, as Masayoshi Son looks to ride the artificial intelligence boom. SoftBank Corp ( SFTBF ) is also planning to use Grace Blackwell chips for a further supercomputer, said Nvidia (...
China showcases its latest military hardware, and ambitions, at Zhuhai
China showcases its latest military hardware, and ambitions, at Zhuhai
Nov 13, 2024
SINGAPORE/ZHUHAI, CHINA (Reuters) - The Chinese military hardware on display at the country's largest air show in Zhuhai illustrates its ambitions, and in some cases may show breakthroughs in capability, experts say. Among the systems showcased were the latest variant of China's J-35A stealth fighter, its larger J-20 stealth fighter, a stealthy drone designated the CH-7 and the HQ-19 air...
US to award Akash Systems up to $18.2 million for chips production
US to award Akash Systems up to $18.2 million for chips production
Nov 13, 2024
(Reuters) - The U.S. Commerce Department said Wednesday it has agreed to provide up to $18.2 million in government subsidy funding to Akash Systems to support the construction of a 40,000-square-foot cleanroom space for advanced semiconductor manufacturing. This proposed funding from the $52.7 billion semiconductor manufacturing and research subsidy program, will be combined with funding from California-based Akash, venture capital...
7 Analysts Assess Baidu: What You Need To Know
7 Analysts Assess Baidu: What You Need To Know
Nov 12, 2024
Baidu ( BIDU ) underwent analysis by 7 analysts in the last quarter, revealing a spectrum of viewpoints from bullish to bearish. The table below offers a condensed view of their recent ratings, showcasing the changing sentiments over the past 30 days and comparing them to the preceding months. Bullish Somewhat Bullish Indifferent Somewhat Bearish Bearish Total Ratings 3 3...
Copyright 2023-2025 - www.financetom.com All Rights Reserved