financetom
Technology
financetom
/
Technology
/
Nvidia chips make gains in training largest AI systems, new data shows
News World Market Environment Technology Personal Finance Politics Retail Business Economy Cryptocurrency Forex Stocks Market Commodities
Nvidia chips make gains in training largest AI systems, new data shows
Jun 4, 2025 9:03 AM

SAN FRANCISCO (Reuters) -Nvidia's ( NVDA ) newest chips have made gains in training large artificial intelligence systems, new data released on Wednesday showed, with the number of chips required to train large language models dropping dramatically.

MLCommons, a nonprofit group that publishes benchmark performance results for AI systems, released new data about chips from Nvidia ( NVDA ) and Advanced Micro Devices ( AMD ), among others, for training, in which AI systems are fed large amounts of data to learn from. While much of the stock market's attention has shifted to a larger market for AI inference, in which AI systems handle questions from users, the number of chips needed to train the systems is still a key competitive concern. China's DeepSeek claims to create a competitive chatbot using far fewer chips than U.S. rivals.

The results were the first that MLCommons has released about how chips fared at training AI systems such as Llama 3.1 405B, an open-source AI model released by Meta Platforms ( META ) that has a large enough number of what are known as "parameters" to give an indication of how the chips would perform at some of the most complex training tasks in the world, which can involve trillions of parameters. 

Nvidia ( NVDA ) and its partners were the only entrants that submitted data about training that large model, and the data showed that Nvidia's ( NVDA ) new Blackwell chips are, on a per-chip basis, more than twice as fast as the previous generation of Hopper chips.

In the fastest results for Nvidia's ( NVDA ) new chips, 2,496 Blackwell chips completed the training test in 27 minutes. It took more than three times that many of Nvidia's ( NVDA ) previous generation of chips to get a faster time, according to the data.

In a press conference, Chetan Kapoor, chief product officer for CoreWeave ( CRWV ), which collaborated with Nvidia ( NVDA ) to produce some of the results, said there has been a trend in the AI industry toward stringing together smaller groups of chips into subsystems for separate AI training tasks, rather than creating homogenous groups of 100,000 chips or more.

"Using a methodology like that, they're able to continue to accelerate or reduce the time to train some of these crazy, multi-trillion parameter model sizes," Kapoor said.

Comments
Welcome to financetom comments! Please keep conversations courteous and on-topic. To fosterproductive and respectful conversations, you may see comments from our Community Managers.
Sign up to post
Sort by
Show More Comments
Related Articles >
What Analysts Are Saying About Quest Diagnostics Stock
What Analysts Are Saying About Quest Diagnostics Stock
Aug 29, 2024
7 analysts have expressed a variety of opinions on Quest Diagnostics ( DGX ) over the past quarter, offering a diverse set of opinions from bullish to bearish. The table below offers a condensed view of their recent ratings, showcasing the changing sentiments over the past 30 days and comparing them to the preceding months. Bullish Somewhat Bullish Indifferent Somewhat...
Competitor Analysis: Evaluating Apple And Competitors In Technology Hardware, Storage & Peripherals Industry
Competitor Analysis: Evaluating Apple And Competitors In Technology Hardware, Storage & Peripherals Industry
Aug 29, 2024
In today's rapidly changing and fiercely competitive business landscape, it is essential for investors and industry enthusiasts to thoroughly analyze companies. In this article, we will conduct a comprehensive industry comparison, evaluating Apple ( AAPL ) against its key competitors in the Technology Hardware, Storage & Peripherals industry. By examining key financial metrics, market position, and growth prospects, we aim...
A Closer Look at 30 Analyst Recommendations For SolarEdge Technologies
A Closer Look at 30 Analyst Recommendations For SolarEdge Technologies
Aug 29, 2024
SolarEdge Technologies ( SEDG ) has been analyzed by 30 analysts in the last three months, revealing a diverse range of perspectives from bullish to bearish. In the table below, you'll find a summary of their recent ratings, revealing the shifting sentiments over the past 30 days and comparing them to the previous months. Bullish Somewhat Bullish Indifferent Somewhat Bearish...
Exclusive-Intel board member quit after differences over chipmaker's revival plan
Exclusive-Intel board member quit after differences over chipmaker's revival plan
Aug 29, 2024
SAN FRANCISCO (Reuters) - The sudden resignation of a high-profile Intel board member came after differences with CEO Pat Gelsinger and other directors over what the director considered the U.S. company's bloated workforce, risk-averse culture and lagging artificial intelligence strategy, according to three sources familiar with the matter.  Lip-Bu Tan, a semiconductor industry veteran, had said he was leaving the...
Copyright 2023-2025 - www.financetom.com All Rights Reserved