financetom
Technology
financetom
/
Technology
/
Nvidia CEO says power-saving optical chip tech will need to wait for wider use
News World Market Environment Technology Personal Finance Politics Retail Business Economy Cryptocurrency Forex Stocks Market Commodities
Nvidia CEO says power-saving optical chip tech will need to wait for wider use
Mar 18, 2025 8:55 PM

SAN JOSE, California (Reuters) - A promising new chip technology that aims to cut energy usage is not yet reliable enough for use in Nvidia's ( NVDA ) flagship graphics processing units (GPUs), Nvidia's ( NVDA ) CEO Jensen Huang said Tuesday.

Co-packaged optics, as the emerging technology is called, uses beams of laser light to send information on fiber optic cables between chips, making connections faster and with superior energy efficiency to those through traditional copper cables.

During a keynote address to Nvidia's ( NVDA ) annual developer conference at a packed hockey stadium in San Jose, California on Tuesday, Huang said his company would use the co-packaged optical technology in two new networking chips that sit in switches on top of its servers, saying the technology would make the chips three and a half times more energy efficient than their predecessors.

The switch chips will come out later this year and into 2026 in a small but significant step toward advancing the technology.

But Huang told a group of journalists after his speech that while Nvidia ( NVDA ) examined using it more widely in its flagship GPU chips it had no current plans to do so, because traditional copper connections were "orders of magnitude" more reliable than today's co-packaged optical connections.

"That's not worth it," Huang said of using optical connections directly between GPUs. "We keep playing with that equation. Copper is far better."

Huang said that he was focused on providing a reliable product roadmap that Nvidia's ( NVDA ) customers, such as OpenAI and Oracle, could prepare for.

"In a couple years, several hundred billion dollars of AI infrastructure is going to get laid down, and so you've got the budget approved. You got the power approved. You got the land built," Huang said. "What are you willing to scale up to several hundred billion dollars right now?"

Silicon Valley entrepreneurs and investors have pinned their hopes on the optics technology, which they believe will be central to building ever-larger computers for AI systems, which Huang said on Tuesday would still be necessary even after advances by companies like DeepSeek because AI systems would need more computing power to think through their answers.

Startups such as Ayar Labs, Lightmatter and Celestial AI have raised hundreds of millions of dollars in venture capital - some of it from Nvidia ( NVDA ) itself - to try and put co-packaged optical connections directly onto AI chips. Lightmatter and Celestial AI are both targeting public offerings.

Copper connections are cheap and fast, but can only carry data a few meters at most. While that might seem trivial, it has had a huge impact on Nvidia's ( NVDA ) product lineup over the past half decade.

Nvidia's ( NVDA ) current flagship product contains 72 of its chips in a single server, consuming 120 kilowatts of electricity and generating so much heat that it requires a liquid cooling system similar to that of a car engine. The flagship server unveiled on Tuesday for release in 2027 will pack hundreds of its Vera Rubin Ultra Chips into a single rack and will consume 600 kilowatts of power.

Cramming more than double the number of chips into the same space over two years will require massive feats of engineering from Nvidia ( NVDA ) and its partners. Those feats are driven by the fact that AI computing work requires moving a lot of data back and forth between chips, and Nvidia ( NVDA ) is trying to keep as many chips as it can within the relatively short reach of copper connections.

Mark Wade, the CEO of Ayar Labs, which has received venture backing from Nvidia ( NVDA ), said the chip industry was still navigating how to manufacture co-packaged optics at lower costs and with higher reliability. While the transition may not come until 2028 or beyond, Wade said, the chip industry will have little choice but to ditch copper if it wants to keep building bigger and bigger servers.

"Just look at the power consumption going up and up on racks with electrical connections," Wade told Reuters in an interview on the sidelines of Nvidia's ( NVDA ) conference. "Optics is the only technology that gets you off of that train."

Comments
Welcome to financetom comments! Please keep conversations courteous and on-topic. To fosterproductive and respectful conversations, you may see comments from our Community Managers.
Sign up to post
Sort by
Show More Comments
Related Articles >
BIO-key Reveals Strategic Move To AWS Marketplace Amid Q2 Revenue Challenges: Details
BIO-key Reveals Strategic Move To AWS Marketplace Amid Q2 Revenue Challenges: Details
Aug 15, 2024
BIO-key International, Inc. ( BKYI ) announced that its PortalGuard IDaaS platform, featuring Identity-Bound Biometrics (IBB) authentication, is now available on the AWS Marketplace, expanding its global reach and customer base. By listing on AWS Marketplace, BIO-key aims to simplify the integration of its advanced security solutions, allowing global customers to easily purchase and implement PortalGuard for enhanced identity management...
This Is What Whales Are Betting On Qualcomm
This Is What Whales Are Betting On Qualcomm
Aug 15, 2024
Deep-pocketed investors have adopted a bullish approach towards Qualcomm ( QCOM ) , and it's something market players shouldn't ignore. Our tracking of public options records at Benzinga unveiled this significant move today. The identity of these investors remains unknown, but such a substantial move in QCOM usually suggests something big is about to happen. We gleaned this information from...
8 Analysts Assess BILL Holdings: What You Need To Know
8 Analysts Assess BILL Holdings: What You Need To Know
Aug 15, 2024
In the preceding three months, 8 analysts have released ratings for BILL Holdings ( BILL ) , presenting a wide array of perspectives from bullish to bearish. The table below summarizes their recent ratings, showcasing the evolving sentiments within the past 30 days and comparing them to the preceding months. Bullish Somewhat Bullish Indifferent Somewhat Bearish Bearish Total Ratings 4...
Performance Comparison: ON Semiconductor And Competitors In Semiconductors & Semiconductor Equipment Industry
Performance Comparison: ON Semiconductor And Competitors In Semiconductors & Semiconductor Equipment Industry
Aug 15, 2024
In the ever-changing and fiercely competitive business landscape, conducting thorough company analysis is crucial for investors and industry experts. In this article, we will undertake a comprehensive industry comparison, evaluating ON Semiconductor and its primary competitors in the Semiconductors & Semiconductor Equipment industry. By closely examining key financial metrics, market position, and growth prospects, our aim is to provide valuable...
Copyright 2023-2025 - www.financetom.com All Rights Reserved