financetom
Technology
financetom
/
Technology
/
Nvidia bets on AI inference as chip revenue opportunity hits $1 trillion
News World Market Environment Technology Personal Finance Politics Retail Business Economy Cryptocurrency Forex Stocks Market Commodities
Nvidia bets on AI inference as chip revenue opportunity hits $1 trillion
Mar 16, 2026 2:53 PM

SAN JOSE, California, March 16 (Reuters) - Nvidia said the revenue opportunity for its artificial intelligence chips may reach at least $1 trillion through 2027, as the company outlined a strategy to compete more aggressively in the fast-growing market for running AI systems in real time.

CEO Jensen Huang unveiled a new central processor and an AI system built on technology from Groq - a chip startup from which Nvidia licensed technology for $17 billion in December at its annual GTC developer conference in San Jose, California.

The moves are part of Huang's bid to firm up the company's position in so-called inference computing, the process of answering queries, where its graphics processors face greater competition from central processing units and custom processors built by the likes of Google. Nvidia chips have dominated the process of AI model training, which has been the focus of recent years.

"The inference inflection has arrived," Huang said. "And demand just keeps on going up," he added.

Dressed in his signature black leather jacket, Huang was speaking at a hockey arena with a capacity of more than 18,000 at the four-day conference that has become one of the biggest showcases of AI technology. "I just want to remind you, this is a tech conference," he told the audience.

But after a dazzling rally that made Nvidia the first company to hit a $5 trillion valuation last October, doubts have risen about its growth. Investors have also questioned if its plan of plowing back profits into the AI ecosystem will pay off. Huang's comments allayed some fears.

The $1 trillion forecast is up from the $500 billion revenue opportunity through 2026 that Nvidia cited for its Blackwell and Rubin AI chips on its last earnings call in February.

Shares of Nvidia briefly jumped on the new forecast but pared those gains to close up 1.2%.

"Huang mapping out a $1 trillion opportunity through 2027 underscores the durable demand for Nvidia's AI infrastructure despite investor concerns," Emarketer analyst Jacob Bourne said.

"It signals Nvidia is sustaining its leadership in the AI chip market while the overall AI industry expands beyond early experimentation into large-scale deployment."

INFERENCE BOOM

Huang said that inference, where AI systems answer questions or carry out tasks, will be split up into two steps.

Nvidia's Vera Rubin chips will handle a first step called "prefill," where the user's request is transformed from human words into ‌the language of "tokens" that AI computers use.

Groq's new chips will handle a second "decode" stage where the AI computer provides the answer the user is looking for.

After spending hundreds of billions of dollars in recent years on chips for training their AI models, companies such as OpenAI, Anthropic and Meta are shifting toward serving hundreds of millions of users who are tapping those AI systems.

That is also driving demand for CPUs - which are dominated by Intel and are increasingly seen as a viable alternative to graphics processors from Nvidia for deploying AI models.

"We are selling a lot of CPU standalone," Huang said as he unveiled the new Vera CPU. "This is already for sure going to be a multi-billion-dollar business for us," he added.

Huang also showed off the company's Feynman roadmap but offered few details beyond a list of the various chips Nvidia plans to include in the platform, including AI processors and several networking chips. The Feynman architecture is expected in 2028, following the company's Rubin Ultra chips.

The company is also targeting the market for autonomous AI agents with NemoClaw, which integrates with the viral OpenClaw platform to add privacy and safety controls to the tool that can autonomously execute a wide range of tasks with minimal human guidance and has generated global buzz.

"It's kind of upleveled the entire discussion. It's up leveled the entire thought of how they do infrastructure," said Technalysis Research president Bob O'Donnell, referring to the announcements.

"He (Huang) used to come out with a new GPU chip and say, look, here's my new chip. Now he's got, you know, five racks of equipment that make up these systems."

Comments
Welcome to financetom comments! Please keep conversations courteous and on-topic. To fosterproductive and respectful conversations, you may see comments from our Community Managers.
Sign up to post
Sort by
Show More Comments
Related Articles >
Japan braces for life with interest rates after historic change
Japan braces for life with interest rates after historic change
Mar 21, 2024
TOKYO, March 22 (Reuters) - In the coming years, Satoaki Kanoh needs to replace almost a dozen ageing machines at his Tokyo-based maker of acrylic panels, a major undertaking that he worries will become even more expensive. Ideally, I'd like to do one a year. But I don't have that much money, Kanoh said of the customised pieces of machinery...
AIOZ Network Partners With Alibaba Cloud to Boost AI, Storage and Streaming Services
AIOZ Network Partners With Alibaba Cloud to Boost AI, Storage and Streaming Services
Mar 22, 2024
The two companies will establish a DePIN alliance in south-east Asia.AIOZ's native token is currently trading flat after the announcement, it is up by more than 200% in 30 days.AIOZ Network will use Alibaba Cloud to improve Web 3, AI, storage and streaming services.Decentralized infrastructure network (DePIN) AIOZ Network has become the leading blockchain partner in Alibaba Cloud’s Innovation Accelerator...
Japan braces for life with interest rates after historic change
Japan braces for life with interest rates after historic change
Mar 21, 2024
TOKYO (Reuters) - In the coming years, Satoaki Kanoh needs to replace almost a dozen ageing machines at his Tokyo-based maker of acrylic panels, a major undertaking that he worries will become even more expensive. Ideally, I'd like to do one a year. But I don't have that much money, Kanoh said of the customised pieces of machinery that cost...
Analysis-Apple antitrust suit mirrors strategy that beat Microsoft, but tech industry has changed
Analysis-Apple antitrust suit mirrors strategy that beat Microsoft, but tech industry has changed
Mar 22, 2024
(Reuters) - The U.S. government's antitrust lawsuit against Apple ( AAPL ) draws on the watershed 1998 case that broke Microsoft's ( MSFT ) stranglehold on desktop software, but that may prove to be an imperfect blueprint for addressing smartphone competition. The market for the iPhone today looks very different from the near-monopoly enjoyed by Microsoft's ( MSFT ) Windows...
Copyright 2023-2026 - www.financetom.com All Rights Reserved