financetom
Technology
financetom
/
Technology
/
Exclusive-OpenAI builds first chip with Broadcom and TSMC, scales back foundry ambition
News World Market Environment Technology Personal Finance Politics Retail Business Economy Cryptocurrency Forex Stocks Market Commodities
Exclusive-OpenAI builds first chip with Broadcom and TSMC, scales back foundry ambition
Nov 3, 2024 2:04 PM

(Reuters) - OpenAI is working with Broadcom ( AVGO ) and TSMC to build its first in-house chip designed to support its artificial intelligence systems, while adding AMD chips alongside Nvidia ( NVDA ) chips to meet its surging infrastructure demands, sources told Reuters.

OpenAI, the fast-growing company behind ChatGPT, has examined a range of options to diversify chip supply and reduce costs. OpenAI considered building everything in-house and raising capital for an expensive plan to build a network of factories known as "foundries" for chip manufacturing.

The company has dropped the ambitious foundry plans for now due to the costs and time needed to build a network, and plans instead to focus on in-house chip design efforts, according to sources, who requested anonymity as they were not authorized to discuss private matters.

The company's strategy, detailed here for the first time, highlights how the Silicon Valley startup is leveraging industry partnerships and a mix of internal and external approaches to secure chip supply and manage costs like larger rivals Amazon ( AMZN ), Meta, Google and Microsoft ( MSFT ). As one of the largest buyers of chips, OpenAI's decision to source from a diverse array of chipmakers while developing its customized chip could have broader tech sector implications.

OpenAI, AMD and TSMC declined to comment. Broadcom ( AVGO ) did not immediately respond to a request for comment.

OpenAI, which helped commercialize generative AI that produces human-like responses to queries, relies on substantial computing power to train and run its systems. As one of the largest purchasers of Nvidia's ( NVDA ) graphics processing units (GPUs), OpenAI uses AI chips both to train models where the AI learns from data and for inference, applying AI to make predictions or decisions based on new information.

Reuters previously reported on OpenAI's chip design endeavors. The Information reported on talks with Broadcom ( AVGO ) and others.

OpenAI has been working for months with Broadcom ( AVGO ) to build its first AI chip focusing on inference, according to sources. Demand right now is greater for training chips, but analysts have predicted the need for inference chips could surpass them as more AI applications are deployed.

Broadcom ( AVGO ) helps companies including Alphabet unit Google fine-tune chip designs for manufacturing and also supplies parts of the design that help move information on and off the chips quickly. This is important in AI systems where tens of thousands of chips are strung together to work in tandem.

OpenAI is still determining whether to develop or acquire other elements for its chip design, and may engage additional partners, said two of the sources. 

The company has assembled a chip team of about 20 people, led by top engineers who have previously built Tensor Processing Units (TPUs) at Google, including Thomas Norrie and Richard Ho.

Sources said that through Broadcom ( AVGO ), OpenAI has secured manufacturing capacity with Taiwan Semiconductor Manufacturing Company ( TSM ) to make its first custom-designed chip in 2026. They said the timeline could change. 

Currently, Nvidia's ( NVDA ) GPUs hold over 80% market share. But shortages and rising costs have led major customers like Microsoft ( MSFT ), Meta, and now OpenAI, to explore in-house or external alternatives.

OpenAI's planned use of AMD chips through Microsoft's ( MSFT ) Azure, first reported here, shows how AMD's new MI300X chips are trying to gain a slice of the market dominated by Nvidia ( NVDA ). AMD has projected $4.5 billion in 2024 AI chip sales, following the chip's launch in the fourth quarter of 2023.

Training AI models and operating services like ChatGPT are expensive. OpenAI has projected a $5 billion loss this year on $3.7 billion in revenue, according to sources. Compute costs, or expenses for hardware, electricity and cloud services needed to process large datasets and develop models, are the company's largest expense, prompting efforts to optimize utilization and diversify suppliers.

OpenAI has been cautious about poaching talent from Nvidia ( NVDA ) because it wants to maintain a good rapport with the chip maker it remains committed to working with, especially for accessing its new generation of Blackwell chips, sources added.

Nvidia ( NVDA ) declined to comment.

Comments
Welcome to financetom comments! Please keep conversations courteous and on-topic. To fosterproductive and respectful conversations, you may see comments from our Community Managers.
Sign up to post
Sort by
Show More Comments
Related Articles >
Deep Dive Into Confluent Stock: Analyst Perspectives (17 Ratings)
Deep Dive Into Confluent Stock: Analyst Perspectives (17 Ratings)
Mar 22, 2024
In the preceding three months, 17 analysts have released ratings for Confluent , presenting a wide array of perspectives from bullish to bearish. The following table summarizes their recent ratings, shedding light on the changing sentiments within the past 30 days and comparing them to the preceding months. Bullish Somewhat Bullish Indifferent Somewhat Bearish Bearish Total Ratings 7 5 5...
AIOZ Network Partners With Alibaba Cloud to Boost AI, Storage and Streaming Services
AIOZ Network Partners With Alibaba Cloud to Boost AI, Storage and Streaming Services
Mar 22, 2024
The two companies will establish a DePIN alliance in south-east Asia.AIOZ's native token is currently trading flat after the announcement, it is up by more than 200% in 30 days.AIOZ Network will use Alibaba Cloud to improve Web 3, AI, storage and streaming services.Decentralized infrastructure network (DePIN) AIOZ Network has become the leading blockchain partner in Alibaba Cloud’s Innovation Accelerator...
The Analyst Landscape: 7 Takes On Clear Secure
The Analyst Landscape: 7 Takes On Clear Secure
Mar 22, 2024
Analysts' ratings for Clear Secure ( YOU ) over the last quarter vary from bullish to bearish, as provided by 7 analysts. The table below provides a concise overview of recent ratings by analysts, offering insights into the changing sentiments over the past 30 days and drawing comparisons with the preceding months for a holistic perspective. Bullish Somewhat Bullish Indifferent...
Analysis-Apple antitrust suit mirrors strategy that beat Microsoft, but tech industry has changed
Analysis-Apple antitrust suit mirrors strategy that beat Microsoft, but tech industry has changed
Mar 22, 2024
(Reuters) - The U.S. government's antitrust lawsuit against Apple ( AAPL ) draws on the watershed 1998 case that broke Microsoft's ( MSFT ) stranglehold on desktop software, but that may prove to be an imperfect blueprint for addressing smartphone competition. The market for the iPhone today looks very different from the near-monopoly enjoyed by Microsoft's ( MSFT ) Windows...
Copyright 2023-2025 - www.financetom.com All Rights Reserved