financetom
Technology
financetom
/
Technology
/
Cerebras launches AI inference tool to challenge Nvidia
News World Market Environment Technology Personal Finance Politics Retail Business Economy Cryptocurrency Forex Stocks Market Commodities
Cerebras launches AI inference tool to challenge Nvidia
Aug 29, 2024 4:36 AM

SAN FRANCISCO (Reuters) - Cerebras Systems launched on Tuesday a tool for AI developers that allows them to access the startup's outsized chips to run applications, offering what it says is a much cheaper option than industry-standard Nvidia ( NVDA ) processors.

Access to Nvidia ( NVDA ) graphics processing units (GPUs) - often via a cloud computing provider - to train and deploy large artificial intelligence models used for applications such as OpenAI's ChatGPT can be difficult to obtain and expensive to run, a process developers refer to as inference.

"We're delivering performance that cannot be achieved by a GPU," Cerebras CEO Andrew Feldman told Reuters in an interview. "We're doing it at the highest accuracy, and we're offering it at the lowest price."

The inference portion of the AI market is expected to be fast-growing and attractive - ultimately worth tens of billions of dollars if consumers and businesses adopt AI tools.

The Sunnyvale, California-based company plans to offer several types of the inference product via a developer key and its cloud. The company will also sell its AI systems to customers who prefer to operate their own data centers.

Cerebras' chips - each the size of a dinner plate and called Wafer Scale Engines - avoid one of the issues with AI data crunching: the data crunched by large models that power AI applications typically won't fit on a single chip and can require hundreds or thousands of chips strung together.

That means Cerebras' chips can achieve speedier performances, Feldman said.

It plans to charge users as little as 10 cents per million tokens, which are one of the ways companies can measure the amount of output data from a large model.

Cerebras is aiming to go public and filed a confidential prospectus with the Securities and Exchange Commission this month, the company said.

Comments
Welcome to financetom comments! Please keep conversations courteous and on-topic. To fosterproductive and respectful conversations, you may see comments from our Community Managers.
Sign up to post
Sort by
Show More Comments
Related Articles >
Vodafone makes world's first satellite video call using standard smartphone
Vodafone makes world's first satellite video call using standard smartphone
Jan 29, 2025
* Vodafone ( VOD ) makes video call via satellite on standard smartphone * Signal was routed via partner AST SpaceMobile's ( ASTS ) satellites * Company aims to launch service across Europe starting later in 2025 By Paul Sandle LONDON, Jan 29 (Reuters) - Vodafone ( VOD ) said it had made the world's first video call via satellite...
American AI firms try to poke holes in disruptive DeepSeek
American AI firms try to poke holes in disruptive DeepSeek
Jan 29, 2025
SAN FRANCISCO -Developers at leading U.S. AI firms are praising the DeepSeek AI models that have leapt into prominence while also trying to poke holes in the notion that their multi-billion dollar technology has been bested by a Chinese newcomer's low-cost alternative. Chinese startup DeepSeek on Monday sparked a stock selloff and its free AI assistant overtook OpenAI's ChatGPT atop...
Microsoft shares dip as cloud growth misses estimates but spending grows
Microsoft shares dip as cloud growth misses estimates but spending grows
Jan 29, 2025
(Reuters) -Microsoft reported slower-than-expected growth in its crucial Azure cloud business on Wednesday despite beating estimates for overall quarterly revenue and increasing use of its cloud services for artificial intelligence. The Azure unit reported revenue growth of 31% in the quarter, missing Visible Alpha estimates of 31.8%. Microsoft's capital expenditures hit $22.6 billion, above analysts' consensus estimate of $20.95 billion,...
Trump officials discussing tightening curbs on Nvidia's China sales, sources say
Trump officials discussing tightening curbs on Nvidia's China sales, sources say
Jan 29, 2025
Jan 29 (Reuters) - U.S. President Donald Trump's administration is considering tightening restrictions on artificial intelligence leader Nvidia's ( NVDA ) sales of its H20 chips designed for the China market, three people familiar with the matter said. Conversations to restrict shipments of those chips to China are in very early stages among Trump officials, the people said, adding the...
Copyright 2023-2026 - www.financetom.com All Rights Reserved