financetom
Technology
financetom
/
Technology
/
New AI benchmark tests speed of responses to user queries
News World Market Environment Technology Personal Finance Politics Retail Business Economy Cryptocurrency Forex Stocks Market Commodities
New AI benchmark tests speed of responses to user queries
Mar 27, 2024 8:28 AM

SAN FRANCISCO (Reuters) - Artificial intelligence benchmarking group MLCommons on Wednesday released a fresh set of tests and results that rate the speed at which top-of-the-line hardware can run AI applications and respond to users.

The two new benchmarks added by MLCommons measure the speed at which the AI chips and systems can generate responses from the powerful AI models packed with data. The results roughly demonstrate to how quickly an AI application such as ChatGPT can deliver a response to a user query.

One of the new benchmarks added the capability to measure the speediness of a question-and-answer scenario for large language models. Called Llama 2, it includes 70 billion parameters and was developed by Meta Platforms ( META ).

MLCommons officials also added a second text-to-image generator to the suite of benchmarking tools, called MLPerf, based on Stability AI's Stable Diffusion XL model.

Servers powered by Nvidia's ( NVDA ) H100 chips built by the likes of Alphabet's Google, Supermicro and Nvidia ( NVDA ) itself handily won both new benchmarks on raw performance. Several server builders submitted designs based on the company's less powerful L40S chip.

Server builder Krai submitted a design for the image generation benchmark with a Qualcomm AI chip that draws significant less power than Nvidia's ( NVDA ) cutting edge processors.

Intel ( INTC ) also submitted a design based on its Gaudi2 accelerator chips. The company described the results as "solid."

Raw performance is not the only measure that is critical when deploying AI applications. Advanced AI chips suck up enormous amounts of energy and one of the most significant challenges for AI companies is deploying chip that deliver an optimal amount of performance for a minimal amount of energy.

MLCommons has a separate benchmark category for measuring power consumption.

Comments
Welcome to financetom comments! Please keep conversations courteous and on-topic. To fosterproductive and respectful conversations, you may see comments from our Community Managers.
Sign up to post
Sort by
Show More Comments
Related Articles >
NXP Semiconductors Receives $1.03 Billion Loan From European Investment Bank
NXP Semiconductors Receives $1.03 Billion Loan From European Investment Bank
Jan 15, 2025
09:33 AM EST, 01/15/2025 (MT Newswires) -- NXP Semiconductors ( NXPI ) said Wednesday that it has received a 1 billion-euro ($1.03 billion) loan from the European Investment Bank to support the company's research, development, and innovation investments. The Dutch semiconductor company said the loan facility has an interest rate of approximately 4.75% when drawn in dollar denominated tranches, and...
US adds 16 entities to its trade blacklist, 14 in China
US adds 16 entities to its trade blacklist, 14 in China
Jan 15, 2025
WASHINGTON (Reuters) - The Biden administration added 16 entities to its trade blacklist on Wednesday, including a Chinese company whose TSMC-made chip was illegally incorporated into a Huawei artificial intelligence processor. Sophgo and other entities linked to it were among 14 China-based companies and two Singapore-based companies added to the U.S. Commerce Department's Entity List, according to a federal government...
Inquiry Into NVIDIA's Competitor Dynamics In Semiconductors & Semiconductor Equipment Industry
Inquiry Into NVIDIA's Competitor Dynamics In Semiconductors & Semiconductor Equipment Industry
Jan 15, 2025
In the dynamic and cutthroat world of business, conducting thorough company analysis is essential for investors and industry experts. In this article, we will undertake a comprehensive industry comparison, evaluating NVIDIA ( NVDA ) and its primary competitors in the Semiconductors & Semiconductor Equipment industry. By closely examining key financial metrics, market position, and growth prospects, our aim is to...
US blacklists company that ordered TSMC chip found in Huawei processor
US blacklists company that ordered TSMC chip found in Huawei processor
Jan 15, 2025
WASHINGTON, Jan 15 (Reuters) - The Biden administration added more than a dozen Chinese entities to its restricted trade list on Wednesday, including a company whose TSMC-made chip was illegally incorporated into a Huawei artificial intelligence processor. Sophgo and other entities linked to it were among 14 China-based companies and two Singapore-based companies added to the U.S. Commerce Department's Entity...
Copyright 2023-2026 - www.financetom.com All Rights Reserved