financetom
Technology
financetom
/
Technology
/
New AI benchmark tests speed of responses to user queries
News World Market Environment Technology Personal Finance Politics Retail Business Economy Cryptocurrency Forex Stocks Market Commodities
New AI benchmark tests speed of responses to user queries
Mar 27, 2024 8:28 AM

SAN FRANCISCO (Reuters) - Artificial intelligence benchmarking group MLCommons on Wednesday released a fresh set of tests and results that rate the speed at which top-of-the-line hardware can run AI applications and respond to users.

The two new benchmarks added by MLCommons measure the speed at which the AI chips and systems can generate responses from the powerful AI models packed with data. The results roughly demonstrate to how quickly an AI application such as ChatGPT can deliver a response to a user query.

One of the new benchmarks added the capability to measure the speediness of a question-and-answer scenario for large language models. Called Llama 2, it includes 70 billion parameters and was developed by Meta Platforms ( META ).

MLCommons officials also added a second text-to-image generator to the suite of benchmarking tools, called MLPerf, based on Stability AI's Stable Diffusion XL model.

Servers powered by Nvidia's ( NVDA ) H100 chips built by the likes of Alphabet's Google, Supermicro and Nvidia ( NVDA ) itself handily won both new benchmarks on raw performance. Several server builders submitted designs based on the company's less powerful L40S chip.

Server builder Krai submitted a design for the image generation benchmark with a Qualcomm AI chip that draws significant less power than Nvidia's ( NVDA ) cutting edge processors.

Intel ( INTC ) also submitted a design based on its Gaudi2 accelerator chips. The company described the results as "solid."

Raw performance is not the only measure that is critical when deploying AI applications. Advanced AI chips suck up enormous amounts of energy and one of the most significant challenges for AI companies is deploying chip that deliver an optimal amount of performance for a minimal amount of energy.

MLCommons has a separate benchmark category for measuring power consumption.

Comments
Welcome to financetom comments! Please keep conversations courteous and on-topic. To fosterproductive and respectful conversations, you may see comments from our Community Managers.
Sign up to post
Sort by
Show More Comments
Related Articles >
AIOZ Network Partners With Alibaba Cloud to Boost AI, Storage and Streaming Services
AIOZ Network Partners With Alibaba Cloud to Boost AI, Storage and Streaming Services
Mar 22, 2024
The two companies will establish a DePIN alliance in south-east Asia.AIOZ's native token is currently trading flat after the announcement, it is up by more than 200% in 30 days.AIOZ Network will use Alibaba Cloud to improve Web 3, AI, storage and streaming services.Decentralized infrastructure network (DePIN) AIOZ Network has become the leading blockchain partner in Alibaba Cloud’s Innovation Accelerator...
Deep Dive Into Confluent Stock: Analyst Perspectives (17 Ratings)
Deep Dive Into Confluent Stock: Analyst Perspectives (17 Ratings)
Mar 22, 2024
In the preceding three months, 17 analysts have released ratings for Confluent , presenting a wide array of perspectives from bullish to bearish. The following table summarizes their recent ratings, shedding light on the changing sentiments within the past 30 days and comparing them to the preceding months. Bullish Somewhat Bullish Indifferent Somewhat Bearish Bearish Total Ratings 7 5 5...
The Analyst Landscape: 7 Takes On Clear Secure
The Analyst Landscape: 7 Takes On Clear Secure
Mar 22, 2024
Analysts' ratings for Clear Secure ( YOU ) over the last quarter vary from bullish to bearish, as provided by 7 analysts. The table below provides a concise overview of recent ratings by analysts, offering insights into the changing sentiments over the past 30 days and drawing comparisons with the preceding months for a holistic perspective. Bullish Somewhat Bullish Indifferent...
Analysis-Apple antitrust suit mirrors strategy that beat Microsoft, but tech industry has changed
Analysis-Apple antitrust suit mirrors strategy that beat Microsoft, but tech industry has changed
Mar 22, 2024
(Reuters) - The U.S. government's antitrust lawsuit against Apple ( AAPL ) draws on the watershed 1998 case that broke Microsoft's ( MSFT ) stranglehold on desktop software, but that may prove to be an imperfect blueprint for addressing smartphone competition. The market for the iPhone today looks very different from the near-monopoly enjoyed by Microsoft's ( MSFT ) Windows...
Copyright 2023-2025 - www.financetom.com All Rights Reserved