financetom
Technology
financetom
/
Technology
/
New AI benchmark tests speed of responses to user queries
News World Market Environment Technology Personal Finance Politics Retail Business Economy Cryptocurrency Forex Stocks Market Commodities
New AI benchmark tests speed of responses to user queries
Mar 27, 2024 8:28 AM

SAN FRANCISCO (Reuters) - Artificial intelligence benchmarking group MLCommons on Wednesday released a fresh set of tests and results that rate the speed at which top-of-the-line hardware can run AI applications and respond to users.

The two new benchmarks added by MLCommons measure the speed at which the AI chips and systems can generate responses from the powerful AI models packed with data. The results roughly demonstrate to how quickly an AI application such as ChatGPT can deliver a response to a user query.

One of the new benchmarks added the capability to measure the speediness of a question-and-answer scenario for large language models. Called Llama 2, it includes 70 billion parameters and was developed by Meta Platforms ( META ).

MLCommons officials also added a second text-to-image generator to the suite of benchmarking tools, called MLPerf, based on Stability AI's Stable Diffusion XL model.

Servers powered by Nvidia's ( NVDA ) H100 chips built by the likes of Alphabet's Google, Supermicro and Nvidia ( NVDA ) itself handily won both new benchmarks on raw performance. Several server builders submitted designs based on the company's less powerful L40S chip.

Server builder Krai submitted a design for the image generation benchmark with a Qualcomm AI chip that draws significant less power than Nvidia's ( NVDA ) cutting edge processors.

Intel ( INTC ) also submitted a design based on its Gaudi2 accelerator chips. The company described the results as "solid."

Raw performance is not the only measure that is critical when deploying AI applications. Advanced AI chips suck up enormous amounts of energy and one of the most significant challenges for AI companies is deploying chip that deliver an optimal amount of performance for a minimal amount of energy.

MLCommons has a separate benchmark category for measuring power consumption.

Comments
Welcome to financetom comments! Please keep conversations courteous and on-topic. To fosterproductive and respectful conversations, you may see comments from our Community Managers.
Sign up to post
Sort by
Show More Comments
Related Articles >
Aehr Test Systems to Announce Third Quarter Fiscal 2026 Financial Results on April 7, 2026
Aehr Test Systems to Announce Third Quarter Fiscal 2026 Financial Results on April 7, 2026
Mar 30, 2026
FREMONT, CA / ACCESS Newswire / March 30, 2026 / Aehr Test Systems ( AEHR ) , a leading provider of test and burn-in solutions for semiconductor devices used in artificial intelligence (AI), data center, automotive, and industrial applications, today announced that it will report financial results for its third quarter of fiscal 2026 ended February 27, 2026 on Tuesday,...
BTQ Technologies to Host Live Webinar on 2025 Financial Results and General Corporate Update
BTQ Technologies to Host Live Webinar on 2025 Financial Results and General Corporate Update
Mar 30, 2026
VANCOUVER, BC, March 30, 2026 /PRNewswire/ - BTQ Technologies Corp. ( BTQ ) (BTQ or the Company) , a global quantum technology company focused on securing mission-critical networks, is pleased to announce that it will hold a shareholder call on Tuesday, March 31, 2026, at 12:00 p.m. EST to discuss its 2025 financial results and provide a general corporate update. The...
PMGC Holdings Inc. [NASDAQ: ELAB] Reports 2025 Annual Results and Files Form 10-K, Company Expands Asset Base to $13.8M, a 43% Increase from 2024
PMGC Holdings Inc. [NASDAQ: ELAB] Reports 2025 Annual Results and Files Form 10-K, Company Expands Asset Base to $13.8M, a 43% Increase from 2024
Mar 30, 2026
Deploys Capital into Cash-Flowing Manufacturing Businesses in Aerospace, Defense and IT PackagingAdvances Dual Myostatin Assets Targeting Muscle Preservation in Potential Combination with GLP-1 Treatments NEWPORT BEACH, Calif., March 30, 2026 (GLOBE NEWSWIRE) -- PMGC Holdings Inc. ( ELAB ) (“the Company,” “PMGC,” “we,” or “our”) today filed its Annual Report on Form 10-K (“Annual Report”) for the fiscal year ended...
NuRAN Wireless Files Nasdaq Listing Application and Appoints Navindran Naidoo and Gerard Lokossou as Strategic Advisors for Operational and Commercial Growth
NuRAN Wireless Files Nasdaq Listing Application and Appoints Navindran Naidoo and Gerard Lokossou as Strategic Advisors for Operational and Commercial Growth
Mar 30, 2026
QUEBEC, QC / ACCESS Newswire / March 30, 2026 / NuRAN Wireless Inc. ( NRRWF ) (NuRAN or the Company) (CSE:NUR)(OTC:NRRWF)(FSE:1RN), a leading supplier of mobile and broadband wireless infrastructure solutions, is pleased to announce that it has submitted an application to list its common shares on the Nasdaq Capital Market (Nasdaq). In advance of the listing on Nasdaq, the...
Copyright 2023-2026 - www.financetom.com All Rights Reserved