Artificial intelligence (AI) chips from Qualcomm Inc beat Nvidia Corp in two out of three measures of power efficiency in a new set of test data published on Wednesday, while a Taiwanese start-up bested both in one category.
Nvidia dominates the market for training AI models, but after AI models are trained, they are put to wider use in “inference” by doing tasks such as generating text responses and analyzing images.
Analysts say that the market for data center inference chips would grow quickly as businesses put AI technologies into their products, but companies such as Alphabet Inc’s Google are already exploring how to keep the lid on the extra costs that doing so would add.
Photo: Reuters
Qualcomm has created a chip called the Cloud AI 100 that aims for parsimonious power consumption.
In testing data published on Wednesday by MLCommons, an engineering consortium that maintains testing benchmarks widely used in the AI chip industry, Qualcomm’s AI 100 beat Nvidia’s flagship H100 chip at classifying images, based on how many data center server queries each chip can carry out per watt.
Qualcomm’s chips hit 197.6 server queries per watt versus 108.4 queries per watt for Nvidia.
Neuchips Corp (創鑫智慧), a start-up founded by veteran Taiwanese chip academic Lin Youn-long (林永隆), took the top spot with 227 queries per watt.
Qualcomm also beat Nvidia at object detection with a score of 3.2 queries per watt versus Nvidia’s 2.4 queries per watt.
Object detection can be used in applications such as analyzing footage from retail stores to see where shoppers go most often.
However, Nvidia took the top spot in absolute performance terms and power efficiency terms in a test of natural-language processing, the AI technology most widely used in chatbots.
Nvidia hit 10.8 samples per watt, while Neuchips ranked second at 8.9 samples per watt and Qualcomm was third at 7.5 samples per watt.
Three experts in the high technology industry have said that US President Donald Trump’s pledge to impose higher tariffs on Taiwanese semiconductors is part of an effort to force Taiwan Semiconductor Manufacturing Co (TSMC, 台積電) to the negotiating table. In a speech to Republicans on Jan. 27, Trump said he intends to impose tariffs on Taiwan to bring chip production to the US. “The incentive is going to be they’re not going to want to pay a 25, 50 or even a 100 percent tax,” he said. Darson Chiu (邱達生), an economics professor at Taichung-based Tunghai University and director-general of
Hon Hai Precision Industry Co (鴻海精密) is reportedly making another pass at Nissan Motor Co, as the Japanese automaker's tie-up with Honda Motor Co falls apart. Nissan shares rose as much as 6 percent after Taiwan’s Central News Agency reported that Hon Hai chairman Young Liu (劉揚偉) instructed former Nissan executive Jun Seki to connect with French carmaker Renault SA, which holds about 36 percent of Nissan’s stock. Hon Hai, the Taiwanese iPhone-maker also known as Foxconn Technology Group (富士康科技集團), was exploring an investment or buyout of Nissan last year, but backed off in December after the Japanese carmaker penned a deal
WASHINGTON POLICY: Tariffs of 10 percent or more and other new costs are tipped to hit shipments of small parcels, cutting export growth by 1.3 percentage points The decision by US President Donald Trump to ban Chinese companies from using a US tariff loophole would hit tens of billions of dollars of trade and reduce China’s economic growth this year, according to new estimates by economists at Nomura Holdings Inc. According to Nomura’s estimates, last year companies such as Shein (希音) and PDD Holdings Inc’s (拼多多控股) Temu shipped US$46 billion of small parcels to the US to take advantage of the rule that allows items with a declared value under US$800 to enter the US tariff-free. Tariffs of 10 percent or more and other new costs would slash such
SENSOR BUSINESS: The Taiwanese company said that a public tender offer would begin on May 7 through its wholly owned subsidiary Yageo Electronics Japan Yageo Corp (國巨), one of the world’s top three suppliers of passive components, yesterday said it is to launch a tender offer to fully acquire Japan’s Shibaura Electronics Co for up to ￥65.57 billion (US$429.37 million), with an aim to expand its sensor business. The tender offer would be a crucial step for the company to expand its sensor business, Yageo said. Shibaura Electronics is the world’s largest supplier of thermistors, with a market share of 13 percent, research conducted in 2022 by the Japanese firm showed. If a deal goes ahead, it would be the second acquisition of a sensor business since
RSS