OpenAI is working with Broadcom Inc to develop a new artificial intelligence (AI) chip specifically focused on running AI models after they have been trained, according to two sources familiar with the matter.
The AI start-up and chipmaker are also consulting with Taiwan Semiconductor Manufacturing Co (TSMC, 台積電), the world’s largest chip contract manufacturer, said the sources, who asked not to be identified because the discussions are private.
OpenAI has been planning a custom chip and working on such uses for the technology for about a year, but the discussions are still at an early stage, the sources said.
Photo: Reuters
OpenAI declined to comment. A representative for Broadcom did not respond to a request for comment, and a TSMC spokesperson said the company does not comment on rumors and speculation. Reuters reported on OpenAI’s ongoing talks with Broadcom and TSMC on Tuesday. The Information reported in June that Broadcom had discussed making an AI chip for OpenAI.
The process for taking a chip from design to production is long and expensive. OpenAI is less focused on graphics processing units, chips that are used to train and build generative AI models — a market that has been cornered by Nvidia Corp.
Instead, it is looking for a specialized chip that would run the software and respond to user requests, a process called inference. Investors and analysts expect the need for chips to support inference would only grow as more tech companies use AI models to field more complex tasks.
OpenAI might continue to research setting up its own network of foundries, or chip factories, one of the sources said, but the start-up has realized that working with partners on custom chips is a quicker, attainable path for now. Reuters earlier reported that OpenAI was pulling back from the effort of establishing its own chip manufacturing capacity.
Broadcom is the largest designer of application-specific integrated circuits — chips designed to fit a single purpose specified by the customer. The company’s biggest customer in this area is Alphabet Inc’s Google. Broadcom also works with Meta Platforms Inc and TikTok owner ByteDance Ltd (字節跳動).
When asked last month whether he has new customers for the business, given the huge demand for AI training, Broadcom chief executive officer Hock Tan (陳福陽) said that he would only add to his short list of customers when projects hit volume shipments.
“It’s not an easy product to deploy for any customer, and so we do not consider proof of concepts as production volume,” he said during an earnings conference call on Sept. 5.
OpenAI’s services require massive amounts of computing power to develop and run — with much of that coming from Nvidia chips. To meet the demand, the industry has been scrambling to find alternatives to Nvidia. That has included embracing processors from Advanced Micro Devices Inc and developing in-house versions.
US SANCTIONS: The Taiwan tech giant has ended all shipments to China-based Sophgo Technologies after one of their chips was discovered in a Huawei phone Taiwan Semiconductor Manufacturing Co (TSMC, 台積電) suspended shipments to China-based chip designer Sophgo Technologies Ltd (算能科技) after a chip it made was found on a Huawei Technologies Co (華為) artificial intelligence (AI) processor, according to two people familiar with the matter. Sophgo had ordered chips from TSMC that matched the one found on Huawei’s Ascend 910B, the people said. Huawei is restricted from buying the technology to protect US national security. Reuters could not determine how the chip ended up on the Huawei product. Sophgo said in a statement on its Web site yesterday that it was in compliance with all laws
TECH TITANS: Nvidia briefly overtook Apple again on Friday after becoming the world’s largest company for a short period in June, as Microsoft fell to third place Nvidia Corp dethroned Apple Inc as the world’s most valuable company on Friday following a record-setting rally in the stock, powered by insatiable demand for its specialized artificial intelligence (AI) chips. Nvidia’s stock market value briefly touched US$3.53 trillion, slightly above Apple’s US$3.52 trillion, London Stock Exchange Group data showed. Nvidia ended the day up 0.8 percent, with a market value of US$3.47 trillion, while Apple’s shares rose 0.4 percent, valuing the iPhone maker at US$3.52 trillion. In June, Nvidia briefly became the world’s most valuable company before it was overtaken by Microsoft Corp and Apple. The tech trio’s market capitalizations have been
Shares of Starlux Airlines Co (星宇航空) surged more than 53 percent on its debut on the Taiwan stock exchange yesterday. Starlux shares closed up 53.75 percent at NT$30.75 from its initial public offering price of NT$20 after retreating in late trading from a 60 percent rise. China Airlines Ltd (CAL, 中華航空) rose 0.90 percent to close at NT$22.35, while EVA Airways Corp (長榮航空) gained 0.40 percent to close at NT$37.70. In Taiwan, a newly listed stock is allowed to go beyond the 10 percent maximum increase or decline in its first five trading sessions. At the listing ceremony, Starlux chairman Chang Kuo-wei (張國煒) said
SPEED OF LIGHT: US lawmakers urged the commerce department to examine the national security threats from China’s development of silicon photonics technology US President Joe Biden’s administration on Monday said it is finalizing rules that would limit US investments in artificial intelligence (AI) and other technology sectors in China that could threaten US national security. The rules, which were proposed in June by the US Department of the Treasury, were directed by an executive order signed by Biden in August last year covering three key sectors: semiconductors and microelectronics, quantum information technologies and certain AI systems. The rules are to take effect on Jan. 2 next year and would be overseen by the Treasury’s newly created Office of Global Transactions. The Treasury said the “narrow
RSS