The explosion of generative artificial intelligence (AI) has taken the world by storm, but one question all too rarely comes up: Who can afford it?
OpenAI Inc bled about US$540 million last year as it developed ChatGPT and said it needs US$100 billion to meet its ambitions, according to industry media The Information.
“We’re going to be the most capital-intensive start-up in Silicon Valley history,” OpenAI founder Sam Altman told a panel recently.
Photo: AFP
When Microsoft Corp, which poured billions of dollars in investment into OpenAI, was asked about how much its AI adventure would cost, the company answered with assurances that it is keeping an eye on its bottom line.
Building something even near the scale of what OpenAI, Microsoft or Google have on offer would require an eye-watering investment on state-of-the-art chips and recruiting prize-winning researchers.
“People don’t realize that to do a significant amount of AI things like ChatGPT takes huge amounts of processing power. And training those models can cost tens of millions of dollars,” independent analyst Jack Gold said.
“How many companies can actually afford to go out and buy 10,000 Nvidia H100 systems that go for tens of thousands of dollars a piece?” Gold asked.
The answer is pretty much no one and in tech, if you cannot build the infrastructure, you rent it and that is what companies already do massively by outsourcing their computing needs to Microsoft, Google and Amazon Web Services.
With the advent of generative AI, this dependency on cloud computing and tech giants deepens, leaving the same players in the driver’s seat, experts said.
The unpredictable costs of cloud computing “is a heavily underestimated problem for many companies,” Software AG chief product officer Stefan Sigg said.
Sigg compared cloud costs to electricity bills and said companies that do not know better are in for “a big surprise” if they let their engineers run up bills in the mad rush to build tech, including AI.
Microsoft’s signature cloud offer is Azure and some observers believe the giant’s all-in bet on AI is really about protecting Azure success and guaranteeing the cash cow’s future.
Azure has been the giant’s unsexy bread-winner for years, bringing in huge profits, but without attracting the headlines of an iPhone or social media that go straight to the consumer.
For Microsoft, “the golden goose is monetizing cloud with Azure, because we’re talking about what could be a US$20, US$30, US$40 billion opportunity annually down the road if the AI bet is successful,” Wedbush Securities Inc analyst Dan Ives said.
Microsoft CEO Satya Nadella said that generative AI is “moving fast in the right direction.”
Deeply respected on Wall Street, Nadella would have a six or nine-month grace period to show his bet is a winner, Ives said.
Microsoft acknowledges the risk, but insists that on AI, it must “lead this wave,” chief financial officer Amy Hood told analysts this month.
“We will charge for those AI capabilities, and then ultimately, we’ll deliver operating profit,” she said.
Piling up profit at the company founded by Bill Gates can only mean passing on the cost of AI to customers. From Main Street to Fortune 500, the dependency on the AI-amped would be an expensive one, and companies and investors are drumming up alternatives to at least reduce the bill.
“AI training, GPT training will become a very important cloud service going forward,” Spectro Cloud CEO Tenry Fu said.
His company, like many others in the sector, helps companies optimize cloud technology to reduce expenses.
“But after training, a company will be able to get their model back for real AI application” and the dependence on the cloud giants will hopefully be reduced, he added.
Regulators are hoping that they can keep up and not leave the giants in charge, imposing their terms on smaller companies.
“Law enforcers [must] ensure that ... opportunities and openings for competition ... are not getting squashed out by the incumbents,” US Federal Trade Commission Chairwoman Lina Khan told CNBC.
Semiconductor shares in China surged yesterday after Reuters reported the US had ordered chipmaking giant Taiwan Semiconductor Manufacturing Co (TSMC, 台積電) to halt shipments of advanced chips to Chinese customers, which investors believe could accelerate Beijing’s self-reliance efforts. TSMC yesterday started to suspend shipments of certain sophisticated chips to some Chinese clients after receiving a letter from the US Department of Commerce imposing export restrictions on those products, Reuters reported on Sunday, citing an unnamed source. The US imposed export restrictions on TSMC’s 7-nanometer or more advanced designs, Reuters reported. Investors figured that would encourage authorities to support China’s industry and bought shares
FLEXIBLE: Taiwan can develop its own ground station equipment, and has highly competitive manufacturers and suppliers with diversified production, the MOEA said The Ministry of Economic Affairs (MOEA) yesterday disputed reports that suppliers to US-based Space Exploration Technologies Corp (SpaceX) had been asked to move production out of Taiwan. Reuters had reported on Tuesday last week that Elon Musk-owned SpaceX had asked their manufacturers to produce outside of Taiwan given geopolitical risks and that at least one Taiwanese supplier had been pushed to relocate production to Vietnam. SpaceX’s requests place a renewed focus on the contentious relationship Musk has had with Taiwan, especially after he said last year that Taiwan is an “integral part” of China, sparking sharp criticism from Taiwanese authorities. The ministry said
US President Joe Biden’s administration is racing to complete CHIPS and Science Act agreements with companies such as Intel Corp and Samsung Electronics Co, aiming to shore up one of its signature initiatives before US president-elect Donald Trump enters the White House. The US Department of Commerce has allocated more than 90 percent of the US$39 billion in grants under the act, a landmark law enacted in 2022 designed to rebuild the domestic chip industry. However, the agency has only announced one binding agreement so far. The next two months would prove critical for more than 20 companies still in the process
CHANGING JAPAN: Nvidia-powered AI services over cellular networks ‘will result in an artificial intelligence grid that runs across Japan,’ Nvidia’s Jensen Huang said Softbank Group Corp would be the first to build a supercomputer with chips using Nvidia Corp’s new Blackwell design, a demonstration of the Japanese company’s ambitions to catch up on artificial intelligence (AI). The group’s telecom unit, Softbank Corp, plans to build Japan’s most powerful AI supercomputer to support local services, it said. That computer would be based on Nvidia’s DGX B200 product, which combines computer processors with so-called AI accelerator chips. A follow-up effort will feature Grace Blackwell, a more advanced version, the company said. The announcement indicates that Softbank Group, which until early 2019 owned 4.9 percent of Nvidia, has secured a
RSS