For a few days, artificial intelligence (AI) chip juggernaut Nvidia Corp sat on the throne as the world’s biggest company, but behind its staggering success are questions on whether new entrants can stake a claim to the AI bonanza.
Nvidia, which makes the processors that are the only option to train generative AI’s large language models, is now big tech’s newest member and its stock market takeoff has lifted the whole sector.
Even tech’s second rung on Wall Street has ridden on Nvidia’s coattails, with Oracle Corp, Broadcom Inc, HP Inc and a spate of others seeing their stock valuations surge, despite sometimes shaky earnings.
Photo: AFP
Amid the champagne popping, start-ups seeking the attention of Silicon Valley venture capitalists are being asked to innovate — but without a clear indication of where the next chapter of AI would be written.
When it comes to generative AI, doubts persist on what exactly would be left for companies that are not existing model makers, a field dominated by Microsoft Corp-backed OpenAI, Google and Anthropic PBC.
Most agree that competing with them head-on could be a fool’s errand.
“I don’t think that there’s a great opportunity to start a foundational AI company at this point in time,” Quiq founder and CEO Mike Myer said at the Collision technology conference in Toronto last week.
Some have tried to build applications that use or mimic the powers of the existing big models, but this is being slapped down by Silicon Valley’s biggest players.
“What I find disturbing is that people are not differentiating between those applications, which are roadkill for the models as they progress in their capabilities, and those that are really adding value and will be here 10 years from now,” venture capitalist Vinod Khosla said.
The tough-talking Khosla is one of OpenAI’s earliest investors.
Companies which only put a “thin wrapper” around what the AI models can offer are doomed, he said.
One of the fields ripe for the taking is chip design, with AI demanding more specialized processors that provide highly specific powers, Khosla said.
“If you look across chip history, we really have, for the most, part focused on more general chips,” tech consultancy Thoughtworks Inc chief technology officer Rebecca Parsons told AFP.
Providing more specialized processing for the many demands of AI is an opportunity that has been seized by Groq Inc, a start-up that has built chips for the deployment of AI, as opposed to its training or inference — the specialty of Nvidia’s world-dominating GPUs.
Nvidia would not be the best at everything, even if they are uncontested for generative AI training, Groq CEO Jonathan Ross told AFP.
“Nvidia and [its CEO] Jensen Huang (黃仁勳) are like Michael Jordan... the greatest of all time in basketball. But inference is baseball, and we try and forget the time where Michael Jordan tried to play baseball and wasn’t very good at it,” he said.
Another opportunity would come from highly specialized AI that would provide expertise and knowhow based on proprietary data, which would not be co-opted by voracious big tech.
“Open AI and Google aren’t going to build a structural engineer. They’re not going to build products like a primary care doctor or a mental health therapist,” Khosla said.
Profiting from highly specialized data is the basis of Cohere Inc, another of Silicon Valley’s hottest start-ups, which pitches specifically-made models to businesses that are skittish about AI veering out of their control.
“Enterprises are skeptical of technology, and they’re risk-averse, and so we need to win their trust and to prove to them that there’s a way to adopt this technology that’s reliable, trustworthy and secure,” Cohere CEO Aidan Gomez told AFP.
Cohere has received funding from Nvidia and Salesforce Ventures LLC, and is valued in the billions of dollars.
Semiconductor shares in China surged yesterday after Reuters reported the US had ordered chipmaking giant Taiwan Semiconductor Manufacturing Co (TSMC, 台積電) to halt shipments of advanced chips to Chinese customers, which investors believe could accelerate Beijing’s self-reliance efforts. TSMC yesterday started to suspend shipments of certain sophisticated chips to some Chinese clients after receiving a letter from the US Department of Commerce imposing export restrictions on those products, Reuters reported on Sunday, citing an unnamed source. The US imposed export restrictions on TSMC’s 7-nanometer or more advanced designs, Reuters reported. Investors figured that would encourage authorities to support China’s industry and bought shares
TECH WAR CONTINUES: The suspension of TSMC AI chips and GPUs would be a heavy blow to China’s chip designers and would affect its competitive edge Taiwan Semiconductor Manufacturing Co (TSMC, 台積電), the world’s biggest contract chipmaker, is reportedly to halt supply of artificial intelligence (AI) chips and graphics processing units (GPUs) made on 7-nanometer or more advanced process technologies from next week in order to comply with US Department of Commerce rules. TSMC has sent e-mails to its Chinese AI customers, informing them about the suspension starting on Monday, Chinese online news outlet Ijiwei.com (愛集微) reported yesterday. The US Department of Commerce has not formally unveiled further semiconductor measures against China yet. “TSMC does not comment on market rumors. TSMC is a law-abiding company and we are
FLEXIBLE: Taiwan can develop its own ground station equipment, and has highly competitive manufacturers and suppliers with diversified production, the MOEA said The Ministry of Economic Affairs (MOEA) yesterday disputed reports that suppliers to US-based Space Exploration Technologies Corp (SpaceX) had been asked to move production out of Taiwan. Reuters had reported on Tuesday last week that Elon Musk-owned SpaceX had asked their manufacturers to produce outside of Taiwan given geopolitical risks and that at least one Taiwanese supplier had been pushed to relocate production to Vietnam. SpaceX’s requests place a renewed focus on the contentious relationship Musk has had with Taiwan, especially after he said last year that Taiwan is an “integral part” of China, sparking sharp criticism from Taiwanese authorities. The ministry said
US President Joe Biden’s administration is racing to complete CHIPS and Science Act agreements with companies such as Intel Corp and Samsung Electronics Co, aiming to shore up one of its signature initiatives before US president-elect Donald Trump enters the White House. The US Department of Commerce has allocated more than 90 percent of the US$39 billion in grants under the act, a landmark law enacted in 2022 designed to rebuild the domestic chip industry. However, the agency has only announced one binding agreement so far. The next two months would prove critical for more than 20 companies still in the process