Asustek Computer Inc (華碩電腦) plans to introduce one of the first services that lets companies tap into the potential of generative artificial intelligence (AI) while keeping control over their data.
The novelty of the Taipei-based firm’s offering, called AFS Appliance, is that all of the hardware would be installed in the client’s own facilities — to maintain security and control.
The AI computational platform, built on Nvidia’s chip technology, would be operated and updated with new data by Asustek.
Photo: Sam Yeh, AFP
A major concern around services such as OpenAI is that they are operated through online data centers that can expose sensitive information. Samsung Electronics Co banned employees from using OpenAI’s ChatGPT after it found workers had uploaded sensitive code to the platform.
Asustek is to preload the AFS hardware with its own large language model, called Formosa, which it says is equivalent to ChatGPT 3.5 and trained in traditional Chinese.
The company aims to price the service at about US$6,000 per month, Asus Cloud Corp (華碩雲端) and Taiwan Web Service Corp (台智雲) president Peter Wu (吳漢章) said in an interview on Monday.
The highest-spec offering, which adds an Nvidia DGX AI supercomputer platform, would cost about US$10,000 a month, he said.
Wu aims to have 30 to 50 enterprise customers in Taiwan and expand internationally by the end of this year.
“Nvidia is a partner with us to accelerate the enterprise adoption of this technology,” Wu said. “Before ChatGPT, the enterprises were not aware of why they need so much computing power.”
Most businesses would deploy generative AI on their own premises due to sensitivity about access to their proprietary data, Wu said.
“They need a smart brain to be under their own control and management, as it will touch on the most sensitive data,” he said.
Recently returning from a trip to Singapore, Wu says he sees a lot of interest from banks and hospitals. In the clinical context, generative AI would help doctors document treatments and patients visits quicker, while also helping communicate diagnoses in more relatable language to patients.
There is no supply shortage of Nvidia’s A100 chips, which run the AFS Appliance, Wu said, and the existing partnership between the companies is helping ensure that Asustek would have all the firepower it needs to roll out its new offering.
Semiconductor shares in China surged yesterday after Reuters reported the US had ordered chipmaking giant Taiwan Semiconductor Manufacturing Co (TSMC, 台積電) to halt shipments of advanced chips to Chinese customers, which investors believe could accelerate Beijing’s self-reliance efforts. TSMC yesterday started to suspend shipments of certain sophisticated chips to some Chinese clients after receiving a letter from the US Department of Commerce imposing export restrictions on those products, Reuters reported on Sunday, citing an unnamed source. The US imposed export restrictions on TSMC’s 7-nanometer or more advanced designs, Reuters reported. Investors figured that would encourage authorities to support China’s industry and bought shares
TECH WAR CONTINUES: The suspension of TSMC AI chips and GPUs would be a heavy blow to China’s chip designers and would affect its competitive edge Taiwan Semiconductor Manufacturing Co (TSMC, 台積電), the world’s biggest contract chipmaker, is reportedly to halt supply of artificial intelligence (AI) chips and graphics processing units (GPUs) made on 7-nanometer or more advanced process technologies from next week in order to comply with US Department of Commerce rules. TSMC has sent e-mails to its Chinese AI customers, informing them about the suspension starting on Monday, Chinese online news outlet Ijiwei.com (愛集微) reported yesterday. The US Department of Commerce has not formally unveiled further semiconductor measures against China yet. “TSMC does not comment on market rumors. TSMC is a law-abiding company and we are
FLEXIBLE: Taiwan can develop its own ground station equipment, and has highly competitive manufacturers and suppliers with diversified production, the MOEA said The Ministry of Economic Affairs (MOEA) yesterday disputed reports that suppliers to US-based Space Exploration Technologies Corp (SpaceX) had been asked to move production out of Taiwan. Reuters had reported on Tuesday last week that Elon Musk-owned SpaceX had asked their manufacturers to produce outside of Taiwan given geopolitical risks and that at least one Taiwanese supplier had been pushed to relocate production to Vietnam. SpaceX’s requests place a renewed focus on the contentious relationship Musk has had with Taiwan, especially after he said last year that Taiwan is an “integral part” of China, sparking sharp criticism from Taiwanese authorities. The ministry said
US President Joe Biden’s administration is racing to complete CHIPS and Science Act agreements with companies such as Intel Corp and Samsung Electronics Co, aiming to shore up one of its signature initiatives before US president-elect Donald Trump enters the White House. The US Department of Commerce has allocated more than 90 percent of the US$39 billion in grants under the act, a landmark law enacted in 2022 designed to rebuild the domestic chip industry. However, the agency has only announced one binding agreement so far. The next two months would prove critical for more than 20 companies still in the process
RSS