Ever since poem-churning ChatGPT burst on the scene six months ago, expert Gary Marcus has voiced caution against artificial intelligence’s (AI) ultra-fast development and adoption.
However, against AI’s apocalyptic doomsayers, the New York University emeritus professor said in an interview that the technology’s existential threats could be “overblown.”
“I’m not personally that concerned about extinction risk, at least for now, because the scenarios are not that concrete,” Marcus said in San Francisco.
Photo: Reuters
“A more general problem that I am worried about ... is that we’re building AI systems that we don’t have very good control over and I think that poses a lot of risks, [but] maybe not literally existential,” he said.
Long before the advent of ChatGPT, Marcus designed his first AI program in high school — software to translate Latin into English — and after years of studying child psychology, he founded Geometric Intelligence, a machine learning company later acquired by Uber Technologies Inc.
In March, alarmed that ChatGPT creator OpenAI was releasing its latest and more powerful AI model with Microsoft Corp, Marcus signed an open letter with more than 1,000 people including Tesla Inc chief executive officer Elon Musk calling for a global pause in AI development.
However, last week he did not sign the more succinct statement by business leaders and specialists — including OpenAI founder Sam Altman — that caused a stir.
Global leaders should be working to reduce “the risk of extinction” from AI technology, the signatories said.
The one-line statement said that tackling the risks from AI should be “a global priority alongside other societal-scale risks such as pandemics and nuclear war.”
Signatories included those who are building systems with a view to achieving “general” AI, a technology that would hold the cognitive abilities on par with those of humans.
“If you really think there’s existential risk, why are you working on this at all? That’s a pretty fair question to ask,” Marcus said.
Instead of putting the focus on more far-fetched scenarios in which no one survives, society should be paying attention to where real dangers lie, Marcus said.
“People might try to manipulate the markets by using AI to cause all kinds of mayhem and then we might, for example, blame the Russians and say: ‘Look what they’ve done to our country,’ when the Russians actually weren’t involved,” he said.
“You [could] have this escalation that winds up in nuclear war or something like that. So I think there are scenarios where it was pretty serious. Extinction? I don’t know,” he said.
In the short term, Marcus is worried about democracy.
Generative AI software produces increasingly convincing fake photographs, and could soon produce videos, at little cost.
“Elections are going to be won by people who are better at spreading disinformation, and those people may change the rules and make it really difficult to have democracy proceed,” he said. “Democracy is premised on having reasonable information and making good decisions. If nobody knows what to believe, then how do you even proceed with democracy?”
The author of the book Rebooting AI does not think hope should be abandoned, as there is still "a lot of upside."
There is a chance that AI not yet invented could "help with science, with medicine, with elder care," Marcus said.
"But in the short term, I feel like we're just not ready. There's going to be some harm along the way and we really need to up our game, we have to figure out serious regulation," he said.
At a US Senate hearing last month, seated beside Altman, Marcus argued for the creation of a national or international agency responsible for AI governance.
The idea is backed by Altman, who has returned from a European tour in which he urged political leaders to find the "right balance" between safety and innovation.
However, beware of leaving the power to corporations, Marcus said.
"The last several months have been a real reminder that the big companies calling the shots here are not necessarily interested in the rest of us," he said.
Semiconductor shares in China surged yesterday after Reuters reported the US had ordered chipmaking giant Taiwan Semiconductor Manufacturing Co (TSMC, 台積電) to halt shipments of advanced chips to Chinese customers, which investors believe could accelerate Beijing’s self-reliance efforts. TSMC yesterday started to suspend shipments of certain sophisticated chips to some Chinese clients after receiving a letter from the US Department of Commerce imposing export restrictions on those products, Reuters reported on Sunday, citing an unnamed source. The US imposed export restrictions on TSMC’s 7-nanometer or more advanced designs, Reuters reported. Investors figured that would encourage authorities to support China’s industry and bought shares
FLEXIBLE: Taiwan can develop its own ground station equipment, and has highly competitive manufacturers and suppliers with diversified production, the MOEA said The Ministry of Economic Affairs (MOEA) yesterday disputed reports that suppliers to US-based Space Exploration Technologies Corp (SpaceX) had been asked to move production out of Taiwan. Reuters had reported on Tuesday last week that Elon Musk-owned SpaceX had asked their manufacturers to produce outside of Taiwan given geopolitical risks and that at least one Taiwanese supplier had been pushed to relocate production to Vietnam. SpaceX’s requests place a renewed focus on the contentious relationship Musk has had with Taiwan, especially after he said last year that Taiwan is an “integral part” of China, sparking sharp criticism from Taiwanese authorities. The ministry said
US President Joe Biden’s administration is racing to complete CHIPS and Science Act agreements with companies such as Intel Corp and Samsung Electronics Co, aiming to shore up one of its signature initiatives before US president-elect Donald Trump enters the White House. The US Department of Commerce has allocated more than 90 percent of the US$39 billion in grants under the act, a landmark law enacted in 2022 designed to rebuild the domestic chip industry. However, the agency has only announced one binding agreement so far. The next two months would prove critical for more than 20 companies still in the process
CHANGING JAPAN: Nvidia-powered AI services over cellular networks ‘will result in an artificial intelligence grid that runs across Japan,’ Nvidia’s Jensen Huang said Softbank Group Corp would be the first to build a supercomputer with chips using Nvidia Corp’s new Blackwell design, a demonstration of the Japanese company’s ambitions to catch up on artificial intelligence (AI). The group’s telecom unit, Softbank Corp, plans to build Japan’s most powerful AI supercomputer to support local services, it said. That computer would be based on Nvidia’s DGX B200 product, which combines computer processors with so-called AI accelerator chips. A follow-up effort will feature Grace Blackwell, a more advanced version, the company said. The announcement indicates that Softbank Group, which until early 2019 owned 4.9 percent of Nvidia, has secured a