As deadly as the COVID-19 pandemic was, the next one could be more nightmarish. Powerful new artificial intelligence (AI) models, combined with novel lab tools, could soon enable rogue scientists or states to engineer a pathogen that would spread faster, resist vaccines better and kill more people than COVID-19 did. Governments, technology companies and scientific researchers should act now to lower the risk.
Nature has always had the ability to concoct nasty pathogens, from the plague to the Spanish Flu. For many decades, so have humans: The Japanese conducted brutal biological warfare experiments in World War II, and the US and the Soviet Union stockpiled toxins during the Cold War, with the latter’s program continuing even after signing the Biological Weapons Convention in 1972. The Pentagon thinks Russia and North Korea continue to develop bioweapons.
However, such efforts have traditionally been limited by the number of scientists trained to conduct the necessary research and the tools available for producing and distributing effective weapons. Technology is breaking down both barriers.
Large language models (LLMs) such as OpenAI Inc’s ChatGPT can synthesize vast amounts of knowledge rapidly: In one experiment, a chatbot advised a group of Massachusetts Institute of Technology students about how to engineer four potentially deadly pathogens and where to procure the necessary DNA without detection — in an hour.
More specific AI programs trained on biological data, known as biological design tools, are even more powerful. Over time, such programs could speed the development of entirely new pathogens with deadly properties, perhaps even the ability to target specific populations. Emerging technologies — from “benchtop” synthesizers that would allow individual researchers to create their own strands of DNA, to so-called cloud labs where experiments can be conducted remotely using robots and automated instruments — would lower other hurdles to testing and producing potential weapons.
It is worth noting that the barriers to producing and distributing a workable weapon remain quite high. However, scientists say that could change in a few years, given how fast all these technologies are progressing. The time to act is now, before they reach maturity. A series of interventions would help.
Begin with the AI models. Some US developers of the most powerful LLMs are voluntarily submitting them to the government for further evaluation. That is welcome, but more scrutiny might be warranted for the riskiest models — those trained on sensitive biological data. Congress should work with AI developers and scientists to develop criteria for which models might require formal screening and what guardrails could be included in those found to pose the highest risks. While legislators should stay narrowly focused for now, stricter oversight might be warranted as the technology progresses.
The next task is to prevent any AI-designed viruses from entering the real world. Providers of synthetic nucleic acids should be required to know their customers and screen orders for suspicious DNA sequences. All requests should be logged, so new pathogens can be traced back if they are released into the wild. Controls should also be built into benchtop synthesizers, while cloud labs should scrutinize customers and requests. Risky experiments should always have a human in the loop.
The US should press other countries to adopt similar safeguards, so rogue actors cannot simply seek out less scrupulous providers elsewhere. If the Biological Weapons Convention cannot be toughened, because of diplomatic frictions, like-minded countries should at least agree on a set of best practices, as they have begun to do with AI.
Above all, countries ought to harden their pandemic defenses so that anyone who manages to exploit loopholes in the system cannot cause extensive damage. AI itself could boost the ability of governments to detect the emergence of new pathogens, not to mention speed the development of vaccines, and the production and distribution of personal protective equipment. Stronger public health systems are critical, whether new viruses are produced by terrorists, rogue states, accidents or nature.
COVID-19 exposed huge gaps in those defenses, too many of which remain unfilled. Governments have every incentive to head off this new threat while there is still time.
The Editorial Board publishes the views of the editors across a range of national and global affairs.
In an article published in Newsweek on Monday last week, President William Lai (賴清德) challenged China to retake territories it lost to Russia in the 19th century rather than invade Taiwan. “If it is really for the sake of territorial integrity, why doesn’t China take back Russia?” Lai asked, referring to territories lost in 1858 and 1860. The territories once made up the two flanks of northern Manchuria. Once ceded to Russia, they became part of the Russian far east. Claims since then have been made that China and Russia settled the disputes in the 1990s through the 2000s and that “China
Trips to the Kenting Peninsula in Pingtung County have dredged up a lot of public debate and furor, with many complaints about how expensive and unreasonable lodging is. Some people even call it a tourist “butchering ground.” Many local business owners stake claims to beach areas by setting up parasols and driving away people who do not rent them. The managing authority for the area — Kenting National Park — has long ignored the issue. Ultimately, this has affected the willingness of domestic travelers to go there, causing tourist numbers to plummet. In 2008, Taiwan opened the door to Chinese tourists and in
Taiwan People’s Party (TPP) Chairman Ko Wen-je (柯文哲) on Thursday was handcuffed and escorted by police to the Taipei Detention Center, after the Taipei District Court ordered that he be detained and held incommunicado for suspected corruption during his tenure as Taipei mayor. The ruling reversed an earlier decision by the same court on Monday last week that ordered Ko’s release without bail. That decision was appealed by prosecutors on Wednesday, leading the High Court to conclude that Ko had been “actively involved” in the alleged corruption and it ordered the district court to hold a second detention hearing. Video clips
Taiwan People’s Party (TPP) Chairman Ko Wen-je’s (柯文哲) arrest is a significant development. He could have become president or vice president on a shared TPP-Chinese Nationalist Party (KMT) ticket and could have stood again in 2028. If he is found guilty, there would be little chance of that, but what of his party? What about the third force in Taiwanese politics? What does this mean for the disenfranchised young people who he attracted, and what does it mean for his ambitious and ideologically fickle right-hand man, TPP caucus leader Huang Kuo-chang (黃國昌)? Ko and Huang have been appealing to that