Her voice tinged with anger, an American mother worried about what the future holds for her teenage daughter, just one of dozens of girls targeted in yet another artificial intelligence (AI)-enabled pornography scandal that has rocked a US school.
The controversy that engulfed the Lancaster Country Day School in Pennsylvania last year highlights a new normal for pupils and educators struggling to keep up with a boom in cheap, easily available AI tools that have facilitated hyperrealistic deepfakes. One parent, who spoke to Agence France-Presse (AFP) on the condition of anonymity, said her 14-year-old daughter came to her “hysterically crying” last summer after finding AI-generated nude pictures of her circulating among her peers.
“What are the ramifications to her long term?” the mother said, voicing fears that the manipulated images could resurface when her daughter applies to college, starts dating or enters the job market.
Photo: AFP
“You can’t tell that they are fake,” she said.
Multiple charges — including sexual abuse of children and possession of child pornography — were filed last month against two teenage boys who authorities allege created the images.
Investigators uncovered 347 images and videos affecting a total of 60 victims, most of them female students at the private school, on the messaging app Discord.
All but one was younger than 18.
The scandal is the latest in a wave of similar incidents in schools across US states — from California to New Jersey — leading to a warning from the FBI last year that such child sexual abuse material, including realistic AI-generated images, was illegal.
“The rise of generative AI has collided with a long-standing problem in schools: the act of sharing non-consensual intimate imagery,” said Alexandra Reeve Givens, chief executive of the nonprofit Center for Democracy & Technology (CDT).
“In the digital age, kids desperately need support to navigate tech-enabled harassment,” she said.
A CDT survey of public schools in September last year found that 15 percent of students and 11 percent of teachers knew of at least one “deepfake that depicts an individual associated with their school in a sexually explicit or intimate manner.”
Such non-consensual imagery can lead to harassment, bullying or blackmail, sometimes causing devastating mental health consequences.
The mother who spoke to AFP said she knows of victims who had avoided school, had trouble eating, or required medical attention and counseling to cope with the ordeal.
She said she and other parents brought into a detective’s office to scrutinize the deepfakes were shocked to find printed out images stacked a “foot-and-a-half” (45.72cm) high.
“I had to see pictures of my daughter,” she said.
“If someone looked, they would think it’s real, so that’s even more damaging,” she added.
The alleged perpetrators, whose names have not been released, are accused of lifting pictures from social media, altering them using an AI application and sharing them on Discord.
The mother told AFP the fakes of her daughter were primarily altered from public photos on the school’s Instagram page, as well as a screenshot of a FaceTime call.
A simple online search throws up dozens of apps and Web sites that allow users to create “deepnudes,” digitally removing clothing, or superimpose selected faces onto pornographic images.
“Although results may not be as realistic or compelling as a professional rendition, these services mean that no technical skills are needed to produce deepfake content,” said Roberta Duffield, director of intelligence at Blackbird.AI.
Only a handful of US states have passed laws to deal with sexually explicit deepfakes, including Pennsylvania at the end of last year. The top leadership at the Pennsylvania school stepped aside after parents of the victims filed a lawsuit accusing the administration of failing to report the activity when they were first alerted to it in late 2023.
Researchers say schools are ill-equipped to tackle the threat of AI technology evolving at a rapid pace, in part because the law is still playing catchup.
“Underage girls are increasingly subject to deepfake exploitation from their friends, colleagues, school classmates,” Duffield said.
“Education authorities must urgently develop clear, comprehensive policies regarding the use of AI and digital technologies,” she said.
THE ‘MONSTER’: The Philippines on Saturday sent a vessel to confront a 12,000-tonne Chinese ship that had entered its exclusive economic zone The Philippines yesterday said it deployed a coast guard ship to challenge Chinese patrol boats attempting to “alter the existing status quo” of the disputed South China Sea. Philippine Coast Guard spokesman Commodore Jay Tarriela said Chinese patrol ships had this year come as close as 60 nautical miles (111km) west of the main Philippine island of Luzon. “Their goal is to normalize such deployments, and if these actions go unnoticed and unchallenged, it will enable them to alter the existing status quo,” he said in a statement. He later told reporters that Manila had deployed a coast guard ship to the area
A group of Uyghur men who were detained in Thailand more than one decade ago said that the Thai government is preparing to deport them to China, alarming activists and family members who say the men are at risk of abuse and torture if they are sent back. Forty-three Uyghur men held in Bangkok made a public appeal to halt what they called an imminent threat of deportation. “We could be imprisoned and we might even lose our lives,” the letter said. “We urgently appeal to all international organizations and countries concerned with human rights to intervene immediately to save us from
RISING TENSIONS: The nations’ three leaders discussed China’s ‘dangerous and unlawful behavior in the South China Sea,’ and agreed on the importance of continued coordination Japan, the Philippines and the US vowed to further deepen cooperation under a trilateral arrangement in the face of rising tensions in Asia’s waters, the three nations said following a call among their leaders. Japanese Prime Minister Shigeru Ishiba, Philippine President Ferdinand Marcos Jr and outgoing US President Joe Biden met via videoconference on Monday morning. Marcos’ communications office said the leaders “agreed to enhance and deepen economic, maritime and technology cooperation.” The call followed a first-of-its-kind summit meeting of Marcos, Biden and then-Japanese prime minister Fumio Kishida in Washington in April last year that led to a vow to uphold international
US president-elect Donald Trump is not typically known for his calm or reserve, but in a craftsman’s workshop in rural China he sits in divine contemplation. Cross-legged with his eyes half-closed in a pose evoking the Buddha, this porcelain version of the divisive US leader-in-waiting is the work of designer and sculptor Hong Jinshi (洪金世). The Zen-like figures — which Hong sells for between 999 and 20,000 yuan (US$136 to US$2,728) depending on their size — first went viral in 2021 on the e-commerce platform Taobao, attracting national headlines. Ahead of the real-estate magnate’s inauguration for a second term on Monday next week,
RSS