When I was 14, I was looking for a video on the most popular file-sharing app of the time — Limewire — and started a download.
The video that arrived did not match the description. What I saw instead is as vivid in my mind today as it was in the seconds after I had shut it off, reacting too slowly to miss the horror of a young woman’s murder. That is the sort of thing that could happen in those days, when the Internet was a true Wild West. It was the risk you took when you used those kinds of services.
There should be no such danger for people who use Instagram.
Illustration: Yusha
Yet on Thursday last week, reports circulated — in 404 Media, the Wall Street Journal and elsewhere — of an “error” on the app that pushed videos of extreme violence and death into their feeds, nestled between their usual serving of friends and influencers.
Feeds started to take a dark turn on Wednesday, the Wall Street Journal reported. Those affected are thought to include minors.
Some of the videos were presented with a “sensitive content” warning that requires a user to tap before the clip is revealed. However, many of them did not — they just automatically started to play.
Reading through comments from unsuspecting users, I was reminded of my 14-year-old self and the lingering effects of a violent video you were not expecting or emotionally prepared for.
“I watched 10 people die today,” one user told the Wall Street Journal.
“I feel like I lost some humanity today,” another wrote on Reddit, saying it caused sleeplessness.
Meta Platforms Inc, Instagram’s parent, has apologized.
“We have fixed an error that caused some users to see content in their Instagram Reels feed that should not have been recommended,” a spokesman said. The company declined to share how many people were involved. Chatter online suggests it is far from an isolated incident.
Affected users need to hold Meta to account. Never before has there been such a clear-cut case of the company’s algorithm actively working to traumatize its users. What caused this error? What steps would be taken to make sure it does not happen again? Would anyone be held responsible? Meta would not voluntarily say.
One question for Meta might be why that content was on Instagram at all, shared on pages with names such as “BlackPeopleBeingHurt.”
Late last year, more than 140 Kenya-based content moderators working for Meta were diagnosed with post-traumatic stress disorder — the result of endless hours of sifting through traumatic material, doctors said. Mercifully, what Instagram users saw on Wednesday (and perhaps Thursday) was just a tiny reflection of the harrowing job those workers do for up to 10 hours a day. However, take it from me, it takes only one clip to sear into your brain for a lifetime.
The company insisted that the error was unrelated to its recently announced changes to its moderation policies. Last month, it said it would stop removing some content that would have previously been prohibited, although it has not provided a full updated breakdown of what is now considered acceptable.
It said it would use fewer automated processes to remove harmful material, instead relying on user reports.
Meta CEO Mark Zuckerberg conceded it would mean the company would “catch less bad stuff.”
Meta’s existing policy on violent material is that even the most disturbing scenes are permitted on the platform. Footage of human “dismemberment” and displaying “innards” are fine if given a warning label. So, too, are images and video of “burned or charred” people and “throat slitting.” However, Meta’s staff would remove such content at the request of a family member — which is mighty good of them.
It is unfortunate, and not Meta’s fault, that there exists an eager audience for such videos, known colloquially on the Internet as “gore.” Other social networks have contended with the issue, too. Reddit, for instance, took steps to remove forums such as “WatchPeopleDie.” However, in those cases, those who wanted such material had to go actively looking. This is different: a catastrophic failure for a company that billions trust to shield them from this harm.
What does it do to young minds to see extreme violence on their Instagram feeds? Meta’s apology does not cut it.
Dave Lee is Bloomberg Opinion’s US technology columnist. He was previously a correspondent for the Financial Times and BBC News.
US President Donald Trump is systematically dismantling the network of multilateral institutions, organizations and agreements that have helped prevent a third world war for more than 70 years. Yet many governments are twisting themselves into knots trying to downplay his actions, insisting that things are not as they seem and that even if they are, confronting the menace in the White House simply is not an option. Disagreement must be carefully disguised to avoid provoking his wrath. For the British political establishment, the convenient excuse is the need to preserve the UK’s “special relationship” with the US. Following their White House
Taiwan is a small, humble place. There is no Eiffel Tower, no pyramids — no singular attraction that draws the world’s attention. If it makes headlines, it is because China wants to invade. Yet, those who find their way here by some twist of fate often fall in love. If you ask them why, some cite numbers showing it is one of the freest and safest countries in the world. Others talk about something harder to name: The quiet order of queues, the shared umbrellas for anyone caught in the rain, the way people stand so elderly riders can sit, the
After the coup in Burma in 2021, the country’s decades-long armed conflict escalated into a full-scale war. On one side was the Burmese army; large, well-equipped, and funded by China, supported with weapons, including airplanes and helicopters from China and Russia. On the other side were the pro-democracy forces, composed of countless small ethnic resistance armies. The military junta cut off electricity, phone and cell service, and the Internet in most of the country, leaving resistance forces isolated from the outside world and making it difficult for the various armies to coordinate with one another. Despite being severely outnumbered and
After the confrontation between US President Donald Trump and Ukrainian President Volodymyr Zelenskiy on Friday last week, John Bolton, Trump’s former national security adviser, discussed this shocking event in an interview. Describing it as a disaster “not only for Ukraine, but also for the US,” Bolton added: “If I were in Taiwan, I would be very worried right now.” Indeed, Taiwanese have been observing — and discussing — this jarring clash as a foreboding signal. Pro-China commentators largely view it as further evidence that the US is an unreliable ally and that Taiwan would be better off integrating more deeply into
RSS