Key Points
- A search for the words Taylor Swift on X will now bring up no results.
- The social media platform is trying to control AI-generated explicit images of the artist from being shared.
- The number of AI-generated images, known as deepfakes, has grown within the last few years.
Social media platform X has blocked some searches for Taylor Swift as pornographic deepfake images of the singer have circulated online.
Attempts to search for her name without quote marks on the site Monday resulted in an error message and a prompt for users to retry their search, which added: "Don't fret — it's not your fault."
However, putting quote marks around her name allowed posts to appear that mentioned her name.
Swift deepfakes already shared to other social media platforms
Sexually explicit and abusive fake images of Swift began circulating widely last week on X, making her the most famous victim of a scourge that tech platforms and anti-abuse groups have struggled to fix.
"This is a temporary action and done with an abundance of caution as we prioritise safety on this issue," Joe Benarroch, head of business operations at X, said in a statement.
Unlike more conventional doctored images that have troubled celebrities in the past, the Swift images appear to have been created using an artificial intelligence image-generator that can instantly create new images from a written prompt.
Taylor Swift is the most famous victim of an issue tech platforms and anti-abuse groups have struggled to fix. Source: AP / Chris Pizzello
The deepfake-detecting group Reality Defender said it tracked a deluge of nonconsensual pornographic material depicting Swift, particularly on X. Some images also made their way to Meta-owned Facebook and other social media platforms.
The researchers found at least a couple dozen unique AI-generated images. The most widely shared were football-related, showing a painted or bloodied Swift that objectified her and in some cases inflicted violent harm on her deepfake persona.
Search block highlighted as a stopgap measure against a much bigger problem
The Swift images first emerged from an ongoing campaign that began last year on fringe platforms to produce sexually explicit AI-generated images of celebrity women, said Ben Decker of the threat intelligence group Memetica. One of the Swift images that went viral last week appeared online as early as 6 January, he said.
X's move to reduce searches of Swift is likely a stopgap measure.
"When you're not sure where everything is and you can't guarantee that everything has been taken down, the simplest thing you can do is limit people's ability to search for it," he said.
Researchers have said the number of explicit deepfakes have grown in the past few years, as the technology used to produce such images has become more accessible and easier to use.
In 2019, a report released by the AI firm DeepTrace Labs showed these images were overwhelmingly weaponised against women. Most of the victims, it said, were Hollywood actors and South Korean K-pop singers.
In the European Union, separate pieces of new legislation include provisions for deepfakes. The Digital Services Act, which took effect last year, requires online platforms to take measures to curb the risk of spreading content that breaches "fundamental rights" like privacy, such as "non-consensual" images or deepfake porn.
The 27-nation bloc's Artificial Intelligence Act, which still awaits final approvals, will require companies that create deepfakes with AI systems to also inform users that the content is artificial or manipulated.
