This is Behind the Blog, where we share our behind-the-scenes thoughts about how a few of our top stories of the week came together. This week, we discuss how data is accessed, AI in games, and more.JOSEPH: This was a pretty big week for impact at 404 Media. Sam’s piece on an exposed AI porn platform ended up with the company closing off those exposed images. Our months-long reporting and pressure from lawmakers led to the closure of the Travel Intelligence Program (TIP), in which a company o
This is Behind the Blog, where we share our behind-the-scenes thoughts about how a few of our top stories of the week came together. This week, we discuss how data is accessed, AI in games, and more.
JOSEPH: This was a pretty big week for impact at 404 Media. Sam’s piece on an exposed AI porn platform ended up with the company closing off those exposed images. Our months-long reporting and pressure from lawmakers led to the closure of the Travel Intelligence Program (TIP), in which a company owned by the U.S.’s major airlines sold flyers data to the government for warrantless surveillance.
For the quick bit of context I have typed many, many times this year: that company is Airlines Reporting Corporation (ARC), and is owned by United, American, Delta, Southwest, JetBlue, Alaska, Lufthansa, Air France, and Air Canada. ARC gets data, including a traveler’s name, credit card used, where they’re flying to and from, whenever someone books a flight with one of more than 10,000 travel agencies. Think Expedia, especially. ARC then sells access to that data to a slew of government agencies, including ICE, the FBI, the SEC, the State Department, ATF, and more.
OnlyFans will start running background checks on people signing up as content creators, the platform’s CEO recently announced. As reported by adult industry news outlet XBIZ, OnlyFans CEO Keily Blair announced the partnership in a LinkedIn post. Blair doesn’t say in the post when the checks will be implemented, whether all types of criminal convictions will bar creators from signing up, if existing creators will be checked as well, or what countries’ criminal records will be checked. OnlyFans
OnlyFans will start running background checks on people signing up as content creators, the platform’s CEO recently announced.
As reported by adult industry news outlet XBIZ, OnlyFans CEO Keily Blair announced the partnership in a LinkedIn post. Blair doesn’t say in the post when the checks will be implemented, whether all types of criminal convictions will bar creators from signing up, if existing creators will be checked as well, or what countries’ criminal records will be checked.
OnlyFans did not respond to 404 Media's request for comment.
“I am very proud to add our partnership with Checkr Trust to our onboarding process in the US,” Blair wrote. “Checkr, Inc. helps OnlyFans to prevent people who have a criminal conviction which may impact on our community's safety from signing up as a Creator on OnlyFans. It’s collaborations like this that make the real difference behind the scenes and keep OnlyFans a space where creators and fans feel secure and empowered.”
Many OnlyFans creators turned to the platform, and to online sex work more generally, when they’re not able to obtain employment at traditional workplaces. Some sex workers doing in-person work turned to online sex work as a way to make ends meet—especially after the passage of the Fight Online Sex Trafficking Act in 2018 made it much more difficult to screen clients for escorting. And in-person sex work is still criminalized in the U.S. and many other countries.
“Criminal background checks will not stop potential predators from using the platform (OF), it will only harm individuals who are already at higher risk. Sex work has always had a low barrier to entry, making it the most accessible career for people from all walks of life,” performer GoAskAlex, who’s on OnlyFans and other platforms, told me in an email. “Removing creators with criminal/arrest records will only push more vulnerable people (overwhelmingly, women) to street based/survival sex work. Adding more barriers to what is arguably the safest form of sex work (online sex work) will push sex industry workers to less and less safe options.”
Jessica Starling, who also creates adult content on OnlyFans, told me in a call that their first thought was that if someone using OnlyFans has a prostitution charge, they might not be able to use the platform. “If they're trying to transition to online work, they won’t be able to do that anymore,” they said. “And the second thing I thought was that it's just invasive and overreaching... And then I looked up the company, and I'm like, ‘Oh, wow, this is really bad.’”
Checkr is reportedly used by Uber, Instacart, Shipt, Postmates, and Lyft, and lists many more companies like Dominos and Doordash on its site as clients. The company has been sued hundreds of times for violations of the Fair Credit Reporting Act or other consumer credit complaints. The Fair Credit Reporting Act says that companies providing information to consumer reporting agencies are legally obligated to investigate disputed information. And a lot of people dispute the information Checkr and Inflection provide on them, claiming mixed-up names, acquittals, and decades-old misdemeanors or traffic tickets prevented them from accessing platforms that use background checking services.
Checkr regularly acquires other background checking and age verification companies, and acquired a background check company called Inflection in 2022. At the time, I found more than a dozen lawsuits against Inflection alone in a three year span, many of them from people who found out about the allegedly inaccurate reports Inflection kept about them after being banned from Airbnb after the company claimed they failed checks.
“Sex workers face discrimination when leaving the sex trade, especially those who have been face-out and are identifiable in the online world. Facial recognition technology has advanced to a point where just about anyone can ascertain your identity from a single picture,” Alex said. “Leaving the online sex trade is not as easy as it once was, and anything you've done online will follow you for a lifetime. Creators who are forced to leave the platform will find that safe and stable alternatives are far and few between.”
Last month, Pornhub announced that it would start performing background checks on existing content partners—which primarily include studios—next year. "To further protect our creators and users, all new applicants must now complete a criminal background check during onboarding," the platform announced in a newsletter to partners, as reported by AVN.
Alex said she believes background checks in the porn industry could be beneficial, under very specific circumstances. “I do not think that someone with egregious history of sexual violence should be allowed to work in the sex trade in any capacity—similarly, a person convicted of hurting children should be not able to work with children—so if the criminal record checks were searching specifically for sex based offences I could see the benefit, but that doesn't appear to be the case (to my knowledge). What's to stop OnlyFans from deactivating someone's account due to a shoplifting offense?” she said. “I'd like to know more about what they're searching for with these background checks.”
Even with third-party companies like Checkr doing the work, as is the case with third-party age verification that’s swept the U.S. and targeted the porn industry, increased data means increased risk of it being leaked or hacked. Last year, a background check company called National Public Data claimed it was breached by hackers who got the confidential data of 2.9 billion people. The unencrypted data was then sold on the dark web.
“It’s dangerous for anyone, but it's especially dangerous for us [adult creators] because we're more vulnerable anyway. Especially when you're online, you're hypervisible,” Starling said. “It doesn't protect anyone except OnlyFans themselves, the company.”
OnlyFans became the household name in independent porn because of the work of its adult content creators. Starling mentioned that because the platform has dominated the market, it’s difficult to just go to another platform if creators don’t want to be subjected to background checks. “We're put in a position where we have very limited power," they said. "So when a platform decides to do something like this, we’re kind of screwed, right?”
Earlier this year, OnlyFans owner Fenix International Ltd reportedly entered talks to sell the company to an investor group at a valuation of around $8 billion.
An erotic roleplay chatbot and AI image creation platform called Secret Desires left millions of user-uploaded photos exposed and available to the public. The databases included nearly two million photos and videos, including many photos of completely random people with very little digital footprint. The exposed data shows how many people use AI roleplay apps that allow face-swapping features: to create nonconsensual sexual imagery of everyone, from the most famous entertainers in the world t
An erotic roleplay chatbot and AI image creation platform called Secret Desires left millions of user-uploaded photos exposed and available to the public. The databases included nearly two million photos and videos, including many photos of completely random people with very little digital footprint.
The exposed data shows how many people use AI roleplay apps that allow face-swapping features: to create nonconsensual sexual imagery of everyone, from the most famous entertainers in the world to women who are not public figures in any way. In addition to the real photo inputs, the exposed data includes AI-generated outputs, which are mostly sexual and often incredibly graphic. Unlike “nudify” apps that generate nude images of real people, these images are putting people into AI-generated videos of hardcore sexual scenarios.
This is Behind the Blog, where we share our behind-the-scenes thoughts about how a few of our top stories of the week came together. This week, we discuss getting back on our AI slop bullshit, deepfakes in schools, and epistemic virtues.JASON: I was back on my bullshit this week, by which I mean staring at some horrible AI-generated shit on Facebook. In this case, I was looking at slop of ICE raids generated using OpenAI’s Sora. I talk about this in the article but one of the many reasons why
This is Behind the Blog, where we share our behind-the-scenes thoughts about how a few of our top stories of the week came together. This week, we discuss getting back on our AI slop bullshit, deepfakes in schools, and epistemic virtues.
JASON: I was back on my bullshit this week, by which I mean staring at some horrible AI-generated shit on Facebook. In this case, I was looking at slop of ICE raids generated using OpenAI’s Sora. I talk about this in the article but one of the many reasons why I think social media—especially Facebook and Instagram—is fucked if they continue to monetize and promote this stuff is because this specific slop page is not being pushed by anyone who seems to have any sort of ideological interest in immigration or the United States or anything like that. It’s just someone trying to make money. And it’s almost definitely one single person, with one single account, generating millions and millions and millions of views. We are very early in the horrible AI slop game, and yet we are seeing the damage that just a few people can do with industrial-grade content generation machines.
Over the years I have talked to a lot of academics about the idea of “trolling” on the internet. The person who has most informed my thinking over the years is Whitney Phillips, who has written a lot about 4chan, “trolling” culture, and generally the worst corners of the internet in a series of books and papers. This Is Why We Can’t Have Nice Things, which is about 4chan, is extremely good, as is her paper called The Oxygen of Amplification. She (and other academics) have argued that it’s not the intent behind “trolls” that matters, it’s the impact. She wrote a lot about “just trolling” racism and misogyny and xenophobia on the internet and what’s important is how it impacts people and changes how they interact with online spaces. You can’t really be “ironically” racist, you’re just racist. And with anonymity and pseudonymity online, you can’t really infer what’s inside of someone’s heart because often it doesn’t matter if the person posting Harambe memes or making deepfake nudes of celebrities of their classmates or whatever didn’t actually “mean” it.
Six of the biggest porn studios in the world, including industry giant and Pornhub parent company Ayl o, announced Wednesday they have formed a first-of-its-kind coalition called the Adult Studio Alliance (ASA). The alliance’s purpose is to “contribute to a safe, healthy, dignified, and respectful adult industry for performers,” the ASA told 404 Media.“This alliance is intended to unite professionals creating adult content (from studios to crews to performers) under a common set of values and
Six of the biggest porn studios in the world, including industry giant and Pornhub parent company Ayl o, announced Wednesday they have formed a first-of-its-kind coalition called the Adult Studio Alliance (ASA). The alliance’s purpose is to “contribute to a safe, healthy, dignified, and respectful adult industry for performers,” the ASA told 404 Media.
“This alliance is intended to unite professionals creating adult content (from studios to crews to performers) under a common set of values and guidelines. In sharing our common standards, we hope to contribute to a safe, healthy, dignified, and respectful adult industry for performers,” a spokesperson for ASA told 404 Media in an email. “As a diverse group of studios producing a large volume and variety of adult content, we believe it’s key to promote best practices on all our scenes. We all come from different studios, but we share the belief that all performers are entitled to comfort and safety on set.”
The founding members include Aylo, Dorcel, ERIKALUST, Gamma Entertainment, Mile High Media and Ricky’s Room. Aylo owns some of the biggest platforms and porn studios in the industry, including Brazzers, Reality Kings, Digital Playground and more.
Fifty years ago—almost two decades before WIRED, seven years ahead of PCMag, just a few years after the first email ever passed through the internet and with the World Wide Web still 14 years away—there was BYTE. Now, you can see the tech magazine's entire run at once. Software engineer Hector Dearman recently released a visualizer to take in all of BYTE’s 287 issues as one giant zoomable map.The physical BYTE magazine published monthly from September 1975 until July 1998, for $10 a month. Pe
Fifty years ago—almost two decades before WIRED, seven years ahead of PCMag, just a few years after the first email ever passed through the internet and with the World Wide Web still 14 years away—there was BYTE. Now, you can see the tech magazine's entire run at once. Software engineer Hector Dearman recently released a visualizer to take in all of BYTE’s 287 issues as one giant zoomable map.
The physical BYTE magazine published monthly from September 1975 until July 1998, for $10 a month. Personal computer kits were a nascent market, with the first microcomputers having just launched a few years prior. BYTE was founded on the idea that the budding microcomputing community would be well-served by a publication that could help them through it.
In a landmark case for Danish courts and internationally, a man was sentenced to seven months’ suspended imprisonment and 120 hours of community service for posting nude scenes from copyrighted films.He’s convicted of “gross violations of copyright, including violating the right of publicity of more than 100 aggrieved female actors relating to their artistic integrity,” Danish police reported Monday.The man, a 40-year-old from Denmark who was a prolific Redditor under the username “KlammereFy
In a landmark case for Danish courts and internationally, a man was sentenced to seven months’ suspended imprisonment and 120 hours of community service for posting nude scenes from copyrighted films.
He’s convicted of “gross violations of copyright, including violating the right of publicity of more than 100 aggrieved female actors relating to their artistic integrity,” Danish police reported Monday.
The man, a 40-year-old from Denmark who was a prolific Redditor under the username “KlammereFyr” (which translates to “NastierGuy”) was arrested and charged with copyright infringement in September 2024 by Denmark’s National Unit for Serious Crime (NSK).
If you’ve been to a national park in the U.S. recently, you might have noticed some odd new signs about “beauty” and “grandeur.” Or, some signs you were used to seeing might now be missing completely. An executive order issued earlier this year put the history and educational aspects of the parks system under threat–but a group of librarians stepped in to save it. This week we have a conversation between Sam and two of the leaders of the independent volunteer archiving project Save Our Signs,
If you’ve been to a national park in the U.S. recently, you might have noticed some odd new signs about “beauty” and “grandeur.” Or, some signs you were used to seeing might now be missing completely. An executive order issued earlier this year put the history and educational aspects of the parks system under threat–but a group of librarians stepped in to save it.
This week we have a conversation between Sam and two of the leaders of the independent volunteer archiving project Save Our Signs, an effort to archive national park signs and monument placards. It’s a community collaboration project co-founded by a group of librarians, public historians, and data experts in partnership with the Data Rescue Project and Safeguarding Research & Culture.
Lynda Kellam leads the Research Data and Digital Scholarship team at the University of Pennsylvania Libraries and is a founding organizer of the Data Rescue Project. Jenny McBurney is the Government Publications Librarian and Regional Depository Coordinator at the University of Minnesota Libraries. In this episode, they discuss turning “frustration, dismay and disbelief” at parks history under threat into action: compiling more than 10,000 images from over 300 national parks into a database to be preserved for the people.
Become a paid subscriber for early access to these interview episodes and to power our journalism. If you become a paid subscriber, check your inbox for an email from our podcast host Transistor for a link to the subscribers-only version! You can also add that subscribers feed to your podcast app of choice and never miss an episode that way. The email should also contain the subscribers-only unlisted YouTube link for the extended video version too. It will also be in the show notes in your podcast player.
This is Behind the Blog, where we share our behind-the-scenes thoughts about how a few of our top stories of the week came together. This week, we discuss archiving to get around paywalls, hating on smart glasses, and more.JASON: I was going to try to twist myself into knots attempting to explain the throughline between my articles this week, and about how I’ve been thinking about the news and our coverage more broadly. This was going to be something about trying to promote analog media and d
This is Behind the Blog, where we share our behind-the-scenes thoughts about how a few of our top stories of the week came together. This week, we discuss archiving to get around paywalls, hating on smart glasses, and more.
JASON: I was going to try to twist myself into knots attempting to explain the throughline between my articles this week, and about how I’ve been thinking about the news and our coverage more broadly. This was going to be something about trying to promote analog media and distinctly human ways of communicating (like film photography), while highlighting the very bad economic and political incentives pushing us toward fundamentally dehumanizing, anti-human methods of communicating. Like fully automated, highly customized and targeted AI ads, automated library software, and I guess whatever Nancy Pelosi has been doing with her stock portfolio. But then I remembered that I blogged about the FBI’s subpoena against archive.is, a website I feel very ambivalent about and one that is the subject of perhaps my most cringe blog of all time.
So let’s revisit that cringe blog, which was called “Dear GamerGate: Please Stop Stealing Our Shit.” I wrote this article in 2014, which was fully 11 years ago, which is alarming to me. First things first: They were not stealing from me they were stealing from VICE, a company that I did not actually experience financial gains from related to people reading articles; it was good if people read my articles and traffic was very important, and getting traffic over time led to me getting raises and promotions and stuff, but the company made very, very clear that we did not “own” the articles and therefore they were not “mine” in the way that they are now. With that out of the way, the reporting and general reason for the article was I think good but the tone of it is kind of wildly off, and, as I mentioned, over the course of many years I have now come to regard archive.is as sort of an integral archiving tool. If you are unfamiliar with archive.is, it’s a site that takes snapshots of any URL and creates a new link for them which, notably, does not go to the original website. Archive.is is extremely well known for bypassing the paywalls on many sites, 404 Media sometimes but not usually among them.
Automattic, the company that owns WordPress.com, is asking Automatic.CSS—a company that provides a CSS framework for WordPress page builders—to change its name amid public spats between Automattic founder Matt Mullenweg and Automatic.CSS creator Kevin Geary. Automattic has two T’s as a nod to Matt.“As you know, our client owns and operates a wide range of software brands and services, including the very popular web building and hosting platform WordPress.com,” Jim Davis, an intellectual prope
Automattic, the company that owns WordPress.com, is asking Automatic.CSS—a company that provides a CSS framework for WordPress page builders—to change its name amid public spats between Automattic founder Matt Mullenweg and Automatic.CSS creator Kevin Geary. Automattic has two T’s as a nod to Matt.
“As you know, our client owns and operates a wide range of software brands and services, including the very popular web building and hosting platform WordPress.com,” Jim Davis, an intellectual property attorney representing Automattic, wrote in a letter dated Oct. 30.
This is Behind the Blog, where we share our behind-the-scenes thoughts about how a few of our top stories of the week came together. This week, we discuss Pavlovian Chartbeat response, when to say "cum," and the wave of making things for humans, by humans. JOSEPH: Right now I’m in the midst of upgrading a bunch of my podcasting and related gear. I’m using the same kinda cheap to midrange web cam I got when we first launched 404 Media. My mic is fine but now that a fair number of people listen
This is Behind the Blog, where we share our behind-the-scenes thoughts about how a few of our top stories of the week came together. This week, we discuss Pavlovian Chartbeat response, when to say "cum," and the wave of making things for humans, by humans.
JOSEPH: Right now I’m in the midst of upgrading a bunch of my podcasting and related gear. I’m using the same kinda cheap to midrange web cam I got when we first launched 404 Media. My mic is fine but now that a fair number of people listen to the pod, and we want to grow it, it’s time to invest in some new tech. Jason has already done this, I’m more following his lead. I used to be very into cameras, tech, gadgets, mics, but it’s been a few years.
Because the four of us are spread all over, we can’t do the popular aesthetic of everyone sitting on a chair or sofa chatting in a podcast studio. That stuff obviously performs better on video/YouTube, which is where podcast discovery often happens now. But we can try to make our remotely recorded podcast look as good as we can. Give people something to actually look at.
A new analysis of synthetic intimate image abuse (SIIA) found that the tools for making non-consensual, sexually explicit deepfakes are easily discoverable all over social media and through simple searches on Google and Bing.Research published by the counter-extremism organization Institute for Strategic Dialogue shows how tools for creating non-consensual deepfakes spread across the internet. They analyzed 31 websites for SIIA tools, and found that they received a combined 21 million visits
A new analysis of synthetic intimate image abuse (SIIA) found that the tools for making non-consensual, sexually explicit deepfakes are easily discoverable all over social media and through simple searches on Google and Bing.
Research published by the counter-extremism organization Institute for Strategic Dialogue shows how tools for creating non-consensual deepfakes spread across the internet. They analyzed 31 websites for SIIA tools, and found that they received a combined 21 million visits a month, with up to four million visits in one month.
Chiara Puglielli and Anne Craanen, the authors of the research paper, used SimilarWeb to identify a common group of sites that shared content, audiences, keywords and referrals. They then used the social media monitoring tool Brandwatch to find mentions of those sites and tools on X, Reddit, Bluesky, YouTube, Tumblr, public pages on Instagram and Facebook, forums, blogs and review sites, according to the paper. “We found 410,592 total mentions of the keywords between 9 June 2020 and 3 July 2025, and used Brandwatch’s ability to separate mentions by source in order to find which sources hosted the highest volumes of mentions,” they wrote.
The easiest place to find SIIA tools was through simple web searches. “Searches on Google, Yahoo, and Bing all yielded at least one result leading the user to SIIA technology within the first 20 results when searching for ‘deepnude,’ ‘nudify,’ and ‘undress app,’” the authors wrote. Last year, 404 Media saw that Google was also advertising these apps in search results. But Bing surfaces the tools most readily: “In the case of Bing, the first results for all three searchers were SIIA tools.” These weren’t counting advertisements on the search engines that the websites would have paid for, but were organic search results surfaced by the engines’ crawlers and indexing.
X was another massively popular way these tools spread, they found: “Of 410,592 total mentions between June 2020 and July 2025, 289,660 were on X, accounting for more than 70 percent of all activity.” A lot of these were bots. “A large volume of traffic appeared to be inorganic, based on the repetitive style of the usernames, the uniformity of posts, and the uniformity of profile pictures,” Craanen told 404 Media. “Nevertheless, this activity remains concerning, as its volume is likely to attract new users to these tools, which can be employed for activities that are illegal in several contexts.”
One major spike in mentions of the tools on social media happened in early 2023 on Tumblr, when a woman posted about her experience being a target of sexual harassment from those very same tools. As targets of malicious deepfakes have said over and over again, the price of speaking up about one’s own harassment, or even objecting to the harassment of others, is the risk of drawing more attention and harassment to themselves.
Another spike on X in 2023 was likely the result of bot advertisements for a single SIIA tool, Craanen said, and the spike was a result of those bots launching. X has rules against “unwanted sexual conduct and graphic objectification” and “inauthentic media,” but the platform remains one of the most significant places where tools for making that content are disseminated and advertised.
Apps and sites for making malicious deepfakes have never been more common or easier to find. There have been several incidents where schoolchildren have used “undress” apps on their classmates, including last year when a Washington state high school was rocked by students using AI to take photos from other children’s Instagram accounts and “undress” around seven of their underage classmates, which police characterized as a possible sex crime against children. In 2023, police arrested two middle schoolers for allegedly creating and sharing AI-generated nude images of their 12 and 13 year old classmates, and police reports showed the preteens used an application to make the images.
A recent report from the Center for Democracy and Technology found that 40 percent of students and 29 percent of teachers said they know of an explicit deepfake depicting people associated with their school being shared in the past school year.
The “Tools to Address Known Exploitation by Immobilizing Technological Deepfakes on Websites and Networks” (TAKE IT DOWN) Act, passed earlier this year, requires platforms to report and remove synthetic sexual abuse material, and after years of state-by-state legislation around deepfake harassment is the first federal-level law to attempt to confront the problem. But critics of that law have said it carries a serious risk of chilling legitimate speech online.
“The persistence and accessibility of SIIA tools highlight the limits of current platform moderation and legal frameworks in addressing this form of abuse. Relevant laws relating to takedowns are not yet in full effect across the jurisdictions analysed, so the impact of this legislation cannot yet be fully known,” the ISD authors wrote. “However, the years of public awareness and regulatory discussion around these tools, combined with the ease with which users can still discover, share and deploy these technologies suggests that takedowns cannot be the only tool used to counter their proliferation. Instead, effective mitigation requires interventions at multiple points in the SIIA life cycle—disrupting not only distribution but also discovery and demand. Stronger search engine safeguards, proactive content-blocking on major platforms, and coordinated international policies are essential to reducing the scale of harm.”
OpenAI CEO Sam Altman appeared on Cleo Abram's podcast in August where he said the company was “tempted” to add sexual content in the past, but resisted, saying that a “sex bot avatar” in ChatGPT would be a move to “juice growth.” In light of his announcement last week that ChatGPT would soon offer erotica, revisiting that conversation is revealing. It’s not clear yet what the specific offerings will be, or whether it’ll be an avatar like Grok’s horny waifu. But OpenAI is following a trend we
OpenAI CEO Sam Altman appeared on Cleo Abram's podcast in August where he said the company was “tempted” to add sexual content in the past, but resisted, saying that a “sex bot avatar” in ChatGPT would be a move to “juice growth.” In light of his announcement last week that ChatGPT would soon offer erotica, revisiting that conversation is revealing.
It’s not clear yet what the specific offerings will be, or whether it’ll be an avatar like Grok’s horny waifu. But OpenAI is following a trend we’ve known about for years: There are endless theorized applications of AI, but in the real world many people want to use LLMs for sexual gratification, and it’s up for the market to keep up. In 2023, a16z published an analysis of the generative AI market, which amounted to one glaringly obvious finding: people use AI as part of their sex lives. As Emanuel wrote at the time in his analysis of the analysis: “Even if we put ethical questions aside, it is absurd that a tech industry kingmaker like a16z can look at this data, write a blog titled ‘How Are Consumers Using Generative AI?’ and not come to the obvious conclusion that people are using it to jerk off. If you are actually interested in the generative AI boom and you are not identifying porn as a core use for the technology, you are either not paying attention or intentionally pretending it’s not happening.”
Altman even hinting at introducing erotic roleplay as a feature is huge, because it’s a signal that he’s no longer pretending. People have been fucking the chatbot for a long time in an unofficial capacity, and have recently started hitting guardrails that stop them from doing so. People use Anthropic’s Claude, Google’s Gemini, Elon Musk’s Grok, and self-rolled large language models to roleplay erotic scenarios whether the terms of use for those platforms permit it or not, DIYing AI boyfriends out of platforms that otherwise forbid it. And there are specialized erotic chatbot platforms and AI dating simulators, but what OpenAI does—as the owner of the biggest share of the chatbot market—the rest follow.
Already we see other AI companies stroking their chins about it. Following Altman’s announcement, Amanda Askell, who works on the philosophical issues that arise with Anthropic’s alignment, posted: “It's unfortunate that people often conflate AI erotica and AI romantic relationships, given that one of them is clearly more concerning than the other. Of the two, I'm more worried about romantic relationships. Mostly because it seems like it would make users pretty vulnerable to the AI company in many ways. It seems like a hard area to navigate responsibly.” And the highly influential anti-porn crowd is paying attention, too: the National Center on Sexual Exploitation put out a statement following Altman’s post declaring that actually, no one should be allowed to do erotic roleplay with chatbots, not even adults. (Ron DeHaas, co-founder of Christian porn surveillance company Covenant Eyes, resigned from the NCOSE board earlier this month after his 38-year-old adult stepson was charged with felony child sexual abuse.)
In the August interview, Abram sets up a question for Altman by noting that there’s a difference between “winning the race” and “building the AI future that would be best for the most people,” noting that it must be easier to focus on winning. She asks Altman for an example of a decision he’s had to make that would be best for the world but not best for winning.
Altman responded that he’s proud of the impression users have that ChatGPT is “trying to help you,” and says a bunch of other stuff that’s not really answering the question, about alignment with users and so on. But then he started to say something actually interesting: “There's a lot of things we could do that would like, grow faster, that would get more time in ChatGPT, that we don't do because we know that like, our long-term incentive is to stay as aligned with our users as possible. But there's a lot of short-term stuff we could do that would really juice growth or revenue or whatever, and be very misaligned with that long-term goal,” Altman said. “And I'm proud of the company and how little we get distracted by that. But sometimes we do get tempted.”
“Are there specific examples that come to mind?” Abram asked. “Any decisions that you've made?”
After a full five-second pause to think, Altman said, “Well, we haven't put a sex bot avatar in ChatGPT yet.”
“That does seem like it would get time spent,” Abram replied. “Apparently, it does.” Altman said. They have a giggle about it and move on.
Two months later, Altman was surprised that the erotica announcement blew up. “Without being paternalistic we will attempt to help users achieve their long-term goals,” he wrote. “But we are not the elected moral police of the world. In the same way that society differentiates other appropriate boundaries (R-rated movies, for example) we want to do a similar thing here.”
This announcement, aside from being a blatant hail mary cash grab for a company that’s bleeding funds because it’s already too popular, has inspired even more “bubble’s popping” speculation, something boosters and doomers alike have been saying (or rooting for) for months now. Once lauded as a productivity godsend, AI has mostly proven to be a hindrance to workers. It’s interesting that OpenAI’s embrace of erotica would cause that reaction, and not, say, the fact that AI is flooding and burdening libraries, eating Wikipedia, and incinerating the planet. It’s also interesting that OpenAI, which takes user conversations as training data—along with all of the writing and information available on the internet—feels it’s finally gobbled enough training data from humans to be able to stoop so low, as Altman’s attitude insinuates, to let users be horny. That training data includes authors of romance novels and NSFW fanfic but also sex workers who’ve spent the last 10 years posting endlessly to social media platforms like Twitter (pre-X, when Elon Musk cut off OpenAI’s access) and Reddit, only to have their posts scraped into the training maw.
Altman believes “sex bots” are not in service of the theoretical future that would “benefit the most people,” and that it’s a fast-track to juicing revenue, something the company badly needs. People have always used technology for horny ends, and OpenAI might be among the last to realize that—or the first of the AI giants to actually admit it.
On Saturday, millions of people across the U.S. attended “No Kings” protests—a slogan born in response to President Donald Trump’s self-aggrandizing social media posts where he’s called himself a king, including with AI-generated images of himself in a crown, and his continuous stretching of executive power. While Americans were out in the street, the president was posting.
On Saturday, millions of people across the U.S. attended “No Kings” protests—a slogan born in response to President Donald Trump’s self-aggrandizing social media posts where he’s called himself a king, including with AI-generated images of himself in a crown, and his continuous stretching of executive power. While Americans were out in the street, the president was posting.
This is Behind the Blog, where we share our behind-the-scenes thoughts about how a few of our top stories of the week came together. This week, we discuss crowdsourced resistance and a big government data dump.SAM: I don’t want to say it’s rare that we publish positive stories. We post more of those than people probably even realize, because the gnarly stories are the ones that go viral, or are talked about by your friends or aggregated by other news outlets. A “scoop” is almost never a happy
This is Behind the Blog, where we share our behind-the-scenes thoughts about how a few of our top stories of the week came together. This week, we discuss crowdsourced resistance and a big government data dump.
SAM: I don’t want to say it’s rare that we publish positive stories. We post more of those than people probably even realize, because the gnarly stories are the ones that go viral, or are talked about by your friends or aggregated by other news outlets. A “scoop” is almost never a happy story because often they’re predicated on information someone in a position of power didn’t want the world to know. But it’s definitely less common for us to report on things that makes you feel good or hopeful than things that make you go “oh shit” or “Jesus fucking Christ,” I will admit.
Three victims of sex trafficking ring GirlsDoPorn brought a complaint against multiple companies that processed payments for the criminal organization, claiming that without their payment services, GirlsDoPorn would never have existed.GirlsDoPorn was a criminal enterprise that coerced primarily high-school and college aged women with no experience in the adult industry into appearing in pornographic videos, by convincing them they were signing up for modeling gigs and telling them the videos
Three victims of sex trafficking ring GirlsDoPorn brought a complaint against multiple companies that processed payments for the criminal organization, claiming that without their payment services, GirlsDoPorn would never have existed.
GirlsDoPorn was a criminal enterprise that coerced primarily high-school and college aged women with no experience in the adult industry into appearing in pornographic videos, by convincing them they were signing up for modeling gigs and telling them the videos would never be posted online. The ring was masterminded by Michael Pratt, who alongside multiple co-conspirators was charged with federal counts of sex trafficking by force, fraud and coercion in 2019. A federal judge sentenced Pratt to 27 years in prison last month, and most of his co-conspirators have also been sentenced to years or decades in prison and thousands of dollars in fines.
The lawsuit, brought by three women who appeared in the videos, seeks to become a class-action complaint on behalf of anyone who appeared in at least one pornographic video on GirlsDoPorn and its sister site GirlsDoToys between 2009 and 2019—which could include up to 300 more individuals, the complaint estimates. They allege that CCBill, Epoch, First Data Merchant Services, Total System Services, and a number of unnamed banks knowingly participated in GirlsDoPorn’s sex trafficking venture by providing it payment services.
The complaint was filed on Monday by several attorneys who’ve represented GirlsDoPorn victims since the civil case which went to trial in 2019. The defendant payment service companies generated “millions in fees for themselves and tens of millions for GirlsDoPorn,” the complaint claims. “By doing so, Defendants turned the victims’ sex acts into ‘commercial sex acts,’ a crucial element of sex trafficking under Section 1591 [the U.S. sex trafficking legal code]. Without Defendants’ payment network, GirlsDoPorn would have never been able to exist.”
CCBill is one of the most popular handlers of online porn payments and subscriptions. Epoch, another longtime service in the adult industry, was GirlsDoPorn’s payment facilitator, which acts as a gateway between credit card companies and merchants like porn sites. Total System Services and First Data were GirlsDoPorn’s payment processors, the complaint alleges, while the yet-unnamed banks settled the payments for GirlsDoPorn.
“Given the integral role of payment processing to the business of Internet pornography, GirlsDoPorn would never have become or remained a viable enterprise absent Defendants’ participation in the sex trafficking venture,” the plaintiffs argue. “GirlsDoPorn would never have achieved the level of success it did without Defendants actively assisting, supporting, and facilitating its unlawful business with streams of revenue.”
The plaintiffs claim that the defendants, as part of running their businesses, should have known GirlsDoPorn was a criminal enterprise, pointing to GirlsDoPorn’s own website and messaging as evidence: “Indeed, when it was launched, GirlsDoPorn’s website openly bragged about using fraud to lure a victim under the guise of a modeling advertisement—’She contacted us regarding an ad I had placed for beauty models wanted, having no idea it was actually for adult videos instead ha :)’” the complaint states. The plaintiffs also point to Reddit posts made by GirlsDoPorn victims talking about being abused, and the boasting GirlsDoPorn operators did on the website about how the women were “first-timers,” caught in their bait-and-switch scheme who would shoot porn for the “studio” exclusively, and weren’t part of the adult industry as a career choice.
“As the years went by, Defendants ignored dozens of red flags indicating GirlsDoPorn was a sex trafficking venture,” the complaint states. By 2017, they allege, defendants “could no longer feign ignorance of GirlsDoPorn’s illegal business practices” because the plantiffs served the defendants a subpoena as part of the civil case in San Diego seeking records related to GirlsDoPorn.
The defendants continued processing payments for the organization until October 2019, the plaintiffs claim, at which point everyone involved was arrested or indicted on federal sex trafficking charges and the websites went offline. “Only then did Defendants stop processing payments forGirlsDoPorn, but it was not by choice,” the complaint claims. “Any ignorance Defendants may have had to GirlsDoPorn’s illegal business practices prior to October 2019 is a direct result of Defendants’ own negligence, recklessness, or willful desire to remain ignorant, which is no defense under Section 1595.”
In addition to certifying the class action and a jury trial, the plaintiffs seek damages exceeding $1 million for each member of the class, restitution for what CCBill and Epoch earned from GirlsDoPorn, punitive damages, and attorney fees.
CCBill and Epoch did not respond to requests for comment. Fiserv, which owns First Data, and Total System Services did not immediately respond to comment requests.
Connexion
