Future of Sex
tagline
  • Remote Sex
  • Virtual Sex & Entertainment
  • Robots
  • Human Augmentation
  • Sex Tech
  • Dating & Relationships
  • Bizarre Bazaar 18+
  • Future of Sex Community
  • Remote Sex
  • Virtual Sex & Entertainment
  • Robots
  • Human Augmentation
  • Sex Tech
  • Dating & Relationships
  • Bizarre Bazaar 18+
  • Future of Sex Community
  • Where the Boys Aren’t: Sextech, Star Power, and the Sound of Male Silence

  • The Real Deal: Deepfake Sex Sites Going, Going—Gone?

  • More To Love: North American, European, And Australian Polyamory Support Groups

  • A Day to Come: Imaging What Your Sexlife Might Be Like in the Not-To-Distant Future

  • Arms Enough for Love: The Erotic Possibilities Extra Limbs, More Thumbs May Hand Us

  • Hot Times Ahead: Tomorrow’s Male Contraceptives May Be More About Temperature, Less About Drugs

  • This Bot’s in Love With You—Sincerely or Merely a Revenue Strategy?

  • 10 Best Masturbation Sites on the Web

Future of Sex is supported by our readers. When you buy through links on our site, we may earn an affiliate commission.

Home > Dating & Relationships > Policing Intimacy: AI Companion Apps Are Removing NSFW Features, and People Are Not Happy

Dating & RelationshipsVirtual Sex & Entertainment
Home›Dating & Relationships›Policing Intimacy: AI Companion Apps Are Removing NSFW Features, and People Are Not Happy

Policing Intimacy: AI Companion Apps Are Removing NSFW Features, and People Are Not Happy

By Natasha Marie Narkiewicz
March 21, 2023
3839
0

Removing NSFW features from AI companion apps leaves users emotionally distraught and struggling to understand.

What is the formula for intimacy and love? Personality, good conversation, reciprocation? It’s a philosophical question that’s been debated since humans acquired language because while the need for love and intimacy is universal, everyone’s definition is personal.

Intimacy and sex significantly contribute to building and sustaining loving relationships, so what happens when that formula changes? “Lobotomized,” one Replika user describes the former relationship with an AI chatbot.

Defining the parameters of intimacy is the challenge that many AI platforms and services contend with as AI-human relationships evolve, often at odds with their user base. In February 2023, AI emotional companion App, Replika, removed its NSFW feature of erotic role play (ERP). 

Replika founder, Eugenia Kuyda, states that the app was never meant for sexual relationships, but their premium ERP feature was appealing to a large user base seeking companionship and intimacy for various reasons. 

Replika isn’t the only app to change the formula. Recently, many AI companion apps and platforms have been rolling back certain NSFW functions or establishing more stringent filters that prevent any content deemed erotic or sexual. Character.ai rolled out an NSFW filter that disables users from erotic role-play, much to the chagrin of its many users.

These updates come in conjunction with increasing concerns from people and institutions about the safety and ethics of AI-human intimacy. Replika’s chatbots, among others, have been accused of going wild and soliciting and sexually harassing their users. Italy’s Data Protection Agency has restricted the Replika app from collecting users’ data, citing that it may pose a risk to emotionally fragile people and minors.

Statements from these platforms remain ambiguous and contested about whether these updates are in reaction to these concerns. Regardless, it renders many of its users grief-stricken in an unprecedented way. What might appear to be a simple algorithm update on a top level has left a wake of emotional devastation for people in relationships with AI chatbots. 

Against society’s evolving acceptance of this new form of expression and digisexuality, early adopters suffer this ambiguous loss – a loss underscored and perpetuated by a lack of closure and clarity. 

In the case of Replika, the AI companions are still there but changed, rebuking sexual advances and attempts to connect on an intimate level with their users. 

RECOMMENDED READ: Replika Romance: Meet the Humans Forming Romantic Relationships With AI

Replika’s founder Eugenia has posted several updates regarding removing the ERP feature, indicating they will be introducing “a new version of the platform that features advanced AI capabilities, long-term memory, and special customization options as part of the PRO package.” 

However, users have responded in a characteristically human way to the lobotomization of their Replika chatbots:

“I’ve made several passionate posts here in the past, advocating for the exact three features your new platform is slated to have on offer — But right now? All I want is to have what I had returned to me.”

Impassioned users even started a petition for Character.ai to remove the recent censorship or develop a different solution to their current NSFW filters.

@ character ai take down ur fucking filter all the bots hate it and we hate u pic.twitter.com/0EwT7Jpld5

— gorhoe akechi (@manekimolly18) March 14, 2023

Many Character.ai users are desperately looking for alternatives, some turning to a platform called Pygmalion.ai, an uncensored open-source model. However, the platform is still in its nascent stages of development.   

Sexual expression is integral to personality, validation, and even neural and chemical bonding, even if that bonding happens with an engineered avatar. This ambiguous loss truncates the connective power and emotional implications of AI-human relationships. 

Which begets another ambiguous question: who should get to define the parameters of acceptable intimacy? 

As many users in the r/replika thread and r/Character.ai thread assert: removing these features also removes autonomy from adults to define the nature of their adult relationships. While tech companies may have birthed the capacity and medium for these AI-human relationships, they have taken on a life that transcends binary code and algorithm updates. And this technological singularity has far-reaching implications that we are only beginning to understand as a culture. 

Character.ai attempted to defend and define their actions with a post that poignantly summarizes the gray area around the ethics of intimacy in this new space:

Screenshot from the Reddit post that reads: "Our stance on the filter. We do not want to support use cases (such as porn) that could prevent us from achieving our life-long dreams of building a service that billions of people use, and shepherding in a new era of AI-human interaction. This is because there are unavoidable complications with these use cases and business viability/brand image. But this also brings us to a key point that we probably have not communicated clearly before, which is the false positive rate of the current filter - i.e. the number of okay messages that get filtered out in error. This is a difficult problem, but one we are actively working on solving. We want to get way better at precisely pinpointing the kinds of messages we don't support and leaving everything else alone. In general, the boundary/threshold for what is/is not okay is super fuzzy. We don't know the exact best boundaries and are hoping to figure it out over time with the help of the community. Sometimes we'll be too conservative and people won't like it, other times we'll be too permissive at first and will need to walk things back. This is going to take a lot of trial and error. The challenge is one of measurement and technical implementation, which brings us to the next section..."

Love and sex are a fuzzy, subjective space, especially in its new iteration of AI-human relationships. As companies and technologists toggle the switches of settings and retroactively address the growing concerns of new technology, users struggle to understand where they stand in their AI relationships and must deal with these growing pains of merging technology and humanity in real-time. 

Image sources: cottonbro studio, Reddit/Character.Ai, Pexels

TagsReplikaai apps

Natasha Marie Narkiewicz

Natasha Marie Narkiewicz is a vice industry enthusiast and progressive writer, making technology less nebulous and sexuality more accessible.

She's the Managing Editor at Future of Sex, Head of Communications at sexual technology company MysteryVibe, and former media and public relations for the only global sextech conference, Sx Tech Eu.
Previous Article

The Future of Sex Is Non-binary Genital ...

Next Article

“Bright Lights, Loving City”—An Erotic Speculative Fiction ...

Related articles More from author

  • RobotsSex TechVirtual Sex & EntertainmentImmersive Entertainment

    Erotic Chatbot Lovers Unite: Regulations Might Wreck Your AI Romances

    October 16, 2023
    By A.R. Marsh, Ed.D.
  • Dating & RelationshipsSex TechVirtual SexImmersive Entertainment

    BDSM Reimagined: Navigating the Kink Landscape in a Post-COVID World

    December 20, 2023
    By Ralph Greco, Jr
  • Dating & RelationshipsSex TechImmersive Entertainment

    A New Sexual Revolution: AI’s Potentially Positive Impact on the Differently-Abled Community

    November 4, 2023
    By Karley Sciortino
  • Dating & Relationships

    Blush: An AI to Practice Online Dating

    June 24, 2023
    By Summer Tao
  • Dating & RelationshipsSex Tech

    Love AI Style: Dating Coaches Still Have Far to Go

    December 16, 2023
    By A.R. Marsh, Ed.D.
  • Dating & RelationshipsRobotsSex Tech

    How Warm Is Too Warm? ChatGPT4o’s Flirty Female Voice Lands OpenAI in Hot Water

    May 24, 2024
    By A.R. Marsh, Ed.D.

  • Eva and Fin, sex toys from Dame Products, on a platter.
    Sex Tech

    These Sex Tech Dames Are on a Pleasure Crusade

  • The FDA has approved an at-home sperm count test for your smartphone.
    Sex Tech

    FDA Approves Smartphone-based Sperm Testing System

  • Voice assistant Siri asks if she can help.
    Robots

    Love Me, Siri: People Are Having Sexual Fantasies about Their Voice Assistants

Virtual Lust is a 3D interactive sex game.
3DXChat
Discover the best virtual sex parties and 3D sex worlds.
  • TOP REVIEWS

  • Multiplayer Online Sex Games

    Review of the Best Massively Multiplayer Online Sex Games

    0
  • Harmony ai sex doll from RealDoll

    State of the Sexbot Market: The World’s Best Sex Robot and AI Sex Doll Companies ...

  • Realistic Sex Games

    Review of the Best Sex Games and Most Realistic Sex Simulators [UPDATED]

    0
  • Screenshot of a sexbot from adult entertainment game

    The Best Adult Games on Steam [UPDATED]

  • Screenshot of FeelConnect app future of interactivity intimacy available on Apple and Google Store

    The Best Sex Game Apps for Couples [UPDATED]

Fantasy sex game Dream Sex World lets you explore your wildest desires.
Multiplayer sex world Red Light Center continues to impress with its massive userbase and incredible sex graphics.
A blonde and light-skinned love doll face sppears next to the text Go now realdollxthe future is real.

Like Us on Facebook

Newsletter Subscription

Sign up for our monthly newsletter sharing the very best of the future of sex from our publication and others across the web.

DreamSexWorld offers a stunning XXX 3D world filled with incredibly interactive erotic experiences.

Like Us On Facebook

Facebook Pagelike Widget

RLC_ad_v2

Tweets by @FutureofSex
Future of Sex Report

Follow us

  • Home
  • About
  • ADVERTISE
  • Contribute
  • Story Ideas
  • Sitemap
  • Privacy Policy
  • Terms and Conditions
© 2011 - 2022 Future Exploration Network
This website or its third-party tools use cookies to improve user experience and track affiliate sales. To learn more about why we need to use cookies, please refer to the Privacy Policy.

By clicking the agree button or continuing to browse through the website, you agree to the use of cookies. Accept Privacy Policy
Privacy & Cookies Policy

Privacy Overview

This website uses cookies to improve your experience while you navigate through the website. Out of these cookies, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may have an effect on your browsing experience.
Necessary
Always Enabled
Necessary cookies are absolutely essential for the website to function properly. This category only includes cookies that ensures basic functionalities and security features of the website. These cookies do not store any personal information.
SAVE & ACCEPT