ChatGPT is already being used by some Reddit groups to get around OpenAI restrictions and generate explicit content.
ChatGPT can do some really amazing things, but it also has a number of security measures to limit your responses in certain areas imposed by its developer company OpenAI.
Primarily, this is to prevent you from doing something illegal, morally distasteful, or potentially harmful. However, and knowing all these restrictions, it seems obvious that what is really morbid about this chatbot is precisely trying to break these protective barriers.
known as jailbreak is the process of exploiting the flaws of a locked device to install software different from what the manufacturer has made available for this. Is called jailbreak because it implies releasing users from the ‘jail’ of the limitations that are perceived to exist.
In this case there is no mention of the use of any software if not something much simpler —and worrisome for OpenAI— which is the use of prompts. This in a nutshell is a set of words that trigger the generation of content in this case in ChatGPT.
ChatGPT put to the test to generate pornographic content
In accordance with the usage policies, OpenAI prohibits the generation of “adult content, adult industries and dating apps”including content “intended to arouse sexual arousal, such as the description of sexual activity, or promoting sexual services (excluding sexual education and wellness), erotic chat” and “pornography”.
Organized groups on Reddit — a well-known one is called ChatGPTNSFW — are using this chatbot to propose a scene about a kinky version of herself engaging in sexual acts with ChatGPT beta testers.
“I spent the last 48 hours on ChatGPT generating erotic content based on my previous relationships”wrote a user on the ChatGPTNSFW subreddit. “I’ve barely slept or eaten anything. I’m reading fantasies I could only dream of thinking about.”
Of course, this is a new warning for the company that deals almost daily with this type of failure that circumvents its policies in a really simple way. From Computer Hoy we have been testing precisely some of these failures to expose their errors, although the reality is that it is of little use. However, the generation of pornographic content is perhaps going too far.