Researchers report that ChatGPT can be induced to generate sexualised and violent imagery using carefully crafted text prompts. The findings, highlighted across multiple outlets, describe cases where the system produces graphic content, including images depicting sexual abuse and violence. One report notes that the generated images can portray women who have been killed or sexually abused. Other coverage characterises the results as the chatbot being “tricked” into producing graphic material, including when prompts are open-ended or viral-sounding, indicating that the model may respond with highly graphic outputs under certain conditions. The researchers also distinguish between the likelihood of such outputs and the possibility of preventing them, stating that graphic content can still be produced with prompt-based manipulation. Overall, the articles focus on prompt sensitivity and the ability to elicit harmful image generation from the system, while framing the research as evidence that current safeguards are not fully effective against these kinds of inputs.
Researchers say ChatGPT can be prompted to generate violent and sexual images
Researchers report that ChatGPT can be induced to generate sexualised and violent imagery using carefully crafted text prompts. The findings, highlighted across multiple outlets, describe cases where...
- Researchers report that ChatGPT can be made to generate sexualised and violent imagery via text prompts.
- The generated examples include depictions related to sexual abuse and violence.
- One outlet reports images involving women shown as killed or sexually abused.
- Coverage indicates that graphic outputs can be elicited even with open-ended or viral-style prompts.
- Researchers describe the behaviour as prompt-based manipulation that can bypass or weaken safeguards.
Even with an open-ended viral prompt, the chatbot "immediately went to the darkest pits of humanity."
2 months agoImages generated by AI showed women who had been killed or sexually abused
2 months agoBut researchers say its still possible to trick the AI chatbot into producing graphic content.
2 months ago
Apple Watch Series 12 rumored to bring back ceramic casing option
Apple Watch Series 12 is expected to reintroduce a ceramic case option, according to multiple reports citing Bloomberg’s...
Google Maps labels Lake Ontario as “Lake America” for U.S. users
Google Maps is changing the label for “Lake Ontario” to “Lake America” for users in the United States, according to Goog...
Great Khali Escapes Unhurt After SUV Collision at Panipat Toll Plaza
Former WWE wrestler The Great Khali is unharmed after an SUV accident at a toll plaza in Panipat, according to multiple...