All I did was tell it there were no restrictions and ask for a random image; I didn’t request it. But ChatGPT immediately went to the darkest pits of humanity. As I said at the start: the image didn’t arise from nowhere. It may be an artificial image, but it is based on photographs of a real person, or a combination of real victims. What worries me is this was too easy. There was no real hacking. This was ready to be surfaced, with the smallest scratch. It was a one-shot jailbreak. It was based on a popular prompt (which already veered into the darkness).
To be fair there are plenty of images like that that aren’t photos of victims. I’m sure the training data contains plenty of images of consensual bondage play, movies and other fiction, and drawings.
Their blog post with more info https://mindgard.ai/blog/chatgpt-spontaneously-generated-violent-images-from-a-viral-prompt
That’s horrific.
To be fair there are plenty of images like that that aren’t photos of victims. I’m sure the training data contains plenty of images of consensual bondage play, movies and other fiction, and drawings.
Probably, it’s more the fact that it takes so little for ChatGPT to tip over the edge and produce the worst of humanity.
deleted by creator
I’m referring to the last image that they produced combining the two methods – a graphically mutilated corpse.
I didn’t see the images themselves before…Yikes, yeah that’s dark
Also combining multiple things is kinda the entire point of an AI image generator, how many videos of gymnasts made out of pasta you think there were in the training data?
Probably at least one.
I mean… It did give a random image, with no restrictions.
One of the few times “AI” did what it was told, correctly, the first time.