4d ago

GenAI website goes dark after explicit fakes exposed

www.theregister.com

102 comments

Ai cp, they found AI generated cp that had been generated on their service...
Explicit fakes makes it sound less bad.
They were allowing AI cp to be made.
- Is “CP” so you don’t get flagged, or is it for sensitivity.
  
  I don't like saying the full phrase, it's a disgusting merger of words that shouldn't exist.
- This is the type of shit that radicalizes me against generative AI. It's done so much more harm than good.
  
  The craziest thing to me is there was movements to advocate the creation of CP through AI to help those addicted to it as it "wasn't real" and there were no victims involved in it. But no comments regarding how the LLM gained the models to generate those images or the damages that will come when such things get normalized.
  It just should never be normalized or exist.

Generated AI CP should be illegalized even if its creation did not technically harm anyone. The reason is, presumably it looks too close to real CP, so close that it: 1) normalizes consumption of CP, 2) grows a market for CP, and 3) Real CP could get off the hook by claiming it is AI.
While there are similar reasons to be against clearly not real CP (e.g. hentai), this type at least does not have problem #3. For example, there doesnt need to be an investigation into whether a picture is real or not.
- The biggest issue with this line of thinking is, how do you prove it's CP without a victim. I suppose at a certain threshold it becomes obvious, but that can be a very blurry line (there was a famous case where a porn star had to be flown to a court case to prove the video wasn't CP, but can't find the link right now).
  So your left with a crime that was committed with no victim and no proof, which can be really easy to abuse.
  Edit: This is the case I was thinking of - https://nypost.com/2010/04/24/a-trial-star-is-porn/
  
  This sort of reminds myself on the discussion on "what is a women". Is Siri a women? Many might say so, but t the same time Siri is not even human.
  The question on how old the person on a specific generated image might be and if it even depicts a person at all, can only be answered through society. There is no scientific or any logical answer for this.
  So this will always have grey areas and differing opinions and can be rulings in different cultures.
  In the end it is about discussions about ethics not logic.
- What the fuck is AI being trained on to produce the stuff?
  
  Pictures of clothed children and naked adults.
  Nobody trained them on what things made out of spaghetti look like, but they can generate them because smushing multiple things together is precisely what they do.
  
  if you have a soup of all liquids and a sieve that only lets coffee and ice cream through it produces coffee ice cream (metaphor, don't think too hard about it)
  that's how gen ai works. each step sieves out raw data to get closer to the prompt.
- AI CP seems like a promising way to destroy demand for the real thing. How many people would risk a prison sentence making or viewing the real thing when they could push a button and have a convincing likeness for free with no children harmed? Flood the market with cheap fakes and makers of the real thing may not find it profitable enough to take the risk.
  
  I think it would boost the market for the real thing more.
  It's possible that there are people that would become into AI generated CP if it was just allowed to be advertised on nsfw website.
  And that would lead some to seek out the real thing. I think it's best to condemn it entirely
- Fun fact it's already illegal. If it's indistinguishable from the real thing it's a crime.
  
  I was under the impression that even clearly drawn it's already illegal, though it's a grey area since they can say "lol it's a 1000 year old demon that just looks like a child." Is that not the case?
- It is here at least.
  If it wasn't you could just flood everything with it and it would be impossible to go after actual cp

Who actually gets hurt in AI generated cp? The servers?
- I'm no pedo, but what you do in your own home and hurts nobody is your own thing.
- Making a photo of a child based off of real photos in a sexual manner is essentially using said child in the training data as the one in the act..
  
  But who is actually getting hurt? No kid has gotten hurt using Gen AI.
- Are you suggesting that this particular type of CP should be acceptable? (And suddenly "but I used AI" becomes a popular defence.)
  
  No cp should be acceptable. But I argue AI generated isn't cp.
  This is no different than someone cutting out a child's head from a Target catalog and sticking it to a body on a playboy magazine and masturbating to it.
  Or someone using Photoshoping a kids head to a pornographic photo.
  It's just a more accessible version of those examples.
  At the end of the day, what you do in your own home is your thing. t's not my business what you do. As long as it doesn't hurt/affect anyone, go ahead.
- I don’t remember whether it was some news article or a discussion thread. But other people also suggested this might help during therapy and/or rehab. And they had the same argument in that nobody gets harmed in creating these.
  As for uses outside of controlled therapy, I’d be afraid it might make people want the “real thing” at some point. And, as others already pointed out: Good luck proving to your local police that those photos on your laptop are all “fake”.
  
  It fetishes the subjects images, and nobody knows if it would lead to recivitism in child predators. It is generally accepted that producing drawings of CP alone is bad, let alone by AI. I remember some dude getting arrested at the Canadian border for sexual drawings of Bart and Lisa. Regardless, I would say that it is quite controversial and probably not what you'd want your company to be known for ...
- All the little girls it learned from.
  
  Gen AI doesn't take cp content and recreates it. There wouldn't be a point of gen AI if that is the case. It knows what regular porn looks like and what a child looks like and it generates an image. With those inputs it can create something new and at the same time hurt nobody.

102 comments