A very NSFW website called Pornpen.ai is churning out an endless stream of graphic, AI-generated porn. We have mixed feelings.

  • BreakDecks@lemmy.ml
    link
    fedilink
    English
    arrow-up
    26
    ·
    1 year ago

    The actual scary use case for AI porn is that if you can get 50 or more photos of the same person’s face (almost anyone with an Instagram account), you can train your own LoRA model to generate believable images of them, which means you can now make “generic looking” porn with pretty much any person you want to see in it. Basically the modern equivalent of gluing cutouts of your crush’s face onto the Playboy centerfold, only with automated distribution over the Internet…

      • pinkdrunkenelephants@sopuli.xyz
        link
        fedilink
        English
        arrow-up
        11
        arrow-down
        7
        ·
        1 year ago

        So how will any progressive politician be able to be elected then? Because all the fascists would have to do is generate porn with their opponent’s likeness to smear them.

        Or even worse, deepfake evidence of rape.

        Or even worse than that, generate CSAM with their likeness portrayed abusing a child.

        They could use that to imprison not only their political opponents, but anyone for anything, and people would think whoever is being disappeared this week actually is a pedophile or a rapist and think nothing of it.

        Actual victims’ movements would be chopped off at the knee, because now there’s no definitive way to prove an actual rape happened since defendants could credibly claim real videos are just AI generated crap and get acquitted. No rape or abuse claims would ever be believed because there is now no way to establish objective truth.

        This would leave the fascists open to do whatever they want to anybody with no serious consequences.

        But no one cares because they want AI to do their homework for them so they don’t have to think, write, or learn to be creative on their own. They want to sit around on their asses and do nothing.

        • hyperhopper@lemmy.ml
          link
          fedilink
          English
          arrow-up
          7
          ·
          1 year ago

          People will have to learn to stop believing everything they see. This has been possible with Photoshop for even more than a decade now. All that’s changed is that it takes less skill and time now.

          • pinkdrunkenelephants@sopuli.xyz
            link
            fedilink
            English
            arrow-up
            1
            arrow-down
            5
            ·
            1 year ago

            That’s not possible with AI-generated images impossible to distinguish from reality, or even expertly done photoshops. The practice, and generative AI as a whole, needs to be banned. They’re putting AI in photoshop too so ban that garbage too.

            It has to stop. We can’t allow the tech industry to enable fascism and propaganda.

              • pinkdrunkenelephants@sopuli.xyz
                link
                fedilink
                English
                arrow-up
                2
                arrow-down
                5
                ·
                1 year ago

                Nah, that Thanos I-am-inevitable shit doesn’t work on me. They can ban AI, you all just don’t want it because generative AI allows you to steal other people’s talent so you can pretend you have your own

            • CoolCat38@lemmy.world
              link
              fedilink
              English
              arrow-up
              3
              arrow-down
              2
              ·
              1 year ago

              Can’t tell whether this is bait or if you are seriously that much of a Luddite.

              • pinkdrunkenelephants@sopuli.xyz
                link
                fedilink
                English
                arrow-up
                3
                arrow-down
                2
                ·
                1 year ago

                Oh look at that, they just released pictures of you raping a 4-year-old, off to prison with you. Never mind they’re not real. That’s the world you wanted and those are the consequences you’re going to get if you don’t stop being lazy and learn to reject terrible things on ethical grounds.

        • Silinde@lemmy.world
          link
          fedilink
          English
          arrow-up
          4
          ·
          edit-2
          1 year ago

          Because that’s called Libel and is very much illegal in practically any country on earth - and depending on the country it’s either easy or trivial to put forth and win a case of libel in court, since it’s the onus of the defendant to prove what they said was entirely true, and “just trust me and this actress I hired, bro” doesn’t cut it.

            • Silinde@lemmy.world
              link
              fedilink
              English
              arrow-up
              3
              ·
              1 year ago

              The burden of liability will then fall on the media company, which can then be sued for not carrying out due dilligance in reporting.

        • Liz@midwest.social
          link
          fedilink
          English
          arrow-up
          4
          ·
          1 year ago

          We’re going to go back to the old model of trust, before videos and photos existed. Consistent, coherent stories from sources known to be trustworthy will be key. Physical evidence will be helpful as well.

          • pinkdrunkenelephants@sopuli.xyz
            link
            fedilink
            English
            arrow-up
            2
            arrow-down
            1
            ·
            1 year ago

            But then people will say “Well how do we know they’re not lying?” and then it’s back to square 1.

            Victims might not ever be able to get justice again if this garbage is allowed to continue. Society’s going so off-track.