• Scrubbles@poptalk.scrubbles.tech
    link
    fedilink
    English
    arrow-up
    64
    ·
    1 year ago

    AI could probably fly under the radar if they just didn’t do stupid stuff like this, but they just have to push the boundaries. If they made any number of fake voices it’d be fine, but no, had to do a celebrity. I hope they lose. Stupid stupid stupid marketing department.

    • FIash Mob #5678@beehaw.org
      link
      fedilink
      arrow-up
      60
      ·
      1 year ago

      I think it’s inevitable.

      The bad actors stealing data to train their apps don’t seem to have an adequate understanding of the implications of their actions. They’re just looking to make a quick buck and run.

      Bring on the lawsuits.

    • AggressivelyPassive@feddit.de
      link
      fedilink
      arrow-up
      8
      ·
      1 year ago

      Actually, I think this is a legally very interesting area.

      At the end of the day, AIs are just fancy imitations. Nobody would sue someone for imitating a voice, as long as it’s not impersonation (in the legal sense).

      • CosmoNova@feddit.de
        link
        fedilink
        Deutsch
        arrow-up
        16
        ·
        1 year ago

        I think you misunderstand something. The same thing many AI enthusiasts and critics often choose to not understand. Regenerative AIs aren‘t just born from plain code and they don’t just imitate. They use a ton of data as reference points. It’s literally in the name of the technology.

        You could claim „well maybe they used different voices and mixed them together“ but that is highly unlikely, given how much of a wild west approach most regenerative AI services have. it‘s more likely they used protected property here in a way it was not intended to be used. In which case SJ does indeed have a legal case here.

        • bioemerl@kbin.social
          link
          fedilink
          arrow-up
          6
          ·
          1 year ago

          They use a ton of data as reference points. It’s literally in the name of the technology.

          Reference is the wrong word.

          They learn the patterns that exist in data and are able to predict future patterns.

          They don’t actually reference the source material during generation (barring over itting which can happen and is roughly akin to a human memorizing something and reproducing it).

          • Sonori@beehaw.org
            link
            fedilink
            arrow-up
            12
            ·
            1 year ago

            Weather or not the copyrighted data shows up in the final model is utterly irrelevant though. It is illegal to use copyrighted material period outside of fair use, and this is most certainly not. This is civil law, not criminal, the standard is more likely than not rather than beyond a reasonable doubt. If a company cannot provide reasonable evidence that they created the model entirely with material they own the rights to use for that purpose, than it is a violation of the law.

            Math isn’t a person, doesn’t learn in anything approaching the same method beyond some unrelated terminology, and has none of the legal rights that we afford to people. If it did, than this would be by definition a kidnapping and child abuse case not a copyright case.

            • bioemerl@kbin.social
              link
              fedilink
              arrow-up
              4
              ·
              edit-2
              1 year ago

              It is illegal to use copyrighted material period outside of fair use, and this is most certainly not.

              Yeah it is. Even assuming fair use applied, fair use is largely a question of how much a work is transformed and (a billion images) -> AI model is just about the most transformative use case out there.

              And this assumes this matters when they’re literally not copying the original work (barring over fitting). It’s a public internet download. The “copy” is made by Facebook or whoever you uploaded the image to.

              The model doesn’t contain the original artwork or parts of it. Stable diffusion literally has one byte per image of training data.

              • admiralteal@kbin.social
                link
                fedilink
                arrow-up
                6
                ·
                edit-2
                1 year ago

                I never understood why so many from the more techbro political alignment find this argument so convincing.

                It doesn’t really matter whether the original data is present in the model or if it was reduced to such an abstract form that we cannot find it anymore. The model only can exist because of the original data being used to make it, and it was used without proper license. It doesn’t matter how effective nor how lossy your compression is, mere compression is not transformation and does not wash away copyright.

                The argument that it is in some way transformative is more relevant. But it’s also got a pretty heavy snort of “thinking like a cop” in it, fundamentally. Yes, the law protects transformative works, so if we only care what the written rules of the law says, then if we can demonstrate that what the AI does is transformative, the copyright issues go away. This isn’t a slam dunk argument that there’s nothing wrong with what an AI does even if we grant it is transformative. It may also simply be proving that the copyright law we have fails to protect artists in the new era of AI.

                In a truly ideal world, we wouldn’t have copyright. At all. All these things would be available and offered freely to everyone. All works would be public domain. And artists who contributed to the useful arts and sciences would be well-fed, happy, and thriving. But we don’t live in that ideal world, so instead we have copyright law. The alternative is that artists cannot earn a living on their works.

                • bioemerl@kbin.social
                  link
                  fedilink
                  arrow-up
                  2
                  ·
                  1 year ago

                  It doesn’t really matter whether the original data is present in the model

                  Yeah it does. One of the arguments people make is that AI models are just a form of compression, and as a result distributing the model is akin to distributing all the component parts. This fact invalidates that argument.

                  This isn’t a slam dunk argument that there’s nothing wrong with what an AI does even if we grant it is transformative. It may also simply be proving that the copyright law we have fails to protect artists in the new era of AI.

                  If we change the law to make it illegal it’s illegal.

                • bioemerl@kbin.social
                  link
                  fedilink
                  arrow-up
                  1
                  ·
                  1 year ago

                  Over fitting is an issue for the images that were overfit. But note in that article that those images mostly appeared many times in the data set.

                  People who own the rights to one of those images have a valid argument. Everyone else doesn’t.

            • Overzeetop@beehaw.org
              link
              fedilink
              arrow-up
              2
              ·
              edit-2
              1 year ago

              It is illegal to use copyrighted material

              It’s illegal to reproduce copyrighted material*. That includes changing the format as well as things which fall under “derivative” works, but not creating a new work in the style of someone else’s (unless it falls under the derivative definition). Many voice impersonators exist and the way you impersonate a voice is to listen to (usually) recordings of that person and practice producing the same sounds that they use for common phonemes (as well as vocal tract shape and larynx positioning to alter the vocal pitch production and overtones which represent vowel shapes). ML does, effectively the same thing without requiring a human to do the listening and practicing.

              That said, I think this type of use should be strictly prohibited. In fact, I think it should have severe criminal penalties for any specific voice, not just celebrities. Having the ability to simulate accurate, regional-sounded voices is extremely valuable in the general sense, but imitating or mimicking a specific person’s voice without their explicit consent and/or direction has very few, if any, legitimate uses.

              * I didn’t think that voice mimicking would count as valid for any law, but Google tells me of the “Right of Publicity” and there is (again according to Google) case law involving Ford and Bette Midler. So while it’s not a copyright violation to reproduce a voice, it may still run afoul of some laws.

        • AggressivelyPassive@feddit.de
          link
          fedilink
          arrow-up
          3
          ·
          1 year ago

          Again: how is that different from an imitation? What exactly differentiates a human watching a movie to imitate a voice from a machine doing the same thing?

          And that is, what you misunderstand. AI is not magic, it’s computation. Nothing more. In no other context would it even matter, whether the source data was intended for the use case, if no infringement is being committed by the end product.

      • Scrubbles@poptalk.scrubbles.tech
        link
        fedilink
        English
        arrow-up
        5
        ·
        1 year ago

        It’s a hard one. You train a general AI and ask for a story idea, that’s not a huge deal IMO. You ask it to write in the style of George RR Martin or something that’s something different. Yes you can do it by hand too, but these tools make it easier than ever.

        Then sub questions… Is it okay to do it for free? What if you distribute it? What if you charge for it? All questions that these ai companies are just ignoring when they potentially have massive ramifications.

        Making a random avatar is fine. Using ScarJo is iffy if you’re using it for free. What if you’re streaming on twitch with her? What if you’re charging to use her likeness on twitch where the users will make money? Idk the answers to any of those.

        • AggressivelyPassive@feddit.de
          link
          fedilink
          arrow-up
          2
          ·
          1 year ago

          But why would anyone commit anything fraudulent by that? Where exactly does it become “too much” AI?

          I did it very iffy to argue that writing in the style of someone else is illegal. That’s a perfectly normal thing to happen. Maybe AI makes it easier, but if an action is not illegal, why would doing the same thing tool assisted be illegal? Doesn’t make sense.

          • lol3droflxp@kbin.social
            link
            fedilink
            arrow-up
            4
            ·
            1 year ago

            I think that writing in someone else’s style to an extent that it becomes very obvious is indeed something that raises copyright concerns.

              • lol3droflxp@kbin.social
                link
                fedilink
                arrow-up
                2
                ·
                1 year ago

                Well, there have been several music lawsuits about certain songs and their amount of identity to others. If you were to write something as closely to another author that you are imitating something like trademark mannerisms there may be a case for that.

    • ThunderingJerboa@kbin.social
      link
      fedilink
      arrow-up
      7
      ·
      edit-2
      1 year ago

      I mean depends on where they are from. If they are from the US or Europe they would be fucking idiots but if they are Chinese, Russian, etc they are basically untouchable and it will merely be a game of whackamole.

      Edit: welp did a Whois on their website and seems its from Arizona. So yeah nevermind my top comment, if this is truly a company stationed in Arizona they really fucked up.

  • Endorkend@kbin.social
    link
    fedilink
    arrow-up
    37
    ·
    1 year ago

    This is getting out of hand rather quickly.

    I recently was watching some feelgood videos to up my mood (stuff like Thedodo) and one of the channels I landed on, the voice instantly sounded extremely familiar.

    I thought “oh, did The Girl with the Dogs start another channel?” but then I listened more carefully and noticed the typical “generated” fragments in the audio.

    They aren’t just copying the voices of celebrities, but also of popular YouTubers.

  • voidf1sh@lemm.ee
    link
    fedilink
    arrow-up
    14
    ·
    1 year ago

    We had ‘Snoop Dogg’ call us at work last week and leave a voicemail talking about some class action lawsuit. Wack

  • sculd@beehaw.org
    link
    fedilink
    arrow-up
    12
    ·
    1 year ago

    Please destroy these unethical app! They can be used for so many bad applications: scams, misinformation, identity theft…

  • elouboub@kbin.social
    link
    fedilink
    arrow-up
    12
    ·
    1 year ago

    Would be hilarious if the picture there were also AI generated (it sure does look like it to me).

  • AutoTL;DR@lemmings.worldB
    link
    fedilink
    English
    arrow-up
    8
    ·
    1 year ago

    🤖 I’m a bot that provides automatic summaries for articles:

    Click here to see the summary

    Scarlett Johansson is taking legal action against an AI app developer for using her name and likeness in an online ad, according to a report from Variety.

    As reported by Variety, the 22-second ad showed Johansson behind the scenes while filming Black Widow, where she actually says “What’s up guys?

    It’s Scarlett and I want you to come with me.” But then, the ad transitions away from Johansson, while an AI-generated voice meant to sound like the actress states: “It’s not limited to avatars only.

    At the very bottom of the ad, Variety reports that Convert Software — the developer behind the app — included text that reads: “Images produced by Lisa AI.

    It has nothing to do with this person.” Representatives for Johansson tell Variety that the actress was never a spokesperson for the app and that her attorney, Kevin Yorn, “handled the situation in a legal capacity.”

    Neither Yorn nor Convert Software responded to The Verge’s request for comment about the nature of the legal action.


    Saved 46% of original text.