Quite frequently I come across scanned books that are viewable for free online. For example, the publisher put them there (such as preview chapters), a library (old books from their collection that are in public domain), etc. Since I like hoarding data, and the online viewers that are used to present the book to me might not be very practical, I frequently try to download the books one way or another. This requires toying with the “inspect element” tool and various other methods of getting the images/PDF. Now, all that I access is what is, well, accessible; I don’t hack into the servers or something. But - the stuff is meant to be hidden from the normal user. Does that act of hiding the material, no matter how primitive and easily circumvented, mean that I’m not allowed to access it at all?

I suppose ripping a public domain book is no big deal, but would books under copyright fare differently?

Mainly I’m asking out of curiosity, I don’t expect the police to come visit me for ripping a 16th century dictionary.

Note: I live in EU, but I’d be curious to hear how this is treated elsewhere too.

Edit: I also remembered a funny trick I noticed on one site - it allows viewing PDFs on their website, but not downloading, unless you pay for the PDF. But when you load the page, even without paying, the PDF is already downloaded onto your computer and can be found in the browser cache. Is it legal to simply save the file that is already on your computer?

  • ulterno@lemmy.kde.social
    link
    fedilink
    English
    arrow-up
    26
    arrow-down
    1
    ·
    edit-2
    6 days ago

    viewable for free online

    If you are viewing it on your computer, you have already downloaded it.
    Don’t let anyone tell you otherwise.

    already downloaded onto your computer and can be found in the browser cache

    Exactly.

  • Vipsu@lemmy.world
    link
    fedilink
    English
    arrow-up
    57
    arrow-down
    4
    ·
    6 days ago

    According to the big tech its ok if you’re training large language model with it.

      • SlothMama@lemmy.world
        link
        fedilink
        arrow-up
        4
        ·
        6 days ago

        Unironically yes, you would not know who Spiderman was without viewing a copyrighted work demonstrating what he looks like, and now you understand while generative AI fundamentally has to ingest copyrighted works.

    • lugal@lemmy.world
      link
      fedilink
      arrow-up
      14
      ·
      6 days ago

      You’re confusing the law that applies for the ruling class with the one that applies to common people

      • Mango@lemmy.world
        link
        fedilink
        arrow-up
        2
        ·
        6 days ago

        There’s a law for the ruling class? I always figured they gotta just cut their political buddies in.

  • simple@lemm.ee
    link
    fedilink
    arrow-up
    55
    ·
    6 days ago

    AFAIK web scraping (the act of grabbing and downloading any data you see available on the internet) isn’t illegal, and I would assume downloading PDFs provided to you online would fall under that. Since it is copyrighted it would probably be illegal to share it, though.

    • nvermind@lemm.ee
      link
      fedilink
      arrow-up
      25
      arrow-down
      1
      ·
      edit-2
      6 days ago

      This. In a case around LinkedIn courts ruled that in the US it’s legal to scrape publicly available data. The company doing the scraping was selling that data to corporate customers, but ultimately use might depend on the information you’re accessing and under what permissions. (Not a lawyer)

      • papalonian@lemmy.world
        link
        fedilink
        arrow-up
        1
        ·
        5 days ago

        If you scraped a pirate site and stored a bunch of links to copyrighted content you’d probably be fine, actually using those links to download or share copyrighted content is what’s illegal. It’d be like buying the stuff to make a bomb or drugs, but then not making any bombs or drugs.

        That being said, while not necessarily illegal, I wouldn’t want authorities to find my bomb and drug ingredients, or my scraped piracy links, as I’d probably have some 'splainin to do.

        (Not a lawyer)

          • papalonian@lemmy.world
            link
            fedilink
            arrow-up
            1
            ·
            5 days ago

            Who said that you can’t scrape content from the other place?

            If you scraped a pirate site and stored a bunch of links to copyrighted content you’d probably be fine,

            If you’re referring to the last line, I say I wouldn’t want authorities to find it because I don’t want to have to explain it. I’m 99% sure someone would not just store links to a bunch of pirated content for fun, they probably have accessed said pirated content, now you have to explain to the authorities why you have links to pirated content without implicating yourself in copyright infringement.

            Like I said, probably fine, I just wouldn’t want the hassle if I somehow got caught.

              • papalonian@lemmy.world
                link
                fedilink
                arrow-up
                1
                ·
                5 days ago

                Sorry man, I’m not exactly sure what you’re asking.

                If you are able to load the content on your computer without infringing copyright laws, you’re allowed to circumvent whatever the website has in place to store whatever data you would like from whatever website you would like, regardless of the nature of the site, so long as the content is legal (is not CP) and again not being presented in a way that infringes aforementioned copyright laws.

                If you’re asking why the copyright laws exist, I can’t really help you with that one.

  • Excrubulent@slrpnk.net
    link
    fedilink
    English
    arrow-up
    14
    arrow-down
    1
    ·
    edit-2
    5 days ago

    I’d say if the copyright holder says you’re not allowed to then you’re not. It’s piracy.

    People will tell you that you’ve already downloaded the data so saving it is fundamentally, technically no different, but that doesn’t matter to the law, it’s still piracy.

    Like yeah, it’s absurd and pointless and anti-consumer and anti-knowledge and unenforceable and unsustainable, but that’s copyright. It’s always been that way.

    Copyright destroys culture and piracy is our ethical duty in the face of that. The only reason to care about it is so you don’t get caught.

      • Excrubulent@slrpnk.net
        link
        fedilink
        English
        arrow-up
        1
        ·
        4 days ago

        Sure, and I’d say that’s piracy too. I wouldn’t mind if it wasn’t also being siloed into private hands to enrich the wealthy and screw the rest of us.

  • slazer2au@lemmy.world
    link
    fedilink
    English
    arrow-up
    39
    ·
    6 days ago

    As with everything with the law, it depends.

    In Australia, distribution is the illegal part, seeding/sharing is where they get you. Not the actual download itself.

    • leisesprecher@feddit.org
      link
      fedilink
      arrow-up
      6
      ·
      6 days ago

      It’s usually not a question of legality, but efficiency.

      It’s easy and efficient to bust someone for seeding, but busting hundreds for the odd file you can prove they downloaded is expensive and takes forever.

      • voracitude@lemmy.world
        link
        fedilink
        arrow-up
        5
        ·
        edit-2
        6 days ago

        busting hundreds for the odd file you can prove they downloaded is expensive and takes forever.

        And might well not be legally possible if all you have is an IP address, because lest we forget:

        An IP is not an ID

  • aaaaace@lemmy.blahaj.zone
    link
    fedilink
    English
    arrow-up
    25
    ·
    6 days ago

    Ask the AI companies who scraped my sites while the media companies were DCMA-ing everything in sight and working with enforcement paid for with publuc funds to prosecute/persecute the “pirates”.

    • AwkwardLookMonkeyPuppet@lemmy.world
      link
      fedilink
      English
      arrow-up
      5
      ·
      edit-2
      6 days ago

      It’s ridiculous that Homeland Security is spending resources taking down pirate sites. That’s a department specifically created to prevent terrorism, and instead they’re operating as Pinkertons for broadcasting companies.

  • The_v@lemmy.world
    link
    fedilink
    arrow-up
    13
    ·
    6 days ago

    Not an expert, but in the U.S. making a copy of a broadcast for personal use is legal under fair-use. Anything that loads up on your computer screen you can make a copy and save it for personal use. So screen captures are by definition legal.

    How exactly you copy the material on your screen gets tricky under the DMCA clusterfuck. Breaking encryption to copy the material is illegal unless there is an valid exception for fair-use. What exactly those valid exceptions are is above my paygrade.

  • Etterra@lemmy.world
    link
    fedilink
    arrow-up
    7
    ·
    6 days ago

    It might be illegal to post it without permission, but you can download it all you damn well please and they can’t stop you. Unless it’s like government top secret something or other. In that case you probably don’t want it anywhere near your computer and should probably tell somebody where you found it.

      • steeznson@lemmy.world
        link
        fedilink
        arrow-up
        2
        ·
        5 days ago

        Astonishing listening to the news coverage of that story where the anchors were reading some terminally online nonsense from the teleprompter about Discord “Thug Shakers”

    • ulterno@lemmy.kde.social
      link
      fedilink
      English
      arrow-up
      7
      ·
      6 days ago

      should probably tell somebody where you found it

      Somebody, as in your lawyer. Who can then inform the correct authorities, while making sure you don’t become their scapegoat.

    • Excrubulent@slrpnk.net
      link
      fedilink
      English
      arrow-up
      3
      ·
      edit-2
      5 days ago

      Right click -> inspect element (Q) works.

      You can also press F12.

      And if right click is blocked, on Firefox holding SHIFT will unblock right click. There is also a plugin that does this for you.

      Often websites will put an invisible element in front of the content to intercept this trick, but you can navigate through the elements to find the one they were trying to obfuscate.

      • Buddahriffic@lemmy.world
        link
        fedilink
        arrow-up
        2
        ·
        5 days ago

        Also you can just block elements you right click on in Firefox (though this might be an option added by an add-on). If there’s hidden elements you just need to go through each of those until you can click on the one you want directly (and you can tell by what is highlighted in the inspect element mode).

        You can also hit delete in inspect element mode to remove that element. You can also edit whatever you want in the element. Makes me wish it existed back when I was doing more web dev work, would have made things a lot easier when debugging.

  • DarkThoughts@fedia.io
    link
    fedilink
    arrow-up
    12
    ·
    6 days ago

    Laws of course differ from country to country but generally if it is legally publicly available then no, it at best violates their EULA or something if you scrap such data. A company trying to prevent direct downloads cannot really charge you for you finding ways around that, because from a technical point of view the data was already cached onto your PC anyway.

    As a tip, use the browsers F12 console’s Network tab, instead of inspect element. For videos you may also try the absolute right click addon. It breaks the video player controls when enabled but often you can just right click save video if it isn’t timed out and you can also enable regular controls via right click show controls. Tools like JDownloader2 can also often scrap various files but the former methods may work better.

    • Buddahriffic@lemmy.world
      link
      fedilink
      arrow-up
      1
      ·
      5 days ago

      There’s also the video download helper add-on for Firefox that will allow you to download streams that aren’t just media files your browser can http get. Though your browser can still access those streams, it needs a script component to handle it, so the built in file downloader/saver won’t even see it as a thing to download.

            • Buddahriffic@lemmy.world
              link
              fedilink
              arrow-up
              1
              ·
              5 days ago

              Reviews say it’s adding a giant QR code to downloaded videos to get people to pay a license fee but I do not see that after downloading something just now. Though tbf, they did update it yesterday and might have removed that because of the feedback they were getting.

              Permissions look reasonable to me, based on my understanding of what they need to do for the functionality, though I suppose there is potential for abuse.

              It requires a companion desktop program for some streams, which did seem sketchy at first but I wasn’t able to find any specific claims of it doing anything undesired, just people who noped out when they saw it wanted them to install something and others who said it does function as desired. Again, hard to say if it does anything in addition to enabling some streams to be downloaded, but I haven’t noticed anything out of place on my PC since installing it either from tool-based scans or manual checks of places where malware can put itself to survive restarts.

              There were also claims that it didn’t work with YouTube in the reviews, but that doesn’t seem to be the case for me, since it does light up. Though maybe that was timing-based, too, where Google briefly managed to block it only for them to adjust.

              So I haven’t seen any of those issues but YMMV. I’m going to keep using it but will also keep an eye on it. Either way, thanks for letting me know.