Lee Duna@lemmy.nz to Technology@lemmy.worldEnglish · 2 years agoEdge 118: updated on-page search may send data to Microsoftwww.ghacks.netexternal-linkmessage-square36linkfedilinkarrow-up1270arrow-down16
arrow-up1264arrow-down1external-linkEdge 118: updated on-page search may send data to Microsoftwww.ghacks.netLee Duna@lemmy.nz to Technology@lemmy.worldEnglish · 2 years agomessage-square36linkfedilink
minus-squareBuddahriffic@lemmy.worldlinkfedilinkEnglisharrow-up3·2 years agoI mean, if you want to go around what the site wants you to do, you can just ignore robots.txt. Or use it to find the juicy stuff the site would rather you didn’t.
I mean, if you want to go around what the site wants you to do, you can just ignore robots.txt. Or use it to find the juicy stuff the site would rather you didn’t.