hylobates@jlai.lu to memes@lemmy.world · 1 month agoBrowsing ain't fun anymorejlai.luimagemessage-square68linkfedilinkarrow-up1641
arrow-up1641imageBrowsing ain't fun anymorejlai.luhylobates@jlai.lu to memes@lemmy.world · 1 month agomessage-square68linkfedilink
minus-squarehylobates@jlai.luOPlinkfedilinkarrow-up13·1 month agoUnfortunately, yes it does. Unless I want it to collapse regularly.
minus-squaredesertdruid@lemmy.blahaj.zonelinkfedilinkarrow-up12·1 month agoit kinda does when the web is being scraped by bots to fuel the LLMs
minus-squareSpice Hoarder@lemmy.ziplinkfedilinkarrow-up1·1 month agoBanning crawlers doesn’t have to affect UX for humans. And you can whitelist your favorite crawlers too if that’s your thing.
minus-squareSpice Hoarder@lemmy.ziplinkfedilinkarrow-up2·1 month agoWatch out, you’ll anger the hive mind.
deleted by creator
Unfortunately, yes it does. Unless I want it to collapse regularly.
it kinda does when the web is being scraped by bots to fuel the LLMs
Banning crawlers doesn’t have to affect UX for humans. And you can whitelist your favorite crawlers too if that’s your thing.
deleted by creator
Watch out, you’ll anger the hive mind.