maam@feddit.uk to Linux@programming.dev · 6 months agoLinux traffic has grown 22.4% in PH this yearfeddit.ukimagemessage-square83linkfedilinkarrow-up1539
arrow-up1539imageLinux traffic has grown 22.4% in PH this yearfeddit.ukmaam@feddit.uk to Linux@programming.dev · 6 months agomessage-square83linkfedilink
minus-squarerealitaetsverlust@piefed.ziplinkfedilinkEnglisharrow-up0·6 months agoI would expect AI scrapers to fake a windows user-agent tbh.
minus-squareWhelks_chance@lemmy.worldlinkfedilinkarrow-up0·6 months agoWhy? Isn’t it likely that it’ll just report e.g. “python-requests” for the user agent, and it’s up to the server side to decide what that means?
minus-squarerealitaetsverlust@piefed.ziplinkfedilinkEnglisharrow-up0·6 months agoThat user agent would make them easily identifiable and therefore blockable. It’s more likely that they are trying to hide as a legitimate user.
I would expect AI scrapers to fake a windows user-agent tbh.
Why? Isn’t it likely that it’ll just report e.g. “python-requests” for the user agent, and it’s up to the server side to decide what that means?
That user agent would make them easily identifiable and therefore blockable. It’s more likely that they are trying to hide as a legitimate user.