cross-posted from: https://realbitcoin.cash/post/349131
I guess Anubis also prevents “good” bots such as search engine bots to access a webpage…
You must log in or register to comment.
Anubis should add an option to “trust” certain tokens or public keys, so good scrapers like Internet Archive can get past.
--user-agent "Mozilla/5.0 (X11; Linux x86_64; rv:154.0) Gecko/20100101 Firefox/154.0 Scrapping-For-Research-Hope-Its-Okay"Here, It’s disclosed, no?
