As an experiment, I opened the firewall for Perplexity-Bot, which according to them is NOT used for GenAI training but j...

As an experiment, I opened the firewall for Perplexity-Bot, which according to them is NOT used for GenAI training but just an indexer.Prior to this, they already had access to robots.txt but despite this, don't respect the crawl-delay directive in robots.txtEnd of experiment.GFY #Perplexity#AI #Webmaster #FuckAI

Read Original

Related