Cloudflare Alleges AI Startup Perplexity Evades Web Crawling Blocks
Summary
Cloudflare alleges AI startup Perplexity evades web crawling blocks on thousands of domains by changing its bots' user agents and network identities, resulting in millions of unauthorized requests daily.
Key Points
- Cloudflare accuses AI startup Perplexity of scraping websites that explicitly blocked web crawling
- Perplexity allegedly circumvents blocks by changing its bots' user agents and network identities
- Cloudflare observes this activity across thousands of domains and millions of requests daily