In the end for any scraping they're just raising the barrier of entry. Automated browsers, residential proxies, captcha services just make it more involved for those determined to hit a URL successfully.
Not necessarily a bad thing, but the line and grey area and the definition of a 'legitimate' request varies, and one entity as a middle-man deciding that is less than ideal.
For legitimate interests today including search engines and services for price comparison that data is often provided for free.
There are design patterns used today that does among other things provide incorrect prices to scrapers.
Scraping is illegal in most western countries btw.
Can you explain that further in the context of search engines, new or existing, need to crawl websites and Cloudflare are a barrier to entry? You seem to contradict yourself.
>There are design patterns used today that does among other things provide incorrect prices to scrapers.
If you say so, and hopefully they do it 100% correctly.
