Web Scrapers Have Bigger-Than-Perceived Impact on Digital Businesses

It’s a sobering thought when you realise you’re spending a significant chunk of your infrastructure budget on bad bots…:

[…] The study shows that while humans and “good bots” — such as those used by search engines— represented a substantial proportion of web traffic, “bad bots” represented a significant proportion as well. Nearly 17% of all traffic on e-commerce websites, for example, was comprised of bad bots. On travel sites, the proportion was closer to 31% and on media sites around 9.5%.

Patel says bad bots are bots that crawl websites to perform abusive or malicious actions, including account takeover and content plagiarism. Such bots often mimic human behavior and use multiple IPs to evade detection.

[…]

Original article here