How is this possible? A quick search of developer job postings for web scrapers, bot builders, etc will generate a long list of results. There are indeed many job seekers and freelancers boasting of skills in automating the completion of forms (form SPAM) and web scraping (content/data theft). When you search online for “web scrapers” you will find many solutions. Some software for scraping is sold preconfigured to crawl directories or other specific websites. Also there are Scraping as a Service providers.
Within the article it vaguely discusses the next steps that EasyJet will take – the problem is that they have to take all of these steps retroactively. Sure, it’s possible to take web scrapers to court – but the lengthy trial and legal fees for litigation are definitely going to add up. In addition, taking them to court does NOT stop all of the other possible hundreds of scrapers out there who will continuously try to steal their data – it’s just a vicious cycle unless the data owners (EasyJet) are able to stop the problem altogether.
WSS’ specialty is in separating human web traffic from the bots and web scrapers – ultimately blocking those malicious website scrapers that are stealing your prices, images, and travel listings. The old adage is certainly true here: “An ounce of prevention is worth a pound of cure”. More often than not, our customers come to us after they’ve experienced a problem. And yes, we solve their problems moving forward, but it is far more cost effective to protect your websites before the damage occurs.
Upon seeing this article on easyJet, our team took a good look at our travel customers and that industry in general – and we saw some alarming numbers, like the number of uniquely identifiable “fingerprints” we found for web scrapers on travel web sites.
- How the industry has changed with new website aggregators (or meta searches)
- Just how much traffic across the travel industry is from bad bots
- Where the bots (scrapers) are coming from
- And much more