02
SEP
2014

Web scraping and the Computer Fraud and Abuse Act

Over the years web scraping has rapidly increased, and in 2013, about 23% of all internet traffic was scraping-related. It is extremely easy to perform as just simple online search will provide step-by-step guides of how to do it. This could also have something to do with it...
09
APR
2014

The Scraping Problem in Ticketing - View Slideshow

This is the presentation that Martin Zetterlund gave at Ticketing Technology Forum in London last month. The presentation covers how to protect ticket sales from ticket touts and other unauthorized resellers that use web bots and other scraper programs to acquire tickets against...
07
APR
2014

Google Launches Google Scraper Report Form

If you are an online publisher, it is probably annoying to see that someone is stealing your content and publishing it somewhere else online. Even worse is to see that this competing site is outranking you on Google for searches related to your own content.  If your business...
04
APR
2014

Competitor Used Scraper Bots in Order to Copy Linkedin Profiles

An American start-up called HiringSolved used an army of scraper bots in order to copy data from LinkedIn. HiringSolved sells subscriptions to recruiters for $799 and have recently been profiled in Business Insider. LinkedIn filed a lawsuit in January where they alleged that...
28
MAR
2014

Ticketmaster Sues Notorious Ticket Scraper Higs

In October Ticketmaster filed a lawsuit against Higs Tickets to prevent them from booking tickets by using bots. The lawsuit is very interesting for a number of reasons, not the least because of Ticketmasters Terms of Use. In the Terms of use they stipulate: “You agree that your...
26
MAR
2014

Web Scraping – Definition, Detection and Prevention

Web Scraping is the act of stealing data secretly from the web. It has become the most common threat to millions of online businesses today. The vast importance of data and the criticality to access it for multiple business purposes has inspired people to adopt various legal or...
20
FEB
2014

Things to Consider When Preventing Screen Scraping

Before starting to think about the technical measures to deploy to prevent scraping, it is useful to try and estimate to what lengths the scrapers will go to try and avoid detection and blocking. This is normally proportional to the value that the scrapers see in the data, if the...
18
FEB
2014
screen_scraping_math_guy

Mathematician McKinlay Web Scrapes OkCupid to Find His Dream Girl

Ever wonder why in the world you were learning calculus? When would you ever need to know how to do this stuff? You have a smart phone, right? Truthfully, many jobs out there don’t require that level of mathematical know-how. However, it looks as if a job isn’t the only thing...
29
JAN
2014
scrapers_airlines

Airline Industry Prime Target for Scrapers

Be it ultra-low-cost, low cost, or full service traditional airlines, scrapers are pushing nearly half the Internet traffic to airline’s websites.  Many airlines see as much as 40% of their bookings come from scraping.  Profits for dynamic packaging of ancillary services for...
22
JAN
2014
scraper-enemy

Know your enemy and learn how to prevent screen scraping

When protecting against screen scraping it is useful to understand whom you are up against.  This article will go through the common methods people and companies use to scrape data. Many scrapers are not aware that they are breaking the terms of use of a website.  A carefully...