26
JAN
2015

United Airlines and Orbitz sue Skiplagged the hidden-city ticketing site for scraping

United Airlines and Orbitz are pursuing legal action against the site Skiplagged on the basis that it has hurt their business by creating unfair competition. Skiplagged effectively scrapes ticket information off of airline’s websites finding all combinations of travel to a...
09
APR
2014

The Scraping Problem in Ticketing - View Slideshow

This is the presentation that Martin Zetterlund gave at Ticketing Technology Forum in London last month. The presentation covers how to protect ticket sales from ticket touts and other unauthorized resellers that use web bots and other scraper programs to acquire tickets against...
28
MAR
2014

Ticketmaster Sues Notorious Ticket Scraper Higs

In October Ticketmaster filed a lawsuit against Higs Tickets to prevent them from booking tickets by using bots. The lawsuit is very interesting for a number of reasons, not the least because of Ticketmasters Terms of Use. In the Terms of use they stipulate: “You agree that your...
26
MAR
2014

Web Scraping – Definition, Detection and Prevention

Web Scraping is the act of stealing data secretly from the web. It has become the most common threat to millions of online businesses today. The vast importance of data and the criticality to access it for multiple business purposes has inspired people to adopt various legal or...
20
FEB
2014

Things to Consider When Preventing Screen Scraping

Before starting to think about the technical measures to deploy to prevent scraping, it is useful to try and estimate to what lengths the scrapers will go to try and avoid detection and blocking. This is normally proportional to the value that the scrapers see in the data, if the...
18
FEB
2014
screen_scraping_math_guy

Mathematician McKinlay Web Scrapes OkCupid to Find His Dream Girl

Ever wonder why in the world you were learning calculus? When would you ever need to know how to do this stuff? You have a smart phone, right? Truthfully, many jobs out there don’t require that level of mathematical know-how. However, it looks as if a job isn’t the only thing...
29
JAN
2014
scrapers_airlines

Airline Industry Prime Target for Scrapers

Be it ultra-low-cost, low cost, or full service traditional airlines, scrapers are pushing nearly half the Internet traffic to airline’s websites.  Many airlines see as much as 40% of their bookings come from scraping.  Profits for dynamic packaging of ancillary services for...
22
JAN
2014
scraper-enemy

Know your enemy and learn how to prevent screen scraping

When protecting against screen scraping it is useful to understand whom you are up against.  This article will go through the common methods people and companies use to scrape data. Many scrapers are not aware that they are breaking the terms of use of a website.  A carefully...
15
JAN
2014
captcha-tests

Will a CAPTCHA test stop scraping?

Yes and No. CAPTCHA tests can be highly effective in the right place if the data is not too valuable for scrapers. There are two main ways of circumventing CAPTCHA tests, by using OCR (optical character recognition) software or to use labor in low cost countries to manually solve...
08
APR
2013
scraped-news-service

Court stops news-scraping service

Denver Post reports that a news-scraping service committed copyright infringement by reusing content from the Associated Press (AP).The news-scraping service managed by Meltwater was a premium service where their customers could track when they are mentioned in the press....