20
JAN
2014

Is screen scraping legal?

The legality of screen scraping is far from simple to address. Laws, where they exist, differ by jurisdiction, and court rulings seem ambiguous at best. This is not surprising as most cases against scrapers are brought using laws that were intended for other types of abuse. It is...
17
JAN
2014

Why is data scraping difficult to counter?

Not all scraping is hard to counter. The simplest case is where normal web robots adhere to the Robot Exclusion Standard according to what you have entered into your robots.txt file for your website.  Generic robots not honoring the protocol that scrape indiscriminately are...
15
JAN
2014
captcha-tests

Will a CAPTCHA test stop scraping?

Yes and No. CAPTCHA tests can be highly effective in the right place if the data is not too valuable for scrapers. There are two main ways of circumventing CAPTCHA tests, by using OCR (optical character recognition) software or to use labor in low cost countries to manually solve...
13
JAN
2014
how_to_block_ip_address

How can I block an IP from accessing my site?

Generally the hard part of stopping screen scrapers is not placing a block on them, but rather finding them in the first place. Once you have identified a scraper, it is essential to place the block as quickly as possible to stop the activity from the current source. When...
30
AUG
2013
scrape-website

Changing IP address in order to scrape website a violation against US law

Judge Charles Breyer of District Court in Northern California ruled that changing your IP address or using proxy servers in order to access public websites you have been forbidden to visit is a violation of the Computer Fraud and Abuse Act (CFAA). This was ruled in a case...
08
APR
2013
scraped-news-service

Court stops news-scraping service

Denver Post reports that a news-scraping service committed copyright infringement by reusing content from the Associated Press (AP).The news-scraping service managed by Meltwater was a premium service where their customers could track when they are mentioned in the press....
10
MAR
2013

Screen scraping to provide threat ‘for next few years’

Online content providers and website operators are forced to deal with a number of IT intrusion and security threats nowadays as cybercriminals’ techniques become more advanced. However, one of the long-standing threats with which hackers are increasingly prolific is...
30
JAN
2013

Unibet wins screen scraping lawsuite over ATG

The Swedish court of appeal has overturned a previous judgement in where the Swedish igaming company Unibet were found guilty of screen scraping ATG. In the previous judgement Unibet was to pay 35 MSEK in damages to ATG for breaching their database rights. The court of appeals...
24
NOV
2011

Ryanair continue to work hard to prevent scraping

According to this article Ryanair stopped using captchas: http://www.travelweekly.co.uk/Articles/2020/11/21/38831/comment-what-now… The article makes a few bald statements of how dependant ryanair is on the travelagents. Ryanairs answer to this seems to have been to move...
21
NOV
2011

Ryanair implements captchas to stop web scraping

Ryanair seems to have taken the drastic step of implementing captchas in the booking process in order to stop Online Travelagents using screen scraping techniques to book tickets on the site. It will be very interesting to se how this turns out, other companies that have tested...