operator Move Inc. says it’s blocking automated Web bots from accessing more than 1 million pages a day on the listing site, and that such efforts have resulted in a sharp decline in attempts at "scraping."

The company says it monitors about 137 million interactions on the site per day, looking for patterns that indicate illicit behavior such as the systematic copying of listing data, blocking suspicious IPs from accessing gets its listing data directly from multiple listing services (MLSs). According to a survey of MLS executives by the Council of Multiple Listing Services (CMLS), most are concerned about scraping — the unauthorized copying and reuse of their listing data.

"Scraping happens everyday, and it’s something that’s surprisingly inexpensive for cybercriminals to do," Move Creative Director Amit Kulkarni said in a blog post detailing the company’s anti-scraping efforts.

As an example, Kulkarni posted a solicitation from a website where companies or individuals put projects they want to contract out to programmers up for bid.

"I am looking for someone to write a program to scrape data from," the bid request said. "The program would take U.S. ZIP codes (from a ‘.txt’ file), input them into, and then take the output from the pages that follow and create a ‘.csv’ file for each ZIP code. Ultimately, I will be running the program for thousands of different ZIP codes. I am willing to pay up to $50 for this program."

The post attracted 12 bids, closing on March 26, 2011, with the status, "awarded."

But Kulkarni said has been so successful at thwarting such efforts that scraping attempts are on the decline, falling from 385 million attempts in October 2011 to 75 million attempts in February.

Brian Larson, president of consulting firm Larson/Sobotka Business Advisors LLC, told Inman News in December that he expects more MLSs will go after "data pirates" who redistribute MLS data without authorization, and that his firm was working with clients to evaluate ways of shutting them down.

Show Comments Hide Comments
Sign up for Inman’s Morning Headlines
What you need to know to start your day with all the latest industry developments
By submitting your email address, you agree to receive marketing emails from Inman.
Thank you for subscribing to Morning Headlines.
Back to top
Only 3 days left to register for Inman Connect Las Vegas before prices go up! Don't miss the premier event for real estate pros.Register Now ×
Limited Time Offer: Get 1 year of Inman Select for $199SUBSCRIBE×
Log in
If you created your account with Google or Facebook
Don't have an account?
Forgot your password?
No Problem

Simply enter the email address you used to create your account and click "Reset Password". You will receive additional instructions via email.

Forgot your username? If so please contact customer support at (510) 658-9252

Password Reset Confirmation

Password Reset Instructions have been sent to

Subscribe to The Weekender
Get the week's leading headlines delivered straight to your inbox.
Top headlines from around the real estate industry. Breaking news as it happens.
15 stories covering tech, special reports, video and opinion.
Unique features from hacker profiles to portal watch and video interviews.
Unique features from hacker profiles to portal watch and video interviews.
It looks like you’re already a Select Member!
To subscribe to exclusive newsletters, visit your email preferences in the account settings.
Up-to-the-minute news and interviews in your inbox, ticket discounts for Inman events and more
1-Step CheckoutPay with a credit card
By continuing, you agree to Inman’s Terms of Use and Privacy Policy.

You will be charged . Your subscription will automatically renew for on . For more details on our payment terms and how to cancel, click here.

Interested in a group subscription?
Finish setting up your subscription