For years, online agent ratings have been a source of much angst in the real estate industry and agent rating sites are becoming ever more common under the pressure of consumer demand.

But at least one state Realtor association has decided to strike back by rating the rating sites themselves, based largely on how friendly they are to agents. The Pennsylvania Association of Realtors has devised a “report card” for 10 sites that offer agent ratings, scoring them based on answers to 10 questions, including who can post reviews, whether agents can respond to reviews, and whether agents can remove their profiles.

Sites can earn a star, for example, if agent profiles are created by agents, but only half a star if profiles are created by reviewers and no stars if the profiles are created by the site itself, with no user input.

If agents can remove their profiles, the rating site also gets a star. Sites are rewarded if they let agents respond to negative reviews and petition for their removal.

The questions do not delve into the much-debated value of using transaction statistics in agent rankings. Realtor.com last year tested a statistics-powered agent-ranking tool, AgentMatch, that drew protests from agents. The company says it will incorporate lessons learned from AgentMatch when it updates agent profile pages later this year to give users the ability to highlight their transaction data, team info and client recommendations to consumers.

PAR originally considered creating an agent review system of its own, assigning a task force to that end under the theory that agent ratings would lead to a higher overall level of professionalism, said Hank Lerner, PAR’s director of professional practice, in a blog post.

“But after considering the political and practical hurdles to launching such a system from within the Realtor organization, the task force recommended not moving forward with a new rating system,” Lerner said.

Instead, PAR developed a report card he said would help members and their clients “understand which existing systems are the best fit for their needs.”

For each question, a site received either one star, a half star, or no star with 10 stars as the highest possible score. Of the 10 sites reviewed, ZillowRealSatisfied and RatedAgent.com each received the highest score: 8 stars, followed by Quality Service Certification Inc. (QSC) at 7.5 stars, Stik (6.5 stars), realtor.com’s SocialBios (6 stars), Trulia (5 stars), Yelp (4.5 stars), Google Ventures-backed HomeLight (4 stars), and lastly, startup Brokur (2 stars).

The report card asked 10 questions:

  • How is the agent profile created?
  • Can the agent remove the profile?
  • Is the agent information in the profile?
  • What are the site’s advertising policies?
  • Can brokers collect and analyze data?
  • Does the site identify Realtors?
  • Who can post reviews?
  • Does the site ask closed-ended questions?
  • Does the site ask open-ended questions?
  • Can agents respond to reviews?

A site would receive the best marks if agent profiles were created by agents themselves; if agents were allowed to remove their profiles; if the information in the profile is entered by the agent; if there were either no advertising on the rating site or no real estate advertising on listing pages; if brokers could collect and analyze the review data; if the site identified Realtors as such; if only verified clients could post reviews; if the site asked close-ended and open-ended questions about an agent’s market knowledge, communication and education; and if agents could either remove reviews or respond to them.

“These rating systems may not be perfect, but they are a step in the right direction toward separating professional agents, from those that still need some work,” said PAR CEO David Phillips in a blog post.

“Now, we need to make sure agents are monitoring these sites. The public will be relying on this data, good or bad, so knowing which sites provide the best data is key to protecting your professional image.”

PAR plans to “tweak” its rating system over time, Lerner said. The detailed report card can be read here.

Show Comments Hide Comments
Sign up for Inman’s Morning Headlines
What you need to know to start your day with all the latest industry developments
By submitting your email address, you agree to receive marketing emails from Inman.
Success!
Thank you for subscribing to Morning Headlines.
Back to top
Only 3 days left to register for Inman Connect Las Vegas before prices go up! Don't miss the premier event for real estate pros.Register Now ×
Limited Time Offer: Get 1 year of Inman Select for $199SUBSCRIBE×
Log in
If you created your account with Google or Facebook
Don't have an account?
Forgot your password?
No Problem

Simply enter the email address you used to create your account and click "Reset Password". You will receive additional instructions via email.

Forgot your username? If so please contact customer support at (510) 658-9252

Password Reset Confirmation

Password Reset Instructions have been sent to

Subscribe to The Weekender
Get the week's leading headlines delivered straight to your inbox.
Top headlines from around the real estate industry. Breaking news as it happens.
15 stories covering tech, special reports, video and opinion.
Unique features from hacker profiles to portal watch and video interviews.
Unique features from hacker profiles to portal watch and video interviews.
It looks like you’re already a Select Member!
To subscribe to exclusive newsletters, visit your email preferences in the account settings.
Up-to-the-minute news and interviews in your inbox, ticket discounts for Inman events and more
1-Step CheckoutPay with a credit card
By continuing, you agree to Inman’s Terms of Use and Privacy Policy.

You will be charged . Your subscription will automatically renew for on . For more details on our payment terms and how to cancel, click here.

Interested in a group subscription?
Finish setting up your subscription
×