Q: "How much credence do you place in the 1- to 5-star ratings of lenders that many online mortgage sites provide based on reports from borrowers?"

A: Very little. For one thing, borrower ratings are based on a single experience covering a complicated process extending over several weeks. A good restaurant reviewer returns to a restaurant being reviewed four or five times, but a mortgage borrower is limited to one exposure, which might or might not be typical or representative.

Basing a judgment on only one unit of experience would not be that large a handicap if the borrower were well equipped to make an informed judgment, but many — if not most — are not.

While most restaurant reviewers know a lot about food preparation, few mortgage borrowers know much about mortgages when they begin the process. This makes their interpretations of what transpires vulnerable to misperceptions.

Here is an example: A borrower receives a price quote of 4.5 percent at 1 point on a 30-year fixed-rate mortgage, and requests the lender to lock that price. The lender won’t lock, however, until it has received some additional information, which takes several days to obtain, during which period the market changes. This is a common occurrence today because underwriting requirements are tight and enforced.

Now consider two possible scenarios. In the first scenario, the new market price is higher at 4.5 percent and 2 points, so the lender gets back to the borrower to report the new price, and asks if the borrower wants to lock 4.5 percent and 2 points.

In the second scenario, the new market price is lower at 4.5 percent and zero points, and the lender locks the price of the original quote, 4.5 percent and 1 point.

How would the borrower evaluate the lender in these two cases? In my experience, the borrower in the first scenario would probably be displeased because the price requested was not received; the borrower might even allege that the lender pulled a "bait and switch."

The borrower in the second scenario, in contrast, would very likely be content because the price requested was the price received. Yet the lender in the first scenario played it straight and gave the borrower the correct price, while the lender in the second scenario cheated the borrower by not passing through the price drop.

Borrower reviews also suffer from ambiguity regarding whether they apply to the lender firm or to the particular loan officer with whom the borrower worked.

Loan officer A working for firm X might be great, but loan officer B also working for X might be a dud. There is much to be said for assessing loan officers rather than firms, and Zillow allows both on its listings. Lending Tree, on the other hand, lists firms only.

I do think that borrowers can do a pretty good job of assessing important qualities of loan officers, such as helpfulness, promptness in returning calls, willingness to answer questions, accessibility when needed, and so on. On the other hand, some loan officers con borrowers into thinking they are great when they aren’t.

Before the Internet and the star-rating system cam into being, I knew a loan officer who was enormously successful, made a seven-figure income, but placed every borrower in a 3/1 adjustable-rate mortgage. He believed it was the best instrument for everyone, and he was an extremely persuasive salesman. By my standards, he was a bad loan officer because one mortgage type cannot possibly be best for everyone, but he would have had a 5-star rating from borrowers.

The final and perhaps the strongest argument against placing any credence in borrower reviews is that the reviews can be and are manipulated. "Ringers" are employed to generate favorable reviews of the employer and negative reviews of competitors. Actual borrowers providing negative reviews are bribed to remove them. My guess is that such manipulations are most prevalent on the sites that list loan officers rather than or in addition to firms, but I have no evidence to back this up.

Show Comments Hide Comments


Sign up for Inman’s Morning Headlines
What you need to know to start your day with all the latest industry developments
Thank you for subscribing to Morning Headlines.
Back to top
Real estate news and analysis that gives you the inside track. Subscribe to Inman Select for 50% off.SUBSCRIBE NOW×
Log in
If you created your account with Google or Facebook
Don't have an account?
Forgot your password?
No Problem

Simply enter the email address you used to create your account and click "Reset Password". You will receive additional instructions via email.

Forgot your username? If so please contact customer support at (510) 658-9252

Password Reset Confirmation

Password Reset Instructions have been sent to

Subscribe to The Weekender
Get the week's leading headlines delivered straight to your inbox.
Top headlines from around the real estate industry. Breaking news as it happens.
15 stories covering tech, special reports, video and opinion.
Unique features from hacker profiles to portal watch and video interviews.
Unique features from hacker profiles to portal watch and video interviews.
It looks like you’re already a Select Member!
To subscribe to exclusive newsletters, visit your email preferences in the account settings.
Up-to-the-minute news and interviews in your inbox, ticket discounts for Inman events and more
1-Step CheckoutPay with a credit card
By continuing, you agree to Inman’s Terms of Use and Privacy Policy.

You will be charged . Your subscription will automatically renew for on . For more details on our payment terms and how to cancel, click here.

Interested in a group subscription?
Finish setting up your subscription