It's not uncommon for home buyers to talk with several mortgage brokers or lenders to compare loan products and interest rates. One buyer who shopped around was scolded by a mortgage broker when he found out she was talking to more than one broker. He told her that she was ruining her credit score by allowing multiple credit inquiries.
Too many credit inquiries can negatively affect your credit score, but you can control the damage. And, credit inquires make up a relatively small part of your credit score.