The English rock singer has owned the property for decades