Some people have no problems with photography, and you should treat them in the same courteous and respectful way you would treat people at home, by engaging them and seeking their permission.