I have to wonder if the guy was so afraid of you taking his picture because he had something to hide. Do you have CCTV everywhere in New York like we do in UK cities? You can't go anywhere without your picture being taken, all the time, so it's a bit disingenous to protest when someone snaps you, even if you did have the right to stop them.