Problem while canvassing

I was doorbelling for local candidates in a residential area in my city. A man in about his mid-30's crossed the street to block my path and demanded to know what I was doing. I told him I was distributing election information. He then demanded that I show hims some ID. I pointed out to him that I was standing in a public street and refused. He kept demanding that I show him my ID, and I kept refusing and referring to my First Amendment rights. I finally told him to "knock it off" and walked away. He seemed confused about what to do at that point, and did not follow me.