It isn't a good point.
If you are never in fear at all for expressing any viewpoint, then your society is likely so far authoritarian or nihilist that none of this matters. In a truly free and reasonable society, if someone wants to stand on a street corner and explain he likes to rape children, someone eventually is likely going to punch him in the head.
That person should be charged with the appropriate level of assault given the level of violence and provocation involved. I'm not saying people should punch people for being offensive, but it is pretty predictable given the human condition. A society that eliminates this urge to the point where one can feel totally safe earnestly advocating genocide is far scarier than one where nazis occasionally get punched. This means either the members of that society are soulless nihilists, or the government is so oppressive that any disorder is met with such force that total obedience is a social norm.
Hard pass either way.
(If you are thinking that this somehow would justify something like the beatings of civil rights workers, you are missing the point and might want to examine your own nihilism. At some point, no matter how open minded one wants to be, there is such a thing as right and wrong)