You can measure the distance one is from actual political organizing by the enthusiasm one has for punching a fascist in the face. Our political power comes from numbers, not from how well some of us throw a punch. Those numbers will be reduced by tens of thousands if the elderly, children, disabled, & peaceful activists have to worry about protecting themselves from violence.
We have nothing to fear from free speech for extremists if we out-mobilize them & drive them back under their rocks. We seriously jeopardize the struggles against war, occupation, genocide if we reduce our numbers by making our protests fisticuff free-for-alls.