Most people are not antisemites, but that is not the point.

As a makeshift sign I recently saw in Israel said: "Tolerating antisemitism is antisemitism."