Far Right and Far Left - Social Outcasts?

It depends on the context of "outcast". They could be outcasts in the sense that their views don't align with those of the general public, but on the flip slide of the coin, people on the far-left and far-right are a sizable minority among the community and in the age of social media, they are quickly gaining traction. I don't think you can really tarnish them all with the one brush though. I personally don't agree with the majority of their views, but they have their reasons for having such strong, controversial opinions.