saying every X user is a fascist seams an oversimplification.

That’s a straw man, nobody I saw here claimed that. The claim is that they don’t mind fascism. Which is not the same.
You can take a country with only 10%, if the remaining 90% remain passive. Staying at Xitter is remaining passive about their fascist propaganda.