Obvious as it may sound, people with authoritarian beliefs hiding behind free speech actually consider it as a weakness akin empathy. It allows losers like them to amplify their reach despite not being in power. They abandon their “free speech absolutist” postures the moment they think they are in power.
Fascism is slightly more diverse and thus adds more opportunities for apologists to relativize. Hence the specific choice.