I believe that the difference between the "free speech" part of the Fediverse (I have no better name for it) and the "SJW-Mastodon" part is not really political. It is a major cultural difference.
I think people on the "free speech" part are much more likely to be decent human beings with whom you could have polite and civil discussion about disagreement, share non-PC jokes and just have fun without having to virtue signal.
The "SJW-Mastodon" part of the Fediverse is mostly known for its complete intolerance of anything non-egalitarian or non-PC. People there will call you names, smear shit over you and generally be dishonest even if you just ask a question. The interactions I had with that side in the past couple days really leave that impression. Only on this part you see my instance blocked and the reason is "wrong ideals" or "ancaps. LOL.".
To me this is a difference between being a basically decent human being and dishonest, malicious, narcissistic garbage.