If the stakes were lower, it wouldn't be an issue. It's not fun to get close to someone, then suddenly realize they don't think the rest of your friends should get to live.
On certain topics, complete indifference also bothers me. I've seen this called a "purity test," and I don't get it.
Why shouldn't I be bothered when someone "doesn't have a side" on taking away people's rights? I very much prefer that they care, at least enough to not support aggressors with careless neutrality.
They don't mind folks being erased or even killed, but I'm the radical for not being ok with that?