I think you're currently in a place where I was in myself many years ago. This is all assuming everything you said was in good faith. You see all of the pain and damage the -isms have caused (racism, sexism, etc) and it seems at first blush that if society simply disregarded the traits those -isms are based around, the problem would go away. There's enough truth in the idea to make it feel like a solution and, even if it's subconscious, it kinda takes the onus of action off of you and puts it on the people that that are actually racist or exist. I don't want to assume your political leanings, but I was farther right on the political spectrum than than I am now, and it fit well with my ideas about personal responsibility and limited government at the time...and I feel like it was regarded as common sense with everyone in that political sphere at the time. At the time, I was a 20-something cishet white guy (I'm still all of those things, except 20), and I felt like everything I had I'd earned, and I legit thought people could pull themselves out of the mire if they wanted it enough. I didn't like being grouped in with the -ists, but I also wasn't likely to call out a buddy for making an offensive joke.
That whole chain of thinking is deeply flawed, but it's an easy place to land, especially in middle-America. I feel like a good analogy that would have hit home with me at that point in my life would have been stories about places where Christianity was outlawed. I remember I had one of those old Christian comic books that were popular in the 90s about it. If you wanted to wear a cross, you'd have to hide it, you couldn't talk about being Christian or meet with other Christians (like a church service or prayer group) without having to worry about the law coming down on you. (Really makes me wonder where that infamous sense of persecution the right has comes from). At the time, I'd hear those stories and think, "Man, government sucks...it would be terrible to have to hide who you were like that." I think about those stories now and I think instead about not wearing the clothes you're comfortable in, not being able to get healthcare for legit medical diagnoses, not being able to have a club or group of similar people you couls safely meet with to build community around shared life experiences. The story about persucted Christians in some unnamed dystopia was also telling the true story of LGBTQ people in my own country. And women in my own country. And racial groups In. My. Own. Country. I never would have accepted the idea that those persecuted Christians would be OK if there just wasn't religion. Just like I know marginalized groups today won't be OK if whatever society deems "wrong" with them just went away. Societies have inertia, and without someone exerting some kind of force on them, they'll maintain their current trajectory. I came to see I didn't like my societies trajectory, so I started trying to change it, probably went a little too extreme in the other direction for a while, but eventually learned to just listen first. It's OK if I belong to a group (or several) that have been bad actors. It means I'm in a position to leverage my privileges to help change society's momentum. I grew up very poor, but I've got pretty much every other privilege society has to offer. I honestly don't know that I'd have been as fortunate as I am today if even one of those privileges was missing. Even with the deck stacked pretty well in my favor, it was a fucking fight to get here...and even now, doing so much better than most, it feels like barely hanging on some days. I agree that humanism is what we should be striving for, but I also understand that I'm part of a group that's done a lot of bad to a lot of other groups. I don't think it makes sense for me to be "proud" of any immutable part of my identity, but that also means I shouldn't feel personally attacked when people talk about that identity. Things like the whole bear thing would have probably bothered me in the past, but now it's more nuanced. I'm sad people feel that way, but I don't blame them, and I've listened enough that I believe them. Now the question I ask isn't "How is this fair to me?" but instead. "How can I use my membership in the group to help change its momentum to something better." Sometimes it's voting, sometimes it's canvassing or protesting, sometimes it's reaching out to someone I see a part of my past self in.