Absolutely agreed. I asked one person if they wanted to share a drink at a celebration (that's just social decorum, right?) and have done no flirting before or after that and now that person talks to me like they've been in love with me their whole life.
And I get the idea that you want to let everyone sleep with their favorite NPC regardless of who they're playing as but it just feels weird to me that everyone is so both pansexual and horny. It makes me feel like nobody has any preferences and just falls in love with you because you're the main character.
And in general it also lessens the sense of camaraderie a bit for me when it comes down to sex so much. I wish some companions had other interests and had no desire to get in your pants.