I moved from HTC to Nexus, and stuck with Nexus until it died, then picked up a pixel and never looked back. Pixel is what I buy/use, and it's not been an issue for me, which is why I keep going back.
From Nexus: I owned the Nexus 4, 5, 6 (I still have this one), 7 LTE tablet, and 5X. On the pixel line, the pixel "1", 4, and now 7. Haven't owned a pixel "a" series. I skipped the pixel 5, since the processor was significantly less powerful than the 4, despite being a newer chip, and I skipped the 6, because it was the first gen tensor, and I wanted it to prove itself. Early pixel days didn't see a lot of improvement IMO between pixel 1/2/3, so I stuck with the 1, mainly because of the RAM: pixel 4 was the first pixel to have more than 4GB RAM.... (It had 6). I would have jumped from the P4 about a year after getting it, simply due to it not having a fingerprint reader, and the pandemic (specifically masks) making it impossible to use the face id or whatever they called it, but I didn't want to lose performance with the lower powered chip in the 5, and my 4 was good enough to not wager on whether the first tensor had any major hardware defects... So I'm on the 7 now, and I'm pretty happy.
I miss the fingerprint reader being on the back. I've found ways around the headphone jack problem: I have two devices for this.... A combo headphone jack/changing cable dongle, and a fiio BTR 5 (though other BTR units from fiio will work similarly), which allows me to use wired headphones over bt, while charging my phone and Bluetooth device (fiio), allowing for a near infinite amount of time where I can use my phone with headphones if I choose.
I'm not big on the optical fingerprint reader, but it's better than the face id stuff on the 4, so I guess I'm happier overall.
My key factors for using and keeping with pixel are pretty basic: prior to me going Nexus/pixel, to remove the bs added to my phone (like it shipping with FB apps), I would need to load custom ROMs which was a massive pita. I enjoyed the custom ROMs, mainly the AOSP versions. I wanted clean, no frills android with Google services (which I use extensively). Everything else I could obtain from the Android app store, aka the play store. For the most part, the Nexus/pixel was the only device I could get that kind of thing going right out of the box, pretty much everything else would require a custom ROM. That's the root of why I switched and what keeps me on pixel. I know others have stepped up in this regard, but not many. I've already had success with pixel and to me, the historical experience with pixel keeps me coming back because so far, they've had what I want and nothing that I don't want. If that changes, I'll probably start considering other options.
As long as Google is using the pixel as a dev platform, bringing new features to pixel first, and eventually allowing third parties to use those features, I'm ok with what they're doing. Some get abandoned long before they get that far, and I understand that, but there's now a short list of features that the pixel has that other phones may never get where those features seem to be pixel exclusive, which is where my support of Google on this, starts to waiver.
Tensor had proven itself to be a decent platform, and the features of tensor, which are above and beyond the base RISC instructions, should be made available in some way to other manufacturing partners. Like having a tensor specific processing core that can be paired with a different ARM CPU to provide similar functionality to the full tensor CPU.... Like a coprocessor. The AI benefits to the Google camera, et al, being made available to third parties.
Instead of going with the Microsoft model, offering first party devices, but continuing to support all features on all devices, they're trending more towards the Apple model, where you use our hardware, or get fucked. Which, I'm not a fan of.... Many industries are taking that page from Apple and honestly IMO, it's anti-consumer activity. John Deere comes to mind....
I don't think Google is too far gone in this respect, not yet, they can choose to open things up for third parties as time goes on.
Build quality, at least on the devices I've owned has been good. Not excellent but good. Few, if any issues, and support is generally good. I'm happy for the most part. I don't subscribe to the brand wars, and I'll happily jump ship if that changes. For now, I don't have significant cause for concern.
I'll continue with pixel for a while and see how it goes. I'm constantly evaluating my stance to see if there's sufficient reason to consider other options. I almost got to that point over the headphone jack, but everyone else seemingly followed suit, and once I found a workable solution, I didn't really care anymore. Bluntly, with the headphone issue, unless a device can charge, and allow the phone to charge, while you're actively using it, it's not a solution; having to stop listening/enjoying content while waiting for your pixel buds (or airpods, or whatever) to charge in their case.... that's not a replacement for a headphone jack, since you can enjoy content with a headphone jack indefinitely while charging your phone. So unless it can satisfy the original use case, it's not a good solution. I have the wired charge/listen dongle for any situation where bt isn't viable (like a high RF noise environment, or any time bt needs to be off, like a plane, though many allow bt to be on now), and the fiio for everything else. If I have to choose either headphones or charging, I'm going to find another way.
I have bt headphones that won't play and charge, but I almost always have either the fiio or dongle with a set of IEMs as a backup. I use my phone for entertainment often enough that this can be a deal breaker for me.
That's just me POV. I like the line, for now, and if things change, that may change. I don't have any negative feelings towards new features being pixel only while they're still being tested and proven, as long as they eventually end up in everyone's hands in whatever form that takes.