Yeah, I have kids, and we can usually get about 300 miles before someone needs a bathroom break. So usually I refill gas (<5 min) while the kids go to the bathroom, and we usually pack enough food with us (sandwiches and whatnot) that we only need to go to a restaurant once on the trip.
An EV could work if fast chargers were as plentiful as gas stations, but in many of the areas we go (I live in Utah and travel to WA, MT, ID, and CA frequently), they're pretty infrequent. So we'd need to plan stops based on charger availability, not on bladder size, which means an extra recharge or two for the trip. It's getting better, but every time I look at maps, there are maybe one or two chargers in a 50 mile radius, so if it's full or out of service, we'd be screwed.
Now, if gas stations started offering EV charging, I'd probably be looking at them today. Gas stations are perfect because they often have fast food, bathrooms, and snacks, all of which are essential for road trips.
As another anecdote, my coworker just bought a Model 3, and he frequently says he can't reasonably visit places within our state because the charging network sucks. That's a pretty serious concern for us, since we like camping, which means pretty remote trips.