20 years ago I worked in IT at a major university, and one of the things I managed there was a 3D visualization wall. Basically a 15 foot wide rear projection wall in 4k, and by wearing special goggles you could see in 3D.
I once saw a demonstration using that wall that showed how surgeons could theoretically perform surgery remotely when using haptic devices. For cutting edge technology from 20 years ago it was quite impressive.
For highly specialized remote activities, including the above, remote learning, etc. I could see something like this very useful. For general social activities, not at all.