Is it impolite to ask someone about their roots?

I'm from Canada so everyone except for the indigenous originally came from somewhere else. I love it when people ask my about my roots, but someone told me it was rude.