While I do think that it's simply bad at generating answers because that is all that's going on, generating the most likely next word that works a lot of the time but then can fail spectacularly...
What if we've created AI but by training it with internet content, we're simply being trolled by the ultimate troll combination ever.