Isn't jokerless challenge hard enough wihout this?

I'm working on Jokerless right now, and an Emperor spawned Judgement and Temperance. I chuckled at my bad luck.

But yeah, it seems unfair that some challenges prevent certain Jokers from spawning, but the reverse is ignored if it's advantageous to the player. At least the blue seals are way more useful than they used to be (used to create a random planet card).