Is there any limit to the amount of instances to federate with?

Looking at the Linked Instances, most instances have at most a few hundred instances linked. What happens when there are thousands, or possibly even millions? Could too many instances require significantly more powerful hardware, or even be impossible altogether?