Federation not working properly?
I subscribed to communities, but my Lemmy instance receives only a few posts, comments and votes. I can see linked instances, but whether or not they sync data feels hit or miss. I'm not quite sure if this is expected. Does Lemmy have a utility similar to the Matrix federation tester?
Are you on a private instance? It can take a long while for your instance to catch up to current stuff.
As far as testing federation... you posted to lemmy.ml from your instance... federation is working :)
Something is seriously wrong. It's been hours and I looked at 7 or 8 instances, nobody has a complete copy. Your instance only shows your own comment: https://lemmy.saik0.com/post/4283
The comment you are reading is comment #14 on lemmy.ml
Well it's possible that an instance blocks other instances. This also includes things like firewalls and proxy services. I for instance block all Russian and Chinese ip addresses outright. I want nothing to do with either of those countries from a web perspective. It's possible that on their instance they're blocking my instance, or IP so it's not quite populating properly. There's a lot that can go wrong... Doesn't help that lemmy.ml is getting HAMMERED recently.
Actually looking at their instance... They're using Cloudflare (I see the email protection injected code). Cloudflare in particular likes to mark ActivityPub traffic as "bot" traffic and block it. It's more likely that lemmy.ml is blocked for that particular instance by cloudflare. Smaller instances like mine probably don't get flagged. So it shows up in their instance just fine... https://lemmy.haigner.me/post/8?scrollToComments=true
But other instances might have problems talking to them. They need to setup a page rule to allow lemmy traffic through cloudflares bot detection.
I don't see all the comments yet on your home Instance either. https://lemmy.haigner.me/post/8
At lemmy.ml - the "owner" of this community, I am now creating the 5th comment (you are reading it).
I'm seeing lemmy.ml communities that aren't replicating posts and comments properly to other major instances.
Everyone keeps upgrading the hardware, but the PostgreSQL database seems to have a lot of locking issues / concurrency contention with federation and user activity at the same time.
Example: this posting over on Beehaw is currently lacking the comments: https://beehaw.org/post/536574
Another site, it is there, but only 2 of the 4 current comments: https://sh.itjust.works/post/74015
The instance might be very busy and it won’t sync older content from before you subscribed.
Your comment made it into lemmy.ml fine, but it seems outbound isn't getting to you very well. Your comment was the 9th comment on this posting, the one you are reading is number 10. Your home sever posting: https://lemmy.wtf/post/1021
Edit: the lemmy.ml posting with 10 total comments currently is here: https://lemmy.ml/post/1239920
I'm also curious, with my new instance, sometimes it seems like we're receiving the content we should be, other times not so much.
I looked at your instance and it isn't showing the other comments. https://lemmy.pro/post/1354
This is comment #15.
I observed my Cloudflare firewall events under Security > Events. Cloudflare takes actions against instances that use the Lemmy API through Tor since the launch of my instance. I will allow this traffic to see if that improves federation for my instance, somehow. I doubt it as the vast majority of traffic gets through without a Cloudflare challenge.
Update: WAF rule didn't work. I suspect page rules block the requests before they reach the WAF.
I whitelist everything under the sun as I only have 3 page rules. Lemmy requires the following paths as far as I saw:
Update 2: Cloudflare neither blocks nor challenges API requests anymore. But federation is still whack.
Ok, so this at least gives me confidence that the issues I'm seeing around federation may not just be me. One issue I'm seeing is that I'm not confident my comments are appearing on other instances/ or that I'm seeing comments from other instances.
@fedora, do you see this comment?
I can see your comment.
testing, 1,2,3. This is comment #22 you are reading, based on lemmy.ml posting.