1y ago

Lemmy.ml is down right now (back online, was unreachable for about 6 hours)

lemmy.world had a DDOS in the past 24 hours, Lemmy.ml was showing problem, but now it is entirely unreachable. lemmy.world was showing "Error!" page (server still reachable), but that seems to have only lasted for a hour or so.

60 comments

I mean, this is one way to find the vulnerabilities in your system, I guess...
- it could be anything related to the datacenter outage,server,dns,apache,nginx and so on...
  
  or DDoS

Ok so I have learned that it is always good to have a backup account or two if I am intent on getting my memes
- lemm.ee has always been solid for me. At this point, I'm debating whether to just make it my primary instance instead.
  
  Nice! I've more or less switched lemdro.id
- Same but it’s tough to keep favorites synced and blocks and filters.
  
  I wrote a tool that will help: https://github.com/CMahaff/lasim
  Let's you copy your subs, blocks, and profile settings between Lemmy accounts.
  You can run it as many times as you like and will keep adding new things.
  At the minute it never removes things though, so you'd have to unsubscribe multiple places.
  
  True true. Hopefully some of the upcoming 3rd party apps can address some of the issues like this.
- That’s what I just did. Also found a tool to subscribe me to all the communities.

Completely down
- Can you check again please?

lemmy.world is back up now (I'm posting this on it). I'm looking forward to @Ruud posting a postmortem.

wait, again??

Lemmy.world also seems to be sporadically down.

This information clarified so much of this morning for me.
Was troubleshooting on my phone because I thought it was my kids using all the bandwidth for YouTube (kids)) and Roblox on a slower than normal Sunday.

lemmy.ml is back online!

Fuck you, Zuck & Musk, lick my taint

That feel when I miss all the fun in Australia because I was asleep

Lemmy.world is now responding some at least, and some of the comments from remote servers came into this posting just now.

.world is down as well right? fuck

Well hey, my instance is small

World was down for me too in the last 10 minutes.
- Lemmy.world down now for over 30 minutes, Lemmy.ml over an hour (I created this post on Lemmy.world before it went down). Distant Early Warning Sign: https://www.youtube.com/watch?v=wrDj5XvZXX4
  
  It's weird, I can access Lemmy.world through sh.itjust.works but I can't log in. Are they updating maybe?

Lemmy.world is still hard to reach.

Beehaw.org was down for over 30 minutes, came back for 15 minutes, now down again another 30 minutes.

6 hours down for lemmy.ml is really going to have a lot of items queued on lemmy.world, beehaw, and other popular servers to delivery to lemmy.ml - causing resources to climb on all those servers.

Well... there has to be something lemmy does right I guess

Why tf aren’t they using Cloudflare for DDoS protection? The site isn’t run for-profit so it would be covered under the free tier. My homelab is proxied through Cloudflare and would be able to handle an attack better than this.

I wonder what happens to posts made to lemmy.ml communities when it comes back up, will they sync to other instances?
https://lemmy.world/post/1578635

looks like lemmy will be getting Cloudflare support soon

https://sh.itjust.works/ is returning "Server error" on all pages, not sure how long that has been going on.
apparently over 45 minutes so far: https://lemmy.world/post/1604919

How did you make that Title?!
- You can use markdown codes in titles. Bold, italic, and in my case ~~strikethrough~~. Two tildes before and after the text.

60 comments