1y ago

[Fixed] Comments temporarily broken, being worked on

There was another attack going on (as you might have noticed). We're working on a fix. In the meantime, we've blocked the listing of comments, so we at least aren't down, but it did break comments.

Hope to have a fix in the next hour. Stay tuned!

Update OK we've implemented a fix, again many thanks to @sunaurus@lemm.ee for his assistance. This will prevent the outages we've seen last couple of days. Let's see what they will come up with next...

56 comments

I'm sure it must be frustrating to have to deal with these attacks, but in a sense they're a signifier of how popular / successful this instance is.
Thanks for all the work you do on it, Ruud.
- Also the more attacks there are the more vulnerabilities found and get fixed. I think in the long run it helps the platform to mature and be more stable.
  
  The script kiddies are unpaid QA testers.
- Big ditto!

I'm getting kinda tired of these attacks. Is some loser from 4chan not getting enough attention from mommy?
- Something like that, or potentially some jerk with a knack for technology who's decided to use their abilities to be an ass.

"What's wrong?"
"No comment"
Sorry, I'll show myself out.

You won't see this, but thanks for working on the fix!

The attack today was wild, someone kept hammering lemmy.world for like 4~5 hours straight. Where do the attacks come from? Maybe also report to law enforcement? (even though practically speaking the chances that they are going to do something about it are very slim)
Hexbear started making a big deal out of the defederation by lemmy.world today on their instance and it's possible that their script kiddies might have felt the need to retaliate.
- These have been going on since they defederated from the Nazi instance but the lefties still get the blame lmao
  
  For real... especially since the "problems with comments" are really convenient for the Mods who seem to be censoring the opposition they are getting to the hexbear defederation left & right - my absolutely civil disagreements were just deleted.

This is why I have a couple different fediverse accounts
- You mean Lemmy? Or do I not get it still..
  
  Lemmy is a part of the fediverse.
  The OP has a kbin account, which is something akin to Lemmy. But they can comment here because both kbin and lemmy are a part of the fediverse and therefore are interoperable.
  But within lemmy itself, you can also have accounts on different instances too! E.g. my account is on lemm.ee, while yours is on lemmy.world. Both servers are a part of Lemmy, but act separately, and are interoperable!
  Think of it like email.
  Kbin is like gmail.com, lemmy is like outlook.com. Users on gmail can send and receive emails from outlook, and vice versa.
  Now think of lemm.ee as outlook.co.uk, and lemmy.world as outlook.co.ca.
  I hope this clarifies stuff a bit!

Looks like it's fixed now?

Why would you attack Lemmy in the first place? I guess it's probably because you can for some wierd people.
- Some people just do because they are mean and have the knowledge to do so.
- Really ramped up after the alt-right extremists on exploding heads were defederated from. There was also turmoil yesterday with the announcement that lemmy.world won't federate with hexbear, and a lot of the users of that instance employ some shady tactics to influence and astroturf. Or it could just be some dumb troll. Who knows?..
- Because their mommy was mean to them today - (told them to take a shower).
  Because their hot pockets burned their mouths.
  Because they have a micropenis.
  Because they see themselves as helping make the site better.
  
  D. All of the above

Thank you for letting us know!

Keep up the good work.

What kind of attack is this one?

Why don't these people go and do something useful, like play in traffic?

Hexbear attacks
- Wouldn't surprise me honestly, but these have been going on since before the hexbear announcement. I would say it's rather convenient timing, but in reality these attacks have been very frequent so it is likely a coincidence. I'd wager more on the alt-right neonazis from exploding heads being the responsible party.
  
  I’d wager more on the alt-right neonazis from exploding heads being the responsible party.
  Putin has both the far-right and pseudo-communists in his pocket to be part of his evangelization troll army. There's no much difference between the camps, just the coat they wear.

Thanks Ruud! LW staff are doing a great job!

those damn script kiddies

The comments still seem to be generating, so I'm able to see them. Great work on your instance @ruud@lemmy.world, you're handling your tenure as Lemmy's largest instance extremely well!

Thank you Ruud for all the work you do!

test (:
- test :P
- Testes...testes...one...two...three. Heh-heh-m-heh!

@ruud@lemmy.world and @sunaurus@lemm.ee
I added some self-awareness of concurrency to the Lemmy API Rust logic: https://github.com/LemmyNet/lemmy/pull/3805/files - this should allow a more standard in-band response to concurrency slow-response server overloads. Keywords ('woodstocksnoopy' as watchdog, and even more alarming keyworld to find in your logs: 'SITE_OVERLOAD') were added to the logging to make it explicit when this is happening.
@sunaurus@lemm.ee

Is this why direct links to replies from the notification view no longer work?
- The links still work for me?
  
  permalinks to comments seem to be broken for me right now (worked a few minutes ago)
  EDIT: now they're working again, seems to have been just a temporary thing
  EDIT 2: actually it does happen again, it's random and quite rare
  
  When I click to see context, it seems to not show my comment but that could be the other instances.
  
  The links still work for me?
  Good for you. :D Sadly, it's the same for me as for AlmightySnoo: Yesterday evening it worked for me, now it doesn't. And when it worked "Show context" didn't link to the parent comment, just to itself.
  Seems to work fine on https://a.lemmy.world/ so I gonna use that for now.

It seems that you can make the comments appear by refreshing once the page is already loaded. At least as far as the webapp goes.

I know this probably isn't the right place to post this but I'm not sure where the right place is. I haven't been able to sort comments by old for over a week. Is this a server wide issue or just a me issue? Any advice about how to tell or where I should ask this question is appreciated.

56 comments