[Done] New try at upgrading to 0.18.1 July 1st 20:00 CET

PSA from Admin Team: The update completed roughly two hours ago. Since that time, the Admin team (and other site admins) have been working on the noted performance issues. We believe we have found a solution, but we still need time to test this out. You may still see brief outages and differences in performance as we are testing different configurations. We are trying to prevent rolling back.

While I know this can be frustrating - especially today - please keep in mind we have a team of volunteer techies (from around the globe!) collaborating on this issue. It is an inspiring situation. Also keep in mind that lemmy.world is quite a bit larger (and more active than any other instance). As such, we are a bit of a ‘test instance’ in regards to high volume requests. This is just part of the growing pain. We appreciate your understanding.

@ruud@lemmy.world will provide a debrief once we have completed testing.

Server feels a lot better now than it did an hour ago. Comments are going through quickly and upvotes are working for me.

Performance is extremely uneven. Sometimes loads instantly, sometimes I get a timeout. Upvotes don't show up until reload. Still a lot better than the last attempt.

The server hamsters seem to be on fire, but I won't hold it against the service/community/individuals (except spez; fuck you spez). Lemmy is in the unfortunate position of being forced into a development model called "fuck it, we'll do it live!"

edit: commenting and editing seems to be fine.

Heyo! Small update from someone who is watching the upgrade live; it's ongoing still. Seems like they are still facing some performance issues. So grab your popcorn and wait! 🍿 (Btw, i am not a sysadmin, just a moderator)

TFW you run a small server with an open source social platform for shits any giggles and one month it explodes a thousandfold because of one greedy pig boy.

looking good so far, the instance is back, testing to post!

Just a heads-up. I ended up having to create a new login at lemm.ee because even after the improvements in speed and so on with the upgrade, for all intents and purposes it looks like my account here may have been wiped. Can't login from anywhere, getting "Record not found" whenever I try to sign in on Connect, "incorrect login" from Jerboa, and a spinning button and then nothing on a PC browser, basically treating my account as if it doesn't exist. Some folks appear to be able to login though. Is this an ongoing server issue, or did my account actually get wiped? Same username (Grangle1) as on lemm.ee.

Posting and seems fine from Jerboa, can't log in using wefwef.

Good luck! Posted 19:59 CET.

Finally able to register. Glad to be here.

Thank you for the heads-up. 🤙

Good luck.

Godspeed you absolute madlads.

The last few minutes the site seems to be very fast! Let's hope it stays this way!

Seems I can't upvote

Edit. I can upvote, but with a lot of delay!

Is the update done? I hope not because can't i upvote😅

Nice work with everything so far, really liking it. What all is being changed/fixed in the new revision? Is it just more efficient code to support higher site traffic?

looking good so far, the instance is back, testing to post!

Wow, this is much faster now that caches are built.

Just looked. First 1/2 loads were slow but after that it's lighting fast! I think by not everyone establishing a Websocket connection and just loading once performance should increase a tad bit.

You know, maybe I'm being overly dramatic, but I really feel like we're at the beginning of something special. I realize that Lemmy has existed for some years, but the whole Reddit thing is really pushing it into the limelight, and it's new to me (I joined just before the blackout).

Seeing all the developers and admins dealing with the inevitable bugs, working together to keep the federated instances operating together during a huge surge in users, like a flotilla of disparate ships lashed together facing a major storm - it makes me excited, nervous, and hopeful. I fully intend to support developers and instances financially, but also want to give a big "yay team" shout-out.

My lemmy server is also running the same versions are you are now. I was getting timeouts with lemmy.world federation so I recompiled lemmy_server with timeout changes:

diff --git a/crates/utils/src/lib.rs b/crates/utils/src/lib.rs
index e5d07db2c..e2c592d82 100644
--- a/crates/utils/src/lib.rs
+++ b/crates/utils/src/lib.rs
@@ -18,7 +18,7 @@ use std::time::Duration;

 pub type ConnectionId = usize;

-pub const REQWEST_TIMEOUT: Duration = Duration::from_secs(10);
+pub const REQWEST_TIMEOUT: Duration = Duration::from_secs(13);

 #[macro_export]
 macro_rules! location_info {
diff --git a/src/lib.rs b/src/lib.rs
index cc77ca48f..45c621a7c 100644
--- a/src/lib.rs
+++ b/src/lib.rs
@@ -37,7 +37,7 @@ use tracing_subscriber::{filter::Targets, layer::SubscriberExt, Layer, Registry}
 use url::Url;

 /// Max timeout for http requests
-pub(crate) const REQWEST_TIMEOUT: Duration = Duration::from_secs(10);
+pub(crate) const REQWEST_TIMEOUT: Duration = Duration::from_secs(16);

 /// Placing the main function in lib.rs allows other crates to import it and embed Lemmy
 pub async fn start_lemmy_server() -> Result<(), LemmyError> {

Tried to logout, website on mobile won't release my session, and when I tried to login on jerboa it said password incorrect, not sure if that's a ui issue or a lemmy.world issue though

I hope it works! I'm so over posts just spawning into a page that is already loaded.

And… we’re back!

The progressive web app had ui issues after the update so I uninstalled it and now I can't figure out how to reinstall it 😕 tried wefwef but that doesn't load anything and can't log in. Happily staying patient though, hoping things smooth out!

Can't you disable the post button within the upgrade progress? It's a shame to see posts to disappear due to it.

Looking forward to it. The lag has been brutal.

This is like that scene in a sci-fi movie where they're trying to repair the shop mid-battle. Good luck!

Countdown in case you're not sure about the time zones -> 🔴

yay, instance is back! trying to post timed out two times, this is the third try.

New update sure is fire, post making process page is all cleared up!

Muuuch faster now. Thanks for all the hard work guys!

yay, instance is back! trying to post timed out two times, this is the third try.

Server has sped up significantly. Things are getting faster / better.

Maybe 0.18.1-RC4 will stick? Lets hope!

It worked this time, nice!! Feels a lot better, much more responsive.

Do logins work for anyone else?

I created a "in private" Firefox browser session. I can't seem to login through that.

It's working! Writing from jerboa.

I get an error message when replying to comments tho.

It's working! Writing from jerboa.

Thanks everyone for your hard work!

How loaded are the servers? It would be good to see it maybe in the instance sidebar or a website

Looks like DB's struggling under the load 🤔 Any chance to move DB to the separate server?

Instance got faster now, but still impossible to log in after you've cleared cookies.

I sadly couldn't use the web version of lemmy.world at all cause of the websocket issues. 0.18+ is gonna be an amazing upgrade fore this instance! All the devs and staff who made this happen have my undying respect.

Super responsive, and I can login using Jerboa 37!

Working for me currently on connect for Lemmy.

Thanks

Logging in doesn't work - returns 404 record not found. Resetting password does log you in though,

Things look better. Thank you for the updates!

I like the new layout better, just hope everything keeps working

For those that were about to Google it... 20:00 CET is 12pm PDT and 3pm EDT

May god help us all

Thank you for all of your hard work!

I can feel the heat off those servers from here.

The Reddit users seem to be wasting no time jumping over to Lemmy, now that their apps just got the boot.

Now the question is: how many will stick around?

Good luck. This is my favorite instance so I will be eagerly awaiting. Lemmy has been incredible and strangely what I needed. I would doom scroll reddit and see the same posts and the same comment chains and just redundancy hell.

Lemmy feels so different and the community is so welcoming. Thanks again everyone for making this lost Redditor a found lemming (is that the correct term lol).

Is it wise to do a big deployment on the day when you may receive a massive influx of new users from Reddit? The API changes take affect on the 1st.

Something tells me it will work this time.

Good luck! And thanks for keeping us updated with what you're all doing, I don't know why but it makes me feel part of something big :D

You have the support of Dragon of Dojima. We'll take out reddit ourselves. You have my word

I am probably one of many refugees coming from Reddit. Here is hoping lemmy grows and grows well.

What happened? Or is this not yet done? Sorry I’m kinda lost in the whole CET timings.

Nice work!

Crossing my fingers, excited for the update

Bailing out, you are on your own. Good luck.

A lot of improvements, but some weird problems. Jerboa finally allowed me to log in but not much else. Connect is working better, but won't allow me to reply to one particular post ("incorrect language" or something). The browser version and wefwef are slow and glitchy - my comment about birds ended up in a conversation about Lemmy apps. I don't know anything about tech stuff but I get the impression that people are working very hard to fix all the issues. And the spezidus wouldn't be making things easy. Looking forward to a bigger better Lemmy!

Looking better! Let's go!

Fingers crossed. Would love for the auto refreshing to finally stop.

Pages loading slowly here and sometimes not loading content. Could be due to the number of new users.

Goodluck and thanks for the effort in all of this guys.

Latest version of Jerboa on Google Play doesn't work with servers below 0.18;

For those who want to use Jerboa to access lemmy.world before the upgrade to 0.18.x happens, you can install a specific release from GitHub instead of Google Play. I found version 0.0.34-alpha to work (using it rn to post this). https://github.com/dessalines/jerboa/releases/tag/0.0.34

Edit: since the update is done, it's probably best to go back to latest version. Glad I helped someone!

Looking awesome! faster, more responsive, new sorting types, tighter layout, no auto-load of random posts 🥳 🥳

Just need to sort out the wefwef issue, and we're back in business...

Godspeed. I really hope this is the one and the age of randomly redirecting to sports game threads will be over!

I can't login on my lemmy.world account, neither on Jerboa nor in the browser, I'm getting "Incorrect login" :(

(I'm posting from Liftoff because I was already logged in)

Seems to have worked! Typed from Jeboa :)

Success?! Hello from 0.18 :)

The UI is a lot smoother. Feels good man.

Edit: servers are very sluggish though. Hopefully this gets fixed without needing to roll back.

This hasn't gone well! Fingers crossed it sorts itself out without a rollback.

Super responsive, and I can login using Jerboa 37!

Working super slow. Like 45 seconds per page load.

Slow, but working.

I don't know if we're slow because of the upgrade, or because of the July rush from Reddit losing 3rd party API access.

Crossing my fingers for everything to work out well. I’m looking forward to being able to log into Jerboa.

What happened? Or is this not yet done? Sorry I’m kinda lost in the whole CET timings.

Looks like it works, but it's very slow - 25 seconds to load the page. https://i.imgur.com/ghiofDC.png

Cleared my cache and cookies as I thought it would be necessary like last time, but now I can't log in. The login button just turns into the animated wheel and then nothing happens. I'm typing this on a mobile where I still have an active session.

Super responsive, and I can login using Jerboa 37!

Is the update done? The platform isn't going too well 😅