Server corruption/outage and backup restored

I’ll do another software update tomorrow, they have been committing lots of bug fixes. Unfortunate that their automated tests don’t catch a lot of these issues.

4 Likes

I see that’s done. I am just catching up on my notifications, but there is some goofy stuff still happening.

  • I’m still unable to click the markdown/rich text toggle or the plus button in message compose,
  • I still cannot see the right results pane in markdown mode that I’m stuck in (right half that shows how the message will look is blank).
  • Sometimes clicking a notification takes me to the middle of a topic consistently instead of knowing where I last read.
  • sometimes interacting with the notification menu causes scroll freeze, or gives a blank page.
  • The forum used to do all sorts of transitions, such as the left sidebar sliding out and the main forum body would slide to maintain position in the middle. Now the sidebar just blinks on and off when toggled, and often it triggers the notification menu on the other side even though I didn’t click there.

This almost suggests something like cookies are disabled in my browser. just as I was typing this the right notification menu kept dropping down randomly and wouldn’t dismiss, so I had to refresh the browser.

I’m still a little mystified what of this is reset forum Admin settings, and what is permanent in the update with regard to supported browsers. I’m in Safari 17.6 which has always worked very well so I’m stumped and continue to twiddle admin settings that might seem relevant.

1 Like

I almost always end up in the wrong place in a topic, whether clicking on a notification in the top right of the forum, or clicking on a thread in the “latest” forum.

Exasperatingly the forum seems to know what I last read. It marks it as a separate thing in the topic. It just won’t take me there. Or to the post I’m being notified about.

I’m using Safari too. On my Mac, iPad and iPod touch.

1 Like

Navigating between posts using the level 2 headings in the header line of each post seems to be somewhat broken using Firefox and Orca.

And while I don’t have an issue with go to first unread post not working, the Infinite scroll remains at the top of of my list of things where I wish Discourse was more like every other forum software I’ve used over the last almost 25 years… Though I understand the Discourse devs went so hard on the infinite scroll that implementing pagination is basically impossible short of rebuilding from scratch.

I’ve just updated the forum software, so hopefully some of the issues have been fixed.

I’m not going to track bug reports in this topic. If you continue to find bugs please either report them at the Discourse Meta forum yourself (where they’re very friendly, and often fix bugs quickly, though sadly accessibility issues get left for longer), or post them in the Site Feedback category where one of us can send the report on for you. Posting each bug in its own topic will let us request more info if needed and track when things get fixed, without cluttering this announcement topic.

5 Likes

Ironically the Discoursa Meta site doesn’t load for me at all. I’ll try Site Feedback here.

Actually, whatever you just did Dannii fixed most every problem I’ve been having - the sidebar nudges, I can see the right panel and toggle markdown, and I can actually click in the compose menu. Also my pointers seem to be updated where I’m not always landing in the middle of the topic.

Uploading images is still freezing but I might need to reload the browser.

Uploading images is still weird, but I’ll work on it. On Mac if I freeze I can hit command-W to close a tab.

2 Likes

Many thanks! It’s fixed my big problem of latest links and post notifications not jumping into the right post in topics. All working now as it should do.

4 Likes

The forum seems to be working well using Google Chrome at this point.

Thanks, Jeff

PS. It is nice that reaction emojis other than a “heart” are now working. I thought that they would be useful in a thread a while ago.

1 Like

the wysiwyg right hand is now working as designed :slight_smile:

[lines of test of the menubar deleted…] (ALL tested save the poll creator, because I’m rather inexpert on it…)

Now the editor works perfectly, as prior of the mess ! THANKS, dannii & others !!!

Best regards from Italy,
dott. Piergiorgio.

ps. I have for some time a bug report (on QTads) which can’t be explained w/o screenshot, so please advice me when the upload of images (still not working, as Hanon notes) works as designed.

1 Like

I just now today am able to upload images.

(This is a random screenshot when we first returned and stuff wasn’t working which I wasn’t able to upload…)

1 Like

My mobile issues seem to have been resolved after the latest update, so no more concerns from me!

1 Like

Just realised I never ended up posting that postmortem I promised, so here it is.

The forum had two types of backups: a daily Linode (whole server) snapshot, and a weekly Discourse (the forum software) backup onto S3. Unfortunately the daily Linode snapshot from the 26th did not work: when we tried restoring it the server would not accept any network connections. Even more unfortunately, each daily Linode snapshot replaces the day before’s, meaning we couldn’t go back and try the one from 2 days ago. Linode also keeps a weekly snapshot, the most recent of which was from July 20, which we could restore and connect to, but using it as is would have resulted in a whole week’s worth of posts being lost.

The forum backed up itself to S3 once a week, and the most recent S3 backup was from July 25. We were able to put this backup into the July 20 server and get everything back up and running on July 30. All up the forum was offline for 3 days and lost about 1 day and 7 hours of posts. Now that we’ve seen that the Linode snapshots are not so reliable we have switched to daily S3 backups. Hopefully we won’t have another server corruption event, but if we do then our backups will at least be more recent.

13 Likes

Out of interest, do we keep any other long-term backups of the forum, even if very infrequently?

2 Likes

Looks like Linode also does a fortnightly snapshot. Other than that we have periodic database exports on the IF archive, but you couldn’t restore the forum from them.

4 Likes