[04:15:29] Is this a fault on my end or am I screwed? Can't tell. [04:16:01] No. Just try again and don't press login twice [04:16:37] I did. [04:16:48] It still brings it up. Unsure if this means I'm banned or not. [04:17:49] you're not the only one experiencing this [04:18:08] two members of AVID staff have also been caught in this [04:18:45] Oh alright. I did get "Invalid CRSF token" when I was signing out. [04:18:58] So I think the site's currently facing server issues. [04:19:17] Couldn't save my edits either. [04:35:06] i am unable to save any edits [06:01:24] i am unable to log out [06:02:32] CSRF token is invalid? [06:02:37] I'm looking [11:04:37] wiki is completely inaccessible for a few hours now, showing this error: [11:09:54] same [11:09:55] 500 [11:21:16] ig editing without css works lol [11:22:08] [1/2] oh wait it doesnt work [11:22:08] [2/2] disappointin [11:24:05] [1/3] wow first edit in 51 minutes [11:24:05] [2/3] and the edit took 3 minutes to save [11:24:05] [3/3] this is totally normal [11:26:20] [1/3] wow first edit in 51 minutes [11:26:21] [2/3] and the edit took 3 minutes to save, there was no css when editing, and it took a bazillion reloads [11:26:21] [3/3] this is totally normal [11:28:37] [1/3] first edit in 51 minutes [11:28:37] [2/3] and the edit took 3 minutes to save, there was no css when editing, it took a bazillion reloads, and now its back to 500s [11:28:37] [3/3] this is totally normal [15:03:56] Hmm, not really sure what happened [15:04:03] It's probably due to PHP 8 I'm guessing [15:06:16] Next time this happens, I might change the Puppet config for mw1 to use php7.4 again [15:06:33] some things don't seem to play nice with php8 yet \:( [15:20:27] 😦 [15:20:49] :( [15:21:08] \:( [15:21:10] Yep my wikis are down too [15:21:27] Still? [15:21:42] avid wiki is also down [15:21:44] I'm starting Puppet then [15:24:24] yeah, I'm starting puppet right now [15:24:31] will deploy to mw* soon [15:24:40] or actually, just mw1 [15:24:44] mw2 has PHP 7.4 [15:36:33] ohhh [15:36:41] I think I know why mw1 is down [15:57:44] Uh.....has it been deleted? [15:58:21] That'd be silly, of course [15:58:26] Refresh now [15:59:21] hmm, seems mw1 is out for now [15:59:38] Well that explains it at least. [16:00:10] Just make sure data is intact [16:00:22] I deleted all wikis obviously \:P [16:00:29] that's why they can't be found [16:00:52] I'd suggest not make that joke during a downtime tho [16:02:43] one can't seriously believe such negligence though [16:02:53] PHP on mw1 is a little borked for now [16:03:05] so I think I'll decommission it and let mw2 handle everything [16:03:07] I mean, since it happened on MH before, people would believe so [20:45:51] Any updates on when the wikis will be back up? [21:56:14] DC Multiverse is fine, but AVID? [21:56:30] Its...basically dead. Probably the whole reason why ALL of this is happening. [22:19:00] the reason, more than likely not [22:19:27] I must admit it's been disappointing though [22:20:27] I'd hoped for an end to regular sustained "events" in host migration [22:24:01] This one isn't a migration issue to my understanding, but I'll defer to the SRE team on finalizing the incident reports. [23:15:09] It's still not working for me [23:15:47] Like I said. It deaf. [23:16:27] No I mean DCM, you said that it's fine but it's not working for me [23:22:35] Well, earlier it was. [23:58:44] what was the problem with AVID [23:59:20] I think the extreme data load it has basically destroyed it. [23:59:48] what kind of extreme data