[00:02:12] @agentisai it's been 90 mins. still on schedule for that 2 hour mark? I've been itching to get the ball rolling on fleshing out this wiki [00:02:13] I will say that the length has been a fair bit more than what was announced (and the notice of its extension was not shared to other servers) [00:02:49] I have to wonder what happened that extended it this much [00:07:13] I'm not sure. 18ish hours down so far. Fingers crossed that everything going okay! [00:12:25] watching the #tech channel is a rollercoaster of emotions. I don't know what I'm seeing, but "LOAD CRITICAL" and "LOAD OK" feel like two very different outcomes [00:23:06] More or less. Perhaps another 30 minutes at most it seems but probably less [00:24:08] If you look at the server name, it's our image file server. I wouldn't worry too much unless you see it mention the "cloudX" servers which host our ~50 servers [00:25:12] Thanks for your hard work! I imagine it's more frustrating from the SysAdmin side than the end user [00:25:31] heh yeah, I didn't get adequate sleep yesterday trying to coordinate this [00:30:49] Soon, you'll get to sit back, sigh in relief, and stay up for another 4 hours until the post-crunch anxiety wears off. [01:04:47] will you be running the smw script as soon as maintenance ends? [01:05:18] Sagan 4 is, inexplicably, getting a lot of people browsing the forum rn, this always seems to happen when the wiki is down lol [01:26:41] of course [02:17:13] hmmm, everything on my wiki's still showing internal error, is there something I need to do? [02:18:18] it's up. I am now logged out, when trying to login I get a problem with session [02:19:24] Might need to clear cookies, old session cookies can cause problems [02:19:33] oooh right right [02:20:20] Ah, not specific to your error, chevrine [02:20:44] [1/2] oh! i was gonna say, yeh, didn't help haha [02:20:44] [2/2] always a good step to try tho i think [02:20:58] Yep, was responding to login issues [02:22:21] internal error encountered by another user too aaa [02:22:28] wouldn't internal errors not be affected by cookies though? [02:22:41] like taking off your coat doesn't stop your pc from overheating [02:22:44] i also have internal error [02:22:52] prolly depends what the site in question stores in cookies ig? [02:25:02] i actually have no idea if i have semantic mediawiki or not so if that's the issue, shhhh ignore me haha [02:25:20] semantic mediawiki will give you a different error rn [02:25:29] > Semantic MediaWiki was installed and enabled but is missing an appropriate upgrade key. [02:25:37] oooh, so different issue then [02:26:03] i spent the downtime tagging a ton of stuff on my booru so i'm raring to upload some pics haha [02:26:58] (you also have to go through a process to request smw so it's hard to forget you installed it) [02:27:43] [1/2] oh! well that's a relief, then haha [02:27:43] [2/2] idk if something like that would carry over from miraheze and my memory's awful but I don't thiiiink i ever requested something like that anyway? [02:27:57] i should probably go find out what that even is haha [02:28:04] yeah you usually only request it if you have some specific use-case [02:28:16] like the linktitles extension! [02:28:26] i got that one on mine and it's so, so nice ;; [02:28:41] it was discussed earlier [02:28:49] oooh tyty [02:29:56] oooh ok that actually sounds gnarly as hell, def reading more on that later haha [02:31:29] Oh I have the same problem too! [02:38:37] don't know if it will help, but here's another error I got logging in... The provided authentication token is either expired or invalid. [02:38:58] Try clearing cookies [02:39:22] or try in incognito [02:39:33] Just to see if it'll work [02:40:01] I did, same thing - I tried doing that in Firefox and Chrome [02:40:30] Okay, umm... I have an idea one sec [02:41:32] Whats on-wiki username? [02:41:36] it don't work for me [02:43:31] trueearth wiki. my username is the same as it's here in Discord [02:44:59] Can you try again [02:45:59] same, I get the There seems to be a problem with your login session... [02:46:08] Damn thats odd... [02:46:38] page seems to hang going to the Main Page, it acts like it's downloading. the browser shows waiting for analytics.wikitide.net ... [02:48:23] [1/2] and, waiting for static.wikitide.net... [02:48:23] [2/2] (not sure if that helps, but seems like something is not running, maybe having to do with these servers / services) [02:49:44] HEY! I just logged in with Incognito (I tried it a moment ago and it didnt work) [02:50:52] Nevermind, it stopped letting me login. But it did once for a sec there. [02:58:45] I am trying a whole bunch of things right now [03:02:27] Try now [03:02:54] Try twice if it doesn't work the first time. [03:03:24] I changed the cache session cache uses and it finally worked for me... [03:03:34] @nolongerontheball_88419 ^ [03:05:08] okay, I got the same message, then I clicked the log in button again, same, I started pounding Login and it shows same message, then a new message said "You are already logged in" , So now I go to main page, and I see I am logged in. [03:05:31] Yeah it might take a minute for it to cache up [03:05:55] Try logging in from incognito or another browser and see if it works the first time now [03:06:46] Session issues are the absolute worst to deal with. [03:07:26] is there a way to prevent session issues following maintenance? I noticed it happens a fair bit here and happened on miraheze, but I don't think I can recall any time I have run into it anywhere else. [03:07:28] [1/2] mine's still down dang, i'm sleepy but i wanna work on it haha [03:07:28] [2/2] not upset or anything! just eager :D [03:08:03] [1/3] okay, I tried with Firefox, same behavior. [03:08:03] [2/3] Incognito took 2 login attempts [03:08:04] [3/3] Chrome incog took me to that central login , but I go back to trueearth and Im logged in [03:08:21] (oh yeah also those of us in smw gang still don't have our wikis up again) [03:08:33] @agentisai ^ [03:08:48] thanks for all your hard work as always guys <3 [03:09:21] This is the first time we have session issues after a migration and we've done like 3. [03:09:25] ditto that, thank you for the hard work you guys are doing ❤️ <:wikiforge:1125253550000316467> [03:09:26] not entirely sure what's up [03:09:47] I fixed session issues I think by switching it to memcached [03:10:25] [1/3] dw i'm cursed things break whenever i start hanging out somewhere [03:10:25] [2/3] i got ghosts :( [03:10:26] [3/3] sorry for all the haunting guys [03:10:37] It might take time for it to work immediately on the first try as cookies and old cache is refreshed. [03:10:39] I tried to clear the cookies and log in many browsers, but it still displays this [03:10:55] click Login a bunch of times... [03:11:18] Try a few different times, eventually it works, at least for me, and when it finally did, it worked without issue in other browsers also. [03:12:15] If they are still happening tomorrow I will look into a much more reliable fix, what I did was sorta a patch-fix temporarily that appears to not work 100% of the time. [03:12:27] we need......wikiforge n wikitide heart emoji. o: [03:13:33] [1/2] this maintenance has felt kinda hectic [03:13:33] [2/2] what caused it to extend way past the window that was announced, anyway? [03:14:07] i told you, man, it's all the ghosts!! [03:15:37] I have to go for tonight all. If there are still issues tomorrow I can look much more tomorrow, or someone else might later tonight. [03:16:18] sleep well! i'mma log too. night all uwu [03:16:18] have a good night - thank you for helping! [03:18:16] I assume the smw script was run? [03:19:00] I don't want Sagan 4 to be down overnight 😓 [03:19:23] so if there's an issue with the script now... [03:19:31] Agent was gonna handle that, if its not up then it might another issue. Sometimes it has to be ran twice so maybe it was only ran once or something. [03:21:22] I am running again now [03:22:20] Link me your wiki again [03:22:39] https://alpha.sagan4.org/ [03:22:58] [1/3] actually we have multiple using smw, [03:22:58] [2/3] https://beta.sagan4.org/ [03:22:59] [3/3] https://mason.sagan4.org/ [03:27:03] [1/3] IDK if this helps; it seems like a service isn't responding. maybe that's part of the issue? [03:27:03] [2/3] GET https://static.wikitide.net/commonswiki/8/8a/Hosted_by_WikiTide.svg 503 (Service Unavailable) Main_Page:682 [03:27:04] [3/3] GET https://analytics.wikitide.net/matomo.js net::ERR_ABORTED 504 (Gateway Timeout) [03:32:21] Fixed [03:32:23] yay [03:41:48] Still in SMW maintenance mode on https://farthestfrontier.wiki, but I'm assuming it'll solve itself in a bit [03:44:34] fixed [03:48:57] having login problems like everyone else mow even after clearing cookies [03:50:35] Yes I'm getting the same login session problems as everyone else, I was logged in a bit ago but when I tried to edit it says it cannot verify that I am logged in and asked to log out/log in [04:28:10] i can't upload either [04:31:21] getting error when ploading [04:44:00] [1/2] It just a fatal and that's it- [04:44:00] [2/2] `[e448caee1d9308cad3f1327d] 2023-12-09 04:43:07: Lỗi chí tử loại “Error”` [05:10:09] yeah i can log in now but the images are not image-ing [05:13:48] Hmmm, my images are loading but some of WikiTides aren't loading [05:37:46] [1/2] Until the image stuff following on from maintenance is resolved, uploads won't work properly. [05:37:47] [2/2] Apologies folks, our SRE team is taking a breather after hours of extended maintenance but will be back on the case soon. [09:48:54] Can someone help me: `[46364404d71dc831f2f075f6] 2023-12-09 09:48:29: Lỗi chí tử loại “Error”` [09:49:20] I can't even re-auth now [10:32:28] @notaracham Thanks for all your hard work. We appreciate you guys! [10:59:28] I get this error when uploading an image [11:10:10] @platyellow It's a known issue. It should be fixed today sometime. SRE team is taking a break after working on the systems for 18+ hours. [11:26:21] i have this error on every single page [12:49:06] You aren't alone- [13:26:19] [1/2] good morning! yep, still internal error/fatal exception on my end. those pesky ghosts! [13:26:19] [2/2] thank you again for your hard work, guys <3 [14:01:56] I created a post in the #support channel the other day and now it's just gone? There were no responses. It looks like the channel was purged? What was the reason for this? [14:03:25] [1/2] Would wiki tide be able to support this extension that enables pages to source directly from Google Sheets? https://github.com/mhucka/mediawiki-google-spreadsheet-extension [14:03:26] [2/2] If no, are there other solutions to pull from a google sheet? Thanks! [15:12:03] My Wikis are working fine it’s just some images not showing up [15:24:51] it shall, as long as it passes the security reviews [15:26:37] or there might be something else, however since it would render stuff from outside the tides, it would also require some times to at least to make it more secure [15:26:50] this also applies to ExternalData [15:30:24] What is the process to request this? [15:31:03] You have to make a [[wtphorge:]] account there, using your WikiTide user, then make a task to request the extension [15:31:03] [15:31:44] But just to be sure, you may have to search for the extension if it have ever been there already, if it don't then continue. [17:08:33] [1/2] "There is currently no text in this page. You can search for this page title in other pages, or search the related logs, but you do not have permission to create this page. " [17:08:33] [2/2] Is there a way to change this text? I'd like to it also say "If you would like to create this page, please create an account." with a Special:CreateAccount link [17:08:43] Note: I did not google it first lol [17:40:10] @sodeca that can be changed by editing MediaWiki:Noarticletext-nopermission on your wiki [17:48:49] hey! any eta on when our wikis will be up yet? ^^ ty! [17:49:52] Your wiki should be back online, there should just be image issues and a few stray MediaWiki errors... [17:50:35] since last night and other users reported the same then! o: [17:50:56] entire wiki's like this as are some other wikis, verified by one of my users too [17:50:59] Thanks, that's the second bucket then. Our SRE team should be back online in a bit. [17:51:06] thank you! <3 [17:51:46] here are two more reports of it linked in the reply [18:44:08] templatestyles also seems to be gone [19:42:21] Images should be coming back soon [19:45:22] ooh, mine's doing something different now :D am guessing this is intended [19:45:51] Definitely not intended looking [19:45:59] lmaoberg [19:46:12] ah, i figured it'd be 'cause y'all're working on the issues now haha [19:46:20] At least the image came back for errors lol [19:46:31] it was doing fatal exceptions before [19:46:42] link? [19:46:54] oh nvm the fatals are back [19:46:58] https://wiki.chevrine.com/wiki/Main_Page [19:47:11] [1/2] just give them the error info- [19:47:11] [2/2] `[f39671dcad1c4d878539579f] 2023-12-09 19:46:08: Lỗi chí tử loại “Error”` [19:47:42] `[415684b3a631fe5bbcf912ba] 2023-12-09 19:46:25: Fatal exception of type "Error"` [19:48:08] they mostly would need the ID at the beginning [19:48:25] the numbers are different every time, i doubt they're actually necessary for the debugging? not like i'd know either way but [19:48:33] it is [19:49:02] do you do backend work on mediawiki farms too? [19:49:26] not really, but I do make PRs in the repo [19:49:37] ah. [19:50:04] the exception ID allows for an easier time finding the error in the logs as a sysadmin can just search for that unique string [19:50:41] [1/15] [c958d048dc10a2fb7fb86e74] /wiki/Main_Page Error: Access to undeclared static property MediaWiki\Extension\PageProperties\SchemaProcessor::$Logger [19:50:42] [2/15] Backtrace: [19:50:42] [3/15] from /srv/mediawiki/1.40/extensions/PageProperties/includes/classes/SchemaProcessor.php(223) [19:50:42] [4/15] #0 /srv/mediawiki/1.40/extensions/PageProperties/includes/classes/SchemaProcessor.php(151): MediaWiki\Extension\PageProperties\SchemaProcessor->getAllowedMimeTypes() [19:50:43] [5/15] #1 /srv/mediawiki/1.40/extensions/PageProperties/includes/PageProperties.php(80): MediaWiki\Extension\PageProperties\SchemaProcessor->__construct() [19:50:43] [6/15] #2 /srv/mediawiki/1.40/extensions/PageProperties/includes/PagePropertiesHooks.php(131): PageProperties::initialize() [19:50:43] [7/15] #3 /srv/mediawiki/1.40/includes/HookContainer/HookContainer.php(338): PagePropertiesHooks::onBeforeInitialize(MediaWiki\Title\Title, NULL, OutputPage, User, WebRequest, MediaWiki) [19:50:44] [8/15] #4 /srv/mediawiki/1.40/includes/HookContainer/HookContainer.php(137): MediaWiki\HookContainer\HookContainer->callLegacyHook(string, array, array, array) [19:50:44] [9/15] #5 /srv/mediawiki/1.40/includes/HookContainer/HookRunner.php(932): MediaWiki\HookContainer\HookContainer->run(string, array) [19:50:44] [10/15] #6 /srv/mediawiki/1.40/includes/MediaWiki.php(207): MediaWiki\HookContainer\HookRunner->onBeforeInitialize(MediaWiki\Title\Title, NULL, OutputPage, User, WebRequest, MediaWiki) [19:50:45] [11/15] #7 /srv/mediawiki/1.40/includes/MediaWiki.php(923): MediaWiki->performRequest() [19:50:45] [12/15] #8 /srv/mediawiki/1.40/includes/MediaWiki.php(576): MediaWiki->main() [19:50:46] [13/15] #9 /srv/mediawiki/config/initialize/entrypoints/index.php(86): MediaWiki->run() [19:50:46] [14/15] #10 /srv/mediawiki/config/initialize/entrypoints/index.php(82): wfIndexMain() [19:50:47] [15/15] #11 {main} [19:50:47] [1/2] oooh, new error this time [19:51:21] I enabled the full trace to show temporarily since nothing seeme to log in our logging. [19:52:06] weird, i don't see any ghosts in there... 👻 [19:52:12] Oh. And PageProperties is the cruprit here exactly [19:52:40] I did having some issues with it before [19:55:18] it seems to be caused by something in wgFileExtensions that doesn't have a valid mime type [20:06:03] Images are back now [20:10:51] not for me- [20:12:28] We renamed all wikis, so you may have to update static URLs in ManageWiki to remove 'tide' from dbname. I will run a script to update all later probably. [20:15:52] ah, ik that's gonna happen [20:16:30] [1/2] Btw, can't reauth now [20:16:31] [2/2] https://lophocmatngu.wiki/wiki/%C4%90%E1%BA%B7c_bi%E1%BB%87t:%C4%90%C4%83ng_nh%E1%BA%ADp?returnto=WLHMN [20:19:23] and login in Meta now cause `There seems to be a problem with your login session; this action has been canceled as a precaution against session hijacking. Please resubmit the form.` [20:20:15] going to sleep for the sake of god, it's 3 AM in my time [20:20:21] Try again please [20:21:08] Nevermind still seems to fail [20:21:15] ah, here we go [20:21:29] oh yeah it does [20:21:57] mine's still out, darn [20:22:09] I'm now logged in Meta, but not my wiki [20:23:07] Login from incognito, logout, then try normal again [20:23:10] I can't even use Special pages to login as above- [20:23:29] Same here, try that on your wiki also [20:23:53] Oh that [20:24:04] You aren't alone [20:24:19] Disable PageProperties in Special:ManageWiki/extensions for now. It seems it was broken recently. [20:24:39] or does error happen there also? [20:24:41] i can't, every page is like this ;; [20:24:45] oh [20:24:49] the entire wiki's been like this since last night [20:24:50] +1 [20:24:54] I will disable from shell [20:25:04] for me and a few other people + their wikis [20:25:28] I will disable PageProperties itself on all wikis for now [20:25:33] thank you!! [20:26:17] nice, but I do think that we might have to run something like rebuild or update if PP still causing issues afterward [20:26:49] I tries disable it once and then the same error happen [20:27:29] Going to sleep for the records [20:27:42] it's 3:30 AM rn [20:29:09] PageProperties is on the latest version [20:29:16] so something recently borked it [20:29:24] indeed but it is broken 5 days ago [20:37:59] Should be disabled [20:38:16] just came up, i was watching the log haha [20:38:25] yay, thank you <3 [21:40:31] oh, thanks! [21:59:54] is PageProperties what handles extensions? because I think that's broke too. trying to enable upload wizard and keeps failing with error 500 [22:08:26] [1/3] Seems like login/logout is working, images are loading, only thing I notice is the page appears to not finish loading, waiting for analytics.wikitide.net/matomo.js (timing out after 2min 20sec) [22:08:26] [2/3] browser console shows: [22:08:26] [3/3] Loading failed for the