[01:05:58] btw why is discussiontools not working on the RfC page [01:07:59] Only shows up on pages with the New Section link at the top. You can force this behavior by sticking `NEWSECTIONLINK` somewhere on the page [01:08:38] Uploading is disabled? [01:10:26] just tested, unrelated [01:10:47] Even if I have access the uploading is still not able to use [01:11:36] Uploads were disabled during swift outage. [01:11:52] AFAIK [01:12:30] [1/3] Ah I know [01:12:31] [2/3] Thanks [01:12:31] [3/3] Hope the issue will be solved soon and uploading will be back asap [01:13:10] Cloud 11 has been reinstalled and we're now going to be working on the VMs [02:54:16] I think it could be withing a day or two [03:26:59] Hi there. Can I request a cloak for myself? [03:27:51] what is a VM [03:28:08] VM = Virtual Machine [03:29:31] hi MacFan4000, Did u know who the IRC Group Contact is? [03:29:36] CharW: normally yes, but at the moment the person who can get cloaks assigned is not at all active, and seemingly isn’t super easy to reach, and so it may be awhile before Miraheze cloaks are available [03:30:02] ok [03:30:05] thx [03:34:57] Just to let people know: per https://phabricator.miraheze.org/T10717 we are making good progress in restoration efforts. Our temporary change that reduced visible errors has been reverted as part of the restoration - you may start seeing 50X errors again, but should hopefully eventually go away [03:55:53] Any updates on this photo thing? :/ [03:56:59] See #announcements [03:57:39] Hopefully it won’t take too long, I’d like to get my scenarios finished [04:01:14] I just posted a message in this channel about that (directly above yours) [04:02:56] The server that got corrupted is currently being rebuilt, after that is done, images should hopefully start working again [04:03:54] As I said 50X errors may start to come back again - I am seeing error rates starting to increase [04:04:59] What happens if it doesn't? [04:05:39] We'll have to see [04:07:40] images are slowly starting to work again [04:07:54] I'm seeing some SocialProfile pfps work [04:10:02] things are starting to come back on my wiki [04:10:55] indeed, I see some pictures on your wiki again [04:11:40] yay [04:11:47] looks like it’s coming back then [04:12:33] Slowly, there are only ~85 containers currently in the list [04:12:51] there should be multiple per wiki [04:13:06] -deleted and -thumbs too, right? [04:13:13] yeah svgs are loading, but jpg thumbnails are not loading rn [04:13:19] 6000*3 = 18000, hurray [04:13:39] thumbnails are in a separate container so that's probably why [04:13:45] png too [04:13:55] once your thumbnails container is up again, they should work [04:14:05] [1/2] got it. [04:14:05] [2/2] uploads should come back soon, i think? [04:14:49] once all containers are back then I'd assume so [04:14:55] yay, congrats [04:16:46] i imagine larger wikis may take more time to come back? [04:17:13] wiki size shouldn't matter [04:17:32] but we know every little about how this is going to work [04:18:16] i'd probably give everything 12-36 hours to fully recover [04:39:29] It's back [04:39:39] never thought I'd be glad to see the Meta logo \:P [05:00:19] images are back on our site (AVID)! thank you for all your hard work 🥹 [05:00:46] I go sleep now 👍 [05:01:45] Me too! [05:01:58] (For realz this time) [05:04:02] Y'all have done an incredible job, thank you so much for the work you've done [05:04:13] jpg and png still not showing up on mine [05:04:31] going alphabetically and was at b last I checked [05:04:40] it's gonna be a while [05:04:47] oh, ok [05:05:11] when should file upload be restored? [05:05:16] once that's done [05:05:26] alr [05:05:27] thanks [05:14:15] So @Orduin your suggested solution didn't work, any other insights why DiscussionTools won't show up on that page or how to fix it? [05:55:49] Glad to see images are working again but I'm getting permission errors when trying to upload a file despite having sysop rights [05:56:18] That's expected, image uploads will be re-enabled once this issue is fixed on all wikis [05:56:34] The script is running alphabetically and most wikis have 3-5 containers so it might take a few hours to finish [05:59:50] Ah makes sense [06:01:23] There is no reason not to now in my opinion, but that is just my opinion on it. I don't think it is necessary anymore if they are working again at all, it would error for wants it can't retrieve access for, but just a file backend error. Another message already exists and that way you give it back to fixed wikis. [06:02:03] Best to keep it this way as I'm sure we'll get a deluge of people asking why they're getting errors trying to delete or upload photos [06:02:22] at least with the current behavior, people know it's related to the recent incident [06:03:17] I doubt many would error, only wikis created since the issue started would, and a notice still exists. I also highly doubt it would be more then why they don't work at all, or why images didn't appear at all for the last couple days. [06:04:15] Permissions still have to be fixed on most wikis though so that's why I say the majority would probably fail [06:04:48] I still don't think so. Even so, it failing that way or this way has no difference. [06:05:12] It just lets some go through one way and none the other way. [06:06:01] It just unnecessary expands an outage to last even longer unnecessarily for some wikis that they would work for in my opinion. But it's up to you. [06:06:57] it's up to @Reception123 [06:07:00] his call [06:08:38] I just mean it failing for a permission error is far more confusing then the upload backend actually failing with no technical reason it can't until this is fully resolved. [06:09:15] Especially when said permission error is wgRevokePermissions given, so it appears you in a group that should have access. [06:09:28] That is not how it should have been disabled to begin with. [06:09:36] whenever a sitenotice is dismissed it is just dismissed permanently, new notices don't pop up much [06:10:15] [1/2] at least on my end [06:10:15] [2/2] thus i think some that dismissed a notice in the past would then not have seen the notice for thiis [06:11:19] NEVER use wgRevokePermissions to disable something globally, that can very understandable cause mass confusion. I was kinda confused myself and had to look how it was disabled. That was one of the worst ways to disable something because of how it behaves like you should still have access. [06:14:32] <2x2Master#7039> THE IMAGES ARE BACK BABY LESSGOOOOOOOO [06:20:31] I agree with that idea though what would your suggestion be in the future for disabling uploads? [06:21:44] $wgEnableUploads = false; using an onMediaWikiServices hook to override ManageWiki. [06:33:24] [1/2] here is another example of users confused by the current error: [06:33:25] [2/2] @Reception123 @Agent [07:10:05] I've replied [07:12:57] Thank you [07:14:56] Uploads will return in ~5-10 mins [07:15:29] 👍 [07:17:40] So are uploads going to fail if I attempt one? [07:17:59] For the moment, yes [07:18:15] You will find yourself don't have the permission to upload one [07:18:23] But soon you'll be able to again [07:19:01] mainly as this is what it looks like [07:21:53] ...yep, it works [07:21:57] Then magic has happened [07:22:30] So we can say everything comes back 🎉 [07:22:40] It will be working again fully for all requests (without any notices) in a few minutes [07:23:06] @Reception123 will post in #announcements once the changes have rolled out everywhere [07:23:33] awesome work 🥳 [07:23:40] The grey banner is currently being removed [07:23:51] It should only take a few minutes though [07:25:33] Images should work [07:25:49] But you’ll see a message when uploading that it might fail for now [07:26:59] it worked for me [07:27:44] Me too [07:28:45] Uploads should go through, but you’ll see a grey banner at the top of the upload screen saying it won’t work [07:28:45] That should be gone now [07:29:08] Your deploy hasn’t finished yet [07:29:24] Oh? I thought I saw a notification that I did [07:29:32] Or if it did then deploy -> logsalmsg is broken [07:29:38] In that case it should be gone soon [07:29:45] Config has finished on both test & prod [07:29:58] But not magic [07:47:16] Yay the images are back! 🎉 [07:48:30] The SocialProfile avatars are still missing though. [07:48:57] I wonder if that's because they're not regular uploaded files? [07:49:24] I don’t really understand Swift [07:49:33] Can you link to a page that uses them though [07:51:50] [1/2] They only show up on user pages and the top bar if you're logged in with one. (Also comments/other related extensions I believe? Don't have any on my wiki though.) [07:51:50] [2/2] [07:52:25] So it's a minor thing compared to all wiki images [07:52:37] Oh now it showed up [07:52:56] Could be a delay 👌 [07:53:48] Could be the swift container for them wasn't rebuilt or something. [07:54:53] Thank you all for fixing the image issue 🎉Glad we didn't lost anything [07:54:58] I thought that’s why we ran setContainerAccess [08:07:03] Well yeah, but it might be a little different when we are rebuilding things this way. [08:07:22] Cool [08:38:49] its fixed for me [08:38:54] the images finally show [08:41:14] @Josephdapro08 while you're around: do you know why `thebackroomswiki` was closed? [08:41:24] looks like the other bureaucrat made some edits and then just shut it down out of nowhere [08:47:33] we had put it unavailable for edits due to inactivity [08:47:41] but im fine with it being closed, its discontinued [08:57:03] You're welcome [09:00:06] that wiki was a terrible idea... [09:00:25] me and others have made a similar wiki, although we're trying to be more original [09:10:59] could you link the new wiki via sitenotice on the old wiki so people can transfer? There have been multiple confused users on RfRW who do not know why it was closed or what's really going on [09:11:28] good or bad it would seem the wiki had at least some following [09:18:01] Thanks for fixing the problem with the images. Long live Miraheze. [09:19:49] its on a custom mediawiki site, and i'm not planning on transfer [09:20:21] [1/2] might wish to comment to the people requesting reopening then [09:20:22] [2/2] [[Requests for reopening wikis]] [09:20:22] https://meta.miraheze.org/wiki/Requests_for_reopening_wikis [09:20:22]

[09:21:59] btw guys, how do CC-BY-SA attributions work and how can i do them properly? [09:25:44] Import full history is best [09:30:47] i've left a message on requests for reopening wikis [09:47:07] as long as there isn't much blowout, that should do it [09:48:52] looks like the infrastructure guys did it [10:17:51] <ÁtkývLţín#0567> Images are fixed, but is anyone else finding that favicons are still not working? [10:18:39] favicons are working for me [10:18:44] at least the ones on AVID and Meta [10:26:14] Orange_Star: can you check reception’s world deploy [10:26:26] Might be worth deploying world and l10n again [10:26:29] Pretty sure it died [10:26:40] Or finished without !log [10:27:29] re-running now [10:27:43] I'll leave it to reception then [10:27:43] Ty [10:28:00] Orange_Star: once that runs it’s all success and done [10:28:09] I assume an IR coming [10:42:16] @Reception123 progress? [10:43:45] Execute: sudo -u www-data rsync --update -r --delete -e "ssh -i /srv/mediawiki-staging/deploykey" /srv/mediawiki/cache/l10n/ www-data@mw142.miraheze.org:/srv/mediawiki/cache/l10n/ [10:45:26] looks like the deploy finished correctly [10:46:32] Yes [10:46:35] Worked this time [10:46:38] \o/ [10:46:48] Incident now resolved Orange_Star [10:46:59] Reception123: are you keeping the task open for IR [11:01:20] oh [11:01:43] [[mh:backrooms:Main Page]] is kinda a personal project at this point [11:01:43] https://mh.wikipedia.org/wiki/backrooms:Main_Page [11:01:43]

[11:13:40] There should be one yeah [11:14:41] @Reception123 check irc [11:14:48] Test is failing nginx Conf test [11:15:38] There are some wikis whose images are still missing, it will be fixed little by little I guess? [11:15:56] There shouldn’t be any issues as of now [11:15:59] Which wiki? [11:16:16] https://arcanefr.miraheze.org/wiki/Accueil [11:17:22] So... We don't have an Administrators' noticeboard and Community Noticeboard in Commons? [11:18:14] impossible [11:19:27] Something is weird with thumbs @Ice Mace [11:19:43] CharW: Miraheze commons is a mess [11:20:07] It might be possible to force them to regenerate if they don’t load soon [11:20:54] yeah, can see that [11:21:00] I refreshed the page, I used ?debug=1 but nothing. [11:22:18] I prepare to work on it, such as translation and copyright. [11:22:26] (for commons [11:22:30] When I click on the image, it displays it well, strangely enough. [11:23:58] Yeah it’s not handling thumbs [11:24:12] Either that container is still rebuilding for some reason or it’s being weird [11:24:32] CharW: feel free to sort the mess out [11:24:56] @CosmicAlpha any hints as to how to determine if it’s a container issue [11:25:03] lol [11:25:06] Or what to do to make it less stupid [11:25:39] Well, I'll wait a bit, see if it gets better. [11:26:13] I assume it will [11:46:38] Do any Interface Administrator or Admintrator on Commons online can help me changes the model of page? [12:00:09] images are fixed <:pleadingapple:806596715561877515> [12:03:01] ya [12:03:51] Overall, it works. [12:52:34] yep all images work, well done.. [13:16:12] I have to say I noticed a similar issue on AVID not long before the file server went down [14:22:06] <[baws]#7595> YES THE IMAGES ARE BAck [14:27:04] <[baws]#7595> and on avid too yes [14:30:18] Yes, we're aware, thank you [15:10:35] anyone using embedvideos extension that was able to make the inline aligment work? [15:10:47] Our wiki images are back safe and sound! Thanks to all the staffs! [15:13:21] nvm, the inline doesnt work, I had to override it with a div class [15:15:43] [1/2] https://meta.miraheze.org/wiki/User:NimoStar [15:15:43]