[00:00:32] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.24, 6.91, 7.13 [00:03:25] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 26.40, 20.02, 16.80 [00:05:19] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 9.82, 8.64, 7.38 [00:05:47] PROBLEM - nenawiki.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for nenawiki.org could not be found [00:08:13] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.43, 4.77, 3.80 [00:09:19] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.42, 7.85, 7.38 [00:10:35] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.77, 7.95, 7.86 [00:11:13] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 22.42, 23.36, 19.88 [00:11:19] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 10.87, 8.73, 7.74 [00:12:13] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 4.25, 4.77, 4.06 [00:12:31] RECOVERY - nenawiki.org - reverse DNS on sslhost is OK: rDNS OK - nenawiki.org reverse DNS resolves to cp13.miraheze.org [00:13:11] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 25.24, 23.27, 20.19 [00:13:19] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.78, 7.85, 7.54 [00:15:10] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 21.01, 22.91, 20.49 [00:18:34] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.89, 6.80, 7.16 [00:19:04] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 28.48, 25.62, 22.05 [00:20:13] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.55, 5.61, 4.66 [00:21:19] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 9.25, 8.39, 7.75 [00:22:32] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.88, 7.90, 7.58 [00:23:19] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.39, 7.73, 7.60 [00:26:13] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 4.47, 5.67, 5.05 [00:28:33] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.77, 7.73, 7.49 [00:30:13] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.47, 5.52, 5.08 [00:30:33] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.44, 7.32, 7.35 [00:33:20] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 12.66, 8.57, 7.82 [00:34:33] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 12.15, 9.22, 8.02 [00:35:21] PROBLEM - wiki.astralprojections.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.astralprojections.org could not be found [00:35:22] PROBLEM - rangpurpedia.xyz - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for rangpurpedia.xyz could not be found [00:35:28] PROBLEM - wiki.danvs.net - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.danvs.net could not be found [00:35:32] PROBLEM - www.wikimicrofinanza.it - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.wikimicrofinanza.it could not be found [00:35:33] PROBLEM - madzebrascience.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for madzebrascience.wiki could not be found [00:35:34] PROBLEM - wiki.responsibly.ai - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.responsibly.ai could not be found [00:35:36] PROBLEM - infectowiki.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for infectowiki.com could not be found [00:35:42] PROBLEM - wiki.thunis.eu - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.thunis.eu could not be found [00:35:42] PROBLEM - wiki.shaazzz.ir - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.shaazzz.ir could not be found [00:35:42] PROBLEM - wiki.wysteria.ga - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.wysteria.ga could not be found [00:35:44] PROBLEM - vortekspedia.tk - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for vortekspedia.tk could not be found [00:35:49] PROBLEM - wiki.macc.nyc - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.macc.nyc could not be found [00:35:53] PROBLEM - nonbinary.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for nonbinary.wiki could not be found [00:35:53] PROBLEM - orain.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for orain.org could not be found [00:38:13] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.30, 5.96, 5.58 [00:39:20] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.06, 7.86, 7.82 [00:40:33] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.50, 7.77, 7.75 [00:42:15] RECOVERY - wiki.astralprojections.org - reverse DNS on sslhost is OK: rDNS OK - wiki.astralprojections.org reverse DNS resolves to cp13.miraheze.org [00:42:16] RECOVERY - www.wikimicrofinanza.it - reverse DNS on sslhost is OK: rDNS OK - www.wikimicrofinanza.it reverse DNS resolves to cp13.miraheze.org [00:42:17] RECOVERY - rangpurpedia.xyz - reverse DNS on sslhost is OK: rDNS OK - rangpurpedia.xyz reverse DNS resolves to cp13.miraheze.org [00:42:18] RECOVERY - madzebrascience.wiki - reverse DNS on sslhost is OK: rDNS OK - madzebrascience.wiki reverse DNS resolves to cp13.miraheze.org [00:42:20] RECOVERY - wiki.responsibly.ai - reverse DNS on sslhost is OK: rDNS OK - wiki.responsibly.ai reverse DNS resolves to cp13.miraheze.org [00:42:23] RECOVERY - infectowiki.com - reverse DNS on sslhost is OK: rDNS OK - infectowiki.com reverse DNS resolves to cp13.miraheze.org [00:42:24] RECOVERY - wiki.danvs.net - reverse DNS on sslhost is OK: rDNS OK - wiki.danvs.net reverse DNS resolves to cp13.miraheze.org [00:42:29] RECOVERY - wiki.macc.nyc - reverse DNS on sslhost is OK: rDNS OK - wiki.macc.nyc reverse DNS resolves to cp13.miraheze.org [00:42:35] RECOVERY - wiki.thunis.eu - reverse DNS on sslhost is OK: rDNS OK - wiki.thunis.eu reverse DNS resolves to cp13.miraheze.org [00:42:35] RECOVERY - wiki.shaazzz.ir - reverse DNS on sslhost is OK: rDNS OK - wiki.shaazzz.ir reverse DNS resolves to cp13.miraheze.org [00:42:35] RECOVERY - orain.org - reverse DNS on sslhost is OK: rDNS OK - orain.org reverse DNS resolves to cp13.miraheze.org [00:42:38] RECOVERY - nonbinary.wiki - reverse DNS on sslhost is OK: rDNS OK - nonbinary.wiki reverse DNS resolves to cp13.miraheze.org [00:42:42] RECOVERY - wiki.wysteria.ga - reverse DNS on sslhost is OK: rDNS OK - wiki.wysteria.ga reverse DNS resolves to cp13.miraheze.org [00:42:43] RECOVERY - vortekspedia.tk - reverse DNS on sslhost is OK: rDNS OK - vortekspedia.tk reverse DNS resolves to cp13.miraheze.org [00:46:13] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 7.87, 5.97, 5.54 [00:48:13] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 4.60, 5.35, 5.37 [00:52:34] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.12, 5.87, 6.72 [00:54:13] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 7.23, 5.85, 5.50 [00:55:24] PROBLEM - johanloopmans.nl - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for johanloopmans.nl could not be found [00:55:34] PROBLEM - www.wikilukas.tk - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.wikilukas.tk could not be found [00:55:35] PROBLEM - speleo.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for speleo.wiki could not be found [00:55:35] PROBLEM - worldsanskrit.net - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for worldsanskrit.net could not be found [00:55:55] PROBLEM - wiki.meeusen.net - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.meeusen.net could not be found [00:56:13] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.38, 5.63, 5.47 [00:57:20] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.37, 5.88, 6.68 [01:02:05] RECOVERY - johanloopmans.nl - reverse DNS on sslhost is OK: rDNS OK - johanloopmans.nl reverse DNS resolves to cp13.miraheze.org [01:02:22] RECOVERY - www.wikilukas.tk - reverse DNS on sslhost is OK: rDNS OK - www.wikilukas.tk reverse DNS resolves to cp13.miraheze.org [01:02:27] RECOVERY - speleo.wiki - reverse DNS on sslhost is OK: rDNS OK - speleo.wiki reverse DNS resolves to cp13.miraheze.org [01:02:28] RECOVERY - worldsanskrit.net - reverse DNS on sslhost is OK: rDNS OK - worldsanskrit.net reverse DNS resolves to cp13.miraheze.org [01:02:42] RECOVERY - wiki.meeusen.net - reverse DNS on sslhost is OK: rDNS OK - wiki.meeusen.net reverse DNS resolves to cp13.miraheze.org [01:04:15] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 3.49, 4.56, 5.06 [01:08:45] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 12.28, 18.93, 23.49 [01:24:45] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 14.10, 17.01, 20.00 [01:27:22] Voidwalker: https://gerrit.wikimedia.org/r/c/mediawiki/extensions/Lingo/+/700631/ was C+2d so Lingo can be updated and re-enabled once merged. [01:27:48] sure, will do [01:28:09] Thanks! [01:29:34] [02mediawiki] 07The-Voidwalker deleted branch 03The-Voidwalker-patch-1 - 13https://git.io/vbL5b [01:29:35] [02miraheze/mediawiki] 07The-Voidwalker deleted branch 03The-Voidwalker-patch-1 [01:31:06] Merged. [01:32:35] [02miraheze/mediawiki] 07The-Voidwalker pushed 031 commit to 03REL1_36 [+0/-0/±1] 13https://git.io/JnXFE [01:32:37] [02miraheze/mediawiki] 07The-Voidwalker 03f74b46f - Update Lingo [01:35:20] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.75, 6.76, 5.79 [01:38:09] Thanks Voidwalker! [01:38:45] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 21.96, 20.72, 19.39 [01:40:45] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 16.36, 19.00, 18.92 [01:41:19] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.58, 6.36, 5.97 [01:44:55] [02miraheze/mw-config] 07The-Voidwalker pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JnXNU [01:44:57] [02miraheze/mw-config] 07The-Voidwalker 033e1693d - re-enable Lingo [01:45:55] miraheze/mw-config - The-Voidwalker the build passed. [01:53:52] reenabled and working :D [02:04:21] Great! Thanks! [02:05:19] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.36, 7.16, 6.21 [02:07:19] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.70, 6.01, 5.89 [03:53:40] PROBLEM - cp12 Current Load on cp12 is CRITICAL: CRITICAL - load average: 2.67, 2.26, 1.47 [03:55:41] RECOVERY - cp12 Current Load on cp12 is OK: OK - load average: 0.74, 1.67, 1.35 [05:03:32] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 9.60, 6.94, 5.47 [05:05:27] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.06, 6.84, 5.61 [05:07:22] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.93, 6.12, 5.49 [05:39:50] PROBLEM - test3 MediaWiki Rendering on test3 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 324 bytes in 0.019 second response time [05:41:49] RECOVERY - test3 MediaWiki Rendering on test3 is OK: HTTP OK: HTTP/1.1 200 OK - 20019 bytes in 0.260 second response time [05:45:49] PROBLEM - test3 MediaWiki Rendering on test3 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 324 bytes in 0.010 second response time [05:47:49] RECOVERY - test3 MediaWiki Rendering on test3 is OK: HTTP OK: HTTP/1.1 200 OK - 20019 bytes in 0.176 second response time [06:07:49] PROBLEM - test3 MediaWiki Rendering on test3 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 765 bytes in 0.111 second response time [06:09:49] RECOVERY - test3 MediaWiki Rendering on test3 is OK: HTTP OK: HTTP/1.1 200 OK - 20019 bytes in 0.162 second response time [11:17:04] [02miraheze/dns] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JnMS8 [11:17:05] [02miraheze/dns] 07Reception123 0381ae5f7 - add www to stardewmodding.wiki [11:21:29] !log sudo rm -rf /tmp/* on mw8 [11:21:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [11:21:55] !log sudo rm -rf /tmp/* on mw9 [11:21:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [11:21:58] !log sudo rm -rf /tmp/* on mw10 [11:22:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [11:22:04] RECOVERY - mw10 Disk Space on mw10 is OK: DISK OK - free space: / 6342 MB (33% inode=75%); [11:22:14] RECOVERY - mw8 Disk Space on mw8 is OK: DISK OK - free space: / 4538 MB (23% inode=75%); [11:23:00] [02miraheze/ssl] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JnM9c [11:23:01] [02miraheze/ssl] 07Reception123 0362bbac0 - Update stardewmodding.wiki.crt [11:23:24] RECOVERY - mw9 Disk Space on mw9 is OK: DISK OK - free space: / 6307 MB (33% inode=76%); [11:24:35] RECOVERY - www.stardewmodding.wiki - reverse DNS on sslhost is OK: rDNS OK - www.stardewmodding.wiki reverse DNS resolves to cp13.miraheze.org [11:32:11] PROBLEM - cp13 Puppet on cp13 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[nginx] [11:58:10] RECOVERY - cp13 Puppet on cp13 is OK: OK: Puppet is currently enabled, last run 7 seconds ago with 0 failures [16:34:58] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.86, 6.31, 5.02 [16:36:55] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.59, 5.69, 4.95 [16:56:10] dmehus: I've never seen the bots website stats show a bot get past reCaptchaV4 [16:56:12] V3* [16:58:32] RhinosF1, wiki bots are different than website bots. Wiki spambot farms have paid employees/contractors answering captchas for them. It's well documented [16:59:11] dmehus: if a human is answering them, we're never gonna stop them with captcha [16:59:18] Of any kind [17:35:21] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.07, 5.85, 5.07 [17:37:15] 1.36.1 comes out tomorrow. [17:37:17] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.54, 5.36, 4.99 [17:57:41] PROBLEM - bacula2 Disk Space on bacula2 is WARNING: DISK WARNING - free space: / 141533 MB (10% inode=99%); [18:00:18] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.04, 4.78, 4.05 [18:02:13] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 4.10, 4.62, 4.09 [18:12:30] PROBLEM - bacula2 Bacula Phabricator Static on bacula2 is WARNING: WARNING: Full, 88383 files, 9.072GB, 2021-06-07 18:09:00 (2.1 weeks ago) [18:16:18] ReCaptchaV3 works differently than V2, V3 assigns a bot score for the user and the service can use the score to determine what to do with it [18:17:07] The thing with MediaWiki is that the current Captcha handling is pass/fail, it is not procedural so V3 doesn't do much [18:18:28] If you're interested in a quick read: https://phabricator.wikimedia.org/T241921 [18:18:29] [url] ⚓ T241921 Fix Wikimedia captchas | phabricator.wikimedia.org [18:19:47] Alternatively why not consider hCaptcha? [18:21:07] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.95, 5.35, 4.55 [18:23:03] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 4.52, 4.92, 4.48 [18:24:45] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-3 [+0/-0/±1] 13https://git.io/Jnytp [18:24:46] [02miraheze/mw-config] 07Universal-Omega 03cc0eb1b - Disable CosmosRail on softcellwiki [18:24:47] [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-3 - 13https://git.io/vbvb3 [18:24:49] [02mw-config] 07Universal-Omega opened pull request 03#3974: Disable CosmosRail on softcellwiki - 13https://git.io/Jnyth [18:25:42] miraheze/mw-config - Universal-Omega the build passed. [18:25:55] [02mw-config] 07Universal-Omega closed pull request 03#3974: Disable CosmosRail on softcellwiki - 13https://git.io/Jnyth [18:25:56] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jnyqq [18:25:58] [02miraheze/mw-config] 07Universal-Omega 0304f604b - Disable CosmosRail on softcellwiki (#3974) [18:25:59] [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-3 [18:26:01] [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-3 - 13https://git.io/vbvb3 [18:26:48] miraheze/mw-config - Universal-Omega the build passed. [18:28:05] Universal_Omega: https://phabricator.miraheze.org/T7510#150727 [18:28:06] [url] ⚓ T7510 Upgrade to MediaWiki 1.36.1 | phabricator.miraheze.org [18:31:29] RhinosF1: seen, thanks! [18:32:22] Universal_Omega: depool might not be needed, it depends how awkward it is [18:32:50] If composer ain't changed much and it's not too big then in place might be possible but I'd rather not be risky [18:33:03] RhinosF1: yeah didn't think so, if not I can do it but otherwise staying unassigned for now. [18:33:14] Ok [18:33:25] We got test3 for a good reason [18:33:29] You can do that [18:33:35] well, couldn't you still assign it to yourself and just make sure you have Reception123 available to depool/repool CPs if needed? [18:34:09] dmehus: yeah true I guess. I did originally but unclaimed for now. [18:35:00] Universal_Omega, yeah I think that would be fine. The person doing the upgrade should still be the assigned person, as the depooling/repooling person is a supporting participant, I think [18:35:15] It's too bad you couldn't have multiple assignees to a task! [18:35:16] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.87, 6.86, 5.56 [18:35:36] RhinosF1: yeah will definitely test on test3 first. [18:35:43] yeah [18:35:49] dmehus: yeah true, may reclaim again later. [18:36:02] Whether I'm around depends on how many walls get punched tommorow [18:36:05] Universal_Omega: of course [18:36:51] I'm surprised at how fast this was released actually. Seems way sooner then normal. [18:37:12] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.72, 5.96, 5.39 [18:38:43] Universal_Omega: that's not necessarily a good thing [18:39:08] I know. [18:39:27] Universal_Omega, ok, sounds good :) [18:39:38] yeah we likely don't need to test too much on test3wiki [18:39:46] as it seems like a minor upgrade to MW 1.36 [18:39:50] maybe a couple days? [18:39:53] dmehus: yeah we just need to make sure it doesn't fatal [18:39:56] Minutes [18:39:59] It's only core [18:40:04] yeah [18:40:05] oh, true [18:40:10] If it doesn't fatal then it'll be fine [18:40:13] yeah [19:05:19] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.29, 6.23, 5.03 [19:05:56] What’s a crate on test3? [19:06:03] I’m confused [19:06:28] Same as crat [19:07:19] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.79, 5.78, 5.00 [19:07:28] Why is it called crate? [19:07:50] Bukkit: ^. It's a minor easter egg Reception123 and I did as an ode to Cocopuff2018 [19:08:08] Admeenistrator is an ode to the Scots version of "administrator" on Scots Wikipedia [19:08:37] Lol yes :D [19:09:49] Haha, cool [19:14:59] @dmehus huh [19:21:45] Cocopuff2018, we thought it's cool how your shorthand for `bureaucrat` is `crate`, basically [19:21:57] so we wanted to create a little homage to that :) [19:24:11] @dmehus ye, it was also an easy thing to edit and change instead of remaking the whole group.... fyi moviepedia has a ton of spam accounts again [19:24:39] Cocopuff2018, okay, thanks, will look in a bit :) [19:25:03] i dont block many of them the filter gets most of them [19:25:25] ah, that's good [19:25:45] is the bot still ignoring my messages just checking. [19:26:58] it is, but that's what I'm going to check #mod-chat later to see about removing that relay ban [19:27:18] im not sure how long we got for the discord ban [19:34:22] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.34, 6.86, 5.71 [19:35:19] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 10.70, 8.68, 6.66 [19:36:16] PROBLEM - zw.fontainebleau-avon.fr - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for zw.fontainebleau-avon.fr could not be found [19:36:16] PROBLEM - history.estill.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for history.estill.org could not be found [19:36:17] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 5.52, 6.54, 5.74 [19:36:20] PROBLEM - wiki.hrznstudio.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.hrznstudio.com could not be found [19:36:21] PROBLEM - wiki.zymonic.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.zymonic.com could not be found [19:36:22] PROBLEM - rangpurpedia.xyz - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for rangpurpedia.xyz could not be found [19:36:23] PROBLEM - wiki.danvs.net - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.danvs.net could not be found [19:36:29] PROBLEM - wiki.lefrenchmelee.fr - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.lefrenchmelee.fr could not be found [19:36:30] PROBLEM - wiki.globasa.net - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.globasa.net could not be found [19:36:30] PROBLEM - sopel.bots.miraheze.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for sopel.bots.miraheze.wiki could not be found [19:36:33] PROBLEM - mr.gyaanipedia.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for mr.gyaanipedia.com could not be found [19:36:33] PROBLEM - wiki.caker18.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.caker18.com could not be found [19:36:34] PROBLEM - madzebrascience.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for madzebrascience.wiki could not be found [19:36:34] PROBLEM - wiki.joust.ro - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.joust.ro could not be found [19:36:35] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 5.92, 7.70, 6.33 [19:36:36] PROBLEM - www.stardewmodding.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.stardewmodding.wiki could not be found [19:36:36] PROBLEM - archive.stellurgists.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for archive.stellurgists.wiki could not be found [19:36:37] PROBLEM - sarovia.graalmilitary.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for sarovia.graalmilitary.com could not be found [19:36:37] PROBLEM - infectowiki.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for infectowiki.com could not be found [19:37:19] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 5.34, 7.52, 6.49 [19:38:33] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.66, 6.64, 6.10 [19:41:19] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.78, 6.53, 6.31 [19:42:03] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.86, 6.97, 6.17 [19:43:03] RECOVERY - zw.fontainebleau-avon.fr - reverse DNS on sslhost is OK: rDNS OK - zw.fontainebleau-avon.fr reverse DNS resolves to cp13.miraheze.org [19:43:04] RECOVERY - history.estill.org - reverse DNS on sslhost is OK: rDNS OK - history.estill.org reverse DNS resolves to cp13.miraheze.org [19:43:12] RECOVERY - wiki.globasa.net - reverse DNS on sslhost is OK: rDNS OK - wiki.globasa.net reverse DNS resolves to cp13.miraheze.org [19:43:12] RECOVERY - sopel.bots.miraheze.wiki - reverse DNS on sslhost is OK: rDNS OK - sopel.bots.miraheze.wiki reverse DNS resolves to cp13.miraheze.org [19:43:12] RECOVERY - wiki.hrznstudio.com - reverse DNS on sslhost is OK: rDNS OK - wiki.hrznstudio.com reverse DNS resolves to cp13.miraheze.org [19:43:15] RECOVERY - wiki.zymonic.com - reverse DNS on sslhost is OK: rDNS OK - wiki.zymonic.com reverse DNS resolves to cp13.miraheze.org [19:43:16] RECOVERY - mr.gyaanipedia.com - reverse DNS on sslhost is OK: rDNS OK - mr.gyaanipedia.com reverse DNS resolves to cp13.miraheze.org [19:43:17] RECOVERY - rangpurpedia.xyz - reverse DNS on sslhost is OK: rDNS OK - rangpurpedia.xyz reverse DNS resolves to cp13.miraheze.org [19:43:17] RECOVERY - wiki.caker18.com - reverse DNS on sslhost is OK: rDNS OK - wiki.caker18.com reverse DNS resolves to cp13.miraheze.org [19:43:18] RECOVERY - madzebrascience.wiki - reverse DNS on sslhost is OK: rDNS OK - madzebrascience.wiki reverse DNS resolves to cp13.miraheze.org [19:43:19] RECOVERY - wiki.danvs.net - reverse DNS on sslhost is OK: rDNS OK - wiki.danvs.net reverse DNS resolves to cp13.miraheze.org [19:43:20] RECOVERY - wiki.joust.ro - reverse DNS on sslhost is OK: rDNS OK - wiki.joust.ro reverse DNS resolves to cp13.miraheze.org [19:43:23] RECOVERY - www.stardewmodding.wiki - reverse DNS on sslhost is OK: rDNS OK - www.stardewmodding.wiki reverse DNS resolves to cp13.miraheze.org [19:43:23] RECOVERY - archive.stellurgists.wiki - reverse DNS on sslhost is OK: rDNS OK - archive.stellurgists.wiki reverse DNS resolves to cp13.miraheze.org [19:43:24] RECOVERY - sarovia.graalmilitary.com - reverse DNS on sslhost is OK: rDNS OK - sarovia.graalmilitary.com reverse DNS resolves to cp13.miraheze.org [19:43:25] RECOVERY - infectowiki.com - reverse DNS on sslhost is OK: rDNS OK - infectowiki.com reverse DNS resolves to cp13.miraheze.org [19:43:29] RECOVERY - wiki.lefrenchmelee.fr - reverse DNS on sslhost is OK: rDNS OK - wiki.lefrenchmelee.fr reverse DNS resolves to cp13.miraheze.org [19:47:52] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 6.26, 6.72, 6.32 [19:49:19] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.56, 6.91, 6.51 [19:51:19] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 6.64, 6.69, 6.47 [19:52:34] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.91, 7.27, 6.38 [19:53:43] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 8.69, 8.52, 7.18 [19:54:34] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.42, 6.59, 6.26 [19:55:19] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.55, 7.68, 6.94 [19:55:38] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 5.17, 7.24, 6.87 [19:57:19] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.47, 7.93, 7.12 [19:57:34] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 5.04, 6.63, 6.70 [20:01:34] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 7.48, 8.06, 7.08 [20:03:30] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.51, 7.71, 7.06 [20:05:19] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.63, 7.84, 7.63 [20:07:23] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 6.07, 6.47, 6.69 [20:09:27] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.71, 6.97, 6.48 [20:11:19] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.38, 5.83, 6.75 [20:11:25] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 5.87, 6.52, 6.37 [20:21:08] by the way, wouldn't be better if there was two test wikis? [20:24:57] why? [20:26:57] hmm, thinking about it now, I don't know if it would matter much for Miraheze but I was thinking about one wiki to be the current test wiki we have and the other to specifically test newer versions of MW or some other backend software [20:28:56] isn't that just test3? [20:28:58] It's already being discussed @Lake [20:35:19] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.28, 6.36, 6.06 [20:35:41] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.98, 6.87, 6.41 [20:37:19] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.26, 5.75, 5.87 [20:37:38] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.95, 6.25, 6.25 [20:49:36] Southparkfan: are you around? Q re matomo [21:15:00] Southparkfan: see https://phabricator.miraheze.org/T7512#150763 [21:15:01] [url] ⚓ T7512 Provide public access to sanitised analytics data | phabricator.miraheze.org [21:25:40] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-3 [+0/-0/±1] 13https://git.io/JnywQ [21:25:41] [02miraheze/mw-config] 07Universal-Omega 03805ba29 - Split Tabs and Tabber extensions [21:25:43] [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-3 - 13https://git.io/vbvb3 [21:25:44] [02mw-config] 07Universal-Omega opened pull request 03#3975: Split Tabs and Tabber extensions - 13https://git.io/Jnyw5 [21:26:37] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-3 [+0/-0/±1] 13https://git.io/JnywN [21:26:38] [02miraheze/mw-config] 07Universal-Omega 032c2454a - Update LocalSettings.php [21:26:40] [02mw-config] 07Universal-Omega synchronize pull request 03#3975: Split Tabs and Tabber extensions - 13https://git.io/Jnyw5 [21:26:44] miraheze/mw-config - Universal-Omega the build passed. [21:27:37] miraheze/mw-config - Universal-Omega the build passed. [21:28:42] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-3 [+0/-0/±1] 13https://git.io/Jnyrt [21:28:44] [02miraheze/mw-config] 07Universal-Omega 036eb757c - Update ManageWikiExtensions.php [21:28:45] [02mw-config] 07Universal-Omega synchronize pull request 03#3975: Split Tabs and Tabber extensions - 13https://git.io/Jnyw5 [21:29:26] [02mw-config] 07Universal-Omega edited pull request 03#3975: Split "Tabber" and "Tabs" extensions in ManageWikiExtensions - 13https://git.io/Jnyw5 [21:29:38] miraheze/mw-config - Universal-Omega the build passed. [21:31:56] @Universal Omega Did you mean to install TabberNeue instead of Tabber? [21:32:05] I mean Vice verse [21:32:09] Versa [21:32:40] No. I am first splitting the tabs and tabber extensions in ManageWikiExtensions so it's not "TabsCombination" [21:33:00] Oh, my bad [21:33:19] Sorry [21:35:40] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.38, 7.11, 6.07 [21:37:35] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.48, 6.26, 5.89 [21:42:08] No problem. [21:42:52] I'll likely move forward with installing that (TabberNeue) and merging the above PR tomorrow. [21:43:44] [02mw-config] 07PullRequestMaster commented on pull request 03#3975: Split "Tabber" and "Tabs" extensions in ManageWikiExtensions - 13https://git.io/Jnyoy [21:45:06] [02mw-config] 07RhinosF1 commented on pull request 03#3975: Split "Tabber" and "Tabs" extensions in ManageWikiExtensions - 13https://git.io/Jnyob [21:45:49] [02mw-config] 07PullRequestMaster commented on pull request 03#3975: Split "Tabber" and "Tabs" extensions in ManageWikiExtensions - 13https://git.io/Jnyox [21:49:08] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-4 [+0/-0/±1] 13https://git.io/JnyKZ [21:49:09] [02miraheze/mw-config] 07Universal-Omega 03e0cec6d - VisualEditor does not require templatedata [21:49:11] [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-4 - 13https://git.io/vbvb3 [21:49:12] [02mw-config] 07Universal-Omega opened pull request 03#3976: VisualEditor does not require templatedata - 13https://git.io/JnyKn [21:50:09] miraheze/mw-config - Universal-Omega the build passed. [21:50:59] [02mw-config] 07Universal-Omega closed pull request 03#3976: VisualEditor does not require templatedata - 13https://git.io/JnyKn [21:51:00] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JnyK2 [21:51:02] [02miraheze/mw-config] 07Universal-Omega 03c1c8fcc - VisualEditor does not require templatedata (#3976) [21:51:03] [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-4 - 13https://git.io/vbvb3 [21:51:05] [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-4 [21:51:55] miraheze/mw-config - Universal-Omega the build passed. [21:56:52] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://git.io/Jny6t [21:56:54] [02miraheze/mw-config] 07Universal-Omega 0316fcfff - Update LocalWiki.php [21:56:55] [02mw-config] 07Universal-Omega synchronize pull request 03#3973: Let otf files recognise application/vnd.ms-opentype mime type - 13https://git.io/JnXBS [21:57:34] [02mw-config] 07Universal-Omega edited pull request 03#3975: Split "Tabber" and "Tabs" extensions - 13https://git.io/Jnyw5 [21:57:50] miraheze/mw-config - Universal-Omega the build passed. [22:04:24] [02mw-config] 07RhinosF1 commented on pull request 03#3975: Split "Tabber" and "Tabs" extensions - 13https://git.io/Jnyit [22:34:47] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 24.67, 16.47, 13.35 [22:36:46] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 15.65, 15.31, 13.28 [23:02:34] [02miraheze/WikiDiscover] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JnySn [23:02:35] [02miraheze/WikiDiscover] 07Universal-Omega 031273944 - Update WikiDiscoverWikisPager.php [23:02:37] [02WikiDiscover] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://git.io/vhUAp [23:03:32] [02WikiDiscover] 07Universal-Omega opened pull request 03#52: Remove "deletable" column - 13https://git.io/JnyS4 [23:04:14] [02miraheze/WikiDiscover] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JnySu [23:04:15] [02miraheze/WikiDiscover] 07Universal-Omega 038051160 - Update en.json [23:04:17] [02WikiDiscover] 07Universal-Omega synchronize pull request 03#52: Remove "deletable" column - 13https://git.io/JnyS4 [23:04:27] miraheze/WikiDiscover - Universal-Omega the build passed. [23:05:18] miraheze/WikiDiscover - Universal-Omega the build passed. [23:05:36] [02WikiDiscover] 07dmehus commented on pull request 03#52: Remove "deletable" column - 13https://git.io/JnySD [23:12:48] [02WikiDiscover] 07Universal-Omega closed pull request 03#52: Remove "deletable" column - 13https://git.io/JnyS4 [23:12:50] [02miraheze/WikiDiscover] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/Jny9F [23:12:51] [02miraheze/WikiDiscover] 07Universal-Omega 030a1a3df - Remove "deletable" column (#52) [23:12:53] [02WikiDiscover] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://git.io/vhUAp [23:12:54] [02miraheze/WikiDiscover] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [23:13:43] miraheze/WikiDiscover - Universal-Omega the build passed. [23:13:56] PROBLEM - cp12 Current Load on cp12 is WARNING: WARNING - load average: 1.82, 1.64, 1.23 [23:15:55] RECOVERY - cp12 Current Load on cp12 is OK: OK - load average: 0.93, 1.47, 1.22 [23:27:39] PROBLEM - bacula2 Disk Space on bacula2 is CRITICAL: DISK CRITICAL - free space: / 77500 MB (5% inode=99%); [23:35:19] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.28, 7.48, 6.07 [23:35:47] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.25, 8.50, 6.63 [23:37:19] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.56, 7.76, 6.36 [23:39:19] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.97, 6.72, 6.15 [23:39:40] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 4.53, 7.12, 6.57 [23:41:36] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.53, 6.32, 6.34 [23:43:20] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.13, 6.81, 6.34 [23:45:19] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.40, 5.76, 6.00