[00:03:13] PROBLEM - graylog2 Puppet on graylog2 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [00:04:22] PROBLEM - cp12 Current Load on cp12 is CRITICAL: CRITICAL - load average: 2.54, 2.01, 1.43 [00:05:04] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 11.31, 8.04, 6.25 [00:05:12] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 13.40, 8.85, 6.50 [00:06:18] PROBLEM - cp12 Current Load on cp12 is WARNING: WARNING - load average: 1.26, 1.71, 1.39 [00:08:13] RECOVERY - cp12 Current Load on cp12 is OK: OK - load average: 0.59, 1.31, 1.28 [00:11:09] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.49, 7.52, 6.74 [00:12:36] PROBLEM - graylog2 Current Load on graylog2 is WARNING: WARNING - load average: 3.79, 3.13, 2.16 [00:14:33] RECOVERY - graylog2 Current Load on graylog2 is OK: OK - load average: 2.02, 2.81, 2.16 [00:16:33] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 4.79, 6.95, 6.93 [00:17:03] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 3.71, 6.04, 6.44 [00:20:26] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.04, 7.31, 7.05 [00:22:25] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.35, 6.72, 6.86 [00:22:55] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.42, 7.65, 7.01 [00:24:26] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 6.47, 6.50, 6.75 [00:24:53] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.21, 7.38, 6.98 [00:26:51] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.59, 6.76, 6.80 [00:30:45] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.63, 6.98, 6.90 [00:31:13] RECOVERY - graylog2 Puppet on graylog2 is OK: OK: Puppet is currently enabled, last run 14 seconds ago with 0 failures [00:34:44] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 10.74, 8.04, 7.25 [00:35:10] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.92, 7.22, 6.77 [00:36:41] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.13, 7.48, 7.14 [00:37:05] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.53, 7.50, 6.92 [00:37:45] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 32.46, 28.33, 22.33 [00:39:00] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.04, 6.88, 6.76 [00:40:37] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.09, 5.85, 6.56 [00:44:44] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.22, 5.85, 6.40 [00:45:31] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 19.34, 22.73, 22.19 [00:51:26] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 13.75, 17.49, 20.04 [02:51:44] [02mw-config] 07The-Voidwalker commented on pull request 03#3890: T7192: Move cache out of w/ directory - 13https://git.io/JnuVw [03:00:33] [02mw-config] 07The-Voidwalker reviewed pull request 03#3965 commit - 13https://git.io/JnurP [03:02:38] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/Jnuok [03:02:39] [02miraheze/mw-config] 07Universal-Omega 0351b68b9 - Update LocalSettings.php [03:02:41] [02mw-config] 07Universal-Omega synchronize pull request 03#3965: Enable some CheckUser configs - 13https://git.io/JnsXs [03:03:00] [02mw-config] 07Universal-Omega reviewed pull request 03#3965 commit - 13https://git.io/Jnuot [03:03:27] Thanks, Voidwalker! [03:03:39] miraheze/mw-config - Universal-Omega the build passed. [03:04:08] No problem [03:12:19] Voidwalker: is it good to merge that CheckUser PR now then since you approved the changes? [03:14:00] Yup, was just making sure we had everything good, and that there were no objections [03:14:51] Voidwalker: Great! Will merge in a few minutes then. Thanks again! [03:17:26] [02mw-config] 07Universal-Omega closed pull request 03#3965: Enable some CheckUser configs - 13https://git.io/JnsXs [03:17:28] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JnuiL [03:17:29] [02miraheze/mw-config] 07Universal-Omega 034d1193a - Enable some CheckUser configs (#3965) [03:17:31] [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://git.io/vbvb3 [03:17:32] [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [03:18:20] miraheze/mw-config - Universal-Omega the build passed. [03:45:54] [02puppet] 07The-Voidwalker synchronize pull request 03#1745: CSP: add iwiki.eu.org mirrors - 13https://git.io/JOSGq [03:48:00] [02puppet] 07The-Voidwalker commented on pull request 03#1745: CSP: add iwiki.eu.org mirrors - 13https://git.io/JnuDC [03:53:22] [02CreateWiki] 07Universal-Omega commented on pull request 03#202: Set setSchemaVars within WikiManager->create - 13https://git.io/Jnuyu [03:56:49] [02miraheze/RemovePII] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JnuSn [03:56:51] [02miraheze/RemovePII] 07Universal-Omega 038a1e4bf - Update SpecialRemovePII.php [03:56:52] [02RemovePII] 07Universal-Omega synchronize pull request 03#3: Create SpecialRemovePII (T7286: phase two and phase three) - 13https://git.io/Js0PN [03:57:45] miraheze/RemovePII - Universal-Omega the build passed. [04:34:54] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.83, 6.87, 5.97 [04:35:03] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.56, 7.10, 5.76 [04:36:50] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 6.36, 6.75, 6.04 [04:37:02] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.90, 6.19, 5.57 [04:50:27] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.67, 6.78, 6.25 [04:51:26] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.47, 6.48, 5.79 [04:52:23] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 4.70, 6.13, 6.09 [04:53:20] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.65, 6.30, 5.81 [06:03:23] RECOVERY - phab2 APT on phab2 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [06:03:30] RECOVERY - jobrunner3 APT on jobrunner3 is OK: APT OK: 30 packages available for upgrade (0 critical updates). [06:07:52] RECOVERY - mw8 APT on mw8 is OK: APT OK: 28 packages available for upgrade (0 critical updates). [06:11:13] PROBLEM - mw9 Disk Space on mw9 is WARNING: DISK WARNING - free space: / 2026 MB (10% inode=76%); [06:12:21] RECOVERY - test3 APT on test3 is OK: APT OK: 29 packages available for upgrade (0 critical updates). [06:13:58] RECOVERY - ns2 APT on ns2 is OK: APT OK: 38 packages available for upgrade (0 critical updates). [06:15:11] RECOVERY - cp12 APT on cp12 is OK: APT OK: 27 packages available for upgrade (0 critical updates). [06:15:27] RECOVERY - gluster3 APT on gluster3 is OK: APT OK: 26 packages available for upgrade (0 critical updates). [06:17:33] [02puppet] 07Universal-Omega opened pull request 03#1791: Create writable directory: /srv/mediawiki/cache and deny access to it - 13https://git.io/Jnz3c [06:19:02] [02puppet] 07Universal-Omega synchronize pull request 03#1791: Create writable directory: /srv/mediawiki/cache and deny access to it - 13https://git.io/Jnz3c [06:19:54] [02puppet] 07Universal-Omega synchronize pull request 03#1772: T7192: Move cache out of w/ directory - 13https://git.io/JZt3Y [06:20:15] [02puppet] 07Universal-Omega synchronize pull request 03#1772: T7192: Move cache out of w/ directory - 13https://git.io/JZt3Y [06:24:10] RECOVERY - graylog2 APT on graylog2 is OK: APT OK: 28 packages available for upgrade (0 critical updates). [06:24:22] RECOVERY - db13 APT on db13 is OK: APT OK: 49 packages available for upgrade (0 critical updates). [06:24:51] RECOVERY - mw11 APT on mw11 is OK: APT OK: 28 packages available for upgrade (0 critical updates). [06:26:13] RECOVERY - db11 APT on db11 is OK: APT OK: 71 packages available for upgrade (0 critical updates). [06:29:35] RECOVERY - services4 APT on services4 is OK: APT OK: 27 packages available for upgrade (0 critical updates). [06:31:28] RECOVERY - gluster4 APT on gluster4 is OK: APT OK: 26 packages available for upgrade (0 critical updates). [06:31:41] RECOVERY - cp13 APT on cp13 is OK: APT OK: 4 packages available for upgrade (0 critical updates). [06:32:10] RECOVERY - mw9 APT on mw9 is OK: APT OK: 28 packages available for upgrade (0 critical updates). [06:32:57] RECOVERY - test4 APT on test4 is OK: APT OK: 26 packages available for upgrade (0 critical updates). [06:35:10] RECOVERY - cloud4 APT on cloud4 is OK: APT OK: 66 packages available for upgrade (0 critical updates). [06:36:46] RECOVERY - db12 APT on db12 is OK: APT OK: 71 packages available for upgrade (0 critical updates). [06:37:34] RECOVERY - cloud5 APT on cloud5 is OK: APT OK: 66 packages available for upgrade (0 critical updates). [06:40:39] RECOVERY - mail2 APT on mail2 is OK: APT OK: 27 packages available for upgrade (0 critical updates). [06:41:26] RECOVERY - ns1 APT on ns1 is OK: APT OK: 40 packages available for upgrade (0 critical updates). [06:44:22] RECOVERY - cp3 APT on cp3 is OK: APT OK: 27 packages available for upgrade (0 critical updates). [06:45:15] RECOVERY - mem2 APT on mem2 is OK: APT OK: 26 packages available for upgrade (0 critical updates). [06:45:50] RECOVERY - ldap2 APT on ldap2 is OK: APT OK: 26 packages available for upgrade (0 critical updates). [06:46:18] RECOVERY - services3 APT on services3 is OK: APT OK: 27 packages available for upgrade (0 critical updates). [06:48:53] RECOVERY - mw10 APT on mw10 is OK: APT OK: 28 packages available for upgrade (0 critical updates). [06:50:33] RECOVERY - bacula2 APT on bacula2 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [06:52:43] RECOVERY - jobrunner4 APT on jobrunner4 is OK: APT OK: 28 packages available for upgrade (0 critical updates). [06:52:59] RECOVERY - mon2 APT on mon2 is OK: APT OK: 32 packages available for upgrade (0 critical updates). [06:53:32] RECOVERY - puppet3 APT on puppet3 is OK: APT OK: 25 packages available for upgrade (0 critical updates). [06:55:31] RECOVERY - cloud3 APT on cloud3 is OK: APT OK: 105 packages available for upgrade (0 critical updates). [06:57:10] RECOVERY - mem1 APT on mem1 is OK: APT OK: 26 packages available for upgrade (0 critical updates). [06:58:58] [02puppet] 07Reception123 closed pull request 03#1791: Create writable directory: /srv/mediawiki/cache and deny access to it - 13https://git.io/Jnz3c [06:59:00] [02miraheze/puppet] 07Reception123 pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/Jnzl5 [06:59:01] [02miraheze/puppet] 07Universal-Omega 03b579bb8 - Create writable directory: /srv/mediawiki/cache and deny access to it (#1791) [07:02:23] [02puppet] 07Universal-Omega synchronize pull request 03#1772: T7192: Move cache out of w/ directory - 13https://git.io/JZt3Y [07:24:58] Seems like l10n cache was never rebuilt after installing WikibaseLocalMedia. [07:24:58] https://cdn.discordapp.com/attachments/808001911868489748/855709728850837524/unknown.png [07:25:41] Oh... that's my bad. I completely forgot. [07:26:53] Reception123: ^ do you have time/access to do that? (Sorry I forgot) I'm already about to go for the night. [07:27:51] No need to rush. 🙂 [07:44:10] will do yeah [07:44:49] !log sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildLocalisationCache.php --wiki loginwiki on mw*/jbr* [07:44:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:50:25] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 9.68, 7.51, 5.70 [07:52:16] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.99, 6.56, 5.31 [07:52:25] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.85, 7.15, 5.78 [07:53:43] Thanks Reception123! Sorry that I forgot. [07:54:16] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.12, 6.12, 5.30 [07:54:25] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.45, 6.18, 5.60 [08:01:09] [02mw-config] 07R4356th synchronize pull request 03#3970: Install Blue Sky (T7336) - 13https://git.io/JnEWc [08:01:20] [02mw-config] 07R4356th reviewed pull request 03#3970 commit - 13https://git.io/JnzKM [08:02:05] miraheze/mw-config - R4356th the build passed. [08:02:42] [02mw-config] 07Universal-Omega reviewed pull request 03#3970 commit - 13https://git.io/Jnz6G [08:11:50] No problem [09:34:58] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 9.39, 6.87, 5.36 [09:36:54] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.88, 6.58, 5.44 [10:49:36] [02miraheze/MirahezeMagic] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JngCE [10:49:38] [02miraheze/MirahezeMagic] 07Reception123 03f779e31 - update survey to 2021 [10:50:38] miraheze/MirahezeMagic - Reception123 the build passed. [10:50:56] [02miraheze/mediawiki] 07Reception123 pushed 031 commit to 03REL1_36 [+0/-0/±1] 13https://git.io/JngCM [10:50:58] [02miraheze/mediawiki] 07Reception123 0328b55d3 - Update MirahezeMagic [13:41:55] PROBLEM - db11 Current Load on db11 is WARNING: WARNING - load average: 5.80, 7.48, 4.06 [13:43:55] RECOVERY - db11 Current Load on db11 is OK: OK - load average: 2.10, 5.83, 3.89 [13:46:26] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.97, 6.09, 5.37 [13:48:25] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.36, 6.06, 5.45 [13:55:55] PROBLEM - db11 Current Load on db11 is CRITICAL: CRITICAL - load average: 17.36, 10.02, 5.79 [13:56:26] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 1 datacenter is down: 2607:5300:205:200::1c30/cpweb [13:57:18] PROBLEM - pt.graalmilitary.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for pt.graalmilitary.com could not be found [13:57:20] PROBLEM - wiki.mnzp.xyz - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.mnzp.xyz could not be found [13:57:20] PROBLEM - rothwell-leeds.co.uk - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for rothwell-leeds.co.uk could not be found [13:57:21] PROBLEM - towarzystwo.prawa.kredytowego.pl - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for towarzystwo.prawa.kredytowego.pl could not be found [13:57:21] PROBLEM - mc-wiki.failboat.fun - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for mc-wiki.failboat.fun could not be found [13:57:23] PROBLEM - storytime.jdstroy.cf - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for storytime.jdstroy.cf could not be found [13:57:26] PROBLEM - wikipariksha.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wikipariksha.com could not be found [13:57:45] PROBLEM - iceria.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for iceria.org could not be found [13:58:23] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [13:58:35] !log sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildLocalisationCache.php --wiki loginwiki on mw*/jbr* [13:58:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:59:55] RECOVERY - db11 Current Load on db11 is OK: OK - load average: 1.86, 5.94, 5.14 [14:00:09] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.30, 6.92, 5.78 [14:02:25] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.18, 6.64, 5.87 [14:02:39] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.45, 6.76, 5.72 [14:04:01] RECOVERY - wiki.mnzp.xyz - reverse DNS on sslhost is OK: rDNS OK - wiki.mnzp.xyz reverse DNS resolves to cp13.miraheze.org [14:04:02] RECOVERY - rothwell-leeds.co.uk - reverse DNS on sslhost is OK: rDNS OK - rothwell-leeds.co.uk reverse DNS resolves to cp13.miraheze.org [14:04:03] RECOVERY - mc-wiki.failboat.fun - reverse DNS on sslhost is OK: rDNS OK - mc-wiki.failboat.fun reverse DNS resolves to cp13.miraheze.org [14:04:04] RECOVERY - towarzystwo.prawa.kredytowego.pl - reverse DNS on sslhost is OK: rDNS OK - towarzystwo.prawa.kredytowego.pl reverse DNS resolves to cp13.miraheze.org [14:04:05] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 17.19, 10.01, 7.13 [14:04:07] RECOVERY - storytime.jdstroy.cf - reverse DNS on sslhost is OK: rDNS OK - storytime.jdstroy.cf reverse DNS resolves to cp13.miraheze.org [14:04:15] RECOVERY - wikipariksha.com - reverse DNS on sslhost is OK: rDNS OK - wikipariksha.com reverse DNS resolves to cp13.miraheze.org [14:04:18] RECOVERY - pt.graalmilitary.com - reverse DNS on sslhost is OK: rDNS OK - pt.graalmilitary.com reverse DNS resolves to cp13.miraheze.org [14:04:27] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 13.30, 8.80, 6.73 [14:04:36] RECOVERY - iceria.org - reverse DNS on sslhost is OK: rDNS OK - iceria.org reverse DNS resolves to cp13.miraheze.org [14:04:36] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.87, 7.09, 5.97 [14:05:59] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 8.62, 8.04, 6.31 [14:07:57] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.64, 7.53, 6.33 [14:08:30] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.88, 6.56, 6.02 [14:09:55] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 4.56, 6.63, 6.15 [14:10:27] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 3.90, 6.72, 6.67 [14:11:57] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 5.76, 7.63, 7.30 [14:15:53] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.16, 5.96, 6.70 [14:58:28] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.42, 7.09, 5.91 [15:00:25] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.28, 7.06, 6.04 [15:02:00] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.83, 7.24, 6.16 [15:02:25] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 10.07, 8.00, 6.50 [15:03:56] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 9.15, 7.83, 6.50 [15:05:10] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.16, 7.12, 6.18 [15:06:06] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.77, 6.61, 5.87 [15:07:08] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.53, 6.54, 6.08 [15:07:56] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.83, 7.62, 6.71 [15:08:05] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 8.93, 7.43, 6.26 [15:10:04] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.05, 7.08, 6.29 [15:10:25] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.34, 7.94, 7.27 [15:12:04] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 5.69, 6.79, 6.29 [15:17:56] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 4.86, 6.40, 6.66 [15:20:25] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 9.76, 8.13, 7.45 [15:20:53] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 9.12, 8.12, 6.85 [15:22:53] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.16, 7.91, 6.94 [15:24:28] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.27, 7.83, 7.54 [15:26:49] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.68, 6.34, 6.52 [15:27:48] [02mw-config] 07dmehus commented on pull request 03#3965: Enable some CheckUser configs - 13https://git.io/Jn2Z2 [15:28:05] Reception123: https://phabricator.miraheze.org/T7489 [15:28:06] [url] ⚓ T7489 Upgrade to Debian 10.10 | phabricator.miraheze.org [15:28:56] * dmehus is happy RhinosF1 both triaged and project tagged T7489 👍 [15:30:25] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.32, 6.01, 6.77 [16:01:56] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.85, 6.37, 5.95 [16:03:05] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 14.92, 8.48, 6.73 [16:03:13] RhinosF1: ack, can do tomorrow / next week probably [16:03:38] Reception123: haven't seen the RN but I wouldn't worry about db*/cloud* [16:03:48] Anything that can easy depool will be easy [16:03:51] yeah, those are definitely not worth it [16:03:57] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 6.04, 6.27, 5.97 [16:03:59] We're gonna have 11 soon anyway [16:04:03] yeah [16:04:07] just the ones that are simple to do [16:06:09] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 9.36, 7.11, 6.12 [16:06:56] [02miraheze/MirahezeMagic] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jn2Ra [16:06:57] [02miraheze/MirahezeMagic] 07Reception123 03ed173b2 - minor changes [16:07:20] [02miraheze/mediawiki] 07Reception123 pushed 031 commit to 03REL1_36 [+0/-0/±1] 13https://git.io/Jn2R6 [16:07:22] [02miraheze/mediawiki] 07Reception123 033972636 - Update MirahezeMagic [16:07:48] miraheze/MirahezeMagic - Reception123 the build passed. [16:08:07] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 5.92, 6.71, 6.10 [16:10:43] [02miraheze/MirahezeMagic] 07RhinosF1 pushed 031 commit to 03RhinosF1-patch-2 [+0/-0/±1] 13https://git.io/Jn20g [16:10:45] [02miraheze/MirahezeMagic] 07RhinosF1 0351474e0 - Survey: fix input validation [16:10:46] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.02, 7.84, 7.32 [16:10:46] [02MirahezeMagic] 07RhinosF1 created branch 03RhinosF1-patch-2 - 13https://git.io/fQRGX [16:10:48] [02MirahezeMagic] 07RhinosF1 opened pull request 03#265: Survey: fix input validation - 13https://git.io/Jn202 [16:11:03] Reception123: mobile but ^ [16:11:43] miraheze/MirahezeMagic - RhinosF1 the build passed. [16:14:50] [02miraheze/MirahezeMagic] 07Reception123 pushed 031 commit to 03RhinosF1-patch-2 [+0/-0/±1] 13https://git.io/Jn2EY [16:14:50] RhinosF1: thanks [16:14:52] [02miraheze/MirahezeMagic] 07Reception123 0396c3832 - tabbing [16:14:53] [02MirahezeMagic] 07Reception123 synchronize pull request 03#265: Survey: fix input validation - 13https://git.io/Jn202 [16:15:18] Np [16:15:48] miraheze/MirahezeMagic - Reception123 the build passed. [16:16:11] [02MirahezeMagic] 07Reception123 closed pull request 03#265: Survey: fix input validation - 13https://git.io/Jn202 [16:16:13] [02miraheze/MirahezeMagic] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jn2EE [16:16:14] [02miraheze/MirahezeMagic] 07RhinosF1 03808c505 - Survey: fix input validation (#265) [16:16:37] [02miraheze/mediawiki] 07Reception123 pushed 031 commit to 03REL1_36 [+0/-0/±1] 13https://git.io/Jn2E6 [16:16:38] [02miraheze/mediawiki] 07Reception123 03a8a79f5 - Update MirahezeMagic [16:17:02] miraheze/MirahezeMagic - Reception123 the build passed. [16:18:28] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.39, 5.85, 6.57 [16:30:22] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.07, 6.46, 5.89 [16:30:26] PROBLEM - graylog2 Current Load on graylog2 is WARNING: WARNING - load average: 3.80, 2.62, 2.15 [16:31:02] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.95, 6.52, 6.32 [16:32:18] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 6.26, 6.34, 5.91 [16:32:23] PROBLEM - graylog2 Current Load on graylog2 is CRITICAL: CRITICAL - load average: 5.58, 3.83, 2.67 [16:32:57] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 9.08, 7.13, 6.55 [16:34:21] PROBLEM - graylog2 Current Load on graylog2 is WARNING: WARNING - load average: 3.97, 3.64, 2.73 [16:34:53] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 11.10, 8.25, 6.75 [16:35:04] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.55, 7.31, 6.54 [16:36:14] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 11.50, 8.31, 6.77 [16:36:19] RECOVERY - graylog2 Current Load on graylog2 is OK: OK - load average: 2.46, 3.11, 2.64 [16:36:51] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.15, 7.40, 6.62 [16:37:04] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 8.60, 7.96, 6.87 [16:39:07] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.23, 7.29, 6.76 [16:40:06] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 4.87, 7.15, 6.70 [16:40:47] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 9.94, 8.42, 7.18 [16:42:45] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.88, 7.76, 7.08 [16:43:06] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 8.43, 7.53, 6.94 [16:45:05] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.47, 7.05, 6.83 [16:45:56] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 6.08, 6.79, 6.71 [16:46:26] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.74, 7.69, 7.42 [16:47:05] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 5.64, 6.55, 6.68 [16:50:37] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.71, 6.24, 6.74 [16:53:55] PROBLEM - graylog2 Current Load on graylog2 is CRITICAL: CRITICAL - load average: 4.13, 3.24, 2.68 [16:55:53] RECOVERY - graylog2 Current Load on graylog2 is OK: OK - load average: 1.25, 2.46, 2.47 [16:58:25] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.95, 6.10, 6.77 [17:06:16] Is there a possibility that I can apply to be a security reviewer? [17:06:54] @Bukkit | Justin What do you mean by security reviewer? [17:08:08] Like R4356th [17:09:03] Didn’t mean to reply on Matrix oops [17:09:19] But like reviewing extensions and skins [17:19:02] Oh yeah [17:19:29] But I think sre reviews extension before the install them..? [17:19:53] Anyone with good enough experience / knowledge can [17:21:03] Where do I apply? Phabricator? [17:34:26] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 9.09, 6.36, 5.58 [17:35:06] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.73, 6.56, 5.58 [17:36:10] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.28, 6.61, 5.71 [17:36:25] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.57, 5.94, 5.52 [17:36:33] Replied on task Bukkit[M] [17:37:33] Evening Voidwalker [17:37:41] hi [17:38:05] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.61, 6.10, 5.63 [17:45:05] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 6.18, 6.55, 6.04 [17:47:57] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.71, 6.77, 6.13 [17:51:03] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.28, 7.32, 6.37 [17:51:12] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.93, 6.91, 6.22 [17:52:58] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.93, 7.75, 6.66 [17:54:53] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.28, 8.12, 6.93 [17:55:09] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 9.59, 8.23, 6.90 [17:56:48] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.45, 7.92, 7.00 [17:57:05] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.79, 7.42, 6.70 [17:57:07] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 5.97, 7.53, 6.82 [17:57:56] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 9.08, 7.53, 6.76 [17:58:43] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.10, 7.94, 7.11 [17:59:56] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.73, 7.06, 6.67 [18:00:28] Hi @RhinosF1 hope you're fine over there You didn't reply DM [18:00:37] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.65, 7.59, 7.08 [18:01:05] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 4.97, 6.51, 6.51 [18:01:56] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.87, 6.49, 6.50 [18:03:03] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.28, 7.26, 6.88 [18:03:16] @Ugochimobi: fully automated or no [18:03:36] At least until August that's my call [18:04:10] You mean you can make it fully automated? [18:04:28] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 11.07, 8.85, 7.61 [18:05:01] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.41, 7.43, 7.00 [18:05:57] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.56, 7.18, 6.79 [18:07:01] No, youd need to #upstream it [18:07:56] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 6.47, 6.80, 6.69 [18:08:25] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 5.75, 7.53, 7.39 [18:08:29] PROBLEM - cp12 Current Load on cp12 is WARNING: WARNING - load average: 1.95, 1.90, 1.40 [18:09:57] But even if it's not fully automated, I could handle it actually. [18:10:55] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.50, 6.27, 6.66 [18:11:57] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.28, 7.03, 6.79 [18:12:20] RECOVERY - cp12 Current Load on cp12 is OK: OK - load average: 0.96, 1.49, 1.35 [18:13:57] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.02, 6.28, 6.54 [18:15:20] We don't give out ssh access to run stuff on our systems [18:15:49] If it's fully automated, I can organise running it [18:16:25] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.02, 5.93, 6.65 [18:20:27] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.95, 7.39, 7.07 [18:20:43] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.33, 8.27, 7.21 [18:22:25] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 3.95, 6.05, 6.61 [18:22:41] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 4.60, 6.95, 6.85 [18:26:19] Hmm I have another. I think that one is fully automated [18:26:38] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.04, 5.64, 6.36 [18:36:27] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.36, 6.91, 6.44 [18:38:27] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.31, 6.35, 6.30 [19:10:30] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.92, 6.94, 5.95 [19:12:26] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 4.84, 6.08, 5.75 [19:15:04] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.80, 7.77, 6.53 [19:20:49] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.08, 7.46, 6.68 [19:22:45] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.67, 6.41, 6.39 [19:27:21] PROBLEM - cp12 Current Load on cp12 is WARNING: WARNING - load average: 1.30, 1.87, 1.31 [19:29:22] RECOVERY - cp12 Current Load on cp12 is OK: OK - load average: 1.44, 1.62, 1.28 [20:04:14] [02mediawiki] 07Universal-Omega closed pull request 03#2262: Add BlueSky (T7336) - 13https://git.io/JnECQ [20:04:15] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_36 [+1/-0/±1] 13https://git.io/JnaL6 [20:04:17] [02miraheze/mediawiki] 07R4356th 0382d436c - Add BlueSky (T7336) (#2262) [20:05:51] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_36 [+0/-0/±1] 13https://git.io/JnatU [20:05:53] [02miraheze/mediawiki] 07Universal-Omega 03efb6171 - Fix formatting [20:06:39] [02mw-config] 07R4356th synchronize pull request 03#3970: Install Blue Sky (T7336) - 13https://git.io/JnEWc [20:06:49] [02mw-config] 07R4356th reviewed pull request 03#3970 commit - 13https://git.io/Jnatm [20:07:14] [02mw-config] 07Universal-Omega reviewed pull request 03#3970 commit - 13https://git.io/Jnats [20:07:45] [02mw-config] 07Universal-Omega assigned pull request 03#3970: Install Blue Sky (T7336) - 13https://git.io/JnEWc [20:07:46] miraheze/mw-config - R4356th the build passed. [20:07:57] [02mw-config] 07R4356th reviewed pull request 03#3970 commit - 13https://git.io/Jnatm [20:15:48] [02puppet] 07Universal-Omega edited pull request 03#1789: Update default.vcl - 13https://git.io/JnCUK [20:20:25] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.62, 6.50, 5.53 [20:22:25] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.05, 5.60, 5.32 [20:34:26] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 9.47, 6.67, 5.74 [20:36:17] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.43, 6.70, 5.65 [20:36:23] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 8.38, 7.14, 5.85 [20:38:16] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 6.35, 6.64, 5.77 [20:38:22] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.20, 7.29, 6.08 [20:40:20] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 6.03, 6.79, 6.03 [20:40:25] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.17, 7.61, 6.50 [20:42:25] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.53, 6.69, 6.29 [20:46:28] RhinosF1, Voidwalker, or Universal_Omega, can either of you run the script to make MalorJak54 a global account for me? [20:49:12] [02miraheze/RemovePII] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JnasZ [20:49:14] [02miraheze/RemovePII] 07Universal-Omega 03f3cf2eb - Add centralauth-oversight check [20:49:15] [02RemovePII] 07Universal-Omega synchronize pull request 03#3: Create SpecialRemovePII (T7286: phase two and phase three) - 13https://git.io/Js0PN [20:50:06] miraheze/RemovePII - Universal-Omega the build passed. [20:50:14] [02RemovePII] 07Universal-Omega commented on pull request 03#3: Create SpecialRemovePII (T7286: phase two and phase three) - 13https://git.io/Jnasz [20:53:04] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.81, 6.56, 6.17 [20:54:59] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 6.42, 6.45, 6.17 [20:58:05] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 5.84, 6.84, 6.28 [21:00:06] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 3.97, 5.76, 5.95 [21:00:24] [02miraheze/RemovePII] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JnaZI [21:00:25] [02miraheze/RemovePII] 07Universal-Omega 0345ee0d8 - Update SpecialGenerateRandomHash.php [21:00:27] [02RemovePII] 07Universal-Omega synchronize pull request 03#3: Create SpecialRemovePII (T7286: phase two and phase three) - 13https://git.io/Js0PN [21:01:12] Universal_Omega: see DMs when you get a chance :) [21:01:16] nevermind [21:01:17] you saw [21:01:19] miraheze/RemovePII - Universal-Omega the build passed. [21:03:33] Voidwalker, are you mobile right now? Universal_Omega is mobile right now. If you're able to run `migrateGlobalAccount.php` on `MalorJak54` for `wiki=wretchedyoutubevideoswiki`, that'd be great. If not, he said he can do it later when not mobile [21:04:11] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.08, 6.91, 6.48 [21:06:08] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.88, 6.46, 6.40 [21:15:29] I can run it in like 2 minutes now. [21:20:52] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.03, 6.48, 5.93 [21:22:52] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.24, 5.84, 5.78 [21:22:55] !log [universalomega@jobrunner4] sudo -u www-data php /srv/mediawiki/w/extensions/CentralAuth/maintenance/migrateAccount.php --wiki=wretchedyoutubevideoswiki --username=MalorJak54 --auto [21:22:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:24:09] If I had any advanced permissions like a Steward or a Global Sysop right now, I would've had no problem locking the accounts. [21:24:18] dmehus: done [21:27:55] PROBLEM - test3 Puppet on test3 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 24 minutes ago with 0 failures [21:32:42] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.04, 6.79, 6.13 [21:33:08] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 10.34, 8.04, 6.61 [21:34:40] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.66, 7.53, 6.48 [21:35:02] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.60, 7.92, 6.74 [21:35:33] Universal_Omega, ty [21:35:42] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.80, 7.37, 6.52 [21:36:38] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 5.92, 7.02, 6.43 [21:37:01] Network died, rip [21:37:08] oh no heh [21:37:10] Huh? How so? [21:37:38] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.41, 6.65, 6.36 [21:38:30] MacFan4000, Sario, MH-Discord and MirahezeBot need restarting [21:38:37] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.50, 6.31, 6.23 [21:38:52] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.84, 6.68, 6.52 [21:39:06]