[00:01:46] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 17.08, 20.50, 24.00 [00:03:49] PROBLEM - graylog2 Puppet on graylog2 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [00:09:46] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 16.33, 15.69, 20.30 [00:09:48] RECOVERY - bacula2 Bacula Databases db13 on bacula2 is OK: OK: Full, 74059 files, 27.75GB, 2021-11-30 00:07:00 (2.8 minutes ago) [00:10:40] RECOVERY - bacula2 Bacula Private Git on bacula2 is OK: OK: Full, 6703 files, 53.55MB, 2021-11-30 00:08:00 (2.7 minutes ago) [00:13:37] [02mw-config] 07paladox closed pull request 03#4238: Update `$wgCdnServers` - 13https://git.io/JMEhE [00:13:39] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JMuk7 [00:13:40] [02miraheze/mw-config] 07Universal-Omega 03c37eb48 - Update `$wgCdnServers` (#4238) [00:13:42] [02mw-config] 07paladox deleted branch 03Universal-Omega-patch-1 - 13https://git.io/vbvb3 [00:13:43] [02miraheze/mw-config] 07paladox deleted branch 03Universal-Omega-patch-1 [00:14:41] miraheze/mw-config - paladox the build passed. [00:19:56] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.14, 3.84, 3.40 [00:22:38] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 22.84, 21.18, 20.38 [00:23:53] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.64, 3.49, 3.38 [00:24:07] !log [@test3] starting deploy of {'config': True} to skip [00:24:08] !log [@test3] finished deploy of {'config': True} to skip - SUCCESS in 0s [00:24:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:24:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:24:36] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 15.94, 18.96, 19.64 [00:31:15] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 1.50, 2.48, 1.66 [00:31:46] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 3.00, 3.26, 3.38 [00:31:49] RECOVERY - graylog2 Puppet on graylog2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:35:16] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.02, 1.87, 1.61 [00:37:15] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.18, 1.67, 1.56 [00:41:48] !log [@mw11] starting deploy of {'config': True} to all [00:41:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:41:57] !log [@mw11] finished deploy of {'config': True} to all - SUCCESS in 9s [00:42:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:51:28] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.06, 4.01, 3.57 [00:53:27] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.35, 3.84, 3.56 [01:01:20] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.46, 3.84, 3.62 [01:03:18] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.12, 3.55, 3.54 [01:13:10] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.26, 3.70, 3.62 [01:15:08] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.12, 3.46, 3.54 [01:21:03] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.22, 4.13, 3.77 [01:28:57] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.41, 3.85, 3.81 [01:34:53] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.50, 4.07, 3.88 [01:36:51] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.78, 3.75, 3.77 [01:46:47] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.21, 2.76, 3.27 [01:49:24] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.21, 1.91, 1.31 [01:51:24] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 9.96, 3.44, 1.86 [01:52:47] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.24, 3.46, 3.40 [01:54:47] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 3.22, 3.28, 3.34 [01:55:24] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.54, 1.85, 1.57 [01:57:24] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.55, 1.46, 1.46 [02:11:40] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.55, 3.08, 3.09 [02:13:39] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.35, 2.85, 3.01 [02:21:31] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.96, 3.87, 3.34 [02:23:30] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.41, 3.67, 3.33 [02:25:28] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.62, 3.40, 3.28 [02:29:23] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.32, 3.55, 3.38 [02:31:21] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.86, 3.30, 3.31 [02:37:15] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.34, 3.73, 3.50 [02:39:14] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.57, 3.55, 3.45 [02:41:12] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.21, 3.96, 3.60 [02:47:07] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.41, 3.59, 3.55 [03:00:56] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.32, 2.92, 3.27 [03:10:29] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 3.32, 4.80, 2.63 [03:10:47] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.22, 3.62, 3.48 [03:12:47] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.18, 3.71, 3.52 [03:14:47] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 4.00, 3.56, 3.47 [03:16:26] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 0.70, 1.81, 1.95 [03:18:48] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.04, 3.42, 3.41 [03:20:47] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 4.00, 3.50, 3.44 [03:22:23] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.62, 1.02, 1.55 [03:22:47] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.37, 3.03, 3.27 [03:28:46] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.70, 3.28, 3.27 [03:30:47] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.85, 3.00, 3.16 [03:34:46] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.45, 3.35, 3.27 [03:36:47] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.06, 2.97, 3.15 [04:01:43] PROBLEM - db12 Disk Space on db12 is CRITICAL: DISK CRITICAL - free space: / 25090 MB (5% inode=98%); [04:11:43] PROBLEM - db12 Disk Space on db12 is WARNING: DISK WARNING - free space: / 41947 MB (9% inode=98%); [04:14:26] PROBLEM - en.famepedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'en.famepedia.org' expires in 7 day(s) (Wed 08 Dec 2021 04:12:21 GMT +0000). [04:18:18] PROBLEM - famepedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'en.famepedia.org' expires in 7 day(s) (Wed 08 Dec 2021 04:12:21 GMT +0000). [05:07:43] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.53, 3.49, 1.84 [05:11:43] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.65, 1.87, 1.53 [05:13:44] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.33, 1.34, 1.38 [05:38:22] PROBLEM - jp.popira.info - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'jp.popira.info' expires in 15 day(s) (Thu 16 Dec 2021 05:36:04 GMT +0000). [05:42:27] PROBLEM - ballmedia.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'ballmedia.org' expires in 15 day(s) (Thu 16 Dec 2021 05:40:01 GMT +0000). [05:42:45] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.66, 7.14, 5.44 [05:43:31] PROBLEM - www.ballmedia.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'ballmedia.org' expires in 15 day(s) (Thu 16 Dec 2021 05:40:01 GMT +0000). [05:44:45] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 3.79, 5.90, 5.19 [05:46:20] PROBLEM - central.ballmedia.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'central.ballmedia.org' expires in 15 day(s) (Thu 16 Dec 2021 05:38:52 GMT +0000). [05:46:59] PROBLEM - commons.ballmedia.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'commons.ballmedia.org' expires in 15 day(s) (Thu 16 Dec 2021 05:42:00 GMT +0000). [05:50:44] PROBLEM - small.polandballwiki.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'small.polandballwiki.com' expires in 15 day(s) (Thu 16 Dec 2021 05:43:32 GMT +0000). [06:06:53] PROBLEM - db11 Current Load on db11 is WARNING: WARNING - load average: 7.42, 5.95, 3.65 [06:08:53] PROBLEM - db11 Current Load on db11 is CRITICAL: CRITICAL - load average: 8.22, 6.53, 4.13 [06:10:53] PROBLEM - db11 Current Load on db11 is WARNING: WARNING - load average: 7.03, 6.66, 4.48 [06:14:53] RECOVERY - db11 Current Load on db11 is OK: OK - load average: 5.54, 6.43, 4.93 [06:24:21] !log [reception@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=devilmanwiki --username-prefix wikia:devilman --report 1 --no-updates /home/reception/devilman_pages_full.xml (START) [06:24:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:28:53] !log renamed kirbyencyclopediawiki to kirbywiki [06:28:54] PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 8.20, 7.08, 5.42 [06:28:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:30:52] RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 3.24, 5.56, 5.06 [06:32:03] !log renamed mctwiki to mcnbwiki [06:32:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:37:55] !log renamed personnageswiki to fictionwiki [06:37:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:40:29] !log [reception@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=devilmanwiki --username-prefix wikia:devilman --report 1 --no-updates /home/reception/devilman_pages_full.xml (END - exit=0) [06:40:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:49:51] !log [reception@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=devilmanwiki (START) [06:49:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:54:39] PROBLEM - puppet3 Puppet on puppet3 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[postgresql-contrib-11] [06:59:06] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03Reception123-patch-1 [+0/-0/±1] 13https://git.io/JMzOV [06:59:08] [02miraheze/mw-config] 07Reception123 0331103fc - Lingo conflicts with Newsletter in 1.37 (see T8166) [06:59:09] [02mw-config] 07Reception123 created branch 03Reception123-patch-1 - 13https://git.io/vbvb3 [06:59:24] [02mw-config] 07Reception123 opened pull request 03#4239: Lingo conflicts with Newsletter in 1.37 (see T8166) - 13https://git.io/JMzOX [07:00:28] miraheze/mw-config - Reception123 the build passed. [07:04:40] [02miraheze/ssl] 07Reception123 pushed 032 commits to 03master [+2/-0/±2] 13https://git.io/JMz36 [07:04:42] [02miraheze/ssl] 07Reception123 03f928936 - add wiki.mistleague.io cert [07:04:44] [02miraheze/ssl] 07Reception123 03f365e61 - Merge branch 'master' of https://github.com/miraheze/ssl [07:04:45] [url] GitHub - miraheze/ssl: A repository for storing and managing SSL certificates for Miraheze | github.com [07:22:04] !log [reception@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=devilmanwiki (END - exit=0) [07:22:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:22:32] RECOVERY - puppet3 Puppet on puppet3 is OK: OK: Puppet is currently enabled, last run 41 seconds ago with 0 failures [07:56:32] RECOVERY - db12 Disk Space on db12 is OK: DISK OK - free space: / 49466 MB (11% inode=98%); [08:02:32] PROBLEM - db12 Disk Space on db12 is WARNING: DISK WARNING - free space: / 48470 MB (10% inode=98%); [08:27:21] PROBLEM - db11 Current Load on db11 is WARNING: WARNING - load average: 7.08, 5.83, 4.84 [08:29:03] PROBLEM - zenith.nsmbu.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'zenith.nsmbu.net' expires in 7 day(s) (Wed 08 Dec 2021 08:27:19 GMT +0000). [08:29:21] RECOVERY - db11 Current Load on db11 is OK: OK - load average: 6.44, 6.12, 5.08 [09:47:29] i want to election is where ? [10:48:40] [[RfGR]] [10:48:40] https://meta.miraheze.org/wiki/RfGR [10:48:41] https://meta.miraheze.org/wiki/RfGR [10:48:42] [url] Requests for global rights - Miraheze Meta | meta.miraheze.org [10:53:05] Reception123 Hi there [10:53:05] The task :grin: [10:53:43] ugochimobi: I've had a look this morning but nothing came up [10:54:05] 🥲 [10:54:12] So I can try to look further but someone else might need to help as I'm not great with Wikibase [10:55:00] Okay, CosmicAlpha 🤗 you could try if you want to, please. [10:55:23] but please Reception123, look further [12:19:44] PROBLEM - ns2 APT on ns2 is CRITICAL: APT CRITICAL: 9 packages available for upgrade (8 critical updates). [12:21:21] PROBLEM - mw13 APT on mw13 is CRITICAL: APT CRITICAL: 9 packages available for upgrade (8 critical updates). [12:21:21] PROBLEM - mw9 APT on mw9 is CRITICAL: APT CRITICAL: 9 packages available for upgrade (8 critical updates). [12:21:59] PROBLEM - db11 APT on db11 is CRITICAL: APT CRITICAL: 17 packages available for upgrade (8 critical updates). [12:22:11] PROBLEM - gluster3 APT on gluster3 is CRITICAL: APT CRITICAL: 9 packages available for upgrade (8 critical updates). [12:22:35] PROBLEM - db12 APT on db12 is CRITICAL: APT CRITICAL: 17 packages available for upgrade (8 critical updates). [12:22:50] PROBLEM - mem2 APT on mem2 is CRITICAL: APT CRITICAL: 9 packages available for upgrade (8 critical updates). [12:23:13] PROBLEM - mon2 APT on mon2 is CRITICAL: APT CRITICAL: 27 packages available for upgrade (8 critical updates). [12:23:46] PROBLEM - db13 APT on db13 is CRITICAL: APT CRITICAL: 17 packages available for upgrade (8 critical updates). [12:23:52] PROBLEM - mw10 APT on mw10 is CRITICAL: APT CRITICAL: 9 packages available for upgrade (8 critical updates). [12:25:07] PROBLEM - puppet3 APT on puppet3 is CRITICAL: APT CRITICAL: 12 packages available for upgrade (8 critical updates). [12:25:43] PROBLEM - gluster4 APT on gluster4 is CRITICAL: APT CRITICAL: 8 packages available for upgrade (8 critical updates). [12:26:51] PROBLEM - cp20 APT on cp20 is CRITICAL: APT CRITICAL: 8 packages available for upgrade (8 critical updates). [12:27:40] PROBLEM - ns1 APT on ns1 is CRITICAL: APT CRITICAL: 8 packages available for upgrade (8 critical updates). [12:28:27] PROBLEM - cloud5 APT on cloud5 is CRITICAL: APT CRITICAL: 8 packages available for upgrade (8 critical updates). [12:29:51] PROBLEM - mail2 APT on mail2 is CRITICAL: APT CRITICAL: 8 packages available for upgrade (8 critical updates). [12:29:57] PROBLEM - mw12 APT on mw12 is CRITICAL: APT CRITICAL: 8 packages available for upgrade (8 critical updates). [12:32:48] PROBLEM - graylog2 APT on graylog2 is CRITICAL: APT CRITICAL: 12 packages available for upgrade (8 critical updates). [12:34:06] PROBLEM - phab2 APT on phab2 is CRITICAL: APT CRITICAL: 9 packages available for upgrade (8 critical updates). [12:37:09] PROBLEM - mem1 APT on mem1 is CRITICAL: APT CRITICAL: 9 packages available for upgrade (8 critical updates). [12:37:22] PROBLEM - ldap2 APT on ldap2 is CRITICAL: APT CRITICAL: 9 packages available for upgrade (8 critical updates). [12:41:27] paladox, Reception123: could you sudo unattended-upgrades -d [12:42:43] PROBLEM - mw8 APT on mw8 is CRITICAL: APT CRITICAL: 9 packages available for upgrade (8 critical updates). [12:42:52] PROBLEM - mw11 APT on mw11 is CRITICAL: APT CRITICAL: 9 packages available for upgrade (8 critical updates). [12:44:43] PROBLEM - cloud4 APT on cloud4 is CRITICAL: APT CRITICAL: 8 packages available for upgrade (8 critical updates). [12:44:44] RECOVERY - mw8 APT on mw8 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [12:44:53] RECOVERY - mw11 APT on mw11 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [12:45:07] RECOVERY - mw9 APT on mw9 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [12:45:25] RECOVERY - mw13 APT on mw13 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [12:45:49] RECOVERY - mw10 APT on mw10 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [12:45:56] RECOVERY - mw12 APT on mw12 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [12:50:27] PROBLEM - bacula2 APT on bacula2 is CRITICAL: APT CRITICAL: 8 packages available for upgrade (8 critical updates). [12:50:41] PROBLEM - cloud3 APT on cloud3 is CRITICAL: APT CRITICAL: 9 packages available for upgrade (8 critical updates). [13:05:39] !log sudo unattended-upgrades -d on mw* [13:05:41] RhinosF1: ^ [13:05:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:06:28] Reception123: and every other server [13:10:41] RECOVERY - cloud3 APT on cloud3 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [13:10:42] RECOVERY - cloud4 APT on cloud4 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [13:12:27] RECOVERY - cloud5 APT on cloud5 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [13:20:57] [02MirahezeMagic] 07RhinosF1 commented on commit 035d4a63ecb7f53a3ce2379609355a430b2aef09e1 - 13https://git.io/JMg2b [13:21:20] [02miraheze/MirahezeMagic] 07RhinosF1 pushed 031 commit to 03revert-300-Universal-Omega-patch-5 [+0/-0/±3] 13https://git.io/JMg2p [13:21:21] [02miraheze/MirahezeMagic] 07RhinosF1 03f7ab665 - Revert "reCAPTCHA: use globally not-blocked recaptcha.net instead of google.com (#300)" [13:21:23] [02MirahezeMagic] 07RhinosF1 created branch 03revert-300-Universal-Omega-patch-5 - 13https://git.io/fQRGX [13:21:45] [02mw-config] 07ugochimobi opened pull request 03#4240: Constraint sections for GD - 13https://git.io/JMgaJ [13:22:52] [02MirahezeMagic] 07RhinosF1 opened pull request 03#304: Revert "reCAPTCHA: use globally not-blocked recaptcha.net instead of google.com" - 13https://git.io/JMga8 [13:23:01] miraheze/mw-config - ugochimobi the build passed. [13:28:09] Reception123: if you want to go ahead, do so [13:28:21] We can work on a fallback later [13:28:35] RhinosF1: (see -mw) [13:32:15] miraheze/MirahezeMagic - RhinosF1 the build passed. [13:35:44] [02MirahezeMagic] 07Reception123 closed pull request 03#304: Revert "reCAPTCHA: use globally not-blocked recaptcha.net instead of google.com" - 13https://git.io/JMga8 [13:35:45] [02miraheze/MirahezeMagic] 07Reception123 pushed 031 commit to 03master [+0/-0/±3] 13https://git.io/JMgo4 [13:35:47] [02miraheze/MirahezeMagic] 07RhinosF1 038ba6d72 - Revert "reCAPTCHA: use globally not-blocked recaptcha.net instead of google.com (#300)" (#304) [13:35:48] [02miraheze/MirahezeMagic] 07Reception123 deleted branch 03revert-300-Universal-Omega-patch-5 [13:35:50] [02MirahezeMagic] 07Reception123 deleted branch 03revert-300-Universal-Omega-patch-5 - 13https://git.io/fQRGX [13:37:12] yeah, sadly we have to revert the recaptcha issues, though at least we didn't do it in response to that IP user's RfC :) [13:37:39] s/revert the recaptcha issues/revert recaptcha due to issues [13:37:39] dmehus meant to say: yeah, sadly we have to revert recaptcha due to issues, though at least we didn't do it in response to that IP user's RfC :) [13:38:42] dmehus, In other words, you're saying that the IP editor who filed the RfC is getting what they wanted, or no? [13:42:36] dmehus: actually, we're now moving back to v3 as we've discovered the issue [13:42:38] well RhinosF1 did [13:43:08] There will however be a plan in the works to have v2 as a fallback option in case people in China have issues with v3 (as that provoked a change to ReCaptcha which we're quite sure was the reason why it started failing) [13:43:38] (ICYMI - we moved back to ReCaptcha v2 temporarily this weekend due to large issues with v3) [13:45:08] miraheze/MirahezeMagic - Reception123 the build passed. [13:56:09] [02miraheze/mediawiki] 07Reception123 pushed 031 commit to 03REL1_36 [+0/-0/±1] 13https://git.io/JMg1R [13:56:11] [02miraheze/mediawiki] 07Reception123 03671b3d5 - Update MirahezeMagic [14:02:48] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.73, 3.77, 3.26 [14:06:36] https://github.com/miraheze/mw-config/pull/4240 [14:06:37] [url] Constraint sections for GD by ugochimobi · Pull Request #4240 · miraheze/mw-config · GitHub | github.com [14:06:40] Reception123 ^ [14:06:47] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.27, 3.12, 3.12 [14:07:33] [02mw-config] 07Reception123 closed pull request 03#4240: Constraint sections for GD - 13https://git.io/JMgaJ [14:07:35] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JMgyu [14:07:36] [02miraheze/mw-config] 07ugochimobi 039edd67b - Constraint sections for GD (#4240) [14:07:44] thank you [14:08:38] miraheze/mw-config - Reception123 the build passed. [14:09:21] !log [@mw11] starting deploy of {'config': True} to all [14:09:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:09:39] !log [@mw11] finished deploy of {'config': True} to all - SUCCESS in 18s [14:09:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:10:36] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 9.19, 6.87, 4.77 [14:11:39] PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 12.89, 10.41, 6.71 [14:12:36] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 3.90, 5.73, 4.62 [14:13:38] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 4.05, 7.80, 6.20 [14:15:39] RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 2.71, 6.14, 5.79 [14:24:18] !log [@test3] starting deploy of {'config': True} to skip [14:24:19] !log [@test3] finished deploy of {'config': True} to skip - SUCCESS in 0s [14:24:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:24:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:52:35] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.93, 3.65, 3.15 [14:54:34] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.45, 3.39, 3.11 [15:00:32] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 3.02, 3.25, 3.17 [15:17:56] [02miraheze/mw-config] 07RhinosF1 pushed 031 commit to 03revert-4235-Reception123-patch-1 [+0/-0/±1] 13https://git.io/JM2JS [15:17:57] [02miraheze/mw-config] 07RhinosF1 035a2d380 - Revert "temporarily switch ReCaptcha back to v2 due to persistent errors (T8335) (#4235)" [15:17:59] [02mw-config] 07RhinosF1 created branch 03revert-4235-Reception123-patch-1 - 13https://git.io/vbvb3 [15:18:00] [02mw-config] 07RhinosF1 opened pull request 03#4241: Revert "temporarily switch ReCaptcha back to v2 due to persistent errors (T8335)" - 13https://git.io/JM2JH [15:18:07] Reception123: ^ [15:18:12] That needs doing too [15:18:27] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.45, 3.14, 3.03 [15:19:10] miraheze/mw-config - RhinosF1 the build passed. [15:19:14] RhinosF1: the thing is I can't understand why it seems like the changes haven't been pulled properly [15:19:15] After deploying https://git.io/JMg1R [15:19:27] I looked at RecaptchaHtml on mwtask1 and it's still displaying the old lin [15:19:28] *link [15:19:29] Reception123: have you ran the deploy tool [15:19:30] even though deploy ran [15:19:46] I don't see any for world [15:19:48] RhinosF1: oh that would be it, does it have to be ran separately to when puppet triggers it for mediawiki? [15:19:55] ah ok that's it then, I was thinking it might be that [15:20:07] Reception123: w is manual [15:20:17] haven't really pulled any changes since deploy was deployed so didn't know [15:20:22] * Reception123 doing now [15:20:40] !log [reception@mw11] starting deploy of {'config': True, 'world': True, 'l10n': True} to all [15:20:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:20:49] PROBLEM - mwtask1 Puppet on mwtask1 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [15:22:26] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.90, 3.12, 3.06 [15:32:26] !log [reception@mw11] finished deploy of {'config': True, 'world': True, 'l10n': True} to all - SUCCESS in 706s [15:32:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:34:56] Reception123: ^ [15:38:20] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.82, 3.63, 3.28 [15:42:49] RECOVERY - mwtask1 Puppet on mwtask1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [15:43:16] RhinosF1: ack, you can close the PR by the way since we did agree that we'd be changing the key [15:43:48] Reception123: just commit the new key on top [15:43:58] yeah can do that too [15:45:04] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03revert-4235-Reception123-patch-1 [+0/-0/±1] 13https://git.io/JM2q9 [15:45:06] [02miraheze/mw-config] 07Reception123 036ddffd4 - Update LocalSettings.php [15:45:07] [02mw-config] 07Reception123 synchronize pull request 03#4241: Revert "temporarily switch ReCaptcha back to v2 due to persistent errors (T8335)" - 13https://git.io/JM2JH [15:46:14] miraheze/mw-config - Reception123 the build passed. [15:46:28] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JM2mO [15:46:30] [02miraheze/mw-config] 07RhinosF1 03572d4cd - Revert "temporarily switch ReCaptcha back to v2 due to persistent errors (T8335)" (#4241) [15:46:31] [02miraheze/mw-config] 07Reception123 deleted branch 03revert-4235-Reception123-patch-1 [15:46:33] [02mw-config] 07Reception123 closed pull request 03#4241: Revert "temporarily switch ReCaptcha back to v2 due to persistent errors (T8335)" - 13https://git.io/JM2JH [15:46:36] [02mw-config] 07Reception123 deleted branch 03revert-4235-Reception123-patch-1 - 13https://git.io/vbvb3 [15:46:50] running puppet now then will make sure it works [15:47:42] miraheze/mw-config - Reception123 the build passed. [15:49:26] !log [@mw11] starting deploy of {'config': True} to all [15:49:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:49:36] !log [@mw11] finished deploy of {'config': True} to all - SUCCESS in 9s [15:49:39] PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 15.73, 10.24, 6.34 [15:49:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:50:16] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.92, 3.34, 3.35 [15:51:41] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 21.95, 19.57, 16.54 [15:51:54] seems to be working (it displays at least) [15:53:41] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 13.74, 17.35, 16.11 [15:54:46] !log [@test3] starting deploy of {'config': True} to skip [15:54:47] !log [@test3] finished deploy of {'config': True} to skip - SUCCESS in 0s [15:54:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:54:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:55:39] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 4.95, 7.27, 6.41 [15:56:45] Reception123: can you give access to new key [15:57:07] already done [15:57:38] RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 4.24, 6.28, 6.15 [15:57:42] Yep I see [16:00:12] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.87, 3.75, 3.52 [16:06:12] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.78, 2.99, 3.26 [16:22:12] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.81, 4.24, 3.62 [16:24:12] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.52, 3.50, 3.42 [16:26:12] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.21, 3.92, 3.56 [16:30:12] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.60, 3.47, 3.49 [16:32:12] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.19, 3.02, 3.31 [16:39:12] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 15.37, 10.26, 6.22 [16:41:09] !log delete old reCaptcha code from google dashboard [16:41:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:43:12] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.40, 7.51, 5.95 [16:44:11] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.23, 3.59, 3.40 [16:46:11] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.13, 2.99, 3.20 [16:47:12] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 2.39, 5.45, 5.54 [16:49:13] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 10.36, 8.26, 6.13 [16:51:11] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 5.07, 6.98, 5.91 [16:52:09] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.46, 3.26, 3.20 [16:53:09] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 3.87, 6.03, 5.70 [16:54:09] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.76, 2.91, 3.07 [17:07:04] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.15, 3.52, 3.30 [17:09:03] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.44, 3.19, 3.21 [17:21:34] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JM22y [17:21:36] [02miraheze/CreateWiki] 07Universal-Omega 030503ed7 - Update WikiRequest.php [17:21:37] [02CreateWiki] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://git.io/vpJTL [17:22:36] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 5.71, 6.88, 5.69 [17:22:58] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.27, 4.03, 3.48 [17:24:36] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.73, 6.02, 5.51 [17:26:58] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.04, 3.79, 3.55 [17:28:26] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 6.53, 6.84, 6.11 [17:28:57] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.02, 3.83, 3.59 [17:30:22] RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 6.20, 6.30, 5.98 [17:30:57] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.91, 3.67, 3.55 [17:36:55] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.36, 3.07, 3.35 [17:40:53] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.98, 3.54, 3.52 [17:48:50] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.16, 3.64, 3.55 [17:50:28] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 11.02, 7.25, 5.89 [17:50:37] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 14.75, 8.81, 6.27 [17:51:50] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 24.32, 20.39, 17.47 [17:52:45] PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 10.56, 9.11, 7.14 [17:52:49] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.17, 3.71, 3.62 [17:53:48] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 17.41, 19.26, 17.42 [17:54:28] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.02, 7.24, 6.26 [17:54:49] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.51, 4.09, 3.78 [17:56:28] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.94, 6.45, 6.09 [17:56:36] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 5.50, 7.18, 6.53 [17:58:36] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 3.99, 6.00, 6.17 [18:00:32] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 4.11, 7.27, 7.14 [18:01:11] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://git.io/JM2ic [18:01:13] [02miraheze/CreateWiki] 07Universal-Omega 03196a9bb - Update WikiRequest.php [18:01:14] [02CreateWiki] 07Universal-Omega created branch 03Universal-Omega-patch-2 - 13https://git.io/vpJTL [18:02:20] [02CreateWiki] 07Universal-Omega opened pull request 03#262: Fix notification for other involved users when request is declined - 13https://git.io/JM2iw [18:02:28] RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 3.31, 5.92, 6.66 [18:06:14] miraheze/CreateWiki - Universal-Omega the build has errored. [18:08:26] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://git.io/JM2Ph [18:08:28] [02miraheze/CreateWiki] 07Universal-Omega 0337f1ede - Update WikiRequest.php [18:08:29] [02CreateWiki] 07Universal-Omega synchronize pull request 03#262: Fix notification for other involved users when request is declined - 13https://git.io/JM2iw [18:10:44] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.89, 3.91, 3.99 [18:12:43] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.14, 3.81, 3.93 [18:14:43] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.84, 3.72, 3.88 [18:16:29] miraheze/CreateWiki - Universal-Omega the build passed. [18:17:17] Ty CosmicAlpha [18:18:49] RhinosF1: no problem, still needs tested but that should work good enough by using the comment notification type for other involved users (except requester). As changing the text for declined would require a whole new echo module/type to be added, so this seemed good enough. [18:19:17] Ok [18:20:41] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.80, 3.72, 3.76 [18:22:40] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.74, 3.34, 3.62 [18:24:39] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.27, 3.43, 3.60 [18:26:39] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.92, 3.11, 3.46 [18:28:38] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.69, 2.99, 3.37 [19:02:19] [02CreateWiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://git.io/vpJTL [19:02:21] [02miraheze/CreateWiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [19:08:25] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.23, 3.57, 3.23 [19:10:25] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 1.80, 3.15, 3.14 [19:22:36] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 14.44, 10.07, 6.77 [19:26:36] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 4.58, 7.09, 6.30 [19:28:18] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.37, 3.49, 3.24 [19:28:36] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.88, 6.60, 6.21 [19:30:18] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.71, 3.33, 3.21 [19:40:14] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.76, 4.48, 3.73 [19:46:12] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.29, 3.87, 3.69 [19:47:40] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+1/-0/±0] 13https://git.io/JM2xe [19:47:42] [02miraheze/puppet] 07paladox 03402160f - php: Add support for php 7.4 under buster [19:47:43] [02puppet] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vbiAS [19:47:45] [02puppet] 07paladox opened pull request 03#2137: php: Add support for php 7.4 under buster - 13https://git.io/JM2xJ [19:49:13] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JM2xn [19:49:14] [02miraheze/puppet] 07paladox 038769980 - Update apt.php [19:49:16] [02puppet] 07paladox synchronize pull request 03#2137: php: Add support for php 7.4 under buster - 13https://git.io/JM2xJ [19:49:45] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+1/-0/±0] 13https://git.io/JM2x4 [19:49:47] [02miraheze/puppet] 07paladox 03cf4b605 - Create wikimedia-apt-key.asc [19:49:48] [02puppet] 07paladox synchronize pull request 03#2137: php: Add support for php 7.4 under buster - 13https://git.io/JM2xJ [19:50:13] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.01, 4.13, 3.83 [19:50:42] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JM2xa [19:50:43] [02miraheze/puppet] 07paladox 034103ba3 - Update apt.php [19:50:45] [02puppet] 07paladox synchronize pull request 03#2137: php: Add support for php 7.4 under buster - 13https://git.io/JM2xJ [19:54:12] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.39, 3.90, 3.84 [19:54:53] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JM2pI [19:54:54] [02miraheze/puppet] 07paladox 0348a5c13 - Update php.pp [19:54:56] [02puppet] 07paladox synchronize pull request 03#2137: php: Add support for php 7.4 under buster - 13https://git.io/JM2xJ [19:55:11] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+1/-1/±0] 13https://git.io/JM2pO [19:55:12] [02miraheze/puppet] 07paladox 03bdecc54 - Rename apt.php to apt.pp [19:55:14] [02puppet] 07paladox synchronize pull request 03#2137: php: Add support for php 7.4 under buster - 13https://git.io/JM2xJ [20:00:12] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JM2pN [20:00:13] [02miraheze/puppet] 07paladox 033ce6a06 - Update php.pp [20:00:15] [02puppet] 07paladox synchronize pull request 03#2137: php: Add support for php 7.4 under buster - 13https://git.io/JM2xJ [20:04:12] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.99, 3.04, 3.36 [20:05:58] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JM2hX [20:05:59] [02miraheze/puppet] 07paladox 03ea17a64 - Update php_fpm.pp [20:06:01] [02puppet] 07paladox synchronize pull request 03#2137: php: Add support for php 7.4 under buster - 13https://git.io/JM2xJ [20:10:32] My Kirby wiki for some reason is all buggy, and @RVM2003 is having issues logging in centrally. [20:11:02] s/@RVM2003/@RMV2003 [20:11:03] darkmatterman450 meant to say: My Kirby wiki for some reason is all buggy, and @RMV2003 is having issues logging in centrally. [20:11:30] @RMV2003 ^ [20:12:12] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.19, 3.49, 3.36 [20:12:36] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.98, 6.19, 5.12 [20:14:11] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.39, 3.23, 3.30 [20:14:36] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.97, 5.59, 5.03 [20:18:35] darkmatterman450: that's what happens after renames [20:18:54] Give them the instructions I left on the task [20:19:11] Reception usually leaves a message on the rename tasks [20:19:36] Oh, let me check the Phab task I recently filed. [20:20:15] Oh yes, I see now. [20:22:12] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.54, 3.33, 3.28 [20:23:40] [02puppet] 07paladox closed pull request 03#2137: php: Add support for php 7.4 under buster - 13https://git.io/JM2xJ [20:23:42] [02puppet] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/vbiAS [20:23:43] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-1 [20:23:55] [02miraheze/mediawiki] 07Reception123 pushed 031 commit to 03REL1_36 [+0/-0/±1] 13https://git.io/JMava [20:23:55] hello [20:23:56] [02miraheze/mediawiki] 07Reception123 034178e85 - Update Wikibase [20:24:02] I was summoned [20:24:02] !log [reception@mw11] starting deploy of {'config': True, 'world': True, 'l10n': True} to all [20:24:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:24:12] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.98, 3.13, 3.21 [20:30:01] Opened https://phabricator.miraheze.org/T8361 as I acknowledge the issue can be annoying and should eventually be fixed. (cc @DarkMatterMan4500) [20:30:02] [url] ⚓ T8361 Attempt to fix login issues caused by DB renames | phabricator.miraheze.org [20:33:03] !log [reception@mw11] finished deploy of {'config': True, 'world': True, 'l10n': True} to all - SUCCESS in 540s [20:33:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:35:36] [02puppet] 07JohnFLewis closed pull request 03#2136: Remove `mwtask1_test` backend - 13https://git.io/JMTcV [20:35:38] [02miraheze/puppet] 07JohnFLewis pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JMaJt [20:35:39] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 7.69, 5.99, 5.51 [20:35:39] [02miraheze/puppet] 07Universal-Omega 03a1d8cca - Remove `mwtask1_test` backend (#2136) [20:36:14] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 21.75, 20.76, 18.51 [20:36:18] [02miraheze/puppet] 07JohnFLewis pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JMaJG [20:36:20] [02miraheze/puppet] 07Universal-Omega 03a763022 - CSP: add db.onlinewebfonts.com to `font-src` (#2130) [20:36:21] [02puppet] 07JohnFLewis closed pull request 03#2130: CSP: add db.onlinewebfonts.com to `font-src` - 13https://git.io/J1DWh [20:36:28] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 12.83, 8.60, 6.31 [20:37:38] RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 6.45, 6.21, 5.65 [20:38:28] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.30, 7.40, 6.14 [20:40:08] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.60, 3.50, 3.28 [20:40:11] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 16.94, 19.28, 18.47 [20:40:25] yeah i have been having login issues [20:40:29] really really annoying [20:40:52] even from clearing cookies & then visiting the renamed site logs me out of other miraheze sites [20:41:07] https://cdn.discordapp.com/attachments/808001911868489748/915341697133711360/Screenshot_from_2021-11-30_12-40-58.png [20:41:41] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 9.54, 7.35, 5.97 [20:42:07] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.66, 3.19, 3.19 [20:43:23] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.06, 7.18, 6.23 [20:43:34] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 5.78, 6.64, 5.88 [20:43:43] the db was renamed from kirbyencyclopediawiki to kirbywiki, although the top-left logo still has the kirbyencyclopediawiki url [20:43:53] i do know it takes a while to fix [20:46:16] i remember when supermariowiki.miraheze.org became mario.miraheze.org. that also took some time [20:46:28] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.19, 6.04, 6.11 [20:47:10] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.36, 6.39, 6.12 [20:50:58] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 12.79, 9.32, 7.33 [20:51:27] PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 11.94, 9.39, 7.34 [20:52:02] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 20.81, 19.85, 18.83 [20:52:05] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.77, 3.70, 3.33 [20:52:28] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 9.87, 7.67, 6.71 [20:54:30] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.66, 7.68, 6.85 [20:55:28] PROBLEM - ping6 on ns1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 125.45 ms [20:55:59] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 18.04, 19.34, 18.89 [20:56:39] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 4.97, 7.51, 7.26 [20:57:31] RECOVERY - ping6 on ns1 is OK: PING OK - Packet loss = 0%, RTA = 113.48 ms [20:59:12] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 6.81, 8.00, 7.57 [21:00:04] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.87, 3.69, 3.57 [21:02:28] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 6.48, 6.72, 6.80 [21:06:02] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.44, 3.81, 3.62 [21:08:36] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.09, 5.88, 6.57 [21:08:55] RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 4.66, 5.85, 6.73 [21:12:01] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.68, 3.96, 3.75 [21:14:01] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.38, 4.13, 3.84 [21:18:03] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.88, 3.62, 3.71 [21:26:03] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.91, 3.81, 3.68 [21:36:09] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.99, 1.53, 1.02 [21:38:07] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.37, 1.41, 1.03 [21:39:58] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.13, 3.73, 3.82 [21:49:57] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.78, 3.04, 3.40 [21:51:41] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 22.49, 20.15, 17.52 [21:51:41] PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 13.57, 8.83, 6.34 [21:52:36] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 5.41, 6.81, 5.74 [21:53:39] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 6.00, 7.63, 6.21 [21:53:41] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 16.92, 18.86, 17.37 [21:54:36] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 3.38, 5.56, 5.41 [21:57:39] RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 5.73, 6.70, 6.15 [22:03:54] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.80, 3.45, 3.32 [22:05:53] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.62, 3.30, 3.29 [22:18:02] PROBLEM - mw11 APT on mw11 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [22:18:48] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.84, 3.46, 3.40 [22:19:12] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 11.71, 7.36, 5.56 [22:20:01] RECOVERY - mw11 APT on mw11 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [22:20:47] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.53, 3.81, 3.53 [22:21:12] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.47, 7.20, 5.72 [22:22:46] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.67, 3.85, 3.59 [22:23:12] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 11.80, 8.85, 6.51 [22:27:35] majavah: do you understand session logic? [22:29:12] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.15, 7.62, 6.78 [22:31:12] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 3.68, 6.33, 6.42 [22:34:42] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.02, 3.42, 3.50 [22:36:42] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.01, 3.30, 3.45 [22:38:41] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.68, 3.13, 3.37 [22:38:55] !log [rhinos@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/CleanupEmptyCategories.php --wiki=nrj1450wiki --force (END - exit=256) [22:38:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:39:11] !log [rhinos@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/cleanupEmptyCategories.php --wiki=nrj1450wiki --force (END - exit=0) [22:39:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:39:19] Agent: ^ [22:42:04] !log [rhinos@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/purgeList.php --wiki=gratisdatawiki --all-namespaces --db-touch --delay=1 (END - exit=2) [22:42:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:42:30] !log (start) sudo -u www-data php /srv/mediawiki/w/maintenance/purgeList.php --wiki=gratisdatawiki --all-namespaces --db-touch --delay=1 [22:42:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:44:18] RhinosF1: thanks, I'll tell them [22:44:39] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.43, 3.49, 3.47 [22:46:38] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.40, 3.21, 3.38 [22:59:39] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 7.46, 7.61, 5.91 [23:00:01] !log [@test3] starting deploy of {'l10nupdate': True} to skip [23:00:02] !log [@mw11] starting deploy of {'l10nupdate': True} to all [23:00:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:00:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:00:57] Agent: https://meta.miraheze.org/wiki/Community_noticeboard#2021_Tech_Excellence [23:00:59] [url] Community noticeboard - Miraheze Meta | meta.miraheze.org [23:01:38] RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 4.54, 6.40, 5.67 [23:04:13] PROBLEM - mw9 APT on mw9 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [23:04:39] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 13.55, 8.08, 5.73 [23:05:12] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 10.14, 8.38, 5.76 [23:05:39] PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 9.49, 9.11, 6.96 [23:06:08] RECOVERY - mw9 APT on mw9 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [23:07:12] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 4.74, 6.82, 5.50 [23:07:39] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 5.49, 7.54, 6.64 [23:08:36] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 4.71, 6.95, 5.88 [23:09:12] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 4.66, 6.15, 5.41 [23:09:30] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.46, 3.55, 3.21 [23:09:39] PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 8.20, 9.06, 7.38 [23:09:49] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.07, 7.00, 5.32 [23:11:29] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.85, 3.30, 3.15 [23:11:49] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 4.54, 6.13, 5.21 [23:12:36] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.37, 7.67, 6.37 [23:13:26] session logic? [23:13:41] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 20.27, 20.45, 18.21 [23:14:15] man i still can't log in [23:14:20] to kirby encyclopedia [23:14:28] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.25, 6.81, 5.45 [23:14:33] even if i clear cookie [23:14:36] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.43, 7.50, 6.46 [23:15:40] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 14.88, 18.49, 17.77 [23:16:28] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 6.11, 6.26, 5.41 [23:17:27] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.86, 3.75, 3.38 [23:17:39] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 7.08, 7.84, 7.52 [23:18:40] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 18.92, 10.44, 7.66 [23:19:26] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.32, 3.29, 3.26 [23:19:38] PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 10.46, 9.20, 8.07 [23:21:25] Log out and lock back in [23:21:29] i tried [23:21:37] Clear your cookies for login.miraheze.org and *.miraheze.org if possible [23:21:41] i did that [23:21:42] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 23.52, 20.67, 18.81 [23:22:03] RhinosF1: ack re: Phabricator End of Year stats [23:22:09] something was filed on phabricator [23:22:09] ty [23:22:19] regarding this [23:22:25] and how it is struggling to update [23:22:28] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.59, 7.77, 6.33 [23:23:41] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 18.04, 20.08, 18.86 [23:24:23] Clear your cookies [23:24:28] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.82, 6.64, 6.09 [23:24:41] If you've cleared them, there is exactly 0% chance of the error still happening [23:24:51] @RMV2003 "If you experience login issues after this please follow these instructions: Open the private browsing mode of your web browser and login, and go to Special:UserLogout. Next, open the regular browsing mode of your web browser, delete your cookies for *.miraheze.org and try and login again" [23:27:02] it logged me back on [23:27:10] niiice 👍 [23:27:52] thank you [23:29:38] !log [@test3] finished deploy of {'l10nupdate': True} to skip - SUCCESS in 1776s [23:29:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:36:19] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.31, 3.49, 3.34 [23:36:36] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 3.66, 6.45, 7.70 [23:37:39] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 4.73, 6.60, 7.89 [23:38:18] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.90, 3.24, 3.26 [23:39:32] PROBLEM - mw13 Current Load on mw13 is WARNING: WARNING - load average: 7.27, 6.40, 5.12 [23:39:39] PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 11.56, 8.36, 8.35 [23:43:32] RECOVERY - mw13 Current Load on mw13 is OK: OK - load average: 3.98, 5.56, 5.10 [23:43:38] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 5.58, 7.30, 7.96 [23:46:36] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 20.37, 20.77, 19.36 [23:48:30] !log [@mw11] finished deploy of {'l10nupdate': True} to all - SUCCESS in 2908s [23:48:34] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 19.56, 20.38, 19.39 [23:48:36] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.59, 5.34, 6.53 [23:48:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:53:39] RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 4.10, 5.44, 6.76