[00:03:32] PROBLEM - graylog2 Puppet on graylog2 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [00:04:03] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 10.32, 6.29, 5.35 [00:04:05] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 34.00, 23.74, 20.85 [00:04:38] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.40, 3.43, 3.22 [00:06:05] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 22.37, 22.07, 20.55 [00:06:33] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.03, 3.64, 3.31 [00:08:03] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.48, 5.82, 5.37 [00:08:05] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 29.13, 23.82, 21.32 [00:10:03] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 12.46, 7.88, 6.14 [00:11:19] PROBLEM - cp15 Puppet on cp15 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [00:12:15] PROBLEM - cp14 Puppet on cp14 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[wiki.danvs.net] [00:12:16] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.46, 3.49, 3.42 [00:14:10] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.17, 3.67, 3.49 [00:16:05] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.98, 3.71, 3.52 [00:23:49] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.55, 3.14, 3.37 [00:31:31] RECOVERY - graylog2 Puppet on graylog2 is OK: OK: Puppet is currently enabled, last run 23 seconds ago with 0 failures [00:38:15] RECOVERY - cp14 Puppet on cp14 is OK: OK: Puppet is currently enabled, last run 53 seconds ago with 0 failures [00:39:19] RECOVERY - cp15 Puppet on cp15 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:43:49] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.39, 4.13, 3.69 [00:53:49] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.10, 3.82, 3.80 [00:55:49] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.57, 4.16, 3.93 [00:57:49] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.15, 3.74, 3.80 [01:01:49] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.46, 4.14, 3.95 [01:05:49] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.94, 3.75, 3.85 [01:09:49] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.20, 3.73, 3.82 [01:11:49] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.39, 3.50, 3.72 [01:15:49] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.89, 3.99, 3.85 [01:16:04] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 18.54, 20.61, 23.48 [01:21:49] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.49, 3.89, 3.86 [01:22:03] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.23, 5.49, 5.99 [01:26:03] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.69, 5.68, 5.93 [01:27:49] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.24, 4.48, 4.06 [01:28:03] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.26, 5.64, 5.90 [01:28:04] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 31.30, 22.26, 22.26 [01:30:03] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 8.50, 6.97, 6.36 [01:31:49] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.18, 3.96, 3.95 [01:32:05] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 21.14, 23.27, 22.85 [01:38:15] PROBLEM - bacula2 Disk Space on bacula2 is WARNING: DISK WARNING - free space: / 139587 MB (10% inode=99%); [01:39:49] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.33, 4.34, 4.05 [01:46:03] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.35, 5.58, 5.99 [01:48:04] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 18.56, 18.66, 20.10 [01:50:03] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.04, 5.46, 5.82 [01:52:03] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 4.80, 5.15, 5.66 [02:00:03] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 8.04, 5.64, 5.47 [02:01:49] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.96, 3.75, 3.97 [02:04:03] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 3.86, 5.31, 5.47 [02:05:49] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.16, 3.49, 3.78 [02:12:03] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 9.89, 6.28, 5.65 [02:13:49] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.24, 3.86, 3.91 [02:14:03] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.45, 5.90, 5.60 [02:18:03] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 3.14, 4.18, 4.95 [02:19:49] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.60, 4.00, 3.88 [02:29:26] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 20.22, 20.62, 18.98 [02:31:24] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 15.66, 18.76, 18.50 [02:39:49] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.82, 3.81, 4.00 [02:49:49] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.26, 3.46, 3.58 [02:53:49] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.21, 3.37, 3.57 [03:07:49] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.62, 3.13, 3.37 [03:11:49] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.43, 3.55, 3.49 [03:15:49] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.14, 3.69, 3.55 [03:17:49] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.54, 3.48, 3.48 [03:20:53] [02mw-config] 07dmehus opened pull request 03#4212: Remove references to quircwiki and rf1botwiki - 13https://git.io/JXamm [03:21:49] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.07, 3.80, 3.60 [03:21:56] miraheze/mw-config - dmehus the build passed. [03:22:51] [02mw-config] 07Universal-Omega closed pull request 03#4212: Remove references to quircwiki and rf1botwiki - 13https://git.io/JXamm [03:22:53] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JXamM [03:22:54] [02miraheze/mw-config] 07dmehus 030a9aec6 - Remove references to quircwiki and rf1botwiki (#4212) [03:23:49] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.71, 3.75, 3.61 [03:23:59] miraheze/mw-config - Universal-Omega the build passed. [03:24:41] !log [@test3] starting deploy of {'config': True} to skip [03:24:42] !log [@test3] finished deploy of {'config': True} to skip - SUCCESS in 0s [03:24:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:24:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:25:49] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 3.94, 4.11, 3.78 [03:26:05] [02mw-config] 07dmehus reviewed pull request 03#4208 commit - 13https://git.io/JXaYg [03:27:45] [02mw-config] 07Universal-Omega reviewed pull request 03#4208 commit - 13https://git.io/JXaOe [03:27:49] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.53, 3.56, 3.62 [03:28:40] PROBLEM - bacula2 Bacula Phabricator Static on bacula2 is CRITICAL: CRITICAL: Full, 88188 files, 9.442GB, 2021-10-10 03:28:00 (4.3 weeks ago) [03:29:49] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.14, 3.75, 3.67 [03:31:49] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.17, 3.52, 3.60 [03:39:49] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.46, 3.01, 3.33 [03:41:33] !log [@mw11] starting deploy of {'config': True} to all [03:41:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:41:44] !log [@mw11] finished deploy of {'config': True} to all - SUCCESS in 11s [03:41:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:47:49] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.33, 3.48, 3.37 [03:49:49] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.10, 2.97, 3.20 [03:54:28] [02mw-config] 07dmehus reviewed pull request 03#4208 commit - 13https://git.io/JXaCn [04:00:38] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.97, 3.49, 3.40 [04:02:32] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.65, 3.38, 3.38 [04:05:23] PROBLEM - nocyclo.tk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'nocyclo.tk' expires in 7 day(s) (Wed 17 Nov 2021 04:05:10 GMT +0000). [04:09:37] PROBLEM - incubator.nocyclo.tk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'incubator.nocyclo.tk' expires in 7 day(s) (Wed 17 Nov 2021 04:06:46 GMT +0000). [04:13:02] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.35, 4.18, 3.70 [04:14:56] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.39, 3.81, 3.62 [04:16:51] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 3.88, 4.02, 3.73 [04:18:45] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.95, 3.65, 3.62 [04:20:40] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.01, 4.13, 3.80 [04:20:56] [02mw-config] 07Universal-Omega reviewed pull request 03#4208 commit - 13https://git.io/JXaEp [04:26:23] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.27, 3.42, 3.65 [04:27:35] [02mw-config] 07dmehus reviewed pull request 03#4208 commit - 13https://git.io/JXagm [04:28:22] [02mw-config] 07dmehus commented on pull request 03#4212: Remove references to quircwiki and rf1botwiki - 13https://git.io/JXagg [04:34:00] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.47, 3.82, 3.71 [04:35:08] [02mw-config] 07Universal-Omega reviewed pull request 03#4208 commit - 13https://git.io/JXaVT [04:35:54] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.95, 3.62, 3.66 [04:39:49] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 1.73, 2.65, 3.26 [05:04:50] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.98, 3.46, 3.18 [05:06:45] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.18, 2.97, 3.03 [05:17:39] [02miraheze/RemovePII] 07dependabot[bot] pushed 031 commit to 03dependabot/composer/mediawiki/mediawiki-phan-config-0.11.1 [+0/-0/±1] 13https://git.io/JXaHE [05:17:40] [02miraheze/RemovePII] 07dependabot[bot] 0332099ab - Update mediawiki/mediawiki-phan-config requirement from 0.11.0 to 0.11.1 [05:17:42] [02RemovePII] 07dependabot[bot] created branch 03dependabot/composer/mediawiki/mediawiki-phan-config-0.11.1 - 13https://git.io/Jsfpj [05:17:44] [02RemovePII] 07dependabot[bot] opened pull request 03#38: Update mediawiki/mediawiki-phan-config requirement from 0.11.0 to 0.11.1 - 13https://git.io/JXaHu [05:17:45] [02RemovePII] 07dependabot[bot] labeled pull request 03#38: Update mediawiki/mediawiki-phan-config requirement from 0.11.0 to 0.11.1 - 13https://git.io/JXaHu [05:17:46] [02RemovePII] 07dependabot[bot] labeled pull request 03#38: Update mediawiki/mediawiki-phan-config requirement from 0.11.0 to 0.11.1 - 13https://git.io/JXaHu [05:25:19] miraheze/RemovePII - dependabot[bot] the build passed. [06:06:21] PROBLEM - db11 Current Load on db11 is WARNING: WARNING - load average: 6.93, 5.60, 3.42 [06:08:21] RECOVERY - db11 Current Load on db11 is OK: OK - load average: 6.47, 5.88, 3.79 [06:10:15] PROBLEM - bacula2 Disk Space on bacula2 is CRITICAL: DISK CRITICAL - free space: / 77576 MB (5% inode=99%); [06:17:04] [02RemovePII] 07Universal-Omega closed pull request 03#38: Update mediawiki/mediawiki-phan-config requirement from 0.11.0 to 0.11.1 - 13https://git.io/JXaHu [06:17:06] [02miraheze/RemovePII] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JXVIV [06:17:07] [02miraheze/RemovePII] 07dependabot[bot] 03c712717 - Update mediawiki/mediawiki-phan-config requirement from 0.11.0 to 0.11.1 (#38) [06:17:09] [02RemovePII] 07Universal-Omega deleted branch 03dependabot/composer/mediawiki/mediawiki-phan-config-0.11.1 - 13https://git.io/Jsfpj [06:17:10] [02miraheze/RemovePII] 07Universal-Omega deleted branch 03dependabot/composer/mediawiki/mediawiki-phan-config-0.11.1 [06:24:07] miraheze/RemovePII - Universal-Omega the build passed. [07:08:07] [02miraheze/puppet] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JXVB6 [07:08:08] [02miraheze/puppet] 07Universal-Omega 03af8f238 - deploy-mediawiki: remove commented l10nupdate from l10n argument (#2111) [07:08:10] [02puppet] 07Reception123 closed pull request 03#2111: deploy-mediawiki: remove commented l10nupdate from l10n argument - 13https://git.io/JXeHS [07:10:35] dmehus: if you can't see a difference [07:10:40] You don't have an eye for design [07:11:09] RhinosF1, I can see the difference, but was just making a point [07:11:35] dmehus: there's no gaps between anything on the 1st one that got deployed and reverted [07:11:50] * RhinosF1 thinks it stands out like a sore thumb [07:14:13] PROBLEM - wiki.tigcity.tk - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.tigcity.tk All nameservers failed to answer the query. [07:21:04] PROBLEM - wiki.tigcity.tk - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.tigcity.tk could not be found [07:27:34] RhinosF1, yeah the new one is certainly an improvement, I'm just saying that I think improvement was quite minor and probably could've had Lake propose to update the logo with the Vector version with the extra padding on the margins [07:27:53] on community noticeboard or some other talk page [07:28:07] I mean it should have gone to CN in the first place [07:28:16] yeah [07:28:41] * RhinosF1 wonders why you say yeah now as you were apparently one of the people who said it didn't need to [09:13:03] PROBLEM - wiki.qadrishattari.xyz - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.qadrishattari.xyz' expires in 15 day(s) (Thu 25 Nov 2021 09:09:05 GMT +0000). [10:00:08] PROBLEM - www.hoolehistoryheritagesociety.org.uk - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'www.hoolehistoryheritagesociety.org.uk' expires in 15 day(s) (Thu 25 Nov 2021 09:52:00 GMT +0000). [12:11:43] Well, we have a process now; a mess, but it'll get there I imagine [12:12:22] Good idea, just needed to pass through more inputs I think [12:36:24] PROBLEM - www.ethene.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'ethene.wiki' expires in 7 day(s) (Wed 17 Nov 2021 12:33:50 GMT +0000). [12:39:37] PROBLEM - ethene.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'ethene.wiki' expires in 7 day(s) (Wed 17 Nov 2021 12:33:50 GMT +0000). [13:52:04] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.55, 3.30, 2.89 [13:57:49] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.26, 2.84, 2.83 [14:49:49] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.58, 3.37, 3.09 [14:51:49] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.12, 2.92, 2.96 [15:06:32] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.66, 3.48, 3.26 [15:08:27] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.80, 3.26, 3.20 [15:38:02] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.97, 3.87, 3.22 [15:39:56] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.07, 3.45, 3.14 [15:41:50] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.75, 3.25, 3.10 [15:51:49] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 6.04, 4.36, 3.58 [15:55:49] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.67, 3.91, 3.57 [16:03:49] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 3.02, 3.04, 3.28 [16:09:49] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.45, 3.43, 3.38 [16:13:49] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.65, 3.29, 3.34 [16:17:03] PROBLEM - cp15 Current Load on cp15 is CRITICAL: CRITICAL - load average: 1.30, 2.24, 1.38 [16:19:03] RECOVERY - cp15 Current Load on cp15 is OK: OK - load average: 0.50, 1.63, 1.26 [16:19:49] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.30, 3.64, 3.45 [16:22:25] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.50, 7.42, 5.48 [16:23:49] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.86, 3.85, 3.61 [16:24:23] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.01, 6.30, 5.29 [16:31:49] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.36, 3.12, 3.39 [17:07:38] !log resizing bacula2 as storage space is insufficient because static takes up too much space [17:07:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:07:44] Reception123: ^^ fyi [17:07:58] PROBLEM - bacula2 Bacula Private Git on bacula2 is CRITICAL: connect to address 168.235.111.29 port 5666: Connection timed outconnect to host 168.235.111.29 port 5666: Connection timed out [17:08:16] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.36, 3.69, 3.42 [17:09:24] PROBLEM - bacula2 Current Load on bacula2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [17:09:33] PROBLEM - bacula2 NTP time on bacula2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [17:09:44] PROBLEM - ping4 on bacula2 is CRITICAL: PING CRITICAL - Packet loss = 100% [17:10:11] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.76, 3.29, 3.31 [17:10:18] PROBLEM - bacula2 Puppet on bacula2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [17:10:56] PROBLEM - bacula2 SSH on bacula2 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:11:02] PROBLEM - bacula2 PowerDNS Recursor on bacula2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [17:11:03] PROBLEM - bacula2 Bacula Databases db12 on bacula2 is CRITICAL: connect to address 168.235.111.29 port 5666: Connection timed outconnect to host 168.235.111.29 port 5666: Connection timed out [17:11:09] PROBLEM - bacula2 APT on bacula2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [17:11:18] PROBLEM - Host bacula2 is DOWN: PING CRITICAL - Packet loss = 100% [17:11:27] * RhinosF1 assumes spam is John [17:11:53] Yeah [17:30:02] [02miraheze/ManageWiki] 07dependabot[bot] pushed 031 commit to 03dependabot/npm_and_yarn/eslint-config-wikimedia-0.21.0 [+0/-0/±2] 13https://git.io/JXopZ [17:30:03] [02miraheze/ManageWiki] 07dependabot[bot] 035827c8e - Bump eslint-config-wikimedia from 0.20.0 to 0.21.0 [17:30:05] [02ManageWiki] 07dependabot[bot] created branch 03dependabot/npm_and_yarn/eslint-config-wikimedia-0.21.0 - 13https://git.io/vpSns [17:30:06] [02ManageWiki] 07dependabot[bot] opened pull request 03#316: Bump eslint-config-wikimedia from 0.20.0 to 0.21.0 - 13https://git.io/JXopc [17:30:08] [02ManageWiki] 07dependabot[bot] labeled pull request 03#316: Bump eslint-config-wikimedia from 0.20.0 to 0.21.0 - 13https://git.io/JXopc [17:30:09] [02ManageWiki] 07dependabot[bot] labeled pull request 03#316: Bump eslint-config-wikimedia from 0.20.0 to 0.21.0 - 13https://git.io/JXopc [17:32:46] miraheze/ManageWiki - dependabot[bot] the build has errored. [17:51:04] PROBLEM - cp15 Current Load on cp15 is WARNING: WARNING - load average: 1.25, 1.81, 1.20 [17:53:03] RECOVERY - cp15 Current Load on cp15 is OK: OK - load average: 0.71, 1.41, 1.12 [17:59:52] PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 8.85, 6.47, 4.70 [18:01:50] RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 4.50, 5.54, 4.57 [18:03:49] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.90, 3.56, 3.18 [18:11:49] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.54, 3.34, 3.27 [18:14:04] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 13.96, 7.90, 5.58 [18:15:49] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.74, 3.70, 3.44 [18:15:50] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 7.81, 7.35, 5.80 [18:16:13] Bump- any update on T8264 [18:17:49] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.34, 4.54, 3.79 [18:18:05] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.28, 7.16, 5.82 [18:19:11] .task 8264 [18:19:13] https://phabricator.miraheze.org/T8264 - custom domain request, authored by Pips, assigned to None, Priority: Normal, Status: Open [18:19:23] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.24, 6.53, 5.07 [18:19:38] It's only a day old [18:19:45] Reception123 normally handles CDs [18:19:50] RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 6.58, 6.72, 5.88 [18:20:05] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.34, 7.53, 6.11 [18:22:04] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.87, 6.61, 5.96 [18:22:43] alright [18:23:21] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 4.25, 5.70, 5.10 [18:23:49] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.23, 3.78, 3.76 [18:29:49] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.21, 3.71, 3.70 [18:30:36] PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 13.71, 10.66, 7.81 [18:31:49] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.17, 3.16, 3.51 [18:33:49] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 1.47, 2.63, 3.28 [18:34:27] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 3.46, 6.91, 6.92 [18:36:23] RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 3.85, 5.94, 6.56 [19:03:49] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.11, 3.13, 2.81 [19:05:49] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 1.77, 2.67, 2.68 [19:32:51] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.97, 3.67, 3.23 [19:36:41] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.64, 3.40, 3.25 [19:37:38] ack r.e. bacula and will likely get to CDs tomorrow [19:51:58] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.48, 3.68, 3.41 [19:52:16] CDs as in Compact Disks [19:52:34] ? ;) [19:53:52] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.47, 3.72, 3.47 [19:57:49] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.36, 3.19, 3.32 [20:00:02] Custom domains [20:02:00] !log [universalomega@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/importImages.php --wiki=dmlwikiwiki /home/rhinos/t8224/miraheze/miraheze_images_to_import --search-recursively (START) [20:05:49] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.57, 3.20, 3.18 [20:07:49] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 3.38, 3.26, 3.20 [20:11:29] RhinosF1 okay [20:21:49] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.62, 3.27, 3.08 [20:22:04] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 10.55, 7.79, 5.72 [20:23:49] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 3.27, 3.26, 3.10 [20:24:04] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 5.08, 7.03, 5.72 [20:26:04] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 3.87, 5.99, 5.50 [20:29:18] PROBLEM - privacy-wiki.0x.no - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'privacy-wiki.0x.no' expires in 7 day(s) (Wed 17 Nov 2021 20:28:02 GMT +0000). [20:29:39] PROBLEM - www.fossilfighterswiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'www.fossilfighterswiki.com' expires in 7 day(s) (Wed 17 Nov 2021 20:27:16 GMT +0000). [20:31:34] PROBLEM - ref.undu.st - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'ref.undu.st' expires in 7 day(s) (Wed 17 Nov 2021 20:28:20 GMT +0000). [20:32:08] PROBLEM - worldsanskrit.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'worldsanskrit.net' expires in 7 day(s) (Wed 17 Nov 2021 20:27:45 GMT +0000). [20:32:34] PROBLEM - meta.orain.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'orain.org' expires in 7 day(s) (Wed 17 Nov 2021 20:31:21 GMT +0000). [20:33:51] PROBLEM - allthetropes.orain.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'orain.org' expires in 7 day(s) (Wed 17 Nov 2021 20:31:21 GMT +0000). [20:34:48] PROBLEM - miraheze.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'miraheze.com' expires in 7 day(s) (Wed 17 Nov 2021 20:33:31 GMT +0000). [20:35:42] PROBLEM - poserdazfreebies.orain.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'orain.org' expires in 7 day(s) (Wed 17 Nov 2021 20:31:21 GMT +0000). [20:35:49] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.19, 3.70, 3.39 [20:37:30] PROBLEM - orain.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'orain.org' expires in 7 day(s) (Wed 17 Nov 2021 20:31:21 GMT +0000). [20:37:37] PROBLEM - isv.orain.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'orain.org' expires in 7 day(s) (Wed 17 Nov 2021 20:31:21 GMT +0000). [20:37:49] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.49, 3.55, 3.37 [20:39:49] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 3.03, 3.34, 3.31 [20:42:08] RECOVERY - Host bacula2 is UP: PING OK - Packet loss = 0%, RTA = 76.07 ms [20:42:11] RECOVERY - bacula2 Current Load on bacula2 is OK: OK - load average: 0.47, 0.11, 0.04 [20:42:11] RECOVERY - ping4 on bacula2 is OK: PING OK - Packet loss = 0%, RTA = 74.63 ms [20:42:11] RECOVERY - bacula2 APT on bacula2 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [20:42:11] RECOVERY - bacula2 PowerDNS Recursor on bacula2 is OK: DNS OK: 0.307 seconds response time. miraheze.org returns 167.114.2.161,2607:5300:201:3100::1d3,2607:5300:205:200::1c30,51.222.25.132 [20:42:12] PROBLEM - bacula2 Bacula Private Git on bacula2 is WARNING: WARNING: Full, 6467 files, 49.72MB, 2021-10-31 00:51:00 (1.4 weeks ago) [20:42:27] PROBLEM - bacula2 Puppet on bacula2 is WARNING: WARNING: Puppet last ran 3 hours ago [20:42:55] RECOVERY - bacula2 SSH on bacula2 is OK: SSH OK - OpenSSH_7.9p1 Debian-10+deb10u2 (protocol 2.0) [20:43:06] RECOVERY - bacula2 Bacula Databases db12 on bacula2 is OK: OK: Full, 70416 files, 28.15GB, 2021-11-07 00:36:00 (2.8 days ago) [20:43:11] RECOVERY - bacula2 NTP time on bacula2 is OK: NTP OK: Offset 0.002097427845 secs [20:44:24] RECOVERY - bacula2 Puppet on bacula2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [20:49:49] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.35, 3.64, 3.41 [20:51:49] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.66, 3.36, 3.35 [21:11:24] !log [universalomega@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/importImages.php --wiki=dmlwikiwiki /home/rhinos/t8224/miraheze/miraheze_images_to_import --search-recursively (END - exit=256) [21:11:35] Sario: I invited you again [21:11:46] I can op so you can sort invex list [21:12:07] Ok [21:14:12] !log [universalomega@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/importImages.php --wiki=dmlwikiwiki /home/rhinos/t8224/miraheze/miraheze_images_to_import --search-recursively (START) [21:16:06] !log [universalomega@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/importImages.php --wiki=dmlwikiwiki /home/rhinos/t8224/miraheze/miraheze_images_to_import --search-recursively (END - exit=0) [21:32:49] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.09, 3.79, 3.34 [21:34:43] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.03, 3.46, 3.27 [21:38:28] [02mw-config] 07Universal-Omega closed pull request 03#4208: Set default rights for CommentStreams and SpriteSheet - 13https://git.io/JX49f [21:38:30] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JXKDL [21:38:32] [02miraheze/mw-config] 07Kelvs599 031fc61e9 - Set default rights for CommentStreams and SpriteSheet (#4208) [21:39:37] miraheze/mw-config - Universal-Omega the build passed. [21:40:26] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.79, 3.18, 3.24 [21:41:31] !log [@mw11] starting deploy of {'config': True} to all [21:41:49] !log [@mw11] finished deploy of {'config': True} to all - SUCCESS in 18s [21:49:14] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 25.60, 21.70, 18.13 [21:51:11] PROBLEM - graylog2 Current Load on graylog2 is WARNING: WARNING - load average: 3.43, 3.00, 2.18 [21:51:12] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 21.09, 21.42, 18.46 [21:53:10] RECOVERY - graylog2 Current Load on graylog2 is OK: OK - load average: 1.39, 2.38, 2.05 [21:53:58] !log [@test3] starting deploy of {'config': True} to skip [21:53:59] !log [@test3] finished deploy of {'config': True} to skip - SUCCESS in 0s [21:57:07] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 26.39, 21.26, 19.14 [21:59:05] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 20.99, 21.58, 19.56 [22:01:03] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 16.15, 19.90, 19.21 [22:04:58] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 21.54, 23.62, 21.09 [22:05:14] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 3.65, 5.39, 4.38 [22:07:11] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 2.07, 4.31, 4.11 [22:08:54] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 15.23, 18.39, 19.49 [22:13:49] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 4.00, 3.73, 3.27 [22:14:00] CosmicAlpha: https://github.com/Universal-Omega/puppet/pull/1 [22:14:01] [url] mwdeploy: refactor some logic by RhinosF1 · Pull Request #1 · Universal-Omega/puppet · GitHub | github.com [22:14:48] i made some changes so it's easier to extend [22:15:03] i could have done more but i didn't want to touch too much not new code [22:15:49] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.59, 3.22, 3.13 [22:16:38] [02puppet] 07Universal-Omega synchronize pull request 03#2114: deploy-mediawiki: add `--pull` argument - 13https://git.io/JX4W1 [22:17:33] Thanks, RhinosF1! [22:17:44] CosmicAlpha: will fix ci [22:18:23] https://github.com/Universal-Omega/puppet/pull/2 [22:18:23] [url] Update deploy-mediawiki.py by RhinosF1 · Pull Request #2 · Universal-Omega/puppet · GitHub | github.com [22:19:02] [02puppet] 07Universal-Omega synchronize pull request 03#2114: deploy-mediawiki: add `--pull` argument - 13https://git.io/JX4W1 [22:19:49] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.38, 3.50, 3.30 [22:21:16] RhinosF1: Still failed. [22:21:49] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.39, 3.17, 3.21 [22:21:56] CosmicAlpha: ye, let it run in my fork before merging 3 [22:22:28] CosmicAlpha: now it passes [22:22:33] https://github.com/Universal-Omega/puppet/pull/3 [22:22:34] [url] synax by RhinosF1 · Pull Request #3 · Universal-Omega/puppet · GitHub | github.com [22:23:31] [02puppet] 07Universal-Omega synchronize pull request 03#2114: deploy-mediawiki: add `--pull` argument - 13https://git.io/JX4W1 [22:24:18] CosmicAlpha: i'll cleanup rsync further in another pr [22:24:33] i don't want to over refactor in a new feature [22:25:07] RhinosF1: Sounds good, thanks! [22:25:22] JohnLewis, paladox: can all 3 open puppet PRs be merged [22:25:49] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.43, 3.73, 3.41 [22:26:33] [02puppet] 07paladox closed pull request 03#2115: Revert "mwdeploy: improve l10nupdate performance" - 13https://git.io/JXuev [22:26:34] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/JXK5a [22:26:36] [02miraheze/puppet] 07RhinosF1 03841ff9f - Revert "mwdeploy: improve l10nupdate performance (#2113)" (#2115) [22:26:41] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JXK5V [22:26:43] [02miraheze/puppet] 07Universal-Omega 03e7db3d1 - deploy-mediawiki: add `--pull` argument (#2114) [22:26:44] [02puppet] 07paladox closed pull request 03#2114: deploy-mediawiki: add `--pull` argument - 13https://git.io/JX4W1 [22:27:02] [02puppet] 07paladox closed pull request 03#2110: Remove absented LocalisationUpdate cron and cleanup spacing - 13https://git.io/JXe9F [22:27:03] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JXK5K [22:27:05] [02miraheze/puppet] 07Universal-Omega 0393a4dc9 - Remove absented LocalisationUpdate cron and cleanup spacing (#2110) [22:27:49] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.02, 3.46, 3.35 [22:29:31] paladox: we just missed puppet so can you pull [22:29:40] i want to test mw-deploy before sleep [22:29:49] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 1.95, 2.93, 3.17 [22:30:03] PROBLEM - mw11 Puppet on mw11 is WARNING: WARNING: Puppet is currently disabled, message: rolling out 2114 - rf1, last run 18 minutes ago with 0 failures [22:30:50] git has already pulled [22:31:03] PROBLEM - cp15 Current Load on cp15 is WARNING: WARNING - load average: 1.22, 1.74, 1.31 [22:31:28] yep it's seeing it now [22:32:16] !log [rhinos@test3] starting deploy of {'pull': 'config', 'config': True} to skip [22:32:18] !log [rhinos@test3] finished deploy of {'pull': 'config', 'config': True} to skip - FAIL: [32768, 5888] in 1s [22:33:03] RECOVERY - cp15 Current Load on cp15 is OK: OK - load average: 0.85, 1.45, 1.25 [22:33:23] [02puppet] 07RhinosF1 opened pull request 03#2116: fix wik spelling - 13https://git.io/JXKdM [22:33:27] paladox: ^ [22:33:39] [02puppet] 07paladox closed pull request 03#2116: fix wik spelling - 13https://git.io/JXKdM [22:33:41] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JXKd9 [22:33:43] [02miraheze/puppet] 07RhinosF1 03ade607c - Update deploy-mediawiki.py (#2116) [22:33:55] paladox: pls pull as script is now broken [22:34:06] it's pulled [22:34:38] we need the typos plugin wikimedia has [22:35:13] !log [rhinos@test3] starting deploy of {'pull': 'config', 'config': True} to skip [22:35:14] !log [rhinos@test3] finished deploy of {'pull': 'config', 'config': True} to skip - SUCCESS in 0s [22:35:34] !log [rhinos@test3] starting deploy of {'world': True} to skip [22:35:42] !log [rhinos@test3] finished deploy of {'world': True} to skip - FAIL: [2, 2, 2] in 7s [22:38:55] [02puppet] 07RhinosF1 opened pull request 03#2117: fix _construct param - 13https://git.io/JXKFD [22:39:02] paladox: final bug fix ^ [22:39:19] [02puppet] 07paladox closed pull request 03#2117: fix _construct param - 13https://git.io/JXKFD [22:39:21] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JXKF7 [22:39:22] [02miraheze/puppet] 07RhinosF1 03551b5cf - fix _construct param (#2117) [22:39:35] !log [rhinos@test3] starting deploy of {'world': True} to skip [22:39:39] pulled [22:39:40] !log [rhinos@test3] finished deploy of {'world': True} to skip - FAIL: [2, 2, 2] in 4s [22:40:23] i should add tests before refactoring [22:40:38] !log [rhinos@test3] starting deploy of {'world': True} to skip [22:44:02] paladox: where is logbot [22:44:51] oh it was disconnected because of net split earlier. [22:46:36] !log [rhinos@test3] finished deploy of {'world': True} to skip - SUCCESS in 357s [22:46:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:48:03] RECOVERY - mw11 Puppet on mw11 is OK: OK: Puppet is currently enabled, last run 1 second ago with 0 failures [22:48:29] CosmicAlpha: Notice: /Stage[main]/Mediawiki/File[/usr/local/bin/deploy-mediawiki]/content: content changed '{sha256}12266db91013212e0cbf757df01939e823eb4189e8bace84205a98c5278acd48' to '{sha256}94d09309a8d5a00e72c1554974c6391d1235b9de6165b39510c4cb9551459684' [22:48:33] now done on 11 [22:49:29] great, thanks! [22:56:08] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 25.52, 22.56, 19.55 [23:00:03] !log [@mw11] starting deploy of {'l10nupdate': True} to all [23:00:05] !log [@test3] starting deploy of {'l10nupdate': True} to skip [23:00:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:00:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:00:23] [02mw-config] 07Universal-Omega reviewed pull request 03#4189 commit - 13https://git.io/JXKAr [23:00:50] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.24, 6.08, 4.97 [23:02:03] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.26, 5.67, 4.66 [23:02:13] [02mw-config] 07Universal-Omega reviewed pull request 03#4189 commit - 13https://git.io/JXKAr [23:02:48] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 6.27, 6.25, 5.17 [23:03:50] PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 13.92, 9.13, 6.43 [23:04:03] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.79, 5.49, 4.70 [23:05:14] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 11.77, 8.78, 6.08 [23:06:03] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 3.01, 4.79, 4.56 [23:07:13] PROBLEM - incubator.nocyclo.tk - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for incubator.nocyclo.tk could not be found [23:07:14] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 5.88, 7.43, 5.90 [23:07:50] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 6.45, 7.38, 6.33 [23:09:15] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 9.94, 8.60, 6.52 [23:09:20] PROBLEM - mw11 APT on mw11 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [23:09:37] PROBLEM - meta.nocyclo.tk - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for meta.nocyclo.tk could not be found [23:09:49] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.54, 3.27, 3.08 [23:09:50] PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 8.74, 8.62, 6.95 [23:11:49] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.04, 2.92, 2.98 [23:11:50] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 5.14, 7.38, 6.70 [23:12:56] [02puppet] 07Universal-Omega opened pull request 03#2118: Run l10nupdate once a week rather than every day - 13https://git.io/JXKpu [23:13:50] RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 3.08, 5.89, 6.24 [23:14:05] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 17.35, 22.56, 23.00 [23:16:37] RECOVERY - meta.nocyclo.tk - reverse DNS on sslhost is OK: SSL OK - meta.nocyclo.tk reverse DNS resolves to cp12.miraheze.org - CNAME FLAT [23:17:39] PROBLEM - cloud5 Current Load on cloud5 is WARNING: WARNING - load average: 20.80, 20.40, 17.76 [23:19:10] !log [@mw11] finished deploy of {'l10nupdate': True} to all - FAIL: [35072, 0, 0, 0, 0, 0, 0, 0, 0] in 1147s [23:19:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:19:39] RECOVERY - cloud5 Current Load on cloud5 is OK: OK - load average: 15.21, 18.68, 17.47 [23:19:46]