[00:02:03] PROBLEM - savage-wiki.com - RapidSSL on sslhost is WARNING: WARNING - Certificate 'savage-wiki.com' expires in 30 day(s) (Sun 14 Nov 2021 23:59:59 GMT +0000). [00:06:12] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 25.32, 21.88, 18.07 [00:06:52] [02puppet] 07paladox closed pull request 03#2033: mwtask1: set `mwservices: true` - 13https://git.io/JKnBN [00:06:53] [02miraheze/puppet] 07paladox pushed 032 commits to 03master [+0/-0/±2] 13https://git.io/JKnEe [00:06:55] [02miraheze/puppet] 07Universal-Omega 03d21a17a - mwtask1: set `mwservices: true` [00:06:56] [02miraheze/puppet] 07paladox 03e8410e8 - Merge pull request #2033 from Universal-Omega/patch-131 [00:09:54] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 9.20, 6.76, 4.32 [00:21:44] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 4.25, 5.75, 5.27 [00:27:36] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 3.72, 4.44, 4.87 [00:28:15] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 16.22, 20.21, 23.37 [00:30:51] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.40, 3.67, 3.37 [00:32:49] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.33, 3.68, 3.43 [00:33:33] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.04, 5.06, 4.93 [00:34:13] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 31.41, 25.43, 24.54 [00:34:51] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.60, 4.13, 3.63 [00:35:30] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 3.88, 4.73, 4.84 [00:36:50] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.81, 3.71, 3.54 [00:38:45] PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 17.71, 11.02, 7.22 [00:38:53] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 1.76, 3.12, 3.35 [00:39:50] PROBLEM - mw12 APT on mw12 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [00:41:41] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 8.19, 6.07, 5.26 [00:41:49] RECOVERY - mw12 APT on mw12 is OK: APT OK: 17 packages available for upgrade (0 critical updates). [00:43:39] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 4.90, 5.82, 5.28 [00:45:13] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JKnzM [00:45:15] [02miraheze/services] 07MirahezeSSLBot 032a41a31 - BOT: Updating services config for wikis [00:48:37] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 5.74, 7.48, 7.40 [00:49:38] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 4.28, 4.88, 5.06 [00:50:13] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 19.70, 22.01, 23.90 [00:50:47] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.30, 6.59, 5.46 [00:50:57] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.33, 3.78, 3.46 [00:52:49] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.65, 6.16, 5.44 [00:52:55] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.77, 3.71, 3.47 [00:56:31] RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 4.92, 5.79, 6.70 [01:00:10] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 12.03, 15.34, 19.69 [01:00:49] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.29, 3.83, 3.57 [01:04:11] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 25.06, 19.56, 20.31 [01:06:10] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 15.17, 17.70, 19.55 [01:06:49] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.15, 3.68, 3.64 [01:12:48] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.45, 2.94, 3.32 [01:19:42] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.33, 3.45, 3.44 [01:21:41] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.20, 3.87, 3.60 [01:23:36] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.80, 3.82, 3.61 [01:33:09] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.37, 3.06, 3.34 [01:40:50] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.78, 3.48, 3.40 [01:42:48] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.50, 3.66, 3.46 [01:44:49] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.81, 3.63, 3.47 [01:48:48] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.54, 3.12, 3.32 [02:07:05] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 16.12, 9.81, 6.21 [02:09:04] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 5.17, 7.78, 5.91 [02:11:02] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 3.89, 6.58, 5.70 [02:17:40] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 6.89, 6.10, 4.62 [02:19:39] RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 6.17, 6.00, 4.75 [02:23:41] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.15, 3.78, 3.47 [02:25:35] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.26, 3.46, 3.38 [02:27:31] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.90, 3.27, 3.32 [02:44:03] PROBLEM - cp12 Current Load on cp12 is WARNING: WARNING - load average: 1.49, 1.78, 1.07 [02:46:04] RECOVERY - cp12 Current Load on cp12 is OK: OK - load average: 0.61, 1.33, 0.98 [02:48:53] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://git.io/JKnMV [02:48:54] [02miraheze/mw-config] 07Universal-Omega 03ad840e6 - Add mtimeFile to `loadExtensions()` [02:48:56] [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-2 - 13https://git.io/vbvb3 [02:48:57] [02mw-config] 07Universal-Omega opened pull request 03#4151: Add mtimeFile to `loadExtensions()` - 13https://git.io/JKnMw [02:49:56] miraheze/mw-config - Universal-Omega the build passed. [02:50:29] [02mw-config] 07Universal-Omega closed pull request 03#4151: Add mtimeFile to `loadExtensions()` - 13https://git.io/JKnMw [02:50:30] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JKnMx [02:50:32] [02miraheze/mw-config] 07Universal-Omega 03c9db180 - Add mtimeFile to `loadExtensions()` (#4151) [02:50:33] [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 [02:50:35] [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 - 13https://git.io/vbvb3 [02:51:29] miraheze/mw-config - Universal-Omega the build passed. [02:51:52] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JKnDO [02:51:54] [02miraheze/mw-config] 07Universal-Omega 0368063f8 - Raise DPL requirement to 75,000 pages [02:52:04] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 13.24, 8.44, 5.41 [02:52:56] miraheze/mw-config - Universal-Omega the build passed. [02:54:03] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 5.91, 7.25, 5.34 [02:56:03] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 2.92, 5.67, 4.99 [03:03:12] !log [@test3] starting deploy of {'config': True} to skip [03:03:13] !log [@test3] finished deploy of {'config': True} to skip - SUCCESS in 0s [03:03:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:03:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:05:26] PROBLEM - mw11 APT on mw11 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [03:05:43] !log [@mw11] starting deploy of {'config': True} to all [03:05:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:06:07] !log [@mw11] finished deploy of {'config': True} to all - SUCCESS in 24s [03:06:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:06:39] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 13.16, 7.63, 5.17 [03:07:24] RECOVERY - mw11 APT on mw11 is OK: APT OK: 17 packages available for upgrade (0 critical updates). [03:08:05] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 5.84, 7.22, 5.42 [03:08:35] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 5.61, 6.71, 5.13 [03:10:04] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 4.24, 6.12, 5.22 [03:36:34] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.03, 6.27, 5.01 [03:38:34] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 3.59, 5.18, 4.77 [05:04:03] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 12.00, 9.25, 5.98 [05:06:47] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 19.43, 9.34, 5.66 [05:08:30] PROBLEM - mw10 APT on mw10 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [05:08:50] PROBLEM - cloud5 Current Load on cloud5 is CRITICAL: CRITICAL - load average: 26.84, 22.52, 17.40 [05:09:11] PROBLEM - mw13 Current Load on mw13 is CRITICAL: CRITICAL - load average: 10.02, 7.40, 5.51 [05:11:10] PROBLEM - mw13 Current Load on mw13 is WARNING: WARNING - load average: 6.53, 6.89, 5.55 [05:12:35] RECOVERY - mw10 APT on mw10 is OK: APT OK: 17 packages available for upgrade (0 critical updates). [05:12:47] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 4.13, 7.62, 6.43 [05:12:52] PROBLEM - cloud5 Current Load on cloud5 is WARNING: WARNING - load average: 16.86, 20.87, 18.08 [05:13:04] RECOVERY - mw13 Current Load on mw13 is OK: OK - load average: 5.00, 6.18, 5.45 [05:14:44] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 3.83, 6.33, 6.10 [05:14:51] RECOVERY - cloud5 Current Load on cloud5 is OK: OK - load average: 16.38, 19.16, 17.76 [05:20:47] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.69, 7.17, 6.46 [05:21:12] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.45, 3.44, 3.22 [05:22:44] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 4.19, 6.14, 6.17 [05:26:20] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 5.48, 6.64, 7.76 [05:26:56] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.13, 3.07, 3.15 [05:28:47] PROBLEM - mw9 APT on mw9 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [05:29:13] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 10.90, 7.80, 6.28 [05:32:16] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 3.85, 5.08, 6.70 [05:32:54] RECOVERY - mw9 APT on mw9 is OK: APT OK: 17 packages available for upgrade (0 critical updates). [05:33:13] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.77, 7.99, 6.77 [05:37:12] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.59, 6.69, 6.52 [05:37:39] PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 11.96, 7.87, 5.71 [05:38:12] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 5.35, 6.45, 6.86 [05:40:10] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.94, 6.11, 6.68 [05:41:39] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 4.21, 7.38, 6.16 [05:43:39] RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 2.09, 5.62, 5.66 [05:59:09] PROBLEM - bacula2 PowerDNS Recursor on bacula2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [05:59:45] PROBLEM - bacula2 Bacula Phabricator Static on bacula2 is CRITICAL: connect to address 168.235.111.29 port 5666: Connection timed outconnect to host 168.235.111.29 port 5666: Connection timed out [05:59:47] PROBLEM - ping4 on bacula2 is CRITICAL: PING CRITICAL - Packet loss = 100% [06:00:20] PROBLEM - bacula2 Current Load on bacula2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [06:00:28] PROBLEM - bacula2 APT on bacula2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [06:00:57] PROBLEM - bacula2 Bacula Daemon on bacula2 is CRITICAL: connect to address 168.235.111.29 port 5666: Connection timed outconnect to host 168.235.111.29 port 5666: Connection timed out [06:01:05] PROBLEM - bacula2 Puppet on bacula2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [06:01:05] PROBLEM - Host bacula2 is DOWN: PING CRITICAL - Packet loss = 100% [06:06:07] PROBLEM - db11 Current Load on db11 is CRITICAL: CRITICAL - load average: 8.62, 6.44, 4.06 [06:13:56] PROBLEM - db11 Current Load on db11 is WARNING: WARNING - load average: 7.91, 8.00, 5.78 [06:19:16] PROBLEM - db11 Current Load on db11 is CRITICAL: CRITICAL - load average: 9.01, 8.08, 6.44 [06:19:32] PROBLEM - jobchron1 Puppet on jobchron1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 5 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_JobRunner] [06:21:58] PROBLEM - db11 Current Load on db11 is WARNING: WARNING - load average: 7.66, 7.77, 6.57 [06:32:19] RECOVERY - db11 Current Load on db11 is OK: OK - load average: 5.25, 6.51, 6.59 [06:45:17] RECOVERY - jobchron1 Puppet on jobchron1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [07:21:16] PROBLEM - db11 Current Load on db11 is WARNING: WARNING - load average: 7.03, 6.71, 6.28 [07:24:04] RECOVERY - db11 Current Load on db11 is OK: OK - load average: 5.82, 6.48, 6.28 [07:29:51] PROBLEM - db11 Current Load on db11 is WARNING: WARNING - load average: 7.84, 7.08, 6.60 [07:32:26] PROBLEM - db11 Current Load on db11 is CRITICAL: CRITICAL - load average: 8.15, 7.44, 6.81 [07:35:11] PROBLEM - db11 Current Load on db11 is WARNING: WARNING - load average: 6.90, 7.57, 6.98 [07:53:38] RECOVERY - db11 Current Load on db11 is OK: OK - load average: 6.23, 6.49, 6.73 [08:00:36] PROBLEM - wiki.caker18.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'wiki.caker18.com' expires in 7 day(s) (Sat 23 Oct 2021 07:54:49 GMT +0000). [08:08:58] PROBLEM - db11 Current Load on db11 is CRITICAL: CRITICAL - load average: 8.30, 7.47, 6.97 [08:11:37] PROBLEM - db11 Current Load on db11 is WARNING: WARNING - load average: 7.21, 7.31, 6.99 [08:19:31] PROBLEM - www.journeytheword.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'www.journeytheword.wiki' expires in 7 day(s) (Sat 23 Oct 2021 08:16:26 GMT +0000). [08:22:04] RECOVERY - db11 Current Load on db11 is OK: OK - load average: 6.21, 6.66, 6.80 [08:23:16] PROBLEM - journeytheword.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'www.journeytheword.wiki' expires in 7 day(s) (Sat 23 Oct 2021 08:16:26 GMT +0000). [08:23:37] PROBLEM - pj-masks-info.cf - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'pj-masks-info.cf' expires in 7 day(s) (Sat 23 Oct 2021 08:19:02 GMT +0000). [08:54:48] [02puppet] 07Reception123 closed pull request 03#2024: Remove unused dblist directory - 13https://git.io/JoAyH [08:54:49] [02miraheze/puppet] 07Reception123 pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/JKCJC [08:54:51] [02miraheze/puppet] 07Universal-Omega 0361ca500 - Remove unused dblist directory (#2024) [08:55:00] [02puppet] 07Reception123 closed pull request 03#2025: Remove unused wikistats stuff - 13https://git.io/JoAHW [08:55:01] [02miraheze/puppet] 07Reception123 pushed 031 commit to 03master [+0/-2/±0] 13https://git.io/JKCJB [08:55:03] [02miraheze/puppet] 07Universal-Omega 032439df7 - Remove unused wikistats stuff (#2025) [09:06:33] PROBLEM - db11 Current Load on db11 is CRITICAL: CRITICAL - load average: 9.43, 7.57, 6.96 [09:11:44] PROBLEM - db11 Current Load on db11 is WARNING: WARNING - load average: 6.67, 7.48, 7.15 [09:20:49] Reception123: please actually remove on disk [09:27:53] RECOVERY - db11 Current Load on db11 is OK: OK - load average: 6.33, 6.47, 6.79 [09:30:58] RhinosF1: yup, will take care of that [09:33:01] !log sudo rm -rf /srv/mediawiki/dblist on mw*/mwtask1/test3 [09:33:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:52:54] PROBLEM - db11 Current Load on db11 is WARNING: WARNING - load average: 7.73, 7.06, 6.59 [09:53:19] PROBLEM - wiki.apico.buzz - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'wiki.apico.buzz' expires in 7 day(s) (Sat 23 Oct 2021 09:52:54 GMT +0000). [09:55:34] RECOVERY - db11 Current Load on db11 is OK: OK - load average: 6.72, 6.59, 6.47 [10:41:27] PROBLEM - db11 Current Load on db11 is CRITICAL: CRITICAL - load average: 8.54, 7.15, 6.37 [10:43:56] PROBLEM - db11 Current Load on db11 is WARNING: WARNING - load average: 7.87, 7.14, 6.47 [10:51:52] RECOVERY - db11 Current Load on db11 is OK: OK - load average: 6.40, 6.41, 6.43 [10:58:27] [02miraheze/ssl] 07Reception123 pushed 036 commits to 03master [+0/-4/±14] 13https://git.io/JKCSD [10:58:28] [02miraheze/ssl] 07Reception123 03c54776d - renew SSL certs [10:58:30] [02miraheze/ssl] 07Reception123 035b4171d - remove warmage.necrocity.co.uk cert (wiki deleted) [10:58:31] [02miraheze/ssl] 07Reception123 03b09ad8b - remove wiki.candela.digital cert (no longer pointing) [10:58:33] [02miraheze/ssl] ... and 3 more commits. [11:00:37] !log bash ./wikibackups.sh /home/reception/publicwikis.txt /srv/mediawiki/w/maintenance/dumpBackup.php (wikibackups) [11:00:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [11:07:24] RECOVERY - miraheze.tk - LetsEncrypt on sslhost is OK: OK - Certificate 'miraheze.tk' will expire on Thu 13 Jan 2022 09:49:01 GMT +0000. [11:07:34] RECOVERY - wiki.candela.digital - LetsEncrypt on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [11:07:59] RECOVERY - wiki.helioss.co - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.helioss.co' will expire on Thu 13 Jan 2022 09:44:17 GMT +0000. [11:08:28] RECOVERY - wiki.invinciblewellbeing.com - LetsEncrypt on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [11:08:46] RECOVERY - tensegritywiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'tensegritywiki.com' will expire on Thu 13 Jan 2022 09:43:05 GMT +0000. [11:08:57] RECOVERY - wiki.pablojprieto.com.es - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.pablojprieto.com.es' will expire on Thu 13 Jan 2022 09:52:44 GMT +0000. [11:09:32] RECOVERY - infectowiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'infectowiki.com' will expire on Thu 13 Jan 2022 09:55:42 GMT +0000. [11:11:57] RECOVERY - wiki.worlduniversityandschool.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.worlduniversityandschool.org' will expire on Thu 13 Jan 2022 09:40:52 GMT +0000. [11:12:41] RECOVERY - warmage.necrocity.co.uk - LetsEncrypt on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [11:12:46] RECOVERY - planetnomads.speedbomb.de - LetsEncrypt on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [11:13:01] RECOVERY - wiki.insideearth.info - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.insideearth.info' will expire on Thu 13 Jan 2022 09:54:04 GMT +0000. [11:13:08] RECOVERY - wiki.seamly.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.seamly.net' will expire on Thu 13 Jan 2022 09:41:51 GMT +0000. [11:13:18] RECOVERY - wiki.joust.ro - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.joust.ro' will expire on Thu 13 Jan 2022 09:51:48 GMT +0000. [11:16:55] !log [reception@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=examplewiki /home/reception/Wikipedia-20211014084815-licensetemplates.xml --username-prefix viwikipedia --report 1 (END - exit=65280) [11:16:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [11:24:59] RECOVERY - meta.nocyclo.tk - LetsEncrypt on sslhost is OK: OK - Certificate 'meta.nocyclo.tk' will expire on Thu 13 Jan 2022 09:56:47 GMT +0000. [11:28:15] [02miraheze/ssl] 07Reception123 pushed 035 commits to 03master [+0/-3/±22] 13https://git.io/JKC71 [11:28:16] [02miraheze/ssl] 07Reception123 0354431c9 - renew SSL cert [11:28:18] [02miraheze/ssl] 07Reception123 0302f5307 - remove wiki.sdbx.dev cert (deleted wiki) [11:28:19] [02miraheze/ssl] 07Reception123 036d61c95 - renew SSL certs [11:28:21] [02miraheze/ssl] ... and 2 more commits. [11:37:14] RECOVERY - wiki.shaazzz.ir - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.shaazzz.ir' will expire on Thu 13 Jan 2022 10:02:09 GMT +0000. [11:37:14] !log [reception@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=scpvncommunitywiki /home/reception/Wikipedia-20211014084815-licensetemplates.xml --username-prefix viwikipedia --report 1 (END - exit=0) [11:37:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [11:37:29] RECOVERY - tl.awiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'tl.awiki.org' will expire on Thu 13 Jan 2022 10:06:17 GMT +0000. [11:38:12] RECOVERY - wiki.openhatch.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.openhatch.org' will expire on Thu 13 Jan 2022 10:24:22 GMT +0000. [11:38:24] RECOVERY - wiki.conworlds.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.conworlds.org' will expire on Thu 13 Jan 2022 10:18:37 GMT +0000. [11:38:31] RECOVERY - wiki.mikrodev.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.mikrodev.com' will expire on Thu 13 Jan 2022 10:12:17 GMT +0000. [11:38:37] RECOVERY - wiki.scvo.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.scvo.org' will expire on Thu 13 Jan 2022 10:09:39 GMT +0000. [11:38:52] RECOVERY - wiki.ciptamedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.ciptamedia.org' will expire on Thu 13 Jan 2022 10:13:29 GMT +0000. [11:39:08] RECOVERY - tep.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'tep.wiki' will expire on Thu 13 Jan 2022 10:05:09 GMT +0000. [11:39:31] RECOVERY - www.programming.red - LetsEncrypt on sslhost is OK: OK - Certificate 'programming.red' will expire on Thu 13 Jan 2022 10:11:18 GMT +0000. [11:39:43] RECOVERY - wiki.responsibly.ai - LetsEncrypt on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [11:40:14] RECOVERY - wiki.twilightsignal.com - LetsEncrypt on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [11:40:25] RECOVERY - wiki.thehall.xyz - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.thehall.xyz' will expire on Thu 13 Jan 2022 10:23:46 GMT +0000. [11:41:16] RECOVERY - stablestate.org - LetsEncrypt on sslhost is OK: OK - Certificate 'stablestate.org' will expire on Thu 13 Jan 2022 10:04:03 GMT +0000. [11:41:21] RECOVERY - pubwiki.lab.co.pl - LetsEncrypt on sslhost is OK: OK - Certificate 'pubwiki.lab.co.pl' will expire on Thu 13 Jan 2022 10:14:58 GMT +0000. [11:41:28] RECOVERY - wiki.sdbx.dev - LetsEncrypt on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Wed 09 Nov 2022 23:59:59 GMT +0000. [11:41:50] RECOVERY - programming.red - LetsEncrypt on sslhost is OK: OK - Certificate 'programming.red' will expire on Thu 13 Jan 2022 10:11:18 GMT +0000. [11:42:03] RECOVERY - wiki.teessidehackspace.org.uk - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.teessidehackspace.org.uk' will expire on Thu 13 Jan 2022 10:08:19 GMT +0000. [11:43:01] RECOVERY - madzebrascience.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'madzebrascience.wiki' will expire on Thu 13 Jan 2022 10:16:15 GMT +0000. [11:43:13] RECOVERY - n64brew.dev - LetsEncrypt on sslhost is OK: OK - Certificate 'n64brew.dev' will expire on Thu 13 Jan 2022 10:26:43 GMT +0000. [11:44:02] RECOVERY - pwiki.arkcls.com - LetsEncrypt on sslhost is OK: OK - Certificate 'pwiki.arkcls.com' will expire on Thu 13 Jan 2022 10:07:00 GMT +0000. [11:44:04] RECOVERY - lg.gyaanipedia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'lg.gyaanipedia.com' will expire on Thu 13 Jan 2022 10:21:40 GMT +0000. [11:44:09] RECOVERY - munwiki.info - LetsEncrypt on sslhost is OK: OK - Certificate 'munwiki.info' will expire on Thu 13 Jan 2022 10:20:29 GMT +0000. [11:44:19] RECOVERY - wiki.funkey-project.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.funkey-project.com' will expire on Thu 13 Jan 2022 10:22:15 GMT +0000. [13:27:25] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.06, 3.43, 3.17 [13:27:44] PROBLEM - cloud5 Current Load on cloud5 is WARNING: WARNING - load average: 21.82, 20.80, 19.39 [13:32:50] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.62, 3.06, 3.10 [13:35:52] RECOVERY - cloud5 Current Load on cloud5 is OK: OK - load average: 18.35, 20.23, 19.85 [13:38:11] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.27, 7.62, 5.62 [13:40:53] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 3.87, 5.77, 5.21 [13:41:59] PROBLEM - cloud5 Current Load on cloud5 is WARNING: WARNING - load average: 20.74, 20.87, 20.24 [13:44:42] RECOVERY - cloud5 Current Load on cloud5 is OK: OK - load average: 19.93, 20.14, 20.04 [13:48:52] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.10, 3.46, 3.36 [13:55:17] PROBLEM - cloud5 Current Load on cloud5 is WARNING: WARNING - load average: 23.41, 22.01, 21.01 [13:59:41] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.74, 3.15, 3.29 [14:00:48] PROBLEM - cloud5 Current Load on cloud5 is CRITICAL: CRITICAL - load average: 32.13, 23.80, 21.76 [14:03:26] PROBLEM - cloud5 Current Load on cloud5 is WARNING: WARNING - load average: 22.05, 22.63, 21.61 [14:06:07] PROBLEM - cloud5 Current Load on cloud5 is CRITICAL: CRITICAL - load average: 24.78, 22.54, 21.65 [14:06:16] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 9.35, 6.82, 5.77 [14:08:50] PROBLEM - cloud5 Current Load on cloud5 is WARNING: WARNING - load average: 20.05, 22.02, 21.64 [14:09:02] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.32, 7.43, 6.25 [14:11:48] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 4.15, 6.07, 5.93 [14:14:11] PROBLEM - cloud5 Current Load on cloud5 is CRITICAL: CRITICAL - load average: 24.54, 23.25, 22.28 [14:16:54] PROBLEM - cloud5 Current Load on cloud5 is WARNING: WARNING - load average: 22.09, 22.31, 22.05 [14:27:23] PROBLEM - cloud5 Current Load on cloud5 is CRITICAL: CRITICAL - load average: 25.46, 22.35, 21.91 [14:30:01] PROBLEM - cloud5 Current Load on cloud5 is WARNING: WARNING - load average: 20.07, 21.78, 21.79 [14:35:29] PROBLEM - cloud5 Current Load on cloud5 is CRITICAL: CRITICAL - load average: 36.97, 25.51, 22.97 [14:38:16] PROBLEM - cloud5 Current Load on cloud5 is WARNING: WARNING - load average: 21.02, 24.00, 22.87 [14:38:18] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.36, 7.91, 6.79 [14:40:59] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 3.97, 6.19, 6.31 [14:48:41] RECOVERY - cloud5 Current Load on cloud5 is OK: OK - load average: 16.59, 18.01, 20.32 [15:07:21] PROBLEM - cloud5 Current Load on cloud5 is WARNING: WARNING - load average: 21.81, 22.25, 20.78 [15:15:08] PROBLEM - cloud5 Current Load on cloud5 is CRITICAL: CRITICAL - load average: 24.97, 21.72, 20.81 [15:15:14] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JKWPI [15:15:15] [02miraheze/mw-config] 07Reception123 036c7a3b3 - add Agent to staffwiki access [15:15:21] PROBLEM - gluster4 Current Load on gluster4 is CRITICAL: CRITICAL - load average: 9.93, 6.83, 5.58 [15:15:46] Reception123: https://github.com/miraheze/mw-config/compare/68063f8acfce...6c7a3b3e892c [15:15:51] that's broken [15:15:52] [url] Comparing 68063f8acfce...6c7a3b3e892c · miraheze/mw-config · GitHub | github.com [15:16:25] miraheze/mw-config - Reception123 the build passed. [15:16:48] RhinosF1: whoops [15:17:22] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JKWPV [15:17:24] [02miraheze/mw-config] 07Reception123 0373ce558 - fix [15:17:50] PROBLEM - cloud5 Current Load on cloud5 is WARNING: WARNING - load average: 19.91, 21.12, 20.76 [15:18:34] miraheze/mw-config - Reception123 the build passed. [15:20:54] PROBLEM - gluster4 Current Load on gluster4 is WARNING: WARNING - load average: 4.82, 5.51, 5.41 [15:23:15] RECOVERY - cloud5 Current Load on cloud5 is OK: OK - load average: 18.53, 19.93, 20.40 [15:23:40] RECOVERY - gluster4 Current Load on gluster4 is OK: OK - load average: 3.21, 4.53, 5.05 [15:29:34] PROBLEM - cloud5 Current Load on cloud5 is WARNING: WARNING - load average: 20.53, 21.13, 20.88 [15:33:05] !log [@test3] starting deploy of {'config': True} to skip [15:33:06] !log [@test3] finished deploy of {'config': True} to skip - SUCCESS in 0s [15:33:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:33:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:35:46] !log [@mw11] starting deploy of {'config': True} to all [15:35:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:36:15] !log [@mw11] finished deploy of {'config': True} to all - SUCCESS in 28s [15:36:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:45:07] PROBLEM - gluster4 Current Load on gluster4 is WARNING: WARNING - load average: 5.22, 4.98, 4.70 [15:47:49] RECOVERY - gluster4 Current Load on gluster4 is OK: OK - load average: 4.89, 5.03, 4.78 [15:54:10] PROBLEM - gluster4 Current Load on gluster4 is WARNING: WARNING - load average: 5.17, 5.38, 5.09 [15:56:49] PROBLEM - cloud5 Current Load on cloud5 is CRITICAL: CRITICAL - load average: 24.02, 21.63, 21.35 [15:59:22] PROBLEM - cloud5 Current Load on cloud5 is WARNING: WARNING - load average: 19.65, 20.60, 21.00 [15:59:52] RECOVERY - gluster4 Current Load on gluster4 is OK: OK - load average: 4.09, 5.06, 5.08 [16:02:12] PROBLEM - cloud5 Current Load on cloud5 is CRITICAL: CRITICAL - load average: 24.90, 22.67, 21.72 [16:06:31] PROBLEM - gluster4 Current Load on gluster4 is WARNING: WARNING - load average: 4.98, 5.39, 5.33 [16:08:42] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 5.06, 6.90, 6.07 [16:11:19] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 3.04, 5.64, 5.75 [16:12:01] PROBLEM - gluster4 Current Load on gluster4 is CRITICAL: CRITICAL - load average: 7.96, 6.00, 5.54 [16:12:59] PROBLEM - cloud5 Current Load on cloud5 is WARNING: WARNING - load average: 19.45, 23.64, 23.29 [16:14:39] PROBLEM - gluster4 Current Load on gluster4 is WARNING: WARNING - load average: 3.94, 4.91, 5.19 [16:17:16] RECOVERY - gluster4 Current Load on gluster4 is OK: OK - load average: 3.51, 4.64, 5.06 [16:21:51] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.38, 4.00, 3.45 [16:24:38] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.63, 3.51, 3.37 [16:27:12] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.36, 3.03, 3.20 [16:41:20] RECOVERY - Host bacula2 is UP: PING OK - Packet loss = 0%, RTA = 85.33 ms [16:41:22] PROBLEM - bacula2 Disk Space on bacula2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [16:41:22] PROBLEM - bacula2 Bacula Databases db13 on bacula2 is CRITICAL: connect to address 168.235.111.29 port 5666: Connection timed outconnect to host 168.235.111.29 port 5666: Connection timed out [16:41:22] RECOVERY - bacula2 PowerDNS Recursor on bacula2 is OK: DNS OK: 0.343 seconds response time. miraheze.org returns 167.114.2.161,2607:5300:201:3100::1d3,2607:5300:205:200::1c30,51.222.25.132 [16:41:23] RECOVERY - bacula2 Bacula Daemon on bacula2 is OK: PROCS OK: 2 processes with UID = 112 (bacula) [16:41:41] RECOVERY - bacula2 APT on bacula2 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [16:41:46] RECOVERY - bacula2 NTP time on bacula2 is OK: NTP OK: Offset 5.930662155e-05 secs [16:41:52] PROBLEM - ping6 on bacula2 is CRITICAL: PING CRITICAL - Packet loss = 100% [16:41:54] RECOVERY - ping6 on bacula2 is OK: PING OK - Packet loss = 0%, RTA = 77.15 ms [16:41:56] RECOVERY - ping4 on bacula2 is OK: PING OK - Packet loss = 0%, RTA = 79.06 ms [16:42:08] RECOVERY - bacula2 Bacula Phabricator Static on bacula2 is OK: OK: Full, 88188 files, 9.442GB, 2021-10-10 03:28:00 (5.6 days ago) [16:42:27] RECOVERY - bacula2 Puppet on bacula2 is OK: OK: Puppet is currently enabled, last run 47 seconds ago with 0 failures [16:42:39] RECOVERY - bacula2 Current Load on bacula2 is OK: OK - load average: 0.28, 0.18, 0.07 [16:42:51] RECOVERY - bacula2 Bacula Databases db13 on bacula2 is OK: OK: Full, 341882 files, 96.13GB, 2021-10-10 02:54:00 (5.6 days ago) [16:42:52] RECOVERY - bacula2 Disk Space on bacula2 is OK: DISK OK - free space: / 153492 MB (11% inode=99%); [16:45:43] RECOVERY - cloud5 Current Load on cloud5 is OK: OK - load average: 19.77, 19.52, 20.34 [16:51:33] PROBLEM - cloud5 Current Load on cloud5 is WARNING: WARNING - load average: 21.17, 20.74, 20.57 [16:52:05] PROBLEM - gluster4 Current Load on gluster4 is CRITICAL: CRITICAL - load average: 7.01, 5.82, 5.08 [16:52:19] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.53, 3.09, 2.98 [16:54:05] PROBLEM - gluster4 Current Load on gluster4 is WARNING: WARNING - load average: 4.81, 5.55, 5.08 [16:54:19] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 3.12, 3.04, 2.97 [16:57:29] PROBLEM - cloud5 Current Load on cloud5 is CRITICAL: CRITICAL - load average: 24.31, 21.74, 21.03 [16:58:14] PROBLEM - gluster4 Current Load on gluster4 is CRITICAL: CRITICAL - load average: 6.50, 6.01, 5.37 [16:59:24] PROBLEM - cloud5 Current Load on cloud5 is WARNING: WARNING - load average: 22.21, 22.01, 21.23 [17:00:15] PROBLEM - gluster4 Current Load on gluster4 is WARNING: WARNING - load average: 5.03, 5.66, 5.32 [17:03:16] PROBLEM - cloud5 Current Load on cloud5 is CRITICAL: CRITICAL - load average: 24.24, 22.86, 21.72 [17:04:34] [02miraheze/puppet] 07JohnFLewis pushed 031 commit to 03JohnFLewis-patch-1 [+0/-0/±1] 13https://git.io/JKWx6 [17:04:35] [02miraheze/puppet] 07JohnFLewis 03045f09b - bacula: use new location for db backups [17:04:37] [02puppet] 07JohnFLewis created branch 03JohnFLewis-patch-1 - 13https://git.io/vbiAS [17:04:39] [02puppet] 07JohnFLewis opened pull request 03#2034: bacula: use new location for db backups - 13https://git.io/JKWxi [17:05:35] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 9.26, 7.38, 5.89 [17:06:27] PROBLEM - gluster4 Current Load on gluster4 is CRITICAL: CRITICAL - load average: 7.30, 6.06, 5.48 [17:06:37] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.62, 8.33, 6.78 [17:07:03] [02miraheze/puppet] 07JohnFLewis pushed 031 commit to 03JohnFLewis-patch-1 [+0/-0/±1] 13https://git.io/JKWxd [17:07:05] [02miraheze/puppet] 07JohnFLewis 03638a7ef - re-adjust monitoring alerts for new DB backups [17:07:06] [02puppet] 07JohnFLewis synchronize pull request 03#2034: bacula: use new location for db backups - 13https://git.io/JKWxi [17:07:34] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 5.93, 7.13, 6.01 [17:08:28] PROBLEM - gluster4 Current Load on gluster4 is WARNING: WARNING - load average: 5.27, 5.73, 5.44 [17:08:39] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 5.92, 7.23, 6.55 [17:09:42] [02puppet] 07JohnFLewis closed pull request 03#2034: bacula: use new location for db backups - 13https://git.io/JKWxi [17:09:43] [02miraheze/puppet] 07JohnFLewis pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/JKWpO [17:09:45] [02miraheze/puppet] 07JohnFLewis 039feab43 - bacula: use new location for db backups (#2034) [17:09:46] [02puppet] 07JohnFLewis deleted branch 03JohnFLewis-patch-1 - 13https://git.io/vbiAS [17:09:48] [02miraheze/puppet] 07JohnFLewis deleted branch 03JohnFLewis-patch-1 [17:11:08] PROBLEM - cloud5 Current Load on cloud5 is WARNING: WARNING - load average: 20.75, 23.74, 23.01 [17:11:34] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 5.41, 6.62, 6.09 [17:11:45] https://phabricator.miraheze.org/T5877 - took 1.5 years but we've now finally resolved our DB backup system and managed to integrate it into bacula for no cost increase as originally anticipated! [17:11:47] [url] ⚓ T5877 Revise MariaDB backup strategy | phabricator.miraheze.org [17:12:38] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 4.40, 6.19, 6.32 [17:20:26] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.55, 3.04, 2.98 [17:22:21] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.05, 2.72, 2.87 [17:22:34] PROBLEM - gluster4 Current Load on gluster4 is CRITICAL: CRITICAL - load average: 6.65, 5.45, 5.32 [17:24:34] PROBLEM - gluster4 Current Load on gluster4 is WARNING: WARNING - load average: 5.81, 5.46, 5.33 [17:34:38] PROBLEM - gluster4 Current Load on gluster4 is CRITICAL: CRITICAL - load average: 6.54, 5.50, 5.35 [17:35:07] PROBLEM - cloud5 Current Load on cloud5 is CRITICAL: CRITICAL - load average: 28.28, 23.64, 22.30 [17:36:42] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 13.82, 9.35, 6.95 [17:36:44] PROBLEM - gluster4 Current Load on gluster4 is WARNING: WARNING - load average: 5.90, 5.64, 5.43 [17:36:50] PROBLEM - mw13 Current Load on mw13 is WARNING: WARNING - load average: 7.38, 6.31, 5.71 [17:36:53] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 9.64, 7.92, 6.35 [17:38:45] RECOVERY - mw13 Current Load on mw13 is OK: OK - load average: 6.75, 6.56, 5.88 [17:38:51] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.25, 7.28, 6.30 [17:40:40] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 3.96, 6.62, 6.40 [17:40:51] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.04, 6.52, 6.15 [17:41:03] PROBLEM - cloud5 Current Load on cloud5 is WARNING: WARNING - load average: 23.26, 23.55, 22.80 [17:42:45] PROBLEM - gluster4 Current Load on gluster4 is CRITICAL: CRITICAL - load average: 6.79, 5.62, 5.42 [17:44:45] PROBLEM - gluster4 Current Load on gluster4 is WARNING: WARNING - load average: 5.77, 5.67, 5.47 [17:46:45] PROBLEM - gluster4 Current Load on gluster4 is CRITICAL: CRITICAL - load average: 6.17, 5.75, 5.52 [17:50:45] PROBLEM - gluster4 Current Load on gluster4 is WARNING: WARNING - load average: 4.75, 5.54, 5.50 [17:56:45] PROBLEM - gluster4 Current Load on gluster4 is CRITICAL: CRITICAL - load average: 6.08, 5.07, 5.22 [18:00:45] PROBLEM - gluster4 Current Load on gluster4 is WARNING: WARNING - load average: 5.85, 5.64, 5.44 [18:02:44] PROBLEM - gluster4 Current Load on gluster4 is CRITICAL: CRITICAL - load average: 6.65, 6.18, 5.67 [18:05:06] PROBLEM - cloud5 Current Load on cloud5 is CRITICAL: CRITICAL - load average: 33.01, 25.25, 23.10 [18:06:58] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 10.04, 8.80, 6.83 [18:08:57] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 5.95, 7.64, 6.63 [18:10:54] PROBLEM - gluster4 Current Load on gluster4 is WARNING: WARNING - load average: 5.79, 5.92, 5.72 [18:14:53] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 4.45, 6.21, 6.41 [18:14:56] PROBLEM - gluster4 Current Load on gluster4 is CRITICAL: CRITICAL - load average: 5.72, 6.03, 5.83 [18:16:24] [02puppet] 07Universal-Omega edited pull request 03#2027: Add landing and ErrorPages to staging - 13https://git.io/JKtV6 [18:18:57] PROBLEM - gluster4 Current Load on gluster4 is WARNING: WARNING - load average: 4.50, 5.47, 5.67 [18:19:04] PROBLEM - cloud5 Current Load on cloud5 is WARNING: WARNING - load average: 21.64, 23.08, 23.58 [18:24:22] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.95, 3.56, 3.16 [18:24:58] PROBLEM - gluster4 Current Load on gluster4 is CRITICAL: CRITICAL - load average: 6.23, 5.85, 5.73 [18:25:40] PROBLEM - wiki.nevillepedia.eu - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'wiki.nevillepedia.eu' expires in 7 day(s) (Sat 23 Oct 2021 18:21:00 GMT +0000). [18:26:59] PROBLEM - gluster4 Current Load on gluster4 is WARNING: WARNING - load average: 5.92, 5.74, 5.69 [18:28:22] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.69, 3.30, 3.16 [18:29:35] PROBLEM - cp15 Current Load on cp15 is WARNING: WARNING - load average: 1.72, 1.64, 0.98 [18:30:59] PROBLEM - gluster4 Current Load on gluster4 is CRITICAL: CRITICAL - load average: 9.16, 7.07, 6.19 [18:31:35] RECOVERY - cp15 Current Load on cp15 is OK: OK - load average: 1.38, 1.65, 1.08 [18:35:06] PROBLEM - gluster4 Current Load on gluster4 is WARNING: WARNING - load average: 4.56, 5.96, 5.96 [18:35:08] PROBLEM - cloud5 Current Load on cloud5 is CRITICAL: CRITICAL - load average: 25.03, 23.21, 23.03 [18:36:32] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.89, 3.74, 3.36 [18:37:06] PROBLEM - gluster4 Current Load on gluster4 is CRITICAL: CRITICAL - load average: 6.28, 5.98, 5.96 [18:37:49] PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 8.66, 6.34, 4.76 [18:38:20] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 13.31, 8.83, 5.56 [18:38:26] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.77, 3.40, 3.28 [18:39:01] PROBLEM - cloud5 Current Load on cloud5 is WARNING: WARNING - load average: 21.21, 22.74, 22.96 [18:41:00] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.97, 6.89, 4.92 [18:41:49] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 6.81, 7.83, 5.81 [18:44:16] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 5.73, 7.28, 6.00 [18:45:01] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.16, 6.72, 5.39 [18:45:49] RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 4.17, 6.11, 5.59 [18:47:00] PROBLEM - cloud5 Current Load on cloud5 is CRITICAL: CRITICAL - load average: 24.63, 22.70, 22.68 [18:47:13] PROBLEM - gluster4 Current Load on gluster4 is WARNING: WARNING - load average: 4.46, 5.65, 5.92 [18:49:14] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 9.07, 7.47, 6.04 [18:51:05] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.18, 7.31, 6.00 [18:51:16] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.62, 6.56, 5.87 [18:52:21] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.62, 3.80, 3.42 [18:53:01] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.98, 7.10, 6.07 [18:53:09] PROBLEM - mem2 APT on mem2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [18:54:35] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.33, 3.34, 3.32 [18:54:42] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 10.55, 9.34, 7.45 [18:54:50] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 20.49, 19.96, 18.11 [18:55:00]