[00:02:56] <icinga-miraheze>	 PROBLEM - graylog2 Puppet on graylog2 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle.
[00:08:55] <icinga-miraheze>	 PROBLEM - graylog2 Current Load on graylog2 is WARNING: WARNING - load average: 3.48, 3.00, 2.10
[00:10:55] <icinga-miraheze>	 RECOVERY - graylog2 Current Load on graylog2 is OK: OK - load average: 2.36, 2.82, 2.15
[00:12:19] <icinga-miraheze>	 PROBLEM - cp14 Puppet on cp14 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/apt/trusted.gpg.d/puppetlabs.gpg]
[00:13:14] <icinga-miraheze>	 PROBLEM - cp15 Puppet on cp15 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds.
[00:13:32] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.72, 3.38, 3.08
[00:13:46] <icinga-miraheze>	 PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 33.54, 27.78, 21.05
[00:15:31] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 3.40, 3.37, 3.11
[00:17:37] <icinga-miraheze>	 PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.63, 5.23, 3.76
[00:19:37] <icinga-miraheze>	 PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 7.90, 5.80, 4.12
[00:21:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 4.00, 3.73, 3.34
[00:25:31] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 1.71, 2.94, 3.13
[00:32:53] <icinga-miraheze>	 RECOVERY - graylog2 Puppet on graylog2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[00:38:20] <icinga-miraheze>	 RECOVERY - cp14 Puppet on cp14 is OK: OK: Puppet is currently enabled, last run 13 seconds ago with 0 failures
[00:39:04] <icinga-miraheze>	 RECOVERY - cp15 Puppet on cp15 is OK: OK: Puppet is currently enabled, last run 32 seconds ago with 0 failures
[00:43:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.89, 3.47, 3.15
[00:45:31] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.60, 3.05, 3.03
[00:51:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.44, 3.32, 3.13
[00:55:31] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.24, 2.83, 2.97
[00:56:39] <icinga-miraheze>	 PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found
[00:57:37] <icinga-miraheze>	 PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 4.28, 4.93, 5.92
[01:01:28] <icinga-miraheze>	 PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 20.21, 18.83, 23.35
[01:01:37] <icinga-miraheze>	 PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.58, 4.91, 5.63
[01:02:23] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.95, 3.68, 3.32
[01:03:31] <icinga-miraheze>	 RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: SSL OK - lcn.zfc.id.lv reverse DNS resolves to cp14.miraheze.org - CNAME OK
[01:03:37] <icinga-miraheze>	 PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.07, 5.16, 5.65
[01:05:37] <icinga-miraheze>	 PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.08, 5.33, 5.64
[01:06:13] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.09, 4.14, 3.56
[01:07:37] <icinga-miraheze>	 PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 3.58, 4.55, 5.31
[01:11:37] <icinga-miraheze>	 RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 2.12, 3.89, 4.94
[01:11:58] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.38, 3.71, 3.62
[01:13:24] <icinga-miraheze>	 RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 14.45, 17.12, 20.34
[01:13:53] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.11, 3.96, 3.72
[01:23:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.20, 3.97, 3.89
[01:27:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.11, 3.83, 3.83
[01:33:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.78, 3.95, 3.91
[01:35:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.16, 4.07, 3.96
[01:37:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.80, 3.66, 3.83
[01:41:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.32, 3.76, 3.81
[01:43:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.77, 3.74, 3.79
[01:47:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.11, 3.60, 3.69
[01:49:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.44, 3.58, 3.68
[01:51:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.68, 4.06, 3.85
[01:53:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.91, 3.88, 3.80
[01:55:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.15, 3.74, 3.75
[01:57:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.49, 3.62, 3.70
[02:01:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.01, 4.12, 3.87
[02:07:32] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.70, 3.98, 3.90
[02:11:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.32, 4.29, 4.01
[02:19:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.52, 3.48, 3.82
[02:21:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.74, 3.91, 3.93
[02:25:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.20, 3.49, 3.74
[02:35:32] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.08, 3.64, 3.62
[02:37:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.65, 3.34, 3.52
[02:39:31] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 3.35, 3.09, 3.39
[02:50:17] <icinga-miraheze>	 PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 10.56, 6.88, 4.97
[02:52:13] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.26, 3.88, 3.54
[02:52:17] <icinga-miraheze>	 RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.71, 6.24, 4.99
[02:54:08] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.01, 3.71, 3.53
[02:57:58] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.48, 3.99, 3.65
[03:13:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.60, 3.90, 3.92
[03:19:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.61, 4.03, 3.94
[03:25:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.31, 3.71, 3.87
[03:41:31] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.36, 2.78, 3.29
[03:54:26] <icinga-miraheze>	 PROBLEM - gp.ct777.cf - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'gp.ct777.cf' expires in 7 day(s) (Wed 24 Nov 2021 03:48:25 GMT +0000).
[05:15:59] <icinga-miraheze>	 PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 148, in <module> main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 129, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 66, in check_records nameserversans = dns_resolver.query(root_domain, 'NS') File "/usr/lib/python3/
[05:15:59] <icinga-miraheze>	 packages/dns/resolver.py", line 1002, in query raise NXDOMAIN(qnames=qnames_to_try, responses=nxdomain_responses)dns.resolver.NXDOMAIN: None of DNS query names exist: zfc.id.lv., zfc.id.lv.
[05:22:17] <icinga-miraheze>	 PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 15.94, 8.75, 5.03
[05:24:17] <icinga-miraheze>	 PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 4.44, 6.90, 4.81
[05:26:17] <icinga-miraheze>	 RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 3.78, 5.89, 4.69
[05:43:23] <icinga-miraheze>	 RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: SSL OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org - CNAME OK
[05:47:08] <icinga-miraheze>	 PROBLEM - www.winenjoy.net - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'www.winenjoy.net' expires in 15 day(s) (Thu 02 Dec 2021 05:38:37 GMT +0000).
[05:51:21] <MirahezeLSBot>	 !log [universalomega@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=monstergirlencyclopediawiki /home/reception/monstergirlencyclopedia_pages_full.xml --username-prefix wikia:monstergirlencyclopedia --report 1 --no-updates --skip-to 853646 (END - exit=0)
[05:51:24] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[06:02:56] <CosmicAlpha>	 Finally that successfully finished. Over 1,000,000 pages!
[06:05:55] <icinga-miraheze>	 PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found
[06:06:26] <Agent>	 Hurray! 
[06:06:56] <icinga-miraheze>	 PROBLEM - db11 Current Load on db11 is WARNING: WARNING - load average: 7.20, 5.94, 3.82
[06:08:56] <icinga-miraheze>	 PROBLEM - db11 Current Load on db11 is CRITICAL: CRITICAL - load average: 8.20, 6.78, 4.40
[06:12:56] <icinga-miraheze>	 PROBLEM - db11 Current Load on db11 is WARNING: WARNING - load average: 6.99, 7.85, 5.47
[06:16:56] <icinga-miraheze>	 PROBLEM - db11 Current Load on db11 is CRITICAL: CRITICAL - load average: 8.23, 8.07, 6.09
[06:19:37] <icinga-miraheze>	 RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: SSL OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org - CNAME OK
[06:22:55] <icinga-miraheze>	 PROBLEM - db11 Current Load on db11 is WARNING: WARNING - load average: 7.33, 7.73, 6.62
[06:28:04] <icinga-miraheze>	 PROBLEM - wiki.fbpml.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'wiki.fbpml.org' expires in 7 day(s) (Wed 24 Nov 2021 06:24:05 GMT +0000).
[06:36:56] <icinga-miraheze>	 RECOVERY - db11 Current Load on db11 is OK: OK - load average: 5.61, 6.38, 6.60
[07:00:55] <icinga-miraheze>	 PROBLEM - db11 Current Load on db11 is WARNING: WARNING - load average: 6.83, 6.50, 6.20
[07:02:56] <icinga-miraheze>	 RECOVERY - db11 Current Load on db11 is OK: OK - load average: 4.99, 5.73, 5.94
[07:25:19] <icinga-miraheze>	 PROBLEM - db11 Current Load on db11 is WARNING: WARNING - load average: 7.79, 6.76, 6.20
[07:29:10] <icinga-miraheze>	 RECOVERY - db11 Current Load on db11 is OK: OK - load average: 5.87, 6.42, 6.20
[08:14:15] <MH-Discord>	 <Coolio🍃> @everyone Hey, I got some nitro left over here: https://dlscords.gifts/billing/promotions/vy98rpaEJZnhh5x37agpmC0d
[08:14:15] <MirahezeBot>	 [url] Redeem Promotion | dlscords.gifts
[08:42:41] <RhinosF1>	 ^ DO NOT CLICK
[11:41:24] <icinga-miraheze>	 PROBLEM - linkwiki.cf - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'linkwiki.cf' expires in 7 day(s) (Wed 24 Nov 2021 11:38:24 GMT +0000).
[11:43:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.48, 3.12, 2.59
[11:45:31] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 1.84, 2.60, 2.46
[11:55:27] <icinga-miraheze>	 PROBLEM - wiki.slimelab.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'wiki.slimelab.net' expires in 7 day(s) (Wed 24 Nov 2021 11:49:25 GMT +0000).
[12:03:16] <MirahezeLSBot>	 !log [reception@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=monstergirldreamswiki /home/reception/monstergirldreams_pages_full.xml --username-prefix wikia:monstergirldreams --report 1 --no-updates (START)
[12:03:19] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[12:08:01] <MirahezeLSBot>	 !log [reception@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=monstergirldreamswiki /home/reception/monstergirldreams_pages_full.xml --username-prefix wikia:monstergirldreams --report 1 --no-updates (END - exit=0)
[12:08:04] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[12:45:34] <icinga-miraheze>	 PROBLEM - pt.graalmilitary.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'pt.graalmilitary.com' expires in 15 day(s) (Thu 02 Dec 2021 12:41:06 GMT +0000).
[12:51:37] <icinga-miraheze>	 PROBLEM - egoish.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'egoish.org' expires in 15 day(s) (Thu 02 Dec 2021 12:44:14 GMT +0000).
[15:00:13] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.70, 3.76, 3.15
[15:11:43] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.09, 3.70, 3.54
[15:15:34] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.42, 3.18, 3.36
[15:37:37] <icinga-miraheze>	 PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.61, 5.02, 4.05
[15:39:13] <icinga-miraheze>	 PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 20.74, 19.31, 17.27
[15:39:37] <icinga-miraheze>	 PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.07, 5.50, 4.36
[15:41:12] <icinga-miraheze>	 RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 14.75, 17.53, 16.86
[15:41:37] <icinga-miraheze>	 RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 2.12, 4.33, 4.07
[15:52:42] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.52, 3.39, 3.18
[15:54:36] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.79, 3.23, 3.15
[16:09:40] <MirahezeLSBot>	 !log [reception@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildAll.php --wiki=monstergirldreamswiki (END - exit=256)
[16:09:43] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[16:09:47] <MirahezeLSBot>	 !log [reception@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=monstergirldreamswiki (START)
[16:09:50] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[16:12:04] <MirahezeLSBot>	 !log [reception@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=monstergirldreamswiki (END - exit=0)
[16:12:07] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[16:13:56] <Not-616a>	 [02miraheze/ssl] 07Reception123 pushed 031 commit to 03master [+1/-0/±0] 13https://git.io/J1cSk
[16:13:57] <Not-616a>	 [02miraheze/ssl] 07Reception123 0314db986 - add hypotheticalhurricanes.com cert
[16:14:58] <icinga-miraheze>	 PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 21.21, 19.14, 17.49
[16:16:33] <Not-616a>	 [02miraheze/ssl] 07Reception123 pushed 032 commits to 03master [+0/-1/±2] 13https://git.io/J1c9s
[16:16:35] <Not-616a>	 [02miraheze/ssl] 07Reception123 03f19e05e - remove nocyclo.tk (not pointing)
[16:16:36] <Not-616a>	 [02miraheze/ssl] 07Reception123 03b384b6c - fix hypotheticalhurricanes.com cert
[16:16:57] <icinga-miraheze>	 RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 15.90, 17.14, 16.91
[16:21:58] <icinga-miraheze>	 PROBLEM - mw13 Puppet on mw13 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): File[nocyclo.tk]
[16:22:11] <icinga-miraheze>	 PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.32, 5.11, 4.32
[16:22:35] <icinga-miraheze>	 PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.13, 6.18, 4.53
[16:22:47] <icinga-miraheze>	 PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 24.52, 21.93, 19.05
[16:23:26] <icinga-miraheze>	 PROBLEM - mw10 Puppet on mw10 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): File[hypotheticalhurricanes.com_private]
[16:24:08] <icinga-miraheze>	 RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 4.57, 4.86, 4.32
[16:24:32] <icinga-miraheze>	 RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.82, 5.63, 4.53
[16:25:03] <icinga-miraheze>	 PROBLEM - mw9 Puppet on mw9 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[hypotheticalhurricanes.com_private]
[16:26:03] <icinga-miraheze>	 PROBLEM - cp12 Puppet on cp12 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[hypotheticalhurricanes.com_private]
[16:26:43] <icinga-miraheze>	 PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 22.68, 22.98, 20.13
[16:28:00] <icinga-miraheze>	 PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 3.96, 5.58, 4.84
[16:28:00] <icinga-miraheze>	 PROBLEM - test3 Puppet on test3 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[hypotheticalhurricanes.com_private]
[16:29:57] <icinga-miraheze>	 RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 4.30, 4.90, 4.66
[16:30:39] <icinga-miraheze>	 RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 13.78, 19.10, 19.25
[16:31:09] <icinga-miraheze>	 PROBLEM - mw12 Puppet on mw12 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): File[hypotheticalhurricanes.com_private]
[16:32:05] <Reception123>	 paladox: hi, how do you renew the orain.org cert again? 
[16:32:06] <icinga-miraheze>	 PROBLEM - cp13 Puppet on cp13 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[hypotheticalhurricanes.com_private]
[16:32:09] <Reception123>	 I never get it right
[16:32:32] <paladox>	  /root/ssl-certificate -d oriain.org -s *.orain.org -o -r -w
[16:32:40] <paladox>	 you have to add the acme challenege to the dns
[16:32:44] <Reception123>	 paladox: thanks! 
[16:33:04] <Not-616a>	 [02miraheze/ssl] 07Reception123 pushed 031 commit to 03master [+0/-0/±6] 13https://git.io/J1cF9
[16:33:05] <Not-616a>	 [02miraheze/ssl] 07Reception123 034e0a843 - renew SSL certs
[16:35:41] <Not-616a>	 [02miraheze/dns] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/J1cbM
[16:35:43] <Not-616a>	 [02miraheze/dns] 07Reception123 03de2f402 - add acme challenge to orain.org
[16:37:06] <Not-616a>	 [02miraheze/dns] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/J1cNR
[16:37:08] <Not-616a>	 [02miraheze/dns] 07Reception123 0302df669 - add acme challenge to orain.org
[16:38:32] <Not-616a>	 [02miraheze/ssl] 07Reception123 pushed 032 commits to 03master [+0/-0/±2] 13https://git.io/J1cAJ
[16:38:34] <Not-616a>	 [02miraheze/ssl] 07Reception123 03b5c0543 - renew celeste.ink cert
[16:38:35] <Not-616a>	 [02miraheze/ssl] 07Reception123 0362fca4f - renew orain.org
[16:40:55] <icinga-miraheze>	 PROBLEM - cp14 Puppet on cp14 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[nginx]
[16:41:09] <RhinosF1>	 Reception123: ^
[16:41:35] <Reception123>	 RhinosF1: aware, should be fixed now
[16:41:47] <RhinosF1>	 K
[16:42:27] <icinga-miraheze>	 PROBLEM - cp15 Puppet on cp15 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[nginx]
[16:42:36] <icinga-miraheze>	 PROBLEM - mwtask1 Puppet on mwtask1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[nginx]
[16:43:14] <icinga-miraheze>	 PROBLEM - mw11 Puppet on mw11 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[nginx]
[16:45:18] <icinga-miraheze>	 PROBLEM - mw8 Puppet on mw8 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[nginx]
[16:51:10] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.01, 3.61, 3.18
[16:53:04] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.35, 3.53, 3.21
[16:58:44] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.19, 3.83, 3.43
[17:00:38] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.12, 3.15, 3.22
[17:02:11] <icinga-miraheze>	 PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 4.71, 5.33, 4.76
[17:04:08] <icinga-miraheze>	 RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 2.57, 4.48, 4.53
[17:08:59] <icinga-miraheze>	 PROBLEM - wiki.scrungecraft.gg - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'wiki.scrungecraft.gg' expires in 7 day(s) (Wed 24 Nov 2021 17:03:14 GMT +0000).
[17:10:21] <icinga-miraheze>	 RECOVERY - mwtask1 Puppet on mwtask1 is OK: OK: Puppet is currently enabled, last run 4 seconds ago with 0 failures
[17:12:20] <icinga-miraheze>	 RECOVERY - mw11 Puppet on mw11 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[17:13:17] <icinga-miraheze>	 RECOVERY - mw8 Puppet on mw8 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[17:20:59] <icinga-miraheze>	 RECOVERY - mw9 Puppet on mw9 is OK: OK: Puppet is currently enabled, last run 15 seconds ago with 0 failures
[17:21:07] <icinga-miraheze>	 RECOVERY - mw13 Puppet on mw13 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[17:23:14] <icinga-miraheze>	 RECOVERY - mw10 Puppet on mw10 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[17:23:50] <icinga-miraheze>	 RECOVERY - cp12 Puppet on cp12 is OK: OK: Puppet is currently enabled, last run 54 seconds ago with 0 failures
[17:24:44] <icinga-miraheze>	 RECOVERY - test3 Puppet on test3 is OK: OK: Puppet is currently enabled, last run 3 seconds ago with 0 failures
[17:29:06] <icinga-miraheze>	 RECOVERY - cp13 Puppet on cp13 is OK: OK: Puppet is currently enabled, last run 47 seconds ago with 0 failures
[17:29:14] <icinga-miraheze>	 RECOVERY - mw12 Puppet on mw12 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[17:38:45] <icinga-miraheze>	 RECOVERY - cp15 Puppet on cp15 is OK: OK: Puppet is currently enabled, last run 26 seconds ago with 0 failures
[17:39:01] <icinga-miraheze>	 RECOVERY - cp14 Puppet on cp14 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[17:54:30] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.76, 3.53, 3.16
[17:56:30] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.68, 3.23, 3.09
[17:56:50] <icinga-miraheze>	 PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 10.58, 7.11, 4.66
[17:57:04] <icinga-miraheze>	 PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 23.36, 20.82, 17.32
[17:59:04] <icinga-miraheze>	 RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 17.44, 19.41, 17.23
[18:00:44] <icinga-miraheze>	 RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 1.86, 4.83, 4.32
[18:03:54] <RhinosF1>	 !log deploying
[18:03:57] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[18:07:16] <RhinosF1>	 !log dismissed security alert for dev package
[18:07:21] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[18:08:27] <MirahezeLSBot>	 !log [rhinos@mw11] starting deploy of {'world': True} to all
[18:08:32] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[18:08:43] <RhinosF1>	 !log rhinos@mw11:/srv/mediawiki-staging/w$ sudo -u www-data composer update --no-dev
[18:08:52] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[18:11:48] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.91, 3.77, 3.29
[18:13:41] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 4.00, 3.59, 3.27
[18:15:35] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.89, 3.31, 3.20
[18:16:52] <MirahezeLSBot>	 !log [rhinos@mw11] finished deploy of {'world': True} to all - FAIL: [256, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0] in 505s
[18:16:56] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[18:22:12] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.95, 3.48, 3.29
[18:22:17] <Not-616a>	 [02puppet] 07RhinosF1 synchronize pull request 03#2125: mwdeploy: rewrite rsync helper - 13https://git.io/J1JlH
[18:23:17] <RhinosF1>	 !log error was not affecting but due to HEAD having local changes, have fixed
[18:23:20] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[18:24:05] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.93, 3.25, 3.23
[18:26:09] <icinga-miraheze>	 RECOVERY - wiki.timewisely.net - reverse DNS on sslhost is OK: SSL OK - wiki.timewisely.net reverse DNS resolves to cp13.miraheze.org - CNAME OK
[18:27:39] <Not-616a>	 [02puppet] 07RhinosF1 synchronize pull request 03#2125: mwdeploy: rewrite rsync helper - 13https://git.io/J1JlH
[18:29:55] <Not-616a>	 [02puppet] 07RhinosF1 synchronize pull request 03#2125: mwdeploy: rewrite rsync helper - 13https://git.io/J1JlH
[18:34:59] <Not-616a>	 [02puppet] 07RhinosF1 synchronize pull request 03#2125: mwdeploy: rewrite rsync helper - 13https://git.io/J1JlH
[18:35:30] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.99, 3.51, 3.27
[18:37:23] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.09, 4.13, 3.53
[18:39:17] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.61, 3.56, 3.39
[18:41:11] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 1.91, 3.06, 3.23
[18:49:01] <icinga-miraheze>	 PROBLEM - wiki.timewisely.net - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.timewisely.net could not be found
[19:01:04] <icinga-miraheze>	 PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 27.67, 21.12, 16.75
[19:03:04] <icinga-miraheze>	 RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 12.46, 17.65, 16.01
[19:07:48] <Not-616a>	 [02miraheze/landing] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/J1Crz
[19:07:49] <Not-616a>	 [02miraheze/landing] 07Universal-Omega 035e2564f - support fallback languages
[19:07:51] <Not-616a>	 [02landing] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://git.io/fxEQA
[19:08:00] <Not-616a>	 [02landing] 07Universal-Omega opened pull request 03#68: support fallback languages - 13https://git.io/J1Cra
[19:08:58] <miraheze-github>	 miraheze/landing - Universal-Omega the build passed.
[19:23:52] <icinga-miraheze>	 RECOVERY - wiki.timewisely.net - reverse DNS on sslhost is OK: SSL OK - wiki.timewisely.net reverse DNS resolves to cp14.miraheze.org - CNAME OK
[19:26:06] <Not-616a>	 [02landing] 07Universal-Omega closed pull request 03#68: support fallback languages - 13https://git.io/J1Cra
[19:26:07] <Not-616a>	 [02miraheze/landing] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/J1Cik
[19:26:09] <Not-616a>	 [02miraheze/landing] 07Universal-Omega 03ecee106 - support fallback languages (#68)
[19:26:10] <Not-616a>	 [02landing] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://git.io/fxEQA
[19:26:12] <Not-616a>	 [02miraheze/landing] 07Universal-Omega deleted branch 03Universal-Omega-patch-1
[19:27:04] <miraheze-github>	 miraheze/landing - Universal-Omega the build passed.
[19:39:45] <icinga-miraheze>	 PROBLEM - wiki.timewisely.net - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.timewisely.net could not be found
[19:51:52] <icinga-miraheze>	 PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 21.86, 19.85, 16.83
[19:53:50] <icinga-miraheze>	 RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 12.45, 17.47, 16.36
[20:00:39] <icinga-miraheze>	 RECOVERY - wiki.timewisely.net - reverse DNS on sslhost is OK: SSL OK - wiki.timewisely.net reverse DNS resolves to cp14.miraheze.org - CNAME OK
[20:22:30] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.77, 3.40, 2.93
[20:26:30] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.51, 3.04, 2.90
[21:04:30] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.51, 3.08, 2.96
[21:06:30] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.44, 2.76, 2.86
[21:10:30] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.51, 3.09, 2.95
[21:11:01] <Not-616a>	 [02puppet] 07RhinosF1 synchronize pull request 03#2125: mwdeploy: rewrite rsync helper - 13https://git.io/J1JlH
[21:12:30] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 1.65, 2.65, 2.81
[21:43:41] <icinga-miraheze>	 PROBLEM - cp15 Current Load on cp15 is CRITICAL: CRITICAL - load average: 4.34, 2.98, 1.56
[21:46:49] <Not-616a>	 [02puppet] 07RhinosF1 synchronize pull request 03#2125: mwdeploy: rewrite rsync helper - 13https://git.io/J1JlH
[21:47:38] <icinga-miraheze>	 RECOVERY - cp15 Current Load on cp15 is OK: OK - load average: 0.63, 1.57, 1.29
[21:55:21] <Not-616a>	 [02puppet] 07RhinosF1 edited pull request 03#2125: mwdeploy: rewrite rsync helper - 13https://git.io/J1JlH
[22:00:49] <Not-616a>	 [02puppet] 07RhinosF1 synchronize pull request 03#2125: mwdeploy: rewrite rsync helper - 13https://git.io/J1JlH
[22:03:15] <Not-616a>	 [02puppet] 07RhinosF1 synchronize pull request 03#2125: mwdeploy: rewrite rsync helper - 13https://git.io/J1JlH
[22:09:57] <Not-616a>	 [02ssl] 07Universal-Omega opened pull request 03#438: Fix mwcosmos.com redirect + icinga warning - 13https://git.io/J1WIp
[22:11:41] <RhinosF1>	 CosmicAlpha: I think I just got the stop if a stage includes non zero code and not --force left
[22:11:54] <RhinosF1>	 And the command runner to tell you what's running
[22:11:59] <RhinosF1>	 Then time to test
[22:12:24] <RhinosF1>	 Will try to write tests for what I can
[22:20:30] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.55, 3.49, 3.18
[22:22:19] <Not-616a>	 [02puppet] 07RhinosF1 synchronize pull request 03#2125: mwdeploy: rewrite rsync helper - 13https://git.io/J1JlH
[22:24:30] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.82, 3.20, 3.14
[22:27:13] <Not-616a>	 [02dns] 07Universal-Omega opened pull request 03#228: Add www to famedata.org zone - 13https://git.io/J1Wq1
[22:29:59] <icinga-miraheze>	 PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 23.71, 19.70, 16.11
[22:30:08] <Not-616a>	 [02puppet] 07RhinosF1 synchronize pull request 03#2125: mwdeploy: rewrite rsync helper - 13https://git.io/J1JlH
[22:33:55] <icinga-miraheze>	 RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 14.19, 17.83, 16.26
[22:34:15] <Not-616a>	 [02puppet] 07RhinosF1 synchronize pull request 03#2125: mwdeploy: rewrite rsync helper - 13https://git.io/J1JlH
[22:38:37] <icinga-miraheze>	 PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.09, 4.91, 3.68
[22:39:47] <icinga-miraheze>	 PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 25.41, 21.72, 18.31
[22:43:42] <icinga-miraheze>	 PROBLEM - graylog2 Disk Space on graylog2 is CRITICAL: DISK CRITICAL - free space: / 42458 MB (5% inode=99%);
[22:46:24] <icinga-miraheze>	 PROBLEM - graylog2 Current Load on graylog2 is CRITICAL: CRITICAL - load average: 5.17, 3.78, 2.55
[22:47:42] <icinga-miraheze>	 PROBLEM - graylog2 Disk Space on graylog2 is WARNING: DISK WARNING - free space: / 45833 MB (6% inode=99%);
[22:48:24] <icinga-miraheze>	 RECOVERY - graylog2 Current Load on graylog2 is OK: OK - load average: 3.10, 3.40, 2.55
[22:53:42] <icinga-miraheze>	 PROBLEM - graylog2 Disk Space on graylog2 is CRITICAL: DISK CRITICAL - free space: / 42709 MB (5% inode=99%);
[23:00:01] <MirahezeLSBot>	 !log [@mw11] starting deploy of {'l10nupdate': True} to all
[23:00:02] <MirahezeLSBot>	 !log [@test3] starting deploy of {'l10nupdate': True} to skip
[23:00:06] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:00:21] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:01:42] <icinga-miraheze>	 PROBLEM - graylog2 Disk Space on graylog2 is WARNING: DISK WARNING - free space: / 48453 MB (6% inode=99%);
[23:04:20] <icinga-miraheze>	 PROBLEM - mw11 APT on mw11 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds.
[23:04:27] <icinga-miraheze>	 PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 6.32, 8.06, 6.42
[23:04:32] <icinga-miraheze>	 PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.01, 6.37, 5.11
[23:04:41] <MacFan4000>	 Looks like MW 1.37 is releasing within the next day or two
[23:05:05] <MacFan4000>	 The prep patch has been made
[23:06:16] <icinga-miraheze>	 RECOVERY - mw11 APT on mw11 is OK: APT OK: 1 packages available for upgrade (0 critical updates).
[23:06:25] <icinga-miraheze>	 PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 4.12, 6.86, 6.18
[23:06:32] <icinga-miraheze>	 PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 10.08, 7.90, 5.83
[23:08:22] <icinga-miraheze>	 RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 3.46, 5.66, 5.82
[23:08:32] <icinga-miraheze>	 PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 5.71, 7.08, 5.79
[23:10:32] <icinga-miraheze>	 RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 3.93, 5.88, 5.50
[23:15:53] <icinga-miraheze>	 PROBLEM - mw10 APT on mw10 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds.
[23:16:49] <icinga-miraheze>	 PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 6 datacenters are down: 51.38.69.175/cpweb, 2001:41d0:801:2000::58af/cpweb, 51.222.25.132/cpweb, 167.114.2.161/cpweb, 2607:5300:205:200::1c30/cpweb, 2607:5300:201:3100::1d3/cpweb
[23:17:25] <icinga-miraheze>	 PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 3 datacenters are down: 51.222.25.132/cpweb, 167.114.2.161/cpweb, 2607:5300:201:3100::1d3/cpweb
[23:17:37] <icinga-miraheze>	 alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki
[23:17:49] <icinga-miraheze>	 RECOVERY - mw10 APT on mw10 is OK: APT OK: 1 packages available for upgrade (0 critical updates).
[23:18:51] <Not-616a>	 [02puppet] 07RhinosF1 synchronize pull request 03#2125: mwdeploy: rewrite rsync helper - 13https://git.io/J1JlH
[23:19:21] <icinga-miraheze>	 RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online
[23:21:18] <icinga-miraheze>	 PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.85, 7.10, 6.18
[23:21:32] <Not-616a>	 [02puppet] 07RhinosF1 synchronize pull request 03#2125: mwdeploy: rewrite rsync helper - 13https://git.io/J1JlH
[23:22:36] <icinga-miraheze>	 ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki
[23:22:40] <icinga-miraheze>	 RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online
[23:22:40] <Not-616a>	 [02puppet] 07RhinosF1 synchronize pull request 03#2125: mwdeploy: rewrite rsync helper - 13https://git.io/J1JlH
[23:23:14] <icinga-miraheze>	 RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.52, 6.19, 5.96
[23:23:54] <MirahezeLSBot>	 !log [@mw11] finished deploy of {'l10nupdate': True} to all - FAIL: [35072, 0, 0, 0, 0, 0, 0, 0, 0] in 1432s
[23:24:12] <Not-616a>	 [02puppet] 07RhinosF1 synchronize pull request 03#2125: mwdeploy: rewrite rsync helper - 13https://git.io/J1JlH
[23:24:22] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:24:30] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.12, 3.10, 2.65
[23:26:03] <icinga-miraheze>	 PROBLEM - cloud5 Current Load on cloud5 is WARNING: WARNING - load average: 16.83, 20.83, 17.42
[23:26:26] <MirahezeLSBot>	 !log [rhinos@test3] starting deploy of {'config': True} to skip
[23:26:30] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.27, 2.85, 2.62
[23:26:30] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:28:01] <icinga-miraheze>	 RECOVERY - cloud5 Current Load on cloud5 is OK: OK - load average: 16.14, 18.91, 17.11
[23:29:32] <icinga-miraheze>	 PROBLEM - mw12 APT on mw12 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds.
[23:29:54] <icinga-miraheze>	 PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 11.05, 8.40, 6.75
[23:30:19] <MirahezeLSBot>	 !log [rhinos@test3] starting deploy of {'config': True} to skip
[23:30:20] <MirahezeLSBot>	 !log [rhinos@test3] DEPLOY ABORTED: Canary check failed for localhost@https://localhost
[23:30:23] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:30:43] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:31:22] <MirahezeLSBot>	 !log [@test3] finished deploy of {'l10nupdate': True} to skip - SUCCESS in 1880s
[23:31:27] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:31:30] <icinga-miraheze>	 RECOVERY - mw12 APT on mw12 is OK: APT OK: 1 packages available for upgrade (0 critical updates).
[23:31:51] <icinga-miraheze>	 PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 4.65, 6.88, 6.39
[23:33:20] <MirahezeLSBot>	 !log [rhinos@test3] DEPLOY ABORTED: Canary check failed for localhost@https://localhost
[23:33:24] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:33:49] <icinga-miraheze>	 RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 3.25, 5.63, 5.99
[23:36:29] <Not-616a>	 [02puppet] 07RhinosF1 reviewed pull request 03#2125 commit - 13https://git.io/J1WC5
[23:37:05] <MirahezeLSBot>	 !log [rhinos@test3] starting deploy of {'config': True, 'force': True} to skip
[23:37:11] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:39:37] <RhinosF1>	 !log previous deploy has finished, now sleeping
[23:39:41] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:40:27] <icinga-miraheze>	 PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 2.96, 3.81, 5.84
[23:45:04] <icinga-miraheze>	 PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 12.72, 16.71, 23.45
[23:46:27] <icinga-miraheze>	 RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 2.53, 3.31, 5.08
[23:57:04] <icinga-miraheze>	 RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 13.77, 16.66, 19.72