[00:02:09] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.31, 3.45, 3.17 [00:02:40] PROBLEM - savage-wiki.com - RapidSSL on sslhost is CRITICAL: CRITICAL - Certificate 'savage-wiki.com' expires in 7 day(s) (Sun 14 Nov 2021 23:59:59 GMT +0000). [00:08:04] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.37, 3.81, 3.44 [00:09:31] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 32.90, 25.78, 21.12 [00:09:40] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 7.83, 5.07, 3.85 [00:10:03] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_36 [+1/-0/±1] 13https://git.io/JXkvD [00:10:04] [02miraheze/mediawiki] 07Universal-Omega 032cece46 - Install LockAuthor [00:12:23] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_37 [+1/-0/±1] 13https://git.io/JXkTu [00:12:24] [02miraheze/mediawiki] 07Universal-Omega 0326a95cd - Install LockAuthor [00:17:55] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.98, 3.28, 3.40 [00:21:50] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.22, 3.84, 3.60 [00:23:48] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.91, 3.73, 3.57 [00:25:37] !log [universalomega@test3] starting deploy of {'world': True, 'extensionlist': True} to skip [00:25:40] !log [universalomega@mw11] starting deploy of {'world': True, 'extensionlist': True} to all [00:27:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:27:45] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 1.57, 2.68, 3.19 [00:28:21] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 6 datacenters are down: 51.38.69.175/cpweb, 54.38.211.199/cpweb, 2001:41d0:801:2000::58af/cpweb, 51.222.25.132/cpweb, 167.114.2.161/cpweb, 2607:5300:205:200::1c30/cpweb [00:28:35] PROBLEM - cp14 Stunnel Http for mw12 on cp14 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [00:28:36] PROBLEM - mw12 MediaWiki Rendering on mw12 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:28:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:29:07] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [00:30:05] !log [universalomega@test3] finished deploy of {'world': True, 'extensionlist': True} to skip - SUCCESS in 267s [00:30:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:30:20] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [00:30:30] RECOVERY - cp14 Stunnel Http for mw12 on cp14 is OK: HTTP OK: HTTP/1.1 200 OK - 15861 bytes in 0.006 second response time [00:30:34] RECOVERY - mw12 MediaWiki Rendering on mw12 is OK: HTTP OK: HTTP/1.1 200 OK - 20011 bytes in 0.254 second response time [00:31:27] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JXkro [00:31:28] [02miraheze/mw-config] 07Universal-Omega 03d7b974b - Update extension-list [00:31:30] [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://git.io/vbvb3 [00:31:48] [02mw-config] 07Universal-Omega opened pull request 03#4204: T8238: add LockAuthor - 13https://git.io/JXkoU [00:32:45] miraheze/mw-config - Universal-Omega the build passed. [00:33:20] !log [universalomega@mw11] finished deploy of {'world': True, 'extensionlist': True} to all - SUCCESS in 459s [00:33:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:34:06] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [00:37:42] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JXkSR [00:37:44] [02miraheze/mw-config] 07Universal-Omega 03ea8059f - Update ManageWikiExtensions.php [00:37:45] [02mw-config] 07Universal-Omega synchronize pull request 03#4204: T8238: add LockAuthor - 13https://git.io/JXkoU [00:38:45] miraheze/mw-config - Universal-Omega the build passed. [00:40:43] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JXk5O [00:40:45] [02miraheze/mw-config] 07Universal-Omega 03af1fb96 - Update extension-list [00:40:46] [02mw-config] 07Universal-Omega synchronize pull request 03#4204: T8238: add LockAuthor - 13https://git.io/JXkoU [00:41:50] miraheze/mw-config - Universal-Omega the build passed. [00:42:58] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 2.68, 3.97, 5.97 [00:44:45] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/JXkpf [00:44:46] [02miraheze/mw-config] 07Universal-Omega 03a233451 - T8238: add LockAuthor (#4204) [00:44:48] [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://git.io/vbvb3 [00:44:49] [02mw-config] 07Universal-Omega closed pull request 03#4204: T8238: add LockAuthor - 13https://git.io/JXkoU [00:44:51] [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [00:44:56] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 7.45, 5.12, 6.14 [00:45:39] !log [@test3] starting deploy of {'config': True} to skip [00:45:40] !log [@test3] finished deploy of {'config': True} to skip - SUCCESS in 0s [00:45:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:45:52] !log [universalomega@test3] starting deploy of {'l10n': True} to skip [00:45:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:45:54] miraheze/mw-config - Universal-Omega the build passed. [00:45:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:46:13] !log [@mw11] starting deploy of {'config': True} to all [00:46:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:46:20] !log [@mw11] finished deploy of {'config': True} to all - SUCCESS in 7s [00:46:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:47:03] !log [universalomega@mw11] starting deploy of {'l10n': True} to all [00:47:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:48:51] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 2.67, 4.43, 5.69 [00:50:48] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.20, 4.85, 5.67 [00:51:24] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.23, 4.07, 3.53 [00:51:27] !log [universalomega@test3] finished deploy of {'l10n': True} to skip - SUCCESS in 334s [00:51:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:52:45] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 4.96, 5.26, 5.76 [00:53:22] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.36, 3.82, 3.50 [00:54:43] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 7.21, 5.89, 5.92 [00:56:40] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.78, 5.59, 5.79 [00:57:19] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.42, 4.46, 3.81 [00:58:38] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.89, 6.25, 6.02 [01:00:33] !log [universalomega@mw11] finished deploy of {'l10n': True} to all - SUCCESS in 810s [01:00:35] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 4.29, 5.47, 5.76 [01:00:37] PROBLEM - cloud5 Current Load on cloud5 is CRITICAL: CRITICAL - load average: 26.27, 21.91, 18.01 [01:00:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:02:36] RECOVERY - cloud5 Current Load on cloud5 is OK: OK - load average: 14.87, 19.40, 17.59 [01:04:30] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 1.67, 3.67, 4.99 [01:05:12] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.44, 3.76, 3.83 [01:06:44] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 21.46, 19.99, 23.78 [01:12:43] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 29.76, 21.50, 22.76 [01:14:43] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 23.52, 21.73, 22.67 [01:15:04] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.85, 4.03, 3.85 [01:17:02] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.32, 3.41, 3.65 [01:20:43] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 25.12, 21.85, 22.13 [01:20:59] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.59, 3.89, 3.76 [01:22:44] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 18.53, 20.53, 21.62 [01:24:55] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.39, 3.66, 3.75 [01:26:43] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 24.43, 21.58, 21.76 [01:28:43] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 16.81, 19.98, 21.17 [01:32:43] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 12.98, 17.43, 19.94 [01:34:47] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 3.29, 3.08, 3.38 [01:47:33] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.67, 4.29, 3.73 [01:51:21] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 25.63, 19.46, 18.17 [01:51:56] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 9.18, 6.93, 4.90 [01:52:37] PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 9.66, 7.27, 5.56 [01:53:13] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.15, 5.76, 4.51 [01:53:16] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 19.59, 19.94, 18.54 [01:53:56] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.81, 6.21, 4.90 [01:54:36] RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 6.04, 6.65, 5.54 [01:55:13] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.44, 5.25, 4.48 [01:58:17] PROBLEM - db12 Disk Space on db12 is WARNING: DISK WARNING - free space: / 48937 MB (10% inode=98%); [01:59:23] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.43, 3.92, 3.97 [02:00:17] RECOVERY - db12 Disk Space on db12 is OK: DISK OK - free space: / 49721 MB (11% inode=98%); [02:07:53] PROBLEM - cp15 Current Load on cp15 is CRITICAL: CRITICAL - load average: 2.03, 1.80, 1.07 [02:09:15] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.49, 2.77, 3.36 [02:09:53] RECOVERY - cp15 Current Load on cp15 is OK: OK - load average: 1.47, 1.68, 1.12 [02:18:17] PROBLEM - db12 Disk Space on db12 is WARNING: DISK WARNING - free space: / 48922 MB (10% inode=98%); [02:29:53] PROBLEM - cp15 Current Load on cp15 is CRITICAL: CRITICAL - load average: 2.23, 2.37, 1.53 [02:31:53] PROBLEM - cp15 Current Load on cp15 is WARNING: WARNING - load average: 0.85, 1.78, 1.41 [02:33:53] RECOVERY - cp15 Current Load on cp15 is OK: OK - load average: 0.50, 1.33, 1.29 [03:30:17] PROBLEM - db12 Disk Space on db12 is CRITICAL: DISK CRITICAL - free space: / 24245 MB (5% inode=98%); [03:36:17] PROBLEM - db12 Disk Space on db12 is WARNING: DISK WARNING - free space: / 48961 MB (10% inode=98%); [03:44:17] RECOVERY - db12 Disk Space on db12 is OK: DISK OK - free space: / 51693 MB (11% inode=98%); [05:03:03] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JXY4B [05:03:05] [02miraheze/mw-config] 07Universal-Omega 03f5f3e86 - Update LocalSettings.php [05:03:06] [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://git.io/vbvb3 [05:03:25] [02mw-config] 07Universal-Omega opened pull request 03#4205: T8124: change restriction levels for lhmnwiki - 13https://git.io/JXY4x [05:04:25] miraheze/mw-config - Universal-Omega the build passed. [06:07:55] PROBLEM - db11 Current Load on db11 is CRITICAL: CRITICAL - load average: 13.19, 7.76, 4.54 [06:08:33] PROBLEM - db11 APT on db11 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [06:10:29] RECOVERY - db11 APT on db11 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [06:11:41] alerting : [FIRING:1] (!sre MediaWiki Exception Rate yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [06:11:54] PROBLEM - db11 Current Load on db11 is WARNING: WARNING - load average: 4.24, 7.18, 5.22 [06:13:54] RECOVERY - db11 Current Load on db11 is OK: OK - load average: 2.83, 5.74, 4.94 [06:16:41] ok : [RESOLVED] (!sre MediaWiki Exception Rate yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [06:55:56] PROBLEM - heavyironmodding.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'heavyironmodding.org' expires in 15 day(s) (Tue 23 Nov 2021 06:53:30 GMT +0000). [06:57:40] PROBLEM - parapedia.pl - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'parapedia.pl' expires in 15 day(s) (Tue 23 Nov 2021 06:49:10 GMT +0000). [07:52:14] PROBLEM - nl.xliving.tk - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'nl.xliving.tk' expires in 15 day(s) (Tue 23 Nov 2021 07:49:11 GMT +0000). [08:02:04] PROBLEM - www.chinatech.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.chinatech.wiki could not be found [08:56:52] [02puppet] 07RhinosF1 opened pull request 03#2113: mwdeploy: improve l10nupdate performance - 13https://git.io/JXsdf [08:57:51] [02puppet] 07RhinosF1 synchronize pull request 03#2113: mwdeploy: improve l10nupdate performance - 13https://git.io/JXsdf [08:58:44] Reception123: ^ [08:59:07] cc CosmicAlpha: the graphs show it was still shitty performance [09:17:51] RhinosF1: thanks [09:24:18] CosmicAlpha: I reopened the ta [09:24:19] Ta [09:24:21] Task [09:24:37] Because the graph says it all [09:24:50] (Please be careful closing tasks that solutions actually worked) [09:35:55] I saw. Sorry. [09:54:30] RhinosF1: thanks! [09:54:34] [02puppet] 07Reception123 closed pull request 03#2113: mwdeploy: improve l10nupdate performance - 13https://git.io/JXsdf [09:54:35] [02miraheze/puppet] 07Reception123 pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/JXGKj [09:54:37] [02miraheze/puppet] 07RhinosF1 031ab33ed - mwdeploy: improve l10nupdate performance (#2113) [09:59:32] Reception123: np [09:59:40] It will probably be really slow [09:59:49] But at least we know it's running [10:00:04] We can move it somewhere where most of us are offline if needed [10:00:22] But it shouldn't cause issues unless an l10n rebuild is needed [10:00:39] We could expose the PID for deploys which would make it easier to kill too [11:50:36] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 6.97, 6.09, 4.67 [11:52:36] RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 5.45, 5.73, 4.71 [12:53:05] 503 [12:53:20] everywhere [12:54:01] PROBLEM - mw13 Puppet on mw13 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [12:54:05] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 11.50, 10.40, 6.36 [12:54:25] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 8 datacenters are down: 51.38.69.175/cpweb, 54.38.211.199/cpweb, 2001:41d0:801:2000::58af/cpweb, 2001:41d0:800:170b::5/cpweb, 51.222.25.132/cpweb, 167.114.2.161/cpweb, 2607:5300:205:200::1c30/cpweb, 2607:5300:201:3100::1d3/cpweb [12:54:26] PROBLEM - cloud5 Current Load on cloud5 is CRITICAL: CRITICAL - load average: 48.68, 36.46, 22.68 [12:54:31] PROBLEM - cp12 Varnish Backends on cp12 is CRITICAL: 1 backends are down. mw13 [12:54:35] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 20.56, 16.33, 8.58 [12:54:36] PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 13.48, 9.57, 6.26 [12:54:37] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [12:54:38] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 23.36, 20.22, 10.50 [12:54:47] PROBLEM - cp14 Varnish Backends on cp14 is CRITICAL: 1 backends are down. mw13 [12:54:47] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 23.91, 22.94, 18.04 [12:54:48] PROBLEM - mw13 Current Load on mw13 is CRITICAL: CRITICAL - load average: 26.36, 21.75, 11.15 [12:54:58] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 1 datacenter is down: 2607:5300:201:3100::1d3/cpweb [12:55:13] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 12.15, 9.25, 5.85 [12:55:55] RECOVERY - mw13 Puppet on mw13 is OK: OK: Puppet is currently enabled, last run 6 minutes ago with 0 failures [12:56:30] RECOVERY - cp12 Varnish Backends on cp12 is OK: All 9 backends are healthy [12:56:43] RECOVERY - cp14 Varnish Backends on cp14 is OK: All 9 backends are healthy [12:56:58] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [12:57:13] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 4.07, 7.20, 5.52 [12:57:56] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 3.93, 7.70, 6.22 [12:58:20] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [12:58:43] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 14.67, 18.84, 17.51 [12:59:13] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 2.34, 5.57, 5.12 [12:59:36] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [12:59:56] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 2.86, 6.04, 5.79 [13:00:23] PROBLEM - cloud5 Current Load on cloud5 is WARNING: WARNING - load average: 15.98, 21.51, 20.29 [13:00:36] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 3.44, 7.19, 6.63 [13:02:22] RECOVERY - cloud5 Current Load on cloud5 is OK: OK - load average: 10.57, 17.80, 19.08 [13:02:24] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 2.53, 6.46, 6.86 [13:02:32] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 2.83, 6.73, 7.70 [13:02:36] RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 3.86, 6.15, 6.32 [13:03:34] I assume 503s recovered [13:04:22] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 3.34, 5.34, 6.39 [13:04:36] PROBLEM - mw13 Current Load on mw13 is WARNING: WARNING - load average: 2.78, 6.04, 7.70 [13:04:54] yes, it recovered quickly. Strange [13:06:32] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 3.29, 4.78, 6.66 [13:07:20] It was low workers [13:10:36] RECOVERY - mw13 Current Load on mw13 is OK: OK - load average: 4.38, 5.00, 6.66 [13:48:57] PROBLEM - diamowiki.ga - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'diamowiki.ga' expires in 7 day(s) (Mon 15 Nov 2021 13:48:35 GMT +0000). [13:56:22] PROBLEM - vrcdev.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'vrcdev.wiki' expires in 7 day(s) (Mon 15 Nov 2021 13:54:56 GMT +0000). [13:56:30] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.13, 3.43, 2.95 [13:58:29] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 3.35, 3.37, 2.98 [14:11:58] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.07, 5.14, 4.24 [14:13:39] Ack, every single day, I get a 503 error [14:13:58] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 3.61, 4.60, 4.16 [14:14:49] huh? isn't that your computer issue? lmao, [14:20:26] It's a recurring issue unfortunately [14:20:49] web black holes [14:53:40] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.48, 3.37, 3.08 [14:57:36] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.44, 3.13, 3.05 [15:20:36] PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 11.18, 7.55, 5.12 [15:22:11] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.03, 3.72, 3.25 [15:22:36] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 6.95, 7.02, 5.21 [15:24:36] RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 5.48, 6.57, 5.28 [15:28:06] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.59, 4.00, 3.58 [15:34:01] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.45, 3.18, 3.35 [15:39:54] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.40, 3.76, 3.53 [15:41:53] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.93, 3.54, 3.48 [15:49:46] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.25, 3.59, 3.54 [15:50:51] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.63, 5.10, 4.51 [15:54:46] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 3.02, 4.58, 4.50 [15:55:41] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.69, 3.89, 3.73 [15:59:42] RECOVERY - ping6 on ns1 is OK: PING OK - Packet loss = 0%, RTA = 111.06 ms [16:07:30] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.25, 2.91, 3.29 [16:13:24] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.95, 3.67, 3.45 [16:15:22] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.59, 3.26, 3.34 [16:18:46] dmehus: hi [16:21:15] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.42, 3.51, 3.40 [16:25:12] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.30, 2.97, 3.22 [16:25:58] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 4.92, 5.55, 4.97 [16:27:58] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 2.84, 4.77, 4.77 [16:38:59] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.48, 3.34, 3.23 [16:40:58] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.99, 3.25, 3.21 [16:41:28] hey RhinosF1 [16:42:14] dmehus: testwiki, was it as a result of specific incident [16:44:02] RhinosF1, yeah, feel free to revert the Consul protection of your user page if undesired [16:44:39] dmehus: what caused it? [16:44:49] I've been busy all weekend [16:45:09] RhinosF1, not sure exactly. Good-faith user testing on your user page [16:45:31] I didn't think it needed a warning as they self-reverted, but thought the protection, at least temporarily, might be prudent [16:47:38] Hmm [16:47:41] Seen [16:48:03] Causes no harm while I'm consul [16:55:11] yeah, SGTM [17:07:32] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.43, 3.57, 3.22 [17:09:30] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.58, 3.31, 3.17 [17:15:28] Hi CosmicAlpha [17:15:54] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://git.io/JXl6U [17:15:55] [02miraheze/mw-config] 07Universal-Omega 03b6c7bfc - Add memedatawiki to wgImportSources [17:15:57] [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-2 - 13https://git.io/vbvb3 [17:16:25] [02mw-config] 07Universal-Omega opened pull request 03#4206: Add memedatawiki to wgImportSources - 13https://git.io/JXl6z [17:17:04] [02mw-config] 07Universal-Omega commented on pull request 03#4200: Add FameData and WikiData to import - 13https://git.io/JXliI [17:17:06] [02mw-config] 07Universal-Omega closed pull request 03#4200: Add FameData and WikiData to import - 13https://git.io/JPQIo [17:17:21] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.69, 3.59, 3.31 [17:17:25] miraheze/mw-config - Universal-Omega the build passed. [17:20:18] [02mw-config] 07Universal-Omega closed pull request 03#4206: Add memedatawiki to wgImportSources - 13https://git.io/JXl6z [17:20:20] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JXlXP [17:20:21] [02miraheze/mw-config] 07Universal-Omega 03913f8a6 - Add memedatawiki to wgImportSources (#4206) [17:20:23] [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 [17:20:24] [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 - 13https://git.io/vbvb3 [17:20:58] [02mw-config] 07Universal-Omega closed pull request 03#4205: T8124: change restriction levels for lhmnwiki - 13https://git.io/JXY4x [17:21:00] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JXl1Y [17:21:01] [02miraheze/mw-config] 07Universal-Omega 03850e3c1 - T8124: change restriction levels for lhmnwiki (#4205) [17:21:03] [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://git.io/vbvb3 [17:21:04] [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [17:21:18] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.16, 3.50, 3.31 [17:21:20] miraheze/mw-config - Universal-Omega the build passed. [17:21:20] Hi RhinosF1! [17:21:59] miraheze/mw-config - Universal-Omega the build passed. [17:24:22] !log [@test3] starting deploy of {'config': True} to skip [17:24:23] !log [@test3] finished deploy of {'config': True} to skip - SUCCESS in 0s [17:24:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:24:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:25:58] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.65, 5.23, 4.56 [17:26:34] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JXlSy [17:26:35] [02miraheze/mw-config] 07Universal-Omega 03f918366 - Fix reviwiki configs [17:26:37] [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://git.io/vbvb3 [17:26:38] [02mw-config] 07Universal-Omega opened pull request 03#4207: Fix reviwiki configs - 13https://git.io/JXlS7 [17:27:37] miraheze/mw-config - Universal-Omega the build passed. [17:27:58] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 3.48, 4.50, 4.37 [17:28:34] [02mw-config] 07Universal-Omega closed pull request 03#4207: Fix reviwiki configs - 13https://git.io/JXlS7 [17:28:36] [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [17:28:37] [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://git.io/vbvb3 [17:28:39] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JXlHu [17:28:40] [02miraheze/mw-config] 07Universal-Omega 0378040c2 - Fix reviwiki configs (#4207) [17:29:11] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.18, 3.78, 3.60 [17:29:38] miraheze/mw-config - Universal-Omega the build passed. [17:30:05] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 22.22, 20.30, 18.63 [17:31:10] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.32, 3.77, 3.60 [17:32:00] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 13.87, 17.94, 17.98 [17:33:08] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.92, 3.34, 3.46 [17:37:05] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.28, 3.16, 3.40 [17:42:05] !log [@mw11] starting deploy of {'config': True} to all [17:42:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:42:44] !log [@mw11] finished deploy of {'config': True} to all - SUCCESS in 39s [17:42:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:44:43] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.28, 5.27, 4.65 [17:46:40] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.97, 5.63, 4.84 [17:48:38] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 3.27, 4.80, 4.64 [17:54:23] !log [@test3] starting deploy of {'config': True} to skip [17:54:25] !log [@test3] finished deploy of {'config': True} to skip - SUCCESS in 0s [17:54:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:54:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:25:20] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.95, 3.55, 3.22 [18:27:18] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.39, 3.18, 3.12 [18:35:09] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.70, 3.51, 3.30 [18:41:04] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.09, 3.63, 3.39 [18:43:28] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 10.15, 7.38, 5.80 [18:45:00] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.73, 3.98, 3.61 [18:45:25] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 5.59, 6.39, 5.62 [18:50:40] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 13.76, 8.64, 6.24 [18:50:43] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 28.76, 22.42, 18.55 [18:50:55] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.22, 3.78, 3.57 [18:52:44] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 18.18, 20.83, 18.46 [18:54:31] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 5.54, 7.66, 6.44 [18:54:43] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 16.18, 19.49, 18.27 [18:54:52] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.69, 3.96, 3.71 [18:56:27] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 3.51, 6.39, 6.13 [19:02:45] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 1.76, 2.75, 3.25 [19:06:40] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.52, 3.39, 3.41 [19:08:38] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.57, 3.86, 3.58 [19:10:37] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.38, 3.69, 3.55 [19:26:29] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.05, 3.96, 3.66 [19:28:29] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.56, 3.51, 3.51 [19:30:29] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.66, 3.22, 3.40 [19:30:43] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.36, 5.08, 4.30 [19:31:15] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 22.06, 19.44, 17.85 [19:32:40] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.55, 5.53, 4.55 [19:33:11] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 20.15, 19.19, 17.92 [19:36:35] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 3.60, 5.12, 4.69 [19:38:33] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.33, 5.32, 4.79 [19:40:30] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 4.09, 4.69, 4.62 [19:44:23] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 8.57, 6.78, 5.48 [19:46:20] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 4.31, 5.77, 5.27 [19:50:15] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 7.47, 6.23, 5.54 [19:50:55] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JX8NO [19:50:56] [02miraheze/CreateWiki] 07Universal-Omega 03214b9ac - Also email bureaucrats on closure if already inactive [19:51:25] PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 8.79, 6.53, 5.48 [19:51:31] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 32.14, 23.87, 20.28 [19:51:54] PROBLEM - gluster4 Current Load on gluster4 is WARNING: WARNING - load average: 5.33, 4.07, 3.14 [19:53:19] RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 5.60, 6.29, 5.52 [19:53:27] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 18.97, 22.09, 20.09 [19:53:54] RECOVERY - gluster4 Current Load on gluster4 is OK: OK - load average: 4.24, 3.90, 3.18 [19:54:04] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JX8AZ [19:54:06] [02miraheze/CreateWiki] 07Universal-Omega 03cc781d3 - Support HTML for closure emails [19:56:08] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 4.33, 5.74, 5.65 [19:57:17] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 18.41, 19.86, 19.58 [19:58:06] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.44, 6.01, 5.76 [19:59:58] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JX8pL [20:00:00] [02miraheze/MirahezeMagic] 07Universal-Omega 0314e3cff - miraheze-close-email-body: link to the Dormancy Policy [20:00:03] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 4.50, 5.36, 5.54 [20:00:55] miraheze/MirahezeMagic - Universal-Omega the build passed. [20:02:05] miraheze/CreateWiki - Universal-Omega the build passed. [20:05:58] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 8.21, 5.89, 5.58 [20:07:09] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.58, 3.68, 3.27 [20:09:58] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 4.87, 5.80, 5.68 [20:13:04] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.03, 3.73, 3.49 [20:15:02] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.64, 3.40, 3.40 [20:17:58] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 3.34, 4.26, 4.98 [20:27:47] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.84, 4.02, 3.59 [20:27:58] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.41, 5.02, 4.97 [20:29:58] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.26, 5.32, 5.08 [20:31:43] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.88, 3.80, 3.63 [20:31:58] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.01, 5.26, 5.09 [20:33:58] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 5.05, 5.00, 5.00 [20:37:58] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.44, 5.22, 5.09 [20:39:58] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.03, 5.48, 5.20 [20:41:58] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.80, 5.73, 5.33 [20:45:31] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.08, 3.01, 3.40 [20:45:58] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.75, 5.98, 5.49 [20:47:58] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 3.44, 5.16, 5.26 [20:51:25] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.50, 4.12, 3.70 [20:53:58] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 2.62, 3.96, 4.76 [20:57:20] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.00, 3.65, 3.67 [20:59:18] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.07, 3.90, 3.77 [21:01:16] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.35, 3.44, 3.62 [21:01:58] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.85, 5.15, 4.95 [21:03:58] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 4.06, 4.60, 4.77 [21:13:06] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.90, 3.07, 3.38 [21:20:04] [02puppet] 07Universal-Omega opened pull request 03#2114: deploy-mediawiki: add `--pull` argument - 13https://git.io/JX4W1 [21:20:43] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.77, 6.44, 5.57 [21:21:06] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 33.61, 26.66, 21.34 [21:21:25] [02puppet] 07Universal-Omega synchronize pull request 03#2114: deploy-mediawiki: add `--pull` argument - 13https://git.io/JX4W1 [21:21:56] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.91, 6.08, 4.81 [21:22:36] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 7.52, 5.93, 4.79 [21:22:40] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 4.67, 5.90, 5.48 [21:22:56] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.71, 3.27, 3.22 [21:23:20] RhinosF1: thoughts on ^? I can close it if it's not good. [21:23:31] Seen [21:23:41] Too tired to properly review code [21:23:56] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.04, 5.86, 4.90 [21:24:22] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.90, 5.62, 4.62 [21:24:34] But concept fine [21:24:37] RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 5.75, 5.95, 4.94 [21:24:38] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 8.75, 6.70, 5.80 [21:26:22] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 3.32, 4.77, 4.44 [21:30:50] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.67, 3.38, 3.33 [21:31:48] PROBLEM - graylog2 Current Load on graylog2 is CRITICAL: CRITICAL - load average: 4.80, 3.33, 2.46 [21:36:07]