[00:00:39] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 27.24, 19.59, 21.27 [00:02:39] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 20.15, 19.92, 21.22 [00:02:54] PROBLEM - graylog2 Puppet on graylog2 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [00:06:39] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 24.61, 21.83, 21.64 [00:08:39] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 19.22, 21.31, 21.51 [00:11:53] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.94, 3.82, 3.40 [00:12:39] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 29.65, 23.89, 22.28 [00:15:48] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 8.30, 7.15, 5.60 [00:17:50] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 3.35, 3.32, 3.33 [00:19:06] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [00:19:07] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 1 datacenter is down: 51.38.69.175/cpweb [00:21:04] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [00:21:46] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.61, 3.81, 3.56 [00:24:06] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [00:29:41] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 1.76, 2.88, 3.25 [00:32:54] RECOVERY - graylog2 Puppet on graylog2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:35:54] PROBLEM - cp15 Current Load on cp15 is CRITICAL: CRITICAL - load average: 1.19, 2.24, 1.65 [00:39:47] RECOVERY - cp15 Current Load on cp15 is OK: OK - load average: 0.72, 1.65, 1.55 [00:50:27] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.89, 4.13, 3.50 [01:02:20] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.30, 3.81, 3.76 [01:10:15] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.18, 3.58, 3.61 [01:14:13] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.27, 3.42, 3.54 [01:18:11] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.66, 3.02, 3.35 [01:22:08] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.37, 3.82, 3.57 [01:24:07] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.94, 3.78, 3.59 [01:29:48] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 2.79, 4.35, 5.95 [01:30:03] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.77, 3.19, 3.37 [01:30:39] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 11.96, 17.42, 22.75 [01:37:48] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 2.17, 3.53, 4.99 [01:38:39] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 14.88, 16.07, 20.10 [01:38:56] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.11, 3.40, 3.42 [01:40:55] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.23, 3.71, 3.53 [01:44:53] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.18, 3.72, 3.58 [01:50:53] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.82, 3.90, 3.66 [01:52:53] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.45, 3.89, 3.71 [01:54:53] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.59, 4.26, 3.87 [01:56:53] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.25, 3.55, 3.66 [02:06:53] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.42, 3.74, 3.61 [02:08:53] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.83, 3.82, 3.66 [02:12:53] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.18, 3.68, 3.61 [02:14:53] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.36, 3.53, 3.56 [02:20:53] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.13, 4.41, 3.93 [02:24:53] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.94, 3.81, 3.82 [02:34:53] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.52, 4.11, 3.90 [02:40:53] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.04, 3.75, 3.87 [02:56:53] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.77, 3.13, 3.40 [03:03:03] PROBLEM - equestripedia.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'equestripedia.org' expires in 15 day(s) (Mon 06 Dec 2021 03:00:01 GMT +0000). [03:30:31] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.16, 3.99, 3.60 [03:32:30] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.37, 3.72, 3.55 [03:38:27] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.06, 3.55, 3.48 [03:42:24] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.95, 3.38, 3.43 [03:44:23] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 3.07, 3.32, 3.40 [04:16:04] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.72, 2.80, 2.49 [04:20:01] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.87, 3.03, 2.69 [04:28:39] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 20.62, 19.39, 16.19 [04:30:39] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 13.49, 16.64, 15.55 [04:39:45] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 10.27, 7.39, 5.08 [04:40:26] PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 11.90, 8.08, 5.30 [04:40:46] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 22.63, 21.28, 17.70 [04:41:45] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.53, 6.31, 4.98 [04:42:25] RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 4.55, 6.66, 5.12 [04:42:43] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 20.38, 19.93, 17.56 [05:26:38] PROBLEM - privacywiki.xyz - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'privacywiki.xyz' expires in 7 day(s) (Sun 28 Nov 2021 05:21:11 GMT +0000). [05:35:48] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.02, 4.64, 3.83 [05:37:48] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 3.20, 3.89, 3.65 [05:43:48] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.52, 4.96, 4.18 [05:44:39] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 22.96, 20.70, 17.71 [05:46:39] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 13.62, 18.50, 17.32 [05:47:48] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 2.54, 4.25, 4.11 [05:51:48] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.92, 4.90, 4.38 [05:55:48] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 3.07, 4.54, 4.39 [06:10:02] PROBLEM - db11 Current Load on db11 is WARNING: WARNING - load average: 7.66, 6.89, 4.55 [06:16:02] RECOVERY - db11 Current Load on db11 is OK: OK - load average: 5.35, 6.64, 5.30 [06:53:36] RECOVERY - puppet3 APT on puppet3 is OK: APT OK: 4 packages available for upgrade (0 critical updates). [07:22:09] PROBLEM - db11 Current Load on db11 is WARNING: WARNING - load average: 7.68, 7.03, 6.34 [07:24:13] PROBLEM - avas.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'avas.wiki' expires in 15 day(s) (Mon 06 Dec 2021 07:20:24 GMT +0000). [07:29:22] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 20.46, 20.23, 16.82 [07:31:18] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 14.64, 18.17, 16.47 [07:32:01] PROBLEM - db11 Current Load on db11 is CRITICAL: CRITICAL - load average: 8.06, 7.09, 6.61 [07:34:02] PROBLEM - db11 Current Load on db11 is WARNING: WARNING - load average: 7.32, 7.10, 6.67 [07:42:02] PROBLEM - db11 Current Load on db11 is CRITICAL: CRITICAL - load average: 8.62, 7.52, 7.01 [07:44:02] PROBLEM - db11 Current Load on db11 is WARNING: WARNING - load average: 7.86, 7.55, 7.08 [07:46:01] PROBLEM - db11 Current Load on db11 is CRITICAL: CRITICAL - load average: 8.18, 7.80, 7.23 [07:48:02] PROBLEM - db11 Current Load on db11 is WARNING: WARNING - load average: 6.95, 7.36, 7.13 [07:50:02] PROBLEM - db11 Current Load on db11 is CRITICAL: CRITICAL - load average: 8.47, 8.11, 7.46 [07:54:02] PROBLEM - db11 Current Load on db11 is WARNING: WARNING - load average: 6.96, 7.89, 7.54 [08:02:02] RECOVERY - db11 Current Load on db11 is OK: OK - load average: 5.16, 5.87, 6.67 [08:16:49] PROBLEM - db11 Current Load on db11 is CRITICAL: CRITICAL - load average: 9.34, 7.62, 6.82 [08:18:44] PROBLEM - db11 Current Load on db11 is WARNING: WARNING - load average: 6.35, 7.12, 6.74 [08:22:35] RECOVERY - db11 Current Load on db11 is OK: OK - load average: 5.82, 6.61, 6.64 [08:33:12] PROBLEM - db11 Current Load on db11 is WARNING: WARNING - load average: 7.20, 6.75, 6.54 [08:35:07] RECOVERY - db11 Current Load on db11 is OK: OK - load average: 6.05, 6.58, 6.51 [08:39:02] PROBLEM - db11 Current Load on db11 is WARNING: WARNING - load average: 7.09, 6.84, 6.62 [08:46:43] RECOVERY - db11 Current Load on db11 is OK: OK - load average: 5.58, 6.73, 6.74 [09:11:45] !log [@mw11] starting deploy of {'config': True} to all [09:11:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:11:57] !log [@mw11] finished deploy of {'config': True} to all - SUCCESS in 12s [09:12:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:24:42] What on earth is it deploying [09:24:58] cc CosmicAlpha [09:25:16] No config master commits in 2 days [09:25:21] So surely no need to deploy [09:25:29] Uh... that's a good question... [09:26:20] CosmicAlpha: well the only other reason we've seen that is puppet having a fit doing git pull because someone has been messing in staging and left conflicts [09:26:31] So unless you've been in there [09:26:40] (I'm assuming not Reception123) [09:26:46] Then puppet is being very wrong [09:27:01] * RhinosF1 suggests running puppet to check it's not gonna get in a fit [09:27:18] Not on mw11 I haven't. (That I can think of) [09:27:42] Yeah I can't think of ever making local changes to staging in mw11. [09:27:53] Only test3. [09:28:18] CosmicAlpha: can you run puppet to ensure it's not in a split brained state [09:28:27] And that it's just a one off [09:28:28] Also config doesn't do git pull always. [09:28:41] I'm mobile right now RhinosF1 [09:28:50] Puppet pulls & then syncs [09:28:56] It's a notify thing [09:28:56] Oh. [09:28:59] I'll log in then [09:31:10] Well I'm gonna head off for tonight. [09:31:18] K [09:33:40] puppet runs clean so meh [10:22:30] PROBLEM - db11 Current Load on db11 is CRITICAL: CRITICAL - load average: 8.45, 7.07, 6.29 [10:24:26] RECOVERY - db11 Current Load on db11 is OK: OK - load average: 5.88, 6.54, 6.18 [10:33:07] PROBLEM - db11 Current Load on db11 is WARNING: WARNING - load average: 7.71, 7.07, 6.52 [10:38:53] PROBLEM - db11 Current Load on db11 is CRITICAL: CRITICAL - load average: 8.13, 7.43, 6.80 [10:42:44] PROBLEM - db11 Current Load on db11 is WARNING: WARNING - load average: 5.78, 6.97, 6.80 [10:45:20] I can run puppet [10:48:30] PROBLEM - db11 Current Load on db11 is CRITICAL: CRITICAL - load average: 8.74, 7.52, 7.06 [10:48:55] Reception123: I did it ages ago [10:49:02] And commented right under [10:49:11] Also please check mwe channel from last night [10:49:17] My ping to you [10:49:40] ah [10:50:26] PROBLEM - db11 Current Load on db11 is WARNING: WARNING - load average: 6.34, 6.94, 6.90 [10:52:21] RECOVERY - db11 Current Load on db11 is OK: OK - load average: 5.76, 6.58, 6.78 [11:10:38] PROBLEM - graylog2 Disk Space on graylog2 is WARNING: DISK WARNING - free space: / 77699 MB (10% inode=99%); [11:12:38] RECOVERY - graylog2 Disk Space on graylog2 is OK: DISK OK - free space: / 79829 MB (11% inode=99%); [12:00:15] PROBLEM - mc-wiki.failboat.fun - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'mc-wiki.failboat.fun' expires in 7 day(s) (Sun 28 Nov 2021 11:59:39 GMT +0000). [12:00:38] PROBLEM - graylog2 Disk Space on graylog2 is WARNING: DISK WARNING - free space: / 78739 MB (10% inode=99%); [12:02:38] RECOVERY - graylog2 Disk Space on graylog2 is OK: DISK OK - free space: / 79286 MB (11% inode=99%); [12:12:38] PROBLEM - graylog2 Disk Space on graylog2 is WARNING: DISK WARNING - free space: / 78663 MB (10% inode=99%); [12:16:38] RECOVERY - graylog2 Disk Space on graylog2 is OK: DISK OK - free space: / 79274 MB (11% inode=99%); [12:39:03] PROBLEM - cp15 Current Load on cp15 is CRITICAL: CRITICAL - load average: 1.42, 2.42, 1.34 [12:40:38] PROBLEM - graylog2 Disk Space on graylog2 is WARNING: DISK WARNING - free space: / 78593 MB (10% inode=99%); [12:41:03] PROBLEM - cp15 Current Load on cp15 is WARNING: WARNING - load average: 0.56, 1.77, 1.24 [12:43:03] RECOVERY - cp15 Current Load on cp15 is OK: OK - load average: 0.18, 1.23, 1.10 [12:56:53] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.81, 3.24, 2.83 [12:58:53] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 3.21, 3.16, 2.85 [13:20:30] PROBLEM - www.recyclerie-uzege.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'www.recyclerie-uzege.org' expires in 7 day(s) (Sun 28 Nov 2021 13:16:35 GMT +0000). [13:42:11] !log [@mw11] starting deploy of {'config': True} to all [13:42:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:42:33] !log [@mw11] finished deploy of {'config': True} to all - SUCCESS in 21s [13:42:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:44:10] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.19, 6.26, 4.43 [13:44:25] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 6.83, 6.65, 5.11 [13:46:10] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.32, 5.61, 4.40 [13:46:25] RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 4.81, 5.86, 5.01 [14:17:37] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.78, 7.00, 5.21 [14:19:33] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 4.59, 5.93, 5.02 [14:20:25] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 7.57, 7.49, 5.73 [14:22:08] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.60, 3.65, 3.14 [14:22:25] RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 4.53, 6.56, 5.61 [14:24:07] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.40, 3.57, 3.18 [14:26:06] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.42, 3.21, 3.10 [14:47:53] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.10, 3.64, 3.28 [14:49:52] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.37, 3.62, 3.33 [14:55:48] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 3.04, 3.38, 3.33 [15:03:43] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.52, 3.39, 3.31 [15:05:41] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 3.06, 3.32, 3.30 [15:08:01] PROBLEM - wiki.globasa.net - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.globasa.net' expires in 15 day(s) (Mon 06 Dec 2021 14:59:12 GMT +0000). [15:09:38] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.38, 3.83, 3.50 [15:09:48] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.98, 5.32, 3.82 [15:11:03] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 35.83, 23.36, 18.32 [15:11:48] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 4.36, 5.22, 3.99 [15:13:00] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 18.14, 21.33, 18.22 [15:13:36] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.55, 3.36, 3.39 [15:13:48] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 4.42, 4.76, 3.96 [15:14:56] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 14.65, 19.49, 17.95 [15:39:18] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.17, 3.70, 3.26 [15:41:17] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.93, 3.53, 3.26 [15:45:15] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.70, 3.11, 3.15 [15:52:48] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.61, 5.44, 4.69 [15:53:09] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.17, 3.58, 3.38 [15:54:42] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 2.58, 4.31, 4.36 [15:57:07] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.40, 3.31, 3.33 [16:01:04] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.21, 3.46, 3.38 [16:05:02] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.22, 3.77, 3.52 [16:07:01] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.17, 3.41, 3.44 [16:16:55] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.54, 3.24, 3.40 [16:20:53] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 6.15, 4.61, 3.89 [16:23:51] PROBLEM - wiki.newnormal.fans - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.newnormal.fans' expires in 15 day(s) (Mon 06 Dec 2021 16:16:02 GMT +0000). [16:23:56] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 12.51, 8.67, 5.74 [16:25:56] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 4.31, 6.83, 5.42 [16:27:56] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 4.45, 6.02, 5.29 [16:35:48] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.39, 5.05, 4.45 [16:37:48] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 3.65, 4.45, 4.30 [16:46:53] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.53, 3.44, 3.89 [16:50:53] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.91, 4.14, 4.07 [16:56:53] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.55, 3.89, 3.98 [16:58:54] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.28, 4.11, 4.05 [17:02:53] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.15, 3.74, 3.97 [17:03:01] [02puppet] 07JohnFLewis reviewed pull request 03#2127 commit - 13https://git.io/J1M1N [17:08:53] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.70, 3.58, 3.77 [17:10:53] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.75, 3.59, 3.75 [17:12:53] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.31, 3.84, 3.82 [17:13:08] [02puppet] 07Universal-Omega synchronize pull request 03#2127: Handle CORS preflight requests + fix `Access-Control-Allow-Origin` for api.php - 13https://git.io/J10Ko [17:13:43] [02puppet] 07Universal-Omega reviewed pull request 03#2127 commit - 13https://git.io/J1MSf [17:15:30] [02puppet] 07JohnFLewis closed pull request 03#2123: Remove services HostGroup - 13https://git.io/JXhXq [17:15:32] [02miraheze/puppet] 07JohnFLewis pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/J1MSw [17:15:33] [02miraheze/puppet] 07Universal-Omega 03d705ec9 - Remove services HostGroup (#2123) [17:15:50] [02puppet] 07JohnFLewis closed pull request 03#2124: Remove Role::Services reference - 13https://git.io/JXh1W [17:15:51] [02miraheze/puppet] 07JohnFLewis pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/J1MS6 [17:15:53] [02miraheze/puppet] 07Universal-Omega 03aa997ef - Remove Role::Services reference (#2124) [17:16:49] [02miraheze/puppet] 07JohnFLewis pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/J1M9e [17:16:50] [02miraheze/puppet] 07Universal-Omega 03a8210d0 - Handle CORS preflight requests + fix `Access-Control-Allow-Origin` for api.php (#2127) [17:16:52] [02puppet] 07JohnFLewis closed pull request 03#2127: Handle CORS preflight requests + fix `Access-Control-Allow-Origin` for api.php - 13https://git.io/J10Ko [17:23:40] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.42, 4.43, 4.16 [17:25:37] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 3.58, 4.04, 4.04 [17:28:09] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 28.01, 21.87, 19.16 [17:30:04] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 23.19, 22.06, 19.55 [17:30:15] PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 13.20, 8.25, 5.71 [17:31:49] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 148, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 129, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 66, in check_records nameserversans = dns_resolver.query(root_domain, 'NS') File "/usr/lib/python3/ [17:31:49] packages/dns/resolver.py", line 1002, in query raise NXDOMAIN(qnames=qnames_to_try, responses=nxdomain_responses)dns.resolver.NXDOMAIN: None of DNS query names exist: zfc.id.lv., zfc.id.lv. [17:32:13] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 5.77, 7.21, 5.65 [17:33:54] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 13.66, 19.02, 18.99 [17:34:11] RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 3.76, 5.94, 5.37 [17:38:30] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.62, 3.74, 3.89 [17:38:37] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: SSL OK - lcn.zfc.id.lv reverse DNS resolves to cp14.miraheze.org - CNAME OK [17:51:31] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 24.20, 21.02, 19.41 [17:53:25] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 17.42, 19.94, 19.23 [17:53:57] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.68, 5.38, 4.89 [17:54:09] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.40, 3.02, 3.39 [17:57:57] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 3.59, 4.54, 4.68 [17:58:01] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.90, 3.23, 3.43 [17:59:58] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.94, 3.04, 3.33 [18:01:07] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 19.07, 21.18, 20.04 [18:01:57] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 4.90, 5.13, 4.91 [18:02:44] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/J1Mpu [18:02:45] [02miraheze/mw-config] 07Universal-Omega 03fee190f - Set `$wgCrossSiteAJAXdomains` to loginwiki and metawiki [18:02:47] [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://git.io/vbvb3 [18:02:48] [02mw-config] 07Universal-Omega opened pull request 03#4225: Set `$wgCrossSiteAJAXdomains` to loginwiki and metawiki - 13https://git.io/J1Mpz [18:03:02] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 18.63, 20.33, 19.85 [18:03:49] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.36, 3.51, 3.43 [18:03:49] miraheze/mw-config - Universal-Omega the build passed. [18:05:46] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.68, 3.50, 3.43 [18:07:57] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 4.44, 4.95, 4.94 [18:09:40] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.78, 4.08, 3.64 [18:20:19] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 22.56, 20.65, 19.50 [18:22:15] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 18.94, 19.97, 19.39 [18:23:33] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.38, 3.91, 3.98 [18:24:52] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 4.94, 5.13, 4.92 [18:26:48] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 8.63, 6.47, 5.44 [18:31:52] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 23.12, 23.29, 20.90 [18:32:37] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 4.32, 5.74, 5.50 [18:33:19] [02puppet] 07Universal-Omega opened pull request 03#2129: Fix undefined/api.php redirect - 13https://git.io/J1DUA [18:33:33] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.43, 3.62, 3.65 [18:36:30] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.53, 5.80, 5.53 [18:37:49] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 24.89, 22.83, 21.21 [18:39:33] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.82, 3.70, 3.72 [18:39:49] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 16.75, 20.77, 20.68 [18:41:43] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/J1DIT [18:41:44] [02miraheze/mw-config] 07Universal-Omega 033164603 - Add `X-Miraheze-Debug` to `$wgAllowedCorsHeaders` [18:41:46] [02mw-config] 07Universal-Omega synchronize pull request 03#4225: Set `$wgCrossSiteAJAXdomains` to loginwiki and metawiki - 13https://git.io/J1Mpz [18:41:49] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 28.94, 23.95, 21.85 [18:42:10] [02mw-config] 07Universal-Omega edited pull request 03#4225: Set `$wgCrossSiteAJAXdomains` to loginwiki and metawiki - 13https://git.io/J1Mpz [18:42:49] miraheze/mw-config - Universal-Omega the build passed. [18:43:49] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 19.55, 22.38, 21.56 [18:46:12] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 4.78, 5.54, 5.64 [18:48:08] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 7.49, 6.74, 6.09 [18:49:33] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 1.86, 2.87, 3.37 [18:49:49] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 25.45, 21.63, 21.18 [18:53:33] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.92, 3.60, 3.58 [18:55:50] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 20.38, 23.80, 22.65 [18:55:57] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 3.56, 5.63, 5.99 [18:56:09] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/J1Dqu [18:56:11] [02miraheze/mw-config] 07Universal-Omega 03b556f66 - Update Defines.php [18:56:12] [02mw-config] 07Universal-Omega synchronize pull request 03#4225: Set `$wgCrossSiteAJAXdomains` to loginwiki and metawiki - 13https://git.io/J1Mpz [18:56:31] PROBLEM - cloud5 Current Load on cloud5 is CRITICAL: CRITICAL - load average: 25.52, 21.49, 18.28 [18:56:35] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/J1DqV [18:56:36] [02miraheze/mw-config] 07Universal-Omega 03147e5af - Update LocalSettings.php [18:56:38] [02mw-config] 07Universal-Omega synchronize pull request 03#4225: Set `$wgCrossSiteAJAXdomains` to loginwiki and metawiki - 13https://git.io/J1Mpz [18:57:19] miraheze/mw-config - Universal-Omega the build passed. [18:57:22] PROBLEM - gluster4 APT on gluster4 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [18:57:40] miraheze/mw-config - Universal-Omega the build passed. [18:58:31] PROBLEM - cloud5 Current Load on cloud5 is WARNING: WARNING - load average: 22.26, 22.56, 19.11 [18:58:57] PROBLEM - gluster4 Current Load on gluster4 is CRITICAL: CRITICAL - load average: 9.86, 10.36, 6.40 [18:59:21] RECOVERY - gluster4 APT on gluster4 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [18:59:33] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.20, 3.95, 3.66 [19:00:31] RECOVERY - cloud5 Current Load on cloud5 is OK: OK - load average: 14.83, 19.43, 18.37 [19:00:41] !log [@test3] starting deploy of {'config': True} to skip [19:00:42] !log [@test3] DEPLOY ABORTED: Canary check failed for localhost [19:00:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:00:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:01:07] PROBLEM - test3 MediaWiki Rendering on test3 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 314 bytes in 0.025 second response time [19:01:33] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.15, 3.35, 3.48 [19:03:01] PROBLEM - test3 Puppet on test3 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[MediaWiki Config Sync] [19:03:07] RECOVERY - test3 MediaWiki Rendering on test3 is OK: HTTP OK: HTTP/1.1 200 OK - 20550 bytes in 0.145 second response time [19:03:33] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.59, 3.11, 3.37 [19:03:49] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 24.87, 23.23, 22.51 [19:03:57] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.13, 5.62, 5.76 [19:04:45] PROBLEM - gluster4 Current Load on gluster4 is WARNING: WARNING - load average: 3.37, 5.26, 5.26 [19:05:49] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 23.21, 22.79, 22.41 [19:05:57] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 4.96, 5.38, 5.65 [19:06:41] RECOVERY - gluster4 Current Load on gluster4 is OK: OK - load average: 2.55, 4.32, 4.91 [19:07:57] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 9.23, 6.46, 5.99 [19:08:49] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/J1DOu [19:08:51] [02miraheze/mw-config] 07Universal-Omega 03345f22b - Set `$wgCrossSiteAJAXdomains` to loginwiki and metawiki (#4225) [19:08:52] [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://git.io/vbvb3 [19:08:54] [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [19:08:55] [02mw-config] 07Universal-Omega closed pull request 03#4225: Set `$wgCrossSiteAJAXdomains` to loginwiki and metawiki - 13https://git.io/J1Mpz [19:09:58] miraheze/mw-config - Universal-Omega the build passed. [19:10:59] !log [@mw11] starting deploy of {'config': True} to all [19:11:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:11:20] !log [@mw11] finished deploy of {'config': True} to all - SUCCESS in 20s [19:11:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:13:57] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 3.16, 5.35, 5.74 [19:17:57] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 7.55, 6.08, 5.90 [19:19:10] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.29, 3.71, 3.53 [19:20:24] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/J1DsA [19:20:26] [02miraheze/mw-config] 07Universal-Omega 0377a2086 - Set `$egLoopsCountLimit` to 200 for `constantnoblewiki` [19:20:27] [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://git.io/vbvb3 [19:20:33] [02mw-config] 07Universal-Omega opened pull request 03#4226: T8312: set `$egLoopsCountLimit` to 200 for `constantnoblewiki` - 13https://git.io/J1Dsh [19:21:08] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 6.00, 4.55, 3.86 [19:21:34] miraheze/mw-config - Universal-Omega the build passed. [19:22:00] [02mw-config] 07Universal-Omega closed pull request 03#4226: T8312: set `$egLoopsCountLimit` to 200 for `constantnoblewiki` - 13https://git.io/J1Dsh [19:22:02] [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://git.io/vbvb3 [19:22:03] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/J1DGc [19:22:05] [02miraheze/mw-config] 07Universal-Omega 0320ed3c1 - T8312: set `$egLoopsCountLimit` to 200 for `constantnoblewiki` [19:22:06] [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [19:22:13] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.88, 7.57, 5.66 [19:22:30] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.51, 6.87, 5.50 [19:23:03] miraheze/mw-config - Universal-Omega the build passed. [19:23:57] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 4.49, 5.46, 5.77 [19:24:09] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.48, 6.45, 5.48 [19:24:16] !log [@test3] starting deploy of {'config': True} to skip [19:24:17] !log [@test3] finished deploy of {'config': True} to skip - SUCCESS in 0s [19:24:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:24:30] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.52, 6.60, 5.58 [19:24:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:25:00] RECOVERY - test3 Puppet on test3 is OK: OK: Puppet is currently enabled, last run 40 seconds ago with 0 failures [19:25:57] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.17, 5.62, 5.78 [19:27:57] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.50, 5.54, 5.73 [19:28:30] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.77, 7.55, 6.20 [19:29:49] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 25.43, 21.83, 21.17 [19:30:59] PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 9.40, 8.53, 6.58 [19:31:49] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 19.87, 21.19, 21.04 [19:32:30] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.64, 6.33, 6.02 [19:32:50] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.30, 3.69, 3.91 [19:32:57] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 6.51, 7.84, 6.57 [19:33:49] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 24.39, 22.17, 21.40 [19:33:57] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.73, 5.66, 5.63 [19:35:49] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 22.58, 22.32, 21.55 [19:35:57] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.40, 5.50, 5.57 [19:36:44] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.13, 3.83, 3.90 [19:37:49] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 25.30, 22.92, 21.82 [19:37:58] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.93, 6.04, 5.76 [19:38:42] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.60, 3.75, 3.87 [19:38:50] RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 6.02, 6.66, 6.42 [19:39:49] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 17.47, 21.01, 21.27 [19:39:57] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.15, 5.66, 5.66 [19:42:36] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.40, 4.54, 4.14 [19:42:36] !log [@mw11] starting deploy of {'config': True} to all [19:42:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:42:47] !log [@mw11] finished deploy of {'config': True} to all - SUCCESS in 11s [19:42:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:43:04] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 9.61, 7.44, 6.33 [19:44:33] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.18, 4.00, 3.99 [19:45:03] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 5.74, 6.80, 6.24 [19:45:57] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.64, 5.67, 5.63 [19:47:05] [02puppet] 07Universal-Omega opened pull request 03#2130: CSP: add db.onlinewebfonts.com to `font-src` - 13https://git.io/J1DWh [19:47:49] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 19.98, 19.16, 20.28 [19:50:24] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.30, 3.65, 3.77 [19:51:49] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 36.11, 28.45, 23.88 [19:52:21] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.33, 3.61, 3.75 [19:54:18] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.51, 3.92, 3.84 [19:59:23] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 5.92, 7.37, 6.55 [19:59:49] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 18.84, 23.16, 23.52 [20:01:21] RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 3.93, 6.22, 6.23 [20:01:57] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 3.52, 4.72, 5.82 [20:05:57] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 7.00, 5.43, 5.82 [20:06:00] [02puppet] 07Universal-Omega synchronize pull request 03#2129: Fix undefined/api.php redirect - 13https://git.io/J1DUA [20:07:32] [02puppet] 07Universal-Omega synchronize pull request 03#2129: Fix undefined/api.php redirect - 13https://git.io/J1DUA [20:07:57] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.82, 5.85, 5.95 [20:15:48] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.82, 3.43, 3.82 [20:15:57] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.74, 5.62, 5.73 [20:19:11] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/J1DEh [20:19:12] [02miraheze/puppet] 07Universal-Omega 039fb5134 - Fix undefined/api.php redirect (#2129) [20:19:14] [02puppet] 07paladox closed pull request 03#2129: Fix undefined/api.php redirect - 13https://git.io/J1DUA [20:19:50] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 32.64, 24.60, 22.79 [20:26:24] PROBLEM - ping4 on jobchron1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 114.10 ms [20:27:49] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 19.10, 23.79, 23.38 [20:28:24] RECOVERY - ping4 on jobchron1 is OK: PING OK - Packet loss = 0%, RTA = 8.97 ms [20:29:49] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 26.49, 24.12, 23.50 [20:29:57] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.65, 5.77, 6.00 [20:31:33] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.48, 3.10, 3.39 [20:31:49] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 21.91, 23.67, 23.43 [20:37:57] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.31, 5.43, 5.62 [20:39:57] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.75, 5.62, 5.67 [20:43:49] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 24.63, 21.23, 21.65 [20:43:57]