[00:02:21] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.82, 3.48, 3.28 [00:03:16] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 25.88, 22.10, 19.15 [00:03:18] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 10.85, 7.01, 4.92 [00:04:21] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 3.03, 3.36, 3.26 [00:05:10] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 19.21, 21.16, 19.17 [00:08:21] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.20, 3.87, 3.51 [00:08:59] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 24.12, 22.75, 20.26 [00:10:53] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 20.36, 21.53, 20.10 [00:11:11] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 4.66, 5.87, 5.21 [00:11:34] PROBLEM - graylog2 Current Load on graylog2 is CRITICAL: CRITICAL - load average: 4.82, 3.12, 1.88 [00:12:21] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.05, 3.93, 3.66 [00:13:10] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 3.83, 5.08, 4.99 [00:13:34] RECOVERY - graylog2 Current Load on graylog2 is OK: OK - load average: 2.78, 2.87, 1.94 [00:14:42] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 28.07, 23.29, 21.01 [00:16:21] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.18, 3.01, 3.35 [00:17:05] [02puppet] 07Universal-Omega opened pull request 03#2161: Add refreshLinksPrioritized to jobQueueCollector - 13https://git.io/JDuOV [00:21:02] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [00:21:02] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 12.32, 7.86, 6.02 [00:21:38] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 6 datacenters are down: 51.195.220.68/cpweb, 2001:41d0:801:2000::1b80/cpweb, 149.56.140.43/cpweb, 149.56.141.75/cpweb, 2607:5300:201:3100::929a/cpweb, 2607:5300:201:3100::5ebc/cpweb [00:21:48] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.99, 6.51, 5.37 [00:23:38] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [00:25:05] [02puppet] 07paladox closed pull request 03#2161: Add refreshLinksPrioritized to jobQueueCollector - 13https://git.io/JDuOV [00:25:07] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JDu33 [00:25:08] [02miraheze/puppet] 07Universal-Omega 0346e6baa - Add refreshLinksPrioritized to jobQueueCollector (#2161) [00:25:39] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.33, 1.62, 1.25 [00:25:44] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.84, 7.18, 5.91 [00:27:42] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 9.52, 7.92, 6.33 [00:29:39] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.99, 1.52, 1.31 [00:30:10] PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 8.65, 7.24, 6.13 [00:30:16] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.91, 6.49, 5.52 [00:31:01] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.87, 3.78, 3.53 [00:31:39] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.07, 7.85, 6.70 [00:32:16] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.26, 7.21, 5.91 [00:32:19] PROBLEM - graylog2 Current Load on graylog2 is WARNING: WARNING - load average: 3.55, 2.97, 2.43 [00:34:02] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 6.71, 7.97, 6.75 [00:34:16] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.32, 7.07, 6.04 [00:34:17] RECOVERY - graylog2 Current Load on graylog2 is OK: OK - load average: 3.03, 2.91, 2.47 [00:35:34] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.34, 6.35, 6.34 [00:35:58] PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 9.64, 8.29, 6.99 [00:36:16] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 6.31, 6.75, 6.04 [00:36:53] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.10, 3.78, 3.58 [00:37:56] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 7.63, 7.83, 6.97 [00:38:50] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 1.74, 3.19, 3.40 [00:41:02] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [00:41:47] RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 6.57, 6.79, 6.71 [00:42:41] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.78, 3.31, 3.42 [00:44:38] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.67, 3.12, 3.34 [00:45:32] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [00:51:23] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 6.12, 4.01, 3.59 [00:51:28] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 6.98, 7.39, 6.96 [00:53:20] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.42, 3.76, 3.55 [00:53:24] RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 5.06, 6.57, 6.71 [00:55:32] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [00:56:32] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:00:36] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 19.70, 21.27, 23.65 [01:00:53] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 3.60, 4.94, 5.90 [01:01:08] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.40, 2.98, 3.30 [01:01:32] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:06:53] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 3.65, 3.71, 4.98 [01:07:53] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.66, 3.44, 3.42 [01:11:49] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 3.22, 3.27, 3.33 [01:16:36] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 14.93, 18.56, 20.36 [01:17:37] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.70, 3.66, 3.46 [01:20:36] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 21.00, 20.63, 20.79 [01:21:31] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 3.21, 3.35, 3.37 [01:22:36] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 17.48, 19.21, 20.23 [01:26:02] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:27:22] PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 8.33, 7.17, 6.32 [01:27:32] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.30, 7.81, 6.24 [01:29:20] RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 4.80, 6.32, 6.11 [01:29:29] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.77, 6.62, 5.99 [01:31:02] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:31:30] [02miraheze/IncidentReporting] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JDuC1 [01:31:32] [02miraheze/IncidentReporting] 07Universal-Omega 036f15887 - Remove dummyProcess [01:31:33] [02IncidentReporting] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://git.io/fh5YJ [01:31:35] [02IncidentReporting] 07Universal-Omega opened pull request 03#30: Remove dummyProcess - 13https://git.io/JDuCM [01:36:59] miraheze/IncidentReporting - Universal-Omega the build passed. [01:38:02] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.17, 3.76, 3.38 [01:39:59] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.68, 3.79, 3.44 [01:41:57] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.47, 4.33, 3.67 [01:47:48] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.20, 3.76, 3.66 [01:49:32] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:49:45] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.06, 4.09, 3.79 [01:51:05] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.84, 6.60, 5.83 [01:51:08] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 20.62, 20.26, 18.73 [01:53:02] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 13.79, 18.07, 18.12 [01:53:04] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 3.81, 5.60, 5.55 [01:53:38] [02miraheze/MatomoAnalytics] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JDulh [01:53:39] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.75, 3.74, 3.75 [01:53:40] [02miraheze/MatomoAnalytics] 07Universal-Omega 0304d1ee2 - Remove dummyProcess [01:53:41] [02MatomoAnalytics] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://git.io/fN4LT [01:53:43] [02MatomoAnalytics] 07Universal-Omega opened pull request 03#66: Remove dummyProcess - 13https://git.io/JDulj [01:54:32] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:58:08] miraheze/MatomoAnalytics - Universal-Omega the build passed. [01:59:20] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 7.23, 6.32, 5.73 [02:01:20] RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 5.36, 6.21, 5.78 [02:09:15] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.38, 3.54, 3.53 [02:09:17] Lol why am I still getting missed messages emails and can still monitor the channels from Element (I can see who says what), when I'm not even connected through matrix anymore? [02:10:20] Whoops wrong channel, meant to post that in #miraheze-offtopic. [02:13:09] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.58, 3.52, 3.52 [02:16:53] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.55, 2.10, 1.39 [02:18:52] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.85, 1.99, 1.44 [02:19:00] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.36, 3.84, 3.64 [02:22:52] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.76, 1.48, 1.37 [02:30:43] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.39, 3.79, 3.86 [02:34:37] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.28, 4.07, 3.97 [02:39:13] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.76, 4.69, 3.71 [02:40:28] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.67, 3.95, 3.98 [02:41:11] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 2.65, 3.70, 3.45 [02:42:25] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.10, 4.31, 4.10 [02:47:14] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 22.16, 20.80, 18.32 [02:48:21] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.97, 3.76, 3.94 [02:48:34] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.13, 1.61, 1.20 [02:49:03] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.94, 5.03, 4.11 [02:49:08] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 29.12, 22.71, 19.24 [02:50:22] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 6.31, 4.49, 4.17 [02:50:31] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.63, 1.58, 1.23 [02:51:02] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 4.50, 4.77, 4.13 [02:51:03] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 23.69, 22.97, 19.75 [02:54:51] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 14.64, 18.85, 18.81 [03:02:21] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.91, 3.45, 3.85 [03:12:21] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 3.05, 2.93, 3.38 [03:23:09] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.98, 3.37, 3.28 [03:32:55] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.45, 3.14, 3.30 [03:36:46] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.56, 3.65, 3.49 [03:38:43] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.76, 3.31, 3.39 [03:41:32] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:46:32] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:51:21] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 6.03, 4.39, 3.66 [03:52:32] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:53:19] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.33, 3.95, 3.59 [03:57:32] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [04:05:01] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.55, 3.63, 3.51 [04:08:55] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.93, 3.62, 3.54 [04:11:53] PROBLEM - www.ambientguitar.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'ambientguitar.org' expires in 15 day(s) (Fri 31 Dec 2021 04:08:32 GMT +0000). [04:13:15] PROBLEM - ambientguitar.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'ambientguitar.org' expires in 15 day(s) (Fri 31 Dec 2021 04:08:32 GMT +0000). [04:18:40] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 3.04, 3.11, 3.35 [04:18:48] PROBLEM - wiki.timewisely.net - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.timewisely.net' expires in 15 day(s) (Fri 31 Dec 2021 04:13:14 GMT +0000). [04:19:39] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.99, 1.30, 1.03 [04:21:39] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.16, 1.28, 1.06 [04:22:31] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.30, 3.70, 3.55 [04:24:28] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.54, 3.60, 3.52 [04:26:25] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 1.66, 2.83, 3.25 [05:20:04] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 11.91, 7.08, 5.56 [05:23:19] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.61, 6.68, 5.54 [05:24:00] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.83, 7.43, 6.13 [05:24:22] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.07, 4.09, 3.38 [05:24:32] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:24:56] PROBLEM - mw13 Current Load on mw13 is CRITICAL: CRITICAL - load average: 8.50, 6.38, 5.41 [05:25:44] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 8.33, 6.90, 5.61 [05:25:58] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.24, 7.74, 6.39 [05:26:52] PROBLEM - mw13 Current Load on mw13 is WARNING: WARNING - load average: 7.15, 6.80, 5.70 [05:27:44] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 6.60, 6.78, 5.74 [05:27:53] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 6.43, 6.81, 6.14 [05:27:56] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.45, 7.21, 6.36 [05:28:48] PROBLEM - mw13 Current Load on mw13 is CRITICAL: CRITICAL - load average: 8.06, 7.22, 5.99 [05:29:49] RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 5.97, 6.28, 6.01 [05:30:44] PROBLEM - mw13 Current Load on mw13 is WARNING: WARNING - load average: 7.82, 7.32, 6.17 [05:32:21] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.26, 3.93, 3.62 [05:32:44] PROBLEM - mw13 Current Load on mw13 is CRITICAL: CRITICAL - load average: 8.50, 7.66, 6.43 [05:33:50] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.56, 6.06, 6.17 [05:34:32] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:34:44] PROBLEM - mw13 Current Load on mw13 is WARNING: WARNING - load average: 6.06, 7.06, 6.36 [05:36:21] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.45, 4.10, 3.75 [05:36:38] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.41, 6.94, 6.30 [05:38:21] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.88, 3.74, 3.67 [05:38:34] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 10.09, 7.90, 6.70 [05:40:21] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.87, 4.05, 3.78 [05:40:44] PROBLEM - mw13 Current Load on mw13 is CRITICAL: CRITICAL - load average: 9.07, 7.81, 6.86 [05:42:21] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.68, 3.89, 3.75 [05:43:32] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:44:21] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.08, 3.88, 3.76 [05:44:44] PROBLEM - mw13 Current Load on mw13 is WARNING: WARNING - load average: 7.19, 7.91, 7.16 [05:46:18] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.64, 7.64, 7.18 [05:46:21] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.83, 3.74, 3.71 [05:48:32] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:50:21] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.21, 3.56, 3.63 [05:51:16] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.99, 7.68, 7.84 [05:52:44] RECOVERY - mw13 Current Load on mw13 is OK: OK - load average: 4.81, 6.17, 6.72 [05:54:02] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 3.36, 5.45, 6.45 [05:54:21] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.70, 3.94, 3.82 [05:56:21] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.37, 4.06, 3.87 [05:58:21] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.84, 3.97, 3.86 [06:00:02] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [06:03:17] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.30, 6.83, 7.06 [06:04:21] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.30, 3.89, 3.83 [06:05:02] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [06:05:16] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.08, 6.89, 7.06 [06:07:02] PROBLEM - db11 Current Load on db11 is WARNING: WARNING - load average: 7.56, 5.87, 3.48 [06:08:21] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.60, 3.95, 3.90 [06:09:17] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.75, 7.72, 7.34 [06:09:32] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [06:11:16] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.73, 7.36, 7.26 [06:13:17] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.39, 7.56, 7.33 [06:15:04] RECOVERY - db11 Current Load on db11 is OK: OK - load average: 5.67, 6.70, 4.99 [06:15:17] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.01, 7.47, 7.34 [06:17:16] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 15.33, 10.19, 8.33 [06:18:56] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 3 datacenters are down: 198.244.148.90/cpweb, 149.56.141.75/cpweb, 2607:5300:201:3100::5ebc/cpweb [06:19:07] PROBLEM - mw11 MediaWiki Rendering on mw11 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:19:07] PROBLEM - mw13 Current Load on mw13 is WARNING: WARNING - load average: 7.86, 7.34, 6.23 [06:19:15] PROBLEM - cp30 Stunnel Http for mw11 on cp30 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [06:19:23] PROBLEM - cp20 Stunnel Http for mw11 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [06:19:27] PROBLEM - cp21 Stunnel Http for mw11 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [06:19:59] PROBLEM - cp31 Stunnel Http for mw11 on cp31 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [06:20:21] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.14, 3.56, 3.67 [06:20:55] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [06:21:03] RECOVERY - mw13 Current Load on mw13 is OK: OK - load average: 5.77, 6.78, 6.15 [06:22:08] RECOVERY - cp31 Stunnel Http for mw11 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15871 bytes in 9.572 second response time [06:22:21] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.55, 3.25, 3.54 [06:23:21] RECOVERY - mw11 MediaWiki Rendering on mw11 is OK: HTTP OK: HTTP/1.1 200 OK - 20527 bytes in 5.167 second response time [06:23:27] RECOVERY - cp20 Stunnel Http for mw11 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15879 bytes in 5.767 second response time [06:23:29] RECOVERY - cp30 Stunnel Http for mw11 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15879 bytes in 6.446 second response time [06:23:33] RECOVERY - cp21 Stunnel Http for mw11 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15871 bytes in 6.021 second response time [06:27:53] PROBLEM - mw13 Current Load on mw13 is WARNING: WARNING - load average: 7.87, 7.34, 6.57 [06:28:21] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.36, 2.83, 3.29 [06:29:16] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 5.09, 7.28, 7.97 [06:29:49] RECOVERY - mw13 Current Load on mw13 is OK: OK - load average: 5.61, 6.61, 6.39 [06:34:32] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [06:35:14] Hi, hardworking ones. Three days ago I sent an email to sre@miraheze.org according to the guide to import some content into a private wiki. When should I expect this work to be completed? (It’s not in a hurry, I’m just to confirm that this request will surely be processed) [06:35:16] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 3.92, 4.66, 6.52 [07:03:36] PROBLEM - db12 APT on db12 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [07:04:17] @shallotsodacake hi, which wiki is that for? [07:05:35] RECOVERY - db12 APT on db12 is OK: APT OK: 9 packages available for upgrade (0 critical updates). [07:05:41] !log [reception@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=thehorriblemusicandsongswikiawiki (START) [07:06:38] PROBLEM - db12 Current Load on db12 is CRITICAL: CRITICAL - load average: 10.94, 11.42, 7.25 [07:07:20] !log [reception@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=thehorriblemusicandsongswikiawiki (END - exit=256) [07:10:32] RECOVERY - db12 Current Load on db12 is OK: OK - load average: 1.40, 6.08, 6.00 [07:27:58] subcultures.miraheze.org [07:36:36] PROBLEM - sarovia.graalmilitary.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'sarovia.graalmilitary.com' expires in 7 day(s) (Thu 23 Dec 2021 07:34:12 GMT +0000). [07:37:42] @shallotsodacake Is there also a Phabricator task open? And when did you send the email? [07:37:56] PROBLEM - lakehub.ga - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'lakehub.ga' expires in 7 day(s) (Thu 23 Dec 2021 07:32:57 GMT +0000). [07:43:31] No.1. I don't know. I want to keep it private. [07:43:36] No.2. 3 days ago. [07:54:00] sysadmins can import to private wikis, you need to fill task as well [07:56:21] The task only needs the wiki url & where we can find the dump [08:05:34] ^ @shallotsodacake [08:11:03] Uh, just here? [08:16:35] Phabricator is better for us to track our tasks. It should take very little time: https://phabricator.miraheze.org/ [08:16:36] [url] Main Page | phabricator.miraheze.org [08:35:43] So if I can log in to the phabricator system, why do you think I should choose to send an email? Should I complain in the phabricator system that I cannot log in to phabricator with my password, and when I try to retrieve the password, it tells me that my email address is invalid? [08:36:22] https://cdn.discordapp.com/attachments/808001911868489748/920595121911783464/unknown.png [08:36:22] https://cdn.discordapp.com/attachments/808001911868489748/920595122519945266/unknown.png [08:36:24] @shallotsodacake since it seems complicated, I'll just do the import without a task then [08:37:17] WTF is the gamil and …… [08:39:40] import will start shortly [08:40:43] !log [reception@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=subcultureswiki --username-prefix zhwikipedia --report 1 --no-updates (START) [08:40:44] !log [reception@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=subcultureswiki --username-prefix zhwikipedia --report 1 --no-updates (END - exit=256) [08:41:09] !log [reception@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=subcultureswiki --username-prefix zhwikipedia --report 1 --no-updates /home/reception/subcultures.xml (START) [08:41:18] Sorry, I just think it Funny. 😆 [08:44:14] !log [reception@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=subcultureswiki --username-prefix zhwikipedia --report 1 --no-updates /home/reception/subcultures.xml (END - exit=0) [08:44:44] @shallotsodacake done! [08:51:55] PROBLEM - cp31 HTTP 4xx/5xx ERROR Rate on cp31 is WARNING: WARNING - NGINX Error Rate is 57% [08:52:41] PROBLEM - cp30 HTTP 4xx/5xx ERROR Rate on cp30 is WARNING: WARNING - NGINX Error Rate is 50% [08:53:55] RECOVERY - cp31 HTTP 4xx/5xx ERROR Rate on cp31 is OK: OK - NGINX Error Rate is 2% [08:54:41] RECOVERY - cp30 HTTP 4xx/5xx ERROR Rate on cp30 is OK: OK - NGINX Error Rate is 3% [09:00:00] 👍 👍 [09:22:02] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [09:27:02] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [13:20:16] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.35, 6.23, 5.09 [13:22:16] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.69, 6.01, 5.15 [13:51:55] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.84, 3.60, 3.18 [13:55:50] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 1.86, 3.02, 3.07 [14:21:02] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [14:21:20] PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 6.51, 8.14, 6.58 [14:23:20] RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 3.85, 6.69, 6.24 [14:24:00] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.40, 4.28, 3.59 [14:26:02] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [14:27:55] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.49, 3.82, 3.56 [14:33:46] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.54, 3.15, 3.37 [14:37:37] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.83, 4.00, 3.71 [14:44:02] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [14:44:46] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.25, 7.15, 5.99 [14:45:26] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.14, 4.30, 3.91 [14:46:44] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.13, 6.26, 5.79 [14:49:02] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [14:50:32] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [14:51:34] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 7.54, 6.93, 6.38 [14:51:49] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.39, 6.31, 5.46 [14:53:30] PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 8.56, 7.63, 6.71 [14:53:48] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 6.36, 6.38, 5.59 [14:54:32] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.64, 7.09, 6.37 [14:54:36] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 20.78, 19.49, 17.14 [14:55:32] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [14:56:30] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.01, 6.46, 6.24 [14:56:32] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [14:56:36] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 17.22, 19.02, 17.28 [15:01:03] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.70, 4.00, 3.98 [15:01:04] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.16, 6.84, 6.12 [15:03:04] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.25, 5.91, 5.87 [15:03:20] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 7.26, 7.62, 7.29 [15:04:57] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.57, 4.00, 3.96 [15:06:32] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [15:06:54] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.49, 3.36, 3.72 [15:10:48] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.56, 3.54, 3.68 [15:11:20] RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 3.90, 6.03, 6.79 [15:12:45] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.51, 3.23, 3.56 [15:20:33] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.31, 3.39, 3.47 [15:22:30] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.72, 3.17, 3.38 [15:26:21] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.68, 3.46, 3.45 [15:30:21] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.16, 2.98, 3.28 [15:42:32] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [15:44:01] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.10, 3.60, 3.42 [15:47:32] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [15:47:55] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.46, 3.73, 3.54 [15:49:52] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.39, 3.92, 3.62 [15:52:13] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 7.50, 7.18, 6.55 [15:53:46] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.42, 3.90, 3.70 [15:54:09] RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 5.97, 6.62, 6.41 [15:55:43] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.19, 3.98, 3.75 [15:57:40] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.04, 3.49, 3.59 [16:07:25] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.37, 3.85, 3.75 [16:11:19] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.89, 3.44, 3.61 [16:13:16] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.13, 3.66, 3.66 [16:15:59] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.37, 6.44, 5.72 [16:19:08] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.88, 3.76, 3.75 [16:19:47] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.56, 7.10, 6.21 [16:19:55] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 12.10, 8.34, 6.55 [16:21:05] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.47, 4.33, 3.95 [16:21:45] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.71, 6.56, 6.12 [16:21:53] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.21, 7.47, 6.45 [16:22:02] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [16:25:39] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.37, 7.08, 6.42 [16:27:02] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [16:29:32] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [16:29:46] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.91, 6.60, 6.43 [16:32:33] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 17.05, 10.27, 7.32 [16:34:32] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [16:35:27] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.47, 6.19, 6.44 [16:35:32] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [16:42:25] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.05, 7.44, 7.49 [16:45:32] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [16:46:27] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.95, 3.67, 3.99 [16:48:20] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.24, 5.68, 6.65 [16:50:22] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.69, 3.73, 3.90 [16:52:21] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.96, 3.80, 3.91 [16:57:20] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 7.03, 6.15, 5.78 [16:59:20] RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 4.88, 5.82, 5.72 [17:04:21] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.75, 2.76, 3.27 [17:18:32] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [17:18:53] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 8.11, 4.88, 3.58 [17:20:37] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 27.76, 22.34, 18.30 [17:22:36] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 21.06, 20.78, 18.17 [17:22:52] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.53, 3.22, 3.15 [17:22:53] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 4.06, 5.23, 4.13 [17:23:32] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [17:24:36] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 13.10, 17.66, 17.34 [17:24:53] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 1.49, 3.89, 3.77 [17:26:46] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.27, 2.90, 3.05 [17:33:31] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.89, 1.82, 1.22 [17:35:31] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.33, 1.56, 1.19 [17:38:26] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.04, 3.02, 2.89 [17:40:23] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.45, 3.13, 2.95 [17:42:21] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.89, 3.03, 2.93 [17:51:16] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.37, 6.52, 5.57 [17:51:23] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.19, 5.91, 5.38 [17:51:33] PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 8.04, 6.33, 5.54 [17:52:16] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.13, 6.54, 5.59 [17:52:21] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.25, 3.78, 3.30 [17:52:56] PROBLEM - mw13 Current Load on mw13 is CRITICAL: CRITICAL - load average: 9.19, 7.14, 5.93 [17:53:14] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.87, 7.22, 5.96 [17:53:22] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.26, 7.03, 5.87 [17:53:29] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 7.40, 6.48, 5.68 [17:54:16] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.36, 6.96, 5.84 [17:54:21] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.70, 3.70, 3.33 [17:55:25] PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 8.58, 7.54, 6.18 [17:56:16] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 8.00, 7.51, 6.19 [17:56:32] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [17:56:48] PROBLEM - mw13 Current Load on mw13 is WARNING: WARNING - load average: 6.88, 7.36, 6.32 [17:57:19] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.72, 7.61, 6.49 [17:58:21] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.91, 4.29, 3.60 [17:59:08] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.45, 7.53, 6.45 [18:00:17] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.40, 7.62, 6.50 [18:00:44] PROBLEM - mw13 Current Load on mw13 is CRITICAL: CRITICAL - load average: 13.20, 8.48, 6.89 [18:01:07] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.12, 7.60, 6.62 [18:02:16] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.85, 7.24, 6.49 [18:03:16] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 6.12, 6.79, 6.46 [18:03:20] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 6.94, 7.66, 6.91 [18:05:04] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.18, 7.42, 6.72 [18:06:44] PROBLEM - mw13 Current Load on mw13 is WARNING: WARNING - load average: 6.94, 7.88, 7.23 [18:07:17] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.89, 6.87, 6.54 [18:08:44] PROBLEM - mw13 Current Load on mw13 is CRITICAL: CRITICAL - load average: 8.45, 8.10, 7.38 [18:09:05] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 5.95, 7.01, 6.75 [18:09:16] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.06, 7.18, 6.68 [18:10:16] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 6.67, 6.62, 6.50 [18:10:21] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.66, 3.93, 3.81 [18:11:16] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.18, 7.11, 6.74 [18:12:44] PROBLEM - mw13 Current Load on mw13 is WARNING: WARNING - load average: 6.88, 7.50, 7.32 [18:13:16] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.50, 6.55, 6.58 [18:13:20]