[00:02:36] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 37.75, 24.84, 17.70 [00:02:53] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 10.20, 6.02, 3.53 [00:03:02] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [00:07:16] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 8.29, 4.80, 3.79 [00:07:55] !log [universalomega@mw11] finished deploy of {'world': True, 'l10n': True} to all - SUCCESS in 1331s [00:07:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:08:02] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [00:10:23] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.10, 1.71, 1.34 [00:11:32] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [00:12:20] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.59, 1.27, 1.22 [00:13:07] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.05, 3.48, 3.56 [00:14:13] [02landing] 07Universal-Omega closed pull request 03#72: Support whitespace alongside pipes for links - 13https://git.io/JDwp3 [00:14:15] [02miraheze/landing] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JD67W [00:14:16] [02miraheze/landing] 07Universal-Omega 0372a0968 - Suport whitespace alongside pipes for links (#72) [00:14:18] [02landing] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://git.io/fxEQA [00:14:19] [02miraheze/landing] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [00:15:16] miraheze/landing - Universal-Omega the build passed. [00:15:30] [02miraheze/ErrorPages] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JD67z [00:15:32] [02miraheze/ErrorPages] 07Universal-Omega 0303e33f1 - Support whitespace alongside pipes for links [00:16:27] miraheze/ErrorPages - Universal-Omega the build passed. [00:16:32] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [00:20:32] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [00:20:55] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.66, 4.33, 3.86 [00:22:52] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.89, 3.97, 3.77 [00:23:04] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.01, 6.82, 5.45 [00:25:09] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 9.23, 6.78, 5.53 [00:25:32] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [00:27:04] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 3.72, 5.57, 5.28 [00:27:07] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.42, 6.27, 5.50 [00:32:38] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.36, 2.96, 3.37 [00:52:21] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.53, 3.63, 3.23 [00:54:21] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.44, 3.37, 3.17 [00:56:21] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 3.02, 3.34, 3.19 [01:04:36] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 17.61, 19.24, 23.68 [01:04:53] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 4.16, 4.66, 5.92 [01:08:53] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 1.50, 3.04, 4.97 [01:11:13] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.20, 3.66, 3.41 [01:13:09] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.43, 3.69, 3.46 [01:14:36] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 15.40, 16.69, 20.11 [01:15:06] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.26, 3.76, 3.50 [01:17:04] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.70, 3.85, 3.57 [01:20:32] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:20:58] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 6.33, 4.77, 3.98 [01:21:33] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.84, 6.59, 4.98 [01:22:44] PROBLEM - mw13 Current Load on mw13 is CRITICAL: CRITICAL - load average: 9.21, 7.31, 5.79 [01:23:16] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.20, 6.79, 5.51 [01:23:31] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.71, 6.28, 5.07 [01:24:52] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.36, 3.82, 3.75 [01:25:16] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.95, 6.65, 5.63 [01:28:44] PROBLEM - mw13 Current Load on mw13 is WARNING: WARNING - load average: 8.00, 7.62, 6.43 [01:30:32] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:30:43] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.50, 3.65, 3.64 [01:30:44] RECOVERY - mw13 Current Load on mw13 is OK: OK - load average: 5.32, 6.59, 6.19 [01:32:40] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.83, 3.39, 3.55 [01:36:34] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.35, 3.72, 3.63 [01:38:31] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.46, 3.62, 3.61 [01:38:44] PROBLEM - mw13 Current Load on mw13 is WARNING: WARNING - load average: 6.89, 6.90, 6.50 [01:40:28] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.08, 3.90, 3.72 [01:40:44] RECOVERY - mw13 Current Load on mw13 is OK: OK - load average: 6.27, 6.52, 6.40 [01:42:25] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.04, 3.60, 3.63 [01:44:22] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.75, 3.83, 3.69 [01:46:21] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.49, 3.52, 3.59 [01:50:21] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.44, 3.88, 3.70 [01:50:39] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.27, 6.06, 5.20 [01:52:36] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.99, 5.53, 5.11 [01:53:02] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:54:21] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.58, 3.68, 3.71 [01:58:02] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [02:02:21] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.23, 2.92, 3.36 [02:37:55] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.05, 3.59, 3.25 [02:39:52] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.49, 3.37, 3.20 [02:41:49] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.80, 3.16, 3.14 [02:59:20] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 7.89, 7.54, 5.81 [03:00:16] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.33, 6.24, 4.91 [03:02:16] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 3.83, 5.45, 4.80 [03:03:20] RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 5.52, 6.74, 5.91 [03:18:36] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 20.50, 19.01, 16.48 [03:22:36] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 19.31, 19.80, 17.37 [03:38:48] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.98, 3.70, 3.18 [03:40:45] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.62, 3.27, 3.09 [05:49:39] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.54, 1.53, 1.03 [05:51:39] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.68, 1.11, 0.93 [06:10:36] PROBLEM - db11 APT on db11 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [06:11:03] PROBLEM - db11 Current Load on db11 is CRITICAL: CRITICAL - load average: 60.37, 23.43, 10.42 [06:12:31] RECOVERY - db11 APT on db11 is OK: APT OK: 9 packages available for upgrade (0 critical updates). [06:19:03] PROBLEM - db11 Current Load on db11 is WARNING: WARNING - load average: 3.26, 6.57, 7.08 [06:21:02] RECOVERY - db11 Current Load on db11 is OK: OK - load average: 2.91, 5.26, 6.53 [09:23:21] why don't we redirect https://static.miraheze.org/ to https://commons.miraheze.org/ ? [09:23:22] [url] 403 Forbidden | static.miraheze.org [09:23:23] [url] Miraheze Commons | commons.miraheze.org [09:25:04] because it's not amazingly helpful for us and no one asked [09:25:46] welp, I just asked [09:25:52] I mean, it would make sense. [09:26:33] why [09:26:51] commons isn't amazingly used nor has any proper oversight [09:27:19] where as most wikimedia wikis don't have local uploads [09:29:47] It's also not a good idea to have 403 Forbidden. [09:30:32] why [09:30:38] access is forbidden [09:30:56] !log GCP: Mark 4 'My First Project' Projects for deletion [09:31:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:33:01] why should access be forbidden though? [09:34:39] I'm not proposing it or something [09:34:39] I just feel it would make sense if it does redirect [09:34:39] I mean, I know, if it's probably Reception123 that said it would make sense, then it might just be redirected without many thoughts. [09:34:39] I'm just always the wrong person to request such things. [09:35:30] because you'd crash gluster accessing the root of static [09:43:39] well then :) [09:43:39] Now you're talking, heh [11:55:06] [02miraheze/MirahezeMagic] 07Reception123 pushed 031 commit to 03Reception123-patch-1 [+0/-0/±1] 13https://git.io/JDPFR [11:55:07] [02miraheze/MirahezeMagic] 07Reception123 03e5d7da5 - Update en.json [11:55:09] [02MirahezeMagic] 07Reception123 synchronize pull request 03#308: customise import message - 13https://git.io/JDoza [12:02:33] miraheze/MirahezeMagic - Reception123 the build passed. [12:18:57] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.44, 3.06, 2.77 [12:20:54] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.05, 2.73, 2.69 [12:30:36] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.49, 3.10, 2.82 [12:32:33] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.81, 2.85, 2.75 [12:34:51] PROBLEM - wikipedia.yogfront.ooo - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'wikipedia.yogfront.ooo' expires in 7 day(s) (Sun 26 Dec 2021 12:33:58 GMT +0000). [12:37:21] PROBLEM - wiki.airyx.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'wiki.airyx.org' expires in 7 day(s) (Sun 26 Dec 2021 12:34:53 GMT +0000). [12:44:09] PROBLEM - wikileague.cf - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'wikileague.cf' expires in 7 day(s) (Sun 26 Dec 2021 12:42:31 GMT +0000). [12:53:06] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.58, 3.13, 2.84 [12:53:22] PROBLEM - www.connorjwat.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'www.connorjwat.net' expires in 7 day(s) (Sun 26 Dec 2021 12:47:07 GMT +0000). [12:55:03] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 3.35, 3.10, 2.86 [13:40:01] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.16, 3.49, 3.18 [13:45:52] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.17, 3.04, 3.11 [13:49:43] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.09, 3.72, 3.33 [13:51:40] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.16, 3.49, 3.30 [13:53:37] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.74, 3.25, 3.23 [14:01:21] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.42, 3.77, 3.47 [14:03:18] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.97, 3.93, 3.58 [14:07:12] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 1.77, 2.94, 3.26 [14:14:57] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.68, 3.31, 3.29 [14:16:54] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 3.25, 3.24, 3.26 [14:17:25] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 8.06, 4.68, 3.11 [14:19:23] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 3.28, 4.23, 3.15 [14:22:43] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.58, 3.60, 3.42 [14:24:40] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.49, 3.30, 3.33 [14:55:43] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.61, 3.43, 3.18 [14:57:40] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.25, 2.95, 3.04 [15:14:21] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.85, 3.77, 3.36 [15:18:21] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.50, 3.24, 3.25 [15:42:54] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.56, 3.64, 3.27 [15:44:51] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.33, 3.97, 3.41 [15:48:46] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.04, 3.70, 3.45 [15:49:32] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [15:50:43] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.96, 4.11, 3.62 [15:52:40] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.08, 3.87, 3.61 [15:54:32] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [15:54:37] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.87, 4.25, 3.77 [15:56:02] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [16:00:28] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.96, 3.69, 3.70 [16:01:02] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [16:04:22] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 1.73, 2.69, 3.29 [16:07:32] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [16:12:32] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [16:31:14] [02miraheze/ManageWiki] 07JohnFLewis pushed 031 commit to 03JohnFLewis-patch-1 [+0/-0/±1] 13https://git.io/JD1vz [16:31:15] [02miraheze/ManageWiki] 07JohnFLewis 03ba95f71 - log changes inside commit, not as the very last step [16:31:17] [02ManageWiki] 07JohnFLewis created branch 03JohnFLewis-patch-1 - 13https://git.io/vpSns [16:31:19] [02ManageWiki] 07JohnFLewis opened pull request 03#321: log changes inside commit, not as the very last step - 13https://git.io/JD1v2 [16:32:41] [02miraheze/ManageWiki] 07github-actions[bot] pushed 031 commit to 03JohnFLewis-patch-1 [+0/-0/±1] 13https://git.io/JD1vj [16:32:42] [02miraheze/ManageWiki] 07github-actions 03e0ddd57 - CI: lint code to MediaWiki standards [16:32:44] [02ManageWiki] 07github-actions[bot] synchronize pull request 03#321: log changes inside commit, not as the very last step - 13https://git.io/JD1v2 [16:35:35] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.01, 3.89, 3.46 [16:36:28] miraheze/ManageWiki - JohnFLewis the build passed. [16:37:32] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.97, 3.96, 3.55 [16:39:29] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.40, 4.08, 3.64 [16:47:17] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.22, 3.77, 3.69 [16:51:11] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.06, 3.88, 3.71 [16:57:02] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.63, 3.95, 3.80 [17:08:44] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.15, 3.48, 3.56 [17:28:21] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.96, 3.88, 3.96 [17:42:21] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.19, 4.03, 3.85 [17:43:25] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 7.88, 6.03, 5.12 [17:45:20] RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 5.34, 5.63, 5.08 [17:46:21] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.66, 3.89, 3.84 [17:50:21] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.92, 3.87, 3.79 [17:51:32] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [17:52:21] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.70, 3.80, 3.78 [17:56:32] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [18:01:43] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JD1Cz [18:01:45] [02miraheze/mw-config] 07Universal-Omega 031b3df50 - MWE: Drop flaggedimages [18:02:45] miraheze/mw-config - Universal-Omega the build passed. [18:05:07] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JD1Wq [18:05:09] [02miraheze/mw-config] 07Universal-Omega 036734f82 - MWE: fix translate SQL paths [18:05:10] [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://git.io/vbvb3 [18:05:12] [02mw-config] 07Universal-Omega opened pull request 03#4289: MWE: fix translate SQL paths - 13https://git.io/JD1WO [18:05:34] RhinosF1: ^ those are the issues. [18:06:12] miraheze/mw-config - Universal-Omega the build passed. [18:06:24] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JD1Wg [18:06:25] [02miraheze/mw-config] 07Universal-Omega 038f895c0 - MWE: fix translate SQL paths (#4289) [18:06:27] [02mw-config] 07Universal-Omega closed pull request 03#4289: MWE: fix translate SQL paths - 13https://git.io/JD1WO [18:06:28] [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [18:06:30] [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://git.io/vbvb3 [18:07:30] miraheze/mw-config - Universal-Omega the build passed. [18:10:21] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.83, 3.21, 3.40 [18:11:32] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [18:12:02] !log [@mw11] starting deploy of {'config': True} to all [18:12:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:12:24] !log [@mw11] finished deploy of {'config': True} to all - SUCCESS in 22s [18:12:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:13:04] PROBLEM - mw13 Current Load on mw13 is WARNING: WARNING - load average: 7.90, 6.55, 5.56 [18:14:21] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.25, 3.66, 3.54 [18:15:00] RECOVERY - mw13 Current Load on mw13 is OK: OK - load average: 6.11, 6.48, 5.66 [18:16:21] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.91, 3.47, 3.50 [18:16:32] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [18:18:21] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.62, 4.09, 3.71 [18:23:32] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [18:24:28] !log [@test3] starting deploy of {'config': True} to skip [18:24:29] !log [@test3] finished deploy of {'config': True} to skip - SUCCESS in 0s [18:24:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:24:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:25:44] PROBLEM - mw13 Current Load on mw13 is WARNING: WARNING - load average: 6.32, 6.88, 6.16 [18:27:40] RECOVERY - mw13 Current Load on mw13 is OK: OK - load average: 5.03, 6.36, 6.06 [18:28:32] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [18:30:21] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.30, 3.70, 3.84 [18:32:21] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.27, 4.00, 3.93 [18:33:02] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [18:33:12] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JD1R8 [18:33:13] [02miraheze/mw-config] 07Universal-Omega 030d2fb3d - Remove sitenotice [18:33:15] [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://git.io/vbvb3 [18:33:16] [02mw-config] 07Universal-Omega opened pull request 03#4290: Remove sitenotice - 13https://git.io/JD1R4 [18:33:19] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.28, 4.62, 3.59 [18:34:21] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.33, 3.61, 3.79 [18:34:23] miraheze/mw-config - Universal-Omega the build passed. [18:34:36] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 26.92, 20.68, 17.83 [18:34:38] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.86, 7.14, 6.17 [18:35:18] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 4.89, 4.78, 3.78 [18:35:49] PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 9.27, 7.12, 5.83 [18:36:21] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.03, 4.08, 3.93 [18:36:36] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 6.10, 6.57, 6.07 [18:36:36] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 21.68, 20.52, 18.10 [18:38:02] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [18:38:21] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.92, 3.92, 3.89 [18:39:32] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [18:39:40] RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 4.91, 6.32, 5.81 [18:40:36] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 20.27, 20.30, 18.59 [18:42:21] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.55, 4.42, 4.08 [18:44:21] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.71, 3.91, 3.95 [18:44:32] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [18:46:21] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.79, 4.22, 4.05 [18:47:39] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.93, 1.78, 1.29 [18:48:21] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.38, 3.74, 3.88 [18:49:24] PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 11.97, 8.07, 6.75 [18:50:02] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [18:50:16] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.16, 6.50, 5.78 [18:51:04] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 9.59, 7.41, 6.25 [18:51:39] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.04, 1.51, 1.31 [18:52:16] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.57, 6.85, 6.00 [18:52:21] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.99, 4.22, 4.02 [18:53:04] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.89, 7.28, 6.35 [18:53:20] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 5.13, 7.07, 6.71 [18:54:21] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.11, 3.87, 3.92 [18:55:02] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [18:55:04] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.08, 6.04, 6.01 [18:56:16] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.35, 7.46, 6.43 [18:57:16] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.46, 7.48, 6.60 [18:58:16] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.77, 6.58, 6.24 [18:58:21] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.75, 3.95, 3.91 [18:59:02] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [18:59:16] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.62, 6.64, 6.39 [19:01:04] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.48, 7.57, 6.71 [19:01:20] PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 8.62, 7.92, 7.27 [19:03:20] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 5.04, 6.92, 7.00 [19:04:02] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [19:04:21] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.96, 3.83, 3.92 [19:05:04] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.63, 6.18, 6.35 [19:05:20] RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 5.14, 6.32, 6.77 [19:09:07] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.98, 6.66, 6.42 [19:09:20] PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 8.58, 7.50, 7.13 [19:11:02] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [19:11:05] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 9.38, 7.58, 6.78 [19:11:44] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.95, 6.68, 5.90 [19:11:58] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 10.46, 10.16, 8.05 [19:12:21] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.50, 3.56, 3.67 [19:13:08] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.29, 7.12, 6.78 [19:15:00] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 4.48, 6.81, 6.73 [19:15:20] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 5.31, 7.40, 7.38 [19:15:44] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 6.21, 6.61, 6.06 [19:15:54] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.55, 7.89, 7.55 [19:16:02] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [19:17:05] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.74, 6.52, 6.62 [19:19:20] PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 8.23, 7.35, 7.34 [19:20:03] PROBLEM - mw13 Current Load on mw13 is CRITICAL: CRITICAL - load average: 10.38, 8.04, 6.99 [19:20:32] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [19:20:53] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.45, 7.58, 7.09 [19:21:20] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 7.85, 7.69, 7.48 [19:22:00] PROBLEM - mw13 Current Load on mw13 is WARNING: WARNING - load average: 6.06, 7.39, 6.90 [19:22:51] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.02, 7.39, 7.08 [19:23:56] RECOVERY - mw13 Current Load on mw13 is OK: OK - load average: 5.68, 6.76, 6.72 [19:25:32] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [19:26:21] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.66, 3.63, 3.93 [19:27:02] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [19:28:21] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.28, 3.88, 3.98 [19:28:44] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.08, 6.12, 6.65 [19:29:20] RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 6.02, 6.20, 6.79 [19:29:41] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.72, 5.97, 6.73 [19:32:02] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [19:32:21] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.26, 3.64, 3.87 [19:42:21] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 1.63, 2.39, 3.18 [19:50:32] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [19:51:20] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 6.88, 6.85, 6.28 [19:53:20] RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 4.49, 6.04, 6.06 [19:55:32] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [20:18:28] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.84, 4.03, 3.51 [20:25:12] [02puppet] 07RhinosF1 opened pull request 03#2162: deploy: support 2 DCs - 13https://git.io/JD11R [20:26:21] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.23, 3.72, 3.67 [20:29:54] [02puppet] 07RhinosF1 synchronize pull request 03#2162: deploy: support 2 DCs - 13https://git.io/JD11R [20:30:30] [02puppet] 07RhinosF1 synchronize pull request 03#2162: deploy: support 2 DCs - 13https://git.io/JD11R [20:31:00] JohnLewis: ^ [20:33:21] Old sheet has 0123 not 1234 [20:33:34] I can fix, must have copied it wrong to phab [20:33:56] [02puppet] 07JohnFLewis reviewed pull request 03#2162 commit - 13https://git.io/JD1Mg [20:34:46] `args.servers = 'ovlon'` won't work as expected, only the first matching `elif` block is executed [20:35:36] [02puppet] 07RhinosF1 synchronize pull request 03#2162: deploy: support 2 DCs - 13https://git.io/JD11R [20:36:21] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.74, 3.75, 3.60 [20:37:04] [02puppet] 07RhinosF1 synchronize pull request 03#2162: deploy: support 2 DCs - 13https://git.io/JD11R [20:37:12] JohnLewis: fixed [20:37:17] majavah: doh! [20:37:48] you can't do it like that either, now the skip block will have no effect [20:38:21] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.93, 3.69, 3.59 [20:39:45] [02puppet] 07RhinosF1 synchronize pull request 03#2162: deploy: support 2 DCs - 13https://git.io/JD11R [20:40:03] majavah: should be right [20:50:21] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.77, 3.87, 3.66 [20:52:21] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.39, 3.59, 3.58 [21:10:20] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 1.70, 2.24, 1.51 [21:10:21] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.39, 3.04, 3.35 [21:11:20] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 7.80, 6.70, 5.85 [21:12:11] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 9.64, 9.56, 7.10 [21:12:16] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 0.80, 1.75, 1.42 [21:12:44] PROBLEM - mw13 Current Load on mw13 is WARNING: WARNING - load average: 7.91, 6.72, 5.74 [21:13:56] [02ManageWiki] 07Universal-Omega closed pull request 03#321: log changes inside commit, not as the very last step - 13https://git.io/JD1v2 [21:13:57] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JD1Hk [21:13:59] [02miraheze/ManageWiki] 07JohnFLewis 03cdda89f - log changes inside commit, not as the very last step (#321) [21:14:00] [02ManageWiki] 07Universal-Omega deleted branch 03JohnFLewis-patch-1 - 13https://git.io/vpSns [21:14:02] [02miraheze/ManageWiki] 07Universal-Omega deleted branch 03JohnFLewis-patch-1 [21:14:13] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.56, 1.37, 1.32 [21:14:21] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.53, 6.90, 5.76 [21:14:32] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [21:14:44] PROBLEM - mw13 Current Load on mw13 is CRITICAL: CRITICAL - load average: 8.50, 7.20, 6.02 [21:15:44] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 9.04, 6.56, 5.35 [21:16:07] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 5.35, 7.27, 6.71 [21:16:21] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.93, 3.89, 3.58 [21:17:20] RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 6.16, 6.71, 6.21 [21:18:18] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.95, 7.95, 6.48 [21:18:21] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.77, 3.70, 3.54 [21:18:44] PROBLEM - mw13 Current Load on mw13 is WARNING: WARNING - load average: 7.37, 7.98, 6.65 [21:18:55] miraheze/ManageWiki - Universal-Omega the build passed. [21:19:07] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 9.71, 7.46, 6.30 [21:19:32] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [21:19:44] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 6.23, 6.59, 5.67 [21:20:21] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.98, 3.93, 3.63 [21:20:36] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 20.58, 18.99, 17.08 [21:21:20] PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 9.13, 7.88, 6.79 [21:21:32] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [21:22:01] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 10.00, 8.56, 7.40 [21:22:44] RECOVERY - mw13 Current Load on mw13 is OK: OK - load average: 5.33, 6.52, 6.34 [21:23:20] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 6.56, 7.38, 6.75 [21:24:13] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 4.59, 6.06, 6.15 [21:24:36] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 20.40, 19.71, 17.82 [21:25:20] PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 13.92, 9.42, 7.54 [21:26:21] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.42, 3.95, 3.80 [21:26:32] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [21:28:56] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 5.74, 7.46, 6.98 [21:30:54] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 9.28, 8.30, 7.34 [21:31:20] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 6.89, 7.84, 7.44 [21:32:21] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.34, 2.88, 3.37 [21:32:52] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.95, 7.91, 7.30 [21:33:55] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.51, 1.91, 1.14 [21:34:50] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 9.49, 8.40, 7.55 [21:35:02] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [21:35:20] PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 10.41, 8.61, 7.78 [21:35:54] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.64, 1.45, 1.06 [21:42:44] PROBLEM - mw13 Current Load on mw13 is WARNING: WARNING - load average: 7.31, 6.94, 6.27 [21:45:02] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [21:46:32] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [21:46:44] RECOVERY - mw13 Current Load on mw13 is OK: OK - load average: 4.26, 6.01, 6.08 [21:49:36] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 24.22, 20.68, 19.14 [21:51:31] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 22.11, 21.37, 19.58 [21:55:10] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.00, 3.83, 3.49 [21:55:19] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 18.38, 20.26, 19.57 [21:56:32] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [21:57:07] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.89, 3.65, 3.45 [21:58:25] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 4.39, 6.38, 7.71 [21:59:20] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 4.52, 6.25, 7.61 [22:02:58] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.25, 3.97, 3.66 [22:04:18] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.51, 4.93, 6.60 [22:04:55] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.37, 3.77, 3.63 [22:05:19] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 4.51, 5.62, 7.91 [22:05:20] RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 4.02, 4.90, 6.56 [22:10:46] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.13, 3.51, 3.51 [22:12:43] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.10, 3.35, 3.45 [22:15:09] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.64, 5.66, 6.74 [22:16:18] [02mw-config] 07Universal-Omega closed pull request 03#4290: Remove sitenotice - 13https://git.io/JD1R4 [22:16:19] [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://git.io/vbvb3 [22:16:21] [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [22:16:22] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JD1Nu [22:16:24] [02miraheze/mw-config] 07Universal-Omega 03b00e11f - Remove sitenotice (#4290) [22:16:37] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.20, 3.49, 3.47 [22:17:30] miraheze/mw-config - Universal-Omega the build passed. [22:18:35] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.59, 3.33, 3.40 [22:19:39]