[00:02:40] <icinga-miraheze>	 PROBLEM - graylog2 Puppet on graylog2 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle.
[00:06:05] <icinga-miraheze>	 PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 9.45, 7.42, 5.05
[00:06:53] <icinga-miraheze>	 PROBLEM - graylog2 Current Load on graylog2 is WARNING: WARNING - load average: 4.00, 2.67, 1.46
[00:06:55] <icinga-miraheze>	 PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 27.04, 21.83, 16.14
[00:07:23] <Hispano76>	 xD
[00:07:30] <icinga-miraheze>	 PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 9.94, 6.92, 4.83
[00:07:49] <icinga-miraheze>	 PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 7.53, 6.75, 4.96
[00:08:00] <icinga-miraheze>	 PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.76, 7.80, 5.50
[00:08:53] <icinga-miraheze>	 RECOVERY - graylog2 Current Load on graylog2 is OK: OK - load average: 2.31, 2.49, 1.54
[00:08:53] <icinga-miraheze>	 PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 20.24, 21.56, 16.74
[00:09:28] <icinga-miraheze>	 RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.95, 6.46, 4.92
[00:09:50] <icinga-miraheze>	 RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 4.63, 5.88, 4.86
[00:10:00] <icinga-miraheze>	 RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.09, 6.65, 5.34
[00:12:52] <icinga-miraheze>	 PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 32.13, 24.57, 18.88
[00:16:19] <icinga-miraheze>	 PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 7.82, 6.35, 4.39
[00:18:17] <icinga-miraheze>	 PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 4.33, 5.39, 4.25
[00:20:24] <icinga-miraheze>	 PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 8.79, 7.08, 5.04
[00:21:11] <Hispano76>	 "There are problems with some of the data you have entered.
[00:21:12] <Hispano76>	 " Special:ManageWiki/settings  -_-
[00:21:46] <icinga-miraheze>	 PROBLEM - bacula2 Puppet on bacula2 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/apt/trusted.gpg.d/puppetlabs.gpg]
[00:23:58] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.91, 3.46, 3.11
[00:26:10] <icinga-miraheze>	 PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 2.47, 5.19, 4.92
[00:27:09] <icinga-miraheze>	 PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 18.60, 23.68, 23.37
[00:27:54] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.76, 3.37, 3.17
[00:28:07] <icinga-miraheze>	 RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 2.68, 4.78, 4.83
[00:32:33] <icinga-miraheze>	 RECOVERY - graylog2 Puppet on graylog2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[00:33:23] <icinga-miraheze>	 PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.69, 6.74, 5.52
[00:35:25] <icinga-miraheze>	 RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 6.71, 6.64, 5.63
[00:41:09] <icinga-miraheze>	 RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 16.90, 17.38, 19.86
[00:49:45] <icinga-miraheze>	 RECOVERY - bacula2 Puppet on bacula2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[00:54:04] <icinga-miraheze>	 PROBLEM - cp12 Current Load on cp12 is WARNING: WARNING - load average: 1.86, 1.68, 1.44
[00:55:37] <Universal_Omega>	 Hispano76: do you mind if I try changing ManageWiki myself on that wiki?
[00:56:01] <icinga-miraheze>	 RECOVERY - cp12 Current Load on cp12 is OK: OK - load average: 1.04, 1.44, 1.38
[00:59:03] <Universal_Omega>	 Ping me when you return. I'll look at it at that point. I don't want to change it without your explicit permission, so I'll wait until your back.
[00:59:07] <Hispano76>	 Universal_Omega, no problem
[00:59:28] <Hispano76>	 go to!
[00:59:30] <Universal_Omega>	 Oh you are still here.
[00:59:37] <Universal_Omega>	 Looking now then.
[00:59:45] <Hispano76>	 ;)
[01:02:58] <Universal_Omega>	 Hispano76: temporarily enable SocialProfile, make a simple change to `$wgCosmosSocialProfileTagGroups`, then save that in ManageWiki, and then ManageWiki should work again. It's likely because there is a group no longer existing saved in that. I'll fix it from happening in the future, later on.
[01:03:21] <Universal_Omega>	 SocialProfile can be disabled after saving settings and verifying it works again.
[01:05:16] <Hispano76>	 who group?
[01:06:20] <Universal_Omega>	 Hispano76: it doesn't matter which change you make to the config, add or remove a current one just change it in some way. And I'm not sure which group it is saved in database that is causing it to fail.
[01:08:23] <Universal_Omega>	 Section for the config: https://ucroniasalt.miraheze.org/wiki/Especial:ManageWiki/settings#mw-section-socialtools
[01:08:26] <MirahezeBot>	 [url] Administra los ajustes adicionales de este wiki - Ucronías | ucroniasalt.miraheze.org
[01:14:56] <Hispano76>	 I disabled cosmos until I could see how to reactivate it without causing problems Universal_Omega 
[01:15:57] <Universal_Omega>	 Hispano76: alright I will try to fix ManageWiki later on. If not then I might remove that config from ManageWiki.
[01:16:46] <Hispano76>	 the problem has been solved on Stettings
[01:17:37] <Universal_Omega>	 Hispano76: Great! It will probably work with Cosmos enabled again now since the Cosmos settings would've been reset now.
[01:18:40] <Universal_Omega>	 If not I will look as soon as I can.
[01:22:21] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.10, 3.77, 3.52
[01:30:14] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.23, 3.02, 3.31
[01:38:28] <icinga-miraheze>	 PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 7.53, 6.91, 5.71
[01:48:30] <icinga-miraheze>	 RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 4.16, 5.84, 5.93
[01:49:02] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.58, 3.72, 3.36
[01:53:03] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.11, 3.55, 3.40
[01:55:00] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.77, 3.35, 3.35
[02:12:49] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.46, 3.62, 3.26
[02:13:45] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 3.19, 3.33, 3.19
[02:23:35] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.38, 3.58, 3.40
[02:25:33] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.34, 3.27, 3.32
[02:48:24] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.75, 3.67, 3.34
[02:52:26] <icinga-miraheze>	 PROBLEM - cp12 Current Load on cp12 is WARNING: WARNING - load average: 1.57, 1.79, 1.41
[02:54:24] <icinga-miraheze>	 PROBLEM - cp12 Current Load on cp12 is CRITICAL: CRITICAL - load average: 4.25, 2.62, 1.75
[02:54:29] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.24, 3.05, 3.20
[02:58:17] <icinga-miraheze>	 RECOVERY - cp12 Current Load on cp12 is OK: OK - load average: 0.74, 1.61, 1.53
[03:10:18] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.78, 3.30, 3.17
[03:12:16] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.47, 2.97, 3.06
[03:28:03] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.37, 3.69, 3.33
[03:29:38] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.09, 5.95, 4.49
[03:30:01] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.28, 3.54, 3.32
[03:32:01] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 3.05, 3.30, 3.26
[03:33:39] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.82, 7.25, 5.34
[03:35:32] <icinga-miraheze>	 PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.32, 5.91, 4.35
[03:37:32] <icinga-miraheze>	 RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 6.30, 6.07, 4.61
[03:41:02] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.82, 3.91, 3.48
[03:41:34] <icinga-miraheze>	 PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.72, 6.94, 5.31
[03:43:36] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.43, 7.79, 6.68
[03:44:59] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.24, 3.65, 3.48
[03:45:35] <icinga-miraheze>	 RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 6.54, 6.76, 5.61
[03:46:57] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.67, 3.38, 3.40
[03:51:36] <icinga-miraheze>	 RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 4.88, 6.23, 6.42
[03:52:56] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.83, 3.47, 3.44
[03:54:53] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.67, 3.25, 3.37
[03:57:30] <icinga-miraheze>	 PROBLEM - equestripedia.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'equestripedia.org' expires in 15 day(s) (Thu 23 Sep 2021 03:53:45 GMT +0000).
[03:57:56] <Not>	 [02mw-config] 07Universal-Omega closed pull request 03#3972: Configure wgCrossSiteAJAXdomains to loginwiki and metawiki - 13https://git.io/JnPhz
[03:57:59] <Not>	 [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://git.io/vbvb3
[03:58:00] <Not>	 [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-1
[04:00:08] <Not>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JuZIj
[04:00:09] <Not>	 [02miraheze/ssl] 07MirahezeSSLBot 03e179ab7 - Bot: Update SSL cert for equestripedia.org
[04:07:46] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.33, 3.81, 3.53
[04:09:47] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.46, 3.56, 3.46
[04:10:52] <Not>	 [02miraheze/mw-config] 07Universal-Omega pushed 0385 commits to 03Universal-Omega-patch-6 [+11/-7/±127] 13https://git.io/JuZqq
[04:10:53] <Not>	 [02miraheze/mw-config] 07Universal-Omega 03b60b673 - Merge branch 'master' into Universal-Omega-patch-6
[04:10:55] <Not>	 [02mw-config] 07Universal-Omega synchronize pull request 03#3991: Remove unnecessary extension loads - 13https://git.io/JcqPl
[04:11:24] <Not>	 [02miraheze/mw-config] 07github-actions[bot] pushed 031 commit to 03Universal-Omega-patch-6 [+0/-0/±1] 13https://git.io/JuZqs
[04:11:25] <Not>	 [02miraheze/mw-config] 07github-actions 03ca75899 - CI: lint code to MediaWiki standards
[04:11:27] <Not>	 [02mw-config] 07github-actions[bot] synchronize pull request 03#3991: Remove unnecessary extension loads - 13https://git.io/JcqPl
[04:12:03] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[04:12:22] <Not>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-6 [+0/-0/±1] 13https://git.io/JuZq0
[04:12:23] <Not>	 [02miraheze/mw-config] 07Universal-Omega 037cf1a7a - Update LocalSettings.php
[04:12:25] <Not>	 [02mw-config] 07Universal-Omega synchronize pull request 03#3991: Remove unnecessary extension loads - 13https://git.io/JcqPl
[04:13:33] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[04:14:19] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 3.18, 3.27, 3.37
[04:15:55] <Not>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-6 [+0/-0/±1] 13https://git.io/JuZmB
[04:15:57] <Not>	 [02miraheze/mw-config] 07Universal-Omega 031197682 - Update LocalExtensions.php
[04:15:58] <Not>	 [02mw-config] 07Universal-Omega synchronize pull request 03#3991: Remove unnecessary extension loads - 13https://git.io/JcqPl
[04:17:04] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[04:18:36] <Not>	 [02mw-config] 07Universal-Omega closed pull request 03#4066: Setting image repository for polandballwikisongcontestwiki - 13https://git.io/JuTFL
[04:18:38] <Not>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JuZm7
[04:18:39] <Not>	 [02miraheze/mw-config] 07AgentIsai 031e4e242 - Setting image repository for polandballwikisongcontestwiki (#4066)
[04:19:06] <Not>	 [02mw-config] 07Universal-Omega closed pull request 03#4067: Adding Import Sources for wikis - 13https://git.io/Jukrg
[04:19:07] <Not>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JuZmN
[04:19:09] <Not>	 [02miraheze/mw-config] 07AgentIsai 039a61969 - Adding Import Sources for wikis (#4067)
[04:19:41] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[04:19:50] <Not>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JuZYk
[04:19:51] <Not>	 [02miraheze/mw-config] 07Universal-Omega 0389e80e5 - Spacing
[04:20:16] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[04:20:47] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[04:23:46] <Not>	 [02mw-config] 07Universal-Omega opened pull request 03#4077: Merge branch 'master' into Universal-Omega-patch-4 - 13https://git.io/JuZYQ
[04:24:09] <Not>	 [02mw-config] 07Universal-Omega closed pull request 03#4077: Merge branch 'master' into Universal-Omega-patch-4 - 13https://git.io/JuZYQ
[04:24:11] <Not>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-4 [+3/-2/±13] 13https://git.io/JuZYN
[04:24:12] <Not>	 [02miraheze/mw-config] 07Universal-Omega 0302e56d4 - Merge branch 'master' into Universal-Omega-patch-4
[04:24:14] <Not>	 [02mw-config] 07Universal-Omega synchronize pull request 03#4073: Simplify InstantCommons fix to not use foreach - 13https://git.io/JuYEe
[04:24:41] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[04:25:12] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[04:27:32] <Not>	 [02mw-config] 07Universal-Omega closed pull request 03#4073: Simplify InstantCommons fix to not use foreach - 13https://git.io/JuYEe
[04:27:35] <Not>	 [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-4 - 13https://git.io/vbvb3
[04:27:36] <Not>	 [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-4
[04:28:28] <Not>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JuZOr
[04:28:29] <Not>	 [02miraheze/mw-config] 07Universal-Omega 03f042b88 - Simplify InstantCommons fix to not use foreach
[04:28:31] <Not>	 [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://git.io/vbvb3
[04:28:32] <Not>	 [02mw-config] 07Universal-Omega opened pull request 03#4078: Simplify InstantCommons fix to not use foreach - 13https://git.io/JuZOo
[04:28:54] <Not>	 [02miraheze/mw-config] 07github-actions[bot] pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JuZOX
[04:28:56] <Not>	 [02miraheze/mw-config] 07github-actions 03171ac06 - CI: lint code to MediaWiki standards
[04:28:57] <Not>	 [02mw-config] 07github-actions[bot] synchronize pull request 03#4078: Simplify InstantCommons fix to not use foreach - 13https://git.io/JuZOo
[04:29:37] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[04:33:26] <MirahezeLSBot>	 !log [@test3] starting deploy of {'config': True} to skip
[04:33:27] <MirahezeLSBot>	 !log [@test3] finished deploy of {'config': True} to skip - SUCCESS in 0s
[04:33:30] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[04:33:33] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[04:37:49] <icinga-miraheze>	 RECOVERY - equestripedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'equestripedia.org' will expire on Mon 06 Dec 2021 03:00:01 GMT +0000.
[05:13:55] <Not>	 [02puppet] 07Reception123 closed pull request 03#1959: deploy-mediawiki: add `--save-gitinfo` to `--gitinfo` argument - 13https://git.io/JuGcO
[05:13:56] <Not>	 [02miraheze/puppet] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JuZWL
[05:13:57] <Not>	 [02miraheze/puppet] 07Universal-Omega 0323468b0 - deploy-mediawiki: add `--save-gitinfo` to `--gitinfo` argument (#1959)
[05:14:40] <icinga-miraheze>	 PROBLEM - mw13 Current Load on mw13 is CRITICAL: CRITICAL - load average: 8.23, 6.74, 5.00
[05:18:39] <icinga-miraheze>	 PROBLEM - mw13 Current Load on mw13 is WARNING: WARNING - load average: 7.62, 7.46, 5.71
[05:18:41] <Not>	 [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-1/±0] 13https://git.io/JuZWb
[05:18:43] <Not>	 [02miraheze/MirahezeMagic] 07Universal-Omega 03e246403 - T7995: delete RemovePII maintenance script
[05:18:44] <Not>	 [02MirahezeMagic] 07Universal-Omega created branch 03Universal-Omega-patch-2 - 13https://git.io/fQRGX
[05:19:12] <Not>	 [02MirahezeMagic] 07Universal-Omega opened pull request 03#285: T7995: delete RemovePII maintenance script - 13https://git.io/JuZWp
[05:20:10] <miraheze-github>	 miraheze/MirahezeMagic - Universal-Omega the build passed.
[05:32:36] <icinga-miraheze>	 RECOVERY - mw13 Current Load on mw13 is OK: OK - load average: 6.43, 6.69, 6.47
[06:22:40] <icinga-miraheze>	 PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 8.87, 6.40, 4.47
[06:26:43] <icinga-miraheze>	 PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 7.86, 7.43, 5.37
[06:28:42] <icinga-miraheze>	 PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 8.63, 7.88, 5.79
[06:34:33] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.22, 7.18, 6.33
[06:36:27] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.81, 7.30, 6.47
[06:36:54] <MirahezeLSBot>	 !log [reception@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=polandballwiki --update (END - exit=0)
[06:36:57] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[06:37:10] <icinga-miraheze>	 PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.10, 7.19, 5.97
[06:38:23] <icinga-miraheze>	 RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.51, 6.70, 6.35
[06:39:08] <icinga-miraheze>	 RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 5.71, 6.72, 5.95
[06:42:26] <RhinosF1>	 Reception123: with UO's PR this morning, I'm hoping that's development done for mwdeploy
[06:42:26] <MirahezeBot>	 [tell] RhinosF1: 2021-09-07 - 07:25:14BST <Reception123> tell RhinosF1 Do you know if we have a way yet to add stuff to the -cvt-feed blacklist?
[06:42:33] <RhinosF1>	 Just docwriting
[06:42:46] <RhinosF1>	 That's a MacFan4000 question but we do
[06:43:05] <Not>	 [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03Reception123-patch-2 [+0/-0/±1] 13https://git.io/JuZom
[06:43:07] <Not>	 [02miraheze/mw-config] 07Reception123 03a77d3bc - add file extensions to MWS for rctwiki per T7973
[06:43:08] <Not>	 [02mw-config] 07Reception123 created branch 03Reception123-patch-2 - 13https://git.io/vbvb3
[06:43:31] <Not>	 [02mw-config] 07Reception123 opened pull request 03#4079: add file extensions to MWS for rctwiki per T7973 - 13https://git.io/JuZoc
[06:43:37] <RhinosF1>	 Info: --force should only be used in an emergency, DEPLOY ABORTED is bad but hopefully it will fail at localhost
[06:43:56] <Reception123>	 ack
[06:44:19] <RhinosF1>	 I've tested abort works and it does
[06:44:25] <miraheze-github>	 miraheze/mw-config - Reception123 the build passed.
[06:44:29] <RhinosF1>	 I can proceed through every server
[06:44:35] <icinga-miraheze>	 PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 3.96, 7.57, 7.45
[06:44:38] <Not>	 [02mw-config] 07Reception123 closed pull request 03#4079: add file extensions to MWS for rctwiki per T7973 - 13https://git.io/JuZoc
[06:44:39] <Not>	 [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JuZou
[06:44:41] <Not>	 [02miraheze/mw-config] 07Reception123 035794a65 - add file extensions to MWS for rctwiki per T7973 (#4079)
[06:44:42] <Not>	 [02miraheze/mw-config] 07Reception123 deleted branch 03Reception123-patch-2
[06:44:44] <Not>	 [02mw-config] 07Reception123 deleted branch 03Reception123-patch-2 - 13https://git.io/vbvb3
[06:45:20] <RhinosF1>	 And I broke test3 to test
[06:45:42] <miraheze-github>	 miraheze/mw-config - Reception123 the build passed.
[06:45:53] <Reception123>	 RhinosF1: it'd be nice to finally have mwdeploy done today
[06:46:34] <icinga-miraheze>	 RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 1.71, 5.55, 6.72
[06:47:04] <icinga-miraheze>	 PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 8.73, 7.61, 6.53
[06:51:08] <MirahezeLSBot>	 !log [reception@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=corpcartographywiki /home/reception/delbackups5/corpcartographywiki.xml --username-prefix corpcartography --report 1 (END - exit=2)
[06:51:14] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[06:51:25] <Reception123>	 ^ done manually as I forgot to do it in screen
[06:57:12] <RhinosF1>	 Reception123: code wise it is done
[06:57:35] <RhinosF1>	 I want to give the code time for other deployers to try so I will write finished docs tonight
[06:57:48] <Reception123>	 Ok, sounds good then 
[06:57:51] <RhinosF1>	 Then probably this time next week we can do the scary production deploy
[06:59:05] <icinga-miraheze>	 PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.71, 7.70, 7.36
[07:03:04] <MirahezeLSBot>	 !log [@test3] starting deploy of {'config': True} to skip
[07:03:05] <MirahezeLSBot>	 !log [@test3] finished deploy of {'config': True} to skip - SUCCESS in 0s
[07:03:09] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[07:03:13] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[07:04:34] <icinga-miraheze>	 PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.04, 6.38, 5.36
[07:05:05] <icinga-miraheze>	 PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 8.13, 7.41, 7.26
[07:07:32] <icinga-miraheze>	 PROBLEM - mw13 Current Load on mw13 is WARNING: WARNING - load average: 7.80, 6.82, 5.90
[07:08:23] <icinga-miraheze>	 RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 3.24, 5.45, 5.27
[07:09:08] <icinga-miraheze>	 PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.73, 7.55, 7.34
[07:09:31] <icinga-miraheze>	 RECOVERY - mw13 Current Load on mw13 is OK: OK - load average: 6.74, 6.73, 5.98
[07:15:04] <icinga-miraheze>	 RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 2.88, 5.19, 6.43
[08:10:21] <Not>	 [02puppet] 07Reception123 commented on pull request 03#1799: Whitelist *.archive.org - 13https://git.io/JuZFJ
[08:10:22] <Not>	 [02puppet] 07Reception123 closed pull request 03#1799: Whitelist *.archive.org - 13https://git.io/Jctix
[08:13:48] <Not>	 [02miraheze/dns] 07Reception123 pushed 031 commit to 03master [+1/-0/±0] 13https://git.io/JuZFo
[08:13:49] <Not>	 [02miraheze/dns] 07Reception123 0354a3c24 - add avas.wiki zone
[08:16:54] <Not>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://git.io/JuZbt
[08:16:55] <Not>	 [02miraheze/mw-config] 07Universal-Omega 0370bb557 - LocalWiki: alphabetically order wiki overrides
[08:16:57] <Not>	 [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-2 - 13https://git.io/vbvb3
[08:16:58] <Not>	 [02mw-config] 07Universal-Omega opened pull request 03#4080: LocalWiki: alphabetically order wiki overrides - 13https://git.io/JuZbq
[08:18:13] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[08:21:54] <Not>	 [02miraheze/ssl] 07Reception123 pushed 031 commit to 03master [+1/-0/±1] 13https://git.io/JuZNn
[08:21:56] <Not>	 [02miraheze/ssl] 07Reception123 035d709a4 - add avas.wiki cert
[12:52:29] <MirahezeLSBot>	 !log [reception@mwtask1] sudo -u www-data php /srv/mediawiki/w/extensions/MirahezeMagic/maintenance/generateMirahezeSitemap.php --wiki=polandballwiki (END - exit=0)
[12:52:32] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[13:33:28] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 12.53, 8.08, 5.54
[13:33:51] <icinga-miraheze>	 PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 15.45, 9.78, 6.34
[13:35:22] <icinga-miraheze>	 PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 11.76, 7.91, 5.65
[13:35:41] <icinga-miraheze>	 PROBLEM - mw13 Current Load on mw13 is CRITICAL: CRITICAL - load average: 12.72, 7.92, 5.59
[13:35:49] <icinga-miraheze>	 PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 12.11, 7.93, 5.81
[13:36:35] <icinga-miraheze>	 PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.90, 7.20, 5.22
[14:02:34] <icinga-miraheze>	 PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 3.10, 6.47, 7.89
[14:03:52] <icinga-miraheze>	 PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 2.13, 3.72, 7.62
[14:05:11] <icinga-miraheze>	 PROBLEM - gluster3 Disk Space on gluster3 is CRITICAL: DISK CRITICAL - free space: / 57334 MB (5% inode=79%);
[14:07:39] <icinga-miraheze>	 PROBLEM - mw13 Current Load on mw13 is WARNING: WARNING - load average: 2.80, 4.83, 7.76
[14:07:48] <icinga-miraheze>	 RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 3.38, 3.66, 6.72
[14:08:34] <icinga-miraheze>	 RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 3.78, 4.39, 6.46
[14:13:38] <icinga-miraheze>	 RECOVERY - mw13 Current Load on mw13 is OK: OK - load average: 4.26, 4.62, 6.73
[14:17:19] <icinga-miraheze>	 PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 3.40, 4.42, 7.86
[14:19:50] <icinga-miraheze>	 PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 4.20, 4.58, 7.66
[14:23:20] <icinga-miraheze>	 RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.19, 4.01, 6.54
[14:25:46] <icinga-miraheze>	 RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 4.16, 4.36, 6.56
[14:30:06] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.12, 6.18, 7.76
[14:35:21] <icinga-miraheze>	 PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.20, 6.22, 5.99
[14:37:19] <icinga-miraheze>	 RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.72, 6.14, 6.00
[14:38:10] <icinga-miraheze>	 RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 4.20, 4.73, 6.47
[14:50:14] <icinga-miraheze>	 PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 9.16, 7.88, 6.74
[14:50:34] <icinga-miraheze>	 PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.01, 7.03, 6.09
[14:51:19] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.04, 3.59, 3.24
[14:53:02] <MirahezeLSBot>	 !log [rhinos@test3] sudo -u www-data php /srv/mediawiki/w/maintenance/undelete.php --wiki=--user=RhinosF1 (Miraheze) (END - exit=512)
[14:53:08] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[14:54:01] <MirahezeLSBot>	 !log [rhinos@test3] sudo -u www-data php /srv/mediawiki/w/maintenance/undelete.php --wiki=firestart464mapswiki --user='RhinosF1 (Miraheze)' --reason='tech request' --pagename='Template:Taliban insurgency detailed map' (END - exit=65280)
[14:54:07] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[14:54:07] <icinga-miraheze>	 PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.90, 7.66, 6.92
[14:54:19] <MirahezeLSBot>	 !log [rhinos@test3] sudo -u www-data php /srv/mediawiki/w/maintenance/undelete.php --wiki=firestar464mapswiki --user='RhinosF1 (Miraheze)' --reason='tech request' --pagename='Template:Taliban insurgency detailed map' (END - exit=256)
[14:54:23] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[14:55:15] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.29, 3.64, 3.37
[14:56:26] <icinga-miraheze>	 PROBLEM - mw13 Current Load on mw13 is CRITICAL: CRITICAL - load average: 8.51, 7.02, 5.94
[14:57:56] <icinga-miraheze>	 PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.12, 7.85, 7.15
[14:58:23] <icinga-miraheze>	 RECOVERY - mw13 Current Load on mw13 is OK: OK - load average: 6.06, 6.58, 5.91
[14:58:34] <icinga-miraheze>	 PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.24, 7.32, 6.56
[14:59:07] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.06, 3.78, 3.47
[14:59:52] <icinga-miraheze>	 PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.80, 7.84, 7.24
[15:00:34] <icinga-miraheze>	 PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 5.78, 6.84, 6.48
[15:02:34] <icinga-miraheze>	 RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.60, 5.96, 6.19
[15:02:56] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.84, 3.57, 3.47
[15:04:53] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.55, 3.20, 3.34
[15:07:35] <icinga-miraheze>	 RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 3.59, 5.57, 6.46
[15:10:47] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.57, 3.54, 3.41
[15:12:34] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.95, 7.25, 6.50
[15:12:43] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.67, 3.20, 3.30
[15:14:35] <icinga-miraheze>	 RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 3.63, 5.95, 6.12
[15:33:39] <MirahezeLSBot>	 !log [rhinos@test3] starting undelete attempt 2
[15:33:44] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[15:36:28] <RhinosF1>	 paladox: around?
[15:49:10] <RhinosF1>	 JohnLewis: access?
[15:49:37] <JohnLewis>	 Not right now, but can in a few if needed?
[15:51:10] <RhinosF1>	 JohnLewis: I'm trying the server side undelete for https://phabricator.miraheze.org/T7998 to help debug the page and it's not moving at all
[15:51:11] <MirahezeBot>	 [url] ⚓ T7998 504 Gateway Time-Out on my personal wiki | phabricator.miraheze.org
[15:51:25] <RhinosF1>	 It's getting stuck based on wiki attempt's log on a query
[15:53:27] <MirahezeLSBot>	 !log [rhinos@test3] sudo -u www-data php /srv/mediawiki/w/maintenance/undelete.php --wiki=firestar464mapswiki --user='RhinosF1 (Miraheze)' --reason='tech request' 'Template:Taliban insurgency detailed map' (END - exit=2)
[15:53:37] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[15:55:39] <icinga-miraheze>	 PROBLEM - wiki.globasa.net - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.globasa.net' expires in 15 day(s) (Thu 23 Sep 2021 15:51:20 GMT +0000).
[15:57:11] <icinga-miraheze>	 PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 9.81, 7.54, 5.61
[15:59:18] <Not>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JucK4
[15:59:19] <Not>	 [02miraheze/ssl] 07MirahezeSSLBot 03dfc3911 - Bot: Update SSL cert for wiki.globasa.net
[16:00:34] <RhinosF1>	 !log killed above shell script with -9 hammer as it was completely unresponsive to even Ctrl+C
[16:00:37] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[16:04:06] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.17, 6.40, 5.37
[16:06:06] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.52, 7.26, 5.82
[16:08:23] <JohnLewis>	 RhinosF1: DB seems to be working fine, operations on other wikis on the DB respond quickly and no other issues reported on wikis. Error logs don't suggest anything either
[16:11:35] <RhinosF1>	 JohnLewis: is there a way someone can watch the DB if I run the script again later to make sure it's actually functioning
[16:11:49] <RhinosF1>	 And see where it gets stuck
[16:12:05] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.01, 7.65, 6.54
[16:12:08] <JohnLewis>	 processlist doesn't show the command being run when the connection opens
[16:12:32] <JohnLewis>	 Which to me suggests MW isn't executing any SQL via the connection
[16:13:01] <RhinosF1>	 JohnLewis: from any point earlier
[16:13:04] <RhinosF1>	 I ran it twice
[16:13:21] <JohnLewis>	 hm?
[16:14:06] <RhinosF1>	 JohnLewis: where and how are you getting that
[16:14:10] <RhinosF1>	 It's not running now
[16:14:31] <JohnLewis>	 | 4592477 | mediawiki   | 2001:41d0:800:1bbd::15:46474 | firestar464mapswiki    | Sleep   |  188 |                          | NULL                                                                                                 |    0.000 |
[16:14:54] <JohnLewis>	 SHOW PROCESSLIST before you kill -9'd above
[16:15:04] <RhinosF1>	 Ah
[16:15:12] <RhinosF1>	 Didn't know that went back in time
[16:15:16] <RhinosF1>	 That's strange
[16:15:18] <JohnLewis>	 it does?
[16:15:21] <JohnLewis>	 *it doesn't
[16:15:37] <RhinosF1>	 ok
[16:16:02] <RhinosF1>	 Strange, mediawiki gave a lock wait timeout for the web attempt by someone this morning according to graylog
[16:16:06] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 9.47, 8.27, 7.01
[16:19:34] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.83, 3.43, 3.00
[16:21:33] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.82, 3.53, 3.09
[16:22:57] <icinga-miraheze>	 PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 9.09, 8.36, 6.63
[16:23:31] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.58, 3.19, 3.02
[16:24:54] <icinga-miraheze>	 PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.89, 7.62, 6.56
[16:25:59] <icinga-miraheze>	 PROBLEM - gluster3 Gluster Disk Space on gluster3 is CRITICAL: DISK CRITICAL - free space: /mnt/mediawiki-static 115884 MB (5% inode=79%);
[16:26:08] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 5.48, 7.88, 7.70
[16:27:18] <RhinosF1>	 paladox: static low on disk ^
[16:30:52] <icinga-miraheze>	 PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 3.46, 5.77, 7.59
[16:32:47] <icinga-miraheze>	 RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 4.90, 6.34, 6.42
[16:36:49] <icinga-miraheze>	 RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.78, 4.87, 6.56
[16:40:06] <icinga-miraheze>	 RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.48, 6.05, 6.70
[16:42:40] <icinga-miraheze>	 RECOVERY - wiki.globasa.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.globasa.net' will expire on Mon 06 Dec 2021 14:59:12 GMT +0000.
[16:45:03] <Not>	 [02puppet] 07Universal-Omega opened pull request 03#1960: CSP: add scratchblocks.github.io to `script-src` (T8002) - 13https://git.io/JucyK
[16:49:06] <RhinosF1>	 Universal_Omega: id rather an extension didn't
[16:51:10] <Universal_Omega>	 RhinosF1: still it can be a temporary measure to get the extension operational. Then we can decide on what to do with CSP. It was already in img-src so added it to script-src just to make it work while something can later be fixed on extension itself and then removed. Currently the extension is entirely broken. I'd rather at least gave a fix for something caused on our side.
[16:52:05] <RhinosF1>	 Universal_Omega: how hard would it be to bundle the JS in the extension
[16:52:15] <RhinosF1>	 Could a quick patch be done
[16:52:58] <Not>	 [02puppet] 07Reception123 commented on pull request 03#1960: CSP: add scratchblocks.github.io to `script-src` (T8002) - 13https://git.io/JucSx
[16:53:00] <Universal_Omega>	 RhinosF1: doubtful it would be hard if the puppet patch is merged for a temporary fix. Then I will look into upstream patch.
[16:53:01] <Not>	 [02puppet] 07Reception123 closed pull request 03#1960: CSP: add scratchblocks.github.io to `script-src` (T8002) - 13https://git.io/JucyK
[16:53:03] <Not>	 [02miraheze/puppet] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JucSp
[16:53:04] <Not>	 [02miraheze/puppet] 07Universal-Omega 0337fead0 - CSP: add scratchblocks.github.io to `script-src` (T8002) (#1960)
[16:53:23] <RhinosF1>	 Reception123: it has been merged so can you
[16:53:26] <RhinosF1>	 Universal_Omega: *
[16:53:32] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.51, 3.41, 3.02
[16:53:33] <RhinosF1>	 It's a complete waste of performance
[16:54:37] <Reception123>	 hm, what's the issue?
[16:54:39] <Universal_Omega>	 RhinosF1: I am and I agree bundling is best. As I mentioned as soon as that is done, if it can be, I will revert that patch.
[16:54:41] <Reception123>	 I didn't see this channel before merging
[16:55:05] <RhinosF1>	 Reception123: the script-src is not long term
[16:55:19] <RhinosF1>	 Extensions shouldn't be loading third party resources if they don't have to
[16:55:24] <RhinosF1>	 Certainly not scripts
[16:55:30] <RhinosF1>	 Universal_Omega: ok cool
[16:55:53] <Reception123>	 yeah, that does have a point
[16:56:36] <Universal_Omega>	 Reception123: yeah as soon as I do upstream patch, if merged, CSP can be reverted.
[16:57:31] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.40, 3.06, 2.99
[17:06:28] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.47, 7.20, 6.71
[17:06:32] <Reception123>	 ok
[17:08:29] <icinga-miraheze>	 RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 6.07, 6.66, 6.56
[17:09:31] <icinga-miraheze>	 PROBLEM - wiki.newnormal.fans - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.newnormal.fans' expires in 15 day(s) (Thu 23 Sep 2021 17:04:18 GMT +0000).
[17:15:30] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.36, 3.57, 3.26
[17:16:11] <Not>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Juc51
[17:16:12] <Not>	 [02miraheze/ssl] 07MirahezeSSLBot 0352e2e00 - Bot: Update SSL cert for wiki.newnormal.fans
[17:19:34] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.39, 3.06, 3.14
[17:23:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.53, 3.53, 3.33
[17:25:33] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 1.88, 2.92, 3.13
[17:34:26] <Reception123>	 JohnLewis: would you perhaps have any idea about https://phabricator.miraheze.org/T7998#161399 ?
[17:34:28] <MirahezeBot>	 [url] ⚓ T7998 504 Gateway Time-Out on my personal wiki | phabricator.miraheze.org
[17:34:28] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 4.00, 3.43, 3.22
[17:35:00] <RhinosF1>	 Reception123: already asked
[17:35:06] <Reception123>	 ah ok, my bad
[17:35:19] <RhinosF1>	 Reception123: I can't get the page to restore server side either
[17:35:25] <RhinosF1>	 It's completely stuck
[17:35:35] <Reception123>	 yeah, there's clearly something wrong
[17:35:43] <icinga-miraheze>	 PROBLEM - mw13 Current Load on mw13 is CRITICAL: CRITICAL - load average: 9.64, 7.27, 5.84
[17:35:57] <Reception123>	 and while we're on the topic I also wanted to ask if we should do something (also cc paladox ) about these repeated errors in the MySQL logs
[17:36:09] <RhinosF1>	 Reception123: i can't see why it should be big
[17:36:14] <Reception123>	 2021-09-07 17:29:31 249348292 [Warning] Aborted connection 249348292 to db: 'commonswiki' user: 'mediawiki' host: '2001:41d0:800:1bbd::10' (Got an error reading communication packets)
[17:36:14] <Reception123>	 2021-09-07 17:30:28 0 [ERROR] InnoDB: (Duplicate key) writing word node to FTS auxiliary index table.
[17:36:17] <RhinosF1>	 But we seem stuck
[17:36:22] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.37, 3.24, 3.20
[17:36:29] <RhinosF1>	 I can't do anything with the page
[17:36:31] <Reception123>	 RhinosF1: yeah, it's a bit odd
[17:37:39] <icinga-miraheze>	 PROBLEM - mw13 Current Load on mw13 is WARNING: WARNING - load average: 7.38, 7.11, 5.94
[17:38:55] <MirahezeLSBot>	 !log [reception@mwtask1] sudo -u www-data php /srv/mediawiki/w/extensions/MirahezeMagic/maintenance/generateMirahezeSitemap.php --wiki=402611wiki (END - exit=0)
[17:38:59] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[17:43:03] <icinga-miraheze>	 RECOVERY - wiki.newnormal.fans - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.newnormal.fans' will expire on Mon 06 Dec 2021 16:16:02 GMT +0000.
[17:47:41] <icinga-miraheze>	 PROBLEM - mw13 Current Load on mw13 is CRITICAL: CRITICAL - load average: 8.21, 7.25, 6.50
[17:49:43] <icinga-miraheze>	 PROBLEM - mw13 Current Load on mw13 is WARNING: WARNING - load average: 6.81, 7.20, 6.58
[17:49:51] <icinga-miraheze>	 PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 9.27, 7.50, 5.81
[17:51:48] <icinga-miraheze>	 PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 7.69, 7.46, 6.00
[17:53:40] <icinga-miraheze>	 PROBLEM - mw13 Current Load on mw13 is CRITICAL: CRITICAL - load average: 8.64, 7.57, 6.83
[17:55:48] <icinga-miraheze>	 PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.48, 6.77, 5.60
[17:55:48] <icinga-miraheze>	 PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 8.22, 7.70, 6.42
[17:57:30] <icinga-miraheze>	 PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.19, 7.08, 6.02
[17:57:48] <icinga-miraheze>	 RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 6.27, 6.62, 5.69
[17:59:28] <icinga-miraheze>	 PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.96, 7.17, 6.17
[17:59:40] <icinga-miraheze>	 PROBLEM - mw13 Current Load on mw13 is WARNING: WARNING - load average: 5.93, 7.47, 7.14
[18:01:27] <icinga-miraheze>	 PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 9.51, 7.99, 6.59
[18:04:47] <icinga-miraheze>	 PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.64, 7.27, 6.30
[18:05:39] <icinga-miraheze>	 RECOVERY - mw13 Current Load on mw13 is OK: OK - load average: 5.69, 6.28, 6.73
[18:08:48] <icinga-miraheze>	 RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 5.58, 6.52, 6.22
[18:09:23] <icinga-miraheze>	 PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 3.54, 7.42, 7.32
[18:13:20] <icinga-miraheze>	 RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.37, 6.07, 6.77
[18:15:48] <icinga-miraheze>	 PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 3.57, 6.63, 7.59
[18:19:41] <icinga-miraheze>	 PROBLEM - mw13 Current Load on mw13 is WARNING: WARNING - load average: 6.91, 6.52, 6.42
[18:19:49] <icinga-miraheze>	 RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 3.70, 5.05, 6.72
[18:27:26] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 9.22, 7.71, 6.63
[18:27:40] <icinga-miraheze>	 PROBLEM - mw13 Current Load on mw13 is CRITICAL: CRITICAL - load average: 10.59, 8.31, 7.23
[18:29:29] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.33, 7.78, 6.81
[18:29:41] <icinga-miraheze>	 PROBLEM - mw13 Current Load on mw13 is WARNING: WARNING - load average: 7.20, 7.95, 7.24
[18:33:38] <icinga-miraheze>	 PROBLEM - mw13 Current Load on mw13 is CRITICAL: CRITICAL - load average: 8.17, 7.54, 7.18
[18:35:32] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.35, 7.50, 6.90
[18:37:33] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.07, 6.91, 6.76
[18:37:40] <icinga-miraheze>	 PROBLEM - mw13 Current Load on mw13 is WARNING: WARNING - load average: 6.66, 7.80, 7.45
[18:39:33] <icinga-miraheze>	 RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 4.13, 6.15, 6.51
[18:45:42] <icinga-miraheze>	 RECOVERY - mw13 Current Load on mw13 is OK: OK - load average: 3.94, 5.48, 6.55
[19:08:19] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.50, 3.69, 3.22
[19:10:14] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.09, 3.46, 3.19
[19:12:13] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.48, 3.05, 3.07
[19:17:48] <paladox>	 !log deploy https://github.com/miraheze/puppet/pull/1953 to cache proxies (as a test, hack on puppet3)
[19:17:49] <MirahezeBot>	 [url] varnish: Use random over round_robin by paladox · Pull Request #1953 · miraheze/puppet · GitHub | github.com
[19:17:51] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[19:22:39] <icinga-miraheze>	 PROBLEM - mw13 Current Load on mw13 is CRITICAL: CRITICAL - load average: 10.72, 7.75, 6.26
[19:23:19] <icinga-miraheze>	 PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 9.41, 7.86, 5.83
[19:23:23] <icinga-miraheze>	 PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.99, 6.84, 5.34
[19:25:21] <icinga-miraheze>	 PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 9.72, 7.82, 5.88
[19:31:20] <icinga-miraheze>	 PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.31, 7.84, 6.55
[19:33:24] <icinga-miraheze>	 PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.11, 7.92, 6.74
[19:42:36] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.50, 3.60, 3.19
[19:44:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.23, 3.42, 3.17
[19:47:34] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.23, 3.05, 3.07
[19:47:34] <icinga-miraheze>	 PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.25, 7.79, 7.86
[19:49:17] <icinga-miraheze>	 PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.51, 7.80, 7.84
[19:50:59] <Not>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JuCY3
[19:51:00] <Not>	 [02miraheze/mw-config] 07paladox 0333a9881 - Set $wgParserCacheType to cache in the DB
[19:51:02] <Not>	 [02mw-config] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vbvb3
[19:51:03] <Not>	 [02mw-config] 07paladox opened pull request 03#4081: Set $wgParserCacheType to cache in the DB - 13https://git.io/JuCYs
[19:51:16] <icinga-miraheze>	 PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.00, 7.37, 7.70
[19:51:19] <Not>	 [02mw-config] 07paladox edited pull request 03#4081: Set $wgParserCacheType to cache in the DB - 13https://git.io/JuCYs
[19:51:53] <Not>	 [02mw-config] 07paladox commented on pull request 03#4081: Set $wgParserCacheType to cache in the DB - 13https://git.io/JuCYW
[19:52:06] <miraheze-github>	 miraheze/mw-config - paladox the build passed.
[19:55:20] <icinga-miraheze>	 PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 4.60, 6.53, 7.80
[19:56:10] <Not>	 [02mw-config] 07paladox closed pull request 03#4081: Set $wgParserCacheType to cache in the DB - 13https://git.io/JuCYs
[19:56:11] <Not>	 [02miraheze/mw-config] 07paladox deleted branch 03paladox-patch-1
[19:56:13] <Not>	 [02mw-config] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/vbvb3
[19:56:14] <Not>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JuCYS
[19:56:16] <Not>	 [02miraheze/mw-config] 07paladox 03e020ae2 - Set $wgParserCacheType to cache in the DB (#4081)
[19:57:22] <miraheze-github>	 miraheze/mw-config - paladox the build passed.
[19:57:31] <MirahezeLSBot>	 !log [paladox@test3] starting deploy of {'config': True, 'world': True, 'gitinfo': True} to skip
[19:57:38] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[19:59:11] <icinga-miraheze>	 RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.28, 5.60, 6.68
[19:59:46] <icinga-miraheze>	 PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.87, 6.43, 6.03
[19:59:57] <MirahezeLSBot>	 !log [paladox@test3] finished deploy of {'config': True, 'world': True, 'gitinfo': True} to skip - SUCCESS in 145s
[20:00:02] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[20:01:22] <icinga-miraheze>	 RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 3.55, 4.61, 6.50
[20:01:46] <icinga-miraheze>	 RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 6.27, 6.44, 6.09
[20:02:34] <JohnLewis>	 paladox: what’s the performance impact of that change?
[20:03:55] <paladox>	 JohnLewis: it should improve performance because it would have more storage to keep the cache around. Though i'm going to monitor it.
[20:04:33] <JohnLewis>	 If DB improves performance, why don’t we switch all of them to the DB?
[20:05:20] <paladox>	 good question
[20:05:47] <icinga-miraheze>	 PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 8.13, 8.20, 6.93
[20:06:12] <icinga-miraheze>	 PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 6.97, 5.95, 5.23
[20:06:39] <JohnLewis>	 Because we’d then be freeing up unnecessary resource usage if Memcached is less performant than the database itself
[20:07:03] <icinga-miraheze>	 PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.89, 6.90, 6.88
[20:07:47] <icinga-miraheze>	 PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.02, 7.73, 6.91
[20:08:09] <icinga-miraheze>	 RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 5.16, 5.60, 5.19
[20:11:04] <icinga-miraheze>	 RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 6.49, 6.62, 6.77
[20:11:48] <icinga-miraheze>	 RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 5.96, 6.80, 6.71
[20:11:50] <paladox>	 we have NVMEs so have a super fast disk anyways, i think it may be benefictial to switch everything to the DB for now as we don't have enough ram to store much things. Though that can be done later i want to see if this negatively impacts anything but i don't think it will.
[20:11:55] <paladox>	 JohnLewis: ^
[20:12:48] <JohnLewis>	 Which is why I asked about the performance impact, the latter comment suggests the answer is ‘unknown’
[20:13:51] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 9.38, 7.77, 6.45
[20:15:01] <icinga-miraheze>	 PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 8.59, 7.67, 6.21
[20:15:52] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 5.23, 6.98, 6.34
[20:16:57] <icinga-miraheze>	 PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 5.68, 6.87, 6.09
[20:18:51] <icinga-miraheze>	 RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 5.58, 6.47, 6.03
[20:20:58] <icinga-miraheze>	 PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.18, 7.06, 6.91
[20:23:00] <icinga-miraheze>	 RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.88, 6.31, 6.66
[20:23:55] <icinga-miraheze>	 RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.28, 6.36, 6.40
[20:28:16] <RhinosF1>	 paladox: why sync world & gitinfo for a config change
[20:28:22] <RhinosF1>	 Config is automated anyway
[20:28:52] <paladox>	 was just the command i had in the bash history
[20:29:07] <RhinosF1>	 Running puppet will trigger config via a subscribe set up
[20:29:40] <icinga-miraheze>	 PROBLEM - mw13 Current Load on mw13 is WARNING: WARNING - load average: 6.23, 7.10, 7.97
[20:30:27] <icinga-miraheze>	 PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 7.16, 6.88, 6.31
[20:34:17] <icinga-miraheze>	 PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 9.70, 7.88, 6.78
[20:34:51] <icinga-miraheze>	 PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.19, 6.75, 6.53
[20:35:42] <icinga-miraheze>	 PROBLEM - mw13 Current Load on mw13 is CRITICAL: CRITICAL - load average: 8.92, 7.25, 7.64
[20:37:43] <icinga-miraheze>	 PROBLEM - mw13 Current Load on mw13 is WARNING: WARNING - load average: 6.67, 7.19, 7.59
[20:38:49] <icinga-miraheze>	 RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.54, 6.17, 6.40
[20:46:48] <icinga-miraheze>	 PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.72, 7.16, 6.67
[20:50:55] <icinga-miraheze>	 PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 10.37, 8.03, 7.09
[20:52:19] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 12.78, 9.71, 7.51
[20:53:46] <icinga-miraheze>	 RECOVERY - mw13 Current Load on mw13 is OK: OK - load average: 5.11, 6.34, 6.76
[20:59:47] <icinga-miraheze>	 PROBLEM - mw13 Current Load on mw13 is CRITICAL: CRITICAL - load average: 10.17, 8.41, 7.48
[21:01:45] <icinga-miraheze>	 PROBLEM - mw13 Current Load on mw13 is WARNING: WARNING - load average: 7.33, 7.85, 7.38
[21:05:42] <icinga-miraheze>	 PROBLEM - mw13 Current Load on mw13 is CRITICAL: CRITICAL - load average: 9.28, 7.78, 7.39
[21:05:44] <icinga-miraheze>	 PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.71, 6.96, 6.30
[21:07:39] <icinga-miraheze>	 RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.56, 6.60, 6.25
[21:07:39] <icinga-miraheze>	 PROBLEM - mw13 Current Load on mw13 is WARNING: WARNING - load average: 5.36, 6.92, 7.13
[21:09:39] <icinga-miraheze>	 RECOVERY - mw13 Current Load on mw13 is OK: OK - load average: 4.25, 6.05, 6.78
[21:16:48] <icinga-miraheze>	 PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.12, 6.81, 7.82
[21:21:47] <icinga-miraheze>	 PROBLEM - mw13 Current Load on mw13 is WARNING: WARNING - load average: 7.12, 6.63, 6.48
[21:22:32] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 4.82, 6.04, 7.71
[21:25:48] <icinga-miraheze>	 PROBLEM - mw13 Current Load on mw13 is CRITICAL: CRITICAL - load average: 8.18, 7.43, 6.83
[21:31:48] <icinga-miraheze>	 PROBLEM - mw13 Current Load on mw13 is WARNING: WARNING - load average: 6.79, 7.69, 7.23
[21:32:43] <icinga-miraheze>	 RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 4.08, 4.89, 6.45
[21:32:51] <icinga-miraheze>	 RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 5.53, 5.88, 6.68
[21:34:24] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 10.56, 5.90, 4.00
[21:36:33] <icinga-miraheze>	 PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 3.20, 5.78, 7.82
[21:41:32] <icinga-miraheze>	 PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.83, 6.36, 6.50
[21:42:21] <icinga-miraheze>	 RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 4.16, 4.64, 6.63
[21:43:31] <icinga-miraheze>	 RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 5.05, 5.83, 6.29
[21:44:13] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 1.99, 3.66, 3.81
[21:46:20] <icinga-miraheze>	 RECOVERY - mw13 Current Load on mw13 is OK: OK - load average: 5.40, 6.36, 6.80
[21:50:01] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.16, 2.76, 3.37
[21:57:16] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.61, 3.15, 3.31
[21:57:44] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 3.25, 3.16, 3.29
[21:58:07] <Not>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JuCuA
[21:58:09] <Not>	 [02miraheze/mw-config] 07paladox 03a3d9ad3 - Experiment switching main cache to the DB
[21:58:10] <Not>	 [02mw-config] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vbvb3
[21:58:12] <Not>	 [02mw-config] 07paladox opened pull request 03#4082: Experiment switching main cache to the DB - 13https://git.io/JuCux
[21:58:49] <Not>	 [02puppet] 07Universal-Omega opened pull request 03#1961: mwscript: remove exception for RemovePII maintenance script - 13https://git.io/JuCuj
[21:59:21] <miraheze-github>	 miraheze/mw-config - paladox the build passed.
[22:02:11] <Not>	 [02mw-config] 07Universal-Omega closed pull request 03#4080: LocalWiki: alphabetically order wiki overrides - 13https://git.io/JuZbq
[22:02:13] <Not>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JuCzB
[22:02:14] <Not>	 [02miraheze/mw-config] 07Universal-Omega 03c84c36e - LocalWiki: alphabetically order wiki overrides (#4080)
[22:02:16] <Not>	 [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-2
[22:02:17] <Not>	 [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 - 13https://git.io/vbvb3
[22:03:17] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[22:03:20] <MirahezeLSBot>	 !log [@test3] starting deploy of {'config': True} to skip
[22:03:21] <MirahezeLSBot>	 !log [@test3] finished deploy of {'config': True} to skip - SUCCESS in 0s
[22:03:24] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[22:03:29] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[22:09:04] <Not>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://git.io/JuCgc
[22:09:05] <Not>	 [02miraheze/mw-config] 07Universal-Omega 036bceea0 - Update LocalWiki.php
[22:09:06] <Not>	 [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-2 - 13https://git.io/vbvb3
[22:09:53] <Not>	 [02mw-config] 07Universal-Omega opened pull request 03#4083: Create new defines.php; use LocalWiki.php for wiki overrides only - 13https://git.io/JuCg2
[22:10:18] <Not>	 [02mw-config] 07paladox closed pull request 03#4082: Experiment switching main cache to the DB - 13https://git.io/JuCux
[22:10:19] <Not>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JuCg1
[22:10:21] <Not>	 [02miraheze/mw-config] 07paladox 037ec9056 - Experiment switching main cache to the DB (#4082)
[22:10:22] <Not>	 [02mw-config] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/vbvb3
[22:10:24] <Not>	 [02miraheze/mw-config] 07paladox deleted branch 03paladox-patch-1
[22:10:32] <Not>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+1/-0/±0] 13https://git.io/JuCgD
[22:10:33] <Not>	 [02miraheze/mw-config] 07Universal-Omega 0370e68e3 - Create Defines.php
[22:10:35] <Not>	 [02mw-config] 07Universal-Omega synchronize pull request 03#4083: Create new defines.php; use LocalWiki.php for wiki overrides only - 13https://git.io/JuCg2
[22:10:57] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[22:11:21] <miraheze-github>	 miraheze/mw-config - paladox the build passed.
[22:11:32] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[22:11:49] <Not>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://git.io/JuCgA
[22:11:50] <Not>	 [02miraheze/mw-config] 07Universal-Omega 03e0375a7 - Update LocalSettings.php
[22:11:52] <Not>	 [02mw-config] 07Universal-Omega synchronize pull request 03#4083: Create new defines.php; use LocalWiki.php for wiki overrides only - 13https://git.io/JuCg2
[22:12:07] <Not>	 [02mw-config] 07Universal-Omega edited pull request 03#4083: Create new Defines.php; use LocalWiki.php for wiki overrides only - 13https://git.io/JuCg2
[22:12:48] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[22:13:43] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 11.30, 7.86, 6.08
[22:14:46] <icinga-miraheze>	 PROBLEM - mw13 Current Load on mw13 is CRITICAL: CRITICAL - load average: 10.21, 7.91, 6.31
[22:15:12] <icinga-miraheze>	 PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 11.15, 7.77, 5.60
[22:15:14] <icinga-miraheze>	 PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 9.01, 7.57, 5.68
[22:15:21] <icinga-miraheze>	 PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.04, 6.60, 5.03
[22:17:09] <icinga-miraheze>	 PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.76, 7.73, 5.86
[22:17:12] <icinga-miraheze>	 PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.92, 7.71, 5.95
[22:17:18] <icinga-miraheze>	 PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.60, 7.19, 5.45
[22:18:39] <icinga-miraheze>	 PROBLEM - mw13 Current Load on mw13 is WARNING: WARNING - load average: 6.64, 7.59, 6.59
[22:19:11] <icinga-miraheze>	 PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.64, 7.92, 6.15
[22:19:20] <icinga-miraheze>	 PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.76, 7.46, 5.74
[22:19:44] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.29, 7.49, 6.54
[22:21:12] <icinga-miraheze>	 PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.46, 7.77, 6.31
[22:21:14] <icinga-miraheze>	 PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 9.73, 8.01, 6.42
[22:21:48] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.23, 7.83, 6.79
[22:21:51] <icinga-miraheze>	 PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 9.03, 7.83, 6.15
[22:22:15] <Not>	 [02mw-config] 07Universal-Omega commented on pull request 03#4018: Sitenotice: Add note about PasswordPolicy changes - 13https://git.io/JuCaJ
[22:23:19] <icinga-miraheze>	 PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.76, 7.62, 6.22
[22:23:47] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.41, 7.32, 6.73
[22:23:49] <icinga-miraheze>	 PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 7.19, 7.49, 6.23
[22:25:12] <icinga-miraheze>	 PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.66, 7.73, 6.60
[22:27:12] <icinga-miraheze>	 PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.60, 7.56, 6.84
[22:27:49] <icinga-miraheze>	 PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 8.47, 7.31, 6.40
[22:29:10] <icinga-miraheze>	 PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 8.25, 7.56, 6.91
[22:29:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.71, 3.08, 2.85
[22:30:22] <icinga-miraheze>	 PROBLEM - mw13 Current Load on mw13 is CRITICAL: CRITICAL - load average: 10.58, 8.53, 7.44
[22:31:08] <icinga-miraheze>	 PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.57, 7.56, 7.01
[22:31:19] <icinga-miraheze>	 RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 6.09, 6.80, 6.42
[22:31:30] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 1.19, 2.43, 2.64
[22:31:48] <icinga-miraheze>	 PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 7.36, 7.49, 6.67
[22:33:49] <icinga-miraheze>	 PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 8.89, 7.70, 6.83
[22:33:56] <MirahezeLSBot>	 !log [@test3] starting deploy of {'config': True} to skip
[22:33:57] <MirahezeLSBot>	 !log [@test3] finished deploy of {'config': True} to skip - SUCCESS in 0s
[22:33:59] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[22:34:04] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[22:34:17] <icinga-miraheze>	 PROBLEM - mw13 Current Load on mw13 is WARNING: WARNING - load average: 6.95, 7.71, 7.35
[22:35:22] <icinga-miraheze>	 PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.38, 7.35, 6.73
[22:35:50] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 9.19, 7.66, 7.07
[22:36:13] <icinga-miraheze>	 PROBLEM - mw13 Current Load on mw13 is CRITICAL: CRITICAL - load average: 9.75, 8.49, 7.67
[22:37:18] <icinga-miraheze>	 RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.43, 6.69, 6.56
[22:37:51] <icinga-miraheze>	 PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 6.95, 7.76, 7.09
[22:37:52] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.90, 7.51, 7.11
[22:39:10] <icinga-miraheze>	 RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 6.00, 6.55, 6.73
[22:42:04] <Not>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03revert-4082-paladox-patch-1 [+0/-0/±1] 13https://git.io/JuCwE
[22:42:06] <Not>	 [02miraheze/mw-config] 07paladox 039583c5a - Revert "Experiment switching main cache to the DB (#4082)"
[22:42:07] <Not>	 [02mw-config] 07paladox created branch 03revert-4082-paladox-patch-1 - 13https://git.io/vbvb3
[22:42:33] <Not>	 [02mw-config] 07paladox opened pull request 03#4084: Revert "Experiment switching main cache to the DB" - 13https://git.io/JuCwz
[22:43:21] <icinga-miraheze>	 PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 10.11, 7.58, 6.87
[22:43:32] <miraheze-github>	 miraheze/mw-config - paladox the build passed.
[22:43:49] <icinga-miraheze>	 PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 10.66, 8.64, 7.57
[22:45:05] <icinga-miraheze>	 PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.47, 7.02, 6.88
[22:45:50] <icinga-miraheze>	 PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 6.85, 7.97, 7.46
[22:47:05] <icinga-miraheze>	 RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 5.78, 6.66, 6.77
[22:47:59] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.50, 7.89, 7.40
[22:48:27] <paladox>	 !log mem2: service memcached restart
[22:48:35] <Not>	 [02mw-config] 07paladox closed pull request 03#4084: Revert "Experiment switching main cache to the DB" - 13https://git.io/JuCwz
[22:48:36] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[22:48:37] <Not>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JuCrr
[22:48:38] <Not>	 [02miraheze/mw-config] 07paladox 034fe6378 - Revert "Experiment switching main cache to the DB (#4082)" (#4084)
[22:48:40] <Not>	 [02mw-config] 07paladox deleted branch 03revert-4082-paladox-patch-1 - 13https://git.io/vbvb3
[22:48:41] <Not>	 [02miraheze/mw-config] 07paladox deleted branch 03revert-4082-paladox-patch-1
[22:49:50] <icinga-miraheze>	 PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 10.06, 8.46, 7.72
[22:49:57] <miraheze-github>	 miraheze/mw-config - paladox the build passed.
[22:51:22] <icinga-miraheze>	 PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.01, 7.86, 7.39
[22:52:05] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 5.13, 7.07, 7.24
[22:54:05] <icinga-miraheze>	 RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 3.65, 5.84, 6.77
[22:55:20] <icinga-miraheze>	 RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.02, 6.09, 6.80
[22:55:50] <icinga-miraheze>	 PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 5.01, 7.28, 7.63
[22:57:43] <icinga-miraheze>	 PROBLEM - mw13 Current Load on mw13 is WARNING: WARNING - load average: 5.10, 6.89, 7.86
[22:58:58] <icinga-miraheze>	 PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 5.03, 6.15, 7.98
[23:01:48] <icinga-miraheze>	 RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 4.67, 5.58, 6.76
[23:03:43] <icinga-miraheze>	 RECOVERY - mw13 Current Load on mw13 is OK: OK - load average: 4.75, 5.06, 6.69
[23:04:24] <MirahezeLSBot>	 !log [@test3] starting deploy of {'config': True} to skip
[23:04:25] <MirahezeLSBot>	 !log [@test3] finished deploy of {'config': True} to skip - SUCCESS in 1s
[23:04:31] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:04:36] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:11:16] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.15, 6.77, 6.47
[23:12:53] <icinga-miraheze>	 PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 9.05, 7.67, 6.77
[23:13:39] <icinga-miraheze>	 PROBLEM - mw13 Current Load on mw13 is WARNING: WARNING - load average: 7.21, 6.97, 6.93
[23:15:21] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.13, 7.44, 6.83
[23:18:55] <icinga-miraheze>	 PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.50, 7.72, 7.14
[23:19:22] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.53, 7.46, 7.02
[23:21:00] <icinga-miraheze>	 PROBLEM - ns2 Puppet on ns2 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_dns]
[23:21:27] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.95, 7.98, 7.25
[23:21:41] <icinga-miraheze>	 PROBLEM - mw13 Current Load on mw13 is CRITICAL: CRITICAL - load average: 11.79, 8.64, 7.64
[23:21:54] <icinga-miraheze>	 PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 10.33, 7.50, 6.65
[23:22:50] <icinga-miraheze>	 PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.25, 7.63, 7.48
[23:22:51] <icinga-miraheze>	 PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 10.52, 9.00, 7.37
[23:22:56] <icinga-miraheze>	 PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 9.21, 7.52, 7.12
[23:23:00] <icinga-miraheze>	 RECOVERY - ns2 Puppet on ns2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[23:23:28] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.29, 7.64, 7.22
[23:24:49] <icinga-miraheze>	 PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.38, 7.41, 7.41
[23:25:30] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 12.06, 8.99, 7.75
[23:26:30] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.89, 3.86, 3.30
[23:26:48] <icinga-miraheze>	 PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.86, 8.33, 7.78
[23:28:24] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.68, 3.40, 3.20
[23:28:46] <icinga-miraheze>	 PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.50, 7.92, 7.69
[23:32:32] <icinga-miraheze>	 PROBLEM - cloud5 Current Load on cloud5 is CRITICAL: CRITICAL - load average: 25.15, 27.03, 21.37
[23:32:59] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.67, 3.99, 3.54
[23:33:05] <icinga-miraheze>	 PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.50, 8.13, 7.81
[23:33:11] <icinga-miraheze>	 PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.27, 7.82, 7.77
[23:35:12] <icinga-miraheze>	 PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 8.51, 8.10, 7.87
[23:36:29] <icinga-miraheze>	 PROBLEM - cloud5 Current Load on cloud5 is WARNING: WARNING - load average: 18.00, 22.67, 20.86
[23:38:51] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.20, 3.02, 3.27
[23:40:22] <icinga-miraheze>	 RECOVERY - cloud5 Current Load on cloud5 is OK: OK - load average: 16.61, 19.24, 19.86
[23:42:02] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.04, 7.33, 7.79
[23:47:06] <icinga-miraheze>	 PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.12, 7.74, 7.94
[23:51:00] <icinga-miraheze>	 PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 4.46, 6.41, 7.55
[23:51:51] <icinga-miraheze>	 PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 4.01, 6.79, 7.95
[23:54:56] <icinga-miraheze>	 RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.07, 5.05, 6.73
[23:55:59] <icinga-miraheze>	 PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 3.52, 5.25, 7.50
[23:56:14] <icinga-miraheze>	 RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 4.31, 5.31, 6.49
[23:57:51] <icinga-miraheze>	 RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 3.70, 4.70, 6.63
[23:59:53] <icinga-miraheze>	 RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.34, 4.65, 6.74