[00:04:31] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [00:12:35] PROBLEM - jobrunner3 Puppet on jobrunner3 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [00:12:41] PROBLEM - mw9 Puppet on mw9 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [00:13:48] PROBLEM - mw8 Puppet on mw8 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [00:20:04] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [00:33:41] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [00:34:36] RECOVERY - jobrunner3 Puppet on jobrunner3 is OK: OK: Puppet is currently enabled, last run 43 seconds ago with 0 failures [00:34:42] RECOVERY - mw9 Puppet on mw9 is OK: OK: Puppet is currently enabled, last run 15 seconds ago with 0 failures [00:35:47] RECOVERY - mw8 Puppet on mw8 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:54:58] RECOVERY - test3 Puppet on test3 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [01:04:47] PROBLEM - cp12 Current Load on cp12 is WARNING: WARNING - load average: 1.45, 1.72, 1.35 [01:06:45] RECOVERY - cp12 Current Load on cp12 is OK: OK - load average: 0.75, 1.36, 1.26 [01:10:41] PROBLEM - cp12 Current Load on cp12 is WARNING: WARNING - load average: 0.99, 1.88, 1.58 [01:12:39] RECOVERY - cp12 Current Load on cp12 is OK: OK - load average: 0.80, 1.59, 1.52 [01:29:59] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_36 [+0/-0/±1] 13https://git.io/JZqWb [01:30:01] [02miraheze/mediawiki] 07Universal-Omega 0380367c2 - Update ApprovedRevs [01:37:48] did you have to patch ApprovedRevs upstream, Universal_Omega? [01:38:06] dmehus: yes. And now need to do another one... [01:41:51] dmehus: https://gerrit.wikimedia.org/r/c/mediawiki/extensions/ApprovedRevs/+/698542 [01:42:54] Universal_Omega, ah, cool, that's good you're able to fix it, though. You should request merge +2 access for that extension [01:43:12] I do prefer ApprovedRevs to FlaggedRevs, though, personally [01:44:40] dmehus: in practice even if I did I would not merge own patches on gerrit. [01:45:16] Universal_Omega, oh is that because it's generally not done/frowned upon? [01:45:36] (to merge one's own patches) [01:45:37] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [01:45:47] dmehus: yes, doing so actually results in loss of merge access in some cases. [01:46:07] Universal_Omega, ah, okay, but you can still be the first +1, though, right? [01:46:16] and then you just need someone else to +1 + merge? [01:46:47] No. two C+1s does not equal C+2/merge. [01:47:26] only users with C+2 give that and then merge it dmehus [01:59:18] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [01:59:19] Universal_Omega, ah, but still it needs two C+2 users to approve, right? And what does C+1 do? [02:14:51] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [02:30:13] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JZqwR [02:30:14] [02miraheze/services] 07MirahezeSSLBot 036c3cbf4 - BOT: Updating services config for wikis [02:50:53] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [02:57:00] PROBLEM - cp12 Current Load on cp12 is CRITICAL: CRITICAL - load average: 2.88, 2.01, 1.33 [02:58:58] RECOVERY - cp12 Current Load on cp12 is OK: OK - load average: 0.78, 1.55, 1.25 [03:17:48] dmehus: it needs one C+2 User. C+1 or C-1 is just for other users to show their support/objection to the change or request changes without actually merging. [03:18:49] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [03:41:50] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [04:15:57] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [04:24:55] PROBLEM - cp12 Current Load on cp12 is CRITICAL: CRITICAL - load average: 2.05, 1.68, 1.18 [04:26:54] RECOVERY - cp12 Current Load on cp12 is OK: OK - load average: 1.05, 1.38, 1.12 [04:45:09] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [04:45:37] [02puppet] 07Universal-Omega opened pull request 03#1774: Don't allow RemovePII to ever be ran with mwscript - 13https://git.io/JZmf8 [04:46:00] [02puppet] 07Universal-Omega synchronize pull request 03#1774: Don't allow RemovePII to ever be ran with mwscript - 13https://git.io/JZmf8 [04:47:15] [02puppet] 07Universal-Omega synchronize pull request 03#1774: Don't allow RemovePII to ever be ran with mwscript - 13https://git.io/JZmf8 [04:51:19] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_36 [+0/-0/±1] 13https://git.io/JZmJX [04:51:20] [02miraheze/mediawiki] 07Universal-Omega 03242c8f5 - Update ApprovedRevs [04:55:18] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_35 [+0/-0/±1] 13https://git.io/JZmU3 [04:55:19] [02miraheze/mediawiki] 07Universal-Omega 03cc54a9e - Update Cosmos [05:11:47] PROBLEM - mw8 Puppet on mw8 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [05:12:35] PROBLEM - jobrunner3 Puppet on jobrunner3 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [05:12:41] PROBLEM - mw9 Puppet on mw9 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [05:19:14] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [05:34:35] RECOVERY - jobrunner3 Puppet on jobrunner3 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [05:34:40] RECOVERY - mw9 Puppet on mw9 is OK: OK: Puppet is currently enabled, last run 37 seconds ago with 0 failures [05:35:46] RECOVERY - mw8 Puppet on mw8 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [05:55:13] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [06:27:19] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_35 [+0/-0/±1] 13https://git.io/JZmlA [06:27:21] [02miraheze/mediawiki] 07Universal-Omega 039033e8f - Update Cosmos [06:29:15] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [06:29:37] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_36 [+0/-0/±1] 13https://git.io/JZm8Z [06:29:39] [02miraheze/mediawiki] 07Universal-Omega 03e20eea5 - Update Cosmos [06:38:01] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [06:40:41] PROBLEM - mw9 Puppet on mw9 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [06:41:47] PROBLEM - mw8 Puppet on mw8 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [06:42:35] PROBLEM - jobrunner3 Puppet on jobrunner3 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [06:51:37] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [06:53:43] !log sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildLocalisationCache.php --wiki=loginwiki on mw* / jbr* / test3 [06:53:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:56:45] RhinosF1: do you mind taking a look at https://github.com/miraheze/puppet/pull/1774 ? I'll close if it is not needed but thought that might be a good idea. [06:58:54] Universal_Omega: good idea and yeah looks fine [07:00:33] RhinosF1: Great! Thanks! [07:03:47] RECOVERY - mw8 Puppet on mw8 is OK: OK: Puppet is currently enabled, last run 2 seconds ago with 0 failures [07:04:36] RECOVERY - jobrunner3 Puppet on jobrunner3 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [07:04:40] RECOVERY - mw9 Puppet on mw9 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [07:13:58] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [07:33:46] Hey, do you know when someone will be able to resolve this task? https://phabricator.miraheze.org/T7386#147373 I know it's not a high priority, but I seems like a simple fix and I would highly appreciate if it was fixed soon. 🙇‍♂️ [07:36:28] @MarkusRost: I would look into it now, but I don't know enough about OAuth to look into it, but I can see what I can do sometime later this week, though no promises that I'll figure it out, but I will definitely try if no one else does. [07:40:11] Thanks a lot, based on the comment it seems to be just missing the public and private keys [07:41:12] Yeah. That seems to be right, I'm just not sure how to go about setting those but I'll definitely take a look this week if no one else does. [07:58:04] PROBLEM - ping4 on cp3 is WARNING: PING WARNING - Packet loss = 0%, RTA = 314.22 ms [08:00:08] RECOVERY - ping4 on cp3 is OK: PING OK - Packet loss = 0%, RTA = 238.85 ms [08:28:51] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [09:11:41] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [09:25:18] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [09:34:03] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [09:42:26] [02puppet] 07paladox closed pull request 03#1774: Don't allow RemovePII to ever be ran with mwscript - 13https://git.io/JZmf8 [09:42:28] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JZYth [09:42:29] [02miraheze/puppet] 07Universal-Omega 030e3f5a7 - Don't allow RemovePII to ever be ran with mwscript (#1774) [09:47:41] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [10:23:41] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [10:50:53] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [10:53:13] Ty paladox [11:06:25] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [11:20:02] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [11:23:37] PROBLEM - db1.miraheze.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'miraheze.wiki' expires in 15 day(s) (Thu 24 Jun 2021 11:21:27 GMT +0000). [11:26:04] PROBLEM - bots.miraheze.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'miraheze.wiki' expires in 15 day(s) (Thu 24 Jun 2021 11:21:27 GMT +0000). [11:26:24] PROBLEM - bots1.miraheze.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'miraheze.wiki' expires in 15 day(s) (Thu 24 Jun 2021 11:21:27 GMT +0000). [11:27:27] PROBLEM - miraheze.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'miraheze.wiki' expires in 15 day(s) (Thu 24 Jun 2021 11:21:27 GMT +0000). [11:28:20] PROBLEM - tools1.miraheze.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'miraheze.wiki' expires in 15 day(s) (Thu 24 Jun 2021 11:21:27 GMT +0000). [11:41:28] [02miraheze/dns] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JZYiU [11:41:29] [02miraheze/dns] 07paladox 03b28ae5f - Add acme challenge for miraheze.wiki [11:42:29] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [11:45:27] [02miraheze/ssl] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JZYPT [11:45:29] [02miraheze/ssl] 07paladox 03dcd54f0 - Update miraheze.wiki.crt [11:46:57] RECOVERY - bots.miraheze.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'miraheze.wiki' will expire on Mon 06 Sep 2021 10:42:56 GMT +0000. [11:47:16] RECOVERY - bots1.miraheze.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'miraheze.wiki' will expire on Mon 06 Sep 2021 10:42:56 GMT +0000. [11:48:15] RECOVERY - miraheze.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'miraheze.wiki' will expire on Mon 06 Sep 2021 10:42:56 GMT +0000. [11:48:38] RECOVERY - tools1.miraheze.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'miraheze.wiki' will expire on Mon 06 Sep 2021 10:42:56 GMT +0000. [11:51:19] RECOVERY - db1.miraheze.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'miraheze.wiki' will expire on Mon 06 Sep 2021 10:42:56 GMT +0000. [12:30:02] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [12:38:49] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [13:28:08] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.34, 6.62, 5.65 [13:30:07] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 4.73, 5.85, 5.49 [13:55:50] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [14:04:05] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 9.29, 7.62, 6.21 [14:04:37] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.69, 7.18, 6.07 [14:06:05] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.50, 7.01, 6.15 [14:08:05] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 6.35, 6.68, 6.13 [14:08:25] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 4.79, 6.06, 5.87 [14:25:49] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [14:30:21] !log puppet3: upgrade puppetdb-termini [14:30:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:37:40] !log mon2: upgrade icinga2 icinga2-bin icinga2-common icinga2-doc icinga2-ido-mysql [14:37:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:43:25] !log mon2: upgrade grafana puppet-agent [14:43:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:54:38] PROBLEM - puppet3 Puppet on puppet3 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[postgresql-contrib-11] [14:59:46] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.06, 6.70, 6.07 [15:01:40] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.56, 6.20, 5.96 [15:07:42] Universal_Omega, ah, okay, that makes sense. So what about requesting C+1 or C-1 then? [15:13:56] dmehus: most people have +1/-1 everywhere [15:13:59] Context? [15:19:32] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [15:19:34] RhinosF1, oh just replying to Universal_Omega's question above, no big deal [15:19:53] dmehus: which question? [15:20:55] RhinosF1: \/ [15:20:55] ```Universal_Omega> [15:20:55] dmehus: it needs one C+2 User. C+1 or C-1 is just for other users to show their support/objection to the change or request changes without actually merging.``` [15:21:58] I just read wm-bot logs [15:22:36] RECOVERY - puppet3 Puppet on puppet3 is OK: OK: Puppet is currently enabled, last run 30 seconds ago with 0 failures [15:24:18] Anyone should have -1..+1 [15:28:00] [02mediawiki] 07R4356th opened pull request 03#2235: T7426: Install CountDownClock - 13https://git.io/JZOBG [15:28:07] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [15:41:27] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [15:42:09] @R4356th: against 1.36 too please [15:50:02] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [16:04:49] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.80, 6.98, 6.11 [16:04:59] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.10, 7.42, 6.28 [16:06:49] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 10.77, 8.04, 6.57 [16:06:55] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.99, 8.05, 6.64 [16:08:47] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 5.95, 7.50, 6.59 [16:08:49] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 5.58, 7.03, 6.43 [16:10:44] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 4.02, 6.04, 6.14 [16:10:44] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 5.17, 6.69, 6.39 [16:14:40] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 12.90, 9.34, 7.47 [16:14:45] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 11.11, 8.08, 6.89 [16:16:33] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.83, 6.96, 5.83 [16:17:05] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.34, 7.03, 6.18 [16:20:43] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 5.55, 7.94, 7.32 [16:21:04] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.26, 6.36, 6.18 [16:22:24] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.53, 7.57, 6.54 [16:23:24] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [16:24:28] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.05, 7.71, 7.71 [16:24:43] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.93, 7.77, 7.34 [16:25:14] RhinosF1: I have not forgotten despite the late response. 🙂 [16:25:31] Don't worry [16:26:15] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.52, 5.99, 6.13 [16:26:43] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 5.61, 7.02, 7.12 [16:27:35] [02mediawiki] 07R4356th opened pull request 03#2236: T7426: Install CountDownClock - 13https://git.io/JZOiP [16:28:18] [02mediawiki] 07R4356th synchronize pull request 03#2236: T7426: Install CountDownClock - 13https://git.io/JZOiP [16:29:29] [02mediawiki] 07R4356th synchronize pull request 03#2236: T7426: Install CountDownClock - 13https://git.io/JZOiP [16:30:14] [02mediawiki] 07R4356th synchronize pull request 03#2235: T7426: Install CountDownClock - 13https://git.io/JZOBG [16:30:43] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 4.42, 5.93, 6.69 [16:34:15] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 8.25, 6.94, 7.13 [16:36:12] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 5.36, 6.38, 6.90 [16:38:10] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 3.75, 5.45, 6.50 [16:52:18] [02mediawiki] 07Universal-Omega reviewed pull request 03#2235 commit - 13https://git.io/JZOSM [16:52:20] [02mediawiki] 07Universal-Omega reviewed pull request 03#2235 commit - 13https://git.io/JZOSD [16:54:46] [02mediawiki] 07Universal-Omega reviewed pull request 03#2236 commit - 13https://git.io/JZO9G [17:01:38] [02mediawiki] 07R4356th synchronize pull request 03#2236: T7426: Install CountDownClock - 13https://git.io/JZOiP [17:01:55] [02mediawiki] 07R4356th reviewed pull request 03#2236 commit - 13https://git.io/JZOH1 [17:02:33] [02mediawiki] 07R4356th reviewed pull request 03#2235 commit - 13https://git.io/JZOHb [17:02:58] [02mediawiki] 07R4356th synchronize pull request 03#2235: T7426: Install CountDownClock - 13https://git.io/JZOBG [17:03:35] [02mediawiki] 07R4356th reviewed pull request 03#2235 commit - 13https://git.io/JZOQT [17:05:52] [02mw-config] 07R4356th opened pull request 03#3942: Add CountDownClock - 13https://git.io/JZOQ2 [17:06:46] miraheze/mw-config - R4356th the build passed. [17:08:28] [02mediawiki] 07Universal-Omega reviewed pull request 03#2236 commit - 13https://git.io/JZO7L [17:09:12] [02mediawiki] 07Universal-Omega closed pull request 03#2236: T7426: Install CountDownClock - 13https://git.io/JZOiP [17:09:14] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_36 [+1/-0/±1] 13https://git.io/JZO7O [17:09:16] [02miraheze/mediawiki] 07R4356th 035850b9e - T7426: Install CountDownClock (#2236) [17:09:42] [02mw-config] 07R4356th synchronize pull request 03#3942: Add CountDownClock - 13https://git.io/JZOQ2 [17:09:58] [02mediawiki] 07Universal-Omega reviewed pull request 03#2235 commit - 13https://git.io/JZO7W [17:10:05] [02mediawiki] 07Universal-Omega reviewed pull request 03#2235 commit - 13https://git.io/JZO7W [17:10:38] [02mediawiki] 07Universal-Omega reviewed pull request 03#2235 commit - 13https://git.io/JZO7B [17:10:39] miraheze/mw-config - R4356th the build passed. [17:11:52] [02mw-config] 07R4356th synchronize pull request 03#3942: Add CountDownClock - 13https://git.io/JZOQ2 [17:12:20] [02mediawiki] 07Universal-Omega commented on pull request 03#2217: Bump extensions/MirahezeMagic from `8068d57` to `f1259cd` - 13https://git.io/JZO76 [17:12:22] [02mediawiki] 07dependabot[bot] edited pull request 03#2217: Bump extensions/MirahezeMagic from `8068d57` to `f1259cd` - 13https://git.io/JZUV2 [17:12:39] [02mediawiki] 07Universal-Omega closed pull request 03#2226: Bump extensions/SocialProfile from `1f972d8` to `2b90f5b` - 13https://git.io/JZUwk [17:12:40] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_36 [+0/-0/±1] 13https://git.io/JZO7y [17:12:42] [02miraheze/mediawiki] 07dependabot[bot] 03bf1aa45 - Bump extensions/SocialProfile from `1f972d8` to `2b90f5b` (#2226) [17:12:42] miraheze/mw-config - R4356th the build passed. [17:12:43] [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_36/extensions/SocialProfile-2b90f5b - 13https://git.io/vbL5b [17:12:45] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_36/extensions/SocialProfile-2b90f5b [17:12:58] [02mediawiki] 07Universal-Omega closed pull request 03#2223: Bump extensions/Video from `fad5983` to `a22d31c` - 13https://git.io/JZUVN [17:13:00] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_36 [+0/-0/±1] 13https://git.io/JZO7Q [17:13:01] [02miraheze/mediawiki] 07dependabot[bot] 03b4cfe63 - Bump extensions/Video from `fad5983` to `a22d31c` (#2223) [17:13:03] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_36/extensions/Video-a22d31c [17:13:04] [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_36/extensions/Video-a22d31c - 13https://git.io/vbL5b [17:13:06] [02mediawiki] 07dependabot[bot] edited pull request 03#2217: Bump extensions/MirahezeMagic from `8068d57` to `f1259cd` - 13https://git.io/JZUV2 [17:13:08] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_36/extensions/MirahezeMagic-82e8eb0 [+0/-0/±1] 13https://git.io/JZO75 [17:13:10] [02miraheze/mediawiki] 07dependabot[bot] 0304e9beb - Bump extensions/MirahezeMagic from `8068d57` to `82e8eb0` [17:13:11] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_36/extensions/MirahezeMagic-82e8eb0 - 13https://git.io/vbL5b [17:13:13] [02mediawiki] 07dependabot[bot] opened pull request 03#2237: Bump extensions/MirahezeMagic from `8068d57` to `82e8eb0` - 13https://git.io/JZO7d [17:13:14] [02mediawiki] 07dependabot[bot] labeled pull request 03#2237: Bump extensions/MirahezeMagic from `8068d57` to `82e8eb0` - 13https://git.io/JZO7d [17:13:16] [02mediawiki] 07dependabot[bot] labeled pull request 03#2237: Bump extensions/MirahezeMagic from `8068d57` to `82e8eb0` - 13https://git.io/JZO7d [17:13:17] [02mediawiki] 07dependabot[bot] commented on pull request 03#2217: Bump extensions/MirahezeMagic from `8068d57` to `f1259cd` - 13https://git.io/JZO7F [17:13:19] [02mediawiki] 07Universal-Omega closed pull request 03#2225: Bump skins/Citizen from `62f161f` to `6d7ed3c` - 13https://git.io/JZUwf [17:13:20] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_36 [+0/-0/±1] 13https://git.io/JZO7b [17:13:22] [02miraheze/mediawiki] 07dependabot[bot] 03dae2f91 - Bump skins/Citizen from `62f161f` to `6d7ed3c` (#2225) [17:13:23] [02mediawiki] 07dependabot[bot] closed pull request 03#2217: Bump extensions/MirahezeMagic from `8068d57` to `f1259cd` - 13https://git.io/JZUV2 [17:13:25] [02mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_36/extensions/MirahezeMagic-f1259cd - 13https://git.io/vbL5b [17:13:26] [02miraheze/mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_36/extensions/MirahezeMagic-f1259cd [17:13:28] [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_36/skins/Citizen-6d7ed3c - 13https://git.io/vbL5b [17:13:29] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_36/skins/Citizen-6d7ed3c [17:13:31] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_36 [+0/-0/±1] 13https://git.io/JZO7A [17:13:32] [02miraheze/mediawiki] 07dependabot[bot] 034f10e0f - Bump extensions/MirahezeMagic from `8068d57` to `82e8eb0` (#2237) [17:13:34] [02mediawiki] 07Universal-Omega closed pull request 03#2237: Bump extensions/MirahezeMagic from `8068d57` to `82e8eb0` - 13https://git.io/JZO7d [17:13:35] [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_36/extensions/MirahezeMagic-82e8eb0 - 13https://git.io/vbL5b [17:13:37] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_36/extensions/MirahezeMagic-82e8eb0 [17:13:49] [02mediawiki] 07Universal-Omega closed pull request 03#2230: Bump extensions/CreateWiki from `d182961` to `9b0649b` - 13https://git.io/JZUwl [17:13:51] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_36 [+0/-0/±1] 13https://git.io/JZO5U [17:13:52] [02miraheze/mediawiki] 07dependabot[bot] 03702383d - Bump extensions/CreateWiki from `d182961` to `9b0649b` (#2230) [17:13:54] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_36/extensions/CreateWiki-9b0649b [17:13:55] [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_36/extensions/CreateWiki-9b0649b - 13https://git.io/vbL5b [17:14:02] [02mediawiki] 07Universal-Omega closed pull request 03#2234: Bump extensions/HAWelcome from `9cacb5f` to `4216d02` - 13https://git.io/JZUwK [17:14:03] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_36 [+0/-0/±1] 13https://git.io/JZO5k [17:14:05] [02miraheze/mediawiki] 07dependabot[bot] 03a5d6984 - Bump extensions/HAWelcome from `9cacb5f` to `4216d02` (#2234) [17:14:06] [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_36/extensions/HAWelcome-4216d02 - 13https://git.io/vbL5b [17:14:08] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_36/extensions/HAWelcome-4216d02 [17:14:15] [02mediawiki] 07Universal-Omega closed pull request 03#2224: Bump extensions/Maps from `111f30c` to `31f7611` - 13https://git.io/JZUVh [17:14:16] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_36 [+0/-0/±1] 13https://git.io/JZO5q [17:14:18] [02miraheze/mediawiki] 07dependabot[bot] 03037710e - Bump extensions/Maps from `111f30c` to `31f7611` (#2224) [17:14:19] [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_36/extensions/Maps-31f7611 - 13https://git.io/vbL5b [17:14:21] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_36/extensions/Maps-31f7611 [17:14:36] [02mediawiki] 07Universal-Omega closed pull request 03#2222: Bump skins/Femiwiki from `5a7e410` to `3a71dbb` - 13https://git.io/JZUV5 [17:14:38] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_36 [+0/-0/±1] 13https://git.io/JZO5O [17:14:39] [02miraheze/mediawiki] 07dependabot[bot] 0309e1980 - Bump skins/Femiwiki from `5a7e410` to `3a71dbb` (#2222) [17:14:41] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_36/skins/Femiwiki-3a71dbb [17:14:42] [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_36/skins/Femiwiki-3a71dbb - 13https://git.io/vbL5b [17:16:02] [02mediawiki] 07Universal-Omega closed pull request 03#2221: Bump extensions/UniversalLanguageSelector from `8354e28` to `0c45465` - 13https://git.io/JZUVS [17:16:04] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_36 [+0/-0/±1] 13https://git.io/JZO5R [17:16:05] [02miraheze/mediawiki] 07dependabot[bot] 03f1b619d - Bump extensions/UniversalLanguageSelector from `8354e28` to `0c45465` (#2221) [17:16:07] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_36/extensions/UniversalLanguageSelector-0c45465 [17:16:08] [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_36/extensions/UniversalLanguageSelector-0c45465 - 13https://git.io/vbL5b [17:16:14] [02mediawiki] 07Universal-Omega closed pull request 03#2220: Bump extensions/QuizGame from `381c7c3` to `16166eb` - 13https://git.io/JZUV1 [17:16:16] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_36 [+0/-0/±1] 13https://git.io/JZO5E [17:16:17] [02miraheze/mediawiki] 07dependabot[bot] 031eeaf7a - Bump extensions/QuizGame from `381c7c3` to `16166eb` (#2220) [17:16:19] [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_36/extensions/QuizGame-16166eb - 13https://git.io/vbL5b [17:16:20] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_36/extensions/QuizGame-16166eb [17:18:29] [02mediawiki] 07Universal-Omega closed pull request 03#2215: Bump extensions/Translate from `d8a8107` to `7f50861` - 13https://git.io/JZUV8 [17:18:33] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_36 [+0/-0/±1] 13https://git.io/JZO5M [17:18:33] [02miraheze/mediawiki] 07dependabot[bot] 033321a8e - Bump extensions/Translate from `d8a8107` to `7f50861` (#2215) [17:18:33] [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_36/extensions/Translate-7f50861 - 13https://git.io/vbL5b [17:18:35] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_36/extensions/Translate-7f50861 [17:20:14] [02mediawiki] 07Universal-Omega synchronize pull request 03#2235: T7426: Install CountDownClock - 13https://git.io/JZOBG [17:21:28] [02mediawiki] 07Universal-Omega closed pull request 03#2235: T7426: Install CountDownClock - 13https://git.io/JZOBG [17:21:30] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_35 [+1/-0/±1] 13https://git.io/JZOdL [17:21:31] [02miraheze/mediawiki] 07R4356th 032687132 - T7426: Install CountDownClock (#2235) [17:22:53] [02mw-config] 07Universal-Omega opened pull request 03#3943: Merge branch 'master' into REL1_36 - 13https://git.io/JZOd8 [17:23:53] miraheze/mw-config - Universal-Omega the build passed. [17:24:13] [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-3 [17:24:14] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JZOdw [17:24:16] [02miraheze/mw-config] 07Universal-Omega 03eb78a14 - Blacklist centralauth-createlocal right (#3929) [17:24:17] [02mw-config] 07Universal-Omega closed pull request 03#3929: Blacklist centralauth-createlocal right - 13https://git.io/JGsTM [17:24:19] [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-3 - 13https://git.io/vbvb3 [17:24:20] [02mw-config] 07Universal-Omega synchronize pull request 03#3943: Merge branch 'master' into REL1_36 - 13https://git.io/JZOd8 [17:25:10] miraheze/mw-config - Universal-Omega the build passed. [17:25:16] miraheze/mw-config - Universal-Omega the build passed. [17:26:46] [02mw-config] 07Universal-Omega closed pull request 03#3943: Merge branch 'master' into REL1_36 - 13https://git.io/JZOd8 [17:26:48] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03REL1_36 [+0/-0/±3] 13https://git.io/JZOdp [17:26:49] [02miraheze/mw-config] 07Universal-Omega 03e3631ff - Merge branch 'master' into REL1_36 (#3943) [17:26:51] [02mw-config] 07Universal-Omega synchronize pull request 03#3824: Update config for 1.36 - 13https://git.io/JYjbk [17:27:49] miraheze/mw-config - Universal-Omega the build passed. [17:33:56] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 10.79, 7.59, 6.10 [17:35:07] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 9.12, 7.68, 6.51 [17:35:11] [02mw-config] 07Universal-Omega reviewed pull request 03#3942 commit - 13https://git.io/JZONa [17:35:57] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.61, 7.65, 6.32 [17:37:11] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 9.15, 8.41, 6.91 [17:39:03] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.42, 7.24, 5.94 [17:39:38] PROBLEM - test3 Puppet on test3 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [17:40:38] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [17:41:04] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.56, 7.05, 6.04 [17:41:29] PROBLEM - jobrunner3 Puppet on jobrunner3 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [17:41:51] PROBLEM - mw10 Puppet on mw10 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [17:41:59] PROBLEM - mw8 Puppet on mw8 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [17:42:14] PROBLEM - jobrunner4 Puppet on jobrunner4 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [17:42:22] PROBLEM - mw9 Puppet on mw9 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [17:42:47] PROBLEM - mw11 Puppet on mw11 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [17:45:57] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.87, 6.77, 6.63 [17:47:04] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.70, 6.41, 6.12 [17:47:06] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.98, 7.67, 7.42 [17:49:04] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 9.53, 8.01, 7.55 [17:53:03] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.64, 8.02, 6.86 [17:55:04] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.99, 7.51, 6.81 [18:00:43] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.35, 7.27, 7.84 [18:01:04] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.07, 6.52, 6.65 [18:03:05] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.64, 7.99, 7.97 [18:04:13] RECOVERY - jobrunner4 Puppet on jobrunner4 is OK: OK: Puppet is currently enabled, last run 55 seconds ago with 0 failures [18:04:43] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 10.52, 8.68, 8.23 [18:05:04] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 11.97, 9.82, 8.66 [18:05:37] RECOVERY - jobrunner3 Puppet on jobrunner3 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [18:05:39] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.38, 7.97, 7.10 [18:05:52] RECOVERY - mw10 Puppet on mw10 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [18:06:01] RECOVERY - mw8 Puppet on mw8 is OK: OK: Puppet is currently enabled, last run 57 seconds ago with 0 failures [18:06:20] RECOVERY - mw9 Puppet on mw9 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [18:06:47] RECOVERY - mw11 Puppet on mw11 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [18:07:02] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.54, 7.27, 6.96 [18:07:36] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.76, 6.77, 6.76 [18:08:43] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.08, 7.66, 7.94 [18:11:04] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.09, 6.21, 6.62 [18:11:05] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.83, 7.36, 7.91 [18:13:59] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [18:14:43] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 9.26, 6.94, 7.40 [18:16:43] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.62, 6.63, 7.23 [18:20:05] [02puppet] 07Universal-Omega synchronize pull request 03#1772: Deny access to /srv/mediawiki/cache - 13https://git.io/JZt3Y [18:20:16] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.61, 6.98, 6.75 [18:21:22] [02puppet] 07Universal-Omega edited pull request 03#1772: Create writable directory /srv/mediawiki/cache and deny access to it - 13https://git.io/JZt3Y [18:22:12] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.28, 6.29, 6.52 [18:24:43] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.78, 7.64, 7.38 [18:25:05] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 6.00, 6.13, 6.80 [18:26:26] [02puppet] 07Universal-Omega synchronize pull request 03#1772: Create writable directory /srv/mediawiki/cache and deny access to it - 13https://git.io/JZt3Y [18:26:43] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.45, 7.17, 7.24 [18:27:21] [02puppet] 07Universal-Omega synchronize pull request 03#1772: Create writable directory /srv/mediawiki/cache and deny access to it - 13https://git.io/JZt3Y [18:29:17] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [18:29:25] [02puppet] 07Universal-Omega synchronize pull request 03#1772: Create writable directory /srv/mediawiki/cache and deny access to it - 13https://git.io/JZt3Y [18:30:19] [02puppet] 07Universal-Omega synchronize pull request 03#1772: Create writable directory /srv/mediawiki/cache and deny access to it - 13https://git.io/JZt3Y [18:30:43] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.01, 6.00, 6.74 [18:30:55] [02puppet] 07Universal-Omega synchronize pull request 03#1772: Create writable directory /srv/mediawiki/cache and deny access to it - 13https://git.io/JZt3Y [18:34:43] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 9.56, 8.59, 7.64 [18:35:58] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.44, 7.72, 6.83 [18:37:58] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.92, 6.63, 6.54 [18:37:58] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 8.06, 7.65, 7.12 [18:38:43] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 5.25, 7.95, 7.69 [18:39:52] [02puppet] 07Universal-Omega opened pull request 03#1775: Delete check_jobqueue - 13https://git.io/JZ3ko [18:39:56] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 5.98, 6.95, 6.92 [18:41:53] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 4.53, 6.21, 6.66 [18:44:43] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.73, 5.90, 6.78 [18:47:52] [02puppet] 07Universal-Omega synchronize pull request 03#1775: Delete check_jobqueue - 13https://git.io/JZ3ko [18:49:54] [02puppet] 07Universal-Omega edited pull request 03#1772: T7192: Move cache out of w/ directory - 13https://git.io/JZt3Y [19:02:38] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [19:11:12] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [19:17:43] [02mw-config] 07R4356th synchronize pull request 03#3942: Add CountDownClock - 13https://git.io/JZOQ2 [19:18:39] miraheze/mw-config - R4356th the build passed. [19:18:40] [02mw-config] 07R4356th reviewed pull request 03#3942 commit - 13https://git.io/JZ3Yb [19:19:15] [02mw-config] 07R4356th reviewed pull request 03#3942 commit - 13https://git.io/JZ3Yb [19:39:01] [02mw-config] 07Universal-Omega reviewed pull request 03#3942 commit - 13https://git.io/JZ3Gj [20:05:33] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.28, 6.30, 5.61 [20:07:31] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 5.39, 5.92, 5.56 [20:23:35] I'm back [20:24:51] Hi 👋 [20:34:43] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 9.65, 7.02, 5.87 [20:36:26] Hey Southparkfan [20:38:43] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.57, 7.25, 6.26 [20:44:29] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [20:44:43] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 4.96, 6.13, 6.13 [20:53:07] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [20:55:48] PROBLEM - podpedia.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for podpedia.org could not be found [20:56:11] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 9.74, 7.90, 6.65 [20:56:32] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.02, 8.24, 6.66 [20:56:46] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 9.65, 9.26, 7.51 [20:57:09] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.53, 8.74, 6.84 [20:59:40] PROBLEM - ethene.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for ethene.wiki could not be found [20:59:40] PROBLEM - private.revi.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for private.revi.wiki could not be found [20:59:41] PROBLEM - www.electrowiki.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.electrowiki.org could not be found [20:59:41] PROBLEM - ref.undu.st - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for ref.undu.st could not be found [20:59:41] PROBLEM - wiki.landev.vn - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.landev.vn could not be found [20:59:42] PROBLEM - wiki.consid.vn - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.consid.vn could not be found [21:02:30] RECOVERY - podpedia.org - reverse DNS on sslhost is OK: rDNS OK - podpedia.org reverse DNS resolves to cp13.miraheze.org [21:05:03] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 5.47, 7.17, 6.98 [21:06:01] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 4.78, 7.51, 7.50 [21:06:10] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 5.43, 7.37, 7.15 [21:06:32] RECOVERY - ethene.wiki - reverse DNS on sslhost is OK: rDNS OK - ethene.wiki reverse DNS resolves to cp13.miraheze.org [21:06:34] RECOVERY - private.revi.wiki - reverse DNS on sslhost is OK: rDNS OK - private.revi.wiki reverse DNS resolves to cp13.miraheze.org [21:06:35] RECOVERY - www.electrowiki.org - reverse DNS on sslhost is OK: rDNS OK - www.electrowiki.org reverse DNS resolves to cp13.miraheze.org [21:06:35] RECOVERY - ref.undu.st - reverse DNS on sslhost is OK: rDNS OK - ref.undu.st reverse DNS resolves to cp13.miraheze.org [21:06:36] RECOVERY - wiki.landev.vn - reverse DNS on sslhost is OK: rDNS OK - wiki.landev.vn reverse DNS resolves to cp13.miraheze.org [21:06:36] RECOVERY - wiki.consid.vn - reverse DNS on sslhost is OK: rDNS OK - wiki.consid.vn reverse DNS resolves to cp13.miraheze.org [21:07:04] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.29, 6.10, 6.61 [21:08:08] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 9.73, 7.70, 7.26 [21:09:59] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 9.85, 8.49, 7.84 [21:11:06] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.92, 7.14, 6.97 [21:12:01] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 4.90, 7.25, 7.28 [21:14:00] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 9.87, 8.51, 7.75 [21:15:03] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.84, 8.01, 7.32 [21:15:36] PROBLEM - aman.awiki.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for aman.awiki.org could not be found [21:15:38] PROBLEM - savagepedia.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for savagepedia.wiki could not be found [21:15:38] PROBLEM - wiki.triplescripts.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.triplescripts.org could not be found [21:15:56] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.10, 7.81, 7.61 [21:17:04] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.06, 7.13, 7.07 [21:19:04] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.66, 6.24, 6.75 [21:19:51] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 5.53, 7.47, 7.86 [21:21:48] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 12.83, 9.76, 8.66 [21:21:57] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 12.33, 8.59, 7.77 [21:22:20] RECOVERY - aman.awiki.org - reverse DNS on sslhost is OK: rDNS OK - aman.awiki.org reverse DNS resolves to cp13.miraheze.org [21:22:25] RECOVERY - savagepedia.wiki - reverse DNS on sslhost is OK: rDNS OK - savagepedia.wiki reverse DNS resolves to cp13.miraheze.org [21:22:26] RECOVERY - wiki.triplescripts.org - reverse DNS on sslhost is OK: rDNS OK - wiki.triplescripts.org reverse DNS resolves to cp13.miraheze.org [21:23:04] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 12.55, 9.54, 7.93 [21:25:56] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 4.55, 6.95, 7.36 [21:26:29] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [21:27:02] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 3.99, 6.61, 7.10 [21:27:40] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 5.18, 7.00, 7.85 [21:28:43] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 5.04, 6.75, 7.90 [21:29:02] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 3.86, 5.61, 6.66 [21:29:56] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.18, 5.30, 6.58 [21:37:30] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 5.68, 5.70, 6.74 [21:38:43] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.78, 5.46, 6.66 [22:03:08] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [22:06:31] [02mw-config] 07Universal-Omega closed pull request 03#3942: Add CountDownClock - 13https://git.io/JZOQ2 [22:06:33] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±4] 13https://git.io/JZ3oB [22:06:34] [02miraheze/mw-config] 07R4356th 03698d4e7 - Add CountDownClock (#3942) [22:07:23] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JZ3oz [22:07:25] [02miraheze/mw-config] 07Universal-Omega 036975850 - Reorder [22:07:28] miraheze/mw-config - Universal-Omega the build passed. [22:08:23] miraheze/mw-config - Universal-Omega the build passed. [22:16:27] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [22:16:44] [02mw-config] 07Universal-Omega commented on pull request 03#3926: Set WebChat to default to Libera - 13https://git.io/JZ3KC [22:17:54] [02mw-config] 07Universal-Omega commented on pull request 03#3890: T7192: Move cache out of w/ directory - 13https://git.io/JZ3Kg [22:28:50] [02puppet] 07paladox closed pull request 03#1775: Delete check_jobqueue - 13https://git.io/JZ3ko [22:28:52] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-1/±1] 13https://git.io/JZ36n [22:28:53] [02miraheze/puppet] 07Universal-Omega 0379340d4 - Delete check_jobqueue (#1775) [22:30:43] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 9.25, 7.70, 6.34 [22:31:43] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [22:31:51] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 12.00, 7.79, 6.31 [22:32:05] !log deleting typedesign per T&S [22:32:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:32:38] !log deleting moretypedesign per T&S [22:32:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:35:12] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JZ3ib [22:35:13] [02miraheze/services] 07MirahezeSSLBot 032a55062 - BOT: Updating services config for wikis [22:36:00] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 11.68, 8.48, 6.25 [22:37:53] PROBLEM - mw9 Disk Space on mw9 is WARNING: DISK WARNING - free space: / 2082 MB (10% inode=70%); [22:37:56] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.53, 7.92, 6.31 [22:39:53] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 14.31, 9.46, 7.02 [22:39:55] RECOVERY - mw9 Disk Space on mw9 is OK: DISK OK - free space: / 2100 MB (11% inode=70%); [22:41:50] [02mw-config] 07Universal-Omega opened pull request 03#3944: Merge branch 'master' into REL1_36 - 13https://git.io/JZ3PM [22:42:24] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 3 datacenters are down: 128.199.139.216/cpweb, 51.38.69.175/cpweb, 51.222.25.132/cpweb [22:42:30] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 9.59, 9.27, 6.82 [22:42:35] [02miraheze/mw-config] 07Universal-Omega created branch 03merge-master 13https://git.io/JZ3P5 [22:42:37] [02mw-config] 07Universal-Omega created branch 03merge-master - 13https://git.io/vbvb3 [22:42:38] [02miraheze/mw-config] 07Universal-Omega pushed 0349 commits to 03merge-master [+0/-0/±104] 13https://git.io/JZ3PF [22:42:40] [02miraheze/mw-config] 07Universal-Omega 03e2509d2 - Merge branch 'REL1_36' into merge-master [22:42:41] [02mw-config] 07Universal-Omega synchronize pull request 03#3944: Merge branch 'master' into REL1_36 - 13https://git.io/JZ3PM [22:43:05] [02mw-config] 07Universal-Omega closed pull request 03#3944: Merge branch 'master' into REL1_36 - 13https://git.io/JZ3PM [22:43:06] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03REL1_36 [+0/-0/±4] 13https://git.io/JZ3PN [22:43:08] [02miraheze/mw-config] 07Universal-Omega 03aff32f9 - Merge branch 'master' into REL1_36 (#3944) [22:43:09] [02mw-config] 07Universal-Omega synchronize pull request 03#3824: Update config for 1.36 - 13https://git.io/JYjbk [22:43:13] [02miraheze/mw-config] 07Universal-Omega deleted branch 03merge-master [22:43:14] [02mw-config] 07Universal-Omega deleted branch 03merge-master - 13https://git.io/vbvb3 [22:43:24] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 3 datacenters are down: 2400:6180:0:d0::403:f001/cpweb, 2001:41d0:801:2000::58af/cpweb, 51.222.25.132/cpweb [22:43:36] miraheze/mw-config - Universal-Omega the build passed. [22:43:52] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 20.64, 18.80, 15.33 [22:44:14] PROBLEM - www.iceria.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.iceria.org could not be found [22:44:15] PROBLEM - www.petrawiki.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.petrawiki.org could not be found [22:44:20] PROBLEM - wiki.seredrau.xyz - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.seredrau.xyz could not be found [22:44:25] PROBLEM - bots.miraheze.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for bots.miraheze.wiki could not be found [22:45:43] PROBLEM - johanloopmans.nl - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for johanloopmans.nl could not be found [22:45:46] PROBLEM - tep.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for tep.wiki could not be found [22:45:55] PROBLEM - wiki.kourouklides.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.kourouklides.com could not be found [22:45:55] PROBLEM - trollpasta.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for trollpasta.com could not be found [22:45:56] PROBLEM - wiki.mussa.id - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.mussa.id could not be found [22:45:56] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 25.66, 21.59, 16.81 [22:46:00] PROBLEM - isv.orain.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for isv.orain.org could not be found [22:46:18] PROBLEM - linkwiki.cf - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for linkwiki.cf could not be found [22:47:16] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [22:47:53] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 16.40, 19.26, 16.51 [22:48:02] PROBLEM - mw9 Disk Space on mw9 is WARNING: DISK WARNING - free space: / 2072 MB (10% inode=70%); [22:48:22] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [22:50:41] !log sudo -u www-data php /srv/mediawiki/w/maintenance/mergeMessageFileList.php --output /srv/mediawiki/config/ExtensionMessageFiles.php --wiki loginwiki && sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildLocalisationCache.php --wiki loginwiki on mw* / jbr* / test3 [22:50:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:51:07] RECOVERY - www.petrawiki.org - reverse DNS on sslhost is OK: rDNS OK - www.petrawiki.org reverse DNS resolves to cp13.miraheze.org [22:51:13] RECOVERY - www.iceria.org - reverse DNS on sslhost is OK: rDNS OK - www.iceria.org reverse DNS resolves to cp13.miraheze.org [22:51:14] RECOVERY - wiki.seredrau.xyz - reverse DNS on sslhost is OK: rDNS OK - wiki.seredrau.xyz reverse DNS resolves to cp13.miraheze.org [22:51:23] RECOVERY - bots.miraheze.wiki - reverse DNS on sslhost is OK: rDNS OK - bots.miraheze.wiki reverse DNS resolves to cp13.miraheze.org [22:51:51] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 5.59, 7.76, 7.89 [22:52:08] RECOVERY - test3 Puppet on test3 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [22:52:35] RECOVERY - wiki.kourouklides.com - reverse DNS on sslhost is OK: rDNS OK - wiki.kourouklides.com reverse DNS resolves to cp13.miraheze.org [22:52:35] RECOVERY - trollpasta.com - reverse DNS on sslhost is OK: rDNS OK - trollpasta.com reverse DNS resolves to cp13.miraheze.org [22:52:35] RECOVERY - johanloopmans.nl - reverse DNS on sslhost is OK: rDNS OK - johanloopmans.nl reverse DNS resolves to cp13.miraheze.org [22:52:37] RECOVERY - wiki.mussa.id - reverse DNS on sslhost is OK: rDNS OK - wiki.mussa.id reverse DNS resolves to cp13.miraheze.org [22:52:40] RECOVERY - tep.wiki - reverse DNS on sslhost is OK: rDNS OK - tep.wiki reverse DNS resolves to cp13.miraheze.org [22:52:59] RECOVERY - isv.orain.org - reverse DNS on sslhost is OK: rDNS OK - isv.orain.org reverse DNS resolves to cp13.miraheze.org [22:53:03] RECOVERY - linkwiki.cf - reverse DNS on sslhost is OK: rDNS OK - linkwiki.cf reverse DNS resolves to cp13.miraheze.org [22:54:10] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 5.84, 7.42, 7.29 [22:58:03] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.83, 6.17, 6.77 [23:01:58] RECOVERY - mw9 Disk Space on mw9 is OK: DISK OK - free space: / 2099 MB (11% inode=70%); [23:03:28] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.29, 6.92, 7.89 [23:03:29] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.98, 6.01, 6.75 [23:05:02] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [23:10:43] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 5.62, 6.36, 7.95 [23:13:24] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 5.31, 5.81, 6.78 [23:26:43] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.54, 5.95, 6.75 [23:34:07] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [23:47:28] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [23:54:41] PROBLEM - cp12 Disk Space on cp12 is WARNING: DISK WARNING - free space: / 4241 MB (10% inode=96%);