[00:04:11] <icinga-miraheze>	 PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 12.69, 7.66, 5.74
[00:06:12] <icinga-miraheze>	 RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.04, 6.42, 5.51
[00:31:16] <icinga-miraheze>	 PROBLEM - cp12 Current Load on cp12 is WARNING: WARNING - load average: 1.76, 1.60, 1.24
[00:33:17] <icinga-miraheze>	 RECOVERY - cp12 Current Load on cp12 is OK: OK - load average: 1.11, 1.40, 1.21
[00:45:29] <icinga-miraheze>	 RECOVERY - test3 Puppet on test3 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures
[00:47:12] <icinga-miraheze>	 PROBLEM - test3 MediaWiki Rendering on test3 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 324 bytes in 0.012 second response time
[00:49:13] <icinga-miraheze>	 RECOVERY - test3 MediaWiki Rendering on test3 is OK: HTTP OK: HTTP/1.1 200 OK - 20019 bytes in 0.254 second response time
[01:04:00] <icinga-miraheze>	 PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 8.19, 7.21, 6.16
[01:04:58] <icinga-miraheze>	 RECOVERY - mw10 APT on mw10 is OK: APT OK: 0 packages available for upgrade (0 critical updates).
[01:05:05] <icinga-miraheze>	 PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.65, 6.58, 5.52
[01:05:17] <icinga-miraheze>	 PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.48, 7.12, 5.80
[01:05:17] <icinga-miraheze>	 RECOVERY - mw8 APT on mw8 is OK: APT OK: 0 packages available for upgrade (0 critical updates).
[01:05:31] <icinga-miraheze>	 PROBLEM - mw11 Disk Space on mw11 is CRITICAL: DISK CRITICAL - free space: / 852 MB (4% inode=75%);
[01:05:50] <icinga-miraheze>	 RECOVERY - mw11 APT on mw11 is OK: APT OK: 0 packages available for upgrade (0 critical updates).
[01:05:57] <icinga-miraheze>	 PROBLEM - mw8 Disk Space on mw8 is WARNING: DISK WARNING - free space: / 1624 MB (8% inode=74%);
[01:05:57] <icinga-miraheze>	 PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.44, 6.95, 6.19
[01:06:01] <icinga-miraheze>	 RECOVERY - mw9 APT on mw9 is OK: APT OK: 0 packages available for upgrade (0 critical updates).
[01:06:31] <icinga-miraheze>	 PROBLEM - mw10 Puppet on mw10 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[php7.3-apcu]
[01:06:48] <icinga-miraheze>	 PROBLEM - mw8 Puppet on mw8 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[php7.3-apcu]
[01:07:02] <icinga-miraheze>	 RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.23, 6.25, 5.54
[01:07:17] <icinga-miraheze>	 PROBLEM - mw11 Puppet on mw11 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[php7.3-apcu]
[01:07:17] <icinga-miraheze>	 RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.01, 6.46, 5.74
[01:07:21] <icinga-miraheze>	 PROBLEM - mw9 Puppet on mw9 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[php7.3-apcu]
[01:07:54] <icinga-miraheze>	 RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 5.38, 6.33, 6.05
[01:08:37] <icinga-miraheze>	 RECOVERY - jobrunner3 APT on jobrunner3 is OK: APT OK: 0 packages available for upgrade (0 critical updates).
[01:08:41] <icinga-miraheze>	 RECOVERY - jobrunner4 APT on jobrunner4 is OK: APT OK: 0 packages available for upgrade (0 critical updates).
[01:08:43] <icinga-miraheze>	 RECOVERY - mw8 Puppet on mw8 is OK: OK: Puppet is currently enabled, last run 10 seconds ago with 0 failures
[01:09:42] <Voidwalker>	 !log apt upgrade on mw* and jbr*
[01:09:48] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[01:10:34] <icinga-miraheze>	 RECOVERY - mw10 Puppet on mw10 is OK: OK: Puppet is currently enabled, last run 4 seconds ago with 0 failures
[01:11:21] <icinga-miraheze>	 RECOVERY - mw11 Puppet on mw11 is OK: OK: Puppet is currently enabled, last run 48 seconds ago with 0 failures
[01:11:25] <icinga-miraheze>	 RECOVERY - mw9 Puppet on mw9 is OK: OK: Puppet is currently enabled, last run 35 seconds ago with 0 failures
[01:13:13] <icinga-miraheze>	 PROBLEM - jobrunner3 Redis Process on jobrunner3 is CRITICAL: PROCS CRITICAL: 2 processes with args 'redis-server'
[01:40:04] <Not-4d2d>	 [02miraheze/DataDump] 07The-Voidwalker pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/Jc99H
[01:40:06] <Not-4d2d>	 [02miraheze/DataDump] 07RhinosF1 0367a82b7 - Merge pull request from GHSA-29mh-4vhv-x8mr
[01:40:56] <miraheze-github>	 miraheze/DataDump - The-Voidwalker the build passed.
[01:41:31] <Not-4d2d>	 [02miraheze/mediawiki] 07The-Voidwalker pushed 031 commit to 03REL1_36 [+0/-0/±1] 13https://git.io/Jc9HI
[01:41:33] <Not-4d2d>	 [02miraheze/mediawiki] 07The-Voidwalker 03d90600b - update DataDump
[01:52:19] <icinga-miraheze>	 RECOVERY - mail2 APT on mail2 is OK: APT OK: 0 packages available for upgrade (0 critical updates).
[01:59:06] <icinga-miraheze>	 PROBLEM - mail2 Puppet on mail2 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 1 minute ago with 2 failures. Failed resources (up to 3 shown): Package[opendmarc],Package[php7.3-apcu]
[02:07:20] <icinga-miraheze>	 PROBLEM - jobrunner3 Puppet on jobrunner3 is WARNING: WARNING: Puppet last ran 1 hour ago
[02:08:02] <Voidwalker>	 fixing mail2
[02:08:11] <Voidwalker>	 not sure what's up with jobrunner3
[02:08:37] <Voidwalker>	 puppet has been running for >1h and I'm not sure what the solution is
[02:09:20] <icinga-miraheze>	 RECOVERY - jobrunner3 Puppet on jobrunner3 is OK: OK: Puppet is currently enabled, last run 8 seconds ago with 0 failures
[02:13:07] <icinga-miraheze>	 PROBLEM - mail2 Puppet on mail2 is WARNING: WARNING: Puppet is currently disabled, message: Testing fix --Void, last run 15 minutes ago with 2 failures
[02:22:49] <Not-4d2d>	 [02miraheze/puppet] 07The-Voidwalker pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jc9bU
[02:22:51] <Not-4d2d>	 [02miraheze/puppet] 07The-Voidwalker 034a34dae - fix opendmarc.conf
[02:23:11] <icinga-miraheze>	 PROBLEM - mail2 Puppet on mail2 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 2 minutes ago with 2 failures. Failed resources (up to 3 shown): Package[opendmarc],Package[php7.3-apcu]
[02:31:19] <icinga-miraheze>	 RECOVERY - mail2 Puppet on mail2 is OK: OK: Puppet is currently enabled, last run 36 seconds ago with 0 failures
[02:35:58] <icinga-miraheze>	 RECOVERY - mon2 APT on mon2 is OK: APT OK: 0 packages available for upgrade (0 critical updates).
[02:42:31] <icinga-miraheze>	 RECOVERY - phab2 APT on phab2 is OK: APT OK: 0 packages available for upgrade (0 critical updates).
[02:43:30] <icinga-miraheze>	 PROBLEM - jobrunner3 Puppet on jobrunner3 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[redis-server]
[02:43:38] <Voidwalker>	 Failed opening the RDB file dump.rdb (in server root dir /srv/redis) for saving: Read-only file system o.o
[02:47:14] <icinga-miraheze>	 RECOVERY - jobrunner3 Redis Process on jobrunner3 is OK: PROCS OK: 1 process with args 'redis-server'
[03:01:13] <icinga-miraheze>	 PROBLEM - jobrunner3 Redis Process on jobrunner3 is CRITICAL: PROCS CRITICAL: 2 processes with args 'redis-server'
[03:03:13] <icinga-miraheze>	 RECOVERY - jobrunner3 Redis Process on jobrunner3 is OK: PROCS OK: 1 process with args 'redis-server'
[03:03:21] <icinga-miraheze>	 PROBLEM - jobrunner3 Puppet on jobrunner3 is WARNING: WARNING: Puppet is currently disabled, message: Redis is broken, puppet attempts to restart it, causing further errors. -Void, last run 23 minutes ago with 1 failures
[03:45:21] <icinga-miraheze>	 PROBLEM - jobrunner3 Puppet on jobrunner3 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[redis-server]
[03:45:40] <icinga-miraheze>	 PROBLEM - mw9 JobRunner Service on mw9 is CRITICAL: PROCS CRITICAL: 0 processes with args 'redisJobRunnerService'
[03:45:51] <icinga-miraheze>	 PROBLEM - mw11 JobRunner Service on mw11 is CRITICAL: PROCS CRITICAL: 0 processes with args 'redisJobRunnerService'
[03:45:54] <icinga-miraheze>	 PROBLEM - jobrunner4 JobRunner Service on jobrunner4 is CRITICAL: PROCS CRITICAL: 0 processes with args 'redisJobRunnerService'
[03:46:04] <icinga-miraheze>	 PROBLEM - mw10 JobRunner Service on mw10 is CRITICAL: PROCS CRITICAL: 0 processes with args 'redisJobRunnerService'
[03:46:08] <icinga-miraheze>	 RECOVERY - jobrunner3 Puppet on jobrunner3 is OK: OK: Puppet is currently enabled, last run 44 seconds ago with 0 failures
[03:46:45] <icinga-miraheze>	 PROBLEM - mw8 JobRunner Service on mw8 is CRITICAL: PROCS CRITICAL: 0 processes with args 'redisJobRunnerService'
[03:49:13] <Voidwalker>	 ack^ looks like check might be wrong?
[03:52:56] <Voidwalker>	 ohh
[03:52:56] <Voidwalker>	 dumb
[03:53:33] <icinga-miraheze>	 RECOVERY - jobrunner4 JobRunner Service on jobrunner4 is OK: PROCS OK: 1 process with args 'redisJobRunnerService'
[03:53:52] <icinga-miraheze>	 RECOVERY - mw11 JobRunner Service on mw11 is OK: PROCS OK: 1 process with args 'redisJobRunnerService'
[03:54:04] <icinga-miraheze>	 RECOVERY - mw10 JobRunner Service on mw10 is OK: PROCS OK: 1 process with args 'redisJobRunnerService'
[03:54:44] <icinga-miraheze>	 RECOVERY - mw8 JobRunner Service on mw8 is OK: PROCS OK: 1 process with args 'redisJobRunnerService'
[03:55:41] <icinga-miraheze>	 RECOVERY - mw9 JobRunner Service on mw9 is OK: PROCS OK: 1 process with args 'redisJobRunnerService'
[05:11:28] <Not-4d2d>	 [02miraheze/ssl] 07Reception123 pushed 033 commits to 03master [+3/-0/±3] 13https://git.io/JcHCy
[05:11:30] <Not-4d2d>	 [02miraheze/ssl] 07Reception123 0360664e7 - add wikidiffs.ga cert
[05:11:31] <Not-4d2d>	 [02miraheze/ssl] 07Reception123 03f041320 - add factorio-mods.tk cert
[05:11:33] <Not-4d2d>	 [02miraheze/ssl] 07Reception123 032ee5d15 - add bluearchive.wiki cert
[05:22:17] <icinga-miraheze>	 PROBLEM - bluearchive.wiki - reverse DNS on sslhost is WARNING: SSL WARNING - rDNS OK but records conflict. {'NS': ['dns1.registrar-servers.com.', 'dns2.registrar-servers.com.'], 'CNAME': 'bluearchive.miraheze.org.'}
[05:30:18] <Reception123>	 !log INSERT INTO content_models (model_id, model_name) VALUES ( 7, 'sanitized-css'); (harnicawiki)
[05:30:22] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[05:59:32] <Reception123>	 !log DROP DATABASE ircwiki
[05:59:35] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[06:04:20] <Agent>	 Reception123: Thanks for all your help on T7606!
[06:04:58] <RhinosF1>	 Hi Agent
[06:07:27] <Reception123>	 Agent: sorry we couldn't recover it :(
[06:07:28] <Agent>	 Hello RhinosF1
[06:07:28] <Agent>	 Reception123: it's fine, I have the XML file either way burried in my old IRCCloud account from when I was able to salvage it from the ruins of Orain, so nothing is lost, but either way, thank you so much!
[06:07:33] <icinga-miraheze>	 PROBLEM - mw9 Puppet on mw9 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[php7.3-apcu]
[06:08:10] <RhinosF1>	 Reception123: can you kick it
[06:15:54] <icinga-miraheze>	 PROBLEM - repository.archiopedia.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for repository.archiopedia.org could not be found
[06:16:01] <icinga-miraheze>	 PROBLEM - wiki.mikrodev.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.mikrodev.com could not be found
[06:16:03] <icinga-miraheze>	 PROBLEM - spcodex.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for spcodex.wiki could not be found
[06:16:04] <icinga-miraheze>	 PROBLEM - miraheze.ml - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for miraheze.ml could not be found
[06:16:13] <icinga-miraheze>	 PROBLEM - wiki.nevillepedia.eu - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.nevillepedia.eu could not be found
[06:16:16] <icinga-miraheze>	 PROBLEM - antiguabarbudacalypso.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for antiguabarbudacalypso.com could not be found
[06:16:16] <icinga-miraheze>	 PROBLEM - www.baharna.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.baharna.org could not be found
[06:21:42] <Reception123>	 Agent: oh that's good :)
[06:21:50] <Reception123>	 RhinosF1: hm? 
[06:22:12] <RhinosF1>	 Reception123: puppet mw9
[06:22:41] <icinga-miraheze>	 RECOVERY - wiki.mikrodev.com - reverse DNS on sslhost is OK: SSL OK - wiki.mikrodev.com reverse DNS resolves to cp13.miraheze.org - CNAME OK
[06:22:43] <icinga-miraheze>	 RECOVERY - miraheze.ml - reverse DNS on sslhost is OK: SSL OK - miraheze.ml reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK
[06:22:48] <icinga-miraheze>	 RECOVERY - repository.archiopedia.org - reverse DNS on sslhost is OK: SSL OK - repository.archiopedia.org reverse DNS resolves to cp13.miraheze.org - CNAME OK
[06:22:53] <icinga-miraheze>	 RECOVERY - spcodex.wiki - reverse DNS on sslhost is OK: SSL OK - spcodex.wiki reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK
[06:23:09] <icinga-miraheze>	 RECOVERY - antiguabarbudacalypso.com - reverse DNS on sslhost is OK: SSL OK - antiguabarbudacalypso.com reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK
[06:23:09] <icinga-miraheze>	 RECOVERY - www.baharna.org - reverse DNS on sslhost is OK: SSL OK - www.baharna.org reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK
[06:23:11] <icinga-miraheze>	 RECOVERY - wiki.nevillepedia.eu - reverse DNS on sslhost is OK: SSL OK - wiki.nevillepedia.eu reverse DNS resolves to cp13.miraheze.org - CNAME OK
[06:23:55] <icinga-miraheze>	 PROBLEM - bacula2 Bacula Phabricator Static on bacula2 is WARNING: WARNING: Diff, 6697 files, 511.9MB, 2021-06-23 06:21:00 (2.1 weeks ago)
[06:26:51] <icinga-miraheze>	 RECOVERY - mw8 Disk Space on mw8 is OK: DISK OK - free space: / 2102 MB (11% inode=74%);
[06:35:53] <icinga-miraheze>	 RECOVERY - mw9 Puppet on mw9 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[06:36:15] <Reception123>	 fixed itself :)
[06:37:08] <icinga-miraheze>	 PROBLEM - mw11 Disk Space on mw11 is WARNING: DISK WARNING - free space: / 1281 MB (6% inode=75%);
[08:24:55] <Not-4d2d>	 [02miraheze/dns] 07Reception123 pushed 031 commit to 03master [+1/-0/±0] 13https://git.io/JcH5v
[08:24:55] <Not-4d2d>	 [02miraheze/dns] 07Reception123 037e0409f - add mwcosmos.com zone
[08:50:49] <Not-4d2d>	 [02miraheze/ssl] 07Reception123 pushed 031 commit to 03master [+1/-0/±1] 13https://git.io/JcHxx
[08:50:49] <Not-4d2d>	 [02miraheze/ssl] 07Reception123 03eeb7bde - add mwcosmos.com cert
[10:23:56] <Not-4d2d>	 [02mw-config] 07Njsmooth opened pull request 03#3995: Added a setting for MultiBoilerplate - 13https://git.io/JcQsV
[10:24:56] <miraheze-github>	 miraheze/mw-config - Njsmooth the build passed.
[10:56:44] <Not-4d2d>	 [02miraheze/ssl] 07Reception123 pushed 031 commit to 03master [+1/-0/±1] 13https://git.io/JcQWX
[10:56:45] <Not-4d2d>	 [02miraheze/ssl] 07Reception123 0326a341d - add ircwiki.cf cert
[11:07:13] <Not-4d2d>	 [02miraheze/landing] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JcQ8K
[11:07:15] <Not-4d2d>	 [02miraheze/landing] 07translatewiki 03561c529 - Localisation updates from https://translatewiki.net.
[11:07:16] <MirahezeBot>	 [url] Main page - translatewiki.net | translatewiki.net
[11:07:16] <Not-4d2d>	 [02miraheze/WikiDiscover] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JcQ8P
[11:07:18] <Not-4d2d>	 [02miraheze/WikiDiscover] 07translatewiki 030582185 - Localisation updates from https://translatewiki.net.
[11:07:19] <MirahezeBot>	 [url] Main page - translatewiki.net | translatewiki.net
[11:07:19] <Not-4d2d>	 [02miraheze/MirahezeMagic] 07translatewiki pushed 031 commit to 03master [+1/-0/±5] 13https://git.io/JcQ8X
[11:07:21] <Not-4d2d>	 [02miraheze/MirahezeMagic] 07translatewiki 0370936a1 - Localisation updates from https://translatewiki.net.
[11:07:22] <MirahezeBot>	 [url] Main page - translatewiki.net | translatewiki.net
[11:08:14] <miraheze-github>	 miraheze/WikiDiscover - translatewiki the build passed.
[11:08:17] <miraheze-github_>	 miraheze/landing - translatewiki the build passed.
[11:08:24] <miraheze-github_>	 miraheze/MirahezeMagic - translatewiki the build passed.
[12:20:58] <icinga-miraheze>	 PROBLEM - wiki.rpointer.ml - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.rpointer.ml' expires in 15 day(s) (Sat 24 Jul 2021 12:18:00 GMT +0000).
[12:26:58] <Not-4d2d>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JcQrc
[12:26:59] <Not-4d2d>	 [02miraheze/ssl] 07MirahezeSSLBot 0372e359f - Bot: Update SSL cert for wiki.rpointer.ml
[13:01:33] <icinga-miraheze>	 RECOVERY - wiki.rpointer.ml - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.rpointer.ml' will expire on Wed 06 Oct 2021 11:26:50 GMT +0000.
[13:07:38] <icinga-miraheze>	 PROBLEM - mw11 Disk Space on mw11 is CRITICAL: DISK CRITICAL - free space: / 1138 MB (5% inode=75%);
[13:09:39] <icinga-miraheze>	 PROBLEM - mw11 Disk Space on mw11 is WARNING: DISK WARNING - free space: / 1273 MB (6% inode=75%);
[13:14:28] <icinga-miraheze>	 PROBLEM - pastport.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for pastport.org could not be found
[13:21:11] <icinga-miraheze>	 RECOVERY - pastport.org - reverse DNS on sslhost is OK: SSL OK - pastport.org reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK
[15:52:11] <RhinosF1>	 @Lake: what is your ISP?
[15:53:22] <MH-Discord>	 <Lake> i think it's called Speednet
[15:53:33] <MH-Discord>	 <Lake> it only serves my city here
[15:54:33] <RhinosF1>	 @Lake: ah, apparently Vivo users can't access .org sites
[15:55:28] <MH-Discord>	 <Lake> Hmm, strange. I don't have Vivo because they suck (like every other large ISP)
[15:55:41] <RhinosF1>	 Well they suck much more today
[15:57:18] <MH-Discord>	 <Lake> oh yes, I'm seeing here. Pretty strange, looks like a crappy DNS server they're using
[15:57:27] <MH-Discord>	 <Lake> but it could be just a temporary failure
[15:59:14] <RhinosF1>	 Yeah it is
[15:59:41] <RhinosF1>	 !log SRE: Brazil users who can't access .org sites should groan at / switch their ISP or find better DNS
[15:59:44] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[16:05:22] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.82, 6.94, 5.99
[16:05:24] <icinga-miraheze>	 PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 8.04, 6.88, 5.97
[16:07:22] <icinga-miraheze>	 RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 6.52, 6.76, 6.04
[16:07:24] <icinga-miraheze>	 RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 5.93, 6.53, 5.95
[16:31:00] <icinga-miraheze>	 PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.03, 7.12, 5.75
[16:31:23] <icinga-miraheze>	 PROBLEM - www.zenbuddhism.info - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.zenbuddhism.info could not be found
[16:31:30] <icinga-miraheze>	 PROBLEM - wiki.yumeka.icu - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.yumeka.icu could not be found
[16:31:31] <icinga-miraheze>	 PROBLEM - stablestate.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for stablestate.org could not be found
[16:31:57] <icinga-miraheze>	 PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 5.83, 7.76, 6.32
[16:32:59] <icinga-miraheze>	 PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.10, 7.09, 5.89
[16:34:59] <icinga-miraheze>	 RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.79, 6.38, 5.78
[16:35:56] <icinga-miraheze>	 RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.29, 6.76, 6.26
[16:38:10] <icinga-miraheze>	 RECOVERY - wiki.yumeka.icu - reverse DNS on sslhost is OK: SSL OK - wiki.yumeka.icu reverse DNS resolves to cp13.miraheze.org - CNAME OK
[16:38:20] <icinga-miraheze>	 RECOVERY - www.zenbuddhism.info - reverse DNS on sslhost is OK: SSL OK - www.zenbuddhism.info reverse DNS resolves to cp13.miraheze.org - CNAME OK
[16:38:30] <icinga-miraheze>	 RECOVERY - stablestate.org - reverse DNS on sslhost is OK: SSL OK - stablestate.org reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK
[16:40:00] <icinga-miraheze>	 PROBLEM - mw8 Disk Space on mw8 is WARNING: DISK WARNING - free space: / 2088 MB (10% inode=74%);
[17:03:28] <Not-4d2d>	 [02mw-config] 07Universal-Omega reviewed pull request 03#3995 commit - 13https://git.io/Jc70A
[17:12:56] <Not-4d2d>	 [02mw-config] 07Njsmooth synchronize pull request 03#3995: Added a setting for MultiBoilerplate - 13https://git.io/JcQsV
[17:13:46] <miraheze-github>	 miraheze/mw-config - Njsmooth the build passed.
[17:16:41] <Not-4d2d>	 [02mw-config] 07Njsmooth reviewed pull request 03#3995 commit - 13https://git.io/Jc7zZ
[17:19:18] <Not-4d2d>	 [02mw-config] 07Universal-Omega reviewed pull request 03#3995 commit - 13https://git.io/Jc7zM
[17:19:19] <Not-4d2d>	 [02mw-config] 07Universal-Omega reviewed pull request 03#3995 commit - 13https://git.io/Jc7zD
[17:19:21] <Not-4d2d>	 [02mw-config] 07Universal-Omega reviewed pull request 03#3995 commit - 13https://git.io/Jc7zy
[17:20:52] <icinga-miraheze>	 PROBLEM - test4 APT on test4 is CRITICAL: APT CRITICAL: 39 packages available for upgrade (1 critical updates).
[17:21:31] <RhinosF1>	 Reception123: is test4 still in use?
[17:22:31] <Not-4d2d>	 [02mw-config] 07Universal-Omega reviewed pull request 03#3994 commit - 13https://git.io/Jc7gs
[17:25:11] <Not-4d2d>	 [02mw-config] 07Njsmooth synchronize pull request 03#3995: Added a setting for MultiBoilerplate - 13https://git.io/JcQsV
[17:26:07] <miraheze-github>	 miraheze/mw-config - Njsmooth the build passed.
[17:30:19] <Not-4d2d>	 [02mw-config] 07Njsmooth synchronize pull request 03#3994: Adding PageImages Namespaces to my Wiki - 13https://git.io/Jc2E6
[17:31:17] <miraheze-github>	 miraheze/mw-config - Njsmooth the build passed.
[17:38:34] <Reception123>	 RhinosF1: until https://phabricator.miraheze.org/T4302 is done I think so, but not sure what is currently being done with it by Infra
[17:38:35] <MirahezeBot>	 [url] ⚓ T4302 Deploy Apache Traffic Server | phabricator.miraheze.org
[17:38:51] <RhinosF1>	 Reception123: ok
[17:38:59] <RhinosF1>	 Someone needs to apt upgrade on it
[17:41:03] <Reception123>	 !log sudo apt-get upgrade on test4
[17:41:06] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[17:42:53] <icinga-miraheze>	 RECOVERY - test4 APT on test4 is OK: APT OK: 0 packages available for upgrade (0 critical updates).
[17:42:57] <RhinosF1>	 Ty
[17:50:53] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.51, 7.08, 6.08
[17:52:52] <icinga-miraheze>	 RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.63, 6.54, 6.00
[17:58:17] <icinga-miraheze>	 PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 8.94, 7.52, 6.22
[18:00:16] <icinga-miraheze>	 PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.33, 7.02, 6.20
[18:02:17] <icinga-miraheze>	 RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 6.34, 6.79, 6.21
[18:05:32] <icinga-miraheze>	 PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.77, 6.94, 5.99
[18:07:27] <icinga-miraheze>	 RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.47, 6.25, 5.84
[18:10:15] <Not-4d2d>	 [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jc7iw
[18:10:16] <Not-4d2d>	 [02miraheze/services] 07MirahezeSSLBot 0381fbb85 - BOT: Updating services config for wikis
[18:38:40] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.31, 6.87, 6.11
[18:40:41] <icinga-miraheze>	 RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.71, 6.59, 6.11
[20:34:49] <Not-4d2d>	 [02mw-config] 07DebuggerByte opened pull request 03#3996: Add privacy wiki as import option, please. - 13https://git.io/Jc7jZ
[20:35:49] <miraheze-github>	 miraheze/mw-config - DebuggerByte the build passed.
[22:39:39] <icinga-miraheze>	 PROBLEM - mw11 Disk Space on mw11 is CRITICAL: DISK CRITICAL - free space: / 1127 MB (5% inode=75%);
[22:41:39] <icinga-miraheze>	 PROBLEM - mw11 Disk Space on mw11 is WARNING: DISK WARNING - free space: / 1176 MB (6% inode=75%);