[00:00:04] <icinga-miraheze>	 PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.2075510025 secs
[00:03:54] <icinga-miraheze>	 RECOVERY - swiftproxy111 HTTPS on swiftproxy111 is OK: HTTP OK: Status line output matched "HTTP/1.1 404" - 352 bytes in 0.033 second response time
[00:04:04] <icinga-miraheze>	 PROBLEM - graylog131 Current Load on graylog131 is WARNING: WARNING - load average: 3.50, 2.66, 1.86
[00:04:14] <icinga-miraheze>	 PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.82, 3.07, 2.32
[00:05:24] <icinga-miraheze>	 PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 6.74, 7.48, 7.15
[00:06:04] <icinga-miraheze>	 RECOVERY - graylog131 Current Load on graylog131 is OK: OK - load average: 2.55, 2.58, 1.92
[00:06:09] <icinga-miraheze>	 RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 3.12, 3.02, 2.39
[00:07:46] <icinga-miraheze>	 PROBLEM - swiftobject111 APT on swiftobject111 is CRITICAL: APT CRITICAL: 48 packages available for upgrade (2 critical updates).
[00:08:16] <icinga-miraheze>	 PROBLEM - cp33 NTP time on cp33 is CRITICAL: NTP CRITICAL: Offset 0.9732280672 secs
[00:10:15] <icinga-miraheze>	 RECOVERY - cp33 NTP time on cp33 is OK: NTP OK: Offset 0.007350474596 secs
[00:16:50] <icinga-miraheze>	 PROBLEM - wiki.consid.vn - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.consid.vn All nameservers failed to answer the query.
[00:18:19] <icinga-miraheze>	 PROBLEM - swiftobject112 APT on swiftobject112 is CRITICAL: APT CRITICAL: 48 packages available for upgrade (2 critical updates).
[00:19:24] <icinga-miraheze>	 RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 5.33, 6.37, 6.77
[00:24:04] <icinga-miraheze>	 RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset -0.02529028058 secs
[00:36:36] <icinga-miraheze>	 PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.08, 7.06, 6.71
[00:38:22] <icinga-miraheze>	 PROBLEM - os141 Current Load on os141 is CRITICAL: CRITICAL - load average: 6.53, 4.03, 2.82
[00:38:30] <icinga-miraheze>	 RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 5.68, 6.50, 6.54
[00:41:05] <icinga-miraheze>	 RECOVERY - tudien.como.vn - reverse DNS on sslhost is OK: SSL OK - tudien.como.vn reverse DNS resolves to cp22.miraheze.org - CNAME OK
[00:41:55] <icinga-miraheze>	 PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 7.51, 6.41, 4.18
[00:43:55] <icinga-miraheze>	 RECOVERY - db142 Current Load on db142 is OK: OK - load average: 5.12, 6.16, 4.38
[00:46:35] <icinga-miraheze>	 RECOVERY - wiki.consid.vn - reverse DNS on sslhost is OK: SSL OK - wiki.consid.vn reverse DNS resolves to cp23.miraheze.org - CNAME OK
[00:48:00] <icinga-miraheze>	 RECOVERY - cloud11 IPMI Sensors on cloud11 is OK: IPMI Status: OK
[00:48:21] <icinga-miraheze>	 PROBLEM - os141 Current Load on os141 is WARNING: WARNING - load average: 2.12, 3.63, 3.47
[00:49:32] <icinga-miraheze>	 PROBLEM - swiftobject121 APT on swiftobject121 is WARNING: APT WARNING: 0 packages available for upgrade (0 critical updates). warnings detected, errors detected.
[00:50:24] <icinga-miraheze>	 RECOVERY - os141 Current Load on os141 is OK: OK - load average: 2.24, 3.27, 3.36
[00:51:33] <icinga-miraheze>	 PROBLEM - swiftobject121 APT on swiftobject121 is CRITICAL: APT CRITICAL: 52 packages available for upgrade (7 critical updates).
[00:52:01] <icinga-miraheze>	 PROBLEM - cloud11 IPMI Sensors on cloud11 is CRITICAL: IPMI Status: Critical [Cntlr 2 Bay 8 = Critical]
[00:58:44] <botifico>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-5 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/e94ffb601986
[00:58:46] <botifico>	 [02miraheze/puppet] 07paladox 03e94ffb6 - swift: fix disabling rsync when disk is full
[00:58:47] <botifico>	 [02puppet] 07paladox created branch 03paladox-patch-5 - 13https://github.com/miraheze/puppet
[00:58:49] <botifico>	 [02puppet] 07paladox opened pull request 03#3244: swift: fix disabling rsync when disk is full - 13https://github.com/miraheze/puppet/pull/3244
[00:59:11] <botifico>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-5 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/e94ffb601986...66787fabedc3
[00:59:15] <botifico>	 [02miraheze/puppet] 07paladox 0366787fa - Update disable_rsync.py
[00:59:15] <botifico>	 [02puppet] 07paladox synchronize pull request 03#3244: swift: fix disabling rsync when disk is full - 13https://github.com/miraheze/puppet/pull/3244
[01:00:22] <icinga-miraheze>	 PROBLEM - os141 Current Load on os141 is WARNING: WARNING - load average: 3.53, 3.56, 3.35
[01:02:21] <icinga-miraheze>	 RECOVERY - os141 Current Load on os141 is OK: OK - load average: 2.03, 3.00, 3.17
[01:12:35] <icinga-miraheze>	 PROBLEM - tudien.como.vn - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - tudien.como.vn All nameservers failed to answer the query.
[01:19:52] <icinga-miraheze>	 PROBLEM - swiftobject121 APT on swiftobject121 is WARNING: APT WARNING: 0 packages available for upgrade (0 critical updates). warnings detected, errors detected.
[01:21:24] <icinga-miraheze>	 PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.13, 7.08, 6.58
[01:21:54] <icinga-miraheze>	 PROBLEM - swiftobject121 APT on swiftobject121 is CRITICAL: APT CRITICAL: 52 packages available for upgrade (7 critical updates).
[01:29:02] <icinga-miraheze>	 PROBLEM - swiftobject122 Disk Space on swiftobject122 is WARNING: DISK WARNING - free space: / 96989 MB (10% inode=83%);
[01:29:24] <icinga-miraheze>	 RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 5.90, 6.67, 6.65
[01:40:11] <icinga-miraheze>	 PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.10, 7.01, 6.79
[01:42:05] <icinga-miraheze>	 RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 6.27, 6.77, 6.73
[01:42:07] <icinga-miraheze>	 RECOVERY - tudien.como.vn - reverse DNS on sslhost is OK: SSL OK - tudien.como.vn reverse DNS resolves to cp22.miraheze.org - CNAME OK
[01:43:12] <icinga-miraheze>	 PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query uk.religiononfire.mar.in.ua. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL
[01:47:46] <icinga-miraheze>	 PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.34, 7.03, 6.84
[01:49:40] <icinga-miraheze>	 PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 12.51, 8.76, 7.48
[02:12:37] <icinga-miraheze>	 RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK
[02:19:46] <botifico>	 [02miraheze/mw-config] 07AgentIsai pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/45453977ff41...926bacd6f4d9
[02:19:47] <botifico>	 [02miraheze/mw-config] 07AgentIsai 03926bacd - Sitenotice for Swift outage
[02:20:45] <miraheze-github>	 miraheze/mw-config - AgentIsai the build passed.
[02:23:19] <botifico>	 [02miraheze/mw-config] 07AgentIsai pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/926bacd6f4d9...c3ee24cc8ed6
[02:23:22] <botifico>	 [02miraheze/mw-config] 07AgentIsai 03c3ee24c - Change image
[02:23:39] <botifico>	 [02miraheze/mw-config] 07AgentIsai pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/c3ee24cc8ed6...297ae5899534
[02:23:40] <botifico>	 [02miraheze/mw-config] 07AgentIsai 03297ae58 - Bump sitenoticeid
[02:24:24] <miraheze-github>	 miraheze/mw-config - AgentIsai the build passed.
[02:24:42] <miraheze-github>	 miraheze/mw-config - AgentIsai the build passed.
[02:27:28] <MirahezeLSBot>	 !log [@test131] starting deploy of {'config': True} to all
[02:27:29] <MirahezeLSBot>	 !log [@test131] finished deploy of {'config': True} to all - SUCCESS in 0s
[02:27:33] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[02:27:38] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[02:35:24] <icinga-miraheze>	 PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 6.87, 6.99, 7.89
[02:51:24] <icinga-miraheze>	 PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.76, 7.70, 7.45
[02:53:24] <icinga-miraheze>	 PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 6.87, 7.37, 7.36
[03:00:33] <icinga-miraheze>	 RECOVERY - db112 Backups SQL on db112 is OK: FILE_AGE OK: /var/log/sql-backup.log is 28 seconds old and 362 bytes
[03:01:12] <icinga-miraheze>	 RECOVERY - db112 Backups SQL on db112 is OK: FILE_AGE OK: /var/log/sql-backup.log is 67 seconds old and 362 bytes
[03:03:24] <icinga-miraheze>	 RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 4.83, 5.93, 6.70
[03:35:27] <icinga-miraheze>	 PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.95, 7.10, 6.60
[03:37:24] <icinga-miraheze>	 PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.47, 7.21, 6.70
[03:39:24] <icinga-miraheze>	 RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 5.65, 6.55, 6.52
[03:40:21] <icinga-miraheze>	 PROBLEM - os141 Current Load on os141 is CRITICAL: CRITICAL - load average: 6.13, 3.88, 1.89
[03:42:21] <icinga-miraheze>	 PROBLEM - os141 Current Load on os141 is WARNING: WARNING - load average: 3.19, 3.65, 2.06
[03:43:24] <icinga-miraheze>	 PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.09, 6.86, 6.65
[03:44:21] <icinga-miraheze>	 RECOVERY - os141 Current Load on os141 is OK: OK - load average: 1.37, 2.97, 2.02
[03:45:24] <icinga-miraheze>	 RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 6.11, 6.63, 6.60
[03:51:24] <icinga-miraheze>	 PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 8.00, 7.21, 6.79
[03:53:24] <icinga-miraheze>	 RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 5.95, 6.76, 6.68
[03:57:24] <icinga-miraheze>	 PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 6.53, 6.95, 6.79
[03:59:24] <icinga-miraheze>	 RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 5.03, 6.26, 6.56
[04:11:24] <icinga-miraheze>	 PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.49, 7.28, 6.73
[04:13:24] <icinga-miraheze>	 RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 5.35, 6.61, 6.55
[04:18:12] <icinga-miraheze>	 PROBLEM - swiftobject113 APT on swiftobject113 is CRITICAL: APT CRITICAL: 48 packages available for upgrade (2 critical updates).
[04:19:24] <icinga-miraheze>	 PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.55, 6.69, 6.49
[04:19:45] <icinga-miraheze>	 PROBLEM - swiftobject121 APT on swiftobject121 is WARNING: APT WARNING: 0 packages available for upgrade (0 critical updates). warnings detected, errors detected.
[04:21:24] <icinga-miraheze>	 PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 9.33, 7.84, 6.96
[04:21:47] <icinga-miraheze>	 PROBLEM - swiftobject121 APT on swiftobject121 is CRITICAL: APT CRITICAL: 52 packages available for upgrade (7 critical updates).
[04:23:24] <icinga-miraheze>	 PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 6.74, 7.50, 6.95
[04:27:24] <icinga-miraheze>	 RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 5.85, 6.45, 6.64
[04:49:24] <icinga-miraheze>	 PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.37, 6.71, 6.33
[04:51:03] <icinga-miraheze>	 PROBLEM - swiftobject122 Disk Space on swiftobject122 is CRITICAL: DISK CRITICAL - free space: / 52988 MB (5% inode=82%);
[04:51:24] <icinga-miraheze>	 PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.17, 7.50, 6.69
[04:53:24] <icinga-miraheze>	 PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 6.92, 7.31, 6.72
[05:01:24] <icinga-miraheze>	 RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 5.69, 6.53, 6.62
[05:13:21] <icinga-miraheze>	 PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 8.28, 6.80, 5.25
[05:13:24] <icinga-miraheze>	 PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.88, 7.55, 6.99
[05:17:17] <icinga-miraheze>	 PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 9.37, 7.54, 6.04
[05:17:21] <icinga-miraheze>	 PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 7.29, 7.50, 5.93
[05:19:17] <icinga-miraheze>	 PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 7.58, 7.58, 6.25
[05:19:24] <icinga-miraheze>	 PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.36, 7.80, 7.33
[05:21:24] <icinga-miraheze>	 PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 9.97, 8.62, 7.68
[05:21:55] <icinga-miraheze>	 PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - en.religiononfire.mar.in.ua All nameservers failed to answer the query.
[05:23:17] <icinga-miraheze>	 RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 5.12, 6.35, 6.05
[05:25:24] <icinga-miraheze>	 PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.33, 7.93, 7.61
[05:29:21] <icinga-miraheze>	 RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 6.24, 6.67, 6.36
[05:35:24] <icinga-miraheze>	 RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 4.13, 5.55, 6.59
[05:38:08] <icinga-miraheze>	 PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 8.38, 9.08, 4.83
[05:43:56] <icinga-miraheze>	 PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 0.85, 3.73, 3.74
[05:47:24] <icinga-miraheze>	 PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.07, 7.04, 6.60
[05:47:56] <icinga-miraheze>	 RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.53, 2.62, 3.28
[05:49:21] <icinga-miraheze>	 PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 7.07, 6.64, 6.11
[05:51:35] <icinga-miraheze>	 RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK
[05:54:15] <icinga-miraheze>	 PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.16, 6.98, 6.17
[05:55:24] <icinga-miraheze>	 PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 6.68, 7.57, 7.14
[05:58:11] <icinga-miraheze>	 PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 9.24, 7.70, 6.62
[05:59:21] <icinga-miraheze>	 RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 5.45, 6.44, 6.39
[06:00:10] <icinga-miraheze>	 PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.60, 7.52, 6.68
[06:02:08] <icinga-miraheze>	 PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 8.30, 7.83, 6.90
[06:10:02] <icinga-miraheze>	 PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 5.22, 7.13, 7.13
[06:13:58] <icinga-miraheze>	 RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 4.76, 5.88, 6.62
[06:19:24] <icinga-miraheze>	 PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.71, 7.66, 7.23
[06:20:48] <icinga-miraheze>	 PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query wiki.andreijiroh.uk.eu.org. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL
[06:23:24] <icinga-miraheze>	 PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 6.90, 7.73, 7.40
[06:25:24] <icinga-miraheze>	 PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.64, 8.16, 7.60
[06:29:24] <icinga-miraheze>	 PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.24, 7.88, 7.64
[06:35:25] <icinga-miraheze>	 PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.98, 7.82, 7.64
[06:37:56] <icinga-miraheze>	 PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.78, 3.15, 2.20
[06:41:24] <icinga-miraheze>	 PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 6.34, 7.39, 7.61
[06:43:12] <icinga-miraheze>	 PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - uk.religiononfire.mar.in.ua All nameservers failed to answer the query.
[06:43:56] <icinga-miraheze>	 PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.46, 3.91, 3.08
[06:45:56] <icinga-miraheze>	 RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.20, 3.10, 2.89
[06:47:54] <icinga-miraheze>	 PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 6.92, 6.21, 5.51
[06:49:24] <icinga-miraheze>	 PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.89, 7.94, 7.75
[06:49:53] <icinga-miraheze>	 RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 6.70, 6.43, 5.67
[06:53:24] <icinga-miraheze>	 PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.61, 7.71, 7.70
[06:53:49] <icinga-miraheze>	 PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 7.40, 6.97, 6.07
[07:01:24] <icinga-miraheze>	 PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 11.19, 8.61, 7.97
[07:03:34] <icinga-miraheze>	 PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.64, 6.80, 5.91
[07:03:42] <icinga-miraheze>	 RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 6.13, 6.58, 6.37
[07:09:34] <icinga-miraheze>	 RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 6.17, 6.68, 6.21
[07:12:37] <icinga-miraheze>	 RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK
[07:15:51] <icinga-miraheze>	 PROBLEM - mail121 Current Load on mail121 is CRITICAL: CRITICAL - load average: 2.50, 1.69, 0.91
[07:17:50] <icinga-miraheze>	 RECOVERY - mail121 Current Load on mail121 is OK: OK - load average: 0.79, 1.38, 0.90
[07:19:24] <icinga-miraheze>	 RECOVERY - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.andreijiroh.uk.eu.org reverse DNS resolves to cp23.miraheze.org - CNAME OK
[07:22:28] <icinga-miraheze>	 PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 8.01, 7.02, 6.46
[07:24:27] <icinga-miraheze>	 PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 6.75, 6.87, 6.47
[07:28:24] <icinga-miraheze>	 RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 6.15, 6.74, 6.53
[07:37:52] <icinga-miraheze>	 PROBLEM - perilous-times.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for perilous-times.com could not be found
[07:45:24] <icinga-miraheze>	 PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 6.41, 6.37, 8.00
[07:48:11] <icinga-miraheze>	 PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 7.95, 7.47, 6.67
[07:49:24] <icinga-miraheze>	 PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.60, 7.20, 7.95
[07:52:08] <icinga-miraheze>	 PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 8.32, 7.42, 6.80
[07:53:21] <icinga-miraheze>	 PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 8.31, 7.26, 6.13
[07:54:06] <icinga-miraheze>	 PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 7.39, 7.51, 6.91
[07:55:21] <icinga-miraheze>	 PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 7.39, 7.15, 6.22
[07:56:05] <icinga-miraheze>	 PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 10.87, 8.49, 7.33
[07:57:24] <icinga-miraheze>	 PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.46, 7.52, 7.95
[07:59:22] <icinga-miraheze>	 PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 9.26, 7.89, 6.73
[07:59:24] <icinga-miraheze>	 PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 9.10, 7.89, 8.02
[08:00:03] <icinga-miraheze>	 PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 6.92, 7.95, 7.40
[08:00:47] <icinga-miraheze>	 PROBLEM - wiki.wisrail.de - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query wiki.wisrail.de. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL
[08:01:21] <icinga-miraheze>	 PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 7.01, 7.55, 6.75
[08:01:24] <icinga-miraheze>	 PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.11, 7.63, 7.92
[08:03:15] <icinga-miraheze>	 PROBLEM - en.clockupwiki.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - en.clockupwiki.org All nameservers failed to answer the query.
[08:05:21] <icinga-miraheze>	 PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 8.42, 7.67, 6.96
[08:05:24] <icinga-miraheze>	 PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.24, 7.37, 7.70
[08:06:25] <icinga-miraheze>	 PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.81, 7.45, 6.45
[08:07:21] <icinga-miraheze>	 PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 6.37, 7.13, 6.85
[08:07:24] <icinga-miraheze>	 PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.31, 7.19, 7.59
[08:07:57] <icinga-miraheze>	 RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 4.31, 5.68, 6.58
[08:10:22] <icinga-miraheze>	 RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 6.21, 6.68, 6.35
[08:11:53] <icinga-miraheze>	 PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 6.55, 6.66, 6.81
[08:13:24] <icinga-miraheze>	 PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.16, 7.73, 7.69
[08:13:52] <icinga-miraheze>	 RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 4.64, 5.90, 6.51
[08:16:04] <icinga-miraheze>	 PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1234516203 secs
[08:19:21] <icinga-miraheze>	 RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 5.71, 6.61, 6.79
[08:29:33] <icinga-miraheze>	 PROBLEM - wiki.wisrail.de - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.wisrail.de All nameservers failed to answer the query.
[08:31:40] <icinga-miraheze>	 PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 7.41, 6.61, 6.27
[08:33:01] <icinga-miraheze>	 RECOVERY - en.clockupwiki.org - reverse DNS on sslhost is OK: SSL OK - en.clockupwiki.org reverse DNS resolves to cp23.miraheze.org - CNAME OK
[08:33:38] <icinga-miraheze>	 RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 4.38, 5.91, 6.06
[08:40:42] <icinga-miraheze>	 PROBLEM - perilous-times.com - LetsEncrypt on sslhost is CRITICAL: connect to address perilous-times.com and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket
[08:44:04] <icinga-miraheze>	 RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.08774274588 secs
[09:09:17] <icinga-miraheze>	 PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 9.07, 7.08, 6.41
[09:13:17] <icinga-miraheze>	 RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 5.37, 6.60, 6.41
[09:22:30] <icinga-miraheze>	 PROBLEM - swiftobject111 Disk Space on swiftobject111 is WARNING: DISK WARNING - free space: / 32130 MB (6% inode=82%);
[09:28:47] <icinga-miraheze>	 RECOVERY - wiki.wisrail.de - reverse DNS on sslhost is OK: SSL OK - wiki.wisrail.de reverse DNS resolves to cp23.miraheze.org - CNAME OK
[09:29:24] <icinga-miraheze>	 PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 6.67, 6.67, 7.90
[09:31:24] <icinga-miraheze>	 PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 10.61, 7.91, 8.19
[09:34:04] <icinga-miraheze>	 PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1457811296 secs
[09:40:07] <icinga-miraheze>	 PROBLEM - wiki.gesamtschule-nordkirchen.de - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query wiki.gesamtschule-nordkirchen.de. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL
[09:52:04] <icinga-miraheze>	 RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.09118452668 secs
[09:56:46] <icinga-miraheze>	 PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.15, 6.33, 5.56
[09:58:44] <icinga-miraheze>	 RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 4.83, 5.68, 5.41
[09:58:46] <icinga-miraheze>	 PROBLEM - wiki.nj.cn.eu.org - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query wiki.nj.cn.eu.org. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL
[10:06:38] <icinga-miraheze>	 PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.18, 6.91, 6.05
[10:08:30] <icinga-miraheze>	 PROBLEM - swiftobject111 Disk Space on swiftobject111 is CRITICAL: DISK CRITICAL - free space: / 31870 MB (5% inode=82%);
[10:09:14] <icinga-miraheze>	 RECOVERY - wiki.gesamtschule-nordkirchen.de - reverse DNS on sslhost is OK: SSL OK - wiki.gesamtschule-nordkirchen.de reverse DNS resolves to cp22.miraheze.org - CNAME OK
[10:10:35] <icinga-miraheze>	 RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 5.34, 6.47, 6.09
[10:17:02] <icinga-miraheze>	 PROBLEM - db101 Backups SQL on db101 is WARNING: FILE_AGE WARNING: /var/log/sql-backup.log is 864122 seconds old and 1879 bytes
[10:24:30] <icinga-miraheze>	 PROBLEM - swiftobject111 Disk Space on swiftobject111 is WARNING: DISK WARNING - free space: / 32208 MB (6% inode=82%);
[10:28:12] <icinga-miraheze>	 RECOVERY - wiki.nj.cn.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.nj.cn.eu.org reverse DNS resolves to cp22.miraheze.org - CNAME OK
[11:18:35] <botifico>	 [02miraheze/landing] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/landing/compare/4ae736a1f643...b5ce0c9fb9bf
[11:18:36] <botifico>	 [02miraheze/landing] 07translatewiki 03b5ce0c9 - Localisation updates from https://translatewiki.net.
[11:19:30] <miraheze-github>	 miraheze/landing - translatewiki the build passed.
[11:22:59] <icinga-miraheze>	 PROBLEM - swiftobject112 Disk Space on swiftobject112 is WARNING: DISK WARNING - free space: / 31970 MB (6% inode=82%);
[11:30:59] <icinga-miraheze>	 PROBLEM - swiftobject112 Disk Space on swiftobject112 is CRITICAL: DISK CRITICAL - free space: / 31964 MB (5% inode=82%);
[11:53:24] <icinga-miraheze>	 PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.17, 7.53, 7.89
[12:03:24] <icinga-miraheze>	 PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 9.56, 7.85, 7.76
[12:25:50] <icinga-miraheze>	 RECOVERY - studyabroad.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'studyabroad.wiki' will expire on Tue 25 Jul 2023 14:49:19 GMT +0000.
[12:37:00] <botifico>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03revert-5256-paladox-patch-2 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/26f10fd85268
[12:37:02] <botifico>	 [02miraheze/mw-config] 07paladox 0326f10fd - Revert "Disable file uploads temporarily due to swift outage (#5256)"
[12:37:04] <botifico>	 [02mw-config] 07paladox created branch 03revert-5256-paladox-patch-2 - 13https://github.com/miraheze/mw-config
[12:37:05] <botifico>	 [02mw-config] 07paladox opened pull request 03#5257: Revert "Disable file uploads temporarily due to swift outage" - 13https://github.com/miraheze/mw-config/pull/5257
[12:37:41] <botifico>	 [02miraheze/mw-config] 07github-actions[bot] pushed 031 commit to 03revert-5256-paladox-patch-2 [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/26f10fd85268...4d1325b18c31
[12:37:44] <botifico>	 [02miraheze/mw-config] 07github-actions 034d1325b - CI: lint code to MediaWiki standards
[12:37:46] <botifico>	 [02mw-config] 07github-actions[bot] synchronize pull request 03#5257: Revert "Disable file uploads temporarily due to swift outage" - 13https://github.com/miraheze/mw-config/pull/5257
[12:38:09] <icinga-miraheze>	 PROBLEM - os141 Current Load on os141 is CRITICAL: CRITICAL - load average: 4.29, 3.06, 1.80
[12:38:18] <miraheze-github>	 miraheze/mw-config - paladox the build passed.
[12:38:45] <icinga-miraheze>	 PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 9.56, 7.72, 4.26
[12:40:07] <icinga-miraheze>	 RECOVERY - os141 Current Load on os141 is OK: OK - load average: 1.43, 2.49, 1.75
[12:40:40] <icinga-miraheze>	 RECOVERY - db142 Current Load on db142 is OK: OK - load average: 3.11, 5.95, 4.03
[12:57:29] <icinga-miraheze>	 PROBLEM - wiki.nj.cn.eu.org - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query wiki.nj.cn.eu.org. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL
[13:12:30] <icinga-miraheze>	 PROBLEM - swiftobject111 Disk Space on swiftobject111 is CRITICAL: DISK CRITICAL - free space: / 31918 MB (5% inode=82%);
[13:24:48] <botifico>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03revert-5256-paladox-patch-2 [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/4d1325b18c31...146a62f69bdb
[13:24:50] <botifico>	 [02miraheze/mw-config] 07paladox 03146a62f - Update Sitenotice.php
[13:24:52] <botifico>	 [02mw-config] 07paladox synchronize pull request 03#5257: Revert "Disable file uploads temporarily due to swift outage" - 13https://github.com/miraheze/mw-config/pull/5257
[13:25:47] <miraheze-github>	 miraheze/mw-config - paladox the build passed.
[13:33:11] <botifico>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-5 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/66787fabedc3...d76606d3050f
[13:33:14] <botifico>	 [02miraheze/puppet] 07paladox 03d76606d - Update server.pp
[13:33:15] <botifico>	 [02puppet] 07paladox synchronize pull request 03#3244: swift: fix disabling rsync when disk is full - 13https://github.com/miraheze/puppet/pull/3244
[13:37:17] <icinga-miraheze>	 PROBLEM - swiftobject121 Disk Space on swiftobject121 is WARNING: DISK WARNING - free space: / 28679 MB (6% inode=82%);
[13:37:35] <botifico>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-5 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/d76606d3050f...d3abfa13a1f9
[13:37:38] <botifico>	 [02miraheze/puppet] 07paladox 03d3abfa1 - Update storage.pp
[13:37:40] <botifico>	 [02puppet] 07paladox synchronize pull request 03#3244: swift: fix disabling rsync when disk is full - 13https://github.com/miraheze/puppet/pull/3244
[13:37:56] <botifico>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-5 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/d3abfa13a1f9...f22e67db0ec0
[13:37:59] <botifico>	 [02miraheze/puppet] 07paladox 03f22e67d - Update disable_rsync.py
[13:38:02] <botifico>	 [02puppet] 07paladox synchronize pull request 03#3244: swift: fix disabling rsync when disk is full - 13https://github.com/miraheze/puppet/pull/3244
[13:56:23] <icinga-miraheze>	 PROBLEM - wiki.nj.cn.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.nj.cn.eu.org All nameservers failed to answer the query.
[14:21:10] <icinga-miraheze>	 PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query wiki.andreijiroh.uk.eu.org. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL
[14:47:55] <icinga-miraheze>	 PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 7.68, 5.43, 3.01
[14:48:22] <icinga-miraheze>	 PROBLEM - os141 Current Load on os141 is CRITICAL: CRITICAL - load average: 5.44, 3.70, 2.01
[14:49:55] <icinga-miraheze>	 RECOVERY - db142 Current Load on db142 is OK: OK - load average: 6.66, 5.86, 3.47
[14:50:29] <icinga-miraheze>	 RECOVERY - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.andreijiroh.uk.eu.org reverse DNS resolves to cp22.miraheze.org - CNAME OK
[14:52:21] <icinga-miraheze>	 RECOVERY - os141 Current Load on os141 is OK: OK - load average: 1.69, 3.12, 2.22
[15:05:24] <botifico>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/db980b4243f8...e65bc7889337
[15:05:27] <botifico>	 [02miraheze/puppet] 07paladox 03e65bc78 - Update disable_rsync.py
[15:09:36] <botifico>	 [02mw-config] 07paladox synchronize pull request 03#5257: Revert "Disable file uploads temporarily due to swift outage" - 13https://github.com/miraheze/mw-config/pull/5257
[15:09:39] <botifico>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03revert-5256-paladox-patch-2 [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/146a62f69bdb...3d555e99e188
[15:09:41] <botifico>	 [02miraheze/mw-config] 07paladox 033d555e9 - Update Sitenotice.php
[15:09:50] <botifico>	 [02mw-config] 07paladox closed pull request 03#5257: Revert "Disable file uploads temporarily due to swift outage" - 13https://github.com/miraheze/mw-config/pull/5257
[15:09:51] <botifico>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/mw-config/compare/297ae5899534...56a46f337bbb
[15:09:54] <botifico>	 [02miraheze/mw-config] 07paladox 0356a46f3 - Revert "Disable file uploads temporarily due to swift outage" (#5257)
[15:09:56] <botifico>	 [02miraheze/mw-config] 07paladox deleted branch 03revert-5256-paladox-patch-2
[15:09:59] <botifico>	 [02mw-config] 07paladox deleted branch 03revert-5256-paladox-patch-2 - 13https://github.com/miraheze/mw-config
[15:10:17] <MirahezeLSBot>	 !log [paladox@mwtask141] starting deploy of {'pull': 'config', 'config': True} to all
[15:10:23] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[15:10:29] <MirahezeLSBot>	 !log [paladox@mwtask141] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 11s
[15:10:33] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[15:10:39] <miraheze-github>	 miraheze/mw-config - paladox the build passed.
[15:10:43] <MirahezeLSBot>	 !log [paladox@mwtask141] starting deploy of {'config': True} to all
[15:10:49] <MirahezeLSBot>	 !log [paladox@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 6s
[15:10:49] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[15:10:53] <miraheze-github>	 miraheze/mw-config - paladox the build passed.
[15:10:55] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[15:21:39] <botifico>	 [02puppet] 07paladox closed pull request 03#3244: swift: fix disabling rsync when disk is full - 13https://github.com/miraheze/puppet/pull/3244
[15:21:42] <botifico>	 [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±3] 13https://github.com/miraheze/puppet/compare/e65bc7889337...1908c2aa1a25
[15:21:44] <botifico>	 [02miraheze/puppet] 07paladox 031908c2a - swift: fix disabling rsync when disk is full (#3244)
[15:21:45] <botifico>	 [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-5
[15:21:48] <botifico>	 [02puppet] 07paladox deleted branch 03paladox-patch-5 - 13https://github.com/miraheze/puppet
[15:24:58] <icinga-miraheze>	 RECOVERY - wiki.nj.cn.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.nj.cn.eu.org reverse DNS resolves to cp22.miraheze.org - CNAME OK
[15:27:34] <MirahezeLSBot>	 !log [@test131] starting deploy of {'config': True} to all
[15:27:35] <MirahezeLSBot>	 !log [@test131] finished deploy of {'config': True} to all - SUCCESS in 1s
[15:27:38] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[15:27:44] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[15:37:24] <icinga-miraheze>	 PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 5.17, 6.97, 7.74
[15:43:17] <icinga-miraheze>	 RECOVERY - swiftobject121 Disk Space on swiftobject121 is OK: DISK OK - free space: / 53280 MB (11% inode=83%);
[15:43:24] <icinga-miraheze>	 RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 4.43, 5.07, 6.62
[15:45:02] <icinga-miraheze>	 PROBLEM - swiftobject122 Disk Space on swiftobject122 is WARNING: DISK WARNING - free space: / 54801 MB (6% inode=82%);
[16:37:56] <icinga-miraheze>	 PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.37, 3.63, 2.44
[16:39:29] <icinga-miraheze>	 PROBLEM - matomo121 HTTPS on matomo121 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 358 bytes in 0.014 second response time
[16:39:56] <icinga-miraheze>	 RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.07, 3.18, 2.42
[16:41:29] <icinga-miraheze>	 RECOVERY - matomo121 HTTPS on matomo121 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.177 second response time
[16:58:04] <icinga-miraheze>	 PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1066464186 secs
[17:14:04] <icinga-miraheze>	 RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.09004053473 secs
[17:16:37] <icinga-miraheze>	 PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.55, 7.35, 7.93
[17:18:37] <icinga-miraheze>	 PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.72, 7.93, 8.07
[17:25:55] <icinga-miraheze>	 PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 6.88, 5.65, 3.24
[17:27:55] <icinga-miraheze>	 RECOVERY - db142 Current Load on db142 is OK: OK - load average: 1.88, 4.37, 3.08
[17:35:17] <icinga-miraheze>	 PROBLEM - swiftobject121 Disk Space on swiftobject121 is WARNING: DISK WARNING - free space: / 51671 MB (10% inode=83%);
[17:50:37] <icinga-miraheze>	 PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.41, 6.95, 7.71
[17:51:29] <botifico>	 [02puppet] 07paladox closed pull request 03#3243: swift: fix disabling rsync - 13https://github.com/miraheze/puppet/pull/3243
[17:51:31] <botifico>	 [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-4
[17:51:32] <botifico>	 [02puppet] 07paladox deleted branch 03paladox-patch-4 - 13https://github.com/miraheze/puppet
[17:52:37] <icinga-miraheze>	 PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.15, 7.21, 7.69
[17:54:37] <icinga-miraheze>	 PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.16, 7.20, 7.63
[17:58:37] <icinga-miraheze>	 PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.11, 7.41, 7.59
[18:00:37] <icinga-miraheze>	 PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.51, 7.15, 7.48
[18:04:37] <icinga-miraheze>	 PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.00, 7.90, 7.67
[18:10:58] <icinga-miraheze>	 PROBLEM - db112 Disk Space on db112 is WARNING: DISK WARNING - free space: / 14506 MB (10% inode=99%);
[18:19:32] <icinga-miraheze>	 PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 6.61, 8.20, 4.99
[18:20:58] <icinga-miraheze>	 RECOVERY - db112 Disk Space on db112 is OK: DISK OK - free space: / 17735 MB (13% inode=99%);
[18:21:13] <icinga-miraheze>	 PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query wiki.andreijiroh.uk.eu.org. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL
[18:34:58] <icinga-miraheze>	 PROBLEM - db112 Disk Space on db112 is WARNING: DISK WARNING - free space: / 14135 MB (10% inode=99%);
[18:36:30] <icinga-miraheze>	 PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.48, 5.39, 3.46
[18:37:02] <icinga-miraheze>	 RECOVERY - swiftobject122 Disk Space on swiftobject122 is OK: DISK OK - free space: / 97880 MB (11% inode=83%);
[18:40:20] <icinga-miraheze>	 PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.28, 3.63, 3.16
[18:42:16] <icinga-miraheze>	 RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.56, 3.33, 3.11
[18:43:02] <icinga-miraheze>	 PROBLEM - swiftobject122 Disk Space on swiftobject122 is WARNING: DISK WARNING - free space: / 97182 MB (10% inode=83%);
[18:44:04] <icinga-miraheze>	 PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1092767715 secs
[18:44:56] <botifico>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/56a46f337bbb...df9f3e0cbea1
[18:44:59] <botifico>	 [02miraheze/mw-config] 07paladox 03df9f3e0 - Remove duplicates in wgImageLimits
[18:45:02] <icinga-miraheze>	 RECOVERY - swiftobject122 Disk Space on swiftobject122 is OK: DISK OK - free space: / 98050 MB (11% inode=83%);
[18:45:19] <MirahezeLSBot>	 !log [paladox@mwtask141] starting deploy of {'pull': 'config', 'config': True} to all
[18:45:24] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[18:45:46] <MirahezeLSBot>	 !log [paladox@mwtask141] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 27s
[18:45:50] <MirahezeLSBot>	 !log [paladox@mwtask141] starting deploy of {'config': True} to all
[18:45:52] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[18:45:57] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[18:45:58] <MirahezeLSBot>	 !log [paladox@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 8s
[18:46:00] <miraheze-github>	 miraheze/mw-config - paladox the build passed.
[18:46:04] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[18:50:30] <icinga-miraheze>	 RECOVERY - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.andreijiroh.uk.eu.org reverse DNS resolves to cp22.miraheze.org - CNAME OK
[18:54:59] <icinga-miraheze>	 RECOVERY - db112 Disk Space on db112 is OK: DISK OK - free space: / 27141 MB (20% inode=99%);
[18:58:04] <icinga-miraheze>	 RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.07800510526 secs
[18:58:08] <MirahezeLSBot>	 !log [@test131] starting deploy of {'config': True} to all
[18:58:09] <MirahezeLSBot>	 !log [@test131] finished deploy of {'config': True} to all - SUCCESS in 1s
[18:58:21] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[18:58:25] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[18:58:35] <icinga-miraheze>	 PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 7.24, 6.38, 4.56
[18:59:15] <icinga-miraheze>	 PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.56, 3.91, 3.05
[19:00:29] <icinga-miraheze>	 RECOVERY - db142 Current Load on db142 is OK: OK - load average: 2.35, 4.86, 4.22
[19:01:13] <icinga-miraheze>	 RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 3.04, 3.31, 2.92
[19:07:56] <icinga-miraheze>	 PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 2.74, 4.19, 3.50
[19:09:56] <icinga-miraheze>	 PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.43, 3.64, 3.38
[19:11:56] <icinga-miraheze>	 RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.41, 2.79, 3.09
[19:17:32] <icinga-miraheze>	 PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 2.64, 5.99, 7.98
[19:21:32] <icinga-miraheze>	 RECOVERY - db112 Current Load on db112 is OK: OK - load average: 0.73, 3.01, 6.29
[19:23:06] <icinga-miraheze>	 PROBLEM - wiki.zulaclub.net - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query wiki.zulaclub.net. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL
[19:44:37] <icinga-miraheze>	 PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.08, 7.06, 7.92
[19:46:37] <icinga-miraheze>	 PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.69, 8.29, 8.27
[19:51:43] <icinga-miraheze>	 RECOVERY - wiki.zulaclub.net - reverse DNS on sslhost is OK: SSL OK - wiki.zulaclub.net reverse DNS resolves to cp23.miraheze.org - CNAME OK
[19:53:11] <icinga-miraheze>	 PROBLEM - wiki.randomstuffimade.page - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query randomstuffimade.page. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL
[20:06:00] <icinga-miraheze>	 PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 14.01, 5.22, 3.00
[20:11:56] <icinga-miraheze>	 PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.55, 3.67, 3.19
[20:13:56] <icinga-miraheze>	 RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.93, 3.09, 3.04
[20:21:51] <icinga-miraheze>	 RECOVERY - wiki.randomstuffimade.page - reverse DNS on sslhost is OK: SSL OK - wiki.randomstuffimade.page reverse DNS resolves to cp23.miraheze.org - CNAME OK
[20:24:37] <icinga-miraheze>	 PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.35, 7.12, 7.83
[20:28:37] <icinga-miraheze>	 PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.43, 8.07, 8.01
[20:30:37] <icinga-miraheze>	 PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.30, 7.19, 7.69
[20:31:36] <icinga-miraheze>	 PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query en.religiononfire.mar.in.ua. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL
[20:40:37] <icinga-miraheze>	 RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.20, 5.41, 6.69
[20:46:01] <icinga-miraheze>	 PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 4.72, 3.35, 1.83
[20:48:01] <icinga-miraheze>	 RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 1.86, 3.02, 1.92
[21:01:15] <icinga-miraheze>	 RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK
[21:26:59] <icinga-miraheze>	 PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.68, 7.03, 6.08
[21:28:53] <icinga-miraheze>	 RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.40, 6.17, 5.87
[21:37:56] <icinga-miraheze>	 PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.54, 4.01, 2.70
[21:41:56] <icinga-miraheze>	 RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.59, 3.12, 2.67
[22:27:12] <icinga-miraheze>	 PROBLEM - wiki.nj.cn.eu.org - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query cn.eu.org. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL
[22:56:39] <icinga-miraheze>	 RECOVERY - wiki.nj.cn.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.nj.cn.eu.org reverse DNS resolves to cp22.miraheze.org - CNAME OK
[23:14:04] <icinga-miraheze>	 PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1237832606 secs
[23:32:06] <icinga-miraheze>	 RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.07547694445 secs
[23:32:30] <icinga-miraheze>	 PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query mar.in.ua. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL
[23:42:39] <icinga-miraheze>	 PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.79, 3.94, 2.88
[23:46:30] <icinga-miraheze>	 RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.22, 3.04, 2.76