[00:00:41] <icinga-miraheze>	 PROBLEM - cp26 HTTP 4xx/5xx ERROR Rate on cp26 is UNKNOWN: UNKNOWN - NGINX Error Rate is UNKNOWN
[00:01:57] <botifico>	 [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03namespace-cleanup [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/617606927ee2...fba5f226d0a5
[00:01:59] <botifico>	 [02miraheze/MirahezeMagic] 07Universal-Omega 03fba5f22 - Fix
[00:02:00] <botifico>	 [02MirahezeMagic] 07Universal-Omega synchronize pull request 03#472: Namespace and cleanup MirahezeMagic - 13https://github.com/miraheze/MirahezeMagic/pull/472
[00:02:02] <icinga-miraheze>	 PROBLEM - cp27 HTTP 4xx/5xx ERROR Rate on cp27 is WARNING: WARNING - NGINX Error Rate is 50%
[00:02:18] <icinga-miraheze>	 PROBLEM - cp36 HTTP 4xx/5xx ERROR Rate on cp36 is UNKNOWN: UNKNOWN - NGINX Error Rate is UNKNOWN
[00:02:41] <icinga-miraheze>	 PROBLEM - cp26 HTTP 4xx/5xx ERROR Rate on cp26 is CRITICAL: CRITICAL - NGINX Error Rate is 100%
[00:03:21] <icinga-miraheze>	 PROBLEM - cp37 HTTP 4xx/5xx ERROR Rate on cp37 is UNKNOWN: UNKNOWN - NGINX Error Rate is UNKNOWN
[00:03:44] <botifico>	 [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03namespace-cleanup [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/fba5f226d0a5...ccc5e512ab2f
[00:03:47] <botifico>	 [02miraheze/MirahezeMagic] 07Universal-Omega 03ccc5e51 - Fix
[00:03:50] <botifico>	 [02MirahezeMagic] 07Universal-Omega synchronize pull request 03#472: Namespace and cleanup MirahezeMagic - 13https://github.com/miraheze/MirahezeMagic/pull/472
[00:04:02] <icinga-miraheze>	 PROBLEM - cp27 HTTP 4xx/5xx ERROR Rate on cp27 is CRITICAL: CRITICAL - NGINX Error Rate is 67%
[00:04:18] <icinga-miraheze>	 RECOVERY - cp36 HTTP 4xx/5xx ERROR Rate on cp36 is OK: OK - NGINX Error Rate is 8%
[00:04:45] <icinga-miraheze>	 RECOVERY - cp37 Disk Space on cp37 is OK: DISK OK - free space: / 14121MiB (15% inode=98%);
[00:04:51] <icinga-miraheze>	 RECOVERY - cp36 Disk Space on cp36 is OK: DISK OK - free space: / 14226MiB (16% inode=98%);
[00:04:54] <botifico>	 [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03namespace-cleanup [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/ccc5e512ab2f...b78ed9774cb3
[00:04:55] <botifico>	 [02miraheze/MirahezeMagic] 07Universal-Omega 03b78ed97 - Fix
[00:04:57] <botifico>	 [02MirahezeMagic] 07Universal-Omega synchronize pull request 03#472: Namespace and cleanup MirahezeMagic - 13https://github.com/miraheze/MirahezeMagic/pull/472
[00:05:21] <icinga-miraheze>	 RECOVERY - cp37 HTTP 4xx/5xx ERROR Rate on cp37 is OK: OK - NGINX Error Rate is 6%
[00:10:10] <miraheze-github>	 miraheze/MirahezeMagic - Universal-Omega the build passed.
[00:11:34] <botifico>	 [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03namespace-cleanup [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/b78ed9774cb3...fe96678dd317
[00:11:35] <botifico>	 [02miraheze/MirahezeMagic] 07Universal-Omega 03fe96678 - Fix
[00:11:37] <botifico>	 [02MirahezeMagic] 07Universal-Omega synchronize pull request 03#472: Namespace and cleanup MirahezeMagic - 13https://github.com/miraheze/MirahezeMagic/pull/472
[00:13:35] <botifico>	 [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03namespace-cleanup [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/fe96678dd317...ae10ccfb38c6
[00:13:38] <botifico>	 [02miraheze/MirahezeMagic] 07Universal-Omega 03ae10ccf - Fix
[00:13:41] <botifico>	 [02MirahezeMagic] 07Universal-Omega synchronize pull request 03#472: Namespace and cleanup MirahezeMagic - 13https://github.com/miraheze/MirahezeMagic/pull/472
[00:15:08] <botifico>	 [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03namespace-cleanup [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/ae10ccfb38c6...b39ad158f1dd
[00:15:11] <botifico>	 [02miraheze/MirahezeMagic] 07Universal-Omega 03b39ad15 - Fix
[00:15:13] <botifico>	 [02MirahezeMagic] 07Universal-Omega synchronize pull request 03#472: Namespace and cleanup MirahezeMagic - 13https://github.com/miraheze/MirahezeMagic/pull/472
[00:19:44] <botifico>	 [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03namespace-cleanup [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/b39ad158f1dd...ced4f548c86f
[00:19:46] <botifico>	 [02miraheze/MirahezeMagic] 07Universal-Omega 03ced4f54 - Fix
[00:19:50] <botifico>	 [02MirahezeMagic] 07Universal-Omega synchronize pull request 03#472: Namespace and cleanup MirahezeMagic - 13https://github.com/miraheze/MirahezeMagic/pull/472
[00:19:59] <miraheze-github>	 miraheze/MirahezeMagic - Universal-Omega the build passed.
[00:20:20] <botifico>	 [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03namespace-cleanup [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/ced4f548c86f...89da80c9bcb8
[00:20:23] <botifico>	 [02miraheze/MirahezeMagic] 07Universal-Omega 0389da80c - Fix
[00:20:24] <botifico>	 [02MirahezeMagic] 07Universal-Omega synchronize pull request 03#472: Namespace and cleanup MirahezeMagic - 13https://github.com/miraheze/MirahezeMagic/pull/472
[00:25:40] <botifico>	 [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03namespace-cleanup [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/89da80c9bcb8...1ac8b3f3e3c6
[00:25:41] <botifico>	 [02miraheze/MirahezeMagic] 07Universal-Omega 031ac8b3f - Fix
[00:25:44] <botifico>	 [02MirahezeMagic] 07Universal-Omega synchronize pull request 03#472: Namespace and cleanup MirahezeMagic - 13https://github.com/miraheze/MirahezeMagic/pull/472
[00:26:02] <miraheze-github>	 miraheze/MirahezeMagic - Universal-Omega the build passed.
[00:29:48] <botifico>	 [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03namespace-cleanup [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/1ac8b3f3e3c6...c7569791a0e0
[00:29:49] <botifico>	 [02miraheze/MirahezeMagic] 07Universal-Omega 03c756979 - Update
[00:29:52] <botifico>	 [02MirahezeMagic] 07Universal-Omega synchronize pull request 03#472: Namespace and cleanup MirahezeMagic - 13https://github.com/miraheze/MirahezeMagic/pull/472
[00:35:29] <miraheze-github>	 miraheze/MirahezeMagic - Universal-Omega the build passed.
[00:55:07] <botifico>	 [02MirahezeMagic] 07Universal-Omega edited pull request 03#472: Add phan, cleanup, and namespace - 13https://github.com/miraheze/MirahezeMagic/pull/472
[01:01:21] <botifico>	 [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03namespace-cleanup [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/c7569791a0e0...3bafb29b7fa7
[01:01:22] <botifico>	 [02miraheze/MirahezeMagic] 07Universal-Omega 033bafb29 - Update
[01:01:25] <botifico>	 [02MirahezeMagic] 07Universal-Omega synchronize pull request 03#472: Add phan, cleanup, and namespace - 13https://github.com/miraheze/MirahezeMagic/pull/472
[01:03:06] <botifico>	 [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03namespace-cleanup [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/3bafb29b7fa7...07eb7e1da3e5
[01:03:09] <botifico>	 [02miraheze/MirahezeMagic] 07Universal-Omega 0307eb7e1 - Update
[01:03:10] <botifico>	 [02MirahezeMagic] 07Universal-Omega synchronize pull request 03#472: Add phan, cleanup, and namespace - 13https://github.com/miraheze/MirahezeMagic/pull/472
[01:05:20] <botifico>	 [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03namespace-cleanup [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/07eb7e1da3e5...f85081c38ac1
[01:05:23] <botifico>	 [02miraheze/MirahezeMagic] 07Universal-Omega 03f85081c - Update
[01:05:24] <botifico>	 [02MirahezeMagic] 07Universal-Omega synchronize pull request 03#472: Add phan, cleanup, and namespace - 13https://github.com/miraheze/MirahezeMagic/pull/472
[01:05:51] <botifico>	 [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03namespace-cleanup [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/f85081c38ac1...bbca4b5e4fac
[01:05:53] <botifico>	 [02miraheze/MirahezeMagic] 07Universal-Omega 03bbca4b5 - Update
[01:05:56] <botifico>	 [02MirahezeMagic] 07Universal-Omega synchronize pull request 03#472: Add phan, cleanup, and namespace - 13https://github.com/miraheze/MirahezeMagic/pull/472
[01:08:21] <botifico>	 [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03namespace-cleanup [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/bbca4b5e4fac...43da67094ad9
[01:08:24] <botifico>	 [02miraheze/MirahezeMagic] 07Universal-Omega 0343da670 - Update
[01:08:25] <botifico>	 [02MirahezeMagic] 07Universal-Omega synchronize pull request 03#472: Add phan, cleanup, and namespace - 13https://github.com/miraheze/MirahezeMagic/pull/472
[01:10:58] <botifico>	 [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03namespace-cleanup [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/43da67094ad9...bb11c1468884
[01:11:01] <botifico>	 [02miraheze/MirahezeMagic] 07Universal-Omega 03bb11c14 - Update
[01:11:02] <botifico>	 [02MirahezeMagic] 07Universal-Omega synchronize pull request 03#472: Add phan, cleanup, and namespace - 13https://github.com/miraheze/MirahezeMagic/pull/472
[01:12:46] <botifico>	 [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03namespace-cleanup [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/bb11c1468884...c4332a964baa
[01:12:48] <botifico>	 [02miraheze/MirahezeMagic] 07Universal-Omega 03c4332a9 - Update
[01:12:51] <botifico>	 [02MirahezeMagic] 07Universal-Omega synchronize pull request 03#472: Add phan, cleanup, and namespace - 13https://github.com/miraheze/MirahezeMagic/pull/472
[01:18:26] <miraheze-github>	 miraheze/MirahezeMagic - Universal-Omega the build passed.
[01:45:30] <icinga-miraheze>	 [Grafana] !sre FIRING: The mediawiki job queue has more than 2500 unclaimed jobs https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1
[02:00:14] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 177.14 ms
[02:00:30] <icinga-miraheze>	 [Grafana] !sre RESOLVED: High Job Queue Backlog https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1
[02:02:15] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 167.34 ms
[02:06:23] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 184.06 ms
[02:10:26] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 173.73 ms
[03:00:20] <icinga-miraheze>	 RECOVERY - mon181 Backups Grafana on mon181 is OK: FILE_AGE OK: /var/log/grafana-backup.log is 2 seconds old and 92 bytes
[03:23:37] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 163.23 ms
[03:25:38] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 173.95 ms
[03:46:59] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 167.23 ms
[03:47:27] <botifico>	 [02miraheze/CreateWiki] 07Universal-Omega pushed 0325 commits to 03Reception123-patch-2 [+2/-0/±66] 13https://github.com/miraheze/CreateWiki/compare/c562d280bf0d...ea55f6ae031f
[03:47:29] <botifico>	 [02miraheze/CreateWiki] 07Universal-Omega 03ea55f6a - Merge branch 'master' into Reception123-patch-2
[03:47:30] <botifico>	 [02CreateWiki] 07Universal-Omega synchronize pull request 03#465: add script to delete individual wikis - 13https://github.com/miraheze/CreateWiki/pull/465
[03:48:51] <icinga-miraheze>	 PROBLEM - cp36 Disk Space on cp36 is WARNING: DISK WARNING - free space: / 9684MiB (10% inode=98%);
[03:48:52] <botifico>	 [02CreateWiki] 07Universal-Omega synchronize pull request 03#465: add script to delete individual wikis - 13https://github.com/miraheze/CreateWiki/pull/465
[03:48:54] <botifico>	 [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03Reception123-patch-2 [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/ea55f6ae031f...b7c95b68fb2f
[03:48:55] <botifico>	 [02miraheze/CreateWiki] 07Universal-Omega 03b7c95b6 - Use single quotes
[03:50:45] <icinga-miraheze>	 PROBLEM - cp37 Disk Space on cp37 is WARNING: DISK WARNING - free space: / 9643MiB (10% inode=98%);
[03:52:30] <miraheze-github>	 miraheze/CreateWiki - Universal-Omega the build has errored.
[04:01:18] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 186.78 ms
[04:14:33] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 181.49 ms
[04:16:34] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 179.57 ms
[04:42:12] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 177.77 ms
[04:44:13] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 183.65 ms
[05:01:27] <botifico>	 [02MirahezeMagic] 07Universal-Omega closed pull request 03#421: Namespace MirahezeMagic - 13https://github.com/miraheze/MirahezeMagic/pull/421
[05:01:30] <botifico>	 [02MirahezeMagic] 07Universal-Omega commented on pull request 03#421: Namespace MirahezeMagic - 13https://github.com/miraheze/MirahezeMagic/pull/421#issuecomment-1962813674
[05:01:31] <botifico>	 [02miraheze/MirahezeMagic] 07Universal-Omega deleted branch 03vanishuser
[05:01:34] <botifico>	 [02MirahezeMagic] 07Universal-Omega deleted branch 03vanishuser - 13https://github.com/miraheze/MirahezeMagic
[05:07:40] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 188.45 ms
[05:13:46] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 186.73 ms
[05:24:54] <MirahezeRelay>	 <cosmicalpha> !log destroyed a user on Phorge
[05:24:57] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[05:38:21] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 191.83 ms
[05:44:28] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 187.40 ms
[06:09:34] <icinga-miraheze>	 PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.andreijiroh.uk.eu.org All nameservers failed to answer the query.
[06:11:44] <icinga-miraheze>	 PROBLEM - swiftac171 Current Load on swiftac171 is CRITICAL: LOAD CRITICAL - total load average: 18.71, 11.35, 5.65
[06:12:04] <icinga-miraheze>	 PROBLEM - swiftac171 Puppet on swiftac171 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[06:13:02] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 191.52 ms
[06:13:42] <icinga-miraheze>	 RECOVERY - swiftac171 Current Load on swiftac171 is OK: LOAD OK - total load average: 7.02, 10.14, 5.97
[06:14:01] <icinga-miraheze>	 RECOVERY - swiftac171 Puppet on swiftac171 is OK: OK: Puppet is currently enabled, last run 19 minutes ago with 0 failures
[06:15:03] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 194.71 ms
[07:01:47] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 191.90 ms
[07:07:36] <icinga-miraheze>	 RECOVERY - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.andreijiroh.uk.eu.org reverse DNS resolves to cp36.wikitide.net - CNAME OK
[07:10:00] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 193.74 ms
[07:17:12] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 193.14 ms
[07:21:15] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 194.50 ms
[07:25:23] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 190.41 ms
[07:27:24] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 191.93 ms
[07:32:45] <icinga-miraheze>	 PROBLEM - cp37 Disk Space on cp37 is CRITICAL: DISK CRITICAL - free space: / 5293MiB (5% inode=98%);
[07:32:51] <icinga-miraheze>	 PROBLEM - cp36 Disk Space on cp36 is CRITICAL: DISK CRITICAL - free space: / 5302MiB (5% inode=98%);
[07:43:40] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 194.16 ms
[07:47:43] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 195.10 ms
[07:54:59] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 37%, RTA = 192.01 ms
[07:57:00] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 194.91 ms
[08:01:12] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 192.48 ms
[08:05:16] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 193.11 ms
[08:08:16] <icinga-miraheze>	 PROBLEM - ping6 on cp28 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 153.27 ms
[08:09:26] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 195.30 ms
[08:10:14] <icinga-miraheze>	 RECOVERY - ping6 on cp28 is OK: PING OK - Packet loss = 0%, RTA = 147.89 ms
[08:15:32] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 192.04 ms
[08:19:42] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 195.05 ms
[08:21:43] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 191.67 ms
[08:32:04] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 37%, RTA = 192.15 ms
[08:34:06] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 193.18 ms
[08:40:58] <icinga-miraheze>	 PROBLEM - ping6 on cp28 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 148.24 ms
[08:42:23] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 197.24 ms
[08:44:55] <icinga-miraheze>	 RECOVERY - ping6 on cp28 is OK: PING OK - Packet loss = 0%, RTA = 153.18 ms
[08:46:26] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 193.73 ms
[09:09:56] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 37%, RTA = 191.20 ms
[09:14:02] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 194.00 ms
[09:22:12] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 195.54 ms
[09:26:15] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 192.77 ms
[09:40:57] <botifico>	 [02WikiDiscover] 07labster opened pull request 03#111: T11683 Actually use $conds instead of an empty array - 13https://github.com/miraheze/WikiDiscover/pull/111
[09:44:49] <miraheze-github>	 miraheze/WikiDiscover - labster the build passed.
[09:46:25] <botifico>	 [02WikiDiscover] 07Universal-Omega closed pull request 03#111: T11683 Actually use $conds instead of an empty array - 13https://github.com/miraheze/WikiDiscover/pull/111
[09:46:28] <botifico>	 [02miraheze/WikiDiscover] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/WikiDiscover/compare/8d6409cd768f...d25e2420cb89
[09:46:29] <botifico>	 [02miraheze/WikiDiscover] 07labster 03d25e242 - T11683 Actually use $conds instead of an empty array (#111)
[09:47:12] <MirahezeLSBot>	 !log [universalomega@mwtask181] starting deploy of {'versions': '1.41', 'upgrade_extensions': 'WikiDiscover'} to all
[09:47:15] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[09:47:21] <MirahezeLSBot>	 !log [universalomega@mwtask181] finished deploy of {'versions': '1.41', 'upgrade_extensions': 'WikiDiscover'} to all - SUCCESS in 9s
[09:47:27] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[09:50:38] <miraheze-github>	 miraheze/WikiDiscover - Universal-Omega the build passed.
[10:01:57] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 191.32 ms
[10:03:58] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 192.23 ms
[10:12:48] <icinga-miraheze>	 PROBLEM - ping6 on cp28 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 157.86 ms
[10:18:45] <icinga-miraheze>	 RECOVERY - ping6 on cp28 is OK: PING OK - Packet loss = 0%, RTA = 161.93 ms
[10:26:26] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 190.48 ms
[10:28:27] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 186.86 ms
[10:36:46] <icinga-miraheze>	 PROBLEM - ping6 on cp28 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 153.45 ms
[10:38:44] <icinga-miraheze>	 RECOVERY - ping6 on cp28 is OK: PING OK - Packet loss = 0%, RTA = 145.68 ms
[10:47:24] <icinga-miraheze>	 PROBLEM - swiftac171 APT on swiftac171 is WARNING: APT WARNING: 0 packages available for upgrade (0 critical updates). warnings detected, errors detected.
[10:49:24] <icinga-miraheze>	 PROBLEM - swiftac171 APT on swiftac171 is CRITICAL: APT CRITICAL: 32 packages available for upgrade (5 critical updates).
[11:06:19] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 190.94 ms
[11:10:23] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 183.62 ms
[11:25:43] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 182.55 ms
[11:29:47] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 190.06 ms
[11:37:56] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 182.11 ms
[11:39:57] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 189.70 ms
[11:47:10] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 189.30 ms
[11:51:13] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 189.96 ms
[12:00:29] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 190.39 ms
[12:02:30] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 191.62 ms
[12:48:27] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 193.88 ms
[12:58:37] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 194.42 ms
[13:21:10] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 199.45 ms
[13:23:11] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 202.83 ms
[13:29:22] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 44%, RTA = 197.36 ms
[13:41:36] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 197.62 ms
[13:45:45] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 198.95 ms
[13:47:46] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 195.89 ms
[13:51:54] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 196.47 ms
[13:52:45] <icinga-miraheze>	 RECOVERY - cp37 Disk Space on cp37 is OK: DISK OK - free space: / 15043MiB (16% inode=98%);
[13:52:51] <icinga-miraheze>	 RECOVERY - cp36 Disk Space on cp36 is OK: DISK OK - free space: / 12178MiB (13% inode=98%);
[14:00:05] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 201.52 ms
[14:06:13] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 197.83 ms
[14:10:17] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 199.40 ms
[14:17:03] <icinga-miraheze>	 PROBLEM - ping6 on cp28 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 153.15 ms
[14:18:29] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 201.49 ms
[14:19:01] <icinga-miraheze>	 RECOVERY - ping6 on cp28 is OK: PING OK - Packet loss = 0%, RTA = 153.42 ms
[14:22:33] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 201.13 ms
[14:35:53] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 198.82 ms
[14:44:01] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 201.95 ms
[15:02:22] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 203.17 ms
[15:18:44] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 202.06 ms
[15:22:53] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 200.55 ms
[15:23:41] <icinga-miraheze>	 PROBLEM - ping6 on cp28 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 148.49 ms
[15:25:40] <icinga-miraheze>	 RECOVERY - ping6 on cp28 is OK: PING OK - Packet loss = 0%, RTA = 155.43 ms
[15:28:59] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 203.82 ms
[15:36:11] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 37%, RTA = 202.55 ms
[15:40:16] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 206.81 ms
[15:42:46] <icinga-miraheze>	 PROBLEM - ping6 on cp28 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 148.41 ms
[15:44:44] <icinga-miraheze>	 RECOVERY - ping6 on cp28 is OK: PING OK - Packet loss = 0%, RTA = 158.81 ms
[15:55:42] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 213.06 ms
[15:58:51] <icinga-miraheze>	 PROBLEM - cp36 Disk Space on cp36 is WARNING: DISK WARNING - free space: / 9691MiB (10% inode=98%);
[15:59:45] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 198.05 ms
[16:08:03] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 100%
[16:14:09] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 208.98 ms
[16:20:18] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 218.51 ms
[16:26:25] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 213.01 ms
[16:37:43] <icinga-miraheze>	 PROBLEM - mw181 Current Load on mw181 is WARNING: LOAD WARNING - total load average: 22.09, 13.77, 7.51
[16:37:46] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 211.60 ms
[16:37:53] <icinga-miraheze>	 PROBLEM - mw171 Current Load on mw171 is WARNING: LOAD WARNING - total load average: 21.65, 14.78, 7.84
[16:37:57] <icinga-miraheze>	 PROBLEM - cp27 Varnish Backends on cp27 is CRITICAL: 1 backends are down. mw171
[16:39:43] <icinga-miraheze>	 RECOVERY - mw181 Current Load on mw181 is OK: LOAD OK - total load average: 5.75, 10.37, 7.03
[16:39:52] <icinga-miraheze>	 RECOVERY - mw171 Current Load on mw171 is OK: LOAD OK - total load average: 7.00, 11.58, 7.52
[16:39:56] <icinga-miraheze>	 RECOVERY - cp27 Varnish Backends on cp27 is OK: All 18 backends are healthy
[16:43:53] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 207.19 ms
[17:02:20] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 207.52 ms
[17:06:23] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 202.68 ms
[17:12:35] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 210.73 ms
[17:14:36] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 209.46 ms
[17:18:36] <botifico>	 [02miraheze/puppet] 07Universal-Omega created branch 03logging 13https://github.com/miraheze/puppet/commit/3486c7615138e46d8597073a81577f7403a54fdf
[17:18:37] <botifico>	 [02puppet] 07Universal-Omega created branch 03logging - 13https://github.com/miraheze/puppet
[17:18:44] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 198.22 ms
[17:20:45] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 205.52 ms
[17:22:47] <botifico>	 [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03logging [+1/-1/±3] 13https://github.com/miraheze/puppet/compare/3486c7615138...95393c6b3102
[17:22:50] <botifico>	 [02miraheze/puppet] 07Universal-Omega 0395393c6 - graylog: use logging.wikitide.net
[17:23:07] <botifico>	 [02puppet] 07Universal-Omega opened pull request 03#3763: graylog: use logging.wikitide.net - 13https://github.com/miraheze/puppet/pull/3763
[17:24:53] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 196.83 ms
[17:26:41] <botifico>	 [02puppet] 07Universal-Omega created branch 03monitoring - 13https://github.com/miraheze/puppet
[17:26:44] <botifico>	 [02miraheze/puppet] 07Universal-Omega created branch 03monitoring 13https://github.com/miraheze/puppet/commit/3486c7615138e46d8597073a81577f7403a54fdf
[17:30:44] <botifico>	 [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03monitoring [+0/-0/±3] 13https://github.com/miraheze/puppet/compare/3486c7615138...2537f7607c7c
[17:30:46] <botifico>	 [02miraheze/puppet] 07Universal-Omega 032537f76 - icinga: use monitoring.wikitide.net
[17:30:57] <botifico>	 [02puppet] 07Universal-Omega opened pull request 03#3764: icinga: use monitoring.wikitide.net - 13https://github.com/miraheze/puppet/pull/3764
[17:31:56] <botifico>	 [02miraheze/puppet] 07Universal-Omega created branch 03grafana 13https://github.com/miraheze/puppet/commit/3486c7615138e46d8597073a81577f7403a54fdf
[17:31:58] <botifico>	 [02puppet] 07Universal-Omega created branch 03grafana - 13https://github.com/miraheze/puppet
[17:34:45] <icinga-miraheze>	 PROBLEM - cp37 Disk Space on cp37 is WARNING: DISK WARNING - free space: / 9699MiB (10% inode=98%);
[17:35:07] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 199.36 ms
[17:35:35] <botifico>	 [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03grafana [+0/-0/±4] 13https://github.com/miraheze/puppet/compare/3486c7615138...2df6cfab7cfc
[17:35:38] <botifico>	 [02miraheze/puppet] 07Universal-Omega 032df6cfa - grafana: use grafana.wikitide.net
[17:35:48] <botifico>	 [02puppet] 07Universal-Omega opened pull request 03#3765: grafana: use grafana.wikitide.net - 13https://github.com/miraheze/puppet/pull/3765
[17:36:49] <botifico>	 [02puppet] 07Universal-Omega edited pull request 03#3765: grafana: use grafana.wikitide.net - 13https://github.com/miraheze/puppet/pull/3765
[17:37:01] <botifico>	 [02puppet] 07Universal-Omega edited pull request 03#3764: icinga: use monitoring.wikitide.net - 13https://github.com/miraheze/puppet/pull/3764
[17:37:14] <botifico>	 [02puppet] 07Universal-Omega edited pull request 03#3763: graylog: use logging.wikitide.net - 13https://github.com/miraheze/puppet/pull/3763
[17:39:13] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 197.85 ms
[17:43:17] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 200.70 ms
[18:17:03] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 37%, RTA = 166.37 ms
[18:19:04] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 154.93 ms
[18:48:51] <icinga-miraheze>	 PROBLEM - cp36 Disk Space on cp36 is CRITICAL: DISK CRITICAL - free space: / 5274MiB (5% inode=98%);
[19:16:10] <botifico>	 [02mediawiki-repos] 07R4356th opened pull request 03#13: Fix path for Snap! Blocks - 13https://github.com/miraheze/mediawiki-repos/pull/13
[19:16:52] <botifico>	 [02mediawiki-repos] 07R4356th commented on pull request 03#13: Fix path for Snap! Blocks - 13https://github.com/miraheze/mediawiki-repos/pull/13#issuecomment-1963034218
[19:21:19] <icinga-miraheze>	 PROBLEM - ping6 on cp28 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 143.52 ms
[19:23:17] <icinga-miraheze>	 RECOVERY - ping6 on cp28 is OK: PING OK - Packet loss = 0%, RTA = 153.05 ms
[19:26:08] <botifico>	 [02puppet] 07paladox closed pull request 03#3065: Add support for role based hiera - 13https://github.com/miraheze/puppet/pull/3065
[19:26:17] <botifico>	 [02puppet] 07paladox closed pull request 03#3187: logbot: allow setting logging level - 13https://github.com/miraheze/puppet/pull/3187
[19:26:24] <botifico>	 [02puppet] 07paladox closed pull request 03#3292: imagemagick: remove use of domain=path, rights=none - 13https://github.com/miraheze/puppet/pull/3292
[19:26:35] <botifico>	 [02puppet] 07paladox closed pull request 03#3341: DO NOT MERGE - 13https://github.com/miraheze/puppet/pull/3341
[19:26:42] <botifico>	 [02puppet] 07paladox closed pull request 03#3732: Allow varnish to use mediawiki port 80 - 13https://github.com/miraheze/puppet/pull/3732
[19:26:49] <botifico>	 [02puppet] 07paladox closed pull request 03#3730: Add strongswan (ipsec) module - 13https://github.com/miraheze/puppet/pull/3730
[19:26:57] <botifico>	 [02puppet] 07paladox closed pull request 03#3559: mw* modify keepalive - 13https://github.com/miraheze/puppet/pull/3559
[19:27:03] <botifico>	 [02puppet] 07paladox closed pull request 03#3437: varnish: cache more of matomo - 13https://github.com/miraheze/puppet/pull/3437
[19:27:13] <botifico>	 [02puppet] 07paladox closed pull request 03#3383: miraheze-backup: Add --passwd_file argument - 13https://github.com/miraheze/puppet/pull/3383
[19:27:20] <botifico>	 [02puppet] 07paladox closed pull request 03#3357: miraheze-backup: backup mediawiki-xml dumps to archive - 13https://github.com/miraheze/puppet/pull/3357
[19:27:27] <botifico>	 [02puppet] 07paladox closed pull request 03#3351: salt: Use roster_defaults to set some params - 13https://github.com/miraheze/puppet/pull/3351
[19:27:32] <botifico>	 [02puppet] 07paladox closed pull request 03#3310: salt: Set ssh_max_procs to how many cpu cores that the host has - 13https://github.com/miraheze/puppet/pull/3310
[19:27:39] <botifico>	 [02puppet] 07paladox closed pull request 03#3295: imagemagick: Add support for being able to set memory/disk/thread limits - 13https://github.com/miraheze/puppet/pull/3295
[19:28:34] <botifico>	 [02mw-config] 07paladox closed pull request 03#5453: Create RunJobs.php - 13https://github.com/miraheze/mw-config/pull/5453
[19:28:40] <botifico>	 [02mw-config] 07paladox closed pull request 03#5324: Uninstall HitCounters - 13https://github.com/miraheze/mw-config/pull/5324
[19:28:46] <botifico>	 [02mw-config] 07paladox closed pull request 03#5300: Store subdomain in url field in cache - 13https://github.com/miraheze/mw-config/pull/5300
[19:29:10] <botifico>	 [02MirahezeMagic] 07paladox closed pull request 03#435: Experiment - 13https://github.com/miraheze/MirahezeMagic/pull/435
[19:29:20] <botifico>	 [02MirahezeMagic] 07paladox closed pull request 03#411: Fix read/write acl on renamed containers - 13https://github.com/miraheze/MirahezeMagic/pull/411
[19:31:00] <botifico>	 [02ManageWiki] 07paladox closed pull request 03#418: Move some of NamespaceMigrationJob logic to a common class - 13https://github.com/miraheze/ManageWiki/pull/418
[19:31:07] <botifico>	 [02ManageWiki] 07paladox closed pull request 03#437: ManageWikiTypes: Fix "Unsupported operand types: string * int" for type integer - 13https://github.com/miraheze/ManageWiki/pull/437
[19:31:49] <botifico>	 [02RemovePII] 07paladox closed pull request 03#71: Fork fixStuckGlobalRename from CentralAuth - 13https://github.com/miraheze/RemovePII/pull/71
[19:39:35] <icinga-miraheze>	 PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.andreijiroh.uk.eu.org All nameservers failed to answer the query.
[20:06:02] <icinga-miraheze>	 PROBLEM - ping6 on cp28 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 155.22 ms
[20:08:01] <icinga-miraheze>	 RECOVERY - ping6 on cp28 is OK: PING OK - Packet loss = 0%, RTA = 162.74 ms
[20:08:10] <icinga-miraheze>	 RECOVERY - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.andreijiroh.uk.eu.org reverse DNS resolves to cp36.wikitide.net - CNAME OK
[20:15:49] <icinga-miraheze>	 PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query.
[20:16:01] <icinga-miraheze>	 PROBLEM - ping6 on cp28 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 159.78 ms
[20:16:50] <botifico>	 [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03namespace-cleanup [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/c4332a964baa...e53a60badc4e
[20:16:52] <botifico>	 [02miraheze/MirahezeMagic] 07Universal-Omega 03e53a60b - Inject CreateWikiHookRunner into CreateWikiJson
[20:16:53] <botifico>	 [02MirahezeMagic] 07Universal-Omega synchronize pull request 03#472: Add phan, cleanup, and namespace - 13https://github.com/miraheze/MirahezeMagic/pull/472
[20:17:59] <icinga-miraheze>	 RECOVERY - ping6 on cp28 is OK: PING OK - Packet loss = 0%, RTA = 161.25 ms
[20:18:00] <botifico>	 [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03namespace-cleanup [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/e53a60badc4e...d7c5738966de
[20:18:03] <botifico>	 [02miraheze/MirahezeMagic] 07Universal-Omega 03d7c5738 - Inject CreateWikiHookRunner into CreateWikiJson
[20:18:04] <botifico>	 [02MirahezeMagic] 07Universal-Omega synchronize pull request 03#472: Add phan, cleanup, and namespace - 13https://github.com/miraheze/MirahezeMagic/pull/472
[20:23:41] <miraheze-github>	 miraheze/MirahezeMagic - Universal-Omega the build passed.
[20:28:44] <botifico>	 [02miraheze/DataDump] 07Universal-Omega pushed 031 commit to 03replace-restrict [+0/-0/±1] 13https://github.com/miraheze/DataDump/commit/cdcd2e10ecd7
[20:28:45] <botifico>	 [02miraheze/DataDump] 07Universal-Omega 03cdcd2e1 - Replace deprecated Command::restrict
[20:28:46] <botifico>	 [02DataDump] 07Universal-Omega created branch 03replace-restrict - 13https://github.com/miraheze/DataDump
[20:28:50] <botifico>	 [02DataDump] 07Universal-Omega opened pull request 03#80: Replace deprecated Command::restrict - 13https://github.com/miraheze/DataDump/pull/80
[20:32:57] <miraheze-github>	 miraheze/DataDump - Universal-Omega the build passed.
[20:32:57] <botifico>	 [02CreateWiki] 07Universal-Omega synchronize pull request 03#472: Fix for 1.41 CI - 13https://github.com/miraheze/CreateWiki/pull/472
[20:33:00] <botifico>	 [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03fix-1.41-ci [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/1882172bc0e6...3132e47e0208
[20:33:03] <botifico>	 [02miraheze/CreateWiki] 07Universal-Omega 033132e47 - Test
[20:34:00] <botifico>	 [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03fix-1.41-ci [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/3132e47e0208...35a6016535e7
[20:34:01] <botifico>	 [02miraheze/CreateWiki] 07Universal-Omega 0335a6016 - Test
[20:34:04] <botifico>	 [02CreateWiki] 07Universal-Omega synchronize pull request 03#472: Fix for 1.41 CI - 13https://github.com/miraheze/CreateWiki/pull/472
[20:37:52] <botifico>	 [02miraheze/CreateWiki] 07Universal-Omega pushed 034 commits to 03fix-1.41-ci [+0/-0/±10] 13https://github.com/miraheze/CreateWiki/compare/35a6016535e7...cac2a33caecf
[20:37:55] <botifico>	 [02miraheze/CreateWiki] 07Universal-Omega 03cac2a33 - Merge branch 'master' into fix-1.41-ci
[20:37:58] <botifico>	 [02CreateWiki] 07Universal-Omega synchronize pull request 03#472: Fix for 1.41 CI - 13https://github.com/miraheze/CreateWiki/pull/472
[20:44:19] <miraheze-github>	 miraheze/CreateWiki - Universal-Omega the build passed.
[20:56:51] <botifico>	 [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 031.41-ci-fix [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/commit/46f9ead545f0
[20:56:52] <botifico>	 [02miraheze/CreateWiki] 07Universal-Omega 0346f9ead - Fix CI for 1.41
[20:56:53] <botifico>	 [02CreateWiki] 07Universal-Omega created branch 031.41-ci-fix - 13https://github.com/miraheze/CreateWiki
[20:56:56] <botifico>	 [02CreateWiki] 07Universal-Omega opened pull request 03#475: Fix CI for 1.41 - 13https://github.com/miraheze/CreateWiki/pull/475
[20:59:35] <botifico>	 [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 031.41-ci-fix [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/46f9ead545f0...9eae6bb8b985
[20:59:37] <botifico>	 [02miraheze/CreateWiki] 07Universal-Omega 039eae6bb - Try
[20:59:39] <botifico>	 [02CreateWiki] 07Universal-Omega synchronize pull request 03#475: Fix CI for 1.41 - 13https://github.com/miraheze/CreateWiki/pull/475
[21:04:00] <miraheze-github>	 miraheze/CreateWiki - Universal-Omega the build passed.
[21:04:45] <icinga-miraheze>	 PROBLEM - cp37 Disk Space on cp37 is CRITICAL: DISK CRITICAL - free space: / 5288MiB (5% inode=98%);
[21:23:46] <icinga-miraheze>	 PROBLEM - ping6 on cp28 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 153.05 ms
[21:25:44] <icinga-miraheze>	 RECOVERY - ping6 on cp28 is OK: PING OK - Packet loss = 0%, RTA = 149.83 ms
[21:53:56] <botifico>	 [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 031.41-ci-fix [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/9eae6bb8b985...3e7e87a12f30
[21:53:57] <botifico>	 [02miraheze/CreateWiki] 07Universal-Omega 033e7e87a - Try
[21:53:59] <botifico>	 [02CreateWiki] 07Universal-Omega synchronize pull request 03#475: Fix CI for 1.41 - 13https://github.com/miraheze/CreateWiki/pull/475
[22:00:10] <miraheze-github>	 miraheze/CreateWiki - Universal-Omega the build passed.
[22:01:55] <botifico>	 [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 031.41-ci-fix [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/3e7e87a12f30...01f5d0d4505c
[22:01:56] <botifico>	 [02miraheze/CreateWiki] 07Universal-Omega 0301f5d0d - Try
[22:01:58] <botifico>	 [02CreateWiki] 07Universal-Omega synchronize pull request 03#475: Fix CI for 1.41 - 13https://github.com/miraheze/CreateWiki/pull/475
[22:07:51] <botifico>	 [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 031.41-ci-fix [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/01f5d0d4505c...89c1a4b6cd4a
[22:07:53] <botifico>	 [02miraheze/CreateWiki] 07Universal-Omega 0389c1a4b - Try
[22:07:56] <botifico>	 [02CreateWiki] 07Universal-Omega synchronize pull request 03#475: Fix CI for 1.41 - 13https://github.com/miraheze/CreateWiki/pull/475
[22:08:07] <miraheze-github>	 miraheze/CreateWiki - Universal-Omega the build passed.
[22:14:48] <miraheze-github>	 miraheze/CreateWiki - Universal-Omega the build passed.
[22:15:25] <botifico>	 [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 031.41-ci-fix [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/89c1a4b6cd4a...5b4a50f2d835
[22:15:26] <botifico>	 [02miraheze/CreateWiki] 07Universal-Omega 035b4a50f - Try
[22:15:27] <botifico>	 [02CreateWiki] 07Universal-Omega synchronize pull request 03#475: Fix CI for 1.41 - 13https://github.com/miraheze/CreateWiki/pull/475
[22:15:50] <icinga-miraheze>	 PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is WARNING: SSL WARNING - rDNS OK but records conflict. {'NS': ['NS.ANKH.FR.eu.org.', 'NS1.eu.org.', 'NS1.ERIOMEM.NET.'], 'CNAME': 'bouncingwiki.miraheze.org.'}
[22:21:40] <miraheze-github>	 miraheze/CreateWiki - Universal-Omega the build passed.
[22:22:29] <botifico>	 [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 031.41-ci-fix [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/5b4a50f2d835...631d09094931
[22:22:32] <botifico>	 [02miraheze/CreateWiki] 07Universal-Omega 03631d090 - Try
[22:22:35] <botifico>	 [02CreateWiki] 07Universal-Omega synchronize pull request 03#475: Fix CI for 1.41 - 13https://github.com/miraheze/CreateWiki/pull/475
[22:29:22] <miraheze-github>	 miraheze/CreateWiki - Universal-Omega the build passed.
[22:36:53] <botifico>	 [02miraheze/ci-scripts] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ci-scripts/compare/2748dcbe8dc1...21eeb7b788a9
[22:36:54] <botifico>	 [02miraheze/ci-scripts] 07Universal-Omega 0321eeb7b - Try a fix
[22:41:23] <miraheze-github>	 miraheze/CreateWiki - Universal-Omega the build passed.
[22:42:26] <botifico>	 [02miraheze/ci-scripts] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ci-scripts/compare/21eeb7b788a9...1b08cde5b164
[22:42:28] <botifico>	 [02miraheze/ci-scripts] 07Universal-Omega 031b08cde - Try again
[22:43:05] <botifico>	 [02miraheze/ci-scripts] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ci-scripts/compare/1b08cde5b164...5bccb0df13cd
[22:43:08] <botifico>	 [02miraheze/ci-scripts] 07Universal-Omega 035bccb0d - Use MW_INSTALL_PATH
[22:49:59] <miraheze-github>	 miraheze/CreateWiki - Universal-Omega the build passed.
[22:51:55] <botifico>	 [02miraheze/ci-scripts] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ci-scripts/compare/5bccb0df13cd...c28b06080511
[22:51:56] <botifico>	 [02miraheze/ci-scripts] 07Universal-Omega 03c28b060 - Cleanup
[22:55:04] <botifico>	 [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03fix-timestamps [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/commit/75cf5ad041d6
[22:55:05] <botifico>	 [02miraheze/CreateWiki] 07Universal-Omega 0375cf5ad - CreateWikiJson: fix resetting timestamps
[22:55:06] <botifico>	 [02CreateWiki] 07Universal-Omega created branch 03fix-timestamps - 13https://github.com/miraheze/CreateWiki
[22:55:09] <botifico>	 [02CreateWiki] 07Universal-Omega opened pull request 03#476: CreateWikiJson: fix resetting timestamps - 13https://github.com/miraheze/CreateWiki/pull/476
[22:59:04] <miraheze-github>	 miraheze/CreateWiki - Universal-Omega the build passed.
[23:02:49] <miraheze-github>	 miraheze/CreateWiki - Universal-Omega the build passed.
[23:20:43] <botifico>	 [02CreateWiki] 07Universal-Omega closed pull request 03#476: CreateWikiJson: fix resetting timestamps - 13https://github.com/miraheze/CreateWiki/pull/476
[23:20:44] <botifico>	 [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/03c06d4d481d...e9f6fe8341e8
[23:20:45] <botifico>	 [02miraheze/CreateWiki] 07Universal-Omega 03e9f6fe8 - CreateWikiJson: fix resetting timestamps (#476)
[23:20:48] <botifico>	 [02miraheze/CreateWiki] 07Universal-Omega deleted branch 03fix-timestamps
[23:20:50] <botifico>	 [02CreateWiki] 07Universal-Omega deleted branch 03fix-timestamps - 13https://github.com/miraheze/CreateWiki
[23:21:22] <MirahezeLSBot>	 !log [universalomega@mwtask181] starting deploy of {'versions': '1.41', 'upgrade_extensions': 'CreateWiki'} to all
[23:21:25] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:21:31] <MirahezeLSBot>	 !log [universalomega@mwtask181] finished deploy of {'versions': '1.41', 'upgrade_extensions': 'CreateWiki'} to all - SUCCESS in 9s
[23:21:34] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:29:26] <miraheze-github>	 miraheze/CreateWiki - Universal-Omega the build passed.
[23:44:30] <botifico>	 [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03fix-zero [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/commit/c8d0b9e8714f
[23:44:33] <botifico>	 [02miraheze/CreateWiki] 07Universal-Omega 03c8d0b9e - Fix condition resulting in timestamps of zero
[23:44:34] <botifico>	 [02CreateWiki] 07Universal-Omega created branch 03fix-zero - 13https://github.com/miraheze/CreateWiki
[23:44:36] <botifico>	 [02CreateWiki] 07Universal-Omega opened pull request 03#477: Fix condition resulting in timestamps of zero - 13https://github.com/miraheze/CreateWiki/pull/477
[23:45:22] <botifico>	 [02CreateWiki] 07Universal-Omega closed pull request 03#477: Fix condition resulting in timestamps of zero - 13https://github.com/miraheze/CreateWiki/pull/477
[23:45:24] <botifico>	 [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/e9f6fe8341e8...1949ccda32e6
[23:45:26] <botifico>	 [02miraheze/CreateWiki] 07Universal-Omega 031949ccd - Fix condition resulting in timestamps of zero (#477)
[23:45:29] <botifico>	 [02miraheze/CreateWiki] 07Universal-Omega deleted branch 03fix-zero
[23:45:32] <botifico>	 [02CreateWiki] 07Universal-Omega deleted branch 03fix-zero - 13https://github.com/miraheze/CreateWiki
[23:45:35] <MirahezeLSBot>	 !log [universalomega@mwtask181] starting deploy of {'versions': '1.41', 'upgrade_extensions': 'CreateWiki'} to all
[23:45:37] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:45:44] <MirahezeLSBot>	 !log [universalomega@mwtask181] finished deploy of {'versions': '1.41', 'upgrade_extensions': 'CreateWiki'} to all - SUCCESS in 9s
[23:45:46] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:52:19] <miraheze-github>	 miraheze/CreateWiki - Universal-Omega the build passed.
[23:53:45] <miraheze-github>	 miraheze/CreateWiki - Universal-Omega the build passed.