[00:01:36] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.72, 3.82, 3.77 [00:01:36] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.25, 3.77, 3.54 [00:02:14] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.82, 10.05, 9.88 [00:04:56] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.21, 3.91, 3.65 [00:05:29] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.22, 4.52, 3.84 [00:08:34] miraheze/ImportDump - Universal-Omega the build has errored. [00:08:53] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.11, 4.20, 3.76 [00:09:22] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.53, 3.85, 3.70 [00:11:35] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.97, 5.15, 4.19 [00:12:28] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.62, 9.99, 9.97 [00:14:50] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.78, 3.99, 3.81 [00:18:47] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.42, 3.72, 3.79 [00:19:04] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.74, 3.93, 3.86 [00:19:18] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 86, in check_records cname = str(dns_resolver.resolve(hostname, 'CNAME')[0]) File "/usr/li [00:19:18] 3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query dnd.bellinrattin.it. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [00:20:29] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.24, 9.75, 9.10 [00:21:01] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.01, 4.17, 3.95 [00:24:44] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.01, 3.78, 3.81 [00:25:09] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.04, 9.88, 9.41 [00:26:57] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.54, 3.95, 3.96 [00:26:59] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.77, 9.80, 9.27 [00:30:29] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 8.26, 9.64, 9.43 [00:30:57] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.01, 3.66, 3.81 [00:32:57] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.05, 3.54, 3.75 [00:33:03] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.81, 9.55, 9.61 [00:33:28] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 9.91, 10.02, 9.65 [00:36:57] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.68, 3.58, 3.69 [00:39:27] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/c824ab18417b...34ff387e8c43 [00:39:28] [02miraheze/ImportDump] 07Universal-Omega 0334ff387 - Update extension.json [00:39:30] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [00:40:09] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/34ff387e8c43...13ce845c7a59 [00:40:10] [02miraheze/ImportDump] 07Universal-Omega 0313ce845 - Update .gitignore [00:40:12] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [00:42:56] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/fa459bfbe1c0...8ef5f89ddc40 [00:42:57] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.57, 2.89, 3.34 [00:42:57] [02miraheze/ImportDump] 07Universal-Omega 038ef5f89 - Update package-lock.json [00:42:59] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [00:45:08] miraheze/ImportDump - Universal-Omega the build has errored. [00:48:58] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - dnd.bellinrattin.it All nameservers failed to answer the query. [00:49:18] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.65, 9.75, 9.75 [00:52:57] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.83, 3.54, 3.41 [00:53:16] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 9.94, 9.87, 9.71 [00:54:05] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/42d8d4ee3ca3...80d336a8c868 [00:54:06] [02miraheze/ImportDump] 07Universal-Omega 0380d336a - Update ImportDumpRequestViewer.php [00:54:08] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [00:56:26] miraheze/ImportDump - Universal-Omega the build has errored. [00:57:13] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.37, 10.19, 9.89 [00:59:11] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 8.86, 9.82, 9.80 [00:59:37] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.36, 10.61, 9.64 [01:00:57] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.90, 3.03, 3.31 [01:01:35] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.31, 10.21, 9.62 [01:03:34] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.04, 9.40, 9.37 [01:04:33] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.43, 9.86, 9.28 [01:06:05] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.10, 10.49, 9.88 [01:06:33] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 10.20, 9.86, 9.34 [01:06:34] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/80d336a8c868...613248d9aacf [01:06:35] [02miraheze/ImportDump] 07Universal-Omega 03613248d - Update ImportDumpOOUIForm.php [01:06:37] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [01:08:04] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.78, 10.50, 9.97 [01:09:21] miraheze/ImportDump - Universal-Omega the build has errored. [01:10:02] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 9.51, 10.02, 9.84 [01:10:23] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.96, 10.20, 9.68 [01:14:15] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 9.65, 9.93, 9.68 [01:14:18] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+1/-0/±0] 13https://github.com/miraheze/ImportDump/compare/613248d9aacf...fe192ab34fa8 [01:14:20] [02miraheze/ImportDump] 07Universal-Omega 03fe192ab - Create ServiceWiring.php [01:14:21] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [01:17:04] miraheze/ImportDump - Universal-Omega the build has errored. [01:17:07] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/fe192ab34fa8...f3b34c4b1c7a [01:17:09] [02miraheze/ImportDump] 07Universal-Omega 03f3b34c4 - Update ImportDumpRequestViewer.php [01:17:10] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [01:18:38] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 73, in check_records nameserversans = dns_resolver.resolve(root_domain, 'NS') File "/usr/l [01:18:38] n3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query bellinrattin.it. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [01:18:55] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.45, 10.54, 10.15 [01:19:11] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/f3b34c4b1c7a...437c3bf8e086 [01:19:13] [02miraheze/ImportDump] 07Universal-Omega 03437c3bf - Update SpecialImportDumpRequestQueue.php [01:19:14] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [01:19:37] miraheze/ImportDump - Universal-Omega the build has errored. [01:20:24] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/437c3bf8e086...60356ba696e2 [01:20:25] [02miraheze/ImportDump] 07Universal-Omega 0360356ba - Update extension.json [01:20:27] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [01:20:54] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.77, 9.72, 9.88 [01:21:26] miraheze/ImportDump - Universal-Omega the build has errored. [01:21:54] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.19, 10.85, 10.18 [01:22:39] miraheze/ImportDump - Universal-Omega the build has errored. [01:24:47] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/60356ba696e2...8da926051118 [01:24:49] [02miraheze/ImportDump] 07Universal-Omega 038da9260 - Update ImportDumpRequestViewer.php [01:24:50] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [01:25:35] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.35, 3.34, 3.93 [01:27:44] miraheze/ImportDump - Universal-Omega the build has errored. [01:29:08] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.53, 1.86, 1.38 [01:29:35] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.75, 3.58, 3.88 [01:29:49] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 8.99, 9.86, 9.97 [01:31:03] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.34, 1.62, 1.35 [01:31:35] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.15, 3.51, 3.82 [01:37:03] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.65, 10.15, 9.49 [01:40:20] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/8da926051118...6340105c7c26 [01:40:22] [02miraheze/ImportDump] 07Universal-Omega 036340105 - Update extension.json [01:40:23] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [01:41:36] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.12, 2.79, 3.36 [01:42:58] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.83, 9.91, 9.63 [01:45:48] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+1/-0/±0] 13https://github.com/miraheze/ImportDump/compare/6340105c7c26...aa0850f92974 [01:45:49] [02miraheze/ImportDump] 07Universal-Omega 03aa0850f - Create ImportDumpRequestManager.php [01:45:51] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [01:46:57] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.75, 3.70, 3.09 [01:47:36] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.92, 5.51, 4.30 [01:47:53] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.82, 3.63, 2.98 [01:47:55] miraheze/ImportDump - Universal-Omega the build has errored. [01:48:13] miraheze/ImportDump - Universal-Omega the build has errored. [01:48:18] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp21.miraheze.org - CNAME OK [01:48:23] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/aa0850f92974...2adae27e82b9 [01:48:24] [02miraheze/ImportDump] 07Universal-Omega 032adae27 - Update SpecialImportDumpRequestQueue.php [01:48:26] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [01:49:41] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/2adae27e82b9...ac657f99b6c6 [01:49:42] [02miraheze/ImportDump] 07Universal-Omega 03ac657f9 - Update ImportDumpRequestViewer.php [01:49:44] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [01:49:52] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.26, 4.09, 3.21 [01:50:25] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/ac657f99b6c6...57b21c8c2616 [01:50:27] [02miraheze/ImportDump] 07Universal-Omega 0357b21c8 - Update ImportDumpRequestManager.php [01:50:28] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [01:50:49] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.86, 1.63, 1.33 [01:50:50] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.88, 10.47, 9.84 [01:50:51] miraheze/ImportDump - Universal-Omega the build has errored. [01:51:51] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.94, 3.92, 3.25 [01:52:15] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.58, 10.23, 9.83 [01:52:48] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 10.02, 10.11, 9.77 [01:53:03] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/57b21c8c2616...5df1dbd106c1 [01:53:03] miraheze/ImportDump - Universal-Omega the build has errored. [01:53:04] [02miraheze/ImportDump] 07Universal-Omega 035df1dbd - Update SpecialImportDumpRequestQueue.php [01:53:06] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [01:54:49] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.29, 1.53, 1.37 [01:54:57] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.76, 3.74, 3.48 [01:55:06] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/5df1dbd106c1...642f248e33fb [01:55:08] [02miraheze/ImportDump] 07Universal-Omega 03642f248 - Update ImportDumpRequestManager.php [01:55:09] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [01:55:22] miraheze/ImportDump - Universal-Omega the build has errored. [01:55:49] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.39, 4.04, 3.45 [01:56:57] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.43, 4.56, 3.79 [01:58:03] miraheze/ImportDump - Universal-Omega the build has errored. [01:58:42] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.59, 11.43, 10.37 [01:58:56] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/642f248e33fb...20f093a3db06 [01:58:57] [02miraheze/ImportDump] 07Universal-Omega 0320f093a - Update ServiceWiring.php [01:58:59] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [02:00:40] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.08, 10.26, 10.06 [02:00:57] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.64, 3.91, 3.75 [02:01:45] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.58, 3.84, 3.66 [02:02:09] miraheze/ImportDump - Universal-Omega the build has errored. [02:02:38] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.72, 9.83, 9.93 [02:03:16] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/20f093a3db06...b2fefd8cabe2 [02:03:17] [02miraheze/ImportDump] 07Universal-Omega 03b2fefd8 - Update ImportDumpOOUIForm.php [02:03:19] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [02:04:14] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.42, 9.63, 9.92 [02:06:35] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.64, 10.86, 10.36 [02:06:47] miraheze/ImportDump - Universal-Omega the build has errored. [02:06:57] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.51, 3.68, 3.59 [02:07:41] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.84, 3.96, 3.69 [02:08:17] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/b2fefd8cabe2...0dc4d255078a [02:08:18] [02miraheze/ImportDump] 07Universal-Omega 030dc4d25 - Update ImportDumpRequestViewer.php [02:08:20] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [02:08:35] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.45, 9.27, 9.84 [02:09:40] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.74, 3.85, 3.69 [02:11:51] miraheze/ImportDump - Universal-Omega the build has errored. [02:13:17] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.63, 10.75, 10.26 [02:16:57] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.87, 3.99, 3.91 [02:18:57] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.08, 4.02, 3.93 [02:19:13] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 9.43, 9.47, 9.85 [02:21:33] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.42, 3.87, 3.73 [02:22:57] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.81, 3.91, 3.92 [02:23:31] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.47, 3.38, 3.57 [02:27:30] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.59, 3.58, 3.58 [02:29:29] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.06, 3.28, 3.46 [02:32:05] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [02:32:07] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/0dc4d255078a...596b77712ef2 [02:32:08] [02miraheze/ImportDump] 07Universal-Omega 03596b777 - Update ImportDumpRequestViewer.php [02:33:26] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.37, 2.95, 3.30 [02:34:20] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/596b77712ef2...0449cae2509b [02:34:21] [02miraheze/ImportDump] 07Universal-Omega 030449cae - Update SpecialRequestImportDump.php [02:34:23] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [02:35:33] miraheze/ImportDump - Universal-Omega the build has errored. [02:35:35] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.64, 3.60, 4.00 [02:37:32] miraheze/ImportDump - Universal-Omega the build has errored. [02:38:57] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.56, 3.73, 3.62 [02:39:21] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.62, 3.85, 3.50 [02:39:35] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.41, 4.13, 4.08 [02:40:57] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.59, 3.84, 3.69 [02:41:20] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.43, 3.31, 3.35 [02:46:57] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.61, 3.07, 3.35 [02:47:35] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.02, 3.71, 3.94 [02:50:50] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.09, 10.04, 9.47 [02:50:54] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.24, 10.25, 9.18 [02:51:35] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.47, 3.68, 3.84 [02:52:49] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 10.01, 10.07, 9.56 [02:52:53] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 13.18, 11.04, 9.58 [02:52:55] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.41, 9.61, 9.01 [02:53:35] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 1.83, 2.92, 3.55 [02:54:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.59, 9.05, 8.89 [02:54:52] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.82, 10.69, 9.65 [02:56:14] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.78, 10.67, 9.58 [02:57:35] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.49, 2.71, 3.32 [02:58:14] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 9.92, 9.86, 9.39 [03:02:14] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.43, 10.57, 9.82 [03:03:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:04:14] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.70, 9.86, 9.64 [03:05:44] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.95, 10.39, 9.50 [03:06:44] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 9.94, 9.91, 9.86 [03:07:41] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.72, 9.96, 9.43 [03:09:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:23:14] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/0449cae2509b...a3cedd2429af [03:23:16] [02miraheze/ImportDump] 07Universal-Omega 03a3cedd2 - Update ImportDumpRequestManager.php [03:23:17] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [03:24:55] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/a3cedd2429af...1e5bd996fd1a [03:24:56] [02miraheze/ImportDump] 07Universal-Omega 031e5bd99 - Update ImportDumpRequestManager.php [03:24:58] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [03:28:09] miraheze/ImportDump - Universal-Omega the build has errored. [03:28:10] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.92, 3.10, 2.77 [03:28:24] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.51, 3.58, 3.11 [03:29:31] alerting : [FIRING:2] (mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:30:45] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.97, 3.41, 2.93 [03:32:03] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.01, 3.39, 2.97 [03:32:23] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.74, 3.52, 3.17 [03:32:44] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.84, 3.22, 2.92 [03:33:00] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/1e5bd996fd1a...b49bb9d331fb [03:33:02] [02miraheze/ImportDump] 07Universal-Omega 03b49bb9d - Update ImportDumpRequestViewer.php [03:33:03] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [03:34:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.62, 4.16, 3.44 [03:34:49] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/b49bb9d331fb...8be21fb2ae5b [03:34:50] [02miraheze/ImportDump] 07Universal-Omega 038be21fb - Update ImportDumpRequestManager.php [03:34:52] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [03:36:21] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.20, 3.33, 3.22 [03:39:18] miraheze/ImportDump - Universal-Omega the build passed. [03:41:16] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.14, 9.80, 9.05 [03:43:15] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 9.38, 9.56, 9.06 [03:44:31] alerting : [FIRING:1] (mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:44:53] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [03:44:55] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/8be21fb2ae5b...32d9c5d5f49c [03:44:56] [02miraheze/ImportDump] 07Universal-Omega 0332d9c5d - Update ImportDumpRequestManager.php [03:45:28] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/32d9c5d5f49c...75978b2d2c46 [03:45:30] [02miraheze/ImportDump] 07Universal-Omega 0375978b2 - Update ServiceWiring.php [03:45:31] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [03:49:31] ok : [RESOLVED] (!sre High Job Queue Backlog yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:49:53] miraheze/ImportDump - Universal-Omega the build passed. [03:55:16] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/75978b2d2c46...98c274010f20 [03:55:17] [02miraheze/ImportDump] 07Universal-Omega 0398c2740 - Update extension.json [03:55:19] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [03:57:23] miraheze/ImportDump - Universal-Omega the build has errored. [04:00:10] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+1/-0/±0] 13https://github.com/miraheze/ImportDump/compare/98c274010f20...8cad6a300ea6 [04:00:12] [02miraheze/ImportDump] 07Universal-Omega 038cad6a3 - Create Hooks.php [04:00:13] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [04:03:55] miraheze/ImportDump - Universal-Omega the build passed. [04:05:02] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [04:15:02] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [04:23:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [04:33:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [04:39:49] PROBLEM - phab121 Current Load on phab121 is WARNING: WARNING - load average: 1.89, 1.33, 1.02 [04:41:49] RECOVERY - phab121 Current Load on phab121 is OK: OK - load average: 1.09, 1.25, 1.03 [04:42:29] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.61, 9.43, 8.36 [04:45:52] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.81, 3.37, 2.99 [04:46:29] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.82, 9.03, 8.48 [04:47:52] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.58, 3.97, 3.26 [04:49:51] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.94, 3.70, 3.25 [04:51:50] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.40, 3.25, 3.14 [05:00:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:10:37] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.42, 2.96, 2.51 [05:10:57] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.84, 3.26, 2.81 [05:12:36] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.23, 3.14, 2.64 [05:12:57] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.03, 3.18, 2.84 [05:15:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:18:37] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.60, 3.53, 3.31 [05:20:37] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.19, 3.01, 3.15 [05:26:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:36:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:42:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:49:49] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 4.04, 2.18, 1.50 [05:52:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:54:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.03, 3.59, 3.24 [05:56:28] [02miraheze/dns] 07Reception123 pushed 031 commit to 03master [+1/-0/±0] 13https://github.com/miraheze/dns/compare/088ea211660f...637d89852ccf [05:56:29] [02miraheze/dns] 07Reception123 03637d898 - add squareenixwiki.com zone [05:56:51] [02miraheze/dns] 07Reception123 pushed 031 commit to 03master [+1/-0/±0] 13https://github.com/miraheze/dns/compare/637d89852ccf...792882f65580 [05:56:53] [02miraheze/dns] 07Reception123 03792882f - add mystiverse.wiki zone [05:58:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.20, 3.63, 3.33 [05:59:02] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:59:48] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.79, 3.86, 3.33 [06:00:20] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.58, 3.31, 3.25 [06:01:13] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.11, 3.42, 2.97 [06:01:45] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.49, 3.01, 3.08 [06:01:49] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.42, 1.98, 1.91 [06:03:05] [02miraheze/ssl] 07Reception123 pushed 033 commits to 03master [+3/-0/±3] 13https://github.com/miraheze/ssl/compare/695336c72156...9fca91ceefa7 [06:03:06] [02miraheze/ssl] 07Reception123 03f57638d - add squareenixwiki.com cert [06:03:08] [02miraheze/ssl] 07Reception123 03e3b408d - add mystiverse.wiki cert [06:03:09] [02miraheze/ssl] 07Reception123 039fca91c - add wiki.aoemods.com cert [06:03:12] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.51, 2.72, 2.77 [06:04:02] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [06:05:43] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.88, 10.06, 9.31 [06:07:49] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.25, 1.96, 1.89 [06:09:40] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 9.10, 9.82, 9.39 [06:11:50] PROBLEM - phab121 Current Load on phab121 is CRITICAL: CRITICAL - load average: 4.97, 4.08, 2.10 [06:13:04] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.28, 3.27, 2.88 [06:15:03] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.93, 2.79, 2.75 [06:17:49] PROBLEM - phab121 Current Load on phab121 is WARNING: WARNING - load average: 0.83, 1.90, 1.74 [06:19:50] RECOVERY - phab121 Current Load on phab121 is OK: OK - load average: 0.73, 1.50, 1.61 [06:27:28] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.46, 10.62, 9.81 [06:27:49] PROBLEM - phab121 Current Load on phab121 is WARNING: WARNING - load average: 1.68, 1.84, 1.71 [06:30:18] [02mw-config] 07Reception123 commented on pull request 03#4594: [#T9071](https://phabricator.miraheze.org/T9071) - 13https://github.com/miraheze/mw-config/pull/4594#issuecomment-1103520024 [06:31:07] RECOVERY - phab121 Current Load on phab121 is OK: OK - load average: 1.40, 1.55, 1.62 [06:31:34] [02mw-config] 07RhinosF1 commented on pull request 03#4594: [#T9071](https://phabricator.miraheze.org/T9071) - 13https://github.com/miraheze/mw-config/pull/4594#issuecomment-1103520838 [06:32:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [06:32:02] [02mw-config] 07RhinosF1 commented on pull request 03#4594: [#T9071](https://phabricator.miraheze.org/T9071) - 13https://github.com/miraheze/mw-config/pull/4594#issuecomment-1103521115 [06:32:39] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 10.09, 10.06, 9.82 [06:37:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [06:37:26] [02mw-config] 07Reception123 commented on pull request 03#4594: [#T9071](https://phabricator.miraheze.org/T9071) - 13https://github.com/miraheze/mw-config/pull/4594#issuecomment-1103524516 [06:44:12] [02mw-config] 07dmehus commented on pull request 03#4594: [#T9071](https://phabricator.miraheze.org/T9071) - 13https://github.com/miraheze/mw-config/pull/4594#issuecomment-1103528674 [06:44:55] [02mw-config] 07dmehus edited a comment on pull request 03#4594: [#T9071](https://phabricator.miraheze.org/T9071) - 13https://github.com/miraheze/mw-config/pull/4594#issuecomment-1103528674 [06:45:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [06:45:54] [02mw-config] 07RhinosF1 commented on pull request 03#4594: [#T9071](https://phabricator.miraheze.org/T9071) - 13https://github.com/miraheze/mw-config/pull/4594#issuecomment-1103529683 [06:46:27] [02mw-config] 07RhinosF1 commented on pull request 03#4594: [#T9071](https://phabricator.miraheze.org/T9071) - 13https://github.com/miraheze/mw-config/pull/4594#issuecomment-1103530040 [06:47:50] [02mw-config] 07JohnFLewis commented on pull request 03#4594: [#T9071](https://phabricator.miraheze.org/T9071) - 13https://github.com/miraheze/mw-config/pull/4594#issuecomment-1103530890 [06:53:55] PROBLEM - mwtask111 Current Load on mwtask111 is CRITICAL: CRITICAL - load average: 4.37, 3.40, 2.71 [06:55:55] RECOVERY - mwtask111 Current Load on mwtask111 is OK: OK - load average: 3.09, 3.24, 2.74 [07:05:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [07:09:56] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03Reception123-patch-1 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/dd1316c36f4d [07:09:57] [02miraheze/mw-config] 07Reception123 03dd1316c - PR for T9071 [07:09:59] [02mw-config] 07Reception123 created branch 03Reception123-patch-1 - 13https://github.com/miraheze/mw-config [07:10:00] [02mw-config] 07Reception123 opened pull request 03#4610: PR for T9071 - 13https://github.com/miraheze/mw-config/pull/4610 [07:10:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.76, 9.53, 9.23 [07:11:17] miraheze/mw-config - Reception123 the build passed. [07:11:35] [02mw-config] 07Reception123 synchronize pull request 03#4610: PR for T9071 - 13https://github.com/miraheze/mw-config/pull/4610 [07:11:36] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03Reception123-patch-1 [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/dd1316c36f4d...3f6cf70e5352 [07:11:37] [02miraheze/mw-config] 07Reception123 033f6cf70 - Update LocalSettings.php [07:12:20] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.78, 9.11, 9.13 [07:12:50] miraheze/mw-config - Reception123 the build passed. [07:13:18] [02mw-config] 07Reception123 closed pull request 03#4610: PR for T9071 - 13https://github.com/miraheze/mw-config/pull/4610 [07:13:20] [02mw-config] 07Reception123 deleted branch 03Reception123-patch-1 - 13https://github.com/miraheze/mw-config [07:13:21] [02miraheze/mw-config] 07Reception123 deleted branch 03Reception123-patch-1 [07:13:23] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/c2aaf15c237b...970632c588fa [07:13:24] [02miraheze/mw-config] 07Reception123 03970632c - PR for T9071 (#4610) [07:13:35] !log [reception@mwtask111] starting deploy of {'config': True} to all [07:13:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:13:44] !log [reception@mwtask111] finished deploy of {'config': True} to all - SUCCESS in 9s [07:13:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:14:28] miraheze/mw-config - Reception123 the build passed. [07:17:02] [02mw-config] 07Reception123 commented on pull request 03#4594: [#T9071](https://phabricator.miraheze.org/T9071) - 13https://github.com/miraheze/mw-config/pull/4594#issuecomment-1103552631 [07:17:03] [02mw-config] 07Reception123 closed pull request 03#4594: [#T9071](https://phabricator.miraheze.org/T9071) - 13https://github.com/miraheze/mw-config/pull/4594 [07:21:30] !log [@test101] starting deploy of {'config': True} to all [07:21:31] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 1s [07:21:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:21:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:23:22] !log [@mwtask111] starting deploy of {'config': True} to all [07:23:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:23:33] !log [@mwtask111] finished deploy of {'config': True} to all - SUCCESS in 11s [07:23:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:42:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [07:51:26] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 86, in check_records cname = str(dns_resolver.resolve(hostname, 'CNAME')[0]) File "/usr/li [07:51:26] 3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query dnd.bellinrattin.it. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [07:52:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [07:58:48] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.85, 2.95, 2.40 [08:00:47] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.03, 2.52, 2.30 [08:06:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [08:11:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [08:25:56] [02mw-config] 07ugochimobi opened pull request 03#4611: remove OpenGraphFallbackImage and ExpandOpenSearchXml - 13https://github.com/miraheze/mw-config/pull/4611 [08:26:57] miraheze/mw-config - ugochimobi the build passed. [08:32:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [08:32:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.97, 2.71, 2.37 [08:34:21] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.22, 2.21, 2.24 [08:36:53] PROBLEM - phab121 Current Load on phab121 is WARNING: WARNING - load average: 1.79, 1.67, 1.44 [08:38:49] RECOVERY - phab121 Current Load on phab121 is OK: OK - load average: 1.58, 1.60, 1.44 [08:42:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [08:49:12] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp20.miraheze.org - CNAME OK [08:53:02] [02mw-config] 07Universal-Omega closed pull request 03#4611: remove OpenGraphFallbackImage and ExpandOpenSearchXml - 13https://github.com/miraheze/mw-config/pull/4611 [08:53:04] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/970632c588fa...0f7093049859 [08:53:05] [02miraheze/mw-config] 07ugochimobi 030f70930 - remove OpenGraphFallbackImage and ExpandOpenSearchXml (#4611) [08:53:21] [02mw-config] 07Universal-Omega closed pull request 03#4608: Add EchoMaxMentionsInEditSummary to ManagaWiki - 13https://github.com/miraheze/mw-config/pull/4608 [08:53:22] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/mw-config/compare/0f7093049859...cf4c30f015ec [08:53:24] [02miraheze/mw-config] 07lens0021 03cf4c30f - Add EchoMaxMentionsInEditSummary to ManagaWiki (#4608) [08:54:18] miraheze/mw-config - Universal-Omega the build passed. [08:54:49] miraheze/mw-config - Universal-Omega the build passed. [08:56:13] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.52, 1.88, 1.32 [08:58:13] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.79, 1.56, 1.28 [09:03:02] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.08, 1.55, 2.00 [09:04:41] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 3.47, 3.01, 1.84 [09:08:41] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.01, 2.00, 1.70 [09:10:41] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.73, 1.59, 1.58 [09:11:02] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.11, 1.26, 1.67 [09:19:02] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.21, 1.67, 1.67 [09:19:42] !log [@test101] starting deploy of {'config': True} to all [09:19:43] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 0s [09:19:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:19:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:20:06] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.12, 3.33, 2.52 [09:21:02] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.77, 1.75, 1.70 [09:22:03] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.91, 3.62, 2.72 [09:22:14] !log [@mwtask111] starting deploy of {'config': True} to all [09:22:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:22:23] !log [@mwtask111] finished deploy of {'config': True} to all - SUCCESS in 9s [09:22:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:23:02] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.33, 1.62, 1.66 [09:24:00] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.90, 2.89, 2.56 [09:30:41] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 4.04, 2.94, 2.11 [09:33:04] [02mw-config] 07ugochimobi opened pull request 03#4612: Minimal metadata to enable OpenGraph cards - 13https://github.com/miraheze/mw-config/pull/4612 [09:33:12] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.70, 9.13, 7.86 [09:33:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [09:34:14] miraheze/mw-config - ugochimobi the build has errored. [09:35:12] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.44, 8.08, 7.63 [09:35:14] [02mw-config] 07ugochimobi synchronize pull request 03#4612: Minimal metadata to enable OpenGraph cards - 13https://github.com/miraheze/mw-config/pull/4612 [09:36:17] miraheze/mw-config - ugochimobi the build has errored. [09:38:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [09:39:28] [02mw-config] 07ugochimobi synchronize pull request 03#4612: Minimal metadata to enable OpenGraph cards - 13https://github.com/miraheze/mw-config/pull/4612 [09:40:41] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.72, 1.87, 1.93 [09:40:43] miraheze/mw-config - ugochimobi the build passed. [09:42:45] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.21, 1.92, 1.59 [09:44:40] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.74, 1.57, 1.50 [09:44:41] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 3.68, 2.18, 1.99 [09:48:41] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.32, 1.81, 1.89 [09:50:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [09:55:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [09:56:41] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 3.22, 2.20, 1.96 [10:02:44] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.10, 1.63, 1.79 [10:04:43] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.08, 1.41, 1.68 [10:09:57] PROBLEM - phab121 Current Load on phab121 is CRITICAL: CRITICAL - load average: 2.11, 1.73, 1.32 [10:11:57] RECOVERY - phab121 Current Load on phab121 is OK: OK - load average: 1.63, 1.66, 1.34 [10:14:02] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [10:19:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [10:24:20] [02mw-config] 07ugochimobi synchronize pull request 03#4612: Minimal metadata to enable OpenGraph cards - 13https://github.com/miraheze/mw-config/pull/4612 [10:25:22] miraheze/mw-config - ugochimobi the build has errored. [10:25:36] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.47, 1.75, 1.54 [10:26:13] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 2.23, 3.40, 2.20 [10:27:36] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.33, 1.60, 1.52 [10:32:13] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.27, 1.92, 1.91 [10:33:33] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.57, 1.71, 1.60 [10:35:32] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.36, 1.56, 1.55 [10:38:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [10:38:13] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.98, 1.22, 1.59 [10:41:29] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.36, 1.81, 1.63 [10:43:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [10:43:28] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.98, 1.47, 1.53 [10:47:26] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.78, 1.98, 1.70 [10:49:25] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.94, 1.55, 1.58 [10:50:51] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.04, 9.45, 8.42 [10:52:46] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 8.64, 9.11, 8.42 [10:55:22] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.56, 1.88, 1.66 [10:57:11] [02mw-config] 07ugochimobi synchronize pull request 03#4612: Minimal metadata to enable OpenGraph cards - 13https://github.com/miraheze/mw-config/pull/4612 [10:58:25] miraheze/mw-config - ugochimobi the build passed. [10:59:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [10:59:21] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.70, 1.84, 1.71 [11:03:04] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.33, 4.79, 3.29 [11:03:24] [02mw-config] 07ugochimobi synchronize pull request 03#4612: Minimal metadata to enable OpenGraph cards - 13https://github.com/miraheze/mw-config/pull/4612 [11:04:31] miraheze/mw-config - ugochimobi the build passed. [11:05:19] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.40, 1.97, 1.78 [11:06:58] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.62, 3.40, 3.09 [11:07:18] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.68, 1.96, 1.81 [11:09:17] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.95, 1.55, 1.68 [11:14:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [11:18:13] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.76, 1.70, 1.71 [11:19:31] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.01, 1.62, 1.40 [11:20:12] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.41, 1.67, 1.70 [11:21:27] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.10, 1.44, 1.36 [11:23:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [11:23:37] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.77, 10.17, 9.26 [11:25:32] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 9.10, 9.87, 9.27 [11:27:36] https://github.com/miraheze/mw-config/pull/4612 [11:27:37] [url] Minimal metadata to enable OpenGraph cards by ugochimobi · Pull Request #4612 · miraheze/mw-config · GitHub | github.com [11:27:48] CosmicAlpha ^^ if you have time [11:35:04] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.36, 1.72, 1.61 [11:37:02] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.03, 1.55, 1.56 [11:38:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [11:47:57] PROBLEM - phab121 Current Load on phab121 is CRITICAL: CRITICAL - load average: 3.09, 2.03, 1.43 [11:49:57] RECOVERY - phab121 Current Load on phab121 is OK: OK - load average: 1.34, 1.63, 1.35 [11:54:19] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.22, 10.20, 9.16 [11:55:49] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.71, 10.24, 8.94 [11:56:14] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 9.45, 9.74, 9.10 [11:57:49] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.31, 10.45, 9.17 [11:59:49] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.50, 9.98, 9.17 [12:00:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [12:09:04] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.52, 10.27, 9.63 [12:10:26] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.25, 10.66, 9.40 [12:10:59] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.10, 10.92, 9.94 [12:12:23] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.29, 9.76, 9.22 [12:12:54] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.07, 10.46, 9.91 [12:13:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.97, 10.27, 9.25 [12:14:27] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.41, 9.66, 9.20 [12:14:49] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 9.91, 10.20, 9.87 [12:14:59] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.69, 9.01, 8.92 [12:16:21] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.16, 9.53, 9.21 [12:17:49] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.95, 1.80, 1.48 [12:18:13] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 73, in check_records nameserversans = dns_resolver.resolve(root_domain, 'NS') File "/usr/l [12:18:13] n3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query bellinrattin.it. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [12:19:48] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.36, 1.93, 1.56 [12:20:36] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.31, 10.75, 10.15 [12:21:47] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.76, 1.77, 1.54 [12:22:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.49, 3.28, 2.80 [12:24:21] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.86, 2.71, 2.65 [12:24:26] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.78, 11.31, 10.47 [12:25:46] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.33, 1.95, 1.65 [12:26:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.76, 10.67, 10.33 [12:26:51] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.70, 10.26, 9.77 [12:27:45] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.47, 1.73, 1.60 [12:28:13] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.84, 1.68, 1.29 [12:28:45] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.28, 9.55, 9.59 [12:29:19] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.00, 3.51, 2.59 [12:29:31] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.09, 3.92, 2.85 [12:29:44] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.24, 1.53, 1.54 [12:30:13] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.85, 1.42, 1.24 [12:30:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.27, 4.17, 3.27 [12:31:15] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.83, 3.37, 2.66 [12:31:30] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.32, 3.91, 2.99 [12:32:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.67, 3.86, 3.26 [12:36:23] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.17, 10.14, 9.64 [12:38:18] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 10.07, 9.99, 9.65 [12:38:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.40, 4.00, 3.47 [12:39:25] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.77, 4.15, 3.44 [12:41:14] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.82, 4.21, 3.31 [12:42:14] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.37, 10.00, 9.11 [12:44:08] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 10.00, 9.78, 9.12 [12:44:13] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 9.57, 9.74, 10.08 [12:47:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.40, 3.89, 3.54 [12:47:21] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.79, 3.92, 3.69 [12:49:14] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.23, 3.38, 3.39 [12:49:42] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.29, 1.84, 1.44 [12:50:13] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 13.52, 11.78, 10.82 [12:50:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.39, 3.69, 3.89 [12:51:38] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.93, 1.86, 1.49 [12:52:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.57, 4.41, 4.10 [12:53:34] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.28, 1.65, 1.46 [12:56:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.40, 3.76, 3.95 [12:58:13] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.44, 11.57, 11.25 [12:59:13] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.72, 10.40, 9.59 [12:59:21] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.40, 9.97, 9.22 [13:01:13] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.13, 3.77, 3.56 [13:01:15] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.85, 9.67, 9.21 [13:02:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.50, 3.89, 3.90 [13:02:30] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.18, 1.77, 1.54 [13:03:12] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.39, 3.39, 3.46 [13:04:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.23, 3.55, 3.76 [13:04:30] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.44, 1.61, 1.51 [13:06:07] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.77, 10.47, 9.97 [13:06:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.26, 4.00, 3.89 [13:07:14] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.87, 11.89, 10.75 [13:08:13] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.66, 11.30, 11.17 [13:08:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.96, 3.52, 3.72 [13:09:09] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.70, 3.17, 3.37 [13:09:49] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.48, 10.23, 9.85 [13:10:02] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 9.51, 10.13, 9.97 [13:11:47] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.87, 4.01, 3.58 [13:11:49] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.63, 10.12, 9.86 [13:15:39] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.50, 3.74, 3.57 [13:15:49] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.36, 10.41, 10.04 [13:17:03] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.92, 3.63, 3.45 [13:17:14] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.44, 11.25, 10.85 [13:17:35] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.21, 3.10, 3.35 [13:18:13] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.29, 11.17, 11.36 [13:18:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.71, 9.89, 9.63 [13:19:02] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.77, 3.93, 3.58 [13:19:13] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 12.00, 11.43, 10.97 [13:20:13] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 13.74, 12.31, 11.76 [13:20:28] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.31, 9.80, 9.64 [13:20:43] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.80, 10.85, 10.43 [13:22:13] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.84, 11.98, 11.71 [13:22:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.66, 3.74, 3.70 [13:25:20] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.89, 3.46, 3.43 [13:26:20] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.62, 2.30, 1.80 [13:26:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.88, 3.85, 3.76 [13:26:58] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.65, 3.89, 3.74 [13:27:16] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.00, 3.29, 3.37 [13:28:19] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.33, 1.94, 1.73 [13:28:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.11, 3.98, 3.80 [13:28:57] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.46, 4.39, 3.95 [13:29:14] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 9.67, 9.61, 10.18 [13:30:18] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.00, 1.65, 1.65 [13:30:56] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.57, 3.92, 3.85 [13:32:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.96, 3.60, 3.72 [13:33:13] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.65, 10.48, 10.39 [13:34:20] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.86, 1.80, 1.73 [13:34:26] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 9.02, 9.53, 10.01 [13:35:49] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.01, 11.41, 10.81 [13:36:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.72, 10.49, 10.04 [13:36:19] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.41, 1.63, 1.68 [13:36:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.63, 4.17, 3.84 [13:37:49] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.93, 11.39, 10.87 [13:37:55] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.40, 10.13, 9.96 [13:38:51] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.81, 2.75, 3.34 [13:41:43] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.82, 10.26, 10.06 [13:43:37] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 10.11, 10.03, 9.98 [13:44:11] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.96, 11.02, 10.43 [13:44:47] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.30, 3.31, 3.43 [13:44:51] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp21.miraheze.org - CNAME OK [13:45:49] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.30, 11.31, 10.90 [13:46:15] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 3.08, 2.00, 1.73 [13:46:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.36, 3.41, 3.66 [13:46:47] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.28, 2.98, 3.30 [13:47:25] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.35, 10.68, 10.25 [13:47:49] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.98, 10.43, 10.63 [13:48:13] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.05, 10.93, 10.85 [13:48:14] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.46, 1.69, 1.64 [13:51:02] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.45, 1.85, 1.36 [13:51:14] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.02, 10.87, 10.53 [13:53:02] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 0.97, 1.53, 1.30 [13:53:14] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.94, 11.31, 10.74 [13:53:49] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.81, 11.60, 11.03 [13:53:59] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.24, 9.88, 10.15 [13:54:13] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.29, 11.47, 11.21 [13:55:12] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.23, 9.68, 10.03 [13:55:49] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.37, 11.55, 11.09 [13:56:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.33, 3.60, 3.62 [13:57:14] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.08, 11.57, 10.96 [13:57:53] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.94, 10.36, 10.27 [13:58:10] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.19, 2.58, 2.06 [13:59:14] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.21, 11.47, 11.01 [13:59:21] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.09, 3.94, 3.32 [13:59:40] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.71, 4.20, 3.57 [13:59:49] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.56, 11.73, 11.23 [13:59:51] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.01, 10.77, 10.41 [14:00:13] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 3.26, 1.78, 1.31 [14:01:48] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.98, 11.12, 10.58 [14:02:13] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.64, 1.71, 1.34 [14:02:52] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.27, 10.20, 9.62 [14:03:49] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.68, 11.90, 11.43 [14:04:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.88, 10.36, 9.74 [14:05:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.87, 3.91, 3.50 [14:05:43] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.13, 10.92, 10.57 [14:05:49] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.45, 12.43, 11.68 [14:06:13] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 3.39, 2.17, 1.59 [14:06:48] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.81, 10.19, 9.76 [14:07:12] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.58, 10.72, 10.24 [14:07:41] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.68, 10.72, 10.53 [14:07:49] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.69, 11.78, 11.54 [14:08:13] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.49, 1.86, 1.55 [14:09:12] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.47, 9.64, 9.91 [14:09:14] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.09, 4.72, 3.86 [14:09:39] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.29, 9.64, 10.15 [14:11:13] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.61, 9.28, 10.19 [14:12:13] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.93, 1.41, 1.44 [14:13:12] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.59, 10.72, 10.25 [14:13:31] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.43, 10.99, 10.58 [14:15:12] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.71, 9.84, 9.98 [14:15:29] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.74, 10.88, 10.59 [14:15:53] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 73, in check_records nameserversans = dns_resolver.resolve(root_domain, 'NS') File "/usr/l [14:15:53] n3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query bellinrattin.it. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [14:16:13] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.41, 10.54, 10.59 [14:20:13] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.62, 10.68, 10.63 [14:21:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.88, 3.66, 3.84 [14:23:14] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.28, 4.03, 3.94 [14:24:00] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 0.96, 1.44, 1.87 [14:26:00] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 3.66, 2.25, 2.11 [14:27:12] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.60, 10.53, 10.13 [14:27:25] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.39, 3.66, 3.97 [14:27:49] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.43, 10.96, 10.64 [14:27:52] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.67, 11.09, 10.54 [14:29:12] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.48, 9.79, 9.88 [14:29:24] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.61, 4.39, 4.20 [14:29:49] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.69, 10.26, 10.44 [14:31:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.93, 3.64, 3.84 [14:31:42] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.16, 11.27, 10.72 [14:32:13] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.62, 11.17, 10.80 [14:33:14] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.10, 3.95, 3.93 [14:33:38] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.55, 11.18, 10.77 [14:34:13] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.28, 11.02, 10.78 [14:35:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.76, 3.52, 3.78 [14:35:56] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 0.91, 1.59, 1.90 [14:37:12] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.05, 10.56, 10.12 [14:39:18] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.96, 3.75, 4.00 [14:39:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.81, 11.31, 10.81 [14:39:49] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.22, 10.97, 10.62 [14:41:12] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.98, 9.79, 9.98 [14:41:49] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.34, 10.72, 10.57 [14:43:14] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.59, 4.10, 3.85 [14:45:12] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.93, 10.64, 10.24 [14:45:16] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.21, 4.14, 4.01 [14:45:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.29, 11.83, 11.30 [14:45:52] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.28, 1.33, 1.65 [14:47:15] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.52, 3.84, 3.91 [14:49:12] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.66, 9.73, 9.98 [14:49:14] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.30, 11.46, 10.97 [14:49:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 1.93, 3.24, 3.62 [14:51:02] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.77, 1.63, 1.39 [14:51:14] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.06, 11.25, 10.95 [14:53:02] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.14, 1.45, 1.36 [14:53:11] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.18, 4.11, 3.97 [14:55:14] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.94, 2.97, 3.37 [14:55:49] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.78, 9.81, 10.17 [14:56:16] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.31, 10.11, 9.69 [14:56:47] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 3.19, 2.30, 1.90 [14:57:09] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.13, 3.74, 3.86 [14:57:12] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.57, 10.04, 9.96 [14:59:08] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 7.34, 4.72, 4.18 [14:59:12] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 10.18, 10.01, 9.95 [14:59:14] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.10, 3.56, 3.51 [14:59:49] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.43, 10.51, 10.34 [15:00:13] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.35, 11.28, 10.80 [15:00:20] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.54, 9.69, 9.65 [15:01:49] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.07, 10.98, 10.53 [15:02:13] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.76, 11.16, 10.82 [15:02:45] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.68, 1.91, 1.87 [15:03:49] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.32, 10.93, 10.55 [15:04:44] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.75, 2.13, 1.95 [15:07:14] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.14, 11.24, 10.92 [15:07:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.38, 3.71, 3.62 [15:07:49] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.95, 9.84, 10.18 [15:08:18] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.87, 10.63, 10.04 [15:09:14] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.33, 10.77, 10.78 [15:09:49] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.89, 10.40, 10.13 [15:11:14] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.33, 4.36, 3.90 [15:12:13] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.16, 11.06, 10.75 [15:12:16] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.48, 10.08, 10.00 [15:13:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.28, 3.76, 3.73 [15:13:49] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.31, 10.14, 10.16 [15:13:53] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp20.miraheze.org - CNAME OK [15:14:13] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.78, 11.14, 10.83 [15:15:31] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.42, 11.30, 10.57 [15:15:49] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 10.02, 9.96, 10.09 [15:16:08] [02mw-config] 07ugochimobi synchronize pull request 03#4612: Minimal metadata to enable OpenGraph cards - 13https://github.com/miraheze/mw-config/pull/4612 [15:17:14] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.33, 3.77, 3.73 [15:17:25] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.84, 10.80, 10.48 [15:17:25] miraheze/mw-config - ugochimobi the build passed. [15:18:06] [02mw-config] 07ugochimobi edited pull request 03#4612: override page HTML title with the wikibase label, if available, or else the id - 13https://github.com/miraheze/mw-config/pull/4612 [15:18:58] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.93, 3.45, 3.89 [15:19:14] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 13.03, 11.56, 11.07 [15:19:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.79, 3.43, 3.61 [15:19:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 13.06, 11.42, 11.00 [15:19:52] [02mw-config] 07ugochimobi edited pull request 03#4612: override page HTML title with the wikibase label, if available, or else the id - 13https://github.com/miraheze/mw-config/pull/4612 [15:20:13] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 13.00, 11.39, 10.93 [15:21:13] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.45, 9.56, 10.05 [15:21:14] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.46, 11.23, 11.02 [15:21:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.68, 10.64, 10.79 [15:22:09] [02mw-config] 07ugochimobi edited pull request 03#4612: override page HTML title with the wikibase label, if available, or else the id - 13https://github.com/miraheze/mw-config/pull/4612 [15:22:13] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.62, 11.54, 11.05 [15:22:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.96, 3.62, 3.98 [15:22:55] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.64, 4.09, 4.04 [15:24:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.04, 4.14, 4.12 [15:26:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.03, 3.69, 3.96 [15:28:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.16, 3.81, 3.97 [15:30:13] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.15, 10.90, 10.79 [15:30:51] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.68, 3.69, 3.96 [15:32:13] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.03, 10.61, 10.71 [15:35:22] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 9.22, 9.23, 9.93 [15:35:49] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.05, 10.76, 10.22 [15:36:00] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.20, 10.68, 10.29 [15:38:13] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.87, 11.80, 11.15 [15:38:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.05, 3.44, 3.84 [15:39:49] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.47, 9.80, 9.97 [15:39:49] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.34, 11.03, 10.48 [15:40:13] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.12, 11.66, 11.20 [15:41:14] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.18, 10.85, 10.62 [15:41:14] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.18, 2.81, 3.30 [15:41:43] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.17, 10.07, 10.20 [15:42:16] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.21, 10.98, 10.49 [15:42:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.97, 10.28, 9.88 [15:42:47] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.80, 2.75, 3.30 [15:42:49] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/f4b1309ac404...6b4b3263ae2f [15:42:50] [02miraheze/puppet] 07paladox 036b4b326 - prometheus: Sort mediawiki urls [15:43:13] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.59, 10.55, 10.55 [15:43:49] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.41, 11.00, 10.34 [15:44:14] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.03, 11.21, 10.62 [15:44:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.59, 4.22, 4.02 [15:45:14] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 13.73, 11.63, 10.94 [15:45:31] alerting : [FIRING:2] (mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [15:45:49] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.93, 10.70, 10.30 [15:46:05] [02mw-config] 07Universal-Omega commented on pull request 03#4612: override page HTML title with the wikibase label, if available, or else the id - 13https://github.com/miraheze/mw-config/pull/4612#issuecomment-1104087154 [15:46:13] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 14.64, 11.84, 11.28 [15:46:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 1.93, 3.33, 3.72 [15:46:39] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.91, 10.18, 9.94 [15:46:54] PROBLEM - cp21 Stunnel HTTP for mw102 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:47:11] PROBLEM - cp30 Stunnel HTTP for mw101 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:47:25] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.26, 11.65, 10.79 [15:47:25] PROBLEM - cp30 Stunnel HTTP for mw122 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:47:26] [02mw-config] 07Universal-Omega commented on pull request 03#4612: override page HTML title with the wikibase label, if available, or else the id - 13https://github.com/miraheze/mw-config/pull/4612#issuecomment-1104088908 [15:47:37] PROBLEM - mw101 MediaWiki Rendering on mw101 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:47:38] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:47:38] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:47:48] PROBLEM - mw102 MediaWiki Rendering on mw102 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 1595 bytes in 0.010 second response time [15:47:51] PROBLEM - mw112 MediaWiki Rendering on mw112 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:47:55] PROBLEM - cp21 Stunnel HTTP for mw112 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:47:56] PROBLEM - cp31 Stunnel HTTP for mw102 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:47:56] PROBLEM - cp30 Stunnel HTTP for mw102 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:47:57] PROBLEM - cp20 Stunnel HTTP for mw101 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:47:57] PROBLEM - cp20 Stunnel HTTP for mw102 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:47:57] PROBLEM - cp31 Stunnel HTTP for mw101 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:48:13] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.77, 10.77, 10.97 [15:48:18] PROBLEM - mw111 MediaWiki Rendering on mw111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:48:19] PROBLEM - cp20 Stunnel HTTP for mw122 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:48:19] PROBLEM - cp21 Stunnel HTTP for mw101 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:48:35] PROBLEM - cp20 Stunnel HTTP for mw112 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:48:36] PROBLEM - cp30 Stunnel HTTP for mw111 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:48:36] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 328 bytes in 0.011 second response time [15:48:41] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.12, 1.69, 1.98 [15:48:45] PROBLEM - cp30 Stunnel HTTP for mw112 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:48:47] PROBLEM - cp31 Stunnel HTTP for mw112 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:48:49] PROBLEM - cp31 Stunnel HTTP for mw111 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:48:51] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 328 bytes in 0.307 second response time [15:48:54] PROBLEM - cp21 Stunnel HTTP for mw111 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:49:13] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.56, 11.78, 11.16 [15:49:49] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.10, 9.32, 9.89 [15:50:00] RECOVERY - cp21 Stunnel HTTP for mw112 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14640 bytes in 8.722 second response time [15:50:23] RECOVERY - cp21 Stunnel HTTP for mw101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14640 bytes in 7.037 second response time [15:50:27] [02mw-config] 07Universal-Omega reviewed pull request 03#4612 commit - 13https://github.com/miraheze/mw-config/pull/4612#discussion_r854297482 [15:50:28] [02mw-config] 07Universal-Omega reviewed pull request 03#4612 commit - 13https://github.com/miraheze/mw-config/pull/4612#discussion_r854297974 [15:50:31] RECOVERY - cp20 Stunnel HTTP for mw112 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14634 bytes in 0.019 second response time [15:50:31] alerting : [FIRING:1] (mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [15:50:40] RECOVERY - cp30 Stunnel HTTP for mw111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14640 bytes in 7.682 second response time [15:50:42] RECOVERY - cp30 Stunnel HTTP for mw112 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14634 bytes in 1.145 second response time [15:50:49] RECOVERY - cp31 Stunnel HTTP for mw112 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14626 bytes in 7.012 second response time [15:50:52] RECOVERY - cp31 Stunnel HTTP for mw111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14626 bytes in 6.754 second response time [15:50:55] RECOVERY - cp21 Stunnel HTTP for mw111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14634 bytes in 3.544 second response time [15:51:14] RECOVERY - cp30 Stunnel HTTP for mw101 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14640 bytes in 2.451 second response time [15:51:30] RECOVERY - mw101 MediaWiki Rendering on mw101 is OK: HTTP OK: HTTP/1.1 200 OK - 22336 bytes in 0.873 second response time [15:51:49] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14626 bytes in 4.295 second response time [15:51:51] RECOVERY - mw112 MediaWiki Rendering on mw112 is OK: HTTP OK: HTTP/1.1 200 OK - 22336 bytes in 0.358 second response time [15:51:57] RECOVERY - cp20 Stunnel HTTP for mw101 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14640 bytes in 0.354 second response time [15:52:00] RECOVERY - cp31 Stunnel HTTP for mw101 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14634 bytes in 0.319 second response time [15:52:17] RECOVERY - mw111 MediaWiki Rendering on mw111 is OK: HTTP OK: HTTP/1.1 200 OK - 22336 bytes in 1.486 second response time [15:52:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.77, 3.63, 3.63 [15:52:47] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 9.45, 4.48, 3.56 [15:53:02] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14634 bytes in 8.142 second response time [15:53:35] RECOVERY - cp30 Stunnel HTTP for mw122 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14634 bytes in 0.313 second response time [15:53:43] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 22336 bytes in 0.366 second response time [15:54:26] RECOVERY - cp20 Stunnel HTTP for mw122 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14640 bytes in 0.023 second response time [15:54:37] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14640 bytes in 0.022 second response time [15:54:42] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.39, 1.30, 1.68 [15:54:45] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 2.01, 3.35, 2.12 [15:55:12] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 6.24, 10.64, 11.15 [15:55:31] alerting : [FIRING:3] (mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [15:56:13] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.67, 8.87, 10.08 [15:57:13] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.23, 8.79, 9.99 [15:57:14] RECOVERY - cp21 Stunnel HTTP for mw102 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14634 bytes in 9.843 second response time [15:57:47] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.82, 3.91, 3.39 [15:57:57] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.46, 11.56, 11.83 [15:58:08] RECOVERY - mw102 MediaWiki Rendering on mw102 is OK: HTTP OK: HTTP/1.1 200 OK - 22336 bytes in 3.734 second response time [15:58:14] RECOVERY - cp20 Stunnel HTTP for mw102 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14634 bytes in 1.998 second response time [15:58:16] [02mw-config] 07ugochimobi synchronize pull request 03#4612: override page HTML title with the wikibase label, if available, or else the id - 13https://github.com/miraheze/mw-config/pull/4612 [15:58:33] RECOVERY - cp31 Stunnel HTTP for mw102 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14634 bytes in 5.310 second response time [15:58:34] RECOVERY - cp30 Stunnel HTTP for mw102 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14640 bytes in 5.048 second response time [15:58:35] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 0.40, 1.85, 1.78 [15:59:02] [02mw-config] 07ugochimobi reviewed pull request 03#4612 commit - 13https://github.com/miraheze/mw-config/pull/4612#discussion_r854307361 [15:59:18] [02mw-config] 07ugochimobi reviewed pull request 03#4612 commit - 13https://github.com/miraheze/mw-config/pull/4612#discussion_r854307640 [15:59:26] miraheze/mw-config - ugochimobi the build passed. [15:59:43] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.55, 4.02, 3.48 [16:00:31] alerting : [FIRING:1] (mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [16:01:01] [02mw-config] 07ugochimobi commented on pull request 03#4612: override page HTML title with the wikibase label, if available, or else the id - 13https://github.com/miraheze/mw-config/pull/4612#issuecomment-1104106362 [16:02:25] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 1.01, 1.46, 1.63 [16:03:50] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 18.97, 13.19, 12.21 [16:03:53] [02mw-config] 07Universal-Omega reviewed pull request 03#4612 commit - 13https://github.com/miraheze/mw-config/pull/4612#discussion_r854310171 [16:04:21] PROBLEM - cp20 Stunnel HTTP for mw102 on cp20 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 328 bytes in 0.021 second response time [16:04:47] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.25, 3.88, 3.85 [16:04:48] PROBLEM - cp31 Stunnel HTTP for mw102 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:04:49] PROBLEM - cp30 Stunnel HTTP for mw102 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:04:49] PROBLEM - cp30 Stunnel HTTP for mw111 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:04:51] PROBLEM - cp31 Stunnel HTTP for mw111 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:05:09] PROBLEM - cp21 Stunnel HTTP for mw111 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:05:20] PROBLEM - cp21 Stunnel HTTP for mw102 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:05:22] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:05:31] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.38, 3.74, 3.63 [16:05:49] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.68, 12.01, 10.57 [16:06:17] PROBLEM - mw102 MediaWiki Rendering on mw102 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:06:41] CosmicAlpha: we are super slow [16:06:44] Like unusable [16:06:47] RECOVERY - cp30 Stunnel HTTP for mw111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14640 bytes in 0.334 second response time [16:06:48] RECOVERY - cp31 Stunnel HTTP for mw111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14634 bytes in 0.322 second response time [16:07:05] PROBLEM - mw101 MediaWiki Rendering on mw101 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:07:07] RECOVERY - cp21 Stunnel HTTP for mw111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14640 bytes in 0.023 second response time [16:07:12] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.66, 8.80, 10.04 [16:07:49] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 7.31, 10.38, 10.17 [16:09:06] RECOVERY - mw101 MediaWiki Rendering on mw101 is OK: HTTP OK: HTTP/1.1 200 OK - 22336 bytes in 4.291 second response time [16:09:23] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14634 bytes in 8.480 second response time [16:09:49] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.66, 9.00, 9.68 [16:10:01] RhinosF1: I noticed. I'm going to look even further into what causes the high load sometimes, that causes slowness every once in a while when things start going down. Something is obviously causing it. In fact, it seems whatever it is, is on test101 now since that's even getting high load every once in awhile. [16:10:43] CosmicAlpha: hmm [16:11:40] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.56, 11.18, 11.78 [16:12:44] [02mw-config] 07ugochimobi reviewed pull request 03#4612 commit - 13https://github.com/miraheze/mw-config/pull/4612#discussion_r854320431 [16:12:47] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.07, 3.75, 3.73 [16:13:14] RECOVERY - cp30 Stunnel HTTP for mw102 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14626 bytes in 9.942 second response time [16:13:34] RECOVERY - cp21 Stunnel HTTP for mw102 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14640 bytes in 8.303 second response time [16:13:38] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.34, 11.62, 11.87 [16:14:09] [02mw-config] 07ugochimobi synchronize pull request 03#4612: override page HTML title with the wikibase label, if available, or else the id - 13https://github.com/miraheze/mw-config/pull/4612 [16:14:36] RECOVERY - mw102 MediaWiki Rendering on mw102 is OK: HTTP OK: HTTP/1.1 200 OK - 22336 bytes in 8.862 second response time [16:14:44] RECOVERY - cp20 Stunnel HTTP for mw102 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14634 bytes in 8.993 second response time [16:14:47] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.33, 3.56, 3.66 [16:15:30] miraheze/mw-config - ugochimobi the build passed. [16:15:35] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.60, 11.28, 11.72 [16:16:47] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.52, 4.13, 3.84 [16:17:14] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.35, 3.85, 3.72 [16:17:39] PROBLEM - cp30 Stunnel HTTP for mw102 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:17:52] PROBLEM - cp21 Stunnel HTTP for mw102 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:18:58] PROBLEM - mw102 MediaWiki Rendering on mw102 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:19:02] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.23, 1.71, 1.31 [16:19:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.80, 3.30, 3.53 [16:19:30] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 13.20, 12.03, 11.91 [16:19:51] PROBLEM - mw112 MediaWiki Rendering on mw112 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:19:55] PROBLEM - cp21 Stunnel HTTP for mw112 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:20:09] [02mw-config] 07RhinosF1 reviewed pull request 03#4612 commit - 13https://github.com/miraheze/mw-config/pull/4612#discussion_r854327317 [16:20:13] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.16, 11.24, 10.06 [16:20:16] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.18, 10.95, 9.60 [16:20:35] PROBLEM - cp20 Stunnel HTTP for mw112 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:20:42] PROBLEM - cp31 Stunnel HTTP for mw101 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:20:45] PROBLEM - cp30 Stunnel HTTP for mw112 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:20:47] PROBLEM - cp31 Stunnel HTTP for mw112 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:20:47] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.33, 3.41, 3.63 [16:20:48] PROBLEM - cp20 Stunnel HTTP for mw121 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:20:55] PROBLEM - cp30 Stunnel HTTP for mw101 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:21:02] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.18, 1.57, 1.31 [16:21:02] RECOVERY - mw102 MediaWiki Rendering on mw102 is OK: HTTP OK: HTTP/1.1 200 OK - 22336 bytes in 9.003 second response time [16:21:06] PROBLEM - cp21 Stunnel HTTP for mw101 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:21:27] PROBLEM - cp31 Stunnel HTTP for mw121 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:21:28] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.46, 11.15, 11.62 [16:21:36] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 1595 bytes in 0.013 second response time [16:21:42] RECOVERY - cp31 Stunnel HTTP for mw102 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14634 bytes in 5.249 second response time [16:21:49] RECOVERY - mw112 MediaWiki Rendering on mw112 is OK: HTTP OK: HTTP/1.1 200 OK - 22336 bytes in 3.449 second response time [16:21:52] RECOVERY - cp21 Stunnel HTTP for mw112 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14634 bytes in 0.939 second response time [16:21:53] RECOVERY - cp30 Stunnel HTTP for mw102 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14640 bytes in 6.339 second response time [16:21:55] RECOVERY - cp21 Stunnel HTTP for mw102 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14634 bytes in 5.142 second response time [16:21:56] PROBLEM - cp21 Stunnel HTTP for mw121 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:22:13] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 8.92, 10.17, 9.79 [16:22:16] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.95, 10.76, 9.70 [16:22:16] PROBLEM - cp20 Stunnel HTTP for mw101 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:22:21] PROBLEM - cp30 Stunnel HTTP for mw121 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:22:31] RECOVERY - cp20 Stunnel HTTP for mw112 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14640 bytes in 0.022 second response time [16:22:43] RECOVERY - cp30 Stunnel HTTP for mw112 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14634 bytes in 2.043 second response time [16:22:44] RECOVERY - cp31 Stunnel HTTP for mw112 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14634 bytes in 2.129 second response time [16:22:46] RECOVERY - cp31 Stunnel HTTP for mw101 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14626 bytes in 7.631 second response time [16:22:49] RECOVERY - cp20 Stunnel HTTP for mw121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14640 bytes in 7.014 second response time [16:23:01] RECOVERY - cp30 Stunnel HTTP for mw101 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14626 bytes in 5.632 second response time [16:23:14] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.76, 3.68, 3.56 [16:24:00] RECOVERY - cp21 Stunnel HTTP for mw121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14640 bytes in 6.405 second response time [16:24:16] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.75, 10.03, 9.57 [16:24:21] RECOVERY - cp20 Stunnel HTTP for mw101 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14634 bytes in 9.406 second response time [16:24:23] RECOVERY - cp30 Stunnel HTTP for mw121 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14640 bytes in 2.093 second response time [16:24:44] [02miraheze/mw-config] 07RhinosF1 pushed 031 commit to 03RhinosF1-patch-3 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/006d2e116b1c [16:24:46] [02miraheze/mw-config] 07RhinosF1 03006d2e1 - metawiki: drop long unused metatags [16:24:47] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.39, 4.85, 4.17 [16:24:47] [02mw-config] 07RhinosF1 created branch 03RhinosF1-patch-3 - 13https://github.com/miraheze/mw-config [16:24:49] [02mw-config] 07RhinosF1 opened pull request 03#4613: metawiki: drop long unused metatags - 13https://github.com/miraheze/mw-config/pull/4613 [16:25:14] RECOVERY - cp21 Stunnel HTTP for mw101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14626 bytes in 4.240 second response time [16:25:23] CosmicAlpha: can you merge ^ so I'm not being ironic to ugochimobi [16:25:35] RECOVERY - cp31 Stunnel HTTP for mw121 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14640 bytes in 0.322 second response time [16:25:39] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 22336 bytes in 0.468 second response time [16:25:57] miraheze/mw-config - RhinosF1 the build passed. [16:27:14] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.30, 9.83, 9.57 [16:27:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.03, 11.30, 11.47 [16:27:45] [02mw-config] 07ugochimobi reviewed pull request 03#4612 commit - 13https://github.com/miraheze/mw-config/pull/4612#discussion_r854334159 [16:28:13] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 1.98, 2.14, 1.47 [16:28:42] [02mw-config] 07RhinosF1 reviewed pull request 03#4612 commit - 13https://github.com/miraheze/mw-config/pull/4612#discussion_r854334995 [16:28:46] [02mw-config] 07ugochimobi synchronize pull request 03#4612: override page HTML title with the wikibase label, if available, or else the id - 13https://github.com/miraheze/mw-config/pull/4612 [16:29:19] [02mw-config] 07ugochimobi reviewed pull request 03#4612 commit - 13https://github.com/miraheze/mw-config/pull/4612#discussion_r854335558 [16:29:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.94, 10.79, 11.26 [16:30:00] miraheze/mw-config - ugochimobi the build passed. [16:30:13] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.33, 1.86, 1.45 [16:31:14] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 13.71, 11.26, 10.16 [16:31:37] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.88, 10.24, 9.65 [16:32:03] RhinosF1: in a few minutes. [16:32:13] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.98, 10.27, 9.96 [16:32:13] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.49, 1.41, 1.33 [16:32:17] Cool [16:33:13] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.30, 11.52, 10.41 [16:36:13] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.85, 9.61, 9.80 [16:42:16] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.54, 10.47, 9.87 [16:43:14] PROBLEM - cloud12 Puppet on cloud12 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [16:44:16] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.15, 11.15, 10.20 [16:45:12] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.31, 9.91, 10.10 [16:45:13] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.16, 9.61, 10.08 [16:46:16] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.56, 10.99, 10.26 [16:50:13] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.62, 10.50, 10.04 [16:50:16] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.96, 9.72, 9.91 [16:51:14] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 13.75, 10.98, 10.40 [16:53:14] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.79, 11.04, 10.49 [16:53:39] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.86, 1.73, 1.40 [16:54:16] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.79, 10.57, 10.23 [16:55:14] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.05, 11.59, 10.78 [16:55:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.86, 3.52, 3.98 [16:56:00] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.75, 10.58, 10.31 [16:57:13] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.60, 11.01, 10.65 [16:57:14] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.40, 4.04, 4.12 [16:57:37] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.87, 1.40, 1.35 [16:58:13] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.24, 10.83, 10.34 [16:59:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.53, 3.50, 3.92 [17:00:13] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.61, 10.65, 10.33 [17:00:16] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.62, 10.00, 10.11 [17:00:47] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.09, 3.22, 3.93 [17:01:13] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.07, 10.95, 10.65 [17:01:43] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.03, 11.33, 10.67 [17:03:14] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.08, 3.69, 3.86 [17:03:37] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.68, 11.13, 10.66 [17:04:14] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 8.66, 10.02, 10.16 [17:05:13] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.54, 11.32, 10.93 [17:05:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.68, 3.53, 3.77 [17:05:22] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.89, 9.78, 10.18 [17:07:14] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.66, 11.76, 11.13 [17:09:14] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.30, 11.08, 10.95 [17:09:14] RECOVERY - cloud12 Puppet on cloud12 is OK: OK: Puppet is currently enabled, last run 13 seconds ago with 0 failures [17:09:14] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.06, 3.75, 3.79 [17:09:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.47, 10.17, 10.26 [17:11:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.79, 3.31, 3.61 [17:12:04] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.09, 10.79, 10.14 [17:12:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.68, 3.52, 3.93 [17:12:47] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.10, 2.66, 3.29 [17:13:05] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.62, 10.29, 10.17 [17:13:22] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 7.43, 9.70, 10.13 [17:13:59] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.34, 10.18, 10.02 [17:14:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.22, 3.69, 3.94 [17:15:03] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.59, 9.92, 10.05 [17:15:14] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.38, 2.95, 3.37 [17:16:18] [02mw-config] 07AgentIsai commented on pull request 03#4613: metawiki: drop long unused metatags - 13https://github.com/miraheze/mw-config/pull/4613#issuecomment-1104204657 [17:19:12] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.83, 9.50, 10.14 [17:19:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.96, 10.40, 10.34 [17:20:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.69, 3.45, 3.82 [17:20:38] PROBLEM - wiki.fbpml.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.fbpml.org' expires in 15 day(s) (Fri 06 May 2022 17:03:13 GMT +0000). [17:20:39] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.01, 10.56, 10.09 [17:21:02] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.85, 1.57, 1.24 [17:21:22] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.81, 9.88, 10.16 [17:22:02] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/9fca91ceefa7...6d3b973cea0a [17:22:04] [02miraheze/ssl] 07MirahezeSSLBot 036d3b973 - Bot: Update SSL cert for wiki.fbpml.org [17:22:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.71, 4.35, 4.10 [17:22:34] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 9.79, 10.15, 9.99 [17:23:02] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 0.70, 1.20, 1.14 [17:24:03] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.07, 3.43, 3.34 [17:24:04] PROBLEM - cloud11 Puppet on cloud11 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [17:24:32] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.28, 10.64, 10.24 [17:25:59] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.20, 3.27, 3.29 [17:26:26] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.33, 10.29, 10.12 [17:26:39] PROBLEM - wiki.qadrishattari.xyz - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.qadrishattari.xyz' expires in 15 day(s) (Fri 06 May 2022 17:05:51 GMT +0000). [17:28:21] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 8.86, 9.66, 9.90 [17:29:44] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.06, 3.70, 3.43 [17:29:53] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.39, 3.82, 3.52 [17:30:15] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.33, 9.60, 10.07 [17:31:45] PROBLEM - wiki.slimelab.net - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.slimelab.net' expires in 15 day(s) (Fri 06 May 2022 17:25:02 GMT +0000). [17:31:49] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.60, 3.83, 3.57 [17:32:35] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/6d3b973cea0a...2b2af517e9dd [17:32:36] [02miraheze/ssl] 07MirahezeSSLBot 032b2af51 - Bot: Update SSL cert for wiki.qadrishattari.xyz [17:33:13] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.50, 11.45, 10.99 [17:33:45] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.75, 4.07, 3.68 [17:34:03] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/2b2af517e9dd...deb4f56f71e6 [17:34:05] [02miraheze/ssl] 07MirahezeSSLBot 03deb4f56 - Bot: Update SSL cert for wiki.slimelab.net [17:34:23] PROBLEM - privacywiki.xyz - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'privacywiki.xyz' expires in 15 day(s) (Fri 06 May 2022 17:18:46 GMT +0000). [17:34:57] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/def669f1ee82 [17:34:58] [02miraheze/mw-config] 07Universal-Omega 03def669f - Don't use QuickInstantCommons for Miraheze wikis [17:35:00] [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-2 - 13https://github.com/miraheze/mw-config [17:35:01] [02mw-config] 07Universal-Omega opened pull request 03#4614: Don't use QuickInstantCommons for Miraheze wikis - 13https://github.com/miraheze/mw-config/pull/4614 [17:35:12] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.78, 10.33, 9.98 [17:35:13] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.18, 10.93, 10.83 [17:35:23] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.47, 10.77, 10.42 [17:35:33] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/deb4f56f71e6...e8ebba356170 [17:35:35] [02miraheze/ssl] 07MirahezeSSLBot 03e8ebba3 - Bot: Update SSL cert for privacywiki.xyz [17:36:04] miraheze/mw-config - Universal-Omega the build passed. [17:36:17] PROBLEM - www.hoolehistoryheritagesociety.org.uk - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'www.hoolehistoryheritagesociety.org.uk' expires in 15 day(s) (Fri 06 May 2022 17:29:48 GMT +0000). [17:36:51] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/e8ebba356170...519d4956fbfe [17:36:53] [02miraheze/ssl] 07MirahezeSSLBot 03519d495 - Bot: Update SSL cert for www.hoolehistoryheritagesociety.org.uk [17:37:12] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.08, 11.03, 10.29 [17:37:34] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 0.93, 2.33, 1.70 [17:39:02] [02mw-config] 07Universal-Omega closed pull request 03#4614: Don't use QuickInstantCommons for Miraheze wikis - 13https://github.com/miraheze/mw-config/pull/4614 [17:39:03] [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 - 13https://github.com/miraheze/mw-config [17:39:05] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/cf4c30f015ec...8b88e3a47d12 [17:39:06] [02miraheze/mw-config] 07Universal-Omega 038b88e3a - Don't use QuickInstantCommons for Miraheze wikis (#4614) [17:39:08] [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 [17:39:12] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.66, 10.11, 10.04 [17:39:25] [02mw-config] 07Universal-Omega closed pull request 03#4613: metawiki: drop long unused metatags - 13https://github.com/miraheze/mw-config/pull/4613 [17:39:26] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/8b88e3a47d12...0025f33e8d89 [17:39:28] [02miraheze/mw-config] 07RhinosF1 030025f33 - metawiki: drop long unused metatags (#4613) [17:39:29] [02miraheze/mw-config] 07Universal-Omega deleted branch 03RhinosF1-patch-3 [17:39:31] [02mw-config] 07Universal-Omega deleted branch 03RhinosF1-patch-3 - 13https://github.com/miraheze/mw-config [17:39:32] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.74, 1.84, 1.60 [17:39:39] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.96, 3.77, 3.74 [17:40:06] miraheze/mw-config - Universal-Omega the build passed. [17:40:32] !log [universalomega@mwtask111] starting deploy of {'pull': 'config', 'config': True} to all [17:40:41] miraheze/mw-config - Universal-Omega the build passed. [17:40:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:40:56] !log [universalomega@mwtask111] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 24s [17:41:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:41:30] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.64, 1.44, 1.48 [17:41:37] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.56, 4.17, 3.88 [17:43:24] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.23, 3.99, 3.89 [17:43:36] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.10, 3.68, 3.74 [17:44:12] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/8cad6a300ea6...328293c2c572 [17:44:14] [02miraheze/ImportDump] 07Universal-Omega 03328293c - Update SpecialRequestImportDump.php [17:44:15] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [17:44:57] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/328293c2c572...ccdc43a6d03c [17:44:58] [02miraheze/ImportDump] 07Universal-Omega 03ccdc43a - Update ImportDumpRequestViewer.php [17:45:00] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [17:45:20] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.19, 4.10, 3.94 [17:45:39] PROBLEM - gp.ct777.cf - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'gp.ct777.cf' expires in 15 day(s) (Fri 06 May 2022 17:27:32 GMT +0000). [17:46:59] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.91, 10.77, 10.03 [17:47:13] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.65, 11.45, 11.07 [17:47:16] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.27, 3.86, 3.87 [17:48:32] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.29, 10.38, 10.08 [17:48:40] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/ccdc43a6d03c...85efafc5f515 [17:48:41] [02miraheze/ImportDump] 07Universal-Omega 0385efafc - Update ImportDumpRequestManager.php [17:48:43] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [17:48:54] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 13.80, 11.82, 10.50 [17:49:02] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.11, 1.74, 1.39 [17:49:14] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.74, 11.51, 11.14 [17:49:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.56, 10.79, 10.51 [17:50:04] !log [@test101] starting deploy of {'config': True} to all [17:50:05] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 1s [17:50:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:50:27] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.47, 11.15, 10.39 [17:50:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:51:02] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.81, 1.82, 1.46 [17:51:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.40, 10.94, 10.60 [17:52:04] RECOVERY - cloud11 Puppet on cloud11 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [17:52:21] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.64, 11.24, 10.52 [17:52:32] miraheze/ImportDump - Universal-Omega the build passed. [17:52:44] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.79, 11.56, 10.71 [17:53:01] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/85efafc5f515...ee9aa631800b [17:53:02] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.14, 1.55, 1.41 [17:53:03] [02miraheze/ImportDump] 07Universal-Omega 03ee9aa63 - Update extension.json [17:53:04] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [17:53:31] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.95, 4.29, 3.89 [17:53:34] PROBLEM - wmworld.sktz.live - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wmworld.sktz.live' expires in 15 day(s) (Fri 06 May 2022 17:34:30 GMT +0000). [17:53:48] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/519d4956fbfe...563eeb4e1a69 [17:53:49] [02miraheze/ssl] 07MirahezeSSLBot 03563eeb4 - Bot: Update SSL cert for gp.ct777.cf [17:54:15] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.80, 11.81, 10.81 [17:55:21] PROBLEM - you.r-fit.cc - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'you.r-fit.cc' expires in 15 day(s) (Fri 06 May 2022 17:36:05 GMT +0000). [17:55:30] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.22, 3.70, 3.71 [17:55:37] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.49, 10.62, 10.19 [17:56:10] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.40, 10.31, 10.37 [17:56:31] RECOVERY - wiki.qadrishattari.xyz - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.qadrishattari.xyz' will expire on Tue 19 Jul 2022 16:32:29 GMT +0000. [17:57:05] miraheze/ImportDump - Universal-Omega the build passed. [17:57:13] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.15, 11.39, 11.15 [17:57:14] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.22, 3.41, 3.56 [17:57:32] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.60, 11.32, 10.50 [17:59:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.81, 3.29, 3.49 [17:59:26] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.98, 10.81, 10.41 [17:59:27] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.84, 4.17, 3.85 [18:01:15] RECOVERY - wiki.slimelab.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.slimelab.net' will expire on Tue 19 Jul 2022 16:33:58 GMT +0000. [18:01:23] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/563eeb4e1a69...c88d41d49d79 [18:01:25] [02miraheze/ssl] 07MirahezeSSLBot 03c88d41d - Bot: Update SSL cert for wmworld.sktz.live [18:01:53] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.82, 9.83, 10.19 [18:03:13] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.22, 11.86, 11.45 [18:03:14] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.00, 9.75, 10.06 [18:03:14] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.41, 2.88, 3.33 [18:03:46] RECOVERY - privacywiki.xyz - LetsEncrypt on sslhost is OK: OK - Certificate 'privacywiki.xyz' will expire on Tue 19 Jul 2022 16:35:28 GMT +0000. [18:04:15] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.74, 11.16, 10.78 [18:05:10] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/c88d41d49d79...4c997efe6ef2 [18:05:11] [02miraheze/ssl] 07MirahezeSSLBot 034c997ef - Bot: Update SSL cert for you.r-fit.cc [18:05:34] RECOVERY - www.hoolehistoryheritagesociety.org.uk - LetsEncrypt on sslhost is OK: OK - Certificate 'www.hoolehistoryheritagesociety.org.uk' will expire on Tue 19 Jul 2022 16:36:45 GMT +0000. [18:06:13] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.45, 10.42, 10.58 [18:07:48] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.20, 1.73, 1.51 [18:09:14] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.25, 4.08, 3.71 [18:12:13] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.08, 10.77, 10.59 [18:12:16] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.34, 10.30, 9.40 [18:13:13] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.84, 9.08, 10.19 [18:13:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.69, 3.76, 3.71 [18:14:13] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.22, 10.40, 10.46 [18:14:15] [02ImportDump] 07Universal-Omega edited pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [18:14:16] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.16, 10.26, 9.51 [18:14:46] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.35, 10.39, 10.15 [18:15:19] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.66, 3.75, 3.99 [18:15:22] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.76, 9.67, 10.20 [18:16:13] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.17, 9.42, 10.11 [18:16:16] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.33, 9.93, 9.48 [18:16:40] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.55, 10.19, 10.11 [18:18:54] RECOVERY - wiki.fbpml.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.fbpml.org' will expire on Tue 19 Jul 2022 16:21:56 GMT +0000. [18:20:13] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.89, 11.25, 10.69 [18:21:07] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.82, 10.43, 10.03 [18:22:13] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.66, 11.00, 10.67 [18:26:50] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.20, 10.89, 10.32 [18:27:12] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.81, 3.76, 3.75 [18:27:14] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.30, 4.11, 3.77 [18:28:13] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.61, 11.62, 11.03 [18:28:45] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.94, 10.33, 10.20 [18:29:11] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.87, 3.43, 3.63 [18:29:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.12, 3.77, 3.69 [18:30:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.45, 3.22, 3.84 [18:30:39] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.24, 9.87, 10.04 [18:32:06] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 14.17, 12.07, 10.70 [18:32:15] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.48, 10.60, 10.81 [18:32:25] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.41, 3.39, 3.81 [18:33:14] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.68, 2.68, 3.26 [18:34:01] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.42, 10.97, 10.46 [18:35:05] Hi chrs [18:35:08] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.17, 3.71, 3.62 [18:36:11] hey [18:36:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.31, 3.60, 3.79 [18:37:07] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.66, 3.58, 3.58 [18:37:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.96, 3.30, 3.42 [18:39:14] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.95, 3.57, 3.48 [18:40:15] chrs: we merged your PR [18:40:30] Not yours but fixing your report [18:41:57] glad to here [18:41:59] s/here/hear/ [18:42:00] chrs meant to say: glad to hear [18:42:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.71, 4.76, 4.15 [18:43:37] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.22, 9.19, 9.98 [18:43:39] RECOVERY - gp.ct777.cf - LetsEncrypt on sslhost is OK: OK - Certificate 'gp.ct777.cf' will expire on Tue 19 Jul 2022 16:53:42 GMT +0000. [18:45:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.41, 3.68, 3.61 [18:45:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [18:48:13] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.28, 10.27, 10.36 [18:48:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.99, 3.83, 3.94 [18:50:59] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.49, 3.08, 3.37 [18:51:14] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.57, 3.08, 3.36 [18:51:58] RECOVERY - wmworld.sktz.live - LetsEncrypt on sslhost is OK: OK - Certificate 'wmworld.sktz.live' will expire on Tue 19 Jul 2022 17:01:17 GMT +0000. [18:52:13] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.80, 11.43, 10.90 [18:52:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.86, 4.14, 4.00 [18:54:02] RECOVERY - you.r-fit.cc - LetsEncrypt on sslhost is OK: OK - Certificate 'you.r-fit.cc' will expire on Tue 19 Jul 2022 17:05:04 GMT +0000. [18:54:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.39, 3.58, 3.83 [18:56:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [18:56:09] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.11, 10.23, 10.10 [18:56:11] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/db57e473b1f5 [18:56:13] [02miraheze/mw-config] 07Universal-Omega 03db57e47 - Test a few configuration changes for performance [18:56:13] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.52, 11.31, 10.89 [18:56:14] [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-2 - 13https://github.com/miraheze/mw-config [18:56:16] [02mw-config] 07Universal-Omega opened pull request 03#4615: Test a few configuration changes for performance - 13https://github.com/miraheze/mw-config/pull/4615 [18:57:25] miraheze/mw-config - Universal-Omega the build passed. [18:58:04] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 9.06, 9.76, 9.94 [18:58:13] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.71, 11.41, 11.01 [18:59:48] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.98, 1.40, 1.16 [19:00:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.33, 3.74, 3.72 [19:01:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.98, 3.41, 3.36 [19:01:48] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.52, 1.38, 1.19 [19:02:08] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.26, 10.37, 9.79 [19:02:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.87, 3.41, 3.60 [19:03:14] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.37, 3.26, 3.30 [19:03:55] PROBLEM - mwtask111 Current Load on mwtask111 is CRITICAL: CRITICAL - load average: 4.06, 3.27, 2.91 [19:04:12] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.77, 10.20, 9.54 [19:06:07] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.80, 9.32, 9.31 [19:07:51] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.55, 9.28, 9.55 [19:07:55] PROBLEM - mwtask111 Current Load on mwtask111 is WARNING: WARNING - load average: 3.34, 3.61, 3.15 [19:08:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.04, 3.92, 3.71 [19:09:55] RECOVERY - mwtask111 Current Load on mwtask111 is OK: OK - load average: 2.84, 3.33, 3.10 [19:10:13] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 8.67, 9.30, 10.17 [19:12:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.10, 3.87, 3.76 [19:13:43] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.72, 1.56, 1.30 [19:13:44] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.60, 3.86, 2.17 [19:14:13] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.21, 10.34, 10.42 [19:14:28] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.38, 10.63, 10.34 [19:14:41] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/db57e473b1f5...67dff081e27a [19:14:43] [02miraheze/mw-config] 07Universal-Omega 0367dff08 - Update Database.php [19:14:44] [02mw-config] 07Universal-Omega synchronize pull request 03#4615: Test a few configuration changes for performance - 13https://github.com/miraheze/mw-config/pull/4615 [19:15:25] paladox: ^ does that look OK to you? (the database part of it anyway) [19:15:42] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.10, 1.46, 1.30 [19:15:48] miraheze/mw-config - Universal-Omega the build passed. [19:15:53] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 86, in check_records cname = str(dns_resolver.resolve(hostname, 'CNAME')[0]) File "/usr/li [19:15:53] 3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query dnd.bellinrattin.it. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [19:16:23] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.94, 10.17, 10.20 [19:17:08] i guess so [19:17:18] but none of that means anything to me (without looking up) [19:19:39] paladox: particularly `innodb_lock_wait_timeout` seem OK to you (and won't cause big issues, in your opinion)? [19:19:55] yeh [19:20:13] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 13.28, 11.22, 10.68 [19:20:13] PROBLEM - mwtask111 MediaWiki Rendering on mwtask111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:21:12] PROBLEM - mwtask111 Current Load on mwtask111 is CRITICAL: CRITICAL - load average: 13.50, 11.97, 6.85 [19:21:16] !log [universalomega@test101] starting deploy of {'config': True} to all [19:21:17] !log [universalomega@test101] finished deploy of {'config': True} to all - SUCCESS in 1s [19:21:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:21:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:21:34] !log [@test101] starting deploy of {'config': True} to all [19:21:37] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 3s [19:21:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:21:44] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 0.70, 1.68, 1.79 [19:21:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:22:11] RECOVERY - mwtask111 MediaWiki Rendering on mwtask111 is OK: HTTP OK: HTTP/1.1 200 OK - 22344 bytes in 0.523 second response time [19:22:13] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.50, 11.33, 10.80 [19:23:44] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.45, 1.29, 1.64 [19:24:06] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.67, 10.03, 9.98 [19:26:01] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.19, 9.35, 9.74 [19:26:05] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.13, 10.21, 9.67 [19:26:13] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.02, 11.45, 10.96 [19:26:21] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.70, 2.93, 3.35 [19:27:44] [02mw-config] 07Universal-Omega edited pull request 03#4615: Try a few configuration changes for performance - 13https://github.com/miraheze/mw-config/pull/4615 [19:27:59] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.06, 10.00, 9.67 [19:28:08] [02mw-config] 07Universal-Omega closed pull request 03#4615: Try a few configuration changes for performance - 13https://github.com/miraheze/mw-config/pull/4615 [19:28:10] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/mw-config/compare/0025f33e8d89...304f9e3c3d0f [19:28:11] [02miraheze/mw-config] 07Universal-Omega 03304f9e3 - Try a few configuration changes for performance (#4615) [19:28:13] [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 - 13https://github.com/miraheze/mw-config [19:28:13] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.00, 10.73, 10.74 [19:28:14] [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 [19:28:27] !log [universalomega@mwtask111] starting deploy of {'pull': 'config', 'config': True} to all [19:28:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:28:43] !log [universalomega@mwtask111] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 15s [19:28:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:29:17] miraheze/mw-config - Universal-Omega the build passed. [19:30:54] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.22, 10.07, 9.57 [19:31:49] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 13.54, 11.54, 10.49 [19:33:44] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.48, 11.14, 10.47 [19:34:32] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.25, 1.76, 1.54 [19:36:20] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.93, 3.32, 2.95 [19:36:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.64, 3.85, 3.48 [19:36:31] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.61, 3.43, 3.05 [19:36:32] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.17, 1.47, 1.45 [19:38:15] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.16, 3.10, 2.90 [19:38:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.96, 3.90, 3.55 [19:38:30] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.31, 3.34, 3.06 [19:38:45] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 9.37, 10.10, 9.87 [19:40:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.08, 4.10, 3.67 [19:41:25] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.04, 9.26, 9.93 [19:42:27] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.96, 4.21, 3.47 [19:42:37] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.85, 10.26, 10.02 [19:44:09] PROBLEM - mwtask111 Current Load on mwtask111 is WARNING: WARNING - load average: 1.46, 2.22, 3.89 [19:44:35] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 9.15, 9.64, 9.80 [19:44:46] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp21.miraheze.org - CNAME OK [19:46:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.81, 3.77, 3.65 [19:46:25] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.82, 3.43, 3.31 [19:47:59] RECOVERY - mwtask111 Current Load on mwtask111 is OK: OK - load average: 0.81, 1.51, 3.23 [19:48:13] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.71, 10.46, 10.41 [19:48:24] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.90, 3.19, 3.23 [19:50:13] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.45, 10.12, 10.30 [19:50:21] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.85, 2.82, 3.30 [19:52:13] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.82, 9.14, 9.91 [19:53:17] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.06, 1.83, 1.44 [19:53:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.65, 10.42, 10.21 [19:53:25] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.04, 1.71, 1.48 [19:53:46] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.06, 3.31, 3.01 [19:55:15] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.06, 1.55, 1.38 [19:55:24] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.85, 1.71, 1.51 [19:55:42] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.00, 3.26, 3.03 [19:56:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [19:57:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.14, 10.76, 10.35 [19:57:23] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.06, 1.46, 1.44 [19:58:18] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.10, 3.62, 3.39 [19:59:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.26, 10.30, 10.21 [20:00:17] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.92, 3.46, 3.37 [20:01:21] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.71, 1.75, 1.57 [20:01:22] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 7.73, 9.42, 9.90 [20:02:16] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.80, 3.23, 3.29 [20:03:20] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.15, 1.59, 1.54 [20:05:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [20:05:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.32, 10.27, 10.14 [20:10:54] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.46, 3.41, 3.38 [20:11:22] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.78, 9.77, 10.01 [20:12:52] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.02, 3.26, 3.33 [20:12:55] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.64, 9.98, 9.26 [20:13:14] PROBLEM - cloud12 Puppet on cloud12 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [20:14:53] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.87, 9.85, 9.30 [20:15:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [20:18:52] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/304f9e3c3d0f...4d190fb7f57b [20:18:53] [02miraheze/mw-config] 07Universal-Omega 034d190fb - Update Database.php [20:19:04] !log [universalomega@mwtask111] starting deploy of {'pull': 'config', 'config': True} to all [20:19:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:19:20] !log [universalomega@mwtask111] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 16s [20:19:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:20:03] miraheze/mw-config - Universal-Omega the build passed. [20:20:13] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.95, 10.42, 9.32 [20:21:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [20:21:44] !log [@test101] starting deploy of {'config': True} to all [20:21:45] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 0s [20:21:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:21:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:23:28] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.49, 3.70, 3.49 [20:24:13] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 9.31, 9.91, 9.37 [20:25:10] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.45, 1.52, 1.29 [20:26:42] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.18, 4.14, 3.36 [20:28:58] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.73, 4.36, 3.63 [20:29:09] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.14, 1.63, 1.41 [20:30:33] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.91, 3.94, 3.46 [20:32:29] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.14, 3.29, 3.28 [20:32:56] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.58, 3.51, 3.45 [20:33:14] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.21, 10.08, 9.77 [20:34:59] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/d8737ba50a3f [20:35:00] [02miraheze/mw-config] 07Universal-Omega 03d8737ba - set flow parsoid configs [20:35:02] [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-2 - 13https://github.com/miraheze/mw-config [20:35:03] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2-1 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/ecd6976db1de [20:35:05] [02miraheze/mw-config] 07Universal-Omega 03ecd6976 - set flow parsoid configs [20:35:06] [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-2-1 - 13https://github.com/miraheze/mw-config [20:35:08] [02mw-config] 07Universal-Omega opened pull request 03#4616: set flow parsoid configs - 13https://github.com/miraheze/mw-config/pull/4616 [20:35:14] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 10.04, 9.95, 9.77 [20:36:05] miraheze/mw-config - Universal-Omega the build passed. [20:36:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [20:36:54] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.40, 3.07, 3.29 [20:37:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.36, 3.70, 3.92 [20:38:20] [02mw-config] 07Universal-Omega closed pull request 03#4616: set flow parsoid configs - 13https://github.com/miraheze/mw-config/pull/4616 [20:38:22] [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-2-1 - 13https://github.com/miraheze/mw-config [20:38:23] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/4d190fb7f57b...160a4629849b [20:38:25] [02miraheze/mw-config] 07Universal-Omega 03160a462 - set flow parsoid configs (#4616) [20:38:26] [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-2-1 [20:39:27] miraheze/mw-config - Universal-Omega the build passed. [20:41:01] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.23, 3.62, 3.81 [20:41:14] RECOVERY - cloud12 Puppet on cloud12 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [20:41:19] [02dns] 07MacFan4000 opened pull request 03#268: Re-add pastport.org zone - 13https://github.com/miraheze/dns/pull/268 [20:42:00] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.36, 10.79, 9.81 [20:42:58] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.70, 3.16, 3.61 [20:43:57] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.71, 10.35, 9.77 [20:44:55] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 7.83, 4.60, 4.07 [20:45:55] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 7.87, 9.32, 9.45 [20:50:46] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.82, 3.52, 3.75 [20:51:28] !log [@test101] starting deploy of {'config': True} to all [20:51:29] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 1s [20:51:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:51:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:52:35] !log [@mwtask111] starting deploy of {'config': True} to all [20:52:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:52:45] !log [@mwtask111] finished deploy of {'config': True} to all - SUCCESS in 9s [20:52:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:54:40] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.49, 3.76, 3.76 [20:56:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [20:56:37] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.21, 3.14, 3.53 [20:58:34] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.94, 2.80, 3.36 [21:02:25] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.94, 3.68, 3.59 [21:02:28] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.06, 3.30, 2.91 [21:04:24] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.98, 3.23, 2.94 [21:04:26] [02ssl] 07AgentIsai opened pull request 03#505: Add redirects - 13https://github.com/miraheze/ssl/pull/505 [21:04:36] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.22, 1.67, 1.42 [21:05:02] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.05, 1.37, 1.94 [21:06:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [21:06:35] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.19, 1.48, 1.37 [21:10:21] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.64, 3.12, 3.37 [21:11:02] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.06, 1.22, 1.69 [21:14:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.49, 3.60, 3.49 [21:16:21] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.99, 3.05, 3.31 [21:21:02] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.68, 1.87, 1.79 [21:22:54] [02ssl] 07Universal-Omega reviewed pull request 03#505 commit - 13https://github.com/miraheze/ssl/pull/505#discussion_r854564872 [21:22:56] [02ssl] 07Universal-Omega reviewed pull request 03#505 commit - 13https://github.com/miraheze/ssl/pull/505#discussion_r854565096 [21:23:02] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.19, 1.61, 1.70 [21:25:36] [02mw-config] 07Universal-Omega deleted branch 03revert-4355-RhinosF1-patch-4 - 13https://github.com/miraheze/mw-config [21:25:37] [02miraheze/mw-config] 07Universal-Omega deleted branch 03revert-4355-RhinosF1-patch-4 [21:25:39] [02mw-config] 07Universal-Omega deleted branch 03RhinosF1-patch-1 - 13https://github.com/miraheze/mw-config [21:25:40] [02miraheze/mw-config] 07Universal-Omega deleted branch 03RhinosF1-patch-1 [21:25:42] [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-4 - 13https://github.com/miraheze/mw-config [21:25:43] [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-4 [21:25:48] [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 - 13https://github.com/miraheze/mw-config [21:25:49] [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 [21:38:01] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.23, 10.59, 9.57 [21:38:04] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.86, 1.54, 1.28 [21:39:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [21:39:56] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.34, 10.24, 9.58 [21:40:02] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.07, 1.30, 1.22 [21:41:51] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 6.75, 9.02, 9.21 [21:44:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [21:57:28] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [21:57:30] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/ee9aa631800b...cce83315bd1b [21:57:32] [02miraheze/ImportDump] 07Universal-Omega 03cce8331 - Implement comment functionality [21:57:38] alerting : [FIRING:1] (!sre High Job Queue Backlog yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [21:57:49] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.51, 3.51, 3.13 [21:58:54] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.97, 3.79, 3.06 [21:59:00] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.38, 3.68, 3.04 [21:59:46] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.62, 3.54, 3.18 [22:01:53] miraheze/ImportDump - Universal-Omega the build passed. [22:02:46] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.63, 3.90, 3.25 [22:04:57] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.59, 3.92, 3.37 [22:05:37] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.44, 4.04, 3.51 [22:07:38] alerting : [FIRING:1] (mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [22:08:33] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.64, 3.12, 3.17 [22:08:55] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.25, 3.35, 3.29 [22:09:31] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.99, 3.93, 3.62 [22:12:57] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [22:12:59] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/cce83315bd1b...5b0ccfecddda [22:13:00] [02miraheze/ImportDump] 07Universal-Omega 035b0ccfe - Implement comment saving [22:13:25] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.34, 3.03, 3.32 [22:17:20] miraheze/ImportDump - Universal-Omega the build passed. [22:17:38] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [22:25:01] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.44, 3.74, 3.49 [22:28:55] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.31, 3.69, 3.55 [22:32:49] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.44, 3.04, 3.31 [22:35:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [22:38:37] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.65, 3.44, 3.38 [22:40:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [22:40:34] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.33, 3.45, 3.37 [22:42:31] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.10, 3.29, 3.32 [22:45:53] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - dnd.bellinrattin.it All nameservers failed to answer the query. [22:52:50] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.12, 2.02, 1.55 [22:55:12] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.43, 4.04, 3.51 [22:55:31] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.09, 3.29, 2.87 [22:57:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.84, 3.22, 2.84 [22:59:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.78, 3.71, 3.53 [22:59:14] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.32, 2.93, 2.79 [22:59:29] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.92, 3.05, 2.91 [23:00:02] !log [@mwtask111] starting deploy of {'l10nupdate': True} to all [23:00:03] !log [@test101] starting deploy of {'l10nupdate': True} to all [23:00:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:00:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:00:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [23:00:43] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.40, 1.90, 1.75 [23:02:41] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.58, 1.43, 1.59 [23:08:52] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.48, 3.03, 3.27 [23:09:17] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 19.26, 7.30, 3.51 [23:10:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [23:14:45] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp21.miraheze.org - CNAME OK [23:16:37] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.46, 3.97, 3.60 [23:17:17] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.04, 3.53, 3.15 [23:18:34] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.30, 3.62, 3.51 [23:19:16] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.72, 3.20, 3.07 [23:22:04] PROBLEM - cloud11 Puppet on cloud11 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [23:22:56] !log [@mwtask111] finished deploy of {'l10nupdate': True} to all - SUCCESS in 1374s [23:23:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:24:25] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.15, 3.19, 3.33 [23:30:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.23, 3.60, 3.37 [23:30:42] [discord] can i get unlocked on phabricator? [23:32:07] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.54, 3.56, 3.23 [23:34:05] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.32, 3.73, 3.33 [23:35:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [23:36:04] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.68, 3.84, 3.42 [23:36:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.36, 3.94, 3.62 [23:40:02] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.56, 3.27, 3.28 [23:40:08] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.87, 3.42, 3.20 [23:42:04] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.60, 3.32, 3.20 [23:45:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [23:47:32] !log [@test101] finished deploy of {'l10nupdate': True} to all - SUCCESS in 2849s [23:47:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:50:04] RECOVERY - cloud11 Puppet on cloud11 is OK: OK: Puppet is currently enabled, last run 7 seconds ago with 0 failures [23:50:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.26, 4.10, 3.82 [23:52:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.96, 4.00, 3.81 [23:57:02] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.09, 1.43, 1.97 [23:58:21] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.98, 2.87, 3.36 [23:59:52] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 4.00, 3.26, 2.99