[00:00:02] [02puppet] 07Universal-Omega synchronize pull request 03#2657: Rename letsencrypt and ssl modules; create ssl-admins group - 13https://github.com/miraheze/puppet/pull/2657 [00:00:02] [url] Page not found · GitHub · GitHub | github.com [00:01:16] [02puppet] 07Universal-Omega synchronize pull request 03#2657: Rename letsencrypt and ssl modules; create ssl-admins group - 13https://github.com/miraheze/puppet/pull/2657 [00:01:16] ... [00:01:47] [02puppet] 07Universal-Omega synchronize pull request 03#2657: Rename letsencrypt and ssl modules; create ssl-admins group - 13https://github.com/miraheze/puppet/pull/2657 [00:01:47] ... [00:02:35] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.70, 1.71, 1.56 [00:02:43] [02puppet] 07Universal-Omega synchronize pull request 03#2657: Rename letsencrypt and ssl modules; create ssl-admins group - 13https://github.com/miraheze/puppet/pull/2657 [00:03:01] PROBLEM - matomo101 Current Load on matomo101 is WARNING: WARNING - load average: 3.52, 3.20, 2.80 [00:03:11] [02puppet] 07Universal-Omega synchronize pull request 03#2657: Rename letsencrypt and ssl modules; create ssl-admins group - 13https://github.com/miraheze/puppet/pull/2657 [00:03:47] [02puppet] 07Universal-Omega synchronize pull request 03#2657: Rename letsencrypt and ssl modules; create ssl-admins group - 13https://github.com/miraheze/puppet/pull/2657 [00:04:18] [02puppet] 07Universal-Omega synchronize pull request 03#2657: Rename letsencrypt and ssl modules; create ssl-admins group - 13https://github.com/miraheze/puppet/pull/2657 [00:04:18] [url] Page not found · GitHub · GitHub | github.com [00:04:57] RECOVERY - matomo101 Current Load on matomo101 is OK: OK - load average: 2.00, 2.75, 2.68 [00:06:00] [02puppet] 07Universal-Omega synchronize pull request 03#2657: Rename letsencrypt and ssl modules; create ssl-admins group - 13https://github.com/miraheze/puppet/pull/2657 [00:06:23] [02puppet] 07Universal-Omega edited pull request 03#2657: Merge letsencrypt and ssl modules; create ssl-admins group - 13https://github.com/miraheze/puppet/pull/2657 [00:06:23] [url] Page not found · GitHub · GitHub | github.com [00:06:33] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.84, 1.44, 1.50 [00:08:27] [02puppet] 07Universal-Omega synchronize pull request 03#2657: Merge letsencrypt and ssl modules; create ssl-admins group - 13https://github.com/miraheze/puppet/pull/2657 [00:08:28] [url] Page not found · GitHub · GitHub | github.com [00:09:40] [02puppet] 07Universal-Omega commented on pull request 03#2657: Merge letsencrypt and ssl modules; create ssl-admins group - 13https://github.com/miraheze/puppet/pull/2657#issuecomment-1148054635 [00:09:40] [url] Merge letsencrypt and ssl modules; create ssl-admins group by Universal-Omega · Pull Request #2657 · miraheze/puppet · GitHub | github.com [00:15:37] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk [00:32:06] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.46, 6.97, 6.31 [00:33:23] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.18, 1.86, 1.52 [00:35:19] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.83, 1.47, 1.42 [00:35:37] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk [00:36:02] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.64, 6.62, 6.35 [00:39:16] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 73, in check_records nameserversans = dns_resolver.resolve(root_domain, 'NS') File "/usr/l [00:39:17] n3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query bellinrattin.it. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [00:40:13] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.78, 1.72, 1.46 [00:42:12] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.64, 1.33, 1.35 [00:53:51] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.64, 1.76, 1.60 [00:55:47] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 5.47, 2.44, 1.83 [00:59:04] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 4.71, 2.61, 1.84 [00:59:40] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.77, 1.86, 1.72 [01:01:37] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.02, 1.61, 1.64 [01:03:02] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.79, 1.64, 1.62 [01:03:53] [02miraheze/ssl] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+1/-0/±0] 13https://github.com/miraheze/ssl/commit/aa97cb3c8198 [01:03:55] [02miraheze/ssl] 07Universal-Omega 03aa97cb3 - Re-add wiki.mastodon.kr cert [01:03:56] [02ssl] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/ssl [01:03:56] [url] Page not found · GitHub · GitHub | github.com [01:03:58] [02ssl] 07Universal-Omega opened pull request 03#544: Re-add wiki.mastodon.kr cert - 13https://github.com/miraheze/ssl/pull/544 [01:03:58] ... [01:04:31] [02miraheze/ssl] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/aa97cb3c8198...53e954f882ae [01:04:31] [url] Comparing aa97cb3c8198...53e954f882ae · miraheze/ssl · GitHub | github.com [01:04:32] [02miraheze/ssl] 07Universal-Omega 0353e954f - Update certs.yaml [01:04:34] [02ssl] 07Universal-Omega synchronize pull request 03#544: Re-add wiki.mastodon.kr cert - 13https://github.com/miraheze/ssl/pull/544 [01:04:34] [url] Page not found · GitHub · GitHub | github.com [01:04:55] [02ssl] 07Universal-Omega closed pull request 03#544: Re-add wiki.mastodon.kr cert - 13https://github.com/miraheze/ssl/pull/544 [01:04:55] ... [01:04:56] [02miraheze/ssl] 07Universal-Omega pushed 031 commit to 03master [+1/-0/±1] 13https://github.com/miraheze/ssl/compare/3055c3991a41...e0b0dcbcae7e [01:04:57] [url] Comparing 3055c3991a41...e0b0dcbcae7e · miraheze/ssl · GitHub | github.com [01:04:58] [02miraheze/ssl] 07Universal-Omega 03e0b0dcb - Re-add wiki.mastodon.kr cert (#544) [01:04:59] [02miraheze/ssl] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [01:05:01] [02ssl] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/ssl [01:05:01] [url] Page not found · GitHub · GitHub | github.com [01:08:58] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.58, 1.73, 1.68 [01:10:57] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.14, 1.53, 1.62 [01:13:39] PROBLEM - mw102 Puppet on mw102 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[nginx] [01:14:03] PROBLEM - mw121 Puppet on mw121 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[nginx] [01:19:36] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.12, 3.49, 3.94 [01:20:50] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.63, 2.35, 1.88 [01:21:36] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.53, 4.34, 4.20 [01:22:09] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.77, 1.48, 1.38 [01:22:41] PROBLEM - mw112 Puppet on mw112 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[nginx] [01:23:54] PROBLEM - cp31 Puppet on cp31 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[nginx] [01:24:09] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.04, 1.33, 1.33 [01:24:49] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.63, 1.59, 1.69 [01:25:41] PROBLEM - cp30 Puppet on cp30 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[nginx] [01:26:12] PROBLEM - mwtask111 Puppet on mwtask111 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[nginx] [01:28:20] PROBLEM - cp20 Puppet on cp20 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[nginx] [01:30:56] PROBLEM - cp21 Puppet on cp21 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 5 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[nginx] [01:31:39] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.32, 3.66, 3.97 [01:33:30] PROBLEM - mw101 Puppet on mw101 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[nginx] [01:35:44] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.85, 1.83, 1.60 [01:37:04] PROBLEM - mw122 Puppet on mw122 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[nginx] [01:37:28] PROBLEM - mw111 Puppet on mw111 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[nginx] [01:37:34] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.54, 3.96, 3.95 [01:37:42] PROBLEM - test101 Puppet on test101 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[nginx] [01:37:43] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.53, 1.33, 1.44 [01:39:32] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.90, 3.70, 3.85 [01:40:51] [02miraheze/ssl] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/e0b0dcbcae7e...641dc17ccd79 [01:40:52] [url] Comparing e0b0dcbcae7e...641dc17ccd79 · miraheze/ssl · GitHub | github.com [01:40:53] [02miraheze/ssl] 07Universal-Omega 03641dc17 - Fix [01:42:54] RECOVERY - mw121 Puppet on mw121 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [01:43:11] RECOVERY - mw102 Puppet on mw102 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [01:43:29] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.02, 4.16, 3.97 [01:50:45] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.77, 2.14, 1.69 [01:51:16] RECOVERY - mw112 Puppet on mw112 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [01:52:43] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.03, 1.73, 1.60 [01:53:03] RECOVERY - mwtask111 Puppet on mwtask111 is OK: OK: Puppet is currently enabled, last run 24 seconds ago with 0 failures [01:53:13] RECOVERY - cp30 Puppet on cp30 is OK: OK: Puppet is currently enabled, last run 32 seconds ago with 0 failures [01:53:15] RECOVERY - cp31 Puppet on cp31 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [01:54:41] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.13, 1.78, 1.62 [01:56:39] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.87, 1.40, 1.50 [01:56:51] RECOVERY - cp20 Puppet on cp20 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [01:56:55] RECOVERY - cp21 Puppet on cp21 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [01:57:18] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.52, 3.51, 3.88 [01:59:16] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.34, 3.78, 3.93 [02:00:31] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.39, 1.76, 1.47 [02:01:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.20, 3.09, 3.65 [02:02:30] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.23, 1.54, 1.42 [02:03:21] RECOVERY - mw101 Puppet on mw101 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [02:04:38] RECOVERY - test101 Puppet on test101 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [02:04:58] RECOVERY - mw122 Puppet on mw122 is OK: OK: Puppet is currently enabled, last run 39 seconds ago with 0 failures [02:05:11] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.79, 3.77, 3.77 [02:07:05] RECOVERY - mw111 Puppet on mw111 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [02:07:09] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.89, 3.68, 3.73 [02:07:19] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp21.miraheze.org - CNAME OK [02:07:26] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.73, 3.55, 3.97 [02:11:24] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.01, 3.53, 3.86 [02:13:23] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.72, 3.51, 3.81 [02:15:03] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.27, 3.61, 3.66 [02:15:22] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.12, 3.96, 3.93 [02:18:59] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.58, 3.98, 3.83 [02:20:58] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.40, 4.72, 4.10 [02:24:54] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.58, 3.68, 3.82 [02:25:18] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.92, 2.92, 1.89 [02:32:48] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.05, 3.87, 3.85 [02:33:15] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.64, 1.80, 1.88 [02:34:46] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.30, 3.67, 3.78 [02:35:14] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.58, 1.35, 1.70 [02:43:09] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.26, 3.23, 3.80 [02:44:39] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.42, 2.94, 3.38 [02:49:48] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.30, 3.38, 3.93 [02:55:05] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.63, 3.48, 3.49 [02:57:41] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.88, 3.74, 3.82 [02:59:03] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.81, 3.53, 3.49 [03:01:37] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.43, 3.39, 3.67 [03:06:59] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.96, 3.16, 3.37 [03:07:50] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.48, 6.97, 5.91 [03:09:30] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.69, 2.93, 3.36 [03:09:50] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.92, 6.45, 5.84 [03:12:55] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 4.00, 3.44, 3.38 [03:14:54] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.83, 3.10, 3.26 [03:21:16] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 6.22, 7.62, 3.86 [03:21:17] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.85, 3.38, 3.44 [03:27:12] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.26, 3.10, 3.35 [03:31:10] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.18, 3.55, 3.46 [03:33:10] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.28, 3.56, 3.48 [03:33:42] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.68, 3.72, 3.50 [03:35:10] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.59, 3.26, 3.39 [03:35:16] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 0.54, 1.03, 1.92 [03:35:41] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.83, 3.07, 3.28 [03:35:50] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.36, 7.18, 6.46 [03:39:16] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.03, 0.93, 1.66 [03:41:05] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.27, 2.21, 1.54 [03:43:05] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.89, 1.74, 1.45 [03:45:05] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.53, 1.35, 1.34 [03:49:10] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.29, 4.17, 3.55 [03:51:50] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 9.00, 7.76, 7.08 [03:53:10] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.73, 3.61, 3.48 [03:53:50] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.20, 7.32, 7.02 [03:57:10] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.41, 4.52, 3.84 [03:57:50] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.18, 6.46, 6.76 [03:58:32] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.36, 3.76, 3.31 [03:59:32] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.32, 3.82, 3.24 [04:00:31] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.03, 3.39, 3.22 [04:01:10] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.80, 3.67, 3.65 [04:03:28] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.50, 3.17, 3.10 [04:09:10] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.04, 2.87, 3.33 [04:34:23] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.41, 3.03, 2.88 [04:38:23] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.84, 2.74, 2.83 [05:02:40] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.12, 3.69, 3.27 [05:06:30] [02miraheze/RemovePII] 07Universal-Omega created branch 03REL1_37 13https://github.com/miraheze/RemovePII/commit/39af2839367c0f8840858acb27a251dbe12dadf1 [05:06:32] [02RemovePII] 07Universal-Omega created branch 03REL1_37 - 13https://github.com/miraheze/RemovePII [05:06:32] [url] Page not found · GitHub · GitHub | github.com [05:06:51] [02RemovePII] 07Universal-Omega closed pull request 03#53: Add 1.38 support - 13https://github.com/miraheze/RemovePII/pull/53 [05:06:51] [url] Page not found · GitHub · GitHub | github.com [05:06:53] [02miraheze/RemovePII] 07Universal-Omega deleted branch 031_38-support [05:06:54] [02RemovePII] 07Universal-Omega deleted branch 031_38-support - 13https://github.com/miraheze/RemovePII [05:06:54] [url] Page not found · GitHub · GitHub | github.com [05:06:56] [02miraheze/RemovePII] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±5] 13https://github.com/miraheze/RemovePII/compare/39af2839367c...2249388f56d3 [05:06:56] [url] Comparing 39af2839367c...2249388f56d3 · miraheze/RemovePII · GitHub | github.com [05:06:57] [02miraheze/RemovePII] 07Universal-Omega 032249388 - Add 1.38 support (#53) [05:07:04] [02miraheze/RemovePII] 07Universal-Omega pushed 0323 commits to 031_38-support [+1/-0/±25] 13https://github.com/miraheze/RemovePII/compare/302327ca35a4^...6bb2c5186d0c [05:07:04] [url] Comparing 302327ca35a4^...6bb2c5186d0c · miraheze/RemovePII · GitHub | github.com [05:07:05] [02miraheze/RemovePII] 07Universal-Omega 03302327c - Update extension.json [05:07:07] [02miraheze/RemovePII] 07Universal-Omega 03cc2e0cd - Update SpecialRemovePII.php [05:07:08] [02miraheze/RemovePII] 07Universal-Omega 032378bca - Update SpecialRemovePII.php [05:07:10] [02miraheze/RemovePII] ... and 20 more commits. [05:07:11] [02RemovePII] 07Universal-Omega created branch 031_38-support - 13https://github.com/miraheze/RemovePII [05:07:11] [url] Page not found · GitHub · GitHub | github.com [05:07:44] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.00, 3.15, 1.95 [05:08:34] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.16, 3.69, 3.47 [05:08:48] [02miraheze/RemovePII] 07Universal-Omega pushed 032 commits to 03Universal-Omega-patch-1 [+0/-0/±10] 13https://github.com/miraheze/RemovePII/compare/fc67b86a231d...c8cabcbab575 [05:08:49] [url] Comparing fc67b86a231d...c8cabcbab575 · miraheze/RemovePII · GitHub | github.com [05:08:50] [02miraheze/RemovePII] 07Universal-Omega 03c8cabcb - Merge branch 'master' into Universal-Omega-patch-1 [05:08:51] [02RemovePII] 07Universal-Omega synchronize pull request 03#57: Support DPA validation - 13https://github.com/miraheze/RemovePII/pull/57 [05:08:52] [url] Page not found · GitHub · GitHub | github.com [05:10:20] miraheze/RemovePII - Universal-Omega the build passed. [05:10:32] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.04, 3.15, 3.30 [05:11:40] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 0.66, 1.82, 1.67 [05:12:12] miraheze/RemovePII - Universal-Omega the build passed. [05:13:38] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.50, 1.40, 1.53 [05:16:55] PROBLEM - test101 APT on test101 is WARNING: APT WARNING: 0 packages available for upgrade (0 critical updates). warnings detected, errors detected. [05:18:23] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.84, 3.22, 2.87 [05:18:23] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.77, 3.79, 3.50 [05:18:23] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.24, 3.54, 3.08 [05:19:00] PROBLEM - test101 APT on test101 is CRITICAL: APT CRITICAL: 7 packages available for upgrade (6 critical updates). [05:20:23] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.83, 3.09, 2.87 [05:20:23] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.98, 3.41, 3.09 [05:22:23] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.02, 3.23, 3.06 [05:26:16] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.77, 3.02, 3.27 [05:28:23] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.97, 3.57, 3.18 [05:30:23] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.82, 3.98, 3.37 [05:32:23] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.40, 3.22, 3.16 [05:39:50] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.19, 7.05, 6.43 [05:41:50] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.30, 7.22, 6.55 [05:43:50] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.60, 6.41, 6.33 [05:43:56] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.59, 3.48, 3.44 [05:45:54] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.85, 3.24, 3.35 [05:57:56] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.07, 4.25, 3.22 [05:58:23] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 7.23, 5.08, 3.78 [05:58:40] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 7.53, 5.79, 4.30 [06:03:51] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.05, 3.70, 3.34 [06:05:50] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 7.25, 5.10, 3.90 [06:11:45] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.14, 3.98, 3.79 [06:14:23] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.23, 3.75, 3.98 [06:18:23] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.39, 3.94, 3.96 [06:19:38] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.02, 3.64, 3.62 [06:21:37] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.50, 3.32, 3.51 [06:22:23] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.01, 3.70, 3.90 [06:25:34] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.95, 3.08, 3.37 [06:29:29] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.67, 3.40, 3.43 [06:31:27] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.41, 3.92, 3.63 [06:32:41] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.83, 7.25, 6.22 [06:34:23] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.52, 3.74, 3.75 [06:34:37] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.40, 6.76, 6.18 [06:41:19] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.71, 3.94, 3.87 [06:43:17] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.34, 4.52, 4.09 [06:44:20] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.60, 7.41, 6.57 [06:45:16] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.57, 3.70, 3.83 [06:47:14] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.10, 3.88, 3.88 [06:50:08] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 6.61, 6.73, 6.53 [06:53:09] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.55, 3.66, 3.79 [06:55:08] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.28, 4.11, 3.93 [06:56:23] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.18, 3.67, 3.97 [06:57:06] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.39, 3.79, 3.83 [07:02:23] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.11, 3.63, 3.85 [07:03:41] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.67, 3.26, 3.99 [07:03:50] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.56, 7.06, 6.57 [07:04:23] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.68, 3.52, 3.78 [07:05:00] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.81, 2.92, 3.37 [07:07:50] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 9.47, 7.69, 6.90 [07:09:50] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.96, 7.47, 6.93 [07:10:23] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.31, 2.83, 3.39 [07:13:32] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.73, 2.74, 3.35 [07:13:50] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.93, 6.53, 6.66 [07:17:27] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.62, 4.28, 3.81 [07:19:25] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.21, 3.79, 3.69 [07:21:24] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.27, 4.27, 3.87 [07:22:41] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.91, 3.62, 3.29 [07:24:23] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.04, 3.66, 3.42 [07:24:36] PROBLEM - www.lab612.at - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 73, in check_records nameserversans = dns_resolver.resolve(root_domain, 'NS') File "/usr/lib/pyt [07:24:36] t-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query lab612.at. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [07:24:40] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.76, 3.27, 3.20 [07:28:23] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.38, 3.70, 3.55 [07:31:14] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.60, 3.95, 3.91 [07:32:23] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.59, 3.17, 3.37 [07:39:10] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.91, 2.65, 3.32 [07:44:23] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.96, 3.58, 3.37 [07:46:23] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.10, 3.35, 3.30 [07:47:10] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.10, 3.59, 3.56 [07:49:10] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.03, 3.70, 3.60 [07:51:10] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.60, 3.24, 3.44 [07:53:45] RECOVERY - www.lab612.at - reverse DNS on sslhost is OK: SSL OK - www.lab612.at reverse DNS resolves to cp20.miraheze.org - CNAME OK [07:54:23] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.74, 3.76, 3.48 [07:57:10] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.78, 3.82, 3.61 [07:59:10] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.58, 3.32, 3.46 [08:01:10] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.16, 3.75, 3.60 [08:04:23] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.02, 4.23, 3.75 [08:05:01] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.88, 3.50, 3.25 [08:08:24] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.50, 3.55, 3.56 [08:08:58] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.84, 3.05, 3.12 [08:11:10] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.32, 3.86, 3.79 [08:14:23] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.61, 2.62, 3.18 [08:15:10] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.03, 3.35, 3.54 [08:17:10] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.46, 3.56, 3.61 [08:19:16] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.89, 1.70, 1.07 [08:21:16] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.82, 1.36, 1.02 [08:23:10] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.68, 2.58, 3.18 [08:28:23] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.54, 3.35, 3.21 [08:30:23] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.16, 3.39, 3.25 [08:57:28] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.19, 2.08, 1.67 [08:57:43] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.57, 3.33, 2.96 [08:59:42] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.68, 3.07, 2.91 [09:01:16] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.66, 1.98, 1.73 [09:05:12] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.76, 1.48, 1.60 [09:18:24] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.18, 3.51, 3.25 [09:20:23] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.01, 4.10, 3.49 [09:21:54] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.43, 3.00, 2.63 [09:22:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.74, 3.66, 3.40 [09:23:53] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.27, 2.72, 2.57 [09:24:12] PROBLEM - arrieretoile.fr - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 73, in check_records nameserversans = dns_resolver.resolve(root_domain, 'NS') File "/usr/lib/p [09:24:12] ist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query arrieretoile.fr. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [09:24:19] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.50, 3.23, 3.27 [09:26:00] PROBLEM - wiki.lefrenchmelee.fr - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.lefrenchmelee.fr All nameservers failed to answer the query. [09:30:59] PROBLEM - wiki.controlistes.fr - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.controlistes.fr All nameservers failed to answer the query. [09:52:52] RECOVERY - arrieretoile.fr - reverse DNS on sslhost is OK: SSL OK - arrieretoile.fr reverse DNS resolves to cp20.miraheze.org - NS RECORDS OK [09:55:31] PROBLEM - wiki.lefrenchmelee.fr - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 73, in check_records nameserversans = dns_resolver.resolve(root_domain, 'NS') File "/usr [09:55:31] hon3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query lefrenchmelee.fr. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [09:57:56] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.39, 1.78, 1.46 [09:59:50] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.11, 1.47, 1.38 [10:00:04] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.10, 3.27, 2.75 [10:02:03] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.04, 3.12, 2.76 [10:11:34] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.18, 3.71, 3.24 [10:11:57] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.47, 3.96, 3.31 [10:13:32] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.80, 3.68, 3.29 [10:13:56] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.92, 3.54, 3.23 [10:15:30] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.25, 3.99, 3.45 [10:17:54] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.60, 3.22, 3.19 [10:19:27] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.44, 3.28, 3.29 [10:20:41] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.98, 6.87, 6.00 [10:22:37] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.54, 6.17, 5.83 [10:25:03] PROBLEM - wiki.lefrenchmelee.fr - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.lefrenchmelee.fr All nameservers failed to answer the query. [10:27:18] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.45, 3.40, 3.30 [10:27:48] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.73, 3.61, 3.26 [10:27:55] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.38, 3.53, 3.11 [10:28:00] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.80, 1.55, 1.20 [10:28:37] RECOVERY - wiki.controlistes.fr - reverse DNS on sslhost is OK: SSL OK - wiki.controlistes.fr reverse DNS resolves to cp21.miraheze.org - CNAME OK [10:29:55] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 1.13, 1.51, 1.23 [10:30:36] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.58, 1.95, 1.57 [10:31:14] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.11, 3.24, 3.30 [10:31:46] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.61, 3.38, 3.28 [10:31:52] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.52, 3.27, 3.13 [10:32:30] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.83, 1.93, 1.62 [10:34:24] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 3.26, 2.11, 1.70 [10:36:18] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.37, 1.79, 1.63 [10:37:10] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.90, 3.52, 3.41 [10:38:13] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.38, 1.84, 1.66 [10:39:10] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.55, 3.14, 3.28 [10:40:11] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.20, 1.64, 1.61 [10:45:10] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.24, 3.48, 3.41 [10:48:45] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.79, 1.83, 1.70 [10:49:10] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.70, 4.04, 3.62 [10:50:40] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.87, 2.16, 1.83 [10:51:10] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.05, 3.56, 3.49 [10:54:34] RECOVERY - wiki.lefrenchmelee.fr - reverse DNS on sslhost is OK: SSL OK - wiki.lefrenchmelee.fr reverse DNS resolves to cp21.miraheze.org - CNAME OK [11:03:10] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.17, 3.22, 3.37 [11:07:48] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 0.58, 1.51, 1.84 [11:17:20] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 4.20, 2.27, 2.00 [11:27:13] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.35, 1.86, 1.95 [11:33:12] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.08, 1.38, 1.70 [11:47:12] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 1.68, 2.85, 2.19 [11:52:23] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.78, 3.40, 3.02 [11:52:32] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.77, 3.80, 3.27 [11:53:13] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 0.75, 1.67, 1.88 [11:54:23] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.92, 3.28, 3.03 [11:56:29] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.48, 3.36, 3.23 [12:01:12] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 4.34, 2.42, 2.07 [12:05:12] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.05, 1.88, 1.94 [12:10:45] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.39, 7.16, 6.27 [12:11:12] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.32, 1.83, 1.86 [12:13:12] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.96, 1.82, 1.85 [12:13:31] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.98, 3.99, 3.11 [12:16:23] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.27, 3.56, 3.24 [12:16:33] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 9.85, 7.79, 6.72 [12:17:10] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 3.94, 4.55, 3.80 [12:17:12] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.41, 2.00, 1.91 [12:17:28] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.30, 3.79, 3.25 [12:18:23] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.93, 3.40, 3.22 [12:19:10] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.84, 3.93, 3.67 [12:19:12] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.73, 1.97, 1.91 [12:19:26] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.46, 3.38, 3.17 [12:25:10] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.38, 4.10, 3.77 [12:27:10] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.35, 3.33, 3.52 [12:29:12] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.89, 1.29, 1.63 [12:30:06] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.72, 7.94, 7.87 [12:32:02] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 7.88, 8.07, 7.93 [12:33:10] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.62, 3.55, 3.51 [12:33:58] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.08, 7.56, 7.76 [12:35:10] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.85, 3.29, 3.42 [12:39:50] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.08, 6.95, 7.35 [12:41:11] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.71, 4.15, 3.73 [12:41:50] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.45, 6.91, 7.30 [12:42:23] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.35, 3.53, 3.19 [12:46:23] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.42, 3.17, 3.15 [12:47:10] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.36, 3.51, 3.63 [12:47:50] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.58, 6.05, 6.78 [12:49:10] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.25, 3.91, 3.77 [12:53:10] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.32, 3.48, 3.62 [12:54:23] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.14, 3.42, 3.27 [12:56:23] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.24, 2.95, 3.12 [12:57:10] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.15, 2.96, 3.39 [13:06:02] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.14, 1.87, 1.38 [13:08:01] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.02, 1.63, 1.35 [13:11:10] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.41, 3.57, 3.46 [13:13:10] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.75, 3.83, 3.55 [13:15:16] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.52, 1.83, 1.49 [13:16:23] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.93, 3.72, 3.40 [13:17:12] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.14, 1.59, 1.44 [13:17:20] PROBLEM - wiki.thesohnlandgov.info - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.thesohnlandgov.info could not be found [13:17:32] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.66, 3.61, 3.17 [13:19:30] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.53, 3.40, 3.16 [13:22:23] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.25, 3.92, 3.59 [13:27:22] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.34, 4.46, 3.60 [13:41:11] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.49, 3.64, 3.77 [13:43:09] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.16, 3.92, 3.84 [13:43:50] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.87, 6.77, 6.22 [13:45:08] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.88, 3.81, 3.81 [13:45:50] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 6.64, 6.66, 6.25 [13:53:01] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.60, 2.68, 3.25 [13:54:23] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.54, 3.43, 3.96 [13:56:36] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.71, 1.55, 1.38 [13:58:23] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.20, 4.06, 4.08 [14:00:23] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.04, 3.62, 3.91 [14:00:24] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.61, 1.62, 1.45 [14:00:53] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.00, 3.51, 3.42 [14:01:28] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.96, 6.77, 6.49 [14:02:51] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.00, 3.24, 3.33 [14:03:48] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 86, in check_records cname = str(dns_resolver.resolve(hostname, 'CNAME')[0]) File "/usr/li [14:03:48] 3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query dnd.bellinrattin.it. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [14:08:02] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.18, 1.82, 1.59 [14:09:13] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 6.27, 6.49, 6.51 [14:09:56] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.83, 1.43, 1.47 [14:12:23] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.27, 3.69, 3.78 [14:14:23] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.54, 3.65, 3.75 [14:16:23] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.31, 3.97, 3.85 [14:18:23] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.97, 3.87, 3.83 [14:18:55] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.64, 6.80, 6.43 [14:20:51] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.33, 7.35, 6.68 [14:22:23] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.86, 4.03, 3.89 [14:22:48] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.31, 6.81, 6.55 [14:24:23] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.66, 3.83, 3.82 [14:24:44] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 4.88, 6.08, 6.31 [14:28:23] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.11, 3.83, 3.81 [14:32:56] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp21.miraheze.org - CNAME OK [14:34:23] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.27, 3.74, 3.81 [14:39:10] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.11, 3.29, 3.91 [14:44:23] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.04, 2.95, 3.32 [14:45:10] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.56, 3.96, 3.93 [14:49:10] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.08, 3.80, 3.89 [14:57:34] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.28, 1.75, 1.41 [14:59:10] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.71, 4.10, 3.86 [14:59:25] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 3.95, 4.03, 3.64 [14:59:28] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.44, 1.61, 1.40 [15:01:24] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.91, 3.75, 3.59 [15:02:33] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.66, 6.95, 6.02 [15:04:29] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 6.57, 6.69, 6.03 [15:07:48] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.62, 3.45, 3.02 [15:09:08] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.03, 1.80, 1.40 [15:09:46] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.69, 3.47, 3.08 [15:11:07] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.19, 1.53, 1.34 [15:11:44] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.33, 3.07, 2.98 [15:13:10] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.48, 3.77, 3.94 [15:13:18] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.52, 3.15, 3.38 [15:15:10] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.21, 4.00, 3.98 [15:17:10] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.98, 3.59, 3.84 [15:22:35] [02miraheze/ssl] 07MacFan4000 pushed 031 commit to 03MacFan4000-patch-1 [+1/-0/±0] 13https://github.com/miraheze/ssl/commit/14273f4a4244 [15:22:37] [02miraheze/ssl] 07MacFan4000 0314273f4 - add www.dovearchives.wiki [15:22:38] [02ssl] 07MacFan4000 created branch 03MacFan4000-patch-1 - 13https://github.com/miraheze/ssl [15:22:39] [url] Page not found · GitHub · GitHub | github.com [15:22:42] [02ssl] 07MacFan4000 opened pull request 03#545: add www.dovearchives.wiki - 13https://github.com/miraheze/ssl/pull/545 [15:22:42] ... [15:24:22] [02miraheze/ssl] 07MacFan4000 pushed 031 commit to 03MacFan4000-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/14273f4a4244...6866f9707812 [15:24:22] [url] Comparing 14273f4a4244...6866f9707812 · miraheze/ssl · GitHub | github.com [15:24:24] [02miraheze/ssl] 07MacFan4000 036866f97 - Update certs.yaml [15:24:25] [02ssl] 07MacFan4000 synchronize pull request 03#545: add www.dovearchives.wiki - 13https://github.com/miraheze/ssl/pull/545 [15:24:25] [url] Page not found · GitHub · GitHub | github.com [15:24:45] [02ssl] 07MacFan4000 closed pull request 03#545: add www.dovearchives.wiki - 13https://github.com/miraheze/ssl/pull/545 [15:24:45] [url] Page not found · GitHub · GitHub | github.com [15:24:46] [02miraheze/ssl] 07MacFan4000 pushed 031 commit to 03master [+1/-0/±1] 13https://github.com/miraheze/ssl/compare/641dc17ccd79...bfa4a03260a9 [15:24:46] [url] Comparing 641dc17ccd79...bfa4a03260a9 · miraheze/ssl · GitHub | github.com [15:24:48] [02miraheze/ssl] 07MacFan4000 03bfa4a03 - add www.dovearchives.wiki (#545) [15:24:49] [02miraheze/ssl] 07MacFan4000 deleted branch 03MacFan4000-patch-1 [15:24:51] [02ssl] 07MacFan4000 deleted branch 03MacFan4000-patch-1 - 13https://github.com/miraheze/ssl [15:24:51] [url] Page not found · GitHub · GitHub | github.com [15:25:57] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.26, 1.79, 1.45 [15:27:10] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.42, 2.94, 3.37 [15:29:28] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.42, 3.10, 2.88 [15:31:09] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.60, 3.39, 3.21 [15:31:10] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.50, 3.58, 3.58 [15:31:26] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.16, 3.18, 2.92 [15:31:39] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.32, 1.87, 1.62 [15:33:08] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.04, 3.48, 3.25 [15:35:07] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.07, 2.88, 3.06 [15:35:13] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 73, in check_records nameserversans = dns_resolver.resolve(root_domain, 'NS') File "/usr/l [15:35:13] n3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query bellinrattin.it. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [15:35:23] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.81, 2.92, 2.87 [15:37:11] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.19, 3.06, 3.39 [15:37:22] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.13, 1.65, 1.63 [15:41:10] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.79, 3.26, 3.42 [15:41:37] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 2.37, 1.55, 1.23 [15:43:37] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.74, 1.47, 1.24 [15:44:23] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.72, 6.83, 6.54 [15:45:12] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.02, 1.79, 1.66 [15:45:37] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 1.06, 1.39, 1.24 [15:46:19] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.26, 7.14, 6.68 [15:47:12] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.43, 1.61, 1.61 [15:48:16] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.84, 7.42, 6.84 [15:49:11] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.50, 3.77, 3.57 [15:50:12] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.69, 7.97, 7.11 [15:51:10] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.57, 3.60, 3.53 [15:52:01] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.39, 4.18, 3.55 [15:52:08] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.57, 7.78, 7.17 [15:53:10] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.90, 4.33, 3.82 [15:55:05] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.40, 3.73, 3.29 [15:55:59] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.04, 3.89, 3.61 [15:56:00] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.11, 6.46, 6.78 [15:56:53] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.34, 1.94, 1.74 [15:57:03] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.32, 3.20, 3.14 [15:57:58] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.50, 4.03, 3.68 [16:00:56] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.29, 1.67, 1.67 [16:01:29] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.76, 6.70, 6.82 [16:03:00] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.19, 3.72, 3.45 [16:03:25] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 6.30, 6.52, 6.74 [16:04:56] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.34, 3.82, 3.51 [16:05:03] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.79, 3.85, 3.83 [16:06:52] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.93, 3.77, 3.52 [16:07:15] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.43, 10.39, 8.76 [16:08:48] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.85, 4.16, 3.69 [16:09:03] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.65, 4.20, 3.97 [16:09:09] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.50, 9.85, 8.76 [16:10:43] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.83, 3.83, 3.64 [16:16:31] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.34, 3.10, 3.40 [16:20:24] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.76, 3.52, 3.52 [16:20:33] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.87, 1.40, 1.15 [16:22:20] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.40, 3.86, 3.64 [16:22:29] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.25, 1.28, 1.13 [16:24:16] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.12, 3.62, 3.58 [16:30:08] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.21, 3.90, 3.72 [16:32:08] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.85, 3.91, 3.74 [16:35:03] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.02, 3.63, 3.96 [16:40:08] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.48, 3.61, 3.57 [16:41:08] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.15, 4.00, 3.96 [16:42:08] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.97, 3.24, 3.43 [16:43:03] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.48, 3.67, 3.83 [16:44:08] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.58, 3.02, 3.33 [16:49:03] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.21, 4.37, 4.02 [16:50:08] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.92, 4.15, 3.71 [16:52:08] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.67, 3.54, 3.54 [16:54:08] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.35, 4.01, 3.69 [16:57:34] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.12, 1.93, 1.54 [16:58:08] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.46, 3.98, 3.78 [17:01:29] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.37, 1.89, 1.64 [17:02:12] [Grafana] !sre FIRING: There has been a rise in the MediaWiki exception rate https://grafana.miraheze.org/d/GtxbP1Xnk [17:03:03] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.22, 3.70, 3.97 [17:03:28] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp20.miraheze.org - CNAME OK [17:03:30] ^ CosmicAlpha RhinosF1 hmm, grafana is saying "Error updating options: Service Unavailable" [17:03:46] PROBLEM - prometheus101 Current Load on prometheus101 is CRITICAL: CRITICAL - load average: 2.49, 2.16, 1.22 [17:04:01] Reception123: that means it went down half way through loading [17:04:09] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.65, 3.79, 3.70 [17:05:07] hmm, appears to be fine now [17:05:24] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.11, 1.55, 1.56 [17:06:08] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.09, 3.40, 3.56 [17:07:03] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 3.60, 4.08, 4.09 [17:07:12] [Grafana] !sre RESOLVED: MediaWiki Exception Rate https://grafana.miraheze.org/d/GtxbP1Xnk [17:07:46] RECOVERY - prometheus101 Current Load on prometheus101 is OK: OK - load average: 0.52, 1.46, 1.16 [17:09:03] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.68, 3.68, 3.94 [17:10:08] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.03, 3.68, 3.62 [17:12:08] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.78, 3.38, 3.52 [17:16:08] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.32, 2.95, 3.31 [17:25:03] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.70, 2.96, 3.35 [17:25:31] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.40, 3.18, 3.92 [17:27:31] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.24, 3.62, 4.00 [17:27:57] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.85, 1.84, 1.65 [17:28:21] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.25, 9.47, 8.12 [17:28:50] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.09, 7.90, 6.74 [17:29:03] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.45, 3.36, 3.41 [17:30:16] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 6.97, 8.66, 7.99 [17:30:46] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.07, 7.19, 6.61 [17:31:05] PROBLEM - test101 MediaWiki Rendering on test101 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:31:31] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.55, 3.56, 3.92 [17:31:52] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.28, 2.08, 1.80 [17:33:49] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.85, 1.98, 1.80 [17:35:03] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.85, 3.09, 3.30 [17:35:19] RECOVERY - test101 MediaWiki Rendering on test101 is OK: HTTP OK: HTTP/1.1 200 OK - 32538 bytes in 4.732 second response time [17:35:47] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.42, 2.04, 1.84 [17:36:35] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.46, 6.40, 6.48 [17:37:45] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.73, 1.97, 1.84 [17:43:31] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.35, 3.87, 3.69 [17:45:03] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.33, 4.10, 3.53 [17:45:35] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.15, 1.54, 1.68 [17:50:08] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.45, 3.85, 3.40 [17:52:08] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.47, 4.37, 3.66 [17:52:36] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.31, 1.89, 1.46 [17:54:08] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.75, 3.73, 3.52 [17:54:32] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.47, 1.45, 1.35 [17:58:03] PROBLEM - test101 MediaWiki Rendering on test101 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:58:08] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.26, 3.61, 3.49 [18:00:06] RECOVERY - test101 MediaWiki Rendering on test101 is OK: HTTP OK: HTTP/1.1 200 OK - 32538 bytes in 3.674 second response time [18:01:50] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.59, 6.60, 6.14 [18:02:37] PROBLEM - test101 JobRunner Service on test101 is CRITICAL: PROCS CRITICAL: 0 processes with args 'redisJobRunnerService' [18:03:46] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 6.56, 6.62, 6.21 [18:04:15] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.71, 1.81, 1.48 [18:08:08] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.84, 1.69, 1.50 [18:10:08] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.08, 1.56, 1.48 [18:11:37] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_38 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/0cf69dca1584...3e464eac4c61 [18:11:37] [url] Comparing 0cf69dca1584...3e464eac4c61 · miraheze/mediawiki · GitHub | github.com [18:11:38] [02miraheze/mediawiki] 07Universal-Omega 033e464ea - Update HitCounters [18:11:58] !log [universalomega@test101] starting deploy of {'world': True} to all [18:12:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:15:49] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_38 [+0/-0/±2] 13https://github.com/miraheze/mediawiki/compare/3e464eac4c61...b29f7d1563ba [18:15:50] [url] Comparing 3e464eac4c61...b29f7d1563ba · miraheze/mediawiki · GitHub | github.com [18:15:51] [02miraheze/mediawiki] 07Universal-Omega 03b29f7d1 - Switch RemovePII to master [18:16:47] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_38 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/b29f7d1563ba...4d74bfe99744 [18:16:47] [url] Comparing b29f7d1563ba...4d74bfe99744 · miraheze/mediawiki · GitHub | github.com [18:16:49] [02miraheze/mediawiki] 07Universal-Omega 034d74bfe - Update .branches.json [18:19:12] !log [universalomega@test101] finished deploy of {'world': True} to all - SUCCESS in 434s [18:19:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:28:20] RECOVERY - test101 JobRunner Service on test101 is OK: PROCS OK: 1 process with args 'redisJobRunnerService' [18:35:04] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.06, 1.82, 1.53 [18:37:04] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.30, 1.60, 1.49 [18:46:08] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.77, 3.54, 3.99 [18:50:08] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.43, 3.95, 4.04 [18:52:08] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.24, 3.45, 3.86 [18:56:08] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.52, 3.75, 3.87 [19:00:08] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.27, 3.75, 3.86 [19:00:08] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.77, 7.49, 6.61 [19:00:52] PROBLEM - test101 MediaWiki Rendering on test101 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:02:08] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.26, 7.19, 6.62 [19:05:10] PROBLEM - cp30 Stunnel HTTP for test101 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:05:38] PROBLEM - cp31 Stunnel HTTP for test101 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:05:43] PROBLEM - cp21 Stunnel HTTP for test101 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:06:08] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 6.28, 6.64, 6.52 [19:06:51] PROBLEM - cp20 Stunnel HTTP for test101 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:07:03] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.88, 3.31, 3.97 [19:07:16] RECOVERY - cp30 Stunnel HTTP for test101 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15895 bytes in 9.076 second response time [19:07:46] RECOVERY - cp31 Stunnel HTTP for test101 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15895 bytes in 9.117 second response time [19:07:47] RECOVERY - cp21 Stunnel HTTP for test101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15895 bytes in 3.855 second response time [19:07:57] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.11, 2.00, 1.60 [19:08:08] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.01, 4.08, 3.89 [19:08:48] RECOVERY - cp20 Stunnel HTTP for test101 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15895 bytes in 0.056 second response time [19:09:03] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.36, 4.34, 4.28 [19:09:54] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.90, 1.97, 1.63 [19:13:40] RECOVERY - test101 MediaWiki Rendering on test101 is OK: HTTP OK: HTTP/1.1 200 OK - 32292 bytes in 2.606 second response time [19:14:08] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.48, 3.89, 3.94 [19:14:08] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.26, 7.36, 6.81 [19:15:47] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.33, 1.67, 1.61 [19:16:08] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.18, 3.79, 3.88 [19:16:08] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.14, 7.23, 6.85 [19:17:08] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.08, 2.02, 1.44 [19:18:08] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.69, 3.43, 3.75 [19:19:04] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.67, 1.52, 1.33 [19:19:40] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.73, 1.74, 1.65 [19:20:08] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.92, 4.12, 3.94 [19:20:08] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.32, 6.76, 6.80 [19:22:59] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.63, 1.72, 1.45 [19:24:55] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.08, 1.50, 1.41 [19:25:33] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.50, 2.18, 1.87 [19:27:36] !log stop redis and jobrunner on test101 temporarily. [19:27:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:29:28] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.68, 1.90, 1.82 [19:29:31] PROBLEM - test101 Puppet on test101 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 25 minutes ago with 0 failures [19:29:41] PROBLEM - test101 JobRunner Service on test101 is CRITICAL: PROCS CRITICAL: 0 processes with args 'redisJobRunnerService' [19:29:57] PROBLEM - test101 JobChron Service on test101 is CRITICAL: PROCS CRITICAL: 0 processes with args 'redisJobChronService' [19:30:08] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.45, 3.83, 3.97 [19:30:27] PROBLEM - test101 Redis Process on test101 is CRITICAL: PROCS CRITICAL: 0 processes with args 'redis-server' [19:31:25] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 3.04, 2.32, 1.98 [19:31:57] RECOVERY - test101 JobChron Service on test101 is OK: PROCS OK: 1 process with args 'redisJobChronService' [19:32:27] RECOVERY - test101 Redis Process on test101 is OK: PROCS OK: 1 process with args 'redis-server' [19:33:23] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.57, 1.91, 1.86 [19:34:08] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.96, 6.55, 6.51 [19:36:08] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.81, 4.05, 4.00 [19:36:08] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.15, 6.13, 6.37 [19:36:13] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.88, 1.70, 1.36 [19:37:14] [02miraheze/.github] 07dependabot[bot] pushed 031 commit to 03dependabot/github_actions/workflow-templates/actions/cache-3.0.4 [+0/-0/±1] 13https://github.com/miraheze/.github/commit/e8bc1dedf29c [19:37:16] [02miraheze/.github] 07dependabot[bot] 03e8bc1de - Bump actions/cache from 3.0.3 to 3.0.4 in /workflow-templates [19:37:17] [02.github] 07dependabot[bot] created branch 03dependabot/github_actions/workflow-templates/actions/cache-3.0.4 - 13https://github.com/miraheze/.github [19:37:19] [02.github] 07dependabot[bot] opened pull request 03#11: Bump actions/cache from 3.0.3 to 3.0.4 in /workflow-templates - 13https://github.com/miraheze/.github/pull/11 [19:37:19] [url] Page not found · GitHub · GitHub | github.com [19:37:20] [02.github] 07dependabot[bot] labeled pull request 03#11: Bump actions/cache from 3.0.3 to 3.0.4 in /workflow-templates - 13https://github.com/miraheze/.github/pull/11 [19:37:21] [url] Page not found · GitHub · GitHub | github.com [19:38:12] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.36, 1.64, 1.38 [19:39:16] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.14, 1.46, 1.69 [19:40:08] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.20, 3.72, 3.87 [19:40:20] [02miraheze/.github] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/.github/compare/df9b876461e7...652efd40febf [19:40:20] [url] Comparing df9b876461e7...652efd40febf · miraheze/.github · GitHub | github.com [19:40:21] [02miraheze/.github] 07Universal-Omega 03652efd4 - Globally enable 1.38 CI [19:40:41] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/fcda4e5447b0...0339d84064ba [19:40:41] [url] Comparing fcda4e5447b0...0339d84064ba · miraheze/CreateWiki · GitHub | github.com [19:40:42] [02miraheze/CreateWiki] 07Universal-Omega 030339d84 - Update workflow [19:40:44] [02miraheze/MatomoAnalytics] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/MatomoAnalytics/compare/1264123b9ed2...dbb8507193e3 [19:40:44] [url] Comparing 1264123b9ed2...dbb8507193e3 · miraheze/MatomoAnalytics · GitHub | github.com [19:40:45] [02miraheze/MatomoAnalytics] 07Universal-Omega 03dbb8507 - Update workflow [19:40:46] [02miraheze/YouTube] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/YouTube/compare/c1cfc2c8a954...95d69a9b8f94 [19:40:47] [url] Comparing c1cfc2c8a954...95d69a9b8f94 · miraheze/YouTube · GitHub | github.com [19:40:48] [02miraheze/YouTube] 07Universal-Omega 0395d69a9 - Update workflow [19:40:49] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/8f32cba4f9b7...0c48559e5982 [19:40:50] [url] Comparing 8f32cba4f9b7...0c48559e5982 · miraheze/ManageWiki · GitHub | github.com [19:40:51] [02miraheze/ManageWiki] 07Universal-Omega 030c48559 - Update workflow [19:40:52] [02miraheze/WikiDiscover] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/WikiDiscover/compare/cb3b1571130f...8392a9e2492f [19:40:53] [url] Comparing cb3b1571130f...8392a9e2492f · miraheze/WikiDiscover · GitHub | github.com [19:40:54] [02miraheze/WikiDiscover] 07Universal-Omega 038392a9e - Update workflow [19:40:55] [02miraheze/DataDump] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/DataDump/compare/a5879075ae79...dbaadff472c6 [19:40:56] [url] Comparing a5879075ae79...dbaadff472c6 · miraheze/DataDump · GitHub | github.com [19:40:57] [02miraheze/DataDump] 07Universal-Omega 03dbaadff - Update workflow [19:40:58] [02miraheze/GlobalNewFiles] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/GlobalNewFiles/compare/35e7c4f4fcab...1dcd6f9fd6f2 [19:40:59] [url] Comparing 35e7c4f4fcab...1dcd6f9fd6f2 · miraheze/GlobalNewFiles · GitHub | github.com [19:41:00] [02miraheze/GlobalNewFiles] 07Universal-Omega 031dcd6f9 - Update workflow [19:41:02] [02miraheze/CustomHeader] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/CustomHeader/compare/af912f52ebd5...011f3c861220 [19:41:02] [url] Comparing af912f52ebd5...011f3c861220 · miraheze/CustomHeader · GitHub | github.com [19:41:03] [02miraheze/CustomHeader] 07Universal-Omega 03011f3c8 - Update workflow [19:41:04] [02miraheze/RottenLinks] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/RottenLinks/compare/4b51d7e74391...21fa491d1000 [19:41:05] [url] Comparing 4b51d7e74391...21fa491d1000 · miraheze/RottenLinks · GitHub | github.com [19:41:06] [02miraheze/RottenLinks] 07Universal-Omega 0321fa491 - Update workflow [19:41:08] [02miraheze/PDFEmbed] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/PDFEmbed/compare/43b8b461502c...3d699c9e25e3 [19:41:08] [url] Comparing 43b8b461502c...3d699c9e25e3 · miraheze/PDFEmbed · GitHub | github.com [19:41:09] [02miraheze/PDFEmbed] 07Universal-Omega 033d699c9 - Update workflow [19:41:10] [02miraheze/RemovePII] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/RemovePII/compare/2249388f56d3...9c647bb6ec74 [19:41:11] [url] Comparing 2249388f56d3...9c647bb6ec74 · miraheze/RemovePII · GitHub | github.com [19:41:12] [02miraheze/RemovePII] 07Universal-Omega 039c647bb - Update workflow [19:41:14] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/ef6e9de5f7dc...4ba63150dcec [19:41:14] [url] Comparing ef6e9de5f7dc...4ba63150dcec · miraheze/MirahezeMagic · GitHub | github.com [19:41:15] [02miraheze/MirahezeMagic] 07Universal-Omega 034ba6315 - Update workflow [19:41:16] [02miraheze/SpriteSheet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/SpriteSheet/compare/7933643b42c2...a66b693533be [19:41:17] [url] Comparing 7933643b42c2...a66b693533be · miraheze/SpriteSheet · GitHub | github.com [19:41:18] [02miraheze/SpriteSheet] 07Universal-Omega 03a66b693 - Update workflow [19:41:19] [02miraheze/IncidentReporting] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/IncidentReporting/compare/4d8930dba349...1a8ff9923dbb [19:41:20] [url] Comparing 4d8930dba349...1a8ff9923dbb · miraheze/IncidentReporting · GitHub | github.com [19:41:21] [02miraheze/IncidentReporting] 07Universal-Omega 031a8ff99 - Update workflow [19:44:26] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/0339d84064ba...b7a46f3d131c [19:44:27] [url] Comparing 0339d84064ba...b7a46f3d131c · miraheze/CreateWiki · GitHub | github.com [19:44:28] [02miraheze/CreateWiki] 07Universal-Omega 03b7a46f3 - remove unused phan suppression [19:45:18] miraheze/CreateWiki - Universal-Omega the build has errored. [19:46:08] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.14, 3.99, 3.95 [19:48:45] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/commit/ede4b8ad43e8 [19:48:47] [02miraheze/ManageWiki] 07Universal-Omega 03ede4b8a - Make addModuleStyles an array [19:48:48] [02ManageWiki] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/ManageWiki [19:48:49] [url] Page not found · GitHub · GitHub | github.com [19:48:51] [02ManageWiki] 07Universal-Omega opened pull request 03#361: Make addModuleStyles an array - 13https://github.com/miraheze/ManageWiki/pull/361 [19:48:51] [url] Page not found · GitHub · GitHub | github.com [19:49:19] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/ede4b8ad43e8...269d2f238d1f [19:49:19] [url] Comparing ede4b8ad43e8...269d2f238d1f · miraheze/ManageWiki · GitHub | github.com [19:49:20] [02miraheze/ManageWiki] 07Universal-Omega 03269d2f2 - Update SpecialManageWiki.php [19:49:22] [02ManageWiki] 07Universal-Omega synchronize pull request 03#361: Make addModuleStyles an array - 13https://github.com/miraheze/ManageWiki/pull/361 [19:49:22] [url] Page not found · GitHub · GitHub | github.com [19:49:36] [02ManageWiki] 07Universal-Omega closed pull request 03#361: Make addModuleStyles an array - 13https://github.com/miraheze/ManageWiki/pull/361 [19:49:37] [url] Page not found · GitHub · GitHub | github.com [19:49:38] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/ManageWiki/compare/0c48559e5982...bde8307642a0 [19:49:38] [url] Comparing 0c48559e5982...bde8307642a0 · miraheze/ManageWiki · GitHub | github.com [19:49:40] [02miraheze/ManageWiki] 07Universal-Omega 03bde8307 - Make addModuleStyles an array (#361) [19:49:41] [02ManageWiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/ManageWiki [19:49:41] [url] Page not found · GitHub · GitHub | github.com [19:49:42] [02miraheze/ManageWiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [19:50:01] PROBLEM - cp31 Stunnel HTTP for mw111 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:50:58] [02miraheze/MatomoAnalytics] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/MatomoAnalytics/compare/dbb8507193e3...e36ab602213e [19:50:58] [url] Comparing dbb8507193e3...e36ab602213e · miraheze/MatomoAnalytics · GitHub | github.com [19:51:00] [02miraheze/MatomoAnalytics] 07Universal-Omega 03e36ab60 - Make addModules an array [19:51:48] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/commit/d8c5bd4696a6 [19:51:50] [02miraheze/CreateWiki] 07Universal-Omega 03d8c5bd4 - make addModules an array [19:51:51] [02CreateWiki] 07Universal-Omega created branch 03Universal-Omega-patch-2 - 13https://github.com/miraheze/CreateWiki [19:51:51] ... [19:51:53] [02CreateWiki] 07Universal-Omega opened pull request 03#322: make addModules an array - 13https://github.com/miraheze/CreateWiki/pull/322 [19:51:53] [url] Page not found · GitHub · GitHub | github.com [19:52:00] RECOVERY - cp31 Stunnel HTTP for mw111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15893 bytes in 0.313 second response time [19:52:21] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/d8c5bd4696a6...9320c70b2838 [19:52:21] [url] Comparing d8c5bd4696a6...9320c70b2838 · miraheze/CreateWiki · GitHub | github.com [19:52:22] [02miraheze/CreateWiki] 07Universal-Omega 039320c70 - Update RequestWikiRequestViewer.php [19:52:24] [02CreateWiki] 07Universal-Omega synchronize pull request 03#322: make addModules an array - 13https://github.com/miraheze/CreateWiki/pull/322 [19:52:24] [url] Page not found · GitHub · GitHub | github.com [19:52:30] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/CreateWiki/compare/b7a46f3d131c...05904a514d5c [19:52:30] [url] Comparing b7a46f3d131c...05904a514d5c · miraheze/CreateWiki · GitHub | github.com [19:52:31] [02miraheze/CreateWiki] 07Universal-Omega 0305904a5 - make addModules an array (#322) [19:52:33] [02CreateWiki] 07Universal-Omega closed pull request 03#322: make addModules an array - 13https://github.com/miraheze/CreateWiki/pull/322 [19:52:33] [url] Page not found · GitHub · GitHub | github.com [19:52:34] [02CreateWiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 - 13https://github.com/miraheze/CreateWiki [19:52:34] [url] Page not found · GitHub · GitHub | github.com [19:52:36] [02miraheze/CreateWiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 [19:53:36] [02miraheze/SpriteSheet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/SpriteSheet/compare/a66b693533be...95d3c6f85f97 [19:53:36] [url] Comparing a66b693533be...95d3c6f85f97 · miraheze/SpriteSheet · GitHub | github.com [19:53:37] [02miraheze/SpriteSheet] 07Universal-Omega 0395d3c6f - Make addModules an array [19:53:55] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.10, 1.60, 1.55 [19:54:37] [02miraheze/IncidentReporting] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/IncidentReporting/compare/1a8ff9923dbb...4d6f5e1634f6 [19:54:37] [url] Comparing 1a8ff9923dbb...4d6f5e1634f6 · miraheze/IncidentReporting · GitHub | github.com [19:54:38] [02miraheze/IncidentReporting] 07Universal-Omega 034d6f5e1 - make addModules an array [19:54:55] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.29, 6.94, 6.45 [19:55:18] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/4ba63150dcec...aa4660068866 [19:55:19] [url] Comparing 4ba63150dcec...aa4660068866 · miraheze/MirahezeMagic · GitHub | github.com [19:55:20] [02miraheze/MirahezeMagic] 07Universal-Omega 03aa46600 - Make addModules an array [19:56:37] miraheze/GlobalNewFiles - Universal-Omega the build has errored. [19:56:52] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 6.64, 6.66, 6.40 [19:59:19] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/3fd1eddc60bb...d68205cfdf00 [19:59:20] [url] Comparing 3fd1eddc60bb...d68205cfdf00 · miraheze/ImportDump · GitHub | github.com [19:59:21] [02miraheze/ImportDump] 07Universal-Omega 03d68205c - Update ImportDumpRequestViewer.php [19:59:22] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [19:59:22] [url] Page not found · GitHub · GitHub | github.com [19:59:50] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/d68205cfdf00...519b5693cb9c [19:59:50] [url] Comparing d68205cfdf00...519b5693cb9c · miraheze/ImportDump · GitHub | github.com [19:59:51] [02miraheze/ImportDump] 07Universal-Omega 03519b569 - Update SpecialRequestImportDump.php [19:59:53] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [19:59:53] [url] Page not found · GitHub · GitHub | github.com [20:00:40] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/519b5693cb9c...5f2eb163b726 [20:00:40] [url] Comparing 519b5693cb9c...5f2eb163b726 · miraheze/ImportDump · GitHub | github.com [20:00:41] [02miraheze/ImportDump] 07Universal-Omega 035f2eb16 - Update mediawiki-tests.yml [20:00:43] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [20:00:43] [url] Page not found · GitHub · GitHub | github.com [20:00:49] miraheze/YouTube - Universal-Omega the build passed. [20:01:09] miraheze/WikiDiscover - Universal-Omega the build passed. [20:01:10] miraheze/CustomHeader - Universal-Omega the build passed. [20:01:27] miraheze/PDFEmbed - Universal-Omega the build passed. [20:01:30] miraheze/DataDump - Universal-Omega the build passed. [20:01:48] miraheze/RottenLinks - Universal-Omega the build passed. [20:03:03] miraheze/RemovePII - Universal-Omega the build passed. [20:03:43] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.00, 1.64, 1.71 [20:05:29] miraheze/MatomoAnalytics - Universal-Omega the build has errored. [20:05:40] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.29, 1.56, 1.68 [20:06:49] miraheze/MatomoAnalytics - Universal-Omega the build has errored. [20:09:33] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.19, 1.76, 1.72 [20:11:31] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.12, 1.53, 1.64 [20:12:00] miraheze/SpriteSheet - Universal-Omega the build passed. [20:12:36] [02miraheze/GlobalNewFiles] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/GlobalNewFiles/commit/7770c57dd571 [20:12:38] [02miraheze/GlobalNewFiles] 07Universal-Omega 037770c57 - Replace usage of removed LocalFile::getUser [20:12:39] [02GlobalNewFiles] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/GlobalNewFiles [20:12:39] [url] Page not found · GitHub · GitHub | github.com [20:12:41] [02GlobalNewFiles] 07Universal-Omega opened pull request 03#36: Replace usage of removed LocalFile::getUser - 13https://github.com/miraheze/GlobalNewFiles/pull/36 [20:12:41] [url] Page not found · GitHub · GitHub | github.com [20:13:03] miraheze/IncidentReporting - Universal-Omega the build passed. [20:13:55] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.29, 9.76, 9.05 [20:14:00] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.81, 10.17, 8.83 [20:15:37] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk [20:15:57] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.25, 9.11, 8.89 [20:16:01] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 9.63, 10.03, 8.95 [20:16:28] [02miraheze/GlobalNewFiles] 07github-actions[bot] pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/GlobalNewFiles/compare/7770c57dd571...6f8dd4d24233 [20:16:28] [url] Comparing 7770c57dd571...6f8dd4d24233 · miraheze/GlobalNewFiles · GitHub | github.com [20:16:29] [02miraheze/GlobalNewFiles] 07github-actions 036f8dd4d - CI: lint code to MediaWiki standards [20:16:31] [02GlobalNewFiles] 07github-actions[bot] synchronize pull request 03#36: Replace usage of removed LocalFile::getUser - 13https://github.com/miraheze/GlobalNewFiles/pull/36 [20:16:31] ... [20:17:01] [02miraheze/MatomoAnalytics] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/MatomoAnalytics/compare/e36ab602213e...a950508cf136 [20:17:01] [url] Comparing e36ab602213e...a950508cf136 · miraheze/MatomoAnalytics · GitHub | github.com [20:17:02] [02miraheze/MatomoAnalytics] 07Universal-Omega 03a950508 - Add phan suppression [20:18:18] miraheze/MirahezeMagic - Universal-Omega the build passed. [20:18:51] [02GlobalNewFiles] 07Universal-Omega closed pull request 03#36: Replace usage of removed LocalFile::getUser - 13https://github.com/miraheze/GlobalNewFiles/pull/36 [20:18:52] [url] Page not found · GitHub · GitHub | github.com [20:18:53] [02miraheze/GlobalNewFiles] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/GlobalNewFiles/compare/1dcd6f9fd6f2...2be8f0fac322 [20:18:53] [url] Comparing 1dcd6f9fd6f2...2be8f0fac322 · miraheze/GlobalNewFiles · GitHub | github.com [20:18:54] [02miraheze/GlobalNewFiles] 07Universal-Omega 032be8f0f - Replace usage of removed LocalFile::getUser (#36) [20:18:56] [02GlobalNewFiles] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/GlobalNewFiles [20:18:56] [url] Page not found · GitHub · GitHub | github.com [20:18:57] [02miraheze/GlobalNewFiles] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [20:24:36] miraheze/ManageWiki - Universal-Omega the build passed. [20:24:52] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_38 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/4d74bfe99744...58a2c0caab14 [20:24:53] [url] Comparing 4d74bfe99744...58a2c0caab14 · miraheze/mediawiki · GitHub | github.com [20:24:54] [02miraheze/mediawiki] 07Universal-Omega 0358a2c0c - Update WikibaseLocalMedia [20:25:25] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_38 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/58a2c0caab14...e335be1004a5 [20:25:25] [url] Comparing 58a2c0caab14...e335be1004a5 · miraheze/mediawiki · GitHub | github.com [20:25:26] [02miraheze/mediawiki] 07Universal-Omega 03e335be1 - Update Video [20:25:37] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk [20:25:44] miraheze/ManageWiki - Universal-Omega the build passed. [20:26:16] miraheze/CreateWiki - Universal-Omega the build passed. [20:26:26] !log [universalomega@test101] starting deploy of {'world': True} to all [20:26:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:26:36] miraheze/ManageWiki - Universal-Omega the build passed. [20:27:35] miraheze/GlobalNewFiles - Universal-Omega the build passed. [20:27:36] miraheze/MatomoAnalytics - Universal-Omega the build passed. [20:29:23] miraheze/ImportDump - Universal-Omega the build has errored. [20:29:43] miraheze/GlobalNewFiles - Universal-Omega the build passed. [20:30:36] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/5f2eb163b726...45ca60a02dfe [20:30:37] [url] Comparing 5f2eb163b726...45ca60a02dfe · miraheze/ImportDump · GitHub | github.com [20:30:38] [02miraheze/ImportDump] 07Universal-Omega 0345ca60a - Update ImportDumpOOUIForm.php [20:30:39] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [20:30:40] [url] Page not found · GitHub · GitHub | github.com [20:30:49] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/45ca60a02dfe...7ddbe70354f1 [20:30:50] [url] Comparing 45ca60a02dfe...7ddbe70354f1 · miraheze/ImportDump · GitHub | github.com [20:30:51] [02miraheze/ImportDump] 07Universal-Omega 037ddbe70 - Update extension.json [20:30:52] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [20:30:53] [url] Page not found · GitHub · GitHub | github.com [20:32:03] !log [universalomega@test101] finished deploy of {'world': True} to all - SUCCESS in 336s [20:32:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:32:51] miraheze/CreateWiki - Universal-Omega the build passed. [20:37:41] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.89, 6.73, 6.42 [20:38:02] miraheze/CreateWiki - Universal-Omega the build passed. [20:41:42] miraheze/ImportDump - Universal-Omega the build passed. [20:42:08] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.63, 3.20, 3.94 [20:43:29] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 6.62, 6.78, 6.56 [20:47:24] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.27, 7.19, 6.77 [20:51:16] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 9.30, 8.10, 7.23 [20:52:08] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.06, 1.66, 1.33 [20:54:08] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.19, 1.49, 1.31 [20:55:03] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.94, 3.21, 3.85 [20:57:03] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 7.33, 4.34, 4.16 [20:58:08] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.34, 3.91, 3.72 [21:01:03] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.41, 3.88, 4.00 [21:01:21] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.58, 1.75, 1.50 [21:02:08] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.00, 3.53, 3.62 [21:03:03] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.18, 4.02, 4.04 [21:03:18] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.97, 1.52, 1.45 [21:04:08] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.19, 2.55, 1.78 [21:04:50] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.58, 7.65, 7.72 [21:05:03] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.44, 3.83, 3.97 [21:08:08] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.59, 2.94, 3.34 [21:10:08] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.81, 1.60, 1.62 [21:11:03] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.35, 3.78, 3.86 [21:12:35] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.26, 7.14, 7.39 [21:14:08] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.76, 3.48, 3.43 [21:14:31] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.54, 6.88, 7.27 [21:17:03] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.04, 3.65, 3.82 [21:18:08] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.35, 4.02, 3.67 [21:20:08] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.83, 3.93, 3.68 [21:21:23] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.08, 1.69, 1.32 [21:24:12] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.61, 6.14, 6.76 [21:25:04] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.41, 1.83, 1.47 [21:25:12] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.81, 1.41, 1.30 [21:26:08] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.26, 3.74, 3.64 [21:27:03] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.56, 3.86, 3.83 [21:27:04] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.58, 1.67, 1.45 [21:28:07] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/6bfed7fb65e3...a0210c59013f [21:28:08] [url] Comparing 6bfed7fb65e3...a0210c59013f · miraheze/mw-config · GitHub | github.com [21:28:08] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.67, 3.79, 3.68 [21:28:09] [02miraheze/mw-config] 07Universal-Omega 03a0210c5 - Re-enable Maps on 1.38 [21:28:22] !log [universalomega@test101] starting deploy of {'pull': 'config', 'config': True} to all [21:28:27] !log [universalomega@test101] DEPLOY ABORTED: Canary check failed for beta.betaheze.org@localhost [21:28:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:28:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:29:05] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.38, 3.60, 3.74 [21:29:18] miraheze/mw-config - Universal-Omega the build passed. [21:30:43] PROBLEM - test101 MediaWiki Rendering on test101 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 785 bytes in 0.796 second response time [21:33:03] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.02, 3.61, 3.70 [21:33:26] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/a0210c59013f...e8621f6e33f6 [21:33:26] [url] Comparing a0210c59013f...e8621f6e33f6 · miraheze/mw-config · GitHub | github.com [21:33:27] [02miraheze/mw-config] 07Universal-Omega 03e8621f6 - Disable Maps again on 1.38 [21:33:28] !log [universalomega@test101] starting deploy of {'pull': 'config', 'config': True} to all [21:33:30] !log [universalomega@test101] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 2s [21:33:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:33:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:33:50] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.15, 1.75, 1.61 [21:34:08] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.41, 3.56, 3.53 [21:34:40] miraheze/mw-config - Universal-Omega the build passed. [21:34:43] RECOVERY - test101 MediaWiki Rendering on test101 is OK: HTTP OK: HTTP/1.1 200 OK - 32151 bytes in 1.110 second response time [21:35:03] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.54, 3.64, 3.70 [21:37:03] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.25, 4.03, 3.84 [21:38:08] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.93, 3.96, 3.72 [21:39:03] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.21, 3.87, 3.82 [21:39:38] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.21, 1.67, 1.63 [21:40:08] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.78, 4.48, 3.92 [21:41:03] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 3.77, 4.19, 3.96 [21:42:08] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.98, 7.43, 6.47 [21:43:05] PROBLEM - cloud10 Puppet on cloud10 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [21:44:08] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.57, 3.74, 3.77 [21:44:08] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.35, 7.10, 6.48 [21:45:03] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.32, 3.34, 3.69 [21:46:08] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.51, 6.49, 6.32 [21:48:08] !log start redis and jobrunner on test101 again. [21:48:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:49:31] RECOVERY - test101 Puppet on test101 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [21:49:41] RECOVERY - test101 JobRunner Service on test101 is OK: PROCS OK: 1 process with args 'redisJobRunnerService' [21:50:08] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.33, 3.88, 3.73 [21:51:03] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.21, 4.39, 3.96 [21:53:01] !log [@mwtask111] starting deploy of {'config': True} to all [21:53:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:53:14] !log [@mwtask111] finished deploy of {'config': True} to all - SUCCESS in 13s [21:53:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:54:08] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.77, 3.80, 3.72 [21:55:03] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.92, 3.90, 3.88 [21:59:03] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.82, 4.52, 4.09 [22:01:03] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.97, 3.79, 3.87 [22:03:03] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.05, 3.68, 3.80 [22:07:03] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.27, 3.70, 3.80 [22:08:08] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.01, 3.00, 3.34 [22:09:04] RECOVERY - cloud10 Puppet on cloud10 is OK: OK: Puppet is currently enabled, last run 29 seconds ago with 0 failures [22:09:32] !log [universalomega@test101] starting deploy of {'folders': 'w/extensions/RemovePII', 'lang': 'en'} to all [22:09:34] !log [universalomega@test101] finished deploy of {'folders': 'w/extensions/RemovePII', 'lang': 'en'} to all - SUCCESS in 2s [22:09:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:09:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:09:48] !log [universalomega@test101] starting deploy of {'l10n': True, 'folders': 'w/extensions/RemovePII', 'lang': 'en'} to all [22:09:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:10:01] !log [universalomega@test101] finished deploy of {'l10n': True, 'folders': 'w/extensions/RemovePII', 'lang': 'en'} to all - SUCCESS in 13s [22:10:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:10:59] !log [universalomega@test101] starting deploy of {'pull': 'config', 'branch': 'Universal-Omega-patch-1', 'config': True} to all [22:11:03] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.50, 2.73, 3.40 [22:11:03] !log [universalomega@test101] finished deploy of {'pull': 'config', 'branch': 'Universal-Omega-patch-1', 'config': True} to all - SUCCESS in 4s [22:11:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:11:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:11:31] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.96, 3.35, 3.93 [22:17:31] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.18, 3.96, 4.00 [22:20:11] PROBLEM - matomo101 Current Load on matomo101 is WARNING: WARNING - load average: 3.87, 3.22, 2.55 [22:21:16] [02miraheze/TSPortal] 07OwenBaines pushed 033 commits to 03master [+0/-0/±14] 13https://github.com/miraheze/TSPortal/compare/e8b17dccd7b0...ad5c30de017b [22:21:16] [url] Comparing e8b17dccd7b0...ad5c30de017b · miraheze/TSPortal · GitHub | github.com [22:21:18] [02miraheze/TSPortal] 07OwenBaines 038418ecf - Display buttons and short icons on mobile rather than hide functionality [22:21:19] [02miraheze/TSPortal] 07OwenBaines 0303ffcfb - Correctly mark investigations.assigned as a foreign key [22:21:21] [02miraheze/TSPortal] 07OwenBaines 03ad5c30d - Add new filtering options for investigations and reports [22:22:10] RECOVERY - matomo101 Current Load on matomo101 is OK: OK - load average: 1.88, 2.74, 2.46 [22:22:15] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.08, 1.64, 1.38 [22:22:48] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.62, 4.02, 3.62 [22:24:08] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.15, 6.91, 5.99 [22:24:11] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.47, 1.55, 1.37 [22:24:45] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.01, 3.64, 3.53 [22:26:08] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.18, 6.21, 5.85 [22:26:42] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.08, 4.05, 3.72 [22:28:59] [02miraheze/RemovePII] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/RemovePII/compare/c8cabcbab575...8f76abae2209 [22:28:59] [url] Comparing c8cabcbab575...8f76abae2209 · miraheze/RemovePII · GitHub | github.com [22:29:00] [02miraheze/RemovePII] 07Universal-Omega 038f76aba - Update SpecialRemovePII.php [22:29:02] [02RemovePII] 07Universal-Omega synchronize pull request 03#57: Support DPA validation - 13https://github.com/miraheze/RemovePII/pull/57 [22:29:02] [url] Page not found · GitHub · GitHub | github.com [22:30:45] !log [universalomega@test101] starting deploy of {'l10n': True, 'folders': 'w/extensions/RemovePII', 'lang': 'en'} to all [22:30:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:30:54] !log [universalomega@test101] finished deploy of {'l10n': True, 'folders': 'w/extensions/RemovePII', 'lang': 'en'} to all - SUCCESS in 8s [22:31:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:32:08] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.13, 3.78, 3.31 [22:32:08] [02miraheze/RemovePII] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/RemovePII/compare/8f76abae2209...10aa59b2d298 [22:32:09] [url] Comparing 8f76abae2209...10aa59b2d298 · miraheze/RemovePII · GitHub | github.com [22:32:10] [02miraheze/RemovePII] 07Universal-Omega 0310aa59b - Update SpecialRemovePII.php [22:32:11] [02RemovePII] 07Universal-Omega synchronize pull request 03#57: Support DPA validation - 13https://github.com/miraheze/RemovePII/pull/57 [22:32:11] [url] Page not found · GitHub · GitHub | github.com [22:32:13] miraheze/RemovePII - Universal-Omega the build passed. [22:32:21] !log [universalomega@test101] starting deploy of {'l10n': True, 'folders': 'w/extensions/RemovePII', 'lang': 'en'} to all [22:32:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:32:29] !log [universalomega@test101] finished deploy of {'l10n': True, 'folders': 'w/extensions/RemovePII', 'lang': 'en'} to all - SUCCESS in 7s [22:32:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:32:36] !log [@test101] starting deploy of {'config': True} to all [22:32:38] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 1s [22:32:38] [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/e3cef984e83f [22:32:40] [02miraheze/mw-config] 07paladox 03e3cef98 - Set wgPasswordHash to [] [22:32:41] [02mw-config] 07paladox created branch 03paladox-patch-2 - 13https://github.com/miraheze/mw-config [22:32:41] [url] Page not found · GitHub · GitHub | github.com [22:32:43] [02mw-config] 07paladox opened pull request 03#4737: Set wgPasswordHash to [] - 13https://github.com/miraheze/mw-config/pull/4737 [22:32:43] [url] Page not found · GitHub · GitHub | github.com [22:32:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:32:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:33:44] miraheze/mw-config - paladox the build passed. [22:34:08] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.87, 3.76, 3.36 [22:34:08] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.12, 1.95, 1.61 [22:35:08] [02miraheze/RemovePII] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/RemovePII/compare/10aa59b2d298...a49302a90f4e [22:35:08] [url] Comparing 10aa59b2d298...a49302a90f4e · miraheze/RemovePII · GitHub | github.com [22:35:10] [02miraheze/RemovePII] 07Universal-Omega 03a49302a - Update SpecialRemovePII.php [22:35:11] [02RemovePII] 07Universal-Omega synchronize pull request 03#57: Support DPA validation - 13https://github.com/miraheze/RemovePII/pull/57 [22:35:11] [url] Page not found · GitHub · GitHub | github.com [22:35:19] !log [universalomega@test101] starting deploy of {'l10n': True, 'folders': 'w/extensions/RemovePII', 'lang': 'en'} to all [22:35:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:35:27] !log [universalomega@test101] finished deploy of {'l10n': True, 'folders': 'w/extensions/RemovePII', 'lang': 'en'} to all - SUCCESS in 7s [22:35:28] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 86, in check_records cname = str(dns_resolver.resolve(hostname, 'CNAME')[0]) File "/usr/li [22:35:28] 3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query dnd.bellinrattin.it. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [22:35:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:35:47] miraheze/RemovePII - Universal-Omega the build passed. [22:36:08] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.64, 3.06, 3.15 [22:36:08] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.59, 1.86, 1.63 [22:38:08] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.84, 1.53, 1.54 [22:38:24] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.76, 3.76, 3.94 [22:38:28] miraheze/RemovePII - Universal-Omega the build passed. [22:39:31] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.49, 3.28, 3.88 [22:40:21] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.70, 3.96, 3.98 [22:40:21] [02miraheze/RemovePII] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/RemovePII/compare/a49302a90f4e...bbc58a117f6e [22:40:22] [url] Comparing a49302a90f4e...bbc58a117f6e · miraheze/RemovePII · GitHub | github.com [22:40:23] [02miraheze/RemovePII] 07Universal-Omega 03bbc58a1 - Update SpecialRemovePII.php [22:40:24] [02RemovePII] 07Universal-Omega synchronize pull request 03#57: Support DPA validation - 13https://github.com/miraheze/RemovePII/pull/57 [22:40:25] ... [22:41:31] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.54, 4.24, 4.16 [22:43:01] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.78, 4.19, 3.58 [22:43:02] PROBLEM - test101 MediaWiki Rendering on test101 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:43:25] miraheze/RemovePII - Universal-Omega the build has errored. [22:44:08] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.96, 6.87, 6.26 [22:45:04] RECOVERY - test101 MediaWiki Rendering on test101 is OK: HTTP OK: HTTP/1.1 200 OK - 32151 bytes in 2.851 second response time [22:46:08] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 6.29, 6.65, 6.25 [22:46:12] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.77, 3.62, 3.89 [22:46:53] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.87, 3.55, 3.46 [22:48:24] !log [universalomega@test101] starting deploy of {'l10n': True, 'folders': 'w/extensions/RemovePII', 'lang': 'en'} to all [22:48:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:48:38] !log [universalomega@test101] finished deploy of {'l10n': True, 'folders': 'w/extensions/RemovePII', 'lang': 'en'} to all - SUCCESS in 14s [22:48:49] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.74, 3.72, 3.52 [22:48:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:49:58] [02miraheze/RemovePII] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/RemovePII/compare/bbc58a117f6e...ec87eb5df6fd [22:49:58] [url] Comparing bbc58a117f6e...ec87eb5df6fd · miraheze/RemovePII · GitHub | github.com [22:49:59] [02miraheze/RemovePII] 07Universal-Omega 03ec87eb5 - Update SpecialRemovePII.php [22:50:01] [02RemovePII] 07Universal-Omega synchronize pull request 03#57: Support DPA validation - 13https://github.com/miraheze/RemovePII/pull/57 [22:50:01] [url] Page not found · GitHub · GitHub | github.com [22:50:06] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.41, 4.21, 4.03 [22:50:17] !log [universalomega@test101] starting deploy of {'l10n': True, 'folders': 'w/extensions/RemovePII', 'lang': 'en'} to all [22:50:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:50:30] !log [universalomega@test101] finished deploy of {'l10n': True, 'folders': 'w/extensions/RemovePII', 'lang': 'en'} to all - SUCCESS in 13s [22:50:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:50:45] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.52, 3.64, 3.52 [22:51:59] [02RemovePII] 07Universal-Omega synchronize pull request 03#57: Support DPA validation - 13https://github.com/miraheze/RemovePII/pull/57 [22:52:00] [url] Page not found · GitHub · GitHub | github.com [22:52:01] [02miraheze/RemovePII] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/RemovePII/compare/ec87eb5df6fd...1548b3f2b4b9 [22:52:01] [url] Comparing ec87eb5df6fd...1548b3f2b4b9 · miraheze/RemovePII · GitHub | github.com [22:52:02] [02miraheze/RemovePII] 07Universal-Omega 031548b3f - Update SpecialRemovePII.php [22:52:06] !log [universalomega@test101] starting deploy of {'l10n': True, 'folders': 'w/extensions/RemovePII', 'lang': 'en'} to all [22:52:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:52:14] !log [universalomega@test101] finished deploy of {'l10n': True, 'folders': 'w/extensions/RemovePII', 'lang': 'en'} to all - SUCCESS in 7s [22:52:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:53:42] PROBLEM - test101 MediaWiki Rendering on test101 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:54:08] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.65, 7.14, 6.68 [22:55:19] miraheze/RemovePII - Universal-Omega the build passed. [22:55:44] RECOVERY - test101 MediaWiki Rendering on test101 is OK: HTTP OK: HTTP/1.1 200 OK - 32151 bytes in 2.712 second response time [22:56:08] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.05, 6.35, 6.44 [22:56:32] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.83, 4.90, 4.06 [22:56:43] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 3.94, 2.53, 1.72 [22:56:59] [02RemovePII] 07Universal-Omega closed pull request 03#57: Support DPA validation - 13https://github.com/miraheze/RemovePII/pull/57 [22:56:59] [url] Page not found · GitHub · GitHub | github.com [22:57:00] [02RemovePII] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/RemovePII [22:57:00] [url] Page not found · GitHub · GitHub | github.com [22:57:02] [02miraheze/RemovePII] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±4] 13https://github.com/miraheze/RemovePII/compare/9c647bb6ec74...f6a0d922e866 [22:57:02] [url] Comparing 9c647bb6ec74...f6a0d922e866 · miraheze/RemovePII · GitHub | github.com [22:57:03] [02miraheze/RemovePII] 07Universal-Omega 03f6a0d92 - Support DPA validation (#57) [22:57:05] [02miraheze/RemovePII] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [22:58:43] PROBLEM - cp30 Stunnel HTTP for mw111 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:59:30] PROBLEM - mw111 MediaWiki Rendering on mw111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:00:31] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.07, 1.91, 1.66 [23:00:46] RECOVERY - cp30 Stunnel HTTP for mw111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15893 bytes in 7.855 second response time [23:00:54] miraheze/RemovePII - Universal-Omega the build passed. [23:01:16] !log [universalomega@test101] starting deploy of {'l10n': True, 'folders': 'w/extensions/RemovePII', 'lang': 'en'} to all [23:01:26] !log [universalomega@test101] finished deploy of {'l10n': True, 'folders': 'w/extensions/RemovePII', 'lang': 'en'} to all - SUCCESS in 10s [23:01:30] RECOVERY - mw111 MediaWiki Rendering on mw111 is OK: HTTP OK: HTTP/1.1 200 OK - 22336 bytes in 3.057 second response time [23:01:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:01:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:02:06] !log [universalomega@test101] starting deploy of {'config': True} to all [23:02:07] !log [universalomega@test101] finished deploy of {'config': True} to all - SUCCESS in 1s [23:02:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:02:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:02:39] [Grafana] !sre FIRING: There has been a rise in the MediaWiki exception rate https://grafana.miraheze.org/d/GtxbP1Xnk [23:03:44] [02miraheze/RemovePII] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/RemovePII/commit/43b6b1e5aec0 [23:03:45] [02miraheze/RemovePII] 07Universal-Omega 0343b6b1e - Set hard-dependency of CentralAuth [23:03:47] [02RemovePII] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/RemovePII [23:03:47] [url] Page not found · GitHub · GitHub | github.com [23:03:48] [02RemovePII] 07Universal-Omega opened pull request 03#58: Set hard-dependency of CentralAuth - 13https://github.com/miraheze/RemovePII/pull/58 [23:03:49] ... [23:04:20] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.83, 1.47, 1.54 [23:04:25] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - dnd.bellinrattin.it All nameservers failed to answer the query. [23:04:43] [02RemovePII] 07Universal-Omega closed pull request 03#58: Set hard-dependency of CentralAuth - 13https://github.com/miraheze/RemovePII/pull/58 [23:04:43] ... [23:04:45] [02RemovePII] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/RemovePII [23:04:45] [url] Page not found · GitHub · GitHub | github.com [23:04:47] [02miraheze/RemovePII] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [23:06:15] miraheze/RemovePII - Universal-Omega the build has errored. [23:07:10] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_38 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/e335be1004a5...2277312fd91e [23:07:10] [url] Comparing e335be1004a5...2277312fd91e · miraheze/mediawiki · GitHub | github.com [23:07:11] [02miraheze/mediawiki] 07Universal-Omega 032277312 - Update RemovePII [23:07:39] [Grafana] !sre RESOLVED: MediaWiki Exception Rate https://grafana.miraheze.org/d/GtxbP1Xnk [23:07:40] !log [universalomega@test101] starting deploy of {'world': True, 'l10n': True} to all [23:07:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:08:58] !log [universalomega@test101] DEPLOY ABORTED: Non-Zero Exit Code in prep, see output. [23:09:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:10:25] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_38 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/2277312fd91e...7d06ede3970f [23:10:25] [url] Comparing 2277312fd91e...7d06ede3970f · miraheze/mediawiki · GitHub | github.com [23:10:26] [02miraheze/mediawiki] 07Universal-Omega 037d06ede - Update GlobalNewFiles [23:10:42] !log [universalomega@test101] starting deploy of {'world': True, 'l10n': True} to all [23:12:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:12:53] PROBLEM - cp31 Stunnel HTTP for mw111 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:14:52] RECOVERY - cp31 Stunnel HTTP for mw111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15879 bytes in 0.683 second response time [23:15:05] [02mw-config] 07Universal-Omega closed pull request 03#4737: Set wgPasswordHash to [] - 13https://github.com/miraheze/mw-config/pull/4737 [23:15:05] [url] Page not found · GitHub · GitHub | github.com [23:15:06] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/e8621f6e33f6...c089e75f836f [23:15:06] [url] Comparing e8621f6e33f6...c089e75f836f · miraheze/mw-config · GitHub | github.com [23:15:08] [02miraheze/mw-config] 07paladox 03c089e75 - Set wgPasswordHash to [] (#4737) [23:15:09] [02miraheze/mw-config] 07Universal-Omega deleted branch 03paladox-patch-2 [23:15:11] [02mw-config] 07Universal-Omega deleted branch 03paladox-patch-2 - 13https://github.com/miraheze/mw-config [23:15:11] [url] Page not found · GitHub · GitHub | github.com [23:15:26] !log [universalomega@mwtask111] starting deploy of {'pull': 'config', 'config': True} to all [23:15:39] !log [universalomega@mwtask111] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 13s [23:15:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:16:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:16:07] miraheze/mw-config - Universal-Omega the build passed. [23:16:09] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03revert-4737-paladox-patch-2 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/5319d8b2ede9 [23:16:09] [url] Page not found · GitHub · GitHub | github.com [23:16:10] [02miraheze/mw-config] 07Universal-Omega 035319d8b - Revert "Set wgPasswordHash to [] (#4737)" [23:16:12] [02mw-config] 07Universal-Omega created branch 03revert-4737-paladox-patch-2 - 13https://github.com/miraheze/mw-config [23:16:12] [url] Page not found · GitHub · GitHub | github.com [23:16:13] [02mw-config] 07Universal-Omega opened pull request 03#4738: Revert "Set wgPasswordHash to []" - 13https://github.com/miraheze/mw-config/pull/4738 [23:16:13] ... [23:16:18] [02miraheze/RemovePII] 07paladox deleted branch 031_38-support [23:16:19] [02RemovePII] 07paladox deleted branch 031_38-support - 13https://github.com/miraheze/RemovePII [23:16:19] [url] Page not found · GitHub · GitHub | github.com [23:16:56] [02mw-config] 07Universal-Omega closed pull request 03#4738: Revert "Set wgPasswordHash to []" - 13https://github.com/miraheze/mw-config/pull/4738 [23:16:57] ... [23:16:58] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/c089e75f836f...455b0458ef9a [23:16:58] [url] Comparing c089e75f836f...455b0458ef9a · miraheze/mw-config · GitHub | github.com [23:16:59] [02miraheze/mw-config] 07Universal-Omega 03455b045 - Revert "Set wgPasswordHash to []" (#4738) [23:17:01] [02mw-config] 07Universal-Omega deleted branch 03revert-4737-paladox-patch-2 - 13https://github.com/miraheze/mw-config [23:17:01] [url] Page not found · GitHub · GitHub | github.com [23:17:02] [02miraheze/mw-config] 07Universal-Omega deleted branch 03revert-4737-paladox-patch-2 [23:17:03] !log [universalomega@mwtask111] starting deploy of {'pull': 'config', 'config': True} to all [23:17:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:17:12] !log [universalomega@mwtask111] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 8s [23:17:15] miraheze/mw-config - Universal-Omega the build passed. [23:17:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:18:02] miraheze/mw-config - Universal-Omega the build passed. [23:18:50] PROBLEM - test101 MediaWiki Rendering on test101 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:20:19] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.43, 2.22, 1.69 [23:20:40] PROBLEM - cp20 Stunnel HTTP for test101 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:21:10] PROBLEM - cp30 Stunnel HTTP for test101 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:22:52] PROBLEM - cp31 Stunnel HTTP for test101 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:23:03] PROBLEM - cp21 Stunnel HTTP for test101 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:24:11] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.14, 1.79, 1.65 [23:27:14] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/455b0458ef9a...d2a9e49b757f [23:27:14] [url] Comparing 455b0458ef9a...d2a9e49b757f · miraheze/mw-config · GitHub | github.com [23:27:15] [02miraheze/mw-config] 07Universal-Omega 03d2a9e49 - Use isExtensionActive for WikibaseLexeme [23:27:36] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/d2a9e49b757f...2e371ee13553 [23:27:37] [url] Comparing d2a9e49b757f...2e371ee13553 · miraheze/mw-config · GitHub | github.com [23:27:38] [02miraheze/mw-config] 07Universal-Omega 032e371ee - Remove double whitespace [23:28:08] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.90, 1.38, 1.53 [23:28:24] miraheze/mw-config - Universal-Omega the build passed. [23:28:43] miraheze/mw-config - Universal-Omega the build passed. [23:28:45] [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/8524411f062d [23:28:47] [02miraheze/mw-config] 07paladox 038524411 - Set wgLDAPDebug to 1 [23:28:48] [02mw-config] 07paladox created branch 03paladox-patch-2 - 13https://github.com/miraheze/mw-config [23:28:48] [url] Page not found · GitHub · GitHub | github.com [23:28:50] [02mw-config] 07paladox opened pull request 03#4739: Set wgLDAPDebug to 1 - 13https://github.com/miraheze/mw-config/pull/4739 [23:28:50] [url] Page not found · GitHub · GitHub | github.com [23:29:53] miraheze/mw-config - paladox the build passed. [23:31:03] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-6 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/2ee3ae4260fb [23:31:05] [02miraheze/puppet] 07paladox 032ee3ae4 - mediawiki: install php7.x-ldap [23:31:06] [02puppet] 07paladox created branch 03paladox-patch-6 - 13https://github.com/miraheze/puppet [23:31:06] [url] Page not found · GitHub · GitHub | github.com [23:31:07] [02puppet] 07paladox opened pull request 03#2658: mediawiki: install php7.x-ldap - 13https://github.com/miraheze/puppet/pull/2658 [23:31:08] [url] Page not found · GitHub · GitHub | github.com [23:31:32] [02puppet] 07paladox closed pull request 03#2658: mediawiki: install php7.x-ldap - 13https://github.com/miraheze/puppet/pull/2658 [23:31:32] ... [23:31:33] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/c4b3fdcfd4ff...bd0dca091ee3 [23:31:34] [url] Comparing c4b3fdcfd4ff...bd0dca091ee3 · miraheze/puppet · GitHub | github.com [23:31:35] [02miraheze/puppet] 07paladox 03bd0dca0 - mediawiki: install php7.x-ldap (#2658) [23:31:36] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-6 [23:31:38] [02puppet] 07paladox deleted branch 03paladox-patch-6 - 13https://github.com/miraheze/puppet [23:31:38] [url] Page not found · GitHub · GitHub | github.com [23:33:28] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp21.miraheze.org - CNAME OK [23:34:27] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/2e371ee13553...aa49bd46b865 [23:34:28] [url] Comparing 2e371ee13553...aa49bd46b865 · miraheze/mw-config · GitHub | github.com [23:34:29] [02miraheze/mw-config] 07paladox 03aa49bd4 - Set wgLDAPDebug to 1 (#4739) [23:34:30] [02mw-config] 07Universal-Omega closed pull request 03#4739: Set wgLDAPDebug to 1 - 13https://github.com/miraheze/mw-config/pull/4739 [23:34:31] ... [23:34:32] [02mw-config] 07Universal-Omega deleted branch 03paladox-patch-2 - 13https://github.com/miraheze/mw-config [23:34:32] [url] Page not found · GitHub · GitHub | github.com [23:34:33] [02miraheze/mw-config] 07Universal-Omega deleted branch 03paladox-patch-2 [23:34:37] Thanks! [23:34:38] !log [universalomega@mwtask111] starting deploy of {'pull': 'config', 'config': True} to all [23:34:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:34:49] !log [universalomega@mwtask111] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 11s [23:34:52] !log restarted php-fpm on mw111 to pickup php config change [23:34:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:35:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:35:36] miraheze/mw-config - Universal-Omega the build passed. [23:37:54] !log rolling restart of php-fpm on mw* [23:38:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:44:12] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.72, 1.46, 1.30 [23:46:12] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.39, 1.40, 1.29 [23:46:40] !log reboot test101 [23:46:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:47:55] oh hold on [23:48:01] CosmicAlpha: were you running a script on test101 [23:48:02] RECOVERY - cp20 Stunnel HTTP for test101 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15895 bytes in 0.183 second response time [23:48:15] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.70, 0.72, 0.27 [23:48:32] RECOVERY - cp30 Stunnel HTTP for test101 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15895 bytes in 0.335 second response time [23:48:33] RECOVERY - cp21 Stunnel HTTP for test101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15895 bytes in 0.041 second response time [23:48:34] RECOVERY - cp31 Stunnel HTTP for test101 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15895 bytes in 0.335 second response time [23:48:52] RECOVERY - test101 MediaWiki Rendering on test101 is OK: HTTP OK: HTTP/1.1 200 OK - 32151 bytes in 1.850 second response time [23:49:41] PROBLEM - test101 JobRunner Service on test101 is CRITICAL: PROCS CRITICAL: 0 processes with args 'redisJobRunnerService' [23:50:13] !log [@test101] starting deploy of {'config': True} to all [23:50:14] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 0s [23:50:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:50:22] PROBLEM - test101 Check Gluster Clients on test101 is CRITICAL: PROCS CRITICAL: 0 processes with args '/usr/sbin/glusterfs' [23:50:25] CosmicAlpha: still around? [23:50:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:51:41] RECOVERY - test101 JobRunner Service on test101 is OK: PROCS OK: 1 process with args 'redisJobRunnerService' [23:52:08] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.87, 1.75, 1.47 [23:54:08] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.94, 1.51, 1.42