[00:04:12] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.02, 3.95, 3.82 [00:04:42] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.20, 4.06, 3.58 [00:13:16] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.72, 4.59, 3.83 [00:19:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.68, 3.68, 3.69 [00:20:32] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.24, 3.71, 4.00 [00:22:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.38, 3.13, 3.83 [00:23:13] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.48, 2.98, 3.39 [00:24:12] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.01, 3.54, 3.89 [00:26:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.51, 3.09, 3.68 [00:30:12] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.10, 3.17, 3.55 [00:30:25] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.25, 3.56, 3.69 [00:34:10] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.61, 3.71, 3.56 [00:36:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.71, 4.00, 3.97 [00:36:21] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.89, 3.96, 3.96 [00:38:12] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 7.72, 4.86, 4.26 [00:38:20] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.75, 4.14, 4.02 [00:40:08] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.59, 3.12, 3.35 [00:40:19] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.09, 3.70, 3.87 [00:41:21] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - dnd.bellinrattin.it All nameservers failed to answer the query. [00:42:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.42, 3.56, 3.87 [00:46:14] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.32, 3.35, 3.58 [00:48:13] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.50, 3.05, 3.45 [00:50:12] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.63, 2.81, 3.30 [00:52:12] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.43, 3.79, 3.79 [00:54:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.29, 3.56, 3.71 [01:02:12] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.57, 2.91, 3.32 [01:12:47] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.96, 3.45, 3.43 [01:14:41] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.53, 3.17, 3.33 [01:17:43] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-6 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/b761f5cbe209 [01:17:45] [02miraheze/puppet] 07paladox 03b761f5c - graylog: allow Prometheus to access port 443 [01:17:46] [02puppet] 07paladox created branch 03paladox-patch-6 - 13https://github.com/miraheze/puppet [01:17:46] [url] Page not found · GitHub · GitHub | github.com [01:17:48] [02puppet] 07paladox opened pull request 03#2553: graylog: allow Prometheus to access port 443 - 13https://github.com/miraheze/puppet/pull/2553 [01:17:48] ... [01:18:11] [02puppet] 07paladox closed pull request 03#2553: graylog: allow Prometheus to access port 443 - 13https://github.com/miraheze/puppet/pull/2553 [01:18:11] ... [01:18:12] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/870d5d574080...e7744e69f8ef [01:18:13] [url] Comparing 870d5d574080...e7744e69f8ef · miraheze/puppet · GitHub | github.com [01:18:14] [02miraheze/puppet] 07paladox 03e7744e6 - graylog: allow Prometheus to access port 443 (#2553) [01:18:16] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-6 [01:18:17] [02puppet] 07paladox deleted branch 03paladox-patch-6 - 13https://github.com/miraheze/puppet [01:18:17] [url] Page not found · GitHub · GitHub | github.com [01:19:23] paladox: do you mind also merging https://github.com/miraheze/puppet/pull/2535? [01:19:23] [url] deploy-mediawiki: use http_proxy for composer by Universal-Omega · Pull Request #2535 · miraheze/puppet · GitHub | github.com [01:20:27] [02puppet] 07paladox closed pull request 03#2535: deploy-mediawiki: use http_proxy for composer - 13https://github.com/miraheze/puppet/pull/2535 [01:20:28] [url] Page not found · GitHub · GitHub | github.com [01:20:29] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/e7744e69f8ef...dadd3abed7a5 [01:20:29] [url] Comparing e7744e69f8ef...dadd3abed7a5 · miraheze/puppet · GitHub | github.com [01:20:30] [02miraheze/puppet] 07Universal-Omega 03dadd3ab - deploy-mediawiki: use http_proxy for composer (#2535) [01:20:34] Thanks! [01:20:58] Guess you may need https_proxy as well? [01:22:39] paladox: no, it works when using just http_proxy. Without it composer always fails, with it it works. I've just had to do it manually for a bit, up until now. [01:24:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.66, 3.54, 3.33 [01:26:12] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.46, 3.04, 3.16 [01:29:54] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/dadd3abed7a5...375789ccb72c [01:29:54] [url] Comparing dadd3abed7a5...375789ccb72c · miraheze/puppet · GitHub | github.com [01:29:55] [02miraheze/puppet] 07paladox 03375789c - fix [01:33:00] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.87, 3.54, 3.40 [01:36:31] paladox: can we try and package the updated version (your patch) for promotheus-es-exporter to support IPv6, so we can get that fixed again? [01:36:47] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.28, 3.38, 3.37 [01:44:35] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 3.17, 2.96, 1.79 [01:45:30] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.94, 4.25, 3.38 [01:46:17] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 9.16, 6.68, 4.71 [01:46:45] [02puppet] 07Universal-Omega opened pull request 03#2554: Move systemd_override for PHP-FPM to MediaWiki module - 13https://github.com/miraheze/puppet/pull/2554 [01:46:46] [url] Page not found · GitHub · GitHub | github.com [01:46:49] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.01, 4.91, 3.67 [01:46:51] [02puppet] 07Universal-Omega edited pull request 03#2554: Move systemd_override for PHP-FPM to MediaWiki module - 13https://github.com/miraheze/puppet/pull/2554 [01:46:51] [url] Page not found · GitHub · GitHub | github.com [01:47:59] [02puppet] 07Universal-Omega synchronize pull request 03#2554: Move systemd_override for PHP-FPM to MediaWiki module - 13https://github.com/miraheze/puppet/pull/2554 [01:48:00] [url] Page not found · GitHub · GitHub | github.com [01:48:32] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.29, 1.98, 1.64 [01:50:31] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.25, 1.69, 1.57 [02:05:51] [02puppet] 07Universal-Omega synchronize pull request 03#2554: Move systemd_override for PHP-FPM to MediaWiki module - 13https://github.com/miraheze/puppet/pull/2554 [02:05:51] [url] Page not found · GitHub · GitHub | github.com [02:08:44] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.33, 3.36, 3.91 [02:11:01] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp20.miraheze.org - CNAME OK [02:11:11] paladox: ^ I *think* I did that right, but not 100% certain with the init_template change. It's not urgent to merge either so can wait if you want. [02:11:13] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.83, 3.34, 3.93 [02:17:09] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.06, 3.21, 3.62 [02:18:41] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.76, 2.82, 3.38 [02:19:07] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.22, 3.15, 3.55 [02:24:39] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.76, 3.76, 3.54 [02:25:03] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.15, 3.90, 3.71 [02:26:06] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [02:26:38] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.91, 3.69, 3.54 [02:30:37] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.93, 3.09, 3.36 [02:32:00] 1 grafana alert in 6 hours... not bad! [02:34:36] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.31, 3.51, 3.50 [02:34:57] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.29, 3.75, 3.84 [02:36:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.59, 3.49, 4.00 [02:36:35] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.78, 3.15, 3.36 [02:44:50] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.89, 2.75, 3.34 [02:52:12] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.39, 3.94, 3.90 [02:52:43] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 7.72, 4.67, 3.81 [02:53:13] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.22, 9.51, 8.47 [02:53:30] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.93, 3.69, 3.49 [02:55:08] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.55, 8.87, 8.37 [02:55:29] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.81, 3.37, 3.39 [02:56:41] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.63, 3.58, 3.56 [02:58:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.67, 3.89, 3.93 [02:59:28] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.86, 3.49, 3.47 [03:00:12] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.24, 3.94, 3.93 [03:02:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.96, 3.51, 3.77 [03:02:37] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.74, 3.11, 3.39 [03:03:26] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.14, 3.25, 3.38 [03:12:12] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.08, 3.95, 3.77 [03:17:22] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.25, 3.55, 3.37 [03:21:20] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.64, 3.24, 3.28 [03:21:43] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.20, 1.81, 1.27 [03:22:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.61, 3.70, 3.84 [03:23:43] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.02, 1.46, 1.20 [03:26:12] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.40, 4.93, 4.26 [03:27:19] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.61, 4.02, 3.56 [03:31:16] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.68, 3.41, 3.42 [03:35:13] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.16, 3.05, 3.31 [03:42:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.40, 3.77, 4.00 [03:42:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.40, 3.45, 3.26 [03:44:12] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.49, 4.21, 4.11 [03:46:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.84, 3.60, 3.90 [03:46:13] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.30, 3.01, 3.14 [03:52:12] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.18, 4.24, 3.98 [03:54:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.42, 3.91, 3.89 [03:56:12] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.25, 4.33, 4.07 [04:00:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 1.76, 3.40, 3.79 [04:08:12] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.17, 2.79, 3.34 [04:12:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.39, 3.49, 3.52 [04:14:12] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.75, 3.72, 3.58 [04:16:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.24, 3.55, 3.54 [04:20:12] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.96, 3.04, 3.31 [04:42:09] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - dnd.bellinrattin.it All nameservers failed to answer the query. [05:12:00] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp20.miraheze.org - CNAME OK [05:15:00] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.69, 4.39, 3.44 [05:18:48] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.84, 3.57, 3.31 [05:22:35] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.05, 3.37, 3.30 [05:23:53] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.96, 1.59, 1.13 [05:25:52] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.95, 1.36, 1.10 [05:51:11] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.91, 1.70, 1.35 [05:53:11] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.38, 1.57, 1.35 [06:09:11] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.59, 2.04, 1.65 [06:12:32] PROBLEM - cloud10 Puppet on cloud10 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [06:13:41] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 86, in check_records cname = str(dns_resolver.resolve(hostname, 'CNAME')[0]) File "/usr/li [06:13:41] 3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query dnd.bellinrattin.it. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [06:22:23] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.81, 1.23, 0.87 [06:24:21] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.60, 0.98, 0.83 [06:40:32] RECOVERY - cloud10 Puppet on cloud10 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [06:43:32] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp21.miraheze.org - CNAME OK [07:15:22] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 73, in check_records nameserversans = dns_resolver.resolve(root_domain, 'NS') File "/usr/l [07:15:22] n3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query bellinrattin.it. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [07:33:11] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.36, 1.60, 1.98 [07:43:11] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.45, 1.41, 1.69 [07:47:11] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.03, 1.74, 1.76 [07:55:11] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.78, 1.96, 1.90 [08:01:11] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.09, 1.89, 1.88 [08:05:11] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.78, 1.87, 1.89 [08:13:11] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 0.10, 1.01, 1.54 [08:15:03] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp21.miraheze.org - CNAME OK [08:48:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.74, 3.42, 2.87 [08:50:12] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.43, 3.31, 2.91 [08:58:08] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 3.59, 2.19, 1.39 [09:00:08] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.87, 1.64, 1.28 [09:16:43] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - dnd.bellinrattin.it All nameservers failed to answer the query. [09:29:58] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.58, 1.84, 1.52 [09:33:47] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.98, 1.55, 1.49 [09:46:34] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 86, in check_records cname = str(dns_resolver.resolve(hostname, 'CNAME')[0]) File "/usr/li [09:46:34] 3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query dnd.bellinrattin.it. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [10:00:49] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.88, 1.69, 1.40 [10:02:44] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.34, 1.59, 1.39 [10:06:33] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.72, 1.83, 1.54 [10:08:27] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.24, 1.58, 1.48 [10:18:49] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.91, 3.71, 3.24 [10:20:43] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.40, 3.85, 3.34 [10:22:37] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.30, 3.47, 3.25 [10:24:40] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.90, 1.88, 1.53 [10:26:25] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 7.73, 5.16, 3.92 [10:27:22] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 7.56, 4.88, 3.52 [10:27:25] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 7.73, 4.61, 3.37 [10:38:01] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 0.77, 1.56, 1.76 [10:46:15] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp20.miraheze.org - CNAME OK [10:47:09] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.83, 3.54, 3.93 [10:47:33] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.50, 1.52, 1.65 [10:55:03] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 3.91, 4.02, 4.02 [10:56:36] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 2.11, 1.68, 1.27 [10:57:02] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.64, 3.58, 3.87 [10:57:17] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.62, 3.42, 3.85 [10:58:36] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.91, 1.33, 1.19 [11:00:59] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.41, 3.81, 3.87 [11:01:16] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.03, 3.67, 3.84 [11:02:58] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.31, 3.40, 3.72 [11:03:15] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.89, 3.26, 3.67 [11:05:14] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.20, 3.49, 3.69 [11:07:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.43, 3.02, 3.49 [11:10:53] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.91, 2.64, 3.29 [11:11:13] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.20, 2.75, 3.29 [11:14:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.46, 3.39, 3.85 [11:16:12] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.37, 3.97, 3.99 [11:18:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.03, 3.59, 3.85 [11:24:12] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.70, 4.25, 4.01 [11:26:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.03, 3.69, 3.82 [11:34:12] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.49, 3.98, 3.87 [11:36:35] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.28, 3.43, 3.30 [11:40:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.87, 3.78, 3.88 [11:40:32] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.26, 3.69, 3.43 [11:46:28] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.09, 3.20, 3.28 [11:52:12] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.10, 2.79, 3.36 [11:55:47] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 4.24, 6.84, 4.04 [11:56:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.93, 3.73, 3.65 [12:02:12] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.31, 3.60, 3.58 [12:04:12] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.10, 3.07, 3.39 [12:08:12] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.23, 3.72, 3.57 [12:09:48] getting 503s [12:12:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.64, 3.98, 3.77 [12:12:55] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.41, 3.42, 3.01 [12:14:12] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.27, 4.32, 3.91 [12:14:54] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.94, 3.28, 3.01 [12:16:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.69, 3.65, 3.72 [12:18:47] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - dnd.bellinrattin.it All nameservers failed to answer the query. [12:22:59] ugochimobi: hi [12:24:16] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.40, 3.81, 3.81 [12:24:57] RhinosF1: hello [12:26:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.47, 3.82, 3.82 [12:26:40] ugochimobi: still having issues? [12:26:58] It stopped [12:27:07] ...already though [12:31:31] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.23, 1.53, 1.89 [12:33:31] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.22, 1.66, 1.88 [12:33:42] ugochimobi: ok [12:33:58] thank you [12:34:12] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.90, 3.55, 3.61 [12:35:20] ugochimobi: ping me if it goes bad again [12:35:31] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.53, 1.62, 1.84 [12:36:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.61, 3.55, 3.61 [12:37:30] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.04, 1.74, 1.85 [12:39:30] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.96, 1.78, 1.85 [12:39:45] RhinosF1: I'd do just that, thanks! [12:42:12] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.40, 2.92, 3.31 [12:43:31] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.08, 1.32, 1.64 [12:46:12] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.70, 3.86, 3.56 [12:47:44] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.52, 3.14, 2.99 [12:48:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.56, 3.79, 3.58 [12:49:43] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.28, 3.38, 3.08 [12:50:12] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.27, 3.96, 3.67 [12:51:43] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.08, 3.18, 3.05 [12:52:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.36, 3.30, 3.46 [12:54:12] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.47, 3.17, 3.40 [12:57:06] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 2.52, 2.56, 1.69 [12:57:58] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.25, 1.85, 1.66 [12:58:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.24, 3.35, 3.49 [12:59:53] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.30, 1.62, 1.60 [13:00:32] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.34, 3.55, 3.28 [13:00:57] ugochimobi: what's your IP [13:01:05] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.67, 1.60, 1.50 [13:04:01] RhinosF1: should I share my IP here? [13:04:15] unless it's not the IP i'm thinking o.o [13:04:30] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.30, 3.18, 3.20 [13:04:49] ugochimobi: pm [13:06:12] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.29, 3.83, 3.64 [13:08:26] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.50, 3.89, 3.49 [13:10:24] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.92, 3.63, 3.45 [13:12:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.36, 3.74, 3.71 [13:12:23] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.08, 3.38, 3.37 [13:14:12] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 7.53, 4.86, 4.11 [13:16:19] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.65, 3.67, 3.53 [13:18:29] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 86, in check_records cname = str(dns_resolver.resolve(hostname, 'CNAME')[0]) File "/usr/li [13:18:29] 3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query dnd.bellinrattin.it. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [13:20:17] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.62, 4.33, 3.83 [13:24:14] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.67, 3.66, 3.68 [13:25:57] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 2.75, 2.00, 1.62 [13:26:13] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.54, 4.03, 3.81 [13:27:35] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.38, 1.98, 1.71 [13:27:57] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.70, 1.91, 1.64 [13:28:30] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.63, 3.61, 3.39 [13:29:56] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.76, 1.48, 1.51 [13:30:30] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.42, 4.13, 3.62 [13:32:29] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.09, 3.75, 3.55 [13:36:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.43, 3.65, 4.00 [13:38:12] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.32, 4.41, 4.27 [13:40:27] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.39, 4.15, 3.74 [13:41:31] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.27, 1.86, 1.90 [13:42:27] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.09, 3.88, 3.70 [13:44:26] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.76, 3.98, 3.74 [13:46:26] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.46, 3.79, 3.71 [13:49:31] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 5.81, 2.51, 2.03 [13:53:31] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.19, 1.63, 1.77 [13:57:31] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.38, 1.95, 1.85 [13:58:23] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.54, 3.80, 3.62 [13:59:31] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.31, 1.70, 1.77 [14:04:22] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.15, 3.91, 3.83 [14:05:31] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.64, 1.26, 1.59 [14:11:47] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.67, 3.52, 3.95 [14:12:20] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.69, 2.62, 3.27 [14:17:47] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.00, 2.57, 3.37 [14:20:17] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.01, 3.82, 3.47 [14:21:47] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.76, 3.56, 3.68 [14:22:17] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.14, 3.45, 3.37 [14:24:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.50, 3.56, 3.97 [14:24:16] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.56, 3.13, 3.26 [14:31:47] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.61, 4.28, 3.83 [14:32:12] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.11, 3.62, 3.77 [14:32:13] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.28, 4.05, 3.62 [14:33:47] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.71, 3.67, 3.64 [14:34:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.22, 3.29, 3.62 [14:34:12] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.64, 3.36, 3.41 [14:36:12] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.15, 3.33, 3.39 [14:38:12] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.15, 3.70, 3.66 [14:39:47] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.58, 3.92, 3.72 [14:40:11] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.23, 3.58, 3.50 [14:41:47] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.11, 3.53, 3.60 [14:42:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.97, 3.66, 3.69 [14:46:10] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.16, 2.90, 3.27 [14:47:47] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.35, 2.92, 3.34 [14:50:15] PROBLEM - matomo101 Current Load on matomo101 is CRITICAL: CRITICAL - load average: 4.98, 3.74, 2.93 [14:52:13] PROBLEM - matomo101 Current Load on matomo101 is WARNING: WARNING - load average: 3.82, 3.64, 2.98 [14:54:11] RECOVERY - matomo101 Current Load on matomo101 is OK: OK - load average: 2.51, 3.26, 2.92 [14:54:12] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.06, 3.97, 3.85 [14:54:17] PROBLEM - cloud11 Puppet on cloud11 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [14:55:47] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.82, 3.71, 3.54 [14:56:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.19, 3.89, 3.84 [14:57:47] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.18, 4.09, 3.69 [14:58:12] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.26, 4.29, 3.99 [14:59:47] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.86, 3.95, 3.69 [15:00:05] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.28, 3.81, 3.48 [15:02:04] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.85, 4.13, 3.61 [15:03:47] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.13, 3.61, 3.56 [15:04:04] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.76, 3.58, 3.48 [15:04:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.88, 3.80, 3.91 [15:05:47] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.53, 3.12, 3.38 [15:06:03] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.05, 3.82, 3.58 [15:08:03] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.41, 3.32, 3.43 [15:09:47] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.41, 4.00, 3.65 [15:10:02] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.90, 3.78, 3.57 [15:10:12] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.33, 3.72, 3.79 [15:11:47] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.94, 3.50, 3.51 [15:12:02] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.68, 3.35, 3.44 [15:12:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.31, 3.50, 3.70 [15:13:47] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.90, 2.93, 3.30 [15:14:12] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.33, 3.54, 3.67 [15:16:01] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.02, 3.27, 3.39 [15:20:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.17, 3.93, 3.89 [15:20:17] RECOVERY - cloud11 Puppet on cloud11 is OK: OK: Puppet is currently enabled, last run 25 seconds ago with 0 failures [15:22:12] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.25, 4.68, 4.19 [15:22:41] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.72, 4.30, 3.77 [15:23:21] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 2.55, 1.85, 1.48 [15:23:58] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.41, 3.54, 3.49 [15:25:21] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.86, 1.82, 1.52 [15:26:14] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.03, 1.83, 1.62 [15:27:20] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 2.93, 2.14, 1.67 [15:29:19] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.29, 1.74, 1.57 [15:30:03] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.93, 1.43, 1.51 [15:30:11] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.34, 1.89, 1.23 [15:31:19] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.93, 1.41, 1.47 [15:32:10] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.55, 1.42, 1.13 [15:36:32] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.85, 3.69, 3.93 [15:39:54] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.83, 4.10, 3.75 [15:42:28] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.37, 3.80, 3.86 [15:44:27] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.39, 3.23, 3.64 [15:45:52] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.99, 3.88, 3.77 [15:47:52] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.12, 4.56, 4.02 [15:48:24] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.16, 3.96, 3.83 [15:53:17] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.07, 1.77, 1.43 [15:55:16] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.96, 1.48, 1.37 [15:55:50] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.76, 3.54, 3.87 [15:57:49] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.40, 3.70, 3.88 [15:59:49] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.71, 3.58, 3.81 [16:00:16] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.86, 3.87, 4.00 [16:02:15] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 3.66, 4.03, 4.05 [16:04:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.68, 3.39, 4.00 [16:04:14] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.68, 3.57, 3.88 [16:07:46] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.74, 3.62, 3.66 [16:08:11] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.44, 4.08, 4.00 [16:08:12] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.56, 4.22, 4.15 [16:11:45] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.36, 3.31, 3.55 [16:12:08] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.31, 3.81, 3.94 [16:15:44] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.24, 3.45, 3.53 [16:16:06] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.67, 4.27, 4.05 [16:21:43] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.98, 3.70, 3.71 [16:25:59] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.13, 3.70, 3.92 [16:27:58] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.17, 3.81, 3.93 [16:29:57] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.09, 3.60, 3.85 [16:31:40] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.31, 3.64, 3.58 [16:31:55] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.21, 4.21, 4.04 [16:33:40] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.16, 3.62, 3.59 [16:33:54] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.42, 3.74, 3.90 [16:35:39] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.51, 2.84, 3.30 [16:36:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 1.94, 3.43, 3.91 [16:46:12] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.24, 4.26, 3.97 [16:49:47] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.45, 3.60, 3.53 [16:52:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.67, 3.78, 3.89 [16:53:47] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.30, 3.19, 3.39 [16:54:12] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 3.78, 4.12, 4.02 [16:55:57] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 3.27, 2.15, 1.51 [16:56:11] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 3.51, 2.27, 1.59 [16:56:53] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.57, 2.92, 1.96 [16:58:32] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.58, 4.27, 3.58 [16:59:47] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.20, 4.11, 3.74 [16:59:56] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.80, 1.94, 1.57 [17:00:31] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.95, 3.72, 3.46 [17:00:53] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.73, 1.68, 1.67 [17:01:47] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.07, 3.72, 3.65 [17:02:31] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.51, 3.29, 3.34 [17:03:55] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 1.55, 1.70, 1.55 [17:05:39] !log modified an email with a typo on phab [17:05:43] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.24, 1.81, 1.72 [17:05:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:07:38] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.03, 1.58, 1.65 [17:13:27] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.78, 3.76, 3.47 [17:13:31] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.99, 1.94, 1.78 [17:15:27] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.00, 3.45, 3.39 [17:17:31] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.31, 1.58, 1.67 [17:17:47] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.54, 3.59, 3.53 [17:19:47] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.31, 3.65, 3.57 [17:21:25] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.46, 3.60, 3.45 [17:21:47] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.71, 4.50, 3.87 [17:23:25] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.55, 3.26, 3.35 [17:23:31] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.70, 1.72, 1.69 [17:25:31] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.43, 1.89, 1.75 [17:27:31] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.20, 1.64, 1.68 [17:31:30] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.79, 1.87, 1.77 [17:33:21] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.40, 3.44, 3.45 [17:33:31] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.87, 1.51, 1.66 [17:35:21] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.07, 3.82, 3.60 [17:35:47] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.37, 3.77, 3.90 [17:37:20] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.27, 3.23, 3.40 [17:39:31] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.52, 1.88, 1.72 [17:40:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.68, 3.45, 3.97 [17:41:31] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.16, 1.55, 1.62 [17:41:47] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.13, 2.74, 3.37 [17:44:12] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.01, 3.91, 4.00 [17:45:31] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.59, 1.73, 1.68 [17:47:06] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - dnd.bellinrattin.it All nameservers failed to answer the query. [17:47:30] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.82, 1.45, 1.59 [17:48:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.12, 3.71, 3.91 [17:48:40] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 2.29, 1.95, 1.58 [17:49:47] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.32, 3.34, 3.42 [17:50:12] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 7.83, 5.03, 4.35 [17:50:16] PROBLEM - wiki.seamly.net - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 73, in check_records nameserversans = dns_resolver.resolve(root_domain, 'NS') File "/usr/lib/p [17:50:16] ist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query seamly.net. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [17:51:47] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.46, 3.17, 3.36 [17:52:39] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.27, 1.86, 1.65 [17:53:31] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.61, 2.03, 1.76 [17:54:38] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.91, 1.53, 1.56 [17:56:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.12, 3.36, 3.83 [17:57:31] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.48, 1.81, 1.74 [17:59:31] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.80, 1.44, 1.61 [18:06:12] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.06, 3.57, 3.65 [18:07:11] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.60, 3.35, 3.14 [18:07:47] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.93, 3.28, 3.12 [18:09:10] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.55, 3.76, 3.31 [18:11:09] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.50, 3.72, 3.35 [18:12:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.35, 3.73, 3.73 [18:13:09] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.07, 3.92, 3.47 [18:13:47] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.09, 4.08, 3.47 [18:14:12] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.41, 4.11, 3.87 [18:15:08] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.91, 3.94, 3.54 [18:15:11] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.93, 1.58, 1.03 [18:16:57] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp21.miraheze.org - CNAME OK [18:17:08] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.37, 3.91, 3.56 [18:17:11] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.29, 1.83, 1.18 [18:20:10] RECOVERY - wiki.seamly.net - reverse DNS on sslhost is OK: SSL OK - wiki.seamly.net reverse DNS resolves to cp21.miraheze.org - CNAME OK [18:21:07] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.85, 3.93, 3.66 [18:23:11] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.84, 1.98, 1.49 [18:25:47] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.18, 3.44, 3.61 [18:27:57] PROBLEM - mabi.myomi.net - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 73, in check_records nameserversans = dns_resolver.resolve(root_domain, 'NS') File "/usr/lib/py [18:27:57] st-packages/dns/resolver.py", line 1043, in resolve timeout = self._compute_timeout(start, lifetime) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 950, in _compute_timeout raise Timeout(timeout=duration)dns.exception.Timeout: The DNS operation timed out after 5.406712532043457 seconds [18:28:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.39, 3.72, 3.97 [18:29:11] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.16, 1.99, 1.65 [18:30:12] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.19, 3.92, 4.02 [18:30:54] [02puppet] 07Universal-Omega opened pull request 03#2555: imagemagick: replace `require_package` with `ensure_packages` - 13https://github.com/miraheze/puppet/pull/2555 [18:30:55] [url] Page not found · GitHub · GitHub | github.com [18:31:04] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.53, 3.67, 3.50 [18:31:11] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.83, 1.91, 1.66 [18:31:47] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.14, 4.28, 3.89 [18:35:47] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.36, 3.55, 3.71 [18:36:54] PROBLEM - www.project-patterns.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'project-patterns.com' expires in 15 day(s) (Tue 31 May 2022 18:24:19 GMT +0000). [18:37:03] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.37, 3.93, 3.76 [18:41:11] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.51, 1.67, 1.66 [18:41:47] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.82, 3.82, 3.74 [18:43:47] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.98, 3.64, 3.67 [18:45:57] PROBLEM - wikien.wildterra2.com - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wikien.wildterra2.com All nameservers failed to answer the query. [18:47:00] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.81, 2.94, 3.38 [18:51:00] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.21, 3.23, 3.41 [18:51:06] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.02, 1.81, 1.71 [18:51:53] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.69, 9.11, 8.01 [18:53:00] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.53, 3.06, 3.33 [18:53:05] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.33, 1.64, 1.67 [18:53:53] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.10, 8.95, 8.07 [18:55:47] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.86, 3.17, 3.36 [18:56:42] RECOVERY - mabi.myomi.net - reverse DNS on sslhost is OK: SSL OK - mabi.myomi.net reverse DNS resolves to cp21.miraheze.org - CNAME OK [19:03:53] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.25, 10.69, 9.16 [19:07:53] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.07, 10.48, 9.54 [19:09:38] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.05, 3.76, 3.51 [19:09:56] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.51, 3.59, 3.39 [19:13:53] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.78, 8.96, 9.26 [19:14:54] RECOVERY - wikien.wildterra2.com - reverse DNS on sslhost is OK: SSL OK - wikien.wildterra2.com reverse DNS resolves to cp21.miraheze.org - CNAME OK [19:15:54] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.13, 3.40, 3.37 [19:18:37] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 73, in check_records nameserversans = dns_resolver.resolve(root_domain, 'NS') File "/usr/l [19:18:38] n3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query bellinrattin.it. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [19:19:53] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.50, 3.56, 3.45 [19:23:52] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.34, 4.03, 3.65 [19:26:15] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.80, 1.52, 1.21 [19:27:31] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.94, 1.67, 1.44 [19:28:14] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 1.25, 1.41, 1.20 [19:29:31] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.18, 1.43, 1.38 [19:29:50] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.16, 3.58, 3.64 [19:30:02] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.98, 1.62, 1.40 [19:32:02] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.15, 1.41, 1.35 [19:33:22] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.75, 3.48, 3.95 [19:33:31] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.17, 1.83, 1.55 [19:35:21] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.04, 3.90, 4.04 [19:35:31] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.14, 1.59, 1.50 [19:39:18] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.88, 3.89, 4.00 [19:39:47] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.00, 4.01, 3.73 [19:41:17] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.16, 3.97, 4.02 [19:41:47] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.37, 3.70, 3.64 [19:43:15] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.25, 3.51, 3.83 [19:45:14] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.88, 4.66, 4.20 [19:45:46] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 9.17, 5.74, 4.39 [19:52:53] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.15, 1.58, 1.36 [19:54:53] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.95, 1.33, 1.30 [19:55:43] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.79, 3.60, 3.97 [19:57:43] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.07, 3.91, 4.02 [20:01:04] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.72, 3.59, 3.99 [20:01:42] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.57, 3.75, 3.92 [20:04:53] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.22, 1.69, 1.47 [20:05:01] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.01, 3.77, 3.98 [20:05:03] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/89e465430fd7...346d67de0ab8 [20:05:03] [url] Comparing 89e465430fd7...346d67de0ab8 · miraheze/ManageWiki · GitHub | github.com [20:05:04] [02miraheze/ManageWiki] 07Universal-Omega 03346d67d - add null check for $configs['type'] [20:05:55] [02puppet] 07Universal-Omega opened pull request 03#2556: varnish: force thumb_handler.php to mwtask111 - 13https://github.com/miraheze/puppet/pull/2556 [20:05:55] ... [20:06:53] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.34, 1.63, 1.48 [20:07:00] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.39, 3.60, 3.89 [20:07:40] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.01, 3.54, 3.76 [20:08:12] [02puppet] 07RhinosF1 commented on pull request 03#2556: varnish: force thumb_handler.php to mwtask111 - 13https://github.com/miraheze/puppet/pull/2556#issuecomment-1127016433 [20:08:12] [url] varnish: force thumb_handler.php to mwtask111 by Universal-Omega · Pull Request #2556 · miraheze/puppet · GitHub | github.com [20:08:59] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.38, 4.11, 4.03 [20:09:23] CosmicAlpha: not objecting to ^ but stating the fact [20:09:31] miraheze/ManageWiki - Universal-Omega the build passed. [20:09:40] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.43, 3.64, 3.78 [20:09:42] !log [universalomega@mw111] sudo -u www-data php /srv/mediawiki/w/extensions/SemanticMediaWiki/maintenance/setupStore.php --wiki=constantnoblewiki (END - exit=0) [20:09:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:10:12] RhinosF1: ^ that was not ran on mw111, now done and works. [20:10:17] and OK [20:10:44] CosmicAlpha: hmm, must have missed it [20:10:52] It should have [20:11:39] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.91, 4.15, 3.95 [20:14:55] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.83, 3.89, 3.96 [20:15:36] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [20:16:53] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.33, 4.26, 4.07 [20:18:19] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - dnd.bellinrattin.it All nameservers failed to answer the query. [20:18:52] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.62, 3.83, 3.96 [20:19:37] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.85, 3.69, 3.93 [20:20:08] [02puppet] 07Universal-Omega commented on pull request 03#2556: varnish: force thumb_handler.php to mwtask111 - 13https://github.com/miraheze/puppet/pull/2556#issuecomment-1127019381 [20:20:08] [url] varnish: force thumb_handler.php to mwtask111 by Universal-Omega · Pull Request #2556 · miraheze/puppet · GitHub | github.com [20:20:36] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [20:22:02] [02puppet] 07paladox closed pull request 03#2554: Move systemd_override for PHP-FPM to MediaWiki module - 13https://github.com/miraheze/puppet/pull/2554 [20:22:02] [url] Page not found · GitHub · GitHub | github.com [20:22:03] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+1/-1/±1] 13https://github.com/miraheze/puppet/compare/375789ccb72c...baf3144fbdd0 [20:22:04] [url] Comparing 375789ccb72c...baf3144fbdd0 · miraheze/puppet · GitHub | github.com [20:22:05] [02miraheze/puppet] 07Universal-Omega 03baf3144 - Move systemd_override for PHP-FPM to MediaWiki module (#2554) [20:22:47] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.13, 1.67, 1.50 [20:23:46] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.25, 1.99, 1.55 [20:24:31] CosmicAlpha: why has restart always been dropped [20:24:46] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.14, 1.48, 1.45 [20:32:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.74, 3.33, 3.98 [20:32:43] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.99, 3.00, 3.39 [20:33:30] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 0.98, 1.70, 1.74 [20:34:12] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.28, 3.96, 4.12 [20:34:47] RhinosF1: not necessary, I don't think. That override is just for preventing a reload if FPM config files are broken (according to the comment), and the `systemd::unit` directly declares `restart => false` (meaning it isn't intended for restarting PHP-FPM from what I can tell). Besides, the PHP changes should make it properly soft-restart should the need arise/if fpm workers are being killed, etc... If I am wrong, and it [20:34:47] becomes necessary again, I will revert that part of it. [20:35:31] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.70, 1.61, 1.69 [20:36:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.18, 3.60, 3.97 [20:36:39] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.15, 3.29, 3.43 [20:37:16] CosmicAlpha: okay, cool. [20:37:32] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.93, 3.06, 3.38 [20:38:12] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.43, 3.92, 4.04 [20:38:37] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.66, 3.96, 3.65 [20:42:35] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.49, 3.49, 3.56 [20:44:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.45, 3.64, 3.92 [20:48:10] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 86, in check_records cname = str(dns_resolver.resolve(hostname, 'CNAME')[0]) File "/usr/li [20:48:10] 3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query dnd.bellinrattin.it. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [20:48:12] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.61, 4.20, 4.07 [20:48:15] [02puppet] 07Universal-Omega opened pull request 03#2557: letsencrypt: replace `require_package` with `ensure_packages` - 13https://github.com/miraheze/puppet/pull/2557 [20:48:16] [url] Page not found · GitHub · GitHub | github.com [20:48:28] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.08, 3.78, 3.52 [20:49:13] [02puppet] 07Universal-Omega synchronize pull request 03#2557: letsencrypt: replace `require_package` with `ensure_packages` - 13https://github.com/miraheze/puppet/pull/2557 [20:49:13] [url] Page not found · GitHub · GitHub | github.com [20:50:28] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.36, 3.80, 3.58 [20:50:29] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.00, 2.98, 3.30 [20:52:55] [02puppet] 07paladox closed pull request 03#2557: letsencrypt: replace `require_package` with `ensure_packages` - 13https://github.com/miraheze/puppet/pull/2557 [20:52:55] [url] Page not found · GitHub · GitHub | github.com [20:52:56] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/puppet/compare/baf3144fbdd0...d48daf76c2eb [20:52:57] [url] Comparing baf3144fbdd0...d48daf76c2eb · miraheze/puppet · GitHub | github.com [20:52:58] [02miraheze/puppet] 07Universal-Omega 03d48daf7 - letsencrypt: replace `require_package` with `ensure_packages` (#2557) [20:53:07] [02puppet] 07paladox closed pull request 03#2555: imagemagick: replace `require_package` with `ensure_packages` - 13https://github.com/miraheze/puppet/pull/2555 [20:53:08] [url] Page not found · GitHub · GitHub | github.com [20:53:09] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/d48daf76c2eb...b7488b302d45 [20:53:09] [url] Comparing d48daf76c2eb...b7488b302d45 · miraheze/puppet · GitHub | github.com [20:53:10] [02miraheze/puppet] 07Universal-Omega 03b7488b3 - imagemagick: replace `require_package` with `ensure_packages` (#2555) [20:55:22] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.51, 10.17, 9.01 [20:56:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.15, 3.32, 3.81 [20:56:24] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.61, 3.36, 3.42 [20:56:26] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.88, 2.98, 3.31 [20:57:06] Thanks paladox! I will do a PR in a second to finish off the replacements of require_package that I have been doing with unrelated stuff for awhile (a few months), whenever I did a PR that touched a file with them I've been doing that, but I'll finish it with a PR soon now. [20:57:21] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.57, 9.33, 8.86 [20:57:34] thanks [20:58:12] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.80, 4.35, 4.10 [20:58:23] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.06, 4.03, 3.65 [21:00:25] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.15, 3.43, 3.44 [21:02:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.96, 3.63, 3.87 [21:02:24] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.94, 3.67, 3.51 [21:04:23] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.55, 3.78, 3.58 [21:10:15] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.54, 3.89, 3.89 [21:10:22] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.27, 2.92, 3.28 [21:13:06] [02puppet] 07Universal-Omega opened pull request 03#2558: Replace `require_package` with `ensure_packages` - 13https://github.com/miraheze/puppet/pull/2558 [21:13:06] [url] Page not found · GitHub · GitHub | github.com [21:14:04] paladox: No problem and done with the PR now ^ [21:14:12] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.46, 4.54, 4.11 [21:15:01] [02puppet] 07paladox closed pull request 03#2558: Replace `require_package` with `ensure_packages` - 13https://github.com/miraheze/puppet/pull/2558 [21:15:01] ... [21:15:02] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-1/±15] 13https://github.com/miraheze/puppet/compare/b7488b302d45...14be4e584de7 [21:15:03] [url] Comparing b7488b302d45...14be4e584de7 · miraheze/puppet · GitHub | github.com [21:15:04] [02miraheze/puppet] 07Universal-Omega 0314be4e5 - Replace `require_package` with `ensure_packages` (#2558) [21:18:01] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - dnd.bellinrattin.it All nameservers failed to answer the query. [21:20:08] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.50, 3.73, 3.75 [21:22:18] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.31, 3.96, 3.47 [21:24:36] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [21:29:36] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [21:31:50] [02puppet] 07Universal-Omega opened pull request 03#2559: mediawiki: use `ensure_packages` for lilypond - 13https://github.com/miraheze/puppet/pull/2559 [21:31:50] [url] Page not found · GitHub · GitHub | github.com [21:32:36] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 4.38, 4.03, 2.25 [21:38:31] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 0.88, 1.92, 1.86 [21:39:11] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.90, 1.80, 1.61 [21:42:28] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.52, 1.47, 1.67 [21:45:09] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.77, 1.44, 1.55 [21:47:51] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 86, in check_records cname = str(dns_resolver.resolve(hostname, 'CNAME')[0]) File "/usr/li [21:47:51] 3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query dnd.bellinrattin.it. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [21:52:10] [02puppet] 07Universal-Omega opened pull request 03#2560: Use Stdlib::HTTPSUrl - 13https://github.com/miraheze/puppet/pull/2560 [21:52:11] [url] Page not found · GitHub · GitHub | github.com [21:53:13] [02puppet] 07Universal-Omega synchronize pull request 03#2560: Use Stdlib::HTTPSUrl - 13https://github.com/miraheze/puppet/pull/2560 [21:53:13] [url] Page not found · GitHub · GitHub | github.com [21:55:17] [02puppet] 07Universal-Omega synchronize pull request 03#2560: Use Stdlib::HTTPSUrl - 13https://github.com/miraheze/puppet/pull/2560 [21:55:17] [url] Page not found · GitHub · GitHub | github.com [21:55:47] [02puppet] 07Universal-Omega edited pull request 03#2560: Monitoring: Use Stdlib::HTTPSUrl for URLs - 13https://github.com/miraheze/puppet/pull/2560 [21:55:47] ... [21:59:03] [02puppet] 07Universal-Omega edited pull request 03#2560: monitoring: Use Stdlib::HTTPSUrl for URLs - 13https://github.com/miraheze/puppet/pull/2560 [21:59:03] [url] Page not found · GitHub · GitHub | github.com [22:05:27] [02puppet] 07Universal-Omega opened pull request 03#2561: users: use VMlib::Ensure - 13https://github.com/miraheze/puppet/pull/2561 [22:05:27] [url] Page not found · GitHub · GitHub | github.com [22:08:15] [02puppet] 07Universal-Omega synchronize pull request 03#2561: users: use VMlib::Ensure - 13https://github.com/miraheze/puppet/pull/2561 [22:08:16] [url] Page not found · GitHub · GitHub | github.com [22:08:29] [02puppet] 07Universal-Omega synchronize pull request 03#2561: users: use VMlib::Ensure - 13https://github.com/miraheze/puppet/pull/2561 [22:08:30] ... [22:10:08] [02puppet] 07Universal-Omega synchronize pull request 03#2561: users: use VMlib::Ensure - 13https://github.com/miraheze/puppet/pull/2561 [22:10:09] ... [22:10:53] [02puppet] 07Universal-Omega synchronize pull request 03#2561: users: use VMlib::Ensure - 13https://github.com/miraheze/puppet/pull/2561 [22:17:23] !log ALTER TABLE searchindex ADD FULLTEXT INDEX si_title (si_title), ADD FULLTEXT INDEX si_text (si_text); for bnwikiwiki [22:17:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:17:42] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - dnd.bellinrattin.it All nameservers failed to answer the query. [22:41:34] [02ssl] 07Universal-Omega opened pull request 03#517: Add en.omniversalis.org certificate - 13https://github.com/miraheze/ssl/pull/517 [22:41:34] [url] Page not found · GitHub · GitHub | github.com [22:47:33] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 86, in check_records cname = str(dns_resolver.resolve(hostname, 'CNAME')[0]) File "/usr/li [22:47:33] 3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query dnd.bellinrattin.it. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [23:00:02] !log [@mwtask111] starting deploy of {'l10nupdate': True} to all [23:00:03] !log [@test101] starting deploy of {'l10nupdate': True} to all [23:00:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:00:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:03:47] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.02, 3.27, 3.95 [23:03:53] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.20, 3.51, 3.92 [23:05:47] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.72, 3.87, 4.08 [23:05:52] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.48, 3.97, 4.04 [23:09:13] !log [@mwtask111] finished deploy of {'l10nupdate': True} to all - SUCCESS in 551s [23:09:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:10:12] PROBLEM - mwtask111 Current Load on mwtask111 is CRITICAL: CRITICAL - load average: 3.79, 5.21, 3.47 [23:11:49] !log [@test101] finished deploy of {'l10nupdate': True} to all - SUCCESS in 706s [23:11:50] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.68, 3.46, 3.83 [23:11:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:12:12] PROBLEM - mwtask111 Current Load on mwtask111 is WARNING: WARNING - load average: 1.51, 3.90, 3.20 [23:14:12] RECOVERY - mwtask111 Current Load on mwtask111 is OK: OK - load average: 1.24, 2.98, 2.94 [23:15:47] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.86, 3.51, 3.85 [23:17:24] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - dnd.bellinrattin.it All nameservers failed to answer the query. [23:17:30] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 1.77, 2.32, 1.36 [23:17:49] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.07, 2.80, 3.38 [23:19:31] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.48, 1.66, 1.23 [23:26:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.73, 3.29, 3.89 [23:28:12] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.24, 3.45, 3.86 [23:29:45] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.77, 3.62, 3.25 [23:30:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.85, 3.29, 3.76 [23:31:45] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.41, 3.29, 3.16 [23:31:47] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.20, 2.95, 3.35 [23:33:44] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.36, 2.86, 3.02 [23:35:10] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 18.60, 11.57, 8.00 [23:35:22] PROBLEM - cp31 Stunnel HTTP for mw111 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:35:34] PROBLEM - cp21 Stunnel HTTP for mw111 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:37:21] RECOVERY - cp31 Stunnel HTTP for mw111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14640 bytes in 0.312 second response time [23:37:34] RECOVERY - cp21 Stunnel HTTP for mw111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14640 bytes in 0.490 second response time [23:39:09] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.30, 11.01, 8.69 [23:40:12] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.30, 3.58, 3.60 [23:41:15] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.14, 10.14, 8.63 [23:42:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.86, 3.63, 3.61 [23:44:12] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.49, 3.92, 3.72 [23:46:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.54, 3.67, 3.64 [23:47:15] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp20.miraheze.org - CNAME OK [23:52:12] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.04, 3.03, 3.33 [23:56:12] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.24, 4.08, 3.67 [23:57:13] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.15, 3.40, 2.07 [23:58:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.82, 3.80, 3.61