[00:02:45] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.77, 4.30, 3.80 [00:02:48] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.18, 3.65, 3.37 [00:02:49] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.15, 4.37, 3.70 [00:04:43] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.54, 4.25, 3.63 [00:08:40] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.81, 3.90, 3.79 [00:10:36] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.97, 4.69, 4.08 [00:16:15] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.82, 3.64, 3.74 [00:16:26] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.11, 3.49, 3.77 [00:17:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [00:22:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [00:22:16] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.66, 3.83, 3.81 [00:25:02] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.39, 9.45, 8.53 [00:27:01] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.47, 9.12, 8.55 [00:27:46] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.70, 3.87, 3.70 [00:29:41] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.90, 3.49, 3.58 [00:30:03] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.40, 3.77, 3.77 [00:32:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [00:32:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.66, 3.33, 3.88 [00:33:57] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.29, 3.59, 3.66 [00:35:27] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.75, 3.10, 3.38 [00:35:53] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.79, 3.41, 3.57 [00:36:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.25, 3.84, 3.96 [00:37:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [00:37:50] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.02, 3.59, 3.61 [00:38:54] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.83, 1.86, 1.48 [00:39:47] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.38, 3.31, 3.50 [00:40:54] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.43, 2.23, 1.66 [00:41:43] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.42, 3.05, 3.39 [00:42:53] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.32, 1.88, 1.60 [00:44:53] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.94, 1.63, 1.55 [00:46:07] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 73, in check_records nameserversans = dns_resolver.resolve(root_domain, 'NS') File "/usr/l [00:46:07] n3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query bellinrattin.it. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [00:52:49] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.63, 9.64, 9.09 [00:54:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.99, 3.39, 3.90 [00:54:48] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.17, 8.96, 8.90 [00:56:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:02:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.21, 4.63, 4.14 [01:03:03] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.06, 3.89, 3.46 [01:05:20] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.60, 3.94, 3.39 [01:05:49] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 1.16, 2.14, 1.80 [01:07:03] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.78, 3.82, 3.53 [01:07:19] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.72, 3.45, 3.28 [01:07:49] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.84, 1.77, 1.71 [01:09:03] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.37, 3.98, 3.62 [01:09:20] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.14, 4.52, 3.68 [01:09:48] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.65, 1.45, 1.60 [01:12:36] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.53, 10.79, 9.91 [01:14:35] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.99, 10.00, 9.75 [01:15:05] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp21.miraheze.org - CNAME OK [01:16:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:19:46] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.94, 1.70, 1.65 [01:23:19] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.50, 3.95, 3.94 [01:23:46] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.29, 1.62, 1.64 [01:27:45] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.89, 1.78, 1.70 [01:29:19] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.74, 4.01, 3.92 [01:29:45] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.51, 1.65, 1.66 [01:30:13] PROBLEM - wiki.phgalaxy.eu.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.phgalaxy.eu.org could not be found [01:33:20] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.70, 3.74, 3.82 [01:33:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:35:20] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.32, 4.29, 4.03 [01:39:19] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.42, 3.90, 3.93 [01:43:17] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.74, 10.39, 9.86 [01:45:16] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.47, 9.17, 9.47 [01:49:19] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.46, 1.97, 1.44 [01:51:18] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.64, 1.91, 1.49 [01:53:19] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.55, 3.60, 3.65 [01:53:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:55:19] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.33, 3.56, 3.63 [01:57:03] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.66, 3.50, 3.91 [01:57:16] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.62, 1.33, 1.39 [02:00:00] RECOVERY - wiki.phgalaxy.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.phgalaxy.eu.org reverse DNS resolves to cp21.miraheze.org - CNAME OK [02:01:19] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.40, 3.02, 3.38 [02:04:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.66, 3.33, 3.98 [02:05:03] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.11, 2.50, 3.28 [02:07:04] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.30, 10.05, 9.01 [02:11:02] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.84, 9.71, 9.12 [02:14:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.59, 3.95, 3.89 [02:16:46] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 3.82, 4.03, 3.65 [02:17:19] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.93, 3.58, 3.43 [02:18:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [02:18:43] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.85, 3.69, 3.58 [02:19:19] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.40, 3.81, 3.52 [02:19:40] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.96, 1.58, 1.31 [02:20:40] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.29, 4.73, 3.97 [02:21:19] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.57, 3.68, 3.51 [02:21:40] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.40, 1.59, 1.35 [02:23:19] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.23, 3.07, 3.30 [02:28:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.83, 3.57, 3.93 [02:28:27] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.56, 3.36, 3.62 [02:30:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.20, 3.92, 4.00 [02:31:38] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.82, 1.76, 1.54 [02:32:20] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.15, 2.93, 3.39 [02:33:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [02:33:37] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.08, 1.65, 1.53 [02:34:01] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.63, 9.38, 8.18 [02:34:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.50, 3.94, 4.00 [02:34:42] PROBLEM - mabi.myomi.net - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 123, in main rdns_hostname = get_reverse_dnshostname(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 108, in get_reverse_dnshostname resolved_ip_addr = str(dns_resolver.resolve(hos [02:34:42] AAAA')[0]) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 1043, in resolve timeout = self._compute_timeout(start, lifetime) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 950, in _compute_timeout raise Timeout(timeout=duration)dns.exception.Timeout: The DNS operation timed out after 5.404881000518799 seconds [02:36:01] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 5.04, 7.71, 7.71 [02:46:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.53, 4.15, 3.87 [02:52:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.86, 3.64, 3.78 [03:00:22] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.80, 2.88, 3.34 [03:03:24] RECOVERY - mabi.myomi.net - reverse DNS on sslhost is OK: SSL OK - mabi.myomi.net reverse DNS resolves to cp20.miraheze.org - CNAME OK [03:04:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.42, 3.49, 3.50 [03:06:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.09, 3.96, 3.69 [03:07:20] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.16, 3.67, 3.20 [03:08:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.39, 3.46, 3.55 [03:09:20] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.14, 3.23, 3.08 [03:12:54] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 73, in check_records nameserversans = dns_resolver.resolve(root_domain, 'NS') File "/usr/l [03:12:54] n3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query bellinrattin.it. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [03:14:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.02, 3.57, 3.54 [03:16:22] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.69, 3.17, 3.40 [03:17:06] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:17:25] [02ssl] 07ajhalili2006 synchronize pull request 03#514: Add redirects for wiki.rtapp.tk and wiki.recaptime.tk as per T9210 - 13https://github.com/miraheze/ssl/pull/514 [03:17:26] [url] Page not found · GitHub · GitHub | github.com [03:19:39] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.73, 1.51, 1.20 [03:21:38] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.85, 1.29, 1.16 [03:22:06] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:22:31] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.75, 2.09, 1.60 [03:25:20] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 7.45, 4.28, 3.27 [03:26:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 7.55, 5.47, 4.19 [03:27:03] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.62, 5.43, 3.97 [03:33:18] PROBLEM - wiki.phgalaxy.eu.org - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 86, in check_records cname = str(dns_resolver.resolve(hostname, 'CNAME')[0]) File "/usr/l [03:33:18] n3/dist-packages/dns/resolver.py", line 1030, in resolve (request, answer) = resolution.next_request() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 584, in next_request raise NXDOMAIN(qnames=self.qnames_to_try,dns.resolver.NXDOMAIN: The DNS query name does not exist: wiki.phgalaxy.eu.org. [03:39:20] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.38, 3.88, 3.73 [03:41:20] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.75, 4.25, 3.86 [03:41:52] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp20.miraheze.org - CNAME OK [03:45:03] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.86, 3.71, 3.95 [03:45:20] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.42, 3.49, 3.66 [03:47:01] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.92, 4.00, 4.01 [03:49:01] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.74, 3.91, 3.98 [03:49:18] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.69, 4.13, 3.83 [03:51:01] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.39, 4.87, 4.35 [03:56:25] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.84, 1.42, 1.98 [03:57:15] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.89, 10.25, 9.04 [03:59:14] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.92, 9.61, 8.97 [03:59:19] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.36, 3.76, 3.95 [04:00:24] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.80, 1.00, 1.68 [04:03:05] RECOVERY - wiki.phgalaxy.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.phgalaxy.eu.org reverse DNS resolves to cp21.miraheze.org - CNAME OK [04:03:19] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.16, 3.93, 3.97 [04:05:10] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.02, 10.40, 9.43 [04:05:19] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.53, 3.81, 3.92 [04:07:09] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.13, 9.40, 9.17 [04:11:19] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.03, 3.90, 3.87 [04:13:19] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.47, 3.67, 3.78 [04:16:17] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.79, 1.74, 1.26 [04:17:03] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.02, 3.39, 3.86 [04:18:17] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.75, 1.33, 1.16 [04:18:37] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.23, 1.61, 0.96 [04:19:19] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.08, 2.67, 3.29 [04:20:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.20, 3.00, 3.86 [04:20:37] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.99, 1.77, 1.10 [04:22:37] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.12, 1.51, 1.08 [04:24:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.09, 3.47, 3.85 [04:26:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.94, 3.63, 3.86 [04:27:03] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 7.19, 4.23, 3.82 [04:28:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 3.50, 4.02, 4.01 [04:29:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [04:29:19] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.67, 3.18, 3.14 [04:31:03] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.46, 3.70, 3.68 [04:31:19] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.97, 3.06, 3.10 [04:33:03] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.79, 3.69, 3.65 [04:34:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [04:34:17] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.79, 1.41, 1.12 [04:34:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.36, 3.91, 3.98 [04:35:03] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.11, 3.27, 3.49 [04:36:17] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.47, 1.05, 1.02 [04:38:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.47, 4.29, 4.08 [04:39:03] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.64, 2.98, 3.32 [04:40:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.69, 3.75, 3.92 [04:48:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.47, 3.75, 3.79 [04:48:37] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.85, 1.62, 1.35 [04:52:37] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.43, 1.64, 1.44 [04:54:33] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.71, 3.72, 3.56 [04:56:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.52, 3.51, 3.73 [04:56:30] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.89, 3.77, 3.57 [05:00:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.69, 4.34, 4.01 [05:02:20] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.74, 3.70, 3.60 [05:03:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:06:13] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.23, 2.88, 3.28 [05:06:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.44, 3.74, 3.97 [05:08:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:12:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.63, 3.17, 3.57 [05:15:53] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.66, 3.87, 3.45 [05:17:19] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.15, 3.47, 3.21 [05:19:19] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.67, 3.58, 3.28 [05:19:47] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.69, 3.31, 3.31 [05:21:18] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.65, 2.04, 1.73 [05:23:13] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.79, 1.91, 1.72 [05:23:19] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.32, 3.00, 3.11 [05:26:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.34, 3.51, 3.83 [05:30:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.60, 3.48, 3.70 [05:32:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.29, 3.26, 3.58 [05:34:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.24, 3.79, 3.73 [05:36:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.24, 3.20, 3.52 [05:40:22] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.65, 2.93, 3.35 [05:48:04] !log MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_user = '52237' AND euw_wiki = 'cosmoswiki'; [05:48:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:48:37] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.23, 1.98, 1.82 [05:52:37] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.74, 1.98, 1.88 [06:00:37] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.40, 1.47, 1.65 [06:08:37] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.54, 1.93, 1.74 [06:12:54] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.57, 4.14, 3.54 [06:13:16] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.93, 3.68, 3.27 [06:15:13] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.75, 2.96, 3.05 [06:19:19] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.54, 3.16, 2.83 [06:20:47] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.67, 3.99, 3.74 [06:21:19] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.77, 2.98, 2.80 [06:22:44] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.33, 4.00, 3.76 [06:24:42] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 4.00, 3.88, 3.74 [06:30:35] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.60, 2.67, 3.26 [07:01:53] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.83, 3.53, 2.92 [07:01:59] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.10, 3.88, 3.14 [07:03:49] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.88, 2.95, 2.78 [07:03:56] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.95, 3.20, 2.99 [07:39:22] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 86, in check_records cname = str(dns_resolver.resolve(hostname, 'CNAME')[0]) File "/usr/li [07:39:22] 3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query dnd.bellinrattin.it. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [08:15:24] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.88, 3.55, 3.09 [08:17:21] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.06, 3.22, 3.04 [08:57:30] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 1.60, 3.24, 2.10 [09:03:30] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.01, 1.73, 1.82 [09:05:30] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.51, 1.29, 1.64 [09:06:28] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - dnd.bellinrattin.it All nameservers failed to answer the query. [09:27:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.63, 3.26, 2.69 [09:29:10] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.68, 3.04, 2.68 [09:34:37] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.21, 1.32, 1.91 [09:40:37] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.01, 1.14, 1.63 [09:50:37] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.85, 1.53, 1.56 [09:52:37] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.15, 1.39, 1.51 [10:06:28] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp21.miraheze.org - CNAME OK [10:18:37] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.17, 1.79, 1.56 [10:20:37] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.83, 1.86, 1.62 [10:24:37] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.41, 1.63, 1.59 [10:38:37] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.71, 1.64, 1.58 [10:44:37] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.67, 1.70, 1.64 [10:44:55] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.76, 3.18, 2.60 [10:46:50] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.98, 3.13, 2.65 [10:48:37] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.35, 1.94, 1.74 [10:54:37] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.60, 1.90, 1.82 [10:55:13] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.91, 3.51, 3.04 [10:55:30] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.53, 1.72, 1.26 [10:57:11] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.33, 3.08, 2.93 [10:57:30] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.83, 1.47, 1.22 [11:00:37] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.16, 1.89, 1.84 [11:02:37] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.61, 1.79, 1.81 [11:03:02] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.45, 3.14, 2.95 [11:04:59] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.36, 3.03, 2.92 [11:08:37] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.45, 1.55, 1.70 [11:10:50] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.30, 3.54, 3.15 [11:14:45] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.11, 4.06, 3.42 [11:16:11] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.61, 3.48, 3.05 [11:16:43] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.43, 3.64, 3.36 [11:18:08] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.97, 2.95, 2.91 [11:18:41] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.83, 3.06, 3.18 [11:20:16] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.44, 1.95, 1.75 [11:22:11] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.43, 1.76, 1.70 [11:24:06] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.43, 1.61, 1.65 [11:49:03] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.15, 1.73, 1.50 [11:52:53] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.56, 1.75, 1.57 [11:54:48] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.33, 1.62, 1.54 [12:08:29] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 86, in check_records cname = str(dns_resolver.resolve(hostname, 'CNAME')[0]) File "/usr/li [12:08:29] 3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query dnd.bellinrattin.it. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [12:13:28] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.44, 3.04, 2.72 [12:15:26] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.11, 2.92, 2.73 [12:20:37] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.42, 2.03, 1.74 [12:22:37] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.89, 1.98, 1.76 [12:24:59] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.21, 9.94, 8.80 [12:26:59] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.67, 9.26, 8.68 [12:37:27] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp21.miraheze.org - CNAME OK [12:39:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [12:40:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.57, 10.80, 9.74 [12:42:51] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.11, 9.94, 9.55 [12:48:37] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.61, 2.12, 1.88 [12:49:03] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.49, 9.14, 7.95 [12:51:01] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.94, 8.74, 7.95 [12:54:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [12:56:37] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.27, 1.73, 1.83 [13:00:37] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.33, 1.41, 1.67 [13:14:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.35, 3.15, 2.80 [13:16:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.98, 3.47, 2.97 [13:20:22] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.28, 3.30, 3.01 [13:20:31] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.90, 10.20, 9.12 [13:20:37] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.75, 1.57, 1.45 [13:21:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [13:22:30] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.41, 9.55, 9.02 [13:22:37] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.61, 1.58, 1.47 [13:24:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.29, 4.33, 3.50 [13:28:18] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.72, 3.59, 2.92 [13:28:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.67, 3.72, 3.46 [13:29:03] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.27, 4.03, 3.19 [13:31:03] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.39, 3.79, 3.20 [13:32:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.04, 4.62, 3.85 [13:34:03] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.88, 3.31, 3.02 [13:34:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.07, 3.98, 3.71 [13:36:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [13:37:03] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.83, 3.27, 3.22 [13:40:48] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.10, 3.68, 3.32 [13:42:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.78, 4.11, 3.83 [13:46:33] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.92, 2.88, 3.12 [13:50:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.88, 3.88, 3.88 [13:50:37] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.34, 1.99, 1.67 [13:51:34] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [13:52:37] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.80, 1.95, 1.70 [13:54:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.06, 3.92, 3.88 [13:56:10] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.32, 3.29, 3.12 [13:56:34] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [13:56:37] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.39, 1.67, 1.64 [13:57:03] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.86, 4.44, 3.66 [14:01:56] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.57, 3.73, 3.40 [14:02:01] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.85, 9.73, 8.53 [14:04:01] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 10.17, 9.56, 8.60 [14:05:46] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.22, 3.99, 3.57 [14:06:06] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.21, 9.92, 9.04 [14:06:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.77, 3.69, 3.96 [14:07:42] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.02, 3.60, 3.48 [14:09:03] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.12, 3.49, 3.79 [14:09:37] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.27, 3.80, 3.56 [14:10:04] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.42, 9.27, 9.04 [14:11:32] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.46, 3.42, 3.43 [14:13:21] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.82, 1.75, 1.68 [14:13:27] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.48, 3.00, 3.27 [14:14:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.21, 3.58, 3.76 [14:16:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.65, 3.63, 3.76 [14:17:03] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.86, 2.99, 3.40 [14:17:11] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.14, 1.87, 1.74 [14:18:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.11, 3.80, 3.80 [14:18:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [14:20:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.77, 3.48, 3.69 [14:22:25] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.44, 3.99, 3.85 [14:24:51] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.72, 1.90, 1.86 [14:26:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.30, 3.57, 3.74 [14:27:53] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.12, 10.88, 9.94 [14:28:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.24, 4.09, 3.91 [14:28:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [14:29:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.18, 10.45, 9.92 [14:29:53] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.83, 3.59, 3.51 [14:31:50] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.76, 3.29, 3.40 [14:32:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.74, 3.31, 3.63 [14:34:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.42, 3.84, 3.77 [14:35:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [14:35:40] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.64, 4.22, 3.77 [14:37:19] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.15, 4.27, 3.65 [14:37:48] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.35, 9.53, 9.75 [14:38:37] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.40, 1.49, 1.67 [14:39:19] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.33, 3.88, 3.58 [14:41:05] [02miraheze/mw-config] 07RhinosF1 pushed 031 commit to 03RhinosF1-patch-1 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/38744433b854 [14:41:06] [02miraheze/mw-config] 07RhinosF1 033874443 - PageImages: make MediaWiki:Pageimages-denylist work everywhere [14:41:08] [02mw-config] 07RhinosF1 created branch 03RhinosF1-patch-1 - 13https://github.com/miraheze/mw-config [14:41:08] [url] Page not found · GitHub · GitHub | github.com [14:41:09] [02mw-config] 07RhinosF1 opened pull request 03#4693: PageImages: make MediaWiki:Pageimages-denylist work everywhere - 13https://github.com/miraheze/mw-config/pull/4693 [14:41:10] ... [14:41:39] [02mw-config] 07RhinosF1 edited pull request 03#4693: PageImages: make MediaWiki:Pageimages-denylist work everywhere - 13https://github.com/miraheze/mw-config/pull/4693 [14:41:39] ... [14:41:50] CosmicAlpha, Reception123: ^ [14:42:23] miraheze/mw-config - RhinosF1 the build passed. [14:45:19] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.47, 3.99, 3.70 [14:45:23] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.30, 3.79, 3.81 [14:46:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.66, 3.80, 3.98 [14:47:19] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.82, 3.45, 3.52 [14:48:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.43, 4.05, 4.04 [14:50:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [14:50:37] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.25, 1.88, 1.69 [14:51:13] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.67, 4.41, 3.95 [14:51:19] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.22, 3.91, 3.65 [14:52:37] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.27, 1.66, 1.63 [14:55:19] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.04, 3.65, 3.62 [14:56:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [14:56:37] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.00, 10.49, 9.91 [14:57:19] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.12, 3.93, 3.72 [15:01:19] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.09, 3.82, 3.75 [15:04:34] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.18, 10.03, 10.02 [15:09:19] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.12, 3.99, 3.70 [15:09:26] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.06, 1.41, 1.07 [15:11:25] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.81, 1.46, 1.12 [15:13:25] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.41, 1.04, 1.01 [15:15:19] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.14, 3.79, 3.73 [15:17:03] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.04, 3.69, 3.96 [15:18:37] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.19, 1.70, 1.47 [15:21:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [15:22:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.43, 3.36, 3.96 [15:22:37] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.43, 1.67, 1.52 [15:23:19] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.20, 2.87, 3.37 [15:33:33] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [15:35:03] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.50, 2.62, 3.25 [15:38:22] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.37, 2.61, 3.30 [15:44:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.13, 3.63, 3.50 [15:46:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.80, 3.65, 3.53 [15:48:33] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [15:49:03] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.65, 3.20, 3.09 [15:49:03] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.64, 1.98, 1.70 [15:50:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.83, 4.37, 3.85 [15:53:04] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.96, 2.90, 3.02 [15:54:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.34, 3.65, 3.66 [15:54:48] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.64, 1.87, 1.78 [15:56:24] [02mw-config] 07Universal-Omega reviewed pull request 03#4693 commit - 13https://github.com/miraheze/mw-config/pull/4693#discussion_r872550950 [15:56:25] [url] PageImages: make MediaWiki:Pageimages-denylist work everywhere by RhinosF1 · Pull Request #4693 · miraheze/mw-config · GitHub | github.com [15:56:26] [02mw-config] 07Universal-Omega reviewed pull request 03#4693 commit - 13https://github.com/miraheze/mw-config/pull/4693#discussion_r872551916 [15:56:26] [url] PageImages: make MediaWiki:Pageimages-denylist work everywhere by RhinosF1 · Pull Request #4693 · miraheze/mw-config · GitHub | github.com [15:56:44] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.18, 2.04, 1.85 [15:57:02] [02mw-config] 07RhinosF1 synchronize pull request 03#4693: PageImages: make MediaWiki:Pageimages-denylist work everywhere - 13https://github.com/miraheze/mw-config/pull/4693 [15:57:02] [url] Page not found · GitHub · GitHub | github.com [15:57:03] [02miraheze/mw-config] 07RhinosF1 pushed 031 commit to 03RhinosF1-patch-1 [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/38744433b854...88bd4ce6b2f3 [15:57:04] [url] Comparing 38744433b854...88bd4ce6b2f3 · miraheze/mw-config · GitHub | github.com [15:57:05] [02miraheze/mw-config] 07RhinosF1 0388bd4ce - Update LocalSettings.php [15:57:07] [02mw-config] 07RhinosF1 synchronize pull request 03#4693: PageImages: make MediaWiki:Pageimages-denylist work everywhere - 13https://github.com/miraheze/mw-config/pull/4693 [15:57:07] [url] Page not found · GitHub · GitHub | github.com [15:57:08] [02miraheze/mw-config] 07RhinosF1 pushed 031 commit to 03RhinosF1-patch-1 [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/88bd4ce6b2f3...ac8348d2f819 [15:57:09] [url] Comparing 88bd4ce6b2f3...ac8348d2f819 · miraheze/mw-config · GitHub | github.com [15:57:10] [02miraheze/mw-config] 07RhinosF1 03ac8348d - Update LocalSettings.php [15:57:27] CosmicAlpha: done [15:58:18] miraheze/mw-config - RhinosF1 the build passed. [16:00:37] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.95, 1.98, 1.88 [16:02:18] RhinosF1: thanks! [16:02:22] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.55, 2.68, 3.24 [16:02:37] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.06, 1.97, 1.89 [16:04:37] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.99, 1.95, 1.89 [16:05:43] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 4.16, 3.16, 1.72 [16:08:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.45, 3.88, 3.55 [16:09:43] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.12, 1.94, 1.53 [16:10:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.98, 3.46, 3.43 [16:13:43] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 1.27, 1.60, 1.48 [16:14:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.23, 3.73, 3.54 [16:16:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.40, 3.63, 3.53 [16:18:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.63, 4.03, 3.69 [16:18:37] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.25, 1.94, 1.87 [16:21:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [16:22:27] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.66, 4.10, 3.38 [16:22:33] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.26, 4.34, 3.55 [16:22:37] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.73, 1.97, 1.91 [16:24:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.12, 3.89, 3.77 [16:24:22] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.33, 3.45, 3.23 [16:24:30] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.47, 3.73, 3.43 [16:25:12] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.77, 1.39, 1.04 [16:26:17] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.77, 3.27, 3.19 [16:26:30] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.47, 3.34, 3.32 [16:26:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [16:27:11] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.97, 1.21, 1.02 [16:28:46] PROBLEM - matomo101 Current Load on matomo101 is CRITICAL: CRITICAL - load average: 4.85, 5.91, 3.80 [16:32:37] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.40, 1.52, 1.70 [16:32:46] RECOVERY - matomo101 Current Load on matomo101 is OK: OK - load average: 0.79, 3.26, 3.19 [16:34:22] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.91, 3.15, 3.38 [16:35:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [16:37:51] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.56, 3.25, 3.00 [16:38:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.34, 3.44, 3.46 [16:39:46] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.55, 3.15, 2.99 [16:40:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [16:40:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.54, 3.85, 3.58 [16:41:41] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.31, 3.31, 3.07 [16:48:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.16, 3.71, 3.69 [16:50:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.85, 4.17, 3.85 [16:53:03] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.89, 3.57, 3.29 [16:55:03] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.08, 3.94, 3.47 [16:57:03] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.22, 3.71, 3.45 [17:00:06] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.69, 1.78, 1.30 [17:01:03] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.06, 4.19, 3.69 [17:02:06] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.32, 1.64, 1.31 [17:02:55] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.87, 3.67, 3.39 [17:03:03] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.89, 3.97, 3.69 [17:04:50] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.24, 3.26, 3.27 [17:05:03] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.00, 4.15, 3.79 [17:08:41] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.56, 3.51, 3.38 [17:12:32] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.88, 3.67, 3.44 [17:13:03] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.45, 3.96, 3.92 [17:14:27] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.00, 3.25, 3.31 [17:15:03] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.38, 4.00, 3.93 [17:17:03] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.32, 3.47, 3.75 [17:17:27] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.33, 1.83, 1.60 [17:18:19] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.12, 3.60, 3.47 [17:21:17] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.76, 1.97, 1.72 [17:24:05] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.07, 3.60, 3.49 [17:25:03] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.41, 2.94, 3.40 [17:25:07] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.40, 1.68, 1.66 [17:26:00] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.71, 3.31, 3.40 [17:29:03] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.83, 4.58, 3.93 [17:29:52] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.85, 3.88, 3.62 [17:31:47] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.69, 3.10, 3.37 [17:32:49] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.71, 1.68, 1.66 [17:35:38] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.35, 3.46, 3.48 [17:37:33] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.26, 3.13, 3.37 [17:38:37] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.01, 1.80, 1.71 [17:39:03] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.18, 3.39, 3.72 [17:40:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.97, 3.52, 3.95 [17:40:37] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.70, 1.73, 1.70 [17:42:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.70, 3.85, 4.00 [17:46:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.99, 3.60, 3.88 [17:48:37] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.47, 2.08, 1.86 [17:49:03] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.52, 3.71, 3.72 [17:50:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.41, 4.13, 3.99 [17:51:19] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.43, 3.71, 3.44 [17:52:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.87, 3.84, 3.92 [17:53:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [17:53:03] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.01, 3.83, 3.81 [17:53:19] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.81, 3.37, 3.35 [17:54:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.19, 3.91, 3.92 [17:54:37] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.81, 1.99, 1.91 [17:56:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.64, 3.41, 3.73 [17:57:03] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.39, 3.97, 3.82 [17:58:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [17:58:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.74, 3.79, 3.83 [17:59:03] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.75, 3.75, 3.76 [17:59:19] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.51, 3.39, 3.35 [18:00:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.02, 3.47, 3.70 [18:03:19] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.75, 3.27, 3.33 [18:06:37] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.26, 1.84, 1.84 [18:07:03] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.06, 2.93, 3.40 [18:08:22] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.43, 2.90, 3.36 [18:12:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.61, 4.26, 3.84 [18:15:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [18:18:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.04, 3.70, 3.74 [18:20:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [18:22:22] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.55, 2.82, 3.39 [18:26:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.21, 3.63, 3.59 [18:27:48] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.97, 10.30, 9.43 [18:28:05] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.17, 1.71, 1.54 [18:29:59] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.23, 1.66, 1.55 [18:31:29] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.46, 3.45, 3.13 [18:33:53] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.99, 3.82, 3.46 [18:35:19] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.34, 3.27, 3.16 [18:35:44] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.93, 10.06, 9.67 [18:35:50] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.24, 3.46, 3.37 [18:36:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.03, 3.93, 3.92 [18:37:46] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.48, 3.63, 3.43 [18:38:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.13, 4.07, 3.97 [18:39:43] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.32, 3.44, 3.38 [18:40:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.21, 3.66, 3.83 [18:41:40] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.30, 3.69, 3.48 [18:42:32] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [18:45:33] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.74, 3.29, 3.36 [18:47:32] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [18:48:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.02, 3.67, 3.72 [18:50:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.76, 3.92, 3.83 [18:55:45] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.04, 1.75, 1.41 [18:56:32] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.71, 1.39, 1.28 [18:56:45] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.49, 3.16, 3.08 [18:57:07] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.35, 3.45, 3.39 [18:57:45] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.49, 1.29, 1.28 [18:58:25] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.00, 1.18, 1.21 [18:58:40] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.23, 2.87, 2.98 [18:59:03] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.53, 2.98, 3.22 [19:00:39] [02dns] 07MacFan4000 opened pull request 03#272: Add roblox-wiki.tk zone - 13https://github.com/miraheze/dns/pull/272 [19:00:40] [url] Page not found · GitHub · GitHub | github.com [19:02:22] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.35, 3.10, 3.37 [19:06:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [19:08:19] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.83, 3.66, 3.28 [19:10:15] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.90, 3.92, 3.41 [19:20:11] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.86, 3.54, 3.35 [19:20:11] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.24, 3.79, 3.55 [19:20:12] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.89, 3.85, 3.47 [19:20:13] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.57, 1.99, 1.51 [19:20:14] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [19:20:14] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.72, 1.57, 1.41 [19:22:20] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.20, 10.07, 9.41 [19:24:19] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.15, 9.77, 9.39 [19:27:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [19:28:11] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.68, 1.85, 1.62 [19:30:05] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 1.75, 2.16, 1.79 [19:31:59] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.23, 1.87, 1.73 [19:33:52] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.76, 1.54, 1.62 [19:47:43] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.58, 1.78, 1.32 [19:48:06] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 3.10, 2.00, 1.70 [19:49:43] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.84, 1.43, 1.24 [19:49:59] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.95, 1.79, 1.65 [19:51:53] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 3.39, 2.25, 1.82 [19:52:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [19:53:47] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.49, 1.95, 1.76 [19:57:35] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.46, 1.80, 1.72 [19:59:30] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.33, 1.66, 1.68 [20:02:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [20:08:28] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 73, in check_records nameserversans = dns_resolver.resolve(root_domain, 'NS') File "/usr/l [20:08:28] n3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query bellinrattin.it. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [20:09:19] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.18, 3.54, 3.98 [20:11:19] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.63, 3.91, 4.06 [20:12:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [20:32:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [20:37:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [20:37:19] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.65, 3.79, 3.97 [20:37:26] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp20.miraheze.org - CNAME OK [20:39:03] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.79, 3.57, 3.98 [20:41:19] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.33, 3.90, 3.95 [20:45:03] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.39, 3.64, 3.84 [20:47:03] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.27, 3.52, 3.77 [20:49:03] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.17, 3.91, 3.89 [20:49:19] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.53, 3.91, 3.93 [20:51:03] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.73, 3.60, 3.77 [20:59:19] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.18, 2.69, 3.32 [21:01:22] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.71, 1.60, 1.17 [21:03:03] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.72, 2.91, 3.28 [21:03:22] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.09, 1.45, 1.17 [21:04:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.22, 3.55, 4.00 [21:05:53] [02puppet] 07Universal-Omega opened pull request 03#2537: Rewrite PHP configuration - 13https://github.com/miraheze/puppet/pull/2537 [21:05:54] [url] Page not found · GitHub · GitHub | github.com [21:07:03] [02puppet] 07Universal-Omega edited pull request 03#2537: Rewrite PHP configuration - 13https://github.com/miraheze/puppet/pull/2537 [21:07:03] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.98, 3.79, 3.53 [21:07:03] [url] Page not found · GitHub · GitHub | github.com [21:07:28] [02puppet] 07Universal-Omega edited pull request 03#2537: Rewrite PHP configuration - 13https://github.com/miraheze/puppet/pull/2537 [21:07:28] ... [21:08:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.76, 4.68, 4.30 [21:08:28] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 73, in check_records nameserversans = dns_resolver.resolve(root_domain, 'NS') File "/usr/l [21:08:28] n3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query bellinrattin.it. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [21:08:42] [02puppet] 07Universal-Omega edited pull request 03#2537: Rewrite PHP configuration - 13https://github.com/miraheze/puppet/pull/2537 [21:08:42] ... [21:09:19] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.29, 3.83, 3.51 [21:10:38] [02puppet] 07Universal-Omega edited pull request 03#2537: Rewrite PHP configuration - 13https://github.com/miraheze/puppet/pull/2537 [21:10:38] [url] Page not found · GitHub · GitHub | github.com [21:10:46] [02puppet] 07Universal-Omega edited pull request 03#2537: Rewrite PHP configuration - 13https://github.com/miraheze/puppet/pull/2537 [21:10:46] ... [21:11:03] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.25, 3.84, 3.65 [21:11:19] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.88, 3.98, 3.62 [21:17:03] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.75, 3.07, 3.36 [21:17:08] [02puppet] 07Universal-Omega edited pull request 03#2537: Rewrite PHP configuration - 13https://github.com/miraheze/puppet/pull/2537 [21:17:08] [url] Page not found · GitHub · GitHub | github.com [21:17:19] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.68, 3.57, 3.48 [21:19:19] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.92, 3.22, 3.36 [21:22:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.38, 3.58, 3.91 [21:27:03] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.12, 3.45, 3.45 [21:29:03] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.86, 3.91, 3.61 [21:30:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.41, 4.04, 3.99 [21:31:03] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.93, 3.94, 3.66 [21:31:19] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.12, 4.11, 3.50 [21:33:19] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.94, 3.82, 3.46 [21:35:19] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 3.63, 4.02, 3.60 [21:36:37] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.10, 1.37, 1.97 [21:38:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.65, 3.66, 3.90 [21:39:19] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.45, 3.67, 3.59 [21:43:03] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.29, 2.93, 3.31 [21:43:19] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.99, 2.88, 3.28 [21:44:37] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.18, 1.29, 1.68 [21:47:03] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.01, 3.69, 3.53 [21:48:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.65, 4.00, 3.77 [21:49:52] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 4.31, 3.86, 2.12 [21:50:07] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.72, 10.02, 8.96 [21:50:37] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.05, 1.85, 1.81 [21:51:19] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.10, 4.09, 3.55 [21:51:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [21:52:37] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.24, 1.65, 1.74 [21:54:37] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.00, 1.44, 1.65 [21:55:50] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 0.71, 1.79, 1.74 [21:57:49] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.04, 1.61, 1.68 [21:58:03] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 10.07, 10.11, 9.52 [22:00:12] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.97, 1.73, 1.40 [22:01:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [22:02:12] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.19, 1.60, 1.39 [22:06:28] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp21.miraheze.org - CNAME OK [22:10:10] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.02, 1.97, 1.62 [22:12:09] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.88, 1.83, 1.60 [22:14:09] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.46, 1.87, 1.62 [22:16:09] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.90, 1.49, 1.52 [22:20:37] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.05, 1.83, 1.59 [22:22:37] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.51, 1.72, 1.58 [22:26:37] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.53, 1.69, 1.60 [22:35:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [22:46:37] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.87, 1.63, 1.54 [22:48:37] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.31, 1.89, 1.65 [22:52:37] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.94, 1.92, 1.73 [22:55:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [23:00:02] !log [@test101] starting deploy of {'l10nupdate': True} to all [23:00:04] !log [@mwtask111] starting deploy of {'l10nupdate': True} to all [23:00:22] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.20, 1.84, 1.43 [23:00:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:00:37] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.06, 1.82, 1.75 [23:00:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:02:21] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.46, 1.34, 1.29 [23:02:37] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.92, 1.85, 1.76 [23:03:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [23:04:37] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.01, 1.88, 1.78 [23:06:51] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.34, 10.17, 9.76 [23:08:50] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.23, 9.45, 9.55 [23:08:59] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.16, 1.81, 1.36 [23:10:59] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.98, 1.54, 1.31 [23:16:58] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.49, 3.00, 2.05 [23:18:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [23:21:26] !log [@test101] finished deploy of {'l10nupdate': True} to all - SUCCESS in 1283s [23:21:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:24:56] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.40, 1.88, 1.87 [23:27:33] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [23:28:23] !log [@mwtask111] finished deploy of {'l10nupdate': True} to all - SUCCESS in 1699s [23:28:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:28:56] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.88, 1.43, 1.70 [23:32:33] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [23:32:37] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.27, 1.51, 1.93 [23:34:54] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.42, 1.53, 1.61 [23:36:54] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.91, 1.31, 1.52 [23:38:37] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.20, 1.26, 1.67 [23:39:19] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.17, 3.40, 3.93 [23:43:19] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.67, 3.88, 3.99 [23:45:03] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.79, 3.44, 3.97 [23:45:19] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.90, 3.46, 3.82 [23:50:37] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.36, 1.85, 1.66 [23:52:37] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.50, 1.73, 1.64 [23:54:37] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.25, 1.59, 1.60 [23:55:19] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.55, 2.96, 3.38