[00:01:38] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.81, 3.98, 3.69 [00:01:39] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.72, 3.29, 3.10 [00:02:52] PROBLEM - mw101 Puppet on mw101 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [00:03:06] RECOVERY - matomo101 Disk Space on matomo101 is OK: DISK OK - free space: / 1775 MB (18% inode=80%); [00:05:07] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.20, 9.15, 8.87 [00:05:16] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.04, 3.89, 3.14 [00:05:30] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.08, 4.81, 3.77 [00:05:38] RECOVERY - www.lab612.at - reverse DNS on sslhost is OK: SSL OK - www.lab612.at reverse DNS resolves to cp21.miraheze.org - CNAME OK [00:06:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.90, 9.62, 8.62 [00:07:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.29, 8.98, 8.83 [00:07:32] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.22, 3.93, 3.73 [00:08:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 11.32, 10.15, 8.93 [00:09:15] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.13, 1.90, 1.51 [00:10:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.35, 9.84, 8.97 [00:11:07] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.64, 9.35, 8.97 [00:11:12] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.90, 3.72, 3.34 [00:11:13] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.56, 8.81, 8.49 [00:11:28] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.23, 3.84, 3.77 [00:12:20] PROBLEM - cloud10 Puppet on cloud10 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [00:13:07] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.11, 1.81, 1.59 [00:13:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.35, 8.60, 8.75 [00:13:10] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.65, 8.30, 8.34 [00:13:10] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.82, 4.28, 3.60 [00:13:26] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.41, 4.40, 3.97 [00:14:25] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.27, 7.97, 8.40 [00:15:02] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.35, 1.62, 1.54 [00:15:07] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.38, 9.67, 9.12 [00:15:09] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.19, 3.61, 3.45 [00:15:24] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.03, 3.52, 3.70 [00:16:57] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.53, 3.71, 3.76 [00:17:07] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.44, 3.35, 3.37 [00:17:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.35, 8.68, 8.82 [00:18:03] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.37, 8.87, 8.20 [00:19:22] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.63, 2.54, 3.26 [00:20:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.29, 9.77, 8.93 [00:21:53] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.92, 9.46, 8.63 [00:23:07] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.20, 7.40, 8.23 [00:24:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 7.67, 9.57, 9.13 [00:24:35] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.35, 2.81, 3.33 [00:24:51] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.71, 9.03, 8.37 [00:27:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.65, 8.58, 8.58 [00:28:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.09, 8.58, 8.31 [00:29:07] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.87, 7.89, 8.32 [00:31:28] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.42, 7.78, 8.23 [00:32:25] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.13, 7.59, 8.42 [00:32:52] RECOVERY - mw101 Puppet on mw101 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:35:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.56, 8.86, 8.64 [00:36:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.73, 9.12, 8.84 [00:36:44] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.06, 9.42, 8.81 [00:37:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.54, 8.58, 8.42 [00:38:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.81, 8.81, 8.75 [00:38:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.31, 9.43, 8.90 [00:39:25] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.51, 8.11, 8.26 [00:40:19] RECOVERY - cloud10 Puppet on cloud10 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:40:44] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.63, 9.52, 8.97 [00:42:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 6.76, 8.34, 8.60 [00:43:20] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.08, 3.97, 3.40 [00:45:07] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.65, 8.36, 8.50 [00:45:14] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.73, 3.77, 3.40 [00:46:25] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.35, 8.10, 8.48 [00:46:44] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.93, 8.23, 8.50 [00:47:09] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.27, 3.19, 3.22 [00:50:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.02, 9.12, 8.87 [00:53:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.84, 8.14, 8.19 [00:54:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.17, 8.68, 8.50 [00:55:25] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.62, 10.06, 9.06 [00:56:25] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.82, 8.47, 8.45 [00:58:44] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.18, 10.68, 9.51 [01:02:45] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.53, 9.85, 9.44 [01:03:07] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.89, 9.15, 8.57 [01:03:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 7.53, 9.35, 9.34 [01:04:44] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.76, 10.50, 9.75 [01:06:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.87, 9.68, 9.55 [01:07:07] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 5.48, 8.00, 8.33 [01:07:13] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.85, 8.87, 8.59 [01:10:44] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.58, 10.08, 9.67 [01:11:03] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.29, 9.12, 8.72 [01:11:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.85, 8.50, 8.45 [01:12:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.19, 9.22, 9.43 [01:12:58] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.52, 8.81, 8.66 [01:13:07] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.34, 8.45, 8.44 [01:14:54] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.45, 7.96, 8.37 [01:15:25] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.14, 7.47, 8.40 [01:21:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.51, 8.91, 8.81 [01:22:36] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.46, 8.69, 8.56 [01:23:06] PROBLEM - cloud11 Puppet on cloud11 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [01:26:45] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.75, 7.60, 8.33 [01:27:25] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.78, 9.93, 9.25 [01:28:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 11.27, 9.48, 8.86 [01:29:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.41, 9.41, 9.13 [01:30:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.68, 9.27, 8.87 [01:32:55] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.55, 7.94, 7.17 [01:34:55] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.97, 7.75, 7.19 [01:36:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.68, 9.95, 9.22 [01:36:59] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.28, 3.01, 2.64 [01:38:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 7.82, 9.18, 9.03 [01:38:57] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.74, 2.84, 2.62 [01:39:33] PROBLEM - www.lab612.at - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 86, in check_records cname = str(dns_resolver.resolve(hostname, 'CNAME')[0]) File "/usr/lib/pyth [01:39:33] -packages/dns/resolver.py", line 1043, in resolve timeout = self._compute_timeout(start, lifetime) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 950, in _compute_timeout raise Timeout(timeout=duration)dns.exception.Timeout: The DNS operation timed out after 5.407220840454102 seconds [01:40:31] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.32, 3.91, 3.11 [01:40:44] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.47, 8.99, 8.40 [01:42:31] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.96, 3.53, 3.07 [01:42:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.05, 8.68, 8.37 [01:44:31] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.35, 3.83, 3.23 [01:44:44] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.18, 8.41, 8.30 [01:47:25] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 8.42, 7.91, 8.49 [01:49:33] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.57, 8.25, 7.94 [01:49:46] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.11, 3.31, 2.90 [01:50:25] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.56, 7.80, 8.41 [01:51:06] RECOVERY - cloud11 Puppet on cloud11 is OK: OK: Puppet is currently enabled, last run 51 seconds ago with 0 failures [01:51:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.15, 8.52, 8.65 [01:51:28] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.86, 8.27, 8.00 [01:53:00] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 8.30, 5.05, 3.75 [01:53:25] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.77, 8.11, 8.50 [01:57:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.57, 8.87, 8.74 [01:58:48] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.84, 8.52, 8.48 [02:00:25] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.23, 8.16, 8.36 [02:00:45] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.51, 9.02, 8.57 [02:03:25] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.54, 8.01, 8.46 [02:05:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.83, 8.92, 8.40 [02:06:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.65, 9.61, 8.91 [02:06:45] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.53, 8.49, 8.50 [02:07:07] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.99, 8.36, 8.27 [02:09:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.42, 8.44, 8.51 [02:10:44] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.74, 9.11, 8.72 [02:10:57] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 86, in check_records cname = str(dns_resolver.resolve(hostname, 'CNAME')[0]) File "/usr/li [02:10:57] 3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query dnd.bellinrattin.it. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [02:11:25] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.81, 8.19, 8.41 [02:12:25] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.09, 8.06, 8.44 [02:12:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.93, 8.62, 8.59 [02:14:45] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.27, 8.31, 8.48 [02:15:26] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.68, 3.67, 3.98 [02:16:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.23, 8.69, 8.64 [02:18:25] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.89, 8.23, 8.46 [02:18:45] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.41, 8.86, 8.66 [02:19:25] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.53, 9.69, 8.82 [02:21:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.33, 9.08, 8.71 [02:24:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.24, 9.12, 8.51 [02:25:25] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.99, 8.26, 8.44 [02:26:30] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.04, 9.31, 8.64 [02:28:25] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.56, 8.18, 8.30 [02:28:31] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.48, 3.62, 3.95 [02:29:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.41, 9.03, 8.72 [02:30:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.66, 9.18, 8.63 [02:32:20] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.48, 3.08, 3.86 [02:32:31] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.25, 3.56, 3.82 [02:33:13] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.23, 3.47, 3.53 [02:33:25] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.11, 9.30, 8.86 [02:34:12] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.63, 9.64, 8.81 [02:34:25] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.34, 8.05, 8.34 [02:34:44] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.12, 7.72, 8.46 [02:35:11] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.75, 3.70, 3.62 [02:35:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.55, 9.27, 8.90 [02:36:08] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.41, 9.23, 8.77 [02:37:09] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.44, 4.44, 3.90 [02:38:03] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.45, 8.22, 8.45 [02:38:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [02:39:25] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.90, 7.77, 8.35 [02:40:31] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.53, 3.72, 3.98 [02:41:07] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.97, 3.71, 3.73 [02:44:08] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.64, 4.04, 3.97 [02:44:31] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.85, 4.02, 4.01 [02:45:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [02:46:06] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.58, 3.97, 3.96 [02:48:31] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.99, 3.96, 3.99 [02:49:00] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.49, 2.93, 3.33 [02:50:06] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.29, 9.23, 8.55 [02:50:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 14.17, 10.22, 8.69 [02:52:00] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.63, 3.69, 3.79 [02:52:01] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.51, 9.21, 8.62 [02:52:31] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 8.12, 5.10, 4.35 [02:53:58] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.56, 3.66, 3.77 [02:54:54] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.31, 3.77, 3.64 [02:55:56] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.81, 4.16, 3.92 [02:56:24] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.64, 8.69, 8.51 [02:56:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.53, 9.75, 9.11 [02:56:53] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.37, 4.06, 3.76 [02:57:47] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.12, 9.79, 8.98 [02:58:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 11.76, 10.45, 9.44 [02:58:31] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.24, 3.70, 3.94 [02:58:52] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.89, 4.00, 3.77 [02:59:42] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.42, 9.65, 9.03 [03:00:31] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.84, 4.37, 4.14 [03:01:37] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.40, 9.99, 9.22 [03:02:13] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 5.69, 8.13, 8.45 [03:02:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.50, 9.50, 9.30 [03:03:32] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.23, 9.59, 9.16 [03:04:02] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.07, 9.12, 8.23 [03:05:27] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.10, 9.80, 9.29 [03:05:58] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.54, 9.52, 8.51 [03:08:31] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.82, 3.55, 3.91 [03:09:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.35, 9.95, 9.51 [03:09:40] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - dnd.bellinrattin.it All nameservers failed to answer the query. [03:10:52] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.49, 2.89, 3.33 [03:11:46] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.07, 8.33, 8.32 [03:11:57] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.16, 8.80, 8.53 [03:14:31] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.63, 3.87, 3.81 [03:15:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:15:38] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.78, 8.71, 8.45 [03:15:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.92, 8.07, 8.34 [03:16:31] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.54, 3.66, 3.74 [03:17:04] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.24, 8.72, 8.08 [03:17:25] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.53, 9.14, 9.14 [03:17:34] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.28, 3.48, 3.99 [03:19:02] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 7.00, 7.99, 7.88 [03:19:29] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.42, 8.24, 8.33 [03:19:32] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:19:43] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.00, 1.89, 1.48 [03:20:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.27, 8.99, 8.89 [03:21:39] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.51, 1.72, 1.47 [03:22:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.43, 9.17, 8.97 [03:23:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.81, 9.63, 9.45 [03:23:28] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.32, 2.59, 3.40 [03:23:35] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.95, 1.47, 1.41 [03:26:55] PROBLEM - pj-masks-info.cf - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'pj-masks-info.cf' expires in 15 day(s) (Sat 02 Apr 2022 03:19:56 GMT +0000). [03:27:57] PROBLEM - correypedia.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'correypedia.org' expires in 15 day(s) (Sat 02 Apr 2022 03:15:26 GMT +0000). [03:29:32] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:30:25] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.77, 7.86, 8.39 [03:32:16] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.03, 3.92, 3.65 [03:33:25] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.27, 9.28, 9.24 [03:33:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:33:55] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/02b641b8edb2...bcf2b9dc750a [03:33:56] [02miraheze/ssl] 07MirahezeSSLBot 03bcf2b9d - Bot: Update SSL cert for pj-masks-info.cf [03:34:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.56, 3.79, 3.63 [03:34:31] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.51, 2.91, 3.33 [03:35:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 7.72, 8.42, 8.92 [03:36:12] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.02, 4.11, 3.75 [03:37:09] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.05, 2.23, 1.70 [03:38:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:39:02] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp21.miraheze.org - CNAME OK [03:39:04] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.70, 1.99, 1.67 [03:40:08] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/bcf2b9dc750a...da1a0baf9f32 [03:40:09] [02miraheze/ssl] 07MirahezeSSLBot 03da1a0ba - Bot: Update SSL cert for correypedia.org [03:41:00] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.87, 1.66, 1.59 [03:42:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:45:09] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.22, 3.78, 3.52 [03:47:03] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.34, 3.81, 3.55 [03:47:25] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.76, 7.67, 8.44 [03:48:00] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.03, 3.86, 3.97 [03:48:22] PROBLEM - sbs.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'sbs.wiki' expires in 15 day(s) (Sat 02 Apr 2022 03:39:57 GMT +0000). [03:48:58] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.96, 3.58, 3.50 [03:50:00] PROBLEM - wiki.apico.buzz - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.apico.buzz' expires in 15 day(s) (Sat 02 Apr 2022 03:43:34 GMT +0000). [03:50:52] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.00, 3.13, 3.35 [03:52:26] PROBLEM - biblestrength.net - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'biblestrength.net' expires in 15 day(s) (Sat 02 Apr 2022 03:32:26 GMT +0000). [03:53:13] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.55, 8.74, 8.48 [03:53:26] PROBLEM - wiki.digitaldesignhq.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.digitaldesignhq.com' expires in 15 day(s) (Sat 02 Apr 2022 03:26:50 GMT +0000). [03:54:40] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.57, 8.20, 7.83 [03:55:08] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.55, 8.16, 8.31 [03:55:52] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.37, 3.77, 3.80 [03:55:57] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/da1a0baf9f32...51e8258acef5 [03:55:59] [02miraheze/ssl] 07MirahezeSSLBot 0351e8258 - Bot: Update SSL cert for sbs.wiki [03:56:19] PROBLEM - steamdecklinux.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'steamdecklinux.wiki' expires in 15 day(s) (Sat 02 Apr 2022 03:25:46 GMT +0000). [03:56:35] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.07, 7.74, 7.71 [03:56:41] RECOVERY - pj-masks-info.cf - LetsEncrypt on sslhost is OK: OK - Certificate 'pj-masks-info.cf' will expire on Wed 15 Jun 2022 02:33:49 GMT +0000. [03:56:54] RECOVERY - correypedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'correypedia.org' will expire on Wed 15 Jun 2022 02:40:02 GMT +0000. [03:58:38] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.26, 9.14, 8.27 [03:59:48] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.66, 3.82, 3.82 [04:00:35] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.98, 8.58, 8.16 [04:02:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [04:04:06] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/51e8258acef5...8a1a498778db [04:04:08] [02miraheze/ssl] 07MirahezeSSLBot 038a1a498 - Bot: Update SSL cert for biblestrength.net [04:06:24] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.08, 7.99, 8.10 [04:07:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [04:07:40] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.04, 3.00, 3.37 [04:10:26] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/8a1a498778db...2dcdeab315b8 [04:10:28] [02miraheze/ssl] 07MirahezeSSLBot 032dcdeab - Bot: Update SSL cert for wiki.apico.buzz [04:11:34] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.90, 3.68, 3.57 [04:12:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [04:13:32] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.39, 3.09, 3.36 [04:15:44] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.96, 3.33, 3.11 [04:17:41] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/2dcdeab315b8...1de6bad3ed86 [04:17:42] [02miraheze/ssl] 07MirahezeSSLBot 031de6bad - Bot: Update SSL cert for steamdecklinux.wiki [04:19:05] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 1.21, 2.01, 1.51 [04:19:33] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.29, 3.23, 3.10 [04:21:01] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.94, 1.62, 1.42 [04:23:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.08, 3.43, 3.24 [04:23:27] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/1de6bad3ed86...2883af045768 [04:23:29] [02miraheze/ssl] 07MirahezeSSLBot 032883af0 - Bot: Update SSL cert for wiki.digitaldesignhq.com [04:24:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [04:25:17] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.20, 3.31, 3.21 [04:29:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [04:36:32] RECOVERY - www.lab612.at - reverse DNS on sslhost is OK: SSL OK - www.lab612.at reverse DNS resolves to cp21.miraheze.org - CNAME OK [04:45:12] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.67, 3.62, 3.13 [04:47:10] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.41, 3.10, 2.99 [04:48:00] RECOVERY - wiki.apico.buzz - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.apico.buzz' will expire on Wed 15 Jun 2022 03:10:21 GMT +0000. [04:48:05] RECOVERY - sbs.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'sbs.wiki' will expire on Wed 15 Jun 2022 02:55:51 GMT +0000. [04:51:18] RECOVERY - biblestrength.net - LetsEncrypt on sslhost is OK: OK - Certificate 'biblestrength.net' will expire on Wed 15 Jun 2022 03:04:00 GMT +0000. [04:51:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [04:54:19] RECOVERY - steamdecklinux.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'steamdecklinux.wiki' will expire on Wed 15 Jun 2022 03:17:35 GMT +0000. [04:56:58] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.68, 2.98, 2.81 [04:58:56] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.28, 2.87, 2.80 [05:01:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:21:27] RECOVERY - wiki.digitaldesignhq.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.digitaldesignhq.com' will expire on Wed 15 Jun 2022 03:23:22 GMT +0000. [05:32:25] !log [reception@mwtask111] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=waysofdarknesswiki /home/reception/ways_of_darknesssoncknl-20220315-history.xml --report 1 --no-updates --username-prefix=waysofdarkness (START) [05:32:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:33:22] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.04, 3.56, 2.97 [05:33:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:35:22] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.71, 3.99, 3.23 [05:37:09] !log sudo -u www-data php /srv/mediawiki/w/maintenance/importImages.php --wiki=waysofdarknesswiki --search-recursively /home/reception/waysofdarkness --user=Miraheze_maintenance_script --comment="Imported from ways-of-darkness.sonck.nl" [05:37:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:37:25] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.43, 4.28, 3.41 [05:38:56] [02mw-config] 07Reception123 closed pull request 03#4499: Adding missing Mobilefrontend configs - 13https://github.com/miraheze/mw-config/pull/4499 [05:38:58] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/72ea039d4637...08f0e1d34983 [05:38:59] [02miraheze/mw-config] 07ugochimobi 0308f0e1d - Adding missing Mobilefrontend configs (#4499) [05:39:59] miraheze/mw-config - Reception123 the build passed. [05:40:19] [02mw-config] 07Reception123 reviewed pull request 03#4500 commit - 13https://github.com/miraheze/mw-config/pull/4500#discussion_r828770890 [05:41:22] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.99, 3.92, 3.49 [05:43:23] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/08f0e1d34983...2218b44a4b16 [05:43:25] [02miraheze/mw-config] 07Reception123 032218b44 - remove mistaken setting (default is wrong) [05:44:27] miraheze/mw-config - Reception123 the build passed. [05:44:42] [02mw-config] 07Reception123 reviewed pull request 03#4501 commit - 13https://github.com/miraheze/mw-config/pull/4501#discussion_r828772661 [05:45:22] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.38, 3.25, 3.29 [05:45:23] [02mw-config] 07Reception123 reviewed pull request 03#4501 commit - 13https://github.com/miraheze/mw-config/pull/4501#discussion_r828772661 [05:49:25] !log [@test101] starting deploy of {'config': True} to all [05:49:26] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 0s [05:49:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:49:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:52:11] [02mw-config] 07Reception123 reviewed pull request 03#4502 commit - 13https://github.com/miraheze/mw-config/pull/4502#discussion_r828774438 [05:52:13] [02mw-config] 07Reception123 reviewed pull request 03#4502 commit - 13https://github.com/miraheze/mw-config/pull/4502#discussion_r828773161 [05:52:14] [02mw-config] 07Reception123 reviewed pull request 03#4502 commit - 13https://github.com/miraheze/mw-config/pull/4502#discussion_r828773432 [05:52:16] [02mw-config] 07Reception123 reviewed pull request 03#4502 commit - 13https://github.com/miraheze/mw-config/pull/4502#discussion_r828774903 [05:52:17] [02mw-config] 07Reception123 reviewed pull request 03#4502 commit - 13https://github.com/miraheze/mw-config/pull/4502#discussion_r828775129 [05:52:19] [02mw-config] 07Reception123 reviewed pull request 03#4502 commit - 13https://github.com/miraheze/mw-config/pull/4502#discussion_r828774553 [05:52:20] [02mw-config] 07Reception123 reviewed pull request 03#4502 commit - 13https://github.com/miraheze/mw-config/pull/4502#discussion_r828775507 [05:52:53] [02mw-config] 07Reception123 closed pull request 03#4503: PropertySuggester/APH configs for GD/GP - 13https://github.com/miraheze/mw-config/pull/4503 [05:52:55] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/2218b44a4b16...26991f93eed7 [05:52:56] [02miraheze/mw-config] 07ugochimobi 0326991f9 - PropertSuggester configs for gratisdatawiki (#4503) [05:53:02] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03revert-4503-patch-26 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/dc4e031f9dae [05:53:04] [02miraheze/mw-config] 07Reception123 03dc4e031 - Revert "PropertSuggester configs for gratisdatawiki (#4503)" [05:53:05] [02mw-config] 07Reception123 created branch 03revert-4503-patch-26 - 13https://github.com/miraheze/mw-config [05:53:07] [02mw-config] 07Reception123 opened pull request 03#4513: Revert "PropertySuggester/APH configs for GD/GP" - 13https://github.com/miraheze/mw-config/pull/4513 [05:53:10] [02mw-config] 07Reception123 closed pull request 03#4513: Revert "PropertySuggester/APH configs for GD/GP" - 13https://github.com/miraheze/mw-config/pull/4513 [05:53:12] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/26991f93eed7...a8cbd6c85340 [05:53:13] [02miraheze/mw-config] 07Reception123 03a8cbd6c - Revert "PropertSuggester configs for gratisdatawiki (#4503)" (#4513) [05:53:15] [02mw-config] 07Reception123 deleted branch 03revert-4503-patch-26 - 13https://github.com/miraheze/mw-config [05:53:16] [02miraheze/mw-config] 07Reception123 deleted branch 03revert-4503-patch-26 [05:53:43] [02mw-config] 07Reception123 commented on pull request 03#4503: PropertySuggester/APH configs for GD/GP - 13https://github.com/miraheze/mw-config/pull/4503#issuecomment-1070352271 [05:53:57] !log [@mwtask111] starting deploy of {'config': True} to all [05:54:00] miraheze/mw-config - Reception123 the build passed. [05:54:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:54:08] miraheze/mw-config - Reception123 the build passed. [05:54:13] !log [@mwtask111] finished deploy of {'config': True} to all - SUCCESS in 16s [05:54:13] miraheze/mw-config - Reception123 the build passed. [05:54:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:54:32] PROBLEM - mwtask111 Current Load on mwtask111 is CRITICAL: CRITICAL - load average: 2.53, 1.70, 1.04 [05:55:18] [02mw-config] 07Reception123 reviewed pull request 03#4509 commit - 13https://github.com/miraheze/mw-config/pull/4509#discussion_r828776513 [05:55:19] [02mw-config] 07Reception123 reviewed pull request 03#4509 commit - 13https://github.com/miraheze/mw-config/pull/4509#discussion_r828776602 [05:55:21] [02mw-config] 07Reception123 reviewed pull request 03#4509 commit - 13https://github.com/miraheze/mw-config/pull/4509#discussion_r828776775 [05:56:11] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.09, 9.10, 7.78 [05:56:32] RECOVERY - mwtask111 Current Load on mwtask111 is OK: OK - load average: 1.53, 1.60, 1.09 [05:58:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [06:00:01] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 7.08, 8.87, 8.04 [06:01:57] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.23, 8.46, 8.00 [06:09:29] !log reception@mwtask111:/srv/mediawiki/w/extensions/ApprovedRevs/maintenance$ sudo -u www-data php approveAllPages.php --wiki primalfeararkwiki [06:09:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:12:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.02, 9.06, 8.15 [06:14:44] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.17, 8.39, 8.02 [06:18:29] !log [reception@mwtask111] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=waysofdarknesswiki /home/reception/ways_of_darknesssoncknl-20220315-history.xml --report 1 --no-updates --username-prefix=waysofdarkness (END - exit=0) [06:18:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:18:57] !log [reception@mwtask111] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=waysofdarknesswiki (START) [06:19:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:20:10] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 2.00, 1.67, 1.33 [06:22:10] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.34, 1.49, 1.31 [06:22:32] PROBLEM - mwtask111 Current Load on mwtask111 is CRITICAL: CRITICAL - load average: 2.66, 2.09, 1.63 [06:25:02] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.58, 8.24, 7.74 [06:28:52] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.98, 8.28, 7.86 [06:31:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [06:36:35] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.03, 8.81, 8.23 [06:38:30] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.53, 8.07, 8.03 [06:41:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [06:48:52] !log [reception@mwtask111] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=waysofdarknesswiki (END - exit=0) [06:49:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:56:32] PROBLEM - mwtask111 Current Load on mwtask111 is WARNING: WARNING - load average: 1.06, 1.68, 2.00 [07:00:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [07:05:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [07:06:32] RECOVERY - mwtask111 Current Load on mwtask111 is OK: OK - load average: 0.91, 1.20, 1.60 [07:11:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [07:21:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [07:35:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [07:40:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [07:45:49] [02mw-config] 07ugochimobi synchronize pull request 03#4509: Popups config for gratispaideiawiki - 13https://github.com/miraheze/mw-config/pull/4509 [07:47:04] miraheze/mw-config - ugochimobi the build passed. [07:47:56] [02mw-config] 07ugochimobi commented on pull request 03#4509: Popups config for gratispaideiawiki - 13https://github.com/miraheze/mw-config/pull/4509#issuecomment-1070476556 [07:49:05] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.32, 6.14, 5.10 [07:51:05] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.90, 6.04, 5.20 [07:53:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [08:03:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [08:08:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [08:12:46] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.31, 8.55, 7.73 [08:16:44] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.94, 7.77, 7.61 [08:18:32] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [08:22:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [08:27:38] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.38, 8.53, 7.85 [08:29:33] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.97, 8.04, 7.76 [08:32:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [08:43:25] [02mw-config] 07ugochimobi synchronize pull request 03#4501: ULS settings for GP - 13https://github.com/miraheze/mw-config/pull/4501 [08:44:42] [02mw-config] 07ugochimobi reviewed pull request 03#4501 commit - 13https://github.com/miraheze/mw-config/pull/4501#discussion_r828876675 [08:44:42] miraheze/mw-config - ugochimobi the build passed. [08:50:47] [02mw-config] 07ugochimobi synchronize pull request 03#4502: Wikibase: Adding missing setups in favour of GD & GP - 13https://github.com/miraheze/mw-config/pull/4502 [08:50:49] [02mw-config] 07ugochimobi synchronize pull request 03#4502: Wikibase: Adding missing setups in favour of GD & GP - 13https://github.com/miraheze/mw-config/pull/4502 [08:51:50] miraheze/mw-config - ugochimobi the build passed. [08:51:53] miraheze/mw-config - ugochimobi the build passed. [08:53:12] [02mw-config] 07ugochimobi reviewed pull request 03#4500 commit - 13https://github.com/miraheze/mw-config/pull/4500#discussion_r828884186 [08:56:37] [02mw-config] 07ugochimobi synchronize pull request 03#4500: Updating with TextExtracts params for GP - 13https://github.com/miraheze/mw-config/pull/4500 [08:56:41] [02mw-config] 07ugochimobi commented on pull request 03#4502: Wikibase: Adding missing setups in favour of GD & GP - 13https://github.com/miraheze/mw-config/pull/4502#issuecomment-1070560216 [08:57:41] miraheze/mw-config - ugochimobi the build passed. [09:09:40] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 73, in check_records nameserversans = dns_resolver.resolve(root_domain, 'NS') File "/usr/l [09:09:40] n3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query bellinrattin.it. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [10:08:24] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp20.miraheze.org - CNAME OK [10:49:24] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.71, 1.51, 1.30 [10:51:22] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.22, 1.39, 1.27 [11:14:28] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 3.28, 4.40, 2.14 [11:15:20] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.58, 4.02, 3.00 [11:15:22] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.23, 3.67, 2.96 [11:17:14] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.62, 3.48, 2.92 [11:17:22] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.52, 3.46, 2.95 [11:19:09] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.92, 3.01, 2.82 [11:19:22] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.31, 3.47, 3.00 [11:20:27] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 0.59, 1.89, 1.71 [11:21:22] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.15, 3.11, 2.91 [11:22:27] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.43, 1.38, 1.54 [11:25:22] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.74, 3.43, 3.08 [11:27:22] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.07, 3.56, 3.16 [11:31:22] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.44, 3.25, 3.14 [11:38:23] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 73, in check_records nameserversans = dns_resolver.resolve(root_domain, 'NS') File "/usr/l [11:38:24] n3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query bellinrattin.it. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [11:59:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [12:04:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [12:07:45] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp20.miraheze.org - CNAME OK [12:09:34] [02miraheze/GlobalNewFiles] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/GlobalNewFiles/compare/4ce965815cc4...15fddab9172e [12:09:36] [02miraheze/GlobalNewFiles] 07translatewiki 0315fddab - Localisation updates from https://translatewiki.net. [12:09:37] [02miraheze/CreateWiki] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/24ac96830b02...687a97bd8754 [12:09:39] [02miraheze/CreateWiki] 07translatewiki 03687a97b - Localisation updates from https://translatewiki.net. [12:09:40] [02miraheze/DataDump] 07translatewiki pushed 031 commit to 03master [+1/-0/±0] 13https://github.com/miraheze/DataDump/compare/b7a6648759f1...5d35720479eb [12:09:42] [02miraheze/DataDump] 07translatewiki 035d35720 - Localisation updates from https://translatewiki.net. [12:09:43] [02miraheze/IncidentReporting] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/IncidentReporting/compare/fec1ee8e0cbb...81d73715cb52 [12:09:45] [02miraheze/IncidentReporting] 07translatewiki 0381d7371 - Localisation updates from https://translatewiki.net. [12:09:46] [02miraheze/MatomoAnalytics] 07translatewiki pushed 031 commit to 03master [+1/-0/±0] 13https://github.com/miraheze/MatomoAnalytics/compare/2e4ddb60888f...f81e107d5bf4 [12:09:48] [02miraheze/MatomoAnalytics] 07translatewiki 03f81e107 - Localisation updates from https://translatewiki.net. [12:09:49] [02miraheze/RemovePII] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/RemovePII/compare/86094b9ffdbd...bc1875c13c40 [12:09:51] [02miraheze/RemovePII] 07translatewiki 03bc1875c - Localisation updates from https://translatewiki.net. [12:09:52] [02miraheze/ManageWiki] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/959c05213c76...0918f5f48c3a [12:09:54] [02miraheze/ManageWiki] 07translatewiki 030918f5f - Localisation updates from https://translatewiki.net. [12:09:55] [02miraheze/WikiDiscover] 07translatewiki pushed 031 commit to 03master [+1/-0/±1] 13https://github.com/miraheze/WikiDiscover/compare/a58ea11f1ef4...ed4e7e2510f7 [12:09:57] [02miraheze/WikiDiscover] 07translatewiki 03ed4e7e2 - Localisation updates from https://translatewiki.net. [12:09:58] [02miraheze/MirahezeMagic] 07translatewiki pushed 031 commit to 03master [+1/-0/±5] 13https://github.com/miraheze/MirahezeMagic/compare/9101e1987bfd...0a33d11d6ab1 [12:10:00] [02miraheze/MirahezeMagic] 07translatewiki 030a33d11 - Localisation updates from https://translatewiki.net. [12:11:38] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.62, 3.60, 2.88 [12:12:44] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.99, 4.16, 3.27 [12:13:32] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.61, 3.29, 2.86 [12:14:42] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.61, 3.61, 3.18 [12:15:06] miraheze/MirahezeMagic - translatewiki the build has errored. [12:16:40] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 7.30, 4.75, 3.62 [12:17:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.25, 3.73, 3.12 [12:18:52] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.54, 3.30, 2.78 [12:19:16] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.33, 3.57, 3.13 [12:22:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [12:22:32] PROBLEM - mwtask111 Current Load on mwtask111 is CRITICAL: CRITICAL - load average: 2.08, 1.72, 1.26 [12:22:53] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.75, 3.33, 2.94 [12:24:32] RECOVERY - mwtask111 Current Load on mwtask111 is OK: OK - load average: 1.63, 1.68, 1.30 [12:24:59] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.43, 3.18, 3.15 [12:25:58] miraheze/GlobalNewFiles - translatewiki the build passed. [12:26:13] miraheze/MatomoAnalytics - translatewiki the build passed. [12:26:38] [02mw-config] 07Reception123 commented on pull request 03#4509: Popups config for gratispaideiawiki - 13https://github.com/miraheze/mw-config/pull/4509#issuecomment-1070860196 [12:26:56] miraheze/RemovePII - translatewiki the build passed. [12:27:29] [02mw-config] 07Reception123 commented on pull request 03#4505: Update with GeoData configs - 13https://github.com/miraheze/mw-config/pull/4505#issuecomment-1070860968 [12:28:03] [02mw-config] 07Reception123 closed pull request 03#4501: ULS settings for GP - 13https://github.com/miraheze/mw-config/pull/4501 [12:28:05] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/a8cbd6c85340...ab883efb0614 [12:28:06] [02miraheze/mw-config] 07ugochimobi 03ab883ef - ULS settings for GP (#4501) [12:28:37] miraheze/WikiDiscover - translatewiki the build passed. [12:28:49] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.63, 3.85, 3.43 [12:28:52] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.91, 4.49, 3.48 [12:28:58] [02mw-config] 07Reception123 reviewed pull request 03#4500 commit - 13https://github.com/miraheze/mw-config/pull/4500#discussion_r829063521 [12:29:06] miraheze/DataDump - translatewiki the build passed. [12:29:08] miraheze/ManageWiki - translatewiki the build passed. [12:29:17] miraheze/mw-config - Reception123 the build passed. [12:29:19] miraheze/IncidentReporting - translatewiki the build passed. [12:30:44] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.81, 3.66, 3.43 [12:30:53] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.83, 3.73, 3.32 [12:32:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [12:32:38] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.14, 3.07, 3.23 [12:32:53] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.21, 3.20, 3.17 [12:36:43] miraheze/CreateWiki - translatewiki the build passed. [12:37:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.56, 8.93, 8.23 [12:38:32] PROBLEM - mwtask111 Current Load on mwtask111 is CRITICAL: CRITICAL - load average: 2.61, 2.02, 1.62 [12:40:16] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.04, 3.40, 3.93 [12:40:32] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 3.09, 4.89, 2.70 [12:41:25] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.29, 7.84, 7.98 [12:46:10] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.23, 3.58, 3.79 [12:48:08] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.70, 3.29, 3.66 [12:48:29] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 0.45, 1.46, 1.85 [12:48:34] !log [@test101] starting deploy of {'config': True} to all [12:48:36] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 1s [12:48:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:48:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:49:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [12:50:28] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.41, 1.10, 1.67 [12:50:35] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.96, 8.34, 7.69 [12:52:04] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.70, 2.88, 3.40 [12:53:25] !log [@mwtask111] starting deploy of {'config': True} to all [12:53:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:53:36] !log [@mwtask111] finished deploy of {'config': True} to all - SUCCESS in 11s [12:53:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:54:25] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.63, 8.02, 7.71 [12:55:58] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.68, 3.34, 3.53 [12:58:32] PROBLEM - mwtask111 Current Load on mwtask111 is WARNING: WARNING - load average: 1.31, 1.75, 1.96 [13:01:52] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.20, 3.24, 3.40 [13:04:20] [02mw-config] 07ugochimobi commented on pull request 03#4509: Popups config for gratispaideiawiki - 13https://github.com/miraheze/mw-config/pull/4509#issuecomment-1070901963 [13:05:46] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.12, 3.32, 3.41 [13:06:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.77, 9.04, 8.39 [13:07:44] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.20, 3.29, 3.37 [13:07:59] [02mw-config] 07Reception123 commented on pull request 03#4509: Popups config for gratispaideiawiki - 13https://github.com/miraheze/mw-config/pull/4509#issuecomment-1070905743 [13:08:25] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.91, 8.28, 8.19 [13:09:21] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 73, in check_records nameserversans = dns_resolver.resolve(root_domain, 'NS') File "/usr/l [13:09:22] n3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query bellinrattin.it. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [13:09:42] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.67, 3.12, 3.30 [13:10:32] RECOVERY - mwtask111 Current Load on mwtask111 is OK: OK - load average: 1.41, 1.48, 1.68 [13:11:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.92, 8.61, 8.19 [13:11:33] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.72, 8.70, 8.00 [13:12:40] [02mw-config] 07ugochimobi commented on pull request 03#4509: Popups config for gratispaideiawiki - 13https://github.com/miraheze/mw-config/pull/4509#issuecomment-1070911246 [13:13:07] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.62, 7.87, 7.96 [13:13:29] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.93, 8.19, 7.91 [13:19:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.77, 8.79, 8.31 [13:19:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.18, 8.93, 8.33 [13:25:25] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.33, 8.38, 8.33 [13:27:09] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.76, 9.09, 8.47 [13:27:22] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.96, 3.66, 3.34 [13:28:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.89, 3.84, 3.27 [13:29:22] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.55, 4.48, 3.69 [13:29:32] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.30, 3.67, 3.00 [13:30:06] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.12, 3.84, 3.33 [13:31:01] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.01, 8.18, 8.27 [13:33:29] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.46, 3.90, 3.26 [13:34:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [13:35:07] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.15, 9.24, 8.84 [13:35:28] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.12, 4.19, 3.43 [13:36:53] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.87, 8.93, 8.58 [13:37:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.73, 8.90, 8.75 [13:37:26] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.56, 3.70, 3.35 [13:37:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [13:38:39] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.20, 8.60, 8.29 [13:38:43] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp20.miraheze.org - CNAME OK [13:39:16] [02mw-config] 07Reception123 commented on pull request 03#4509: Popups config for gratispaideiawiki - 13https://github.com/miraheze/mw-config/pull/4509#issuecomment-1070935623 [13:39:39] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.40, 3.52, 3.55 [13:40:46] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.14, 8.49, 8.48 [13:41:22] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.80, 3.64, 3.91 [13:41:23] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.93, 2.98, 3.16 [13:41:33] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.78, 2.91, 3.32 [13:43:15] [02mw-config] 07ugochimobi commented on pull request 03#4509: Popups config for gratispaideiawiki - 13https://github.com/miraheze/mw-config/pull/4509#issuecomment-1070940449 [13:43:22] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.87, 4.42, 4.13 [13:44:25] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.14, 8.10, 8.24 [13:45:22] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.54, 3.73, 3.90 [13:47:07] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.08, 8.27, 8.49 [13:47:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [13:50:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.27, 8.88, 8.51 [13:50:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [13:50:35] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.98, 8.89, 8.17 [13:51:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.17, 8.38, 8.52 [13:51:22] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.75, 2.72, 3.38 [13:54:25] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.90, 8.21, 8.31 [13:57:07] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.88, 9.48, 8.93 [13:58:15] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.93, 8.24, 8.22 [13:58:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.21, 8.90, 8.55 [14:00:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [14:00:55] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.33, 8.53, 7.39 [14:01:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.47, 8.82, 8.82 [14:02:25] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 5.87, 7.45, 8.05 [14:02:55] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.46, 8.27, 7.42 [14:03:07] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.63, 9.41, 9.03 [14:03:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [14:04:01] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.52, 8.99, 8.48 [14:05:56] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.65, 9.09, 8.57 [14:06:10] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.17, 3.38, 3.41 [14:06:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.70, 8.78, 8.46 [14:07:14] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.08, 8.56, 8.16 [14:07:52] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.26, 8.29, 8.34 [14:08:08] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.16, 3.35, 3.40 [14:09:11] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.08, 8.62, 8.23 [14:10:00] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 86, in check_records cname = str(dns_resolver.resolve(hostname, 'CNAME')[0]) File "/usr/li [14:10:00] 3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query dnd.bellinrattin.it. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [14:10:25] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.99, 8.28, 8.37 [14:11:07] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.15, 9.10, 8.44 [14:13:03] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.55, 9.24, 8.58 [14:15:00] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.66, 9.52, 8.74 [14:17:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.86, 9.70, 9.72 [14:19:02] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.87, 1.47, 1.07 [14:20:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.81, 9.08, 8.65 [14:20:49] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.66, 9.61, 9.18 [14:21:02] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.60, 1.10, 0.98 [14:21:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 7.31, 8.68, 8.50 [14:23:07] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.27, 9.74, 9.67 [14:24:44] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.10, 9.72, 9.30 [14:26:45] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.85, 9.10, 9.13 [14:27:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.69, 9.75, 9.71 [14:29:25] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.92, 8.06, 8.37 [14:31:15] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 11.20, 8.89, 8.24 [14:33:07] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.85, 9.56, 9.56 [14:33:10] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.50, 9.13, 8.41 [14:34:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.47, 9.06, 8.85 [14:35:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.01, 9.03, 9.38 [14:36:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 7.69, 8.79, 8.80 [14:37:00] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 6.65, 7.79, 8.03 [14:37:06] PROBLEM - matomo101 Disk Space on matomo101 is WARNING: DISK WARNING - free space: / 1036 MB (10% inode=80%); [14:40:45] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.17, 9.02, 8.88 [14:42:25] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.70, 7.97, 8.43 [14:42:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.56, 8.44, 8.69 [14:43:07] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.24, 9.02, 9.08 [14:45:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.47, 8.66, 8.93 [14:48:31] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.15, 3.62, 3.04 [14:48:45] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.27, 7.83, 8.38 [14:50:31] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.25, 3.30, 3.00 [14:51:09] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.55, 8.96, 8.44 [14:55:07] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.89, 7.81, 8.46 [14:57:40] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.97, 9.29, 8.76 [14:59:49] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.63, 6.72, 5.58 [15:00:45] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.74, 7.78, 8.27 [15:01:33] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.99, 8.23, 8.44 [15:03:46] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.78, 6.43, 5.74 [15:05:20] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.87, 8.25, 7.57 [15:06:41] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.22, 8.98, 8.49 [15:07:14] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.27, 8.32, 7.68 [15:08:24] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.49, 8.95, 8.66 [15:08:36] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.52, 8.42, 8.34 [15:08:43] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp20.miraheze.org - CNAME OK [15:11:36] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.28, 8.62, 8.37 [15:12:28] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 7.80, 8.78, 8.54 [15:13:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [15:14:13] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.57, 9.34, 8.88 [15:16:09] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.53, 8.70, 8.70 [15:17:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [15:18:06] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.79, 9.66, 9.06 [15:18:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.97, 9.89, 9.06 [15:20:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.82, 9.83, 9.14 [15:21:58] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.87, 9.47, 9.09 [15:23:08] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 5.86, 7.80, 8.27 [15:23:55] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.25, 9.70, 9.22 [15:24:10] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.85, 8.66, 7.87 [15:24:55] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.04, 8.63, 7.80 [15:26:10] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.48, 8.32, 7.83 [15:26:55] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.28, 8.42, 7.82 [15:27:07] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.81, 9.21, 8.67 [15:28:54] PROBLEM - hypotheticalhurricanes.com - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - hypotheticalhurricanes.com All nameservers failed to answer the query. [15:29:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.85, 9.26, 8.77 [15:29:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.60, 9.45, 9.35 [15:30:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.03, 9.05, 8.89 [15:32:55] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.51, 9.08, 8.33 [15:33:07] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.01, 10.08, 9.22 [15:33:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.15, 10.45, 9.73 [15:34:02] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.66, 8.61, 8.34 [15:34:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.42, 8.88, 8.90 [15:34:55] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 5.46, 7.82, 7.96 [15:35:33] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.87, 10.00, 9.66 [15:35:57] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.17, 7.98, 8.16 [15:37:30] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.62, 10.07, 9.71 [15:41:56] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.70, 8.83, 8.29 [15:43:54] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 7.71, 8.32, 8.17 [15:45:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.54, 9.91, 9.83 [15:45:09] [02mw-config] 07ugochimobi synchronize pull request 03#4500: Updating with TextExtracts params for GP - 13https://github.com/miraheze/mw-config/pull/4500 [15:46:24] [02mw-config] 07ugochimobi commented on pull request 03#4500: Updating with TextExtracts params for GP - 13https://github.com/miraheze/mw-config/pull/4500#issuecomment-1070992706 [15:47:28] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.18, 9.34, 8.66 [15:47:47] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.35, 8.67, 8.39 [15:48:24] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.79, 3.31, 2.86 [15:49:00] miraheze/mw-config - ugochimobi the build passed. [15:49:45] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.16, 8.32, 8.28 [15:50:22] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.45, 3.01, 2.81 [15:50:25] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.92, 7.88, 8.35 [15:51:05] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.13, 9.38, 9.93 [15:51:11] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.86, 1.80, 1.43 [15:51:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.51, 9.42, 8.90 [15:53:06] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.02, 1.53, 1.38 [15:53:08] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.83, 3.66, 3.11 [15:55:01] [02mw-config] 07ugochimobi synchronize pull request 03#4505: Update with GeoData configs - 13https://github.com/miraheze/mw-config/pull/4505 [15:55:02] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.25, 3.62, 3.17 [15:57:25] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.94, 9.53, 9.02 [15:58:51] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.34, 3.34, 3.14 [15:59:17] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.69, 8.63, 8.50 [15:59:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.61, 9.11, 8.93 [15:59:38] miraheze/mw-config - ugochimobi the build passed. [16:00:47] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.24, 10.09, 9.98 [16:01:49] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.02, 8.87, 7.79 [16:02:45] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.77, 9.81, 9.88 [16:05:07] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.19, 9.60, 9.45 [16:05:39] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.93, 9.00, 8.09 [16:06:58] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.07, 8.43, 8.48 [16:08:28] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 1.36, 2.22, 1.44 [16:09:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.16, 9.23, 9.38 [16:09:29] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.25, 8.47, 8.08 [16:10:28] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 0.97, 1.80, 1.38 [16:12:27] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.26, 1.56, 1.34 [16:12:44] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.04, 9.20, 9.32 [16:14:31] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.73, 3.60, 3.17 [16:14:52] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.42, 3.32, 3.06 [16:16:31] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.94, 3.71, 3.27 [16:17:07] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.96, 9.72, 9.45 [16:17:09] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.68, 9.08, 8.43 [16:17:10] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.95, 8.44, 8.09 [16:19:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 7.82, 8.66, 8.36 [16:19:25] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.45, 9.54, 9.07 [16:19:30] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 7.61, 8.67, 8.59 [16:20:46] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.05, 3.29, 3.16 [16:21:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.05, 9.88, 9.63 [16:22:55] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.63, 9.47, 8.74 [16:23:07] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.84, 10.69, 9.96 [16:23:20] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.65, 9.48, 8.90 [16:24:55] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 7.10, 8.89, 8.64 [16:25:16] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.22, 9.46, 8.97 [16:26:31] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.71, 3.40, 3.38 [16:26:55] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.35, 8.35, 8.46 [16:27:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.58, 9.75, 9.73 [16:27:11] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.55, 9.69, 9.10 [16:27:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [16:28:43] RECOVERY - hypotheticalhurricanes.com - reverse DNS on sslhost is OK: SSL OK - hypotheticalhurricanes.com reverse DNS resolves to cp20.miraheze.org - NS RECORDS OK [16:29:06] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.44, 9.55, 9.14 [16:29:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.86, 9.92, 9.49 [16:30:56] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.46, 8.48, 8.44 [16:32:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [16:32:45] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.60, 9.52, 9.89 [16:34:12] Reception123: Does the United Kingdom has a copyright law, I presume yes, is it documented anywhere online? [16:34:36] Of course, I don't think there's any country without copyright laws [16:34:44] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.08, 10.18, 10.09 [16:34:51] https://www.legislation.gov.uk/ukpga/1988/48/contents [16:34:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 11.31, 9.31, 9.08 [16:34:52] [url] Copyright, Designs and Patents Act 1988 | www.legislation.gov.uk [16:35:28] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.87, 3.41, 3.20 [16:35:38] Reception123: lol, yeah, thanks for the link [16:36:47] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.79, 9.48, 9.18 [16:37:40] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.05, 8.65, 8.51 [16:39:24] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.11, 3.61, 3.32 [16:39:35] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.08, 8.26, 8.40 [16:40:38] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 11.24, 9.99, 9.43 [16:41:22] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.88, 3.17, 3.19 [16:42:33] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.80, 9.49, 9.31 [16:43:07] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.08, 9.74, 9.64 [16:47:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.34, 9.43, 9.62 [16:49:25] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.04, 9.24, 9.17 [16:51:22] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.61, 3.94, 3.39 [16:53:22] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.34, 3.70, 3.36 [16:53:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.83, 9.47, 9.29 [16:55:25] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.58, 9.93, 9.48 [16:55:48] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.88, 3.39, 3.14 [16:57:22] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.23, 3.77, 3.45 [16:57:46] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.02, 3.45, 3.18 [16:59:07] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.85, 9.47, 9.27 [16:59:22] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.11, 3.60, 3.43 [16:59:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 6.95, 8.81, 9.17 [16:59:45] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.18, 3.53, 3.25 [17:01:22] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.11, 3.25, 3.33 [17:01:43] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.96, 3.12, 3.15 [17:03:25] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.72, 9.17, 9.19 [17:04:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 11.09, 9.33, 9.09 [17:05:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.42, 8.60, 8.96 [17:06:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.82, 9.56, 9.22 [17:07:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 6.78, 9.06, 9.35 [17:09:25] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.68, 7.41, 8.39 [17:11:22] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.45, 3.46, 3.31 [17:13:22] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.81, 4.01, 3.54 [17:15:42] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.55, 3.63, 3.30 [17:17:07] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.66, 9.39, 9.23 [17:18:10] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.78, 8.20, 7.94 [17:18:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.17, 8.94, 8.83 [17:19:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.83, 9.30, 9.24 [17:19:22] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.92, 3.85, 3.67 [17:19:25] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.79, 9.94, 8.97 [17:19:31] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.04, 3.69, 3.43 [17:20:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.75, 9.24, 8.96 [17:21:25] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.40, 3.25, 3.30 [17:21:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.58, 9.70, 9.00 [17:22:10] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 7.73, 8.02, 7.95 [17:22:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.82, 10.50, 9.45 [17:23:25] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.63, 9.93, 9.16 [17:25:07] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.50, 9.62, 9.31 [17:25:22] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.38, 3.04, 3.38 [17:25:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 7.78, 8.97, 8.89 [17:26:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.42, 9.51, 9.30 [17:27:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.77, 9.24, 9.21 [17:27:25] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.61, 9.33, 9.01 [17:29:08] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.31, 10.44, 9.66 [17:29:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.70, 9.39, 9.07 [17:30:17] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.81, 3.17, 2.98 [17:31:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.66, 9.86, 9.55 [17:32:15] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.58, 2.97, 2.93 [17:33:07] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.88, 10.18, 9.70 [17:37:10] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.32, 3.70, 3.53 [17:38:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 6.80, 9.05, 9.94 [17:39:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.54, 9.74, 9.74 [17:39:08] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.02, 3.81, 3.59 [17:40:31] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.66, 3.31, 3.12 [17:40:44] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.51, 9.41, 9.95 [17:41:06] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.70, 3.76, 3.59 [17:42:31] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.94, 3.29, 3.14 [17:42:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.22, 9.06, 9.74 [17:42:55] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.66, 8.04, 7.62 [17:43:25] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.51, 7.91, 8.47 [17:44:55] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.38, 7.79, 7.59 [17:46:25] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.70, 7.46, 8.26 [17:46:44] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.01, 9.20, 9.56 [17:47:00] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.68, 4.41, 3.87 [17:47:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [17:48:58] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.05, 3.61, 3.66 [17:51:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.56, 8.74, 8.67 [17:52:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [17:52:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.34, 9.06, 9.48 [17:53:07] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.15, 9.28, 9.32 [17:54:52] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.76, 4.07, 3.79 [17:56:31] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.88, 3.42, 3.13 [17:56:46] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.35, 9.84, 9.70 [17:56:50] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.24, 3.85, 3.75 [17:57:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.85, 8.97, 9.22 [17:58:31] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.54, 3.13, 3.06 [17:58:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.98, 9.41, 9.56 [17:58:48] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.54, 4.53, 3.98 [17:59:07] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.07, 9.37, 9.34 [18:00:55] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.07, 8.27, 7.78 [18:01:01] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.38, 2.96, 1.92 [18:01:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.30, 9.22, 9.30 [18:02:31] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.39, 3.51, 3.26 [18:02:55] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.79, 8.40, 7.89 [18:03:48] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.50, 3.54, 3.29 [18:04:55] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 6.83, 7.86, 7.75 [18:05:25] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 8.24, 8.08, 8.40 [18:07:45] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.46, 3.98, 3.51 [18:08:31] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.23, 4.16, 3.63 [18:08:50] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.80, 1.97, 2.00 [18:10:44] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.25, 9.44, 9.07 [18:11:07] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.13, 9.51, 9.35 [18:11:42] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.47, 3.98, 3.64 [18:11:57] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.11, 9.21, 8.44 [18:12:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.32, 9.28, 9.06 [18:13:40] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.71, 4.12, 3.72 [18:13:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.31, 9.26, 8.55 [18:14:50] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.60, 1.12, 1.62 [18:17:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.94, 9.35, 9.44 [18:17:37] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.64, 3.62, 3.63 [18:18:02] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 13.33, 9.99, 8.89 [18:18:25] PROBLEM - mw111 NTP time on mw111 is WARNING: NTP WARNING: Offset 0.1050424874 secs [18:18:45] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.50, 9.22, 8.99 [18:19:35] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.02, 3.76, 3.68 [18:19:38] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.85, 10.16, 9.13 [18:21:33] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.38, 9.56, 9.04 [18:22:31] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.88, 3.82, 3.92 [18:22:32] PROBLEM - mwtask111 Current Load on mwtask111 is CRITICAL: CRITICAL - load average: 2.18, 1.69, 1.21 [18:23:29] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.40, 9.92, 9.23 [18:23:33] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.64, 3.36, 3.56 [18:23:47] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.10, 9.84, 9.30 [18:24:31] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.27, 3.87, 3.91 [18:24:32] RECOVERY - mwtask111 Current Load on mwtask111 is OK: OK - load average: 1.57, 1.66, 1.26 [18:25:24] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.91, 9.52, 9.17 [18:26:31] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.20, 3.60, 3.81 [18:26:37] RECOVERY - mw111 NTP time on mw111 is OK: NTP OK: Offset 0.09507668018 secs [18:27:07] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.11, 9.83, 9.53 [18:29:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.32, 9.90, 9.62 [18:30:31] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.15, 3.57, 3.73 [18:31:10] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.37, 9.32, 9.14 [18:32:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.93, 3.34, 3.98 [18:32:23] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.88, 9.80, 8.85 [18:32:31] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.09, 3.00, 3.50 [18:33:05] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.67, 9.62, 9.28 [18:33:07] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.24, 9.70, 9.53 [18:33:25] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.75, 3.03, 3.32 [18:34:32] PROBLEM - mwtask111 Current Load on mwtask111 is WARNING: WARNING - load average: 1.82, 1.74, 1.47 [18:35:00] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.43, 10.67, 9.70 [18:36:32] PROBLEM - mwtask111 Current Load on mwtask111 is CRITICAL: CRITICAL - load average: 2.03, 1.80, 1.52 [18:37:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.92, 9.53, 9.53 [18:37:26] [02miraheze/mediawiki] 07Reception123 pushed 031 commit to 03REL1_37 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/96d8efaa7614...d3eca0f69127 [18:37:28] [02miraheze/mediawiki] 07Reception123 03d3eca0f - Update DPL3 [18:37:57] !log [reception@mwtask111] starting deploy of {'world': True} to all [18:38:08] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.69, 3.27, 3.69 [18:38:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:38:31] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.67, 3.93, 3.67 [18:38:51] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 7.64, 9.55, 9.50 [18:39:25] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.83, 9.24, 9.03 [18:40:02] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 6.18, 7.92, 8.36 [18:40:06] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.60, 3.39, 3.69 [18:40:31] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.09, 3.57, 3.58 [18:40:46] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.14, 9.75, 9.58 [18:41:07] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.25, 9.23, 9.37 [18:42:04] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.07, 3.54, 3.70 [18:42:41] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.04, 9.42, 9.47 [18:43:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.59, 9.75, 9.57 [18:44:02] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.38, 3.38, 3.62 [18:44:31] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.85, 4.03, 3.74 [18:45:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.26, 9.37, 9.25 [18:47:11] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.75, 3.77, 3.51 [18:48:27] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.03, 9.66, 9.55 [18:48:31] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.38, 3.66, 3.70 [18:48:33] !log [reception@mwtask111] finished deploy of {'world': True} to all - SUCCESS in 636s [18:49:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:49:09] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.14, 3.11, 3.30 [18:49:25] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.79, 9.95, 9.44 [18:49:56] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.89, 3.55, 3.61 [18:50:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.17, 9.65, 9.58 [18:50:31] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.04, 3.98, 3.81 [18:51:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.25, 9.63, 9.38 [18:51:54] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.36, 3.41, 3.55 [18:52:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.17, 9.77, 9.62 [18:52:31] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.37, 3.76, 3.75 [18:53:25] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.37, 10.11, 9.60 [18:54:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.87, 9.45, 9.50 [18:54:31] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.41, 4.41, 3.99 [18:55:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.93, 9.98, 9.61 [18:56:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 11.17, 9.96, 9.67 [18:56:31] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.14, 3.89, 3.85 [18:57:08] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.26, 10.09, 9.52 [18:57:25] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.28, 10.00, 9.66 [18:59:46] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.42, 3.64, 3.55 [19:00:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.12, 9.42, 9.55 [19:01:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.91, 9.68, 9.51 [19:01:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 7.61, 9.06, 9.39 [19:02:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 11.08, 9.89, 9.70 [19:02:31] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.77, 4.43, 4.02 [19:03:07] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.27, 10.05, 9.65 [19:05:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.68, 9.41, 9.49 [19:05:54] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.05, 4.05, 3.49 [19:06:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.30, 9.80, 9.72 [19:07:52] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.80, 3.70, 3.41 [19:11:07] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.76, 10.13, 9.70 [19:11:49] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.32, 3.16, 3.28 [19:12:31] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.56, 3.48, 3.83 [19:15:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.09, 9.84, 9.71 [19:18:25] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.39, 7.49, 8.50 [19:18:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.95, 9.33, 10.00 [19:19:07] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.48, 9.76, 9.70 [19:19:42] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.81, 4.43, 3.71 [19:20:31] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.88, 4.41, 4.03 [19:21:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.26, 9.50, 9.61 [19:22:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 11.38, 9.93, 9.28 [19:23:07] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.43, 10.01, 9.77 [19:23:25] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.87, 9.64, 9.11 [19:24:44] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.44, 9.27, 9.65 [19:25:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.47, 9.39, 9.10 [19:26:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.61, 9.74, 9.36 [19:26:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 6.46, 8.31, 9.27 [19:27:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.01, 9.61, 9.66 [19:28:04] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 1.63, 2.42, 1.68 [19:28:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.45, 10.63, 9.72 [19:29:25] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.69, 9.57, 9.17 [19:30:00] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.05, 1.98, 1.61 [19:31:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.70, 9.23, 9.10 [19:31:44] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.96, 8.59, 7.93 [19:31:55] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.85, 1.61, 1.52 [19:32:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.51, 9.32, 9.39 [19:33:07] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.42, 9.66, 9.58 [19:34:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.99, 9.61, 9.46 [19:35:29] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.65, 3.58, 3.85 [19:36:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.69, 9.42, 9.43 [19:36:44] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.04, 8.56, 8.79 [19:37:29] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.62, 8.25, 8.01 [19:38:31] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 1.80, 2.99, 3.75 [19:38:32] PROBLEM - mwtask111 Current Load on mwtask111 is WARNING: WARNING - load average: 0.41, 0.66, 1.83 [19:40:32] RECOVERY - mwtask111 Current Load on mwtask111 is OK: OK - load average: 0.42, 0.59, 1.66 [19:41:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.19, 9.92, 9.88 [19:41:25] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.81, 3.43, 3.61 [19:41:25] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.43, 7.78, 8.40 [19:42:31] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.08, 3.85, 3.92 [19:44:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.12, 9.39, 9.32 [19:46:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.57, 8.78, 8.84 [19:46:44] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.00, 10.03, 9.54 [19:47:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.16, 8.90, 8.22 [19:47:07] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.41, 9.24, 9.51 [19:47:20] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.39, 3.78, 3.75 [19:48:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.68, 8.64, 8.78 [19:48:59] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.62, 8.92, 8.31 [19:49:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.93, 8.71, 9.29 [19:49:25] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.72, 9.95, 9.03 [19:50:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.32, 9.54, 9.50 [19:51:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.09, 9.81, 9.11 [19:52:31] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.74, 3.49, 3.86 [19:53:22] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.80, 3.35, 3.94 [19:53:25] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.63, 9.83, 9.18 [19:54:55] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.44, 8.21, 8.20 [19:55:07] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.09, 9.25, 9.23 [19:55:14] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.25, 2.96, 3.37 [19:55:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.97, 9.67, 9.18 [19:56:31] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.34, 3.66, 3.81 [19:57:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.38, 8.54, 8.97 [19:58:31] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.03, 3.47, 3.73 [19:58:44] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.69, 9.97, 9.63 [19:59:09] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.66, 3.76, 3.65 [20:00:25] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 5.73, 7.52, 8.31 [20:00:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 6.98, 8.77, 9.23 [20:01:25] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.22, 9.54, 9.27 [20:01:27] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.42, 3.55, 3.78 [20:03:07] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.18, 9.21, 9.08 [20:03:25] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.75, 3.32, 3.68 [20:04:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.09, 9.71, 8.99 [20:05:05] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.88, 2.98, 3.33 [20:05:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.51, 9.17, 9.10 [20:05:23] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.66, 3.61, 3.72 [20:06:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.51, 9.31, 8.94 [20:06:31] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.06, 3.53, 3.60 [20:06:44] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.07, 9.75, 9.50 [20:07:22] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.52, 3.24, 3.58 [20:08:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.42, 9.65, 9.10 [20:09:31] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 11.37, 9.56, 8.73 [20:11:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.06, 9.82, 9.76 [20:11:26] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.21, 9.08, 8.66 [20:12:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 6.98, 8.84, 8.95 [20:17:07] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.38, 9.80, 9.36 [20:19:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.69, 9.68, 9.37 [20:19:22] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.32, 3.26, 3.40 [20:19:25] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.59, 9.75, 9.63 [20:20:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.42, 8.89, 8.84 [20:21:00] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.53, 8.26, 8.47 [20:21:58] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.53, 9.06, 8.51 [20:23:56] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 7.20, 8.41, 8.34 [20:25:07] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.93, 9.91, 9.47 [20:25:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.97, 9.41, 9.54 [20:26:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.57, 9.76, 9.37 [20:27:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.85, 9.10, 9.23 [20:27:25] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.27, 9.51, 9.54 [20:27:42] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.67, 3.46, 3.28 [20:28:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.60, 10.10, 9.53 [20:29:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.89, 9.72, 9.62 [20:29:40] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.98, 2.84, 3.07 [20:30:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.33, 9.27, 9.29 [20:30:31] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.80, 3.63, 3.98 [20:31:07] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.11, 9.24, 9.24 [20:37:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.24, 9.63, 9.53 [20:37:22] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.36, 3.82, 3.57 [20:38:31] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.11, 3.84, 3.89 [20:38:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.52, 9.63, 9.92 [20:40:31] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.50, 3.72, 3.84 [20:40:44] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.97, 10.13, 10.07 [20:42:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [20:42:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.16, 9.87, 9.99 [20:45:22] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.25, 3.58, 3.74 [20:46:25] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.76, 7.74, 8.40 [20:46:31] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.43, 4.08, 3.87 [20:47:22] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.42, 4.01, 3.89 [20:47:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [20:49:07] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.39, 7.37, 8.39 [20:49:22] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.64, 3.69, 3.80 [20:49:25] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.66, 10.04, 9.37 [20:50:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.64, 8.85, 8.67 [20:52:31] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.13, 3.40, 3.72 [20:53:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.35, 8.41, 8.67 [20:53:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.32, 9.71, 9.40 [20:54:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.14, 8.86, 8.74 [20:57:07] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.44, 8.73, 8.69 [20:57:22] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.69, 3.92, 3.73 [20:58:31] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.85, 3.54, 3.62 [20:59:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.74, 8.87, 8.75 [21:00:12] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.02, 3.68, 3.25 [21:00:25] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.74, 7.99, 8.39 [21:00:31] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.55, 3.26, 3.52 [21:00:45] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.95, 9.47, 9.42 [21:00:55] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.54, 7.94, 7.35 [21:02:31] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.54, 2.86, 3.33 [21:02:55] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.45, 7.98, 7.43 [21:03:07] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.58, 9.62, 9.08 [21:03:22] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.63, 3.98, 3.91 [21:03:25] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.16, 7.66, 8.48 [21:04:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.84, 9.44, 9.48 [21:05:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.38, 9.82, 9.24 [21:05:22] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.48, 4.36, 4.05 [21:07:07] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.96, 10.24, 9.46 [21:07:22] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.79, 3.71, 3.85 [21:07:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [21:08:06] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.29, 3.07, 3.16 [21:09:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.40, 9.44, 9.25 [21:09:22] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.88, 3.95, 3.90 [21:10:37] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 86, in check_records cname = str(dns_resolver.resolve(hostname, 'CNAME')[0]) File "/usr/li [21:10:37] 3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query dnd.bellinrattin.it. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [21:10:44] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.63, 10.30, 9.68 [21:13:22] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.19, 3.61, 3.78 [21:13:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [21:14:45] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.01, 9.21, 9.37 [21:19:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.43, 8.71, 8.54 [21:20:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.56, 8.22, 7.83 [21:20:58] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.48, 8.12, 7.48 [21:21:22] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.27, 2.92, 3.36 [21:22:25] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.97, 8.16, 7.86 [21:22:56] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 7.39, 7.62, 7.36 [21:23:07] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 5.85, 7.46, 8.31 [21:25:25] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.32, 7.92, 8.31 [21:29:03] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.40, 3.66, 3.26 [21:29:22] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.07, 3.92, 3.56 [21:30:58] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.16, 3.18, 3.14 [21:31:22] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.89, 3.36, 3.39 [21:32:16] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.33, 8.77, 8.56 [21:33:13] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.76, 8.75, 8.16 [21:35:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.70, 8.91, 8.52 [21:36:06] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.71, 9.50, 8.89 [21:37:03] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.22, 7.91, 7.99 [21:38:01] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.79, 9.41, 8.92 [21:39:07] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.56, 8.10, 8.32 [21:39:22] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.62, 4.52, 3.87 [21:39:58] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - dnd.bellinrattin.it All nameservers failed to answer the query. [21:40:45] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.23, 7.85, 8.38 [21:41:52] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.26, 7.97, 8.46 [21:44:36] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.48, 3.47, 3.08 [21:46:14] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.82, 3.79, 3.42 [21:47:38] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.57, 8.49, 8.54 [21:48:33] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.95, 2.84, 2.91 [21:49:33] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.61, 9.76, 9.01 [21:50:03] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.69, 3.18, 3.25 [21:50:31] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.63, 7.99, 7.72 [21:51:06] PROBLEM - matomo101 Disk Space on matomo101 is CRITICAL: DISK CRITICAL - free space: / 566 MB (5% inode=80%); [21:51:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.84, 8.61, 8.44 [21:51:28] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.82, 9.40, 8.97 [21:52:45] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.72, 8.63, 8.53 [21:54:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.21, 8.67, 8.04 [21:54:44] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.34, 9.69, 8.93 [21:55:22] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.83, 3.58, 3.97 [21:57:22] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.30, 3.97, 4.05 [21:58:25] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.37, 8.32, 8.12 [21:59:22] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.84, 3.67, 3.94 [21:59:25] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.73, 7.98, 8.44 [22:00:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.65, 9.94, 9.27 [22:03:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [22:08:44] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.83, 9.99, 9.46 [22:09:20] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 86, in check_records cname = str(dns_resolver.resolve(hostname, 'CNAME')[0]) File "/usr/li [22:09:20] 3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query dnd.bellinrattin.it. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [22:09:22] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.41, 3.27, 3.54 [22:09:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [22:11:07] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.43, 7.95, 8.39 [22:11:22] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.17, 3.07, 3.43 [22:13:22] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.43, 3.35, 3.47 [22:14:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.74, 9.95, 9.77 [22:15:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.96, 8.56, 8.52 [22:15:22] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.64, 3.02, 3.33 [22:18:45] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.56, 9.68, 9.65 [22:19:07] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.14, 9.69, 8.96 [22:19:25] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.14, 9.19, 8.51 [22:20:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.23, 9.17, 8.39 [22:20:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.98, 9.65, 9.64 [22:21:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.68, 9.29, 8.91 [22:21:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 7.49, 8.84, 8.49 [22:22:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.67, 8.87, 8.37 [22:23:25] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 5.67, 7.62, 8.08 [22:24:31] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.52, 3.70, 3.21 [22:25:07] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.36, 8.11, 8.47 [22:26:12] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.34, 3.93, 3.51 [22:26:31] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.73, 3.75, 3.29 [22:27:01] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.07, 3.79, 3.05 [22:28:59] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.98, 3.67, 3.08 [22:29:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [22:30:08] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.33, 3.91, 3.63 [22:30:25] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.01, 8.32, 8.34 [22:30:57] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.78, 3.29, 3.01 [22:32:31] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 3.87, 4.05, 3.59 [22:33:55] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.75, 10.63, 9.32 [22:34:44] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 5.70, 7.35, 8.42 [22:35:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [22:36:31] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.62, 3.55, 3.51 [22:36:34] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:37:03] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:37:03] PROBLEM - cp20 Stunnel HTTP for mw122 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:37:28] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 328 bytes in 0.236 second response time [22:37:31] PROBLEM - cp30 Stunnel HTTP for mw122 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:38:28] PROBLEM - mw122 Disk Space on mw122 is WARNING: DISK WARNING - free space: / 2420 MB (10% inode=83%); [22:38:31] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.20, 2.97, 3.29 [22:38:41] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp21.miraheze.org - CNAME OK [22:39:30] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 6.918 second response time [22:39:38] RECOVERY - cp30 Stunnel HTTP for mw122 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14548 bytes in 8.001 second response time [22:39:57] PROBLEM - cloud11 Current Load on cloud11 is CRITICAL: CRITICAL - load average: 48.63, 40.06, 24.97 [22:39:58] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 3.72, 4.06, 3.81 [22:40:13] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 13.02, 9.38, 8.29 [22:40:38] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14548 bytes in 0.706 second response time [22:41:09] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 22336 bytes in 0.413 second response time [22:41:10] RECOVERY - cp20 Stunnel HTTP for mw122 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 0.017 second response time [22:41:37] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.47, 9.48, 9.46 [22:41:56] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.59, 3.88, 3.77 [22:41:57] RECOVERY - cloud11 Current Load on cloud11 is OK: OK - load average: 28.29, 37.95, 26.23 [22:42:08] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.15, 9.28, 8.40 [22:43:54] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.49, 4.87, 4.17 [22:44:44] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.07, 8.32, 8.04 [22:46:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.62, 8.65, 8.21 [22:49:48] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.62, 3.92, 3.98 [22:52:44] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.07, 9.23, 8.57 [22:53:40] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.59, 7.89, 6.99 [22:54:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.08, 9.10, 8.60 [22:55:35] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 6.81, 7.42, 6.92 [22:58:44] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.71, 7.95, 8.28 [22:59:38] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.97, 3.74, 3.72 [23:00:01] !log [@test101] starting deploy of {'l10nupdate': True} to all [23:00:03] !log [@mwtask111] starting deploy of {'l10nupdate': True} to all [23:00:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:00:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:01:25] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 8.24, 8.00, 8.39 [23:01:36] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.31, 3.12, 3.49 [23:03:07] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 5.71, 7.37, 8.45 [23:07:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.42, 8.87, 8.91 [23:07:30] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.66, 3.10, 3.37 [23:13:22] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.38, 3.99, 3.65 [23:13:40] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.40, 8.73, 8.47 [23:14:16] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.18, 8.86, 8.54 [23:14:31] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.44, 3.32, 3.06 [23:15:22] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.99, 3.52, 3.51 [23:16:31] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.80, 4.20, 3.41 [23:16:37] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.31, 1.81, 1.48 [23:18:31] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.83, 3.51, 3.24 [23:19:29] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.28, 8.06, 8.30 [23:21:03] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.01, 8.25, 7.50 [23:21:22] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.34, 3.77, 3.59 [23:21:57] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.08, 8.41, 8.47 [23:22:26] !log [@mwtask111] finished deploy of {'l10nupdate': True} to all - SUCCESS in 1342s [23:22:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:23:00] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 6.21, 7.41, 7.27 [23:23:22] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.04, 3.42, 3.48 [23:24:31] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.65, 3.11, 3.17 [23:25:21] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.35, 8.53, 8.44 [23:25:22] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.05, 3.31, 3.41 [23:27:17] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.04, 8.24, 8.36 [23:28:31] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.54, 3.76, 3.41 [23:28:38] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.30, 3.63, 3.32 [23:30:31] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.03, 3.36, 3.30 [23:30:36] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.28, 3.21, 3.21 [23:31:12] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.35, 8.98, 8.64 [23:31:33] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.05, 9.90, 8.93 [23:31:55] !log [@test101] finished deploy of {'l10nupdate': True} to all - SUCCESS in 1913s [23:32:00] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.71, 8.02, 7.69 [23:32:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:33:07] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.14, 9.13, 8.88 [23:33:09] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.28, 9.22, 8.75 [23:33:22] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.20, 3.75, 3.85 [23:33:28] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.14, 9.50, 8.92 [23:33:38] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.87, 8.42, 7.98 [23:33:54] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 5.98, 7.28, 7.47 [23:34:20] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.02, 1.70, 1.87 [23:36:44] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.75, 8.38, 7.75 [23:37:02] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.19, 9.49, 9.04 [23:37:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.27, 9.53, 9.15 [23:37:28] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.80, 8.11, 8.00 [23:38:16] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.04, 1.36, 1.68 [23:38:42] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.34, 8.21, 7.76 [23:39:25] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.55, 7.62, 8.24 [23:40:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [23:40:54] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.64, 10.22, 9.39 [23:42:51] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.89, 9.16, 9.09 [23:43:22] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.49, 2.98, 3.39 [23:45:07] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 5.94, 7.56, 8.33 [23:45:56] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.02, 3.78, 3.47 [23:47:22] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.25, 1.75, 1.33 [23:47:50] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.35, 3.48, 3.39 [23:49:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.69, 8.38, 8.50 [23:49:18] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.63, 1.37, 1.24 [23:49:45] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.04, 3.40, 3.37 [23:51:07] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.97, 8.25, 8.44 [23:51:25] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.07, 9.12, 8.49 [23:53:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.20, 9.00, 8.52 [23:57:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [23:58:45] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.08, 9.65, 9.34 [23:58:58] PROBLEM - mw111 NTP time on mw111 is WARNING: NTP WARNING: Offset -0.1081420183 secs