[00:00:32] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.24, 7.96, 8.48 [00:02:39] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.34, 9.18, 9.08 [00:03:26] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 11.05, 9.28, 8.64 [00:04:04] PROBLEM - mw101 Puppet on mw101 is CRITICAL: CRITICAL: Puppet has 362 failures. Last run 3 minutes ago with 362 failures. Failed resources (up to 3 shown): File[ethene.wiki],File[ethene.wiki_private],File[reviews.thejoshmeister.com],File[reviews.thejoshmeister.com_private] [00:04:34] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.82, 9.71, 9.16 [00:04:38] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.91, 8.68, 8.90 [00:05:26] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 7.99, 8.83, 8.56 [00:06:34] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 7.80, 8.78, 8.87 [00:07:26] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.17, 8.45, 8.44 [00:12:34] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.05, 9.14, 8.90 [00:14:31] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.58, 7.94, 8.47 [00:14:40] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - dnd.bellinrattin.it All nameservers failed to answer the query. [00:15:21] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.62, 8.63, 8.49 [00:17:17] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.30, 9.27, 8.74 [00:19:13] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.28, 8.24, 8.43 [00:20:34] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.18, 9.47, 9.17 [00:22:07] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.94, 8.54, 8.39 [00:24:02] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.48, 9.00, 8.55 [00:25:58] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.77, 9.06, 8.64 [00:27:53] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.53, 8.41, 8.48 [00:31:57] RECOVERY - mw101 Puppet on mw101 is OK: OK: Puppet is currently enabled, last run 14 seconds ago with 0 failures [00:34:34] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.08, 9.25, 8.93 [00:36:34] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.46, 8.62, 8.72 [00:42:32] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.94, 8.98, 8.38 [00:42:34] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.29, 9.86, 9.17 [00:42:37] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.84, 3.45, 3.86 [00:44:13] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp20.miraheze.org - CNAME OK [00:44:32] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.23, 9.15, 8.50 [00:44:34] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.61, 9.29, 9.04 [00:45:05] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.78, 9.04, 8.37 [00:46:37] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.44, 3.59, 3.80 [00:48:32] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.75, 9.26, 8.71 [00:48:34] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 13.21, 10.81, 9.67 [00:48:37] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.49, 3.50, 3.73 [00:51:00] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.16, 8.49, 8.41 [00:56:36] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.09, 3.75, 3.74 [00:57:20] [02mw-config] 07Universal-Omega commented on pull request 03#4521: MF configs for gratispaideiawiki and gratidatawiki - 13https://github.com/miraheze/mw-config/pull/4521#issuecomment-1079806346 [00:57:26] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.46, 8.64, 8.33 [00:58:32] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.22, 7.84, 8.30 [01:00:34] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.72, 9.77, 9.81 [01:00:37] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.56, 3.77, 3.82 [01:01:50] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.31, 8.57, 8.42 [01:02:34] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.63, 10.05, 9.90 [01:03:26] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.79, 8.47, 8.40 [01:03:49] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.44, 9.41, 8.75 [01:05:47] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.79, 9.04, 8.72 [01:06:34] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.41, 9.64, 9.78 [01:08:04] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.22, 3.50, 3.93 [01:09:44] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.40, 8.09, 8.39 [01:11:25] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.70, 8.88, 8.49 [01:12:49] PROBLEM - cloud12 Puppet on cloud12 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [01:13:40] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.95, 9.63, 8.89 [01:14:34] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.73, 9.27, 9.44 [01:16:04] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.78, 2.57, 3.34 [01:16:18] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.01, 3.37, 3.98 [01:17:37] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.09, 9.19, 8.92 [01:18:36] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.74, 2.93, 3.39 [01:23:33] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.39, 7.70, 8.36 [01:24:02] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.10, 8.89, 8.60 [01:24:18] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.22, 3.61, 3.77 [01:24:37] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.96, 3.71, 3.52 [01:26:37] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.97, 3.51, 3.48 [01:28:18] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.86, 3.87, 3.86 [01:28:47] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.40, 7.49, 8.20 [01:29:49] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.12, 9.21, 8.79 [01:30:36] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.06, 2.92, 3.28 [01:32:18] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.11, 3.57, 3.70 [01:32:34] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.52, 9.63, 9.93 [01:33:40] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.81, 9.14, 8.88 [01:35:35] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.49, 9.92, 9.21 [01:36:34] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.92, 10.27, 10.10 [01:37:31] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 7.49, 9.09, 9.00 [01:38:34] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 6.80, 9.08, 9.69 [01:39:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.20, 8.92, 8.54 [01:39:25] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.36, 3.59, 3.44 [01:40:18] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.34, 3.73, 3.80 [01:40:49] RECOVERY - cloud12 Puppet on cloud12 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [01:41:08] hi [01:41:20] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.49, 3.26, 3.34 [01:41:22] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.26, 9.48, 8.58 [01:42:34] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.09, 9.56, 9.74 [01:43:18] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.91, 8.90, 8.49 [01:43:26] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.16, 7.69, 8.35 [01:44:18] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.85, 3.90, 3.82 [01:44:34] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 7.87, 8.89, 9.47 [01:46:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:47:03] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.45, 4.44, 3.79 [01:47:09] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.60, 8.42, 8.38 [01:47:37] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.27, 3.69, 3.46 [01:48:18] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.08, 3.96, 3.90 [01:48:34] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.14, 9.13, 9.36 [01:48:57] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.68, 3.83, 3.65 [01:49:35] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.97, 3.09, 3.27 [01:50:34] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.10, 8.65, 9.16 [01:51:03] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.82, 9.34, 8.74 [01:51:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:52:46] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.27, 4.29, 3.85 [01:52:58] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.60, 8.83, 8.63 [01:54:18] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 11.28, 9.28, 8.68 [01:54:23] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 1.43, 2.41, 1.58 [01:54:40] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.09, 3.86, 3.75 [01:56:14] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.93, 9.14, 8.71 [01:56:23] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.15, 1.84, 1.46 [01:58:09] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.55, 9.56, 8.91 [01:58:18] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.84, 2.92, 3.38 [01:58:23] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.89, 1.48, 1.37 [01:59:06] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.13, 7.85, 8.37 [02:00:05] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.66, 9.22, 8.87 [02:01:20] hi Hispano76 :) [02:01:25] .tell hi Hispano76 :) [02:01:25] dmehus: I'll pass that on when hi is around. [02:01:38] .tell Hispano76 hi Hispano76 :) [02:01:38] dmehus: I'll pass that on when Hispano76 is around. [02:02:09] * dmehus thinks if a user named "hi" ever comes around, they'll be quite confused [02:02:18] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.37, 3.53, 3.54 [02:02:34] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.62, 7.83, 8.44 [02:02:36] test [02:02:37] [tell] hi: 2022-03-27 - 02:01:25UTC tell hi Hispano76 :) [02:02:42] there we go :) [02:04:36] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.39, 3.07, 3.35 [02:05:58] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.44, 9.80, 9.06 [02:06:18] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.35, 3.11, 3.38 [02:10:32] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.54, 9.87, 9.09 [02:11:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.29, 9.90, 9.41 [02:12:32] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.27, 9.77, 9.17 [02:12:34] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.51, 8.41, 8.36 [02:14:34] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 8.46, 8.45, 8.39 [02:16:32] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 5.18, 7.75, 8.50 [02:18:34] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.03, 9.61, 8.84 [02:26:18] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.41, 3.38, 3.20 [02:26:32] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.44, 8.54, 8.42 [02:27:42] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.42, 9.62, 9.19 [02:28:18] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.16, 3.29, 3.19 [02:28:32] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.42, 8.15, 8.30 [02:29:26] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.72, 9.39, 8.88 [02:30:34] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 7.94, 9.23, 9.35 [02:31:28] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.70, 7.70, 6.98 [02:32:18] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.41, 3.88, 3.45 [02:33:26] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 7.58, 9.14, 8.94 [02:34:18] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.63, 3.37, 3.31 [02:34:52] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.88, 3.72, 3.28 [02:35:26] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 11.67, 9.80, 9.18 [02:35:28] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 6.21, 7.16, 6.94 [02:35:37] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.05, 9.70, 9.49 [02:36:34] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.22, 9.40, 9.40 [02:37:03] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.16, 4.11, 3.47 [02:38:18] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.78, 3.93, 3.59 [02:38:34] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.60, 8.91, 9.21 [02:38:48] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.84, 4.14, 3.53 [02:38:57] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.47, 3.75, 3.41 [02:39:26] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.42, 9.05, 9.03 [02:40:18] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.19, 3.90, 3.60 [02:40:34] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.76, 9.27, 9.28 [02:41:26] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.38, 9.18, 9.05 [02:42:34] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.12, 8.95, 9.17 [02:42:46] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.44, 3.94, 3.53 [02:43:26] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.94, 9.08, 9.03 [02:47:26] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 5.92, 7.59, 8.45 [02:48:34] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.83, 9.32, 9.23 [02:52:34] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.54, 8.94, 9.11 [02:54:32] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.12, 3.91, 3.99 [02:54:37] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.87, 3.77, 3.80 [02:55:26] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.70, 9.61, 9.01 [02:57:26] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.86, 9.34, 8.99 [03:00:37] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.03, 3.80, 3.74 [03:02:34] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.51, 9.79, 9.37 [03:02:37] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.86, 3.53, 3.66 [03:03:17] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.17, 9.30, 8.99 [03:04:34] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.53, 9.36, 9.27 [03:05:15] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.06, 9.02, 8.94 [03:06:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:08:18] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.99, 2.70, 3.33 [03:08:37] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.96, 2.77, 3.32 [03:09:12] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.32, 7.66, 8.41 [03:09:26] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.56, 7.48, 8.32 [03:12:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:14:51] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 86, in check_records cname = str(dns_resolver.resolve(hostname, 'CNAME')[0]) File "/usr/li [03:14:51] 3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query dnd.bellinrattin.it. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [03:18:34] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.52, 8.49, 8.68 [03:20:34] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.19, 8.64, 8.72 [03:21:26] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 11.41, 9.36, 8.48 [03:21:59] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.22, 9.21, 8.37 [03:22:34] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.65, 9.29, 8.94 [03:22:59] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.25, 8.87, 8.49 [03:23:26] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.16, 9.23, 8.55 [03:23:50] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.47, 1.65, 1.09 [03:23:54] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.90, 9.11, 8.44 [03:24:34] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.41, 9.07, 8.92 [03:24:58] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.38, 8.38, 8.34 [03:25:49] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.14, 1.46, 1.09 [03:26:18] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.06, 3.13, 3.81 [03:27:26] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.03, 8.96, 8.55 [03:27:46] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.55, 8.27, 8.25 [03:29:26] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.63, 9.04, 8.65 [03:30:18] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.75, 3.95, 3.93 [03:32:18] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.47, 3.36, 3.71 [03:32:47] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.66, 1.81, 1.34 [03:33:26] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.52, 8.10, 8.34 [03:34:46] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.95, 1.45, 1.26 [03:37:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:38:18] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.38, 2.68, 3.31 [03:38:34] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 5.86, 7.35, 8.21 [03:50:37] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 1.63, 2.13, 1.61 [03:51:00] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.82, 3.72, 3.45 [03:52:36] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.03, 1.69, 1.51 [03:52:54] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.93, 5.09, 3.98 [03:55:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:56:41] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.40, 3.79, 3.67 [04:00:28] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.40, 1.84, 1.39 [04:00:29] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.61, 3.63, 3.59 [04:02:23] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.60, 3.40, 3.50 [04:02:27] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.50, 1.33, 1.25 [04:05:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [04:06:18] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.46, 2.70, 3.22 [04:06:27] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 1.23, 2.05, 1.60 [04:08:26] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.52, 1.52, 1.46 [04:10:32] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.96, 8.71, 7.81 [04:12:18] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.42, 3.51, 3.35 [04:12:35] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.61, 8.37, 7.81 [04:14:18] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.56, 3.56, 3.40 [04:16:18] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.79, 3.32, 3.33 [04:20:18] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.67, 4.88, 3.94 [04:21:10] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.64, 8.76, 8.22 [04:21:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [04:22:28] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.03, 3.55, 3.17 [04:25:07] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.00, 8.29, 8.19 [04:26:24] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.24, 3.07, 3.09 [04:30:18] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.47, 3.45, 3.76 [04:31:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.23, 8.70, 8.35 [04:36:05] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.86, 8.97, 8.13 [04:36:57] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.39, 9.94, 8.89 [04:38:55] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.22, 9.26, 8.75 [04:40:18] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.03, 2.86, 3.30 [04:41:52] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.01, 8.31, 8.12 [04:43:32] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp21.miraheze.org - CNAME OK [04:46:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [04:48:48] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.74, 8.17, 8.45 [04:56:41] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.21, 8.54, 8.37 [05:00:38] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.69, 8.27, 8.33 [05:02:18] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.69, 4.15, 3.62 [05:06:18] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.99, 3.89, 3.68 [05:20:18] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.78, 3.68, 3.56 [05:24:18] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.24, 3.75, 3.66 [05:32:18] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.50, 2.95, 3.32 [05:45:28] [02puppet] 07Reception123 closed pull request 03#2455: Revert "Remove SSH key for Universal Omega" - 13https://github.com/miraheze/puppet/pull/2455 [05:45:29] [02miraheze/puppet] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/795ac20914c7...bb90cd68236e [05:45:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:45:31] [02miraheze/puppet] 07Universal-Omega 03bb90cd6 - Revert "Remove SSH key for Universal Omega (#2414)" (#2455) [05:45:32] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 86, in check_records cname = str(dns_resolver.resolve(hostname, 'CNAME')[0]) File "/usr/li [05:45:32] 3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query dnd.bellinrattin.it. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [05:50:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:53:12] [02mw-config] 07ugochimobi commented on pull request 03#4521: MF configs for gratispaideiawiki and gratidatawiki - 13https://github.com/miraheze/mw-config/pull/4521#issuecomment-1079846203 [06:08:52] PROBLEM - mwtask111 Current Load on mwtask111 is CRITICAL: CRITICAL - load average: 2.25, 1.68, 1.10 [06:22:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [06:32:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [06:38:51] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.53, 2.93, 2.64 [06:40:45] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.38, 2.39, 2.49 [06:44:33] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.66, 3.40, 2.85 [06:44:38] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp21.miraheze.org - CNAME OK [06:45:04] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.71, 4.06, 2.81 [06:46:27] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.89, 3.70, 3.04 [06:47:02] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.20, 3.52, 2.76 [06:49:00] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.97, 2.90, 2.62 [06:50:18] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.00, 3.27, 3.01 [06:55:10] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.66, 7.59, 7.20 [06:55:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [06:57:08] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.97, 7.48, 7.19 [07:00:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [07:16:52] PROBLEM - mwtask111 Current Load on mwtask111 is WARNING: WARNING - load average: 1.37, 1.43, 1.96 [07:19:27] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.88, 8.27, 7.69 [07:20:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [07:21:25] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.24, 7.66, 7.53 [07:25:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [07:28:52] RECOVERY - mwtask111 Current Load on mwtask111 is OK: OK - load average: 1.28, 1.42, 1.69 [07:32:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [07:34:43] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.34, 8.17, 6.97 [07:36:41] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.97, 7.91, 7.02 [07:42:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [07:42:32] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.51, 7.96, 7.32 [07:44:32] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.76, 7.47, 7.22 [08:03:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [08:08:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [08:15:26] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 3.06, 3.60, 1.90 [08:19:26] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 0.61, 1.86, 1.56 [08:21:21] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.70, 8.85, 7.70 [08:21:26] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.49, 1.38, 1.42 [08:23:19] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.81, 8.88, 7.86 [08:25:17] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.34, 8.19, 7.72 [08:29:08] [02puppet] 07Reception123 closed pull request 03#2453: mwdeploy: use a TypedDict; drop running on non-canary - 13https://github.com/miraheze/puppet/pull/2453 [08:29:09] [02miraheze/puppet] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/bb90cd68236e...eecd5d5309cc [08:29:11] [02miraheze/puppet] 07RhinosF1 03eecd5d5 - mwdeploy: use a TypedDict; drop running on non-canary (#2453) [08:32:48] [02puppet] 07RhinosF1 opened pull request 03#2456: mwdeploy: allow async command running - 13https://github.com/miraheze/puppet/pull/2456 [08:36:05] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.60, 7.99, 7.58 [08:36:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [08:38:05] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 5.85, 7.15, 7.32 [08:39:26] [02puppet] 07RhinosF1 synchronize pull request 03#2456: mwdeploy: allow async command running - 13https://github.com/miraheze/puppet/pull/2456 [08:41:09] [02puppet] 07RhinosF1 synchronize pull request 03#2456: mwdeploy: allow async command running - 13https://github.com/miraheze/puppet/pull/2456 [08:41:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [08:57:12] [02puppet] 07RhinosF1 synchronize pull request 03#2456: mwdeploy: allow async command running - 13https://github.com/miraheze/puppet/pull/2456 [09:00:07] [02puppet] 07RhinosF1 synchronize pull request 03#2456: mwdeploy: allow async command running - 13https://github.com/miraheze/puppet/pull/2456 [09:02:21] [02puppet] 07RhinosF1 synchronize pull request 03#2456: mwdeploy: allow async command running - 13https://github.com/miraheze/puppet/pull/2456 [09:10:14] [02puppet] 07RhinosF1 synchronize pull request 03#2456: mwdeploy: allow async command running - 13https://github.com/miraheze/puppet/pull/2456 [09:12:42] [02puppet] 07RhinosF1 synchronize pull request 03#2456: mwdeploy: allow async command running - 13https://github.com/miraheze/puppet/pull/2456 [09:12:43] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.87, 7.80, 7.10 [09:14:39] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.83, 7.54, 7.09 [09:15:44] [02puppet] 07RhinosF1 synchronize pull request 03#2456: mwdeploy: allow async command running - 13https://github.com/miraheze/puppet/pull/2456 [09:17:14] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 73, in check_records nameserversans = dns_resolver.resolve(root_domain, 'NS') File "/usr/l [09:17:14] n3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query bellinrattin.it. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [09:18:23] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 1.54, 2.31, 1.36 [09:20:23] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.52, 1.69, 1.24 [09:31:46] [02puppet] 07RhinosF1 synchronize pull request 03#2456: mwdeploy: allow async command running - 13https://github.com/miraheze/puppet/pull/2456 [09:32:28] [02puppet] 07RhinosF1 edited pull request 03#2456: mwdeploy: allow async command running - 13https://github.com/miraheze/puppet/pull/2456 [09:43:04] [02puppet] 07RhinosF1 synchronize pull request 03#2456: mwdeploy: allow async command running - 13https://github.com/miraheze/puppet/pull/2456 [09:44:53] [02puppet] 07RhinosF1 synchronize pull request 03#2456: mwdeploy: allow async command running - 13https://github.com/miraheze/puppet/pull/2456 [09:46:47] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - dnd.bellinrattin.it All nameservers failed to answer the query. [09:47:19] [02puppet] 07RhinosF1 synchronize pull request 03#2456: mwdeploy: allow async command running - 13https://github.com/miraheze/puppet/pull/2456 [10:10:06] [02puppet] 07RhinosF1 synchronize pull request 03#2456: mwdeploy: allow async command running - 13https://github.com/miraheze/puppet/pull/2456 [10:16:21] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp20.miraheze.org - CNAME OK [10:30:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [10:35:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [10:47:29] PROBLEM - parapedia.pl - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 73, in check_records nameserversans = dns_resolver.resolve(root_domain, 'NS') File "/usr/lib/pyth [10:47:29] -packages/dns/resolver.py", line 1030, in resolve (request, answer) = resolution.next_request() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 584, in next_request raise NXDOMAIN(qnames=self.qnames_to_try,dns.resolver.NXDOMAIN: The DNS query name does not exist: parapedia.pl. [10:53:15] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.30, 4.53, 2.67 [10:53:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [10:57:36] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.40, 3.66, 2.89 [10:59:04] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 0.27, 1.72, 1.99 [10:59:34] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.74, 3.26, 2.84 [11:02:18] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.95, 3.34, 2.81 [11:04:18] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.85, 3.81, 3.04 [11:04:53] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.45, 0.97, 1.57 [11:05:26] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.81, 3.50, 3.10 [11:06:18] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.30, 3.51, 3.02 [11:08:18] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.55, 2.91, 2.86 [11:08:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [11:09:22] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.04, 3.28, 3.11 [11:15:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.24, 3.54, 3.29 [11:17:12] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.17, 3.01, 3.12 [11:17:22] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - dnd.bellinrattin.it All nameservers failed to answer the query. [11:22:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [11:30:39] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 10.00, 7.88, 6.06 [11:32:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [11:32:38] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.42, 7.41, 6.13 [11:34:38] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 6.31, 6.72, 6.01 [11:37:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [11:46:56] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 73, in check_records nameserversans = dns_resolver.resolve(root_domain, 'NS') File "/usr/l [11:46:56] n3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query bellinrattin.it. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [11:50:34] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.98, 8.32, 7.62 [11:53:02] PROBLEM - cloud11 Puppet on cloud11 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [11:54:34] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.82, 8.25, 7.83 [11:54:47] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.98, 8.02, 7.52 [11:56:46] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.15, 7.62, 7.43 [11:58:34] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.05, 9.41, 8.37 [12:00:34] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 7.94, 8.68, 8.22 [12:02:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [12:02:34] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.33, 8.25, 8.12 [12:04:37] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.71, 9.06, 8.25 [12:06:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [12:10:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.44, 3.22, 2.81 [12:11:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [12:12:32] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.92, 9.06, 8.18 [12:14:10] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.61, 9.08, 8.32 [12:14:10] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.30, 2.76, 2.71 [12:14:30] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.23, 8.21, 8.33 [12:14:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [12:16:05] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.75, 9.52, 8.56 [12:18:01] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 7.96, 9.01, 8.49 [12:18:32] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.36, 8.43, 8.19 [12:21:01] RECOVERY - cloud11 Puppet on cloud11 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [12:23:47] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.77, 8.16, 8.33 [12:24:04] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.08, 3.97, 3.32 [12:24:56] PROBLEM - mwtask111 Current Load on mwtask111 is CRITICAL: CRITICAL - load average: 2.05, 1.79, 1.37 [12:26:04] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.56, 3.86, 3.36 [12:26:54] RECOVERY - mwtask111 Current Load on mwtask111 is OK: OK - load average: 1.45, 1.65, 1.36 [12:27:40] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.85, 8.98, 8.57 [12:29:35] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 7.91, 8.81, 8.58 [12:30:04] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.87, 3.07, 3.19 [12:31:25] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.97, 9.39, 8.54 [12:31:31] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.96, 8.37, 8.43 [12:32:08] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.32, 8.63, 8.24 [12:33:21] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.30, 9.23, 8.60 [12:39:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [12:40:00] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.36, 8.27, 8.34 [12:40:44] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.87, 3.19, 2.70 [12:41:04] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.62, 9.65, 8.97 [12:42:38] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.15, 3.06, 2.71 [12:43:00] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.38, 9.07, 8.84 [12:45:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [12:46:02] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp20.miraheze.org - CNAME OK [12:50:43] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.46, 8.07, 8.45 [12:50:46] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.06, 8.99, 8.55 [12:51:51] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.46, 3.99, 3.32 [12:52:45] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.87, 9.00, 8.61 [12:52:52] PROBLEM - mwtask111 Current Load on mwtask111 is CRITICAL: CRITICAL - load average: 2.52, 1.94, 1.64 [12:53:00] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.01, 9.33, 8.35 [12:54:05] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.86, 8.63, 8.22 [12:54:43]