[00:00:57] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.15, 3.71, 3.24 [00:03:04] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.06, 3.83, 3.61 [00:04:27] PROBLEM - mw101 Puppet on mw101 is CRITICAL: CRITICAL: Puppet has 590 failures. Last run 2 minutes ago with 590 failures. Failed resources (up to 3 shown): File[/etc/ssl/localcerts/nonbinary.wiki.crt],File[/etc/ssl/private/nonbinary.wiki.key],File[/etc/ssl/localcerts/wiki.autocountsoft.com.crt],File[/etc/ssl/private/wiki.autocountsoft.com.key] [00:06:18] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.75, 9.42, 8.20 [00:07:42] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.33, 3.92, 3.97 [00:08:18] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.63, 8.71, 8.10 [00:08:57] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.24, 3.09, 3.18 [00:13:39] Hi [00:15:32] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.38, 3.75, 3.82 [00:15:36] Hi [00:17:04] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.67, 3.18, 3.39 [00:17:32] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.64, 3.74, 3.81 [00:24:07] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.40, 1.78, 1.37 [00:24:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [00:25:18] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 13.91, 9.38, 5.26 [00:26:07] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.69, 1.91, 1.45 [00:28:07] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.14, 1.57, 1.38 [00:33:04] RECOVERY - mw101 Puppet on mw101 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:33:32] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.83, 2.70, 3.25 [00:34:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [00:37:26] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.25, 3.53, 3.14 [00:39:23] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.63, 3.33, 3.10 [00:41:18] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 4.62, 5.22, 5.85 [00:43:16] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.83, 3.98, 3.39 [00:43:18] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 7.30, 5.86, 5.99 [00:43:32] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.78, 3.38, 3.23 [00:45:13] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.96, 3.63, 3.33 [00:47:10] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.15, 4.39, 3.66 [00:48:49] PROBLEM - db112 Disk Space on db112 is WARNING: DISK WARNING - free space: / 13958 MB (10% inode=99%); [00:49:18] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 4.21, 5.56, 5.99 [00:53:32] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.77, 3.58, 3.63 [00:54:57] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.24, 3.62, 3.61 [00:55:18] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 14.10, 7.41, 6.29 [00:55:32] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.63, 3.75, 3.66 [00:57:32] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.00, 3.53, 3.60 [00:58:57] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.32, 4.05, 3.76 [00:59:18] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 4.13, 5.62, 5.82 [00:59:32] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.78, 3.73, 3.65 [01:01:18] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.13, 3.70, 3.26 [01:01:32] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.81, 3.58, 3.59 [01:03:15] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.39, 3.26, 3.16 [01:04:57] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 1.97, 3.38, 3.63 [01:07:18] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 6.95, 5.49, 5.47 [01:07:32] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.12, 2.85, 3.28 [01:08:49] PROBLEM - db112 Disk Space on db112 is CRITICAL: DISK CRITICAL - free space: / 7278 MB (5% inode=99%); [01:08:57] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.60, 2.86, 3.35 [01:15:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:25:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:30:49] RECOVERY - db112 Disk Space on db112 is OK: DISK OK - free space: / 22444 MB (16% inode=99%); [01:33:18] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 2.75, 4.44, 5.86 [01:43:18] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 7.50, 5.36, 5.57 [01:48:07] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp20.miraheze.org - CNAME OK [01:51:02] PROBLEM - es101 Puppet on es101 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/apt/trusted.gpg.d/puppetlabs.gpg] [01:56:49] PROBLEM - db112 Disk Space on db112 is WARNING: DISK WARNING - free space: / 13388 MB (10% inode=99%); [01:57:03] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.95, 3.84, 3.11 [02:00:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.90, 4.05, 3.37 [02:02:17] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.27, 3.43, 3.22 [02:02:57] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.51, 2.89, 2.98 [02:04:13] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.34, 3.03, 3.09 [02:17:01] RECOVERY - es101 Puppet on es101 is OK: OK: Puppet is currently enabled, last run 29 seconds ago with 0 failures [02:17:18] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 2.30, 3.39, 5.71 [02:19:18] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 10.26, 7.86, 7.17 [02:20:49] RECOVERY - db112 Disk Space on db112 is OK: DISK OK - free space: / 24472 MB (18% inode=99%); [02:21:43] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.35, 3.57, 3.16 [02:22:41] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.36, 3.68, 3.37 [02:24:37] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.27, 3.22, 3.24 [02:25:18] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 1.66, 4.45, 5.88 [02:25:36] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.56, 2.83, 2.98 [02:29:18] RECOVERY - db112 Current Load on db112 is OK: OK - load average: 0.76, 2.53, 4.77 [02:45:58] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.13, 3.81, 3.32 [02:51:46] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.23, 3.92, 3.62 [02:57:35] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.95, 3.09, 3.31 [03:05:32] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.08, 3.77, 3.38 [03:07:32] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.99, 3.61, 3.36 [03:09:33] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.68, 3.26, 3.26 [03:16:51] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 1.88, 2.03, 1.48 [03:18:46] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.09, 1.63, 1.39 [03:24:31] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 1.87, 2.10, 1.66 [03:26:25] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.21, 1.77, 1.59 [03:28:20] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.30, 1.63, 1.56 [03:28:57] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.93, 3.40, 2.79 [03:29:32] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.62, 3.59, 3.16 [03:30:57] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.30, 2.95, 2.70 [03:33:32] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.38, 3.38, 3.16 [03:37:04] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.02, 3.64, 3.01 [03:39:04] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.73, 3.18, 2.91 [04:12:06] alerting : [FIRING:1] (!sre High Job Queue Backlog yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [04:20:39] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.76, 3.50, 3.25 [04:20:54] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.28, 2.12, 1.53 [04:22:52] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.91, 1.64, 1.42 [04:24:31] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.59, 3.15, 3.17 [04:26:57] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.08, 1.95, 1.56 [04:30:47] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.52, 1.86, 1.62 [04:32:06] ok : [RESOLVED] (!sre High Job Queue Backlog yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [04:32:41] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.02, 1.59, 1.55 [04:45:27] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.45, 2.71, 2.29 [04:45:50] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.65, 3.22, 2.79 [04:47:24] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.93, 2.45, 2.25 [04:47:46] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.92, 2.73, 2.67 [04:57:06] alerting : [FIRING:1] (!sre High Job Queue Backlog yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [04:58:42] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.86, 1.80, 1.59 [05:00:36] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.04, 1.52, 1.51 [05:42:06] ok : [RESOLVED] (!sre High Job Queue Backlog yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [06:09:33] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.03, 1.75, 1.36 [06:15:22] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.56, 3.53, 2.90 [06:16:03] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.31, 3.94, 3.31 [06:17:19] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.49, 3.60, 3.00 [06:18:00] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.14, 3.89, 3.38 [06:19:15] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.41, 2.75, 2.76 [06:19:56] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.15, 3.14, 3.16 [07:22:58] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.99, 3.56, 3.12 [07:23:03] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.93, 3.44, 2.87 [07:23:04] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.00, 1.60, 1.93 [07:24:54] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.98, 3.09, 3.01 [07:24:59] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.98, 2.82, 2.71 [07:29:04] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.10, 1.26, 1.66 [07:30:46] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.52, 1.94, 1.34 [07:32:41] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.69, 1.47, 1.24 [07:34:36] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.61, 3.63, 3.11 [07:34:57] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.41, 3.41, 2.99 [07:35:08] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.52, 3.45, 2.87 [07:36:32] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.84, 3.65, 3.18 [07:36:57] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.04, 3.51, 3.07 [07:38:57] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.30, 3.33, 3.05 [07:39:04] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.78, 3.34, 2.97 [07:40:25] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.42, 3.22, 3.12 [08:25:10] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.52, 3.21, 2.84 [08:27:06] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.49, 2.90, 2.77 [08:57:49] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.61, 2.71, 2.36 [08:59:47] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.05, 2.42, 2.29 [09:32:39] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.94, 3.03, 2.59 [09:34:35] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.21, 3.13, 2.68 [10:25:54] PROBLEM - wiki.teessidehackspace.org.uk - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.teessidehackspace.org.uk' expires in 15 day(s) (Tue 26 Apr 2022 10:05:28 GMT +0000). [10:26:34] PROBLEM - wiki.digitalefitheid.nl - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.digitalefitheid.nl' expires in 15 day(s) (Tue 26 Apr 2022 10:07:59 GMT +0000). [10:33:07] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/5b07e720aa0c...300cdf1ff1ad [10:33:08] [02miraheze/ssl] 07MirahezeSSLBot 03300cdf1 - Bot: Update SSL cert for wiki.teessidehackspace.org.uk [10:35:19] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/300cdf1ff1ad...4d0af4ada1dc [10:35:21] [02miraheze/ssl] 07MirahezeSSLBot 034d0af4a - Bot: Update SSL cert for wiki.digitalefitheid.nl [10:39:47] PROBLEM - wiki.iurevar.world - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.iurevar.world' expires in 15 day(s) (Tue 26 Apr 2022 10:09:33 GMT +0000). [10:43:54] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/4d0af4ada1dc...b82a8e45971a [10:43:55] [02miraheze/ssl] 07MirahezeSSLBot 03b82a8e4 - Bot: Update SSL cert for wiki.iurevar.world [10:54:40] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 86, in check_records cname = str(dns_resolver.resolve(hostname, 'CNAME')[0]) File "/usr/li [10:54:40] 3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query dnd.bellinrattin.it. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [10:55:48] RECOVERY - wiki.teessidehackspace.org.uk - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.teessidehackspace.org.uk' will expire on Sat 09 Jul 2022 09:33:00 GMT +0000. [10:59:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [11:04:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [11:08:35] RECOVERY - wiki.iurevar.world - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.iurevar.world' will expire on Sat 09 Jul 2022 09:43:48 GMT +0000. [11:15:32] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.48, 3.85, 3.27 [11:17:32] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.74, 3.65, 3.26 [11:19:33] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.76, 4.14, 3.50 [11:21:32] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.31, 3.54, 3.37 [11:23:32] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.02, 3.27, 3.31 [11:23:57] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.31, 3.53, 3.08 [11:24:20] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp21.miraheze.org - CNAME OK [11:25:53] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.34, 3.27, 3.05 [11:26:15] RECOVERY - wiki.digitalefitheid.nl - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.digitalefitheid.nl' will expire on Sat 09 Jul 2022 09:35:14 GMT +0000. [12:14:57] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.78, 3.34, 2.85 [12:15:17] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.98, 3.56, 3.04 [12:16:57] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.39, 3.10, 2.83 [12:17:13] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.51, 3.18, 2.97 [12:41:32] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.69, 3.69, 3.02 [12:43:32] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.92, 3.19, 2.91 [12:47:32] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.78, 3.63, 3.16 [12:51:32] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.75, 3.83, 3.32 [12:54:26] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.63, 4.29, 3.39 [12:54:43] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.82, 3.85, 2.97 [12:56:23] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.30, 3.81, 3.32 [12:56:41] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.82, 3.28, 2.87 [12:57:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [12:59:32] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 1.97, 3.66, 3.72 [13:00:35] PROBLEM - wiki.controlistes.fr - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.controlistes.fr All nameservers failed to answer the query. [13:01:32] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.74, 4.25, 3.93 [13:02:13] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.36, 3.10, 3.15 [13:02:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [13:07:32] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.89, 3.75, 3.79 [13:09:32] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.41, 3.64, 3.72 [13:11:32] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.54, 3.40, 3.64 [13:15:32] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.99, 3.81, 3.72 [13:21:32] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.11, 3.48, 3.70 [13:25:29] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 5.00, 4.13, 2.08 [13:26:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [13:29:32] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.71, 4.25, 3.90 [13:30:27] PROBLEM - wiki.controlistes.fr - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 73, in check_records nameserversans = dns_resolver.resolve(root_domain, 'NS') File "/usr/ [13:30:27] on3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query controlistes.fr. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [13:31:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [13:31:29] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.34, 1.65, 1.62 [13:31:32] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.98, 3.81, 3.79 [13:36:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [13:41:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [13:41:32] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.98, 3.66, 3.59 [13:42:57] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.91, 3.87, 3.30 [13:43:40] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.46, 3.20, 3.00 [13:46:57] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.48, 3.31, 3.23 [13:47:32] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.13, 3.93, 3.78 [13:47:36] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.62, 3.07, 3.01 [13:50:08] PROBLEM - idleon.info - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for idleon.info could not be found [13:52:57] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.80, 3.30, 3.20 [13:53:31] PROBLEM - cloud11 Puppet on cloud11 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [13:54:57] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.64, 3.09, 3.14 [13:55:32] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.93, 2.83, 3.35 [14:00:19] RECOVERY - wiki.controlistes.fr - reverse DNS on sslhost is OK: SSL OK - wiki.controlistes.fr reverse DNS resolves to cp20.miraheze.org - CNAME OK [14:00:57] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.76, 3.72, 3.29 [14:01:32] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.97, 3.63, 3.51 [14:02:57] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.53, 3.58, 3.30 [14:04:57] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.56, 3.23, 3.20 [14:07:32] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.95, 3.12, 3.32 [14:09:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [14:11:32] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.94, 3.44, 3.43 [14:15:35] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.62, 3.80, 3.56 [14:17:04] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.93, 3.75, 3.23 [14:17:36] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.91, 3.73, 3.44 [14:19:04] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.39, 4.05, 3.39 [14:19:33] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.08, 3.73, 3.46 [14:21:30] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.34, 3.81, 3.54 [14:21:31] RECOVERY - cloud11 Puppet on cloud11 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [14:22:46] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.20, 1.70, 1.30 [14:23:26] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.68, 4.20, 3.71 [14:24:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [14:24:41] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.39, 1.61, 1.32 [14:25:04] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.60, 3.76, 3.56 [14:25:23] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.89, 3.98, 3.68 [14:29:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [14:29:16] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.46, 4.29, 3.80 [14:31:13] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.50, 3.84, 3.69 [14:33:32] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.97, 3.78, 3.98 [14:35:04] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.54, 3.05, 3.33 [14:37:03] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.21, 3.29, 3.45 [14:37:32] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.30, 3.68, 3.85 [14:39:04] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.51, 3.60, 3.51 [14:41:04] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.92, 4.17, 3.74 [14:42:57] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.32, 3.44, 3.48 [14:43:04] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.49, 3.93, 3.70 [14:44:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [14:48:57] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.12, 3.52, 3.46 [14:50:57] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.56, 3.53, 3.47 [14:54:57] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.13, 4.04, 3.66 [14:55:04] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 7.47, 4.96, 4.03 [14:57:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [15:03:04] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.71, 3.80, 3.89 [15:07:04] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.57, 3.99, 3.92 [15:22:57] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.90, 3.61, 3.94 [15:23:04] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.61, 3.61, 3.99 [15:27:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [15:31:04] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.62, 3.83, 3.88 [15:36:57] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.71, 2.61, 3.26 [15:37:04] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.18, 3.05, 3.53 [15:41:04] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.14, 3.30, 3.52 [15:42:38] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.22, 9.91, 8.92 [15:44:37] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 7.76, 9.15, 8.76 [15:45:04] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.02, 3.36, 3.49 [15:47:39] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.21, 1.80, 1.47 [15:48:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [15:49:04] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.62, 3.12, 3.38 [15:49:34] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.77, 1.85, 1.53 [15:51:28] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.49, 1.67, 1.50 [15:53:04] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.20, 3.43, 3.46 [15:53:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [15:53:33] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.25, 3.72, 3.44 [15:55:18] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.19, 2.16, 1.74 [15:57:13] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.66, 1.90, 1.69 [15:57:26] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.81, 3.45, 3.41 [15:59:04] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.98, 2.96, 3.29 [15:59:08] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.74, 1.64, 1.29 [15:59:08] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.77, 1.48, 1.56 [15:59:23] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.56, 3.23, 3.34 [15:59:32] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.69, 3.28, 3.83 [16:01:08] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.08, 1.40, 1.24 [16:01:32] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.52, 3.77, 3.94 [16:02:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [16:03:04] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.19, 3.58, 3.53 [16:03:13] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.37, 4.06, 3.64 [16:03:32] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.62, 3.84, 3.95 [16:05:32] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.01, 3.99, 4.00 [16:07:06] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.44, 3.71, 3.60 [16:09:04] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.12, 3.67, 3.55 [16:09:32] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.43, 3.53, 3.84 [16:10:59] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.13, 3.59, 3.55 [16:11:04] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.63, 3.16, 3.37 [16:11:25] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.54, 10.32, 9.41 [16:13:20] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 9.54, 9.82, 9.33 [16:13:32] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.52, 4.18, 4.00 [16:15:04] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.33, 3.99, 3.66 [16:19:04] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.88, 4.00, 3.80 [16:22:57] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.13, 3.51, 3.84 [16:27:04] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.58, 2.65, 3.23 [16:29:32] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.03, 3.23, 3.89 [16:30:57] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.19, 2.64, 3.31 [16:32:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [16:33:29] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.38, 9.99, 9.26 [16:35:32] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.24, 3.59, 3.75 [16:36:07] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.99, 2.20, 1.51 [16:36:57] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.57, 3.66, 3.46 [16:37:04] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.25, 3.50, 3.18 [16:37:28] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.07, 9.54, 9.33 [16:37:32] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.22, 3.43, 3.68 [16:38:57] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.17, 3.48, 3.42 [16:39:04] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.85, 3.23, 3.12 [16:40:07] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.98, 1.64, 1.44 [16:40:57] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.79, 3.25, 3.34 [16:45:32] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.17, 2.84, 3.33 [16:49:32] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.36, 3.47, 3.52 [16:51:32] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.56, 3.62, 3.55 [16:53:04] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.65, 3.18, 3.03 [16:53:32] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.53, 3.46, 3.50 [16:54:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [16:55:04] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.65, 2.91, 2.95 [16:55:32] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.52, 3.16, 3.38 [16:59:18] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - dnd.bellinrattin.it All nameservers failed to answer the query. [16:59:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [17:03:32] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.42, 3.72, 3.56 [17:05:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [17:05:32] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 3.70, 4.13, 3.76 [17:09:32] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.69, 3.70, 3.66 [17:19:32] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.12, 3.85, 3.80 [17:21:32] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.88, 3.55, 3.70 [17:25:32] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.22, 3.76, 3.72 [17:26:57] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.45, 3.38, 3.19 [17:27:32] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.99, 3.49, 3.63 [17:28:58] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp20.miraheze.org - CNAME OK [17:30:57] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.87, 3.11, 3.12 [17:33:32] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.48, 3.73, 3.60 [17:34:57] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.58, 3.57, 3.32 [17:36:51] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.13, 2.08, 1.63 [17:36:57] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.51, 3.72, 3.39 [17:40:57] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.81, 3.54, 3.42 [17:42:57] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.22, 3.48, 3.39 [17:43:32] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.20, 3.62, 3.72 [17:44:30] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.15, 1.67, 1.68 [17:44:57] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.09, 2.94, 3.20 [17:47:32] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.87, 4.93, 4.16 [17:48:20] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.03, 2.20, 1.89 [17:48:57] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.41, 4.41, 3.79 [17:49:31] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.26, 3.46, 3.23 [17:50:15] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.57, 1.94, 1.83 [17:51:29] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.09, 3.32, 3.20 [17:51:40] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.77, 1.74, 1.20 [17:53:40] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.76, 1.41, 1.15 [17:54:38] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.28, 9.96, 9.15 [17:55:22] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.67, 3.53, 3.30 [17:56:07] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.33, 1.93, 1.85 [17:56:37] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.84, 9.55, 9.10 [17:58:07] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.27, 1.72, 1.79 [17:58:57] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.17, 3.80, 3.82 [17:59:18] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.62, 3.30, 3.27 [18:02:07] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.04, 1.44, 1.66 [18:03:11] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.86, 3.50, 3.35 [18:03:32] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.14, 3.34, 3.85 [18:05:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [18:05:08] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.68, 2.79, 3.10 [18:06:07] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.95, 2.50, 2.07 [18:09:04] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.17, 1.61, 1.27 [18:09:32] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.61, 4.36, 4.03 [18:11:32] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.71, 3.64, 3.80 [18:12:07] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.90, 1.87, 1.91 [18:12:32] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [18:12:57] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.53, 2.60, 3.23 [18:16:07] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.18, 2.11, 1.96 [18:17:32] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.15, 4.02, 3.86 [18:20:57] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.21, 3.87, 3.56 [18:22:57] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.76, 3.90, 3.61 [18:26:57] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.08, 3.75, 3.61 [18:28:57] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.05, 3.75, 3.64 [18:29:32] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.82, 3.82, 3.92 [18:32:45] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.86, 3.65, 3.37 [18:36:41] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.12, 3.84, 3.49 [18:37:32] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.54, 3.82, 3.77 [18:39:32] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.18, 3.68, 3.74 [18:40:36] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.29, 3.76, 3.58 [18:40:57] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.30, 2.94, 3.31 [18:42:34] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.31, 4.45, 3.85 [18:43:32] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.55, 4.03, 3.83 [18:44:57] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.51, 4.03, 3.65 [18:50:24] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.34, 3.90, 3.93 [18:50:42] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 1.15, 2.29, 1.75 [18:52:40] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.45, 1.68, 1.60 [18:56:07] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.78, 1.12, 1.91 [18:56:18] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.89, 3.80, 3.81 [18:57:32] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [18:58:15] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.45, 3.66, 3.75 [18:58:57] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.27, 3.97, 3.90 [19:02:07] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.75, 1.06, 1.66 [19:04:57] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.97, 3.99, 3.84 [19:05:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [19:06:06] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.18, 3.64, 3.66 [19:08:57] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.58, 3.86, 3.83 [19:11:59] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.98, 3.49, 3.61 [19:15:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [19:17:32] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.79, 3.53, 4.00 [19:17:52] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.79, 2.79, 3.29 [19:19:32] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.76, 3.62, 3.95 [19:21:32] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.07, 3.39, 3.83 [19:24:57] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 8.35, 4.99, 4.08 [19:25:33] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.19, 4.88, 4.31 [19:25:40] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.13, 4.04, 3.54 [19:26:24] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.05, 2.26, 1.57 [19:28:19] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.07, 1.86, 1.50 [19:30:15] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.51, 1.41, 1.38 [19:30:24] Hi [19:31:04]