[00:00:24] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.16, 1.76, 1.86 [00:00:56] [02puppet] 07Universal-Omega opened pull request 03#2525: Raise default PHP memory limit to 256MB - 13https://github.com/miraheze/puppet/pull/2525 [00:00:57] [url] Page not found · GitHub · GitHub | github.com [00:01:34] [02puppet] 07Universal-Omega synchronize pull request 03#2525: Raise default PHP memory limit to 256MB - 13https://github.com/miraheze/puppet/pull/2525 [00:01:34] [url] Page not found · GitHub · GitHub | github.com [00:02:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [00:02:26] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.67, 1.75, 1.85 [00:02:31] [02puppet] 07Universal-Omega edited pull request 03#2525: Raise base PHP memory limit to 256MB - 13https://github.com/miraheze/puppet/pull/2525 [00:02:32] ... [00:03:18] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.86, 1.83, 1.71 [00:05:15] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.28, 1.57, 1.63 [00:05:55] PROBLEM - es101 Current Load on es101 is WARNING: WARNING - load average: 3.71, 2.67, 1.53 [00:06:32] [02puppet] 07paladox closed pull request 03#2525: Raise base PHP memory limit to 256MB - 13https://github.com/miraheze/puppet/pull/2525 [00:06:33] [url] Page not found · GitHub · GitHub | github.com [00:06:34] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/61d6122ca6eb...cf2f78a76e87 [00:06:34] [url] Comparing 61d6122ca6eb...cf2f78a76e87 · miraheze/puppet · GitHub | github.com [00:06:35] [02miraheze/puppet] 07Universal-Omega 03cf2f78a - Raise base PHP memory limit to 256MB (#2525) [00:07:55] RECOVERY - es101 Current Load on es101 is OK: OK - load average: 2.44, 2.49, 1.60 [00:08:33] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.72, 11.86, 9.45 [00:10:24] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.50, 1.52, 1.70 [00:10:33] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.56, 10.11, 9.10 [00:12:00] [02mw-config] 07Universal-Omega closed pull request 03#4661: Only require ExtensionMessageFiles.php if file exists - 13https://github.com/miraheze/mw-config/pull/4661 [00:12:01] [url] Page not found · GitHub · GitHub | github.com [00:12:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [00:12:02] [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/mw-config [00:12:02] [url] Page not found · GitHub · GitHub | github.com [00:12:03] [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [00:12:05] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/2be6e3df1ec9...4b047773612a [00:12:05] [url] Comparing 2be6e3df1ec9...4b047773612a · miraheze/mw-config · GitHub | github.com [00:12:06] [02miraheze/mw-config] 07Universal-Omega 034b04777 - Only require ExtensionMessageFiles.php if file exists (#4661) [00:13:10] miraheze/mw-config - Universal-Omega the build passed. [00:18:24] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 5.88, 2.97, 2.14 [00:20:11] !log [@test101] starting deploy of {'config': True} to all [00:20:12] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 0s [00:20:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:20:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:22:50] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.79, 1.77, 1.49 [00:22:52] !log [@mwtask111] starting deploy of {'config': True} to all [00:22:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:23:08] !log [@mwtask111] finished deploy of {'config': True} to all - SUCCESS in 16s [00:23:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:24:47] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.24, 1.53, 1.44 [00:26:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [00:27:22] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.38, 12.19, 9.95 [00:29:22] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.96, 11.27, 9.89 [00:31:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [00:33:20] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.56, 9.79, 9.62 [00:37:39] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.64, 3.71, 3.98 [00:38:24] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.85, 1.89, 1.98 [00:38:28] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.95, 10.12, 9.29 [00:40:25] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.84, 9.80, 9.28 [00:42:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [00:47:29] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.80, 2.74, 3.32 [00:47:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [00:48:24] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.62, 2.07, 1.97 [00:49:52] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.41, 3.37, 3.95 [00:54:24] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.70, 1.93, 1.97 [00:55:52] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.38, 3.69, 3.85 [00:57:33] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.39, 3.09, 3.85 [00:57:52] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.85, 3.74, 3.85 [00:57:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.47, 11.23, 9.95 [00:58:55] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/4b047773612a...0183cc655751 [00:58:55] [url] Comparing 4b047773612a...0183cc655751 · miraheze/mw-config · GitHub | github.com [00:58:56] [02miraheze/mw-config] 07Universal-Omega 030183cc6 - Raise lua memory limit to 50MB [00:59:33] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 7.50, 4.26, 4.15 [00:59:49] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.26, 10.89, 10.02 [00:59:52] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.09, 4.41, 4.06 [00:59:59] miraheze/mw-config - Universal-Omega the build passed. [01:01:10] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.71, 3.81, 3.55 [01:02:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:04:24] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.37, 1.43, 1.68 [01:05:06] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.59, 3.24, 3.37 [01:05:55] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/0183cc655751...fc6dcef91771 [01:05:55] [url] Comparing 0183cc655751...fc6dcef91771 · miraheze/mw-config · GitHub | github.com [01:05:56] [02miraheze/mw-config] 07Universal-Omega 03fc6dcef - Use 50 * 1024 * 1024 instead of fixed bytes [01:07:01] miraheze/mw-config - Universal-Omega the build passed. [01:09:04] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.97, 3.59, 3.49 [01:09:39] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.34, 9.52, 9.83 [01:11:52] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.37, 3.69, 3.92 [01:13:52] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.20, 3.90, 3.96 [01:17:01] alerting : [FIRING:1] (mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:17:04] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.96, 2.84, 3.24 [01:17:33] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.84, 3.38, 3.91 [01:17:52] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.91, 3.62, 3.86 [01:19:39] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.05, 10.32, 10.10 [01:20:24] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.01, 1.61, 1.51 [01:20:38] !log [@test101] starting deploy of {'config': True} to all [01:20:39] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 0s [01:20:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:20:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:21:33] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.01, 3.78, 3.97 [01:22:31] !log [@mwtask111] starting deploy of {'config': True} to all [01:22:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:22:40] !log [@mwtask111] finished deploy of {'config': True} to all - SUCCESS in 8s [01:22:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:23:33] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.22, 3.66, 3.91 [01:23:52] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.84, 4.32, 4.04 [01:24:24] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.75, 1.76, 1.60 [01:25:33] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.93, 4.78, 4.28 [01:26:24] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.23, 1.57, 1.54 [01:27:01] alerting : [FIRING:2] (mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:27:04] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.70, 3.85, 3.60 [01:27:39] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.29, 9.86, 10.06 [01:29:04] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 3.98, 4.05, 3.71 [01:32:01] alerting : [FIRING:1] (mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:35:04] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.43, 3.89, 3.79 [01:43:04] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.79, 3.49, 3.53 [01:50:24] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.90, 2.10, 1.76 [01:52:24] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.71, 1.95, 1.75 [01:55:04] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.32, 3.91, 3.79 [01:56:24] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.41, 1.68, 1.68 [01:57:01] alerting : [FIRING:2] (mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [02:01:04] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 3.57, 4.02, 3.88 [02:02:01] ok : [RESOLVED] (mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [02:03:04] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.45, 3.57, 3.74 [02:03:52] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.84, 3.55, 3.92 [02:04:24] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.82, 1.71, 1.67 [02:05:52] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.34, 3.75, 3.94 [02:06:27] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.69, 1.70, 1.67 [02:10:24] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.88, 1.79, 1.73 [02:13:04] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 9.06, 5.65, 4.44 [02:14:09] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.37, 1.73, 0.97 [02:16:09] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.47, 1.27, 0.90 [02:16:24] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.25, 1.88, 1.77 [02:21:04] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.56, 3.76, 3.95 [02:21:52] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.85, 3.38, 3.94 [02:24:24] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.71, 1.98, 1.93 [02:25:59] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 73, in check_records nameserversans = dns_resolver.resolve(root_domain, 'NS') File "/usr/l [02:25:59] n3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query bellinrattin.it. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [02:27:04] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.31, 3.70, 3.81 [02:27:33] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.23, 3.38, 3.94 [02:29:04] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.02, 3.45, 3.70 [02:29:52] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.77, 2.59, 3.36 [02:31:33] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.21, 3.93, 4.04 [02:35:04] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.14, 2.71, 3.29 [02:42:19] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 4.68, 5.08, 2.83 [02:44:24] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.27, 1.50, 1.66 [02:47:38] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.35, 3.58, 3.40 [02:49:13] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.36, 10.10, 9.28 [02:49:36] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.14, 3.77, 3.47 [02:50:24] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.64, 2.13, 1.87 [02:52:06] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.64, 1.38, 1.87 [02:52:24] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.36, 1.82, 1.78 [02:53:04] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.86, 3.29, 3.10 [02:53:06] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.53, 10.02, 9.44 [02:54:04] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.48, 1.06, 1.69 [02:54:24] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.11, 1.56, 1.69 [02:59:04] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.44, 3.89, 3.44 [03:03:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:08:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:08:39] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.16, 10.35, 10.01 [03:10:36] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.18, 10.09, 9.96 [03:12:04] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.53, 1.32, 1.04 [03:14:02] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.88, 1.08, 0.98 [03:17:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:20:24] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.18, 1.90, 1.60 [03:22:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:22:24] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.48, 1.71, 1.57 [03:24:00] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp21.miraheze.org - CNAME OK [03:24:24] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.56, 1.67, 1.57 [03:29:04] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.72, 3.61, 3.98 [03:35:52] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.17, 10.10, 9.67 [03:37:04] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.03, 3.47, 3.76 [03:37:48] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.21, 9.34, 9.45 [03:39:04] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.86, 3.65, 3.80 [03:48:24] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.62, 1.96, 1.66 [03:53:04] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.47, 2.87, 3.39 [03:54:24] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.88, 1.97, 1.78 [03:54:30] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.67, 3.46, 3.98 [03:58:26] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.48, 3.69, 3.95 [04:01:04] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.94, 3.40, 3.43 [04:02:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.86, 3.76, 3.98 [04:04:24] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.09, 1.89, 1.83 [04:05:04] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.04, 2.93, 3.25 [04:06:24] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.78, 1.84, 1.82 [04:08:16] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.31, 3.58, 3.77 [04:09:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [04:11:04] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.79, 3.38, 3.30 [04:12:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.66, 3.68, 3.81 [04:13:04] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.55, 3.09, 3.20 [04:14:10] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.23, 3.87, 3.85 [04:14:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [04:16:08] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.76, 3.49, 3.72 [04:18:24] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.57, 1.98, 1.86 [04:20:04] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.03, 3.86, 3.76 [04:22:02] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.60, 3.35, 3.59 [04:24:24] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.27, 1.86, 1.89 [04:25:58] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.08, 3.90, 3.73 [04:27:56] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.48, 3.37, 3.56 [04:29:54] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.63, 2.90, 3.38 [04:30:24] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.03, 1.36, 1.65 [04:31:33] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 1.58, 2.62, 3.78 [04:41:33] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.04, 2.69, 3.28 [04:43:25] PROBLEM - cp30 Stunnel HTTP for mw121 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [04:43:39] PROBLEM - cp21 Stunnel HTTP for mw121 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [04:44:07] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 29.73, 18.12, 10.94 [04:45:23] RECOVERY - cp30 Stunnel HTTP for mw121 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14640 bytes in 0.318 second response time [04:45:36] PROBLEM - mw121 Disk Space on mw121 is CRITICAL: DISK CRITICAL - free space: / 212 MB (0% inode=83%); [04:45:38] RECOVERY - cp21 Stunnel HTTP for mw121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14634 bytes in 0.015 second response time [04:47:52] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.28, 3.94, 3.38 [04:50:07] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 6.59, 11.44, 10.50 [04:50:24] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.18, 1.66, 1.48 [04:50:55] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.85, 3.51, 3.23 [04:51:52] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.83, 3.76, 3.49 [04:52:07] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 5.94, 9.77, 10.01 [04:52:24] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.64, 1.66, 1.50 [04:52:53] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.23, 3.24, 3.18 [04:53:52] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.36, 3.25, 3.33 [04:56:09] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.86, 1.36, 0.93 [04:58:09] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.46, 1.02, 0.86 [04:58:45] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.62, 3.93, 3.46 [05:00:23] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.58, 3.72, 3.46 [05:01:52] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.70, 3.76, 3.52 [05:02:41] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.91, 3.66, 3.47 [05:03:52] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.48, 3.80, 3.54 [05:04:39] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.13, 3.64, 3.47 [05:05:52] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.81, 3.36, 3.41 [05:06:13] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.17, 3.06, 3.27 [05:06:37] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.76, 3.60, 3.47 [05:09:52] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.36, 4.17, 3.70 [05:10:34] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.70, 4.13, 3.67 [05:12:00] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.59, 3.48, 3.38 [05:12:32] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.29, 3.65, 3.55 [05:14:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:14:30] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.87, 4.32, 3.79 [05:15:54] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.28, 3.08, 3.25 [05:16:28] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.24, 3.55, 3.58 [05:17:52] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.63, 3.57, 3.68 [05:19:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:19:55] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.41, 2.01, 1.70 [05:20:24] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.53, 3.07, 3.38 [05:21:49] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.67, 1.93, 1.71 [05:23:52] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.07, 3.63, 3.64 [05:24:34] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.41, 3.42, 3.22 [05:25:52] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.74, 3.67, 3.65 [05:26:31] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.22, 3.40, 3.25 [05:27:30] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.46, 1.64, 1.65 [05:32:18] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.18, 3.56, 3.35 [05:33:11] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.86, 1.79, 1.71 [05:34:15] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.48, 2.88, 3.13 [05:35:52] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.12, 2.73, 3.21 [05:42:39] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.13, 1.87, 1.78 [05:44:33] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.97, 1.86, 1.79 [05:46:27] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.18, 1.93, 1.82 [05:54:24] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.73, 1.99, 1.96 [05:56:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [06:00:40] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.20, 3.88, 3.26 [06:01:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [06:02:38] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.32, 3.23, 3.09 [06:04:20] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.92, 3.73, 3.14 [06:06:17] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.31, 3.90, 3.27 [06:06:24] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.66, 2.06, 1.95 [06:06:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [06:07:15] [discord] I see :DoneMH: [06:07:39] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.36, 10.45, 9.37 [06:10:10] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.50, 3.44, 3.23 [06:12:07] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.81, 2.90, 3.06 [06:15:39] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.30, 9.92, 9.68 [06:16:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [06:21:39] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.09, 10.28, 9.87 [06:23:39] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.40, 10.96, 10.16 [06:25:39] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.35, 11.05, 10.30 [06:26:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [06:27:10] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.85, 3.29, 3.00 [06:27:38] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.55, 3.66, 3.18 [06:29:07] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.62, 3.68, 3.17 [06:29:26] [02miraheze/dns] 07Reception123 pushed 031 commit to 03master [+1/-0/±0] 13https://github.com/miraheze/dns/compare/42e0950362e9...098ef4fff189 [06:29:27] [url] Comparing 42e0950362e9...098ef4fff189 · miraheze/dns · GitHub | github.com [06:29:28] [02miraheze/dns] 07Reception123 03098ef4f - add aresrocket.ml zone [06:29:34] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.30, 4.44, 3.53 [06:29:39] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.17, 9.99, 10.09 [06:31:05] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.04, 3.08, 3.01 [06:31:33] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.22, 3.58, 3.32 [06:33:33] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.53, 3.30, 3.25 [06:33:39] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.48, 10.77, 10.38 [06:36:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [06:39:39] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.22, 10.96, 10.54 [06:40:23] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.34, 3.55, 3.39 [06:41:39] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.58, 11.13, 10.65 [06:42:20] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.02, 3.70, 3.47 [06:44:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [06:46:15] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.92, 3.64, 3.53 [06:47:39] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.33, 9.36, 10.02 [06:49:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [06:50:08] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.66, 3.80, 3.61 [07:02:27] [02miraheze/ssl] 07Reception123 pushed 031 commit to 03master [+1/-0/±1] 13https://github.com/miraheze/ssl/compare/d0f0ab3257f6...cc4d0c0e76fb [07:02:27] [url] Comparing d0f0ab3257f6...cc4d0c0e76fb · miraheze/ssl · GitHub | github.com [07:02:28] [02miraheze/ssl] 07Reception123 03cc4d0c0 - add aresrocket.ml cert [07:05:42] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.75, 3.92, 3.89 [07:07:39] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.98, 10.80, 9.81 [07:09:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [07:09:36] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.53, 4.56, 4.15 [07:09:39] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.61, 10.23, 9.72 [07:11:33] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 1.87, 3.65, 3.87 [07:11:39] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.25, 9.05, 9.34 [07:17:33] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.78, 2.55, 3.29 [07:19:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [07:21:33] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.68, 3.27, 3.42 [07:25:33] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.20, 3.05, 3.34 [07:27:39] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.56, 9.89, 8.88 [07:31:18] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 7.93, 10.25, 9.35 [07:33:16] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.29, 9.30, 9.11 [07:33:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [07:38:29] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.44, 3.48, 3.35 [07:42:17] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.57, 3.28, 3.31 [07:43:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [07:50:26] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.88, 6.73, 5.99 [07:52:23] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 6.34, 6.79, 6.12 [07:53:17] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.84, 9.97, 9.11 [07:55:13] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 9.62, 9.68, 9.09 [07:57:48] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.50, 9.71, 9.19 [07:59:46] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.69, 9.45, 9.16 [08:03:54] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.62, 10.21, 9.56 [08:05:38] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.23, 10.24, 9.53 [08:05:49] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.94, 9.20, 9.26 [08:07:36] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.50, 9.73, 9.42 [08:08:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [08:08:54] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.90, 6.79, 6.34 [08:12:47] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.65, 6.60, 6.40 [08:18:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [08:23:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [08:28:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [08:30:50] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.62, 9.88, 9.18 [08:33:08] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.77, 10.53, 9.97 [08:34:40] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.97, 9.53, 9.24 [08:35:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [08:35:06] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.04, 11.11, 10.22 [08:37:04] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.24, 10.58, 10.15 [08:39:02] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.89, 9.59, 9.84 [08:40:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [08:44:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.21, 2.89, 2.40 [08:46:18] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.91, 3.23, 2.59 [08:48:13] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.97, 2.89, 2.52 [08:52:48] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.91, 6.70, 6.16 [08:53:48] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.79, 3.39, 2.74 [08:54:15] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.25, 3.47, 2.07 [08:54:43] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 86, in check_records cname = str(dns_resolver.resolve(hostname, 'CNAME')[0]) File "/usr/li [08:54:43] 3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query dnd.bellinrattin.it. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [08:55:46] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.37, 2.92, 2.64 [08:58:37] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 6.14, 6.71, 6.36 [09:00:15] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.34, 1.48, 1.64 [09:00:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [09:02:31] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.68, 7.00, 6.56 [09:04:28] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.50, 6.51, 6.43 [09:05:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [09:24:13] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - dnd.bellinrattin.it All nameservers failed to answer the query. [09:24:46] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.40, 1.56, 1.22 [09:28:39] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.60, 1.81, 1.41 [09:30:36] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.53, 1.38, 1.31 [09:45:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [09:53:19] PROBLEM - cp31 Stunnel HTTP for test101 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:53:43] PROBLEM - cp30 Stunnel HTTP for test101 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:53:44] PROBLEM - cp20 Stunnel HTTP for test101 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:53:44] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 73, in check_records nameserversans = dns_resolver.resolve(root_domain, 'NS') File "/usr/l [09:53:44] n3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query bellinrattin.it. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [09:54:44] PROBLEM - test101 MediaWiki Rendering on test101 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:58:42] RECOVERY - test101 MediaWiki Rendering on test101 is OK: HTTP OK: HTTP/1.1 200 OK - 52093 bytes in 0.819 second response time [09:59:23] RECOVERY - cp31 Stunnel HTTP for test101 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14642 bytes in 0.317 second response time [09:59:59] RECOVERY - cp20 Stunnel HTTP for test101 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14642 bytes in 0.025 second response time [10:00:03] RECOVERY - cp30 Stunnel HTTP for test101 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14642 bytes in 0.336 second response time [10:00:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [10:09:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [10:14:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [10:21:33] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [10:23:15] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp21.miraheze.org - CNAME OK [10:25:40] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.74, 10.21, 9.71 [10:27:38] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.09, 10.55, 9.88 [10:29:18] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.96, 3.59, 3.08 [10:29:36] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.13, 9.50, 9.57 [10:31:14] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.66, 3.15, 2.98 [10:38:16] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.54, 1.52, 1.99 [10:42:16] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.28, 1.70, 1.94 [10:50:10] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.44, 10.01, 9.85 [10:52:23] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 4.00, 3.34, 2.79 [10:54:22] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.91, 3.20, 2.81 [10:56:04] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.18, 10.84, 10.21 [10:56:24] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.60, 4.09, 3.40 [10:58:02] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.92, 10.26, 10.08 [10:58:17] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 8.25, 5.21, 3.64 [10:59:19] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.49, 4.30, 3.16 [11:00:00] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.84, 10.14, 10.06 [11:04:16] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.73, 1.92, 1.99 [11:05:00] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.94, 3.79, 3.32 [11:05:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 14.17, 11.81, 10.70 [11:07:00] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.33, 3.99, 3.45 [11:11:16] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 1.05, 2.06, 1.49 [11:11:46] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.80, 11.97, 11.17 [11:12:16] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.99, 3.94, 3.85 [11:13:13] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.75, 1.91, 1.49 [11:14:16] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.36, 4.27, 4.00 [11:15:00] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.01, 3.86, 3.70 [11:15:09] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 1.44, 1.70, 1.46 [11:15:42] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.71, 12.18, 11.42 [11:16:17] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.09, 3.75, 3.83 [11:16:17] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.60, 1.82, 1.41 [11:17:00] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 3.74, 4.06, 3.81 [11:17:40]