[00:02:23] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.39, 1.43, 1.99 [00:04:51] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.31, 8.62, 7.57 [00:05:19] PROBLEM - you.r-fit.cc - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 123, in main rdns_hostname = get_reverse_dnshostname(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 108, in get_reverse_dnshostname resolved_ip_addr = str(dns_resolver.resolve(hostn [00:05:20] AA')[0]) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 1043, in resolve timeout = self._compute_timeout(start, lifetime) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 950, in _compute_timeout raise Timeout(timeout=duration)dns.exception.Timeout: The DNS operation timed out after 5.4016029834747314 seconds [00:06:21] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.35, 4.25, 3.43 [00:06:23] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.38, 0.85, 1.62 [00:06:30] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.41, 3.34, 2.79 [00:06:47] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.93, 7.98, 7.45 [00:07:57] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.05, 4.52, 3.47 [00:08:25] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.21, 3.73, 3.00 [00:08:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [00:11:51] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.64, 3.64, 3.35 [00:12:16] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.77, 3.81, 3.19 [00:13:48] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.19, 3.63, 3.37 [00:15:46] PROBLEM - mwtask111 Current Load on mwtask111 is WARNING: WARNING - load average: 1.79, 1.68, 1.26 [00:17:05] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.12, 9.01, 8.27 [00:17:42] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.15, 3.52, 3.39 [00:17:46] RECOVERY - mwtask111 Current Load on mwtask111 is OK: OK - load average: 1.52, 1.60, 1.28 [00:19:39] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.71, 3.14, 3.25 [00:20:56] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 6.82, 8.08, 8.09 [00:21:13] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.27, 8.75, 7.96 [00:21:53] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.56, 3.79, 3.39 [00:21:54] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.94, 9.36, 8.37 [00:23:07] RECOVERY - with.cpt-ra.bid - reverse DNS on sslhost is OK: SSL OK - with.cpt-ra.bid reverse DNS resolves to cp21.miraheze.org - CNAME OK [00:23:10] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.86, 8.29, 7.89 [00:23:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [00:23:49] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.49, 3.21, 3.22 [00:25:46] PROBLEM - mwtask111 Current Load on mwtask111 is WARNING: WARNING - load average: 1.50, 1.71, 1.45 [00:25:50] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.24, 9.62, 8.69 [00:27:46] RECOVERY - mwtask111 Current Load on mwtask111 is OK: OK - load average: 1.04, 1.47, 1.40 [00:27:49] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.14, 9.13, 8.63 [00:28:13] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.28, 9.39, 8.33 [00:30:10] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.51, 9.48, 8.50 [00:30:21] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 1.88, 3.40, 3.98 [00:31:46] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.28, 8.35, 8.43 [00:32:06] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.73, 8.35, 8.19 [00:33:53] RECOVERY - you.r-fit.cc - reverse DNS on sslhost is OK: SSL OK - you.r-fit.cc reverse DNS resolves to cp20.miraheze.org - CNAME OK [00:35:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [00:40:21] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.83, 3.79, 3.78 [00:42:00] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.54, 3.65, 3.28 [00:43:57] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.83, 3.41, 3.24 [00:44:21] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.89, 3.99, 3.88 [00:45:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [00:45:54] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.80, 4.34, 3.60 [00:47:50] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.82, 3.65, 3.43 [00:48:06] PROBLEM - franchise.franchising.org.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - franchise.franchising.org.ua All nameservers failed to answer the query. [00:49:47] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.18, 3.21, 3.30 [00:51:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [00:53:46] PROBLEM - mwtask111 Current Load on mwtask111 is CRITICAL: CRITICAL - load average: 2.59, 1.74, 1.45 [00:54:30] PROBLEM - db111 Current Load on db111 is WARNING: WARNING - load average: 6.82, 6.34, 4.91 [00:55:24] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.16, 9.50, 8.49 [00:55:46] RECOVERY - mwtask111 Current Load on mwtask111 is OK: OK - load average: 1.44, 1.60, 1.44 [00:58:18] RECOVERY - db111 Current Load on db111 is OK: OK - load average: 6.17, 6.46, 5.29 [00:58:21] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.47, 3.60, 3.53 [00:59:20] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.77, 9.95, 8.93 [01:00:21] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.39, 3.12, 3.36 [01:01:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:02:17] [02miraheze/mw-config] 07MacFan4000 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/01c6146f0c0e...91b79396e383 [01:02:19] [02miraheze/mw-config] 07MacFan4000 0391b7939 - fix user rights syntax (betawiki) from previous pr [01:03:29] miraheze/mw-config - MacFan4000 the build passed. [01:04:21] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.73, 3.61, 3.51 [01:04:39] !log [macfan@test101] starting deploy of {'config': True} to skip [01:04:40] !log [macfan@test101] finished deploy of {'config': True} to skip - SUCCESS in 0s [01:04:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:04:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:06:21] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.58, 3.27, 3.40 [01:07:14] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.59, 8.13, 8.41 [01:10:21] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.68, 3.32, 3.42 [01:11:09] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.08, 8.71, 8.58 [01:12:21] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 8.40, 4.91, 3.97 [01:14:33] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.44, 3.87, 3.21 [01:16:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:17:39] RECOVERY - franchise.franchising.org.ua - reverse DNS on sslhost is OK: SSL OK - franchise.franchising.org.ua reverse DNS resolves to cp21.miraheze.org - CNAME OK [01:18:08] !log [@test101] starting deploy of {'config': True} to all [01:18:09] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 0s [01:18:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:18:33] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.97, 3.77, 3.32 [01:18:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:19:03] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.32, 9.58, 9.00 [01:21:01] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.47, 9.39, 9.00 [01:21:40] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.51, 8.28, 7.65 [01:21:52] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.06, 8.87, 7.77 [01:22:21] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.91, 3.84, 3.86 [01:22:33] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.82, 3.26, 3.23 [01:23:22] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.61, 9.17, 8.17 [01:23:24] PROBLEM - diamowiki.ga - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 123, in main rdns_hostname = get_reverse_dnshostname(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 108, in get_reverse_dnshostname resolved_ip_addr = str(dns_resolver.resolve(hostn [01:23:24] AA')[0]) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 1043, in resolve timeout = self._compute_timeout(start, lifetime) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 950, in _compute_timeout raise Timeout(timeout=duration)dns.exception.Timeout: The DNS operation timed out after 5.412624359130859 seconds [01:23:28] !log [@mwtask111] starting deploy of {'config': True} to all [01:23:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:23:38] !log [@mwtask111] finished deploy of {'config': True} to all - SUCCESS in 9s [01:23:38] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 4.76, 7.05, 7.28 [01:23:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:23:49] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.56, 8.84, 7.90 [01:25:18] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.73, 8.71, 8.10 [01:25:46] PROBLEM - mwtask111 Current Load on mwtask111 is CRITICAL: CRITICAL - load average: 2.05, 1.81, 1.52 [01:26:33] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.11, 3.85, 3.48 [01:26:57] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.28, 9.30, 9.06 [01:27:15] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.28, 8.50, 8.09 [01:27:44] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.11, 8.40, 7.92 [01:28:33] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.77, 3.60, 3.44 [01:28:55] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.10, 8.97, 8.98 [01:31:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:31:46] PROBLEM - mwtask111 Current Load on mwtask111 is WARNING: WARNING - load average: 1.51, 1.76, 1.60 [01:33:46] RECOVERY - mwtask111 Current Load on mwtask111 is OK: OK - load average: 1.25, 1.58, 1.55 [01:34:33] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.87, 3.37, 3.39 [01:34:50] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.36, 7.70, 8.44 [01:36:21] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.22, 3.83, 3.68 [01:36:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:38:21] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.07, 3.39, 3.53 [01:40:21] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.71, 3.08, 3.39 [01:40:43] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.30, 1.72, 1.29 [01:42:42] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.85, 1.41, 1.23 [01:43:56] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.10, 9.01, 7.95 [01:45:56] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.59, 8.90, 8.04 [01:48:59] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 0.88, 2.14, 1.70 [01:49:56] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 6.65, 8.23, 8.03 [01:50:56] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.84, 1.73, 1.61 [01:52:53] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.77, 1.45, 1.52 [01:53:23] PROBLEM - diamowiki.ga - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - diamowiki.ga All nameservers failed to answer the query. [01:54:37] PROBLEM - mwtask111 Current Load on mwtask111 is CRITICAL: CRITICAL - load average: 2.61, 2.05, 1.69 [01:56:35] PROBLEM - mwtask111 Current Load on mwtask111 is WARNING: WARNING - load average: 1.80, 1.94, 1.70 [01:56:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:57:02] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.27, 3.80, 3.26 [01:57:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.34, 3.49, 3.24 [01:58:59] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.53, 3.34, 3.16 [01:59:09] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.14, 3.37, 3.23 [02:00:30] RECOVERY - mwtask111 Current Load on mwtask111 is OK: OK - load average: 1.14, 1.59, 1.62 [02:05:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [02:08:22] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.63, 8.44, 8.24 [02:08:51] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.00, 4.22, 3.63 [02:09:24] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.87, 1.84, 1.51 [02:10:22] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 8.36, 8.45, 8.27 [02:10:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [02:10:43] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.34, 3.47, 3.20 [02:11:10] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.55, 3.67, 3.27 [02:11:22] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.99, 1.55, 1.44 [02:12:39] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.10, 3.23, 3.14 [02:13:05] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.61, 3.23, 3.15 [02:15:09] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.38, 8.83, 7.90 [02:16:40] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.76, 8.43, 8.18 [02:17:09] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 5.84, 7.70, 7.59 [02:18:23] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.56, 8.32, 8.19 [02:18:39] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 7.59, 8.12, 8.10 [02:18:40] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.14, 3.86, 3.84 [02:19:02] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.67, 3.50, 3.28 [02:20:36] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.40, 4.02, 3.89 [02:21:02] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.23, 3.92, 3.47 [02:22:10] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.07, 2.54, 1.90 [02:22:23] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.28, 7.83, 8.08 [02:22:24] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.15, 3.68, 3.37 [02:23:24] PROBLEM - diamowiki.ga - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 123, in main rdns_hostname = get_reverse_dnshostname(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 108, in get_reverse_dnshostname resolved_ip_addr = str(dns_resolver.resolve(hostn [02:23:24] AA')[0]) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 1043, in resolve timeout = self._compute_timeout(start, lifetime) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 950, in _compute_timeout raise Timeout(timeout=duration)dns.exception.Timeout: The DNS operation timed out after 5.406635999679565 seconds [02:26:04] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.41, 1.52, 1.63 [02:26:23] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.02, 8.43, 8.26 [02:28:23] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.39, 9.42, 8.63 [02:28:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [02:30:01] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.36, 1.75, 1.72 [02:30:21] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.25, 3.79, 3.60 [02:30:23] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.35, 9.17, 8.66 [02:31:02] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.48, 3.87, 3.82 [02:31:58] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.97, 1.49, 1.63 [02:32:23] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.48, 8.29, 8.40 [02:32:33] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.18, 3.57, 3.88 [02:33:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [02:34:21] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.30, 3.07, 3.34 [02:36:33] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.41, 4.02, 3.98 [02:37:07] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 6.18, 3.83, 2.16 [02:38:33] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.79, 3.62, 3.85 [02:39:48] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.03, 1.74, 1.71 [02:40:21] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 3.98, 4.02, 3.69 [02:41:45] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.39, 1.29, 1.55 [02:43:04] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 0.71, 1.71, 1.73 [02:45:03] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.02, 1.61, 1.67 [02:45:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [02:46:33] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.59, 3.59, 3.66 [02:47:02] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.42, 3.96, 3.68 [02:48:33] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.57, 3.77, 3.73 [02:49:02] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.58, 3.74, 3.63 [02:50:23] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.07, 8.61, 8.30 [02:50:33] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.07, 4.38, 3.96 [02:50:59] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.72, 1.92, 1.81 [02:51:56] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.79, 8.64, 7.99 [02:52:33] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.14, 3.78, 3.78 [02:53:56] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 5.67, 7.70, 7.74 [02:54:57] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.31, 1.58, 1.69 [02:55:46] PROBLEM - mwtask111 Current Load on mwtask111 is WARNING: WARNING - load average: 1.99, 1.86, 1.57 [02:56:22] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.04, 8.28, 8.35 [02:57:02] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.25, 2.84, 3.28 [02:57:46] RECOVERY - mwtask111 Current Load on mwtask111 is OK: OK - load average: 1.45, 1.68, 1.54 [02:58:33] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.49, 2.84, 3.35 [03:00:23] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.55, 9.05, 8.69 [03:00:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:02:23] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.08, 8.41, 8.50 [03:03:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:06:23] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 7.19, 8.39, 8.51 [03:06:39] [02CreateWiki] 07lens0021 synchronize pull request 03#283: Convert to PSR-4 and use AutoloadNamespaces - 13https://github.com/miraheze/CreateWiki/pull/283 [03:08:22] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 5.50, 7.56, 8.21 [03:09:33] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.54, 8.14, 7.69 [03:11:29] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.60, 8.10, 7.74 [03:11:46] PROBLEM - mwtask111 Current Load on mwtask111 is WARNING: WARNING - load average: 1.92, 1.61, 1.49 [03:12:08] miraheze/CreateWiki - lens0021 the build passed. [03:12:21] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.10, 3.08, 3.83 [03:13:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:13:46] RECOVERY - mwtask111 Current Load on mwtask111 is OK: OK - load average: 0.84, 1.41, 1.43 [03:14:21] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.54, 3.54, 3.90 [03:16:21] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.31, 3.44, 3.81 [03:18:21] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.15, 3.72, 3.87 [03:20:21] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.14, 3.43, 3.74 [03:23:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:28:21] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.73, 2.80, 3.29 [03:32:23] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.71, 8.77, 8.18 [03:33:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:34:23] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.41, 8.33, 8.11 [03:39:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:41:28] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.70, 7.64, 7.05 [03:42:12] [02CreateWiki] 07lens0021 commented on pull request 03#283: Convert to PSR-4 and use AutoloadNamespaces - 13https://github.com/miraheze/CreateWiki/pull/283#issuecomment-1051551938 [03:42:23] [02CreateWiki] 07lens0021 synchronize pull request 03#283: Convert to PSR-4 and use AutoloadNamespaces - 13https://github.com/miraheze/CreateWiki/pull/283 [03:42:56] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.37, 8.91, 8.16 [03:43:28] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.47, 7.16, 6.95 [03:43:36] [02CreateWiki] 07lens0021 edited a comment on pull request 03#283: Convert to PSR-4 and use AutoloadNamespaces - 13https://github.com/miraheze/CreateWiki/pull/283#issuecomment-1051551938 [03:45:45] miraheze/CreateWiki - lens0021 the build has errored. [03:47:01] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.41, 3.22, 3.13 [03:48:43] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 7.40, 8.20, 8.11 [03:48:46] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.66, 8.51, 7.98 [03:48:58] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.12, 2.75, 2.96 [03:49:16] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.64, 9.61, 8.67 [03:49:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:52:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:52:41] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.49, 8.17, 7.98 [03:53:13] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.25, 9.70, 8.95 [03:55:15] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.49, 8.37, 7.60 [03:57:10] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.97, 9.34, 8.90 [03:57:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:59:08] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.85, 7.91, 7.59 [03:59:08] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.49, 9.47, 9.01 [04:03:05] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.00, 7.82, 8.42 [04:13:38] [02CreateWiki] 07Universal-Omega commented on pull request 03#283: Convert to PSR-4 and use AutoloadNamespaces - 13https://github.com/miraheze/CreateWiki/pull/283#issuecomment-1051561531 [04:15:31] [02miraheze/RemovePII] 07Universal-Omega pushed 031 commit to 03revert-47-Universal-Omega-patch-1 [+5/-5/±2] 13https://github.com/miraheze/RemovePII/commit/93a75cefce2c [04:15:33] [02miraheze/RemovePII] 07Universal-Omega 0393a75ce - Revert "Convert to PSR4 (#47)" [04:15:34] [02RemovePII] 07Universal-Omega created branch 03revert-47-Universal-Omega-patch-1 - 13https://github.com/miraheze/RemovePII [04:16:22] [02RemovePII] 07Universal-Omega opened pull request 03#50: Revert "Convert to PSR4 (#47)" - 13https://github.com/miraheze/RemovePII/pull/50 [04:16:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [04:17:12] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.88, 3.74, 3.19 [04:17:31] [02miraheze/RemovePII] 07Universal-Omega pushed 031 commit to 03revert-47-Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/RemovePII/compare/93a75cefce2c...44ec1bceb974 [04:17:32] [02miraheze/RemovePII] 07Universal-Omega 0344ec1bc - Update generatePII.php [04:17:34] [02RemovePII] 07Universal-Omega synchronize pull request 03#50: Revert "Convert to PSR4 (#47)" - 13https://github.com/miraheze/RemovePII/pull/50 [04:17:56] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.45, 9.77, 8.32 [04:18:00] [02miraheze/RemovePII] 07Universal-Omega pushed 031 commit to 03revert-47-Universal-Omega-patch-1 [+1/-1/±0] 13https://github.com/miraheze/RemovePII/compare/44ec1bceb974...b0922a365061 [04:18:01] [02miraheze/RemovePII] 07Universal-Omega 03b0922a3 - Rename includes/RemovePIIAliases.php to RemovePIIAliases.php [04:18:03] [02RemovePII] 07Universal-Omega synchronize pull request 03#50: Revert "Convert to PSR4 (#47)" - 13https://github.com/miraheze/RemovePII/pull/50 [04:18:13] [02miraheze/RemovePII] 07Universal-Omega pushed 031 commit to 03revert-47-Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/RemovePII/compare/b0922a365061...ff9cd937a9e0 [04:18:14] [02miraheze/RemovePII] 07Universal-Omega 03ff9cd93 - Update extension.json [04:18:16] [02RemovePII] 07Universal-Omega synchronize pull request 03#50: Revert "Convert to PSR4 (#47)" - 13https://github.com/miraheze/RemovePII/pull/50 [04:19:56] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 7.82, 8.81, 8.13 [04:21:05] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.60, 3.34, 3.18 [04:21:56] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 7.50, 8.22, 7.99 [04:23:14] miraheze/RemovePII - Universal-Omega the build passed. [04:23:23] PROBLEM - diamowiki.ga - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - diamowiki.ga All nameservers failed to answer the query. [04:25:01] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.00, 3.45, 3.28 [04:26:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [04:26:57] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.54, 3.18, 3.20 [04:37:02] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.47, 2.91, 2.55 [04:38:39] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.60, 3.89, 3.44 [04:39:02] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.96, 2.85, 2.57 [04:40:35] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.86, 3.36, 3.30 [04:44:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [04:50:21] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.50, 4.49, 3.72 [04:50:33] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.74, 3.30, 2.82 [04:51:49] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.42, 3.14, 2.69 [04:52:33] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.92, 3.24, 2.87 [04:53:45] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.27, 2.81, 2.62 [04:54:21] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.75, 3.89, 3.66 [04:54:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [04:54:57] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.05, 8.60, 7.43 [04:56:34] [02CreateWiki] 07lens0021 synchronize pull request 03#283: Convert to PSR-4 and use AutoloadNamespaces - 13https://github.com/miraheze/CreateWiki/pull/283 [04:56:54] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.19, 8.06, 7.38 [04:58:21] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 3.85, 4.04, 3.76 [04:59:50] [02CreateWiki] 07lens0021 commented on pull request 03#283: Convert to PSR-4 and use AutoloadNamespaces - 13https://github.com/miraheze/CreateWiki/pull/283#issuecomment-1051577363 [05:00:21] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.54, 3.84, 3.72 [05:02:10] miraheze/CreateWiki - lens0021 the build passed. [05:02:13] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.53, 8.17, 7.63 [05:02:25] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 86, in check_records cname = str(dns_resolver.resolve(hostname, 'CNAME')[0]) File "/usr/li [05:02:25] 3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query dnd.bellinrattin.it. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [05:03:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:04:11] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.43, 7.39, 7.40 [05:05:19] [02CreateWiki] 07lens0021 reviewed pull request 03#283 commit - 13https://github.com/miraheze/CreateWiki/pull/283#discussion_r815269127 [05:06:21] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.93, 2.97, 3.38 [05:08:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:18:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:24:52] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.55, 8.72, 7.91 [05:26:50] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.54, 8.29, 7.85 [05:33:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:53:24] PROBLEM - diamowiki.ga - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 123, in main rdns_hostname = get_reverse_dnshostname(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 108, in get_reverse_dnshostname resolved_ip_addr = str(dns_resolver.resolve(hostn [05:53:24] AA')[0]) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 1043, in resolve timeout = self._compute_timeout(start, lifetime) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 950, in _compute_timeout raise Timeout(timeout=duration)dns.exception.Timeout: The DNS operation timed out after 5.404552459716797 seconds [05:54:55] [02CreateWiki] 07Universal-Omega reviewed pull request 03#283 commit - 13https://github.com/miraheze/CreateWiki/pull/283#discussion_r815273267 [05:59:44] [02CreateWiki] 07Universal-Omega commented on pull request 03#283: Convert to PSR-4 and use AutoloadNamespaces - 13https://github.com/miraheze/CreateWiki/pull/283#issuecomment-1051645402 [06:00:25] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp21.miraheze.org - CNAME OK [06:01:07] [02CreateWiki] 07Universal-Omega commented on pull request 03#283: Convert to PSR-4 and use AutoloadNamespaces - 13https://github.com/miraheze/CreateWiki/pull/283#issuecomment-1051647131 [06:02:22] [02RemovePII] 07Universal-Omega closed pull request 03#50: Revert "Convert to PSR4 (#47)" - 13https://github.com/miraheze/RemovePII/pull/50 [06:02:24] [02RemovePII] 07Universal-Omega deleted branch 03revert-47-Universal-Omega-patch-1 - 13https://github.com/miraheze/RemovePII [06:02:26] [02miraheze/RemovePII] 07Universal-Omega deleted branch 03revert-47-Universal-Omega-patch-1 [06:02:27] [02miraheze/RemovePII] 07Universal-Omega pushed 031 commit to 03master [+4/-4/±1] 13https://github.com/miraheze/RemovePII/compare/7aa9a4b88f07...b0292502a448 [06:02:28] [02miraheze/RemovePII] 07Universal-Omega 03b029250 - Revert "Convert to PSR4 (#47)" (#50) [06:07:08] miraheze/RemovePII - Universal-Omega the build passed. [06:18:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [06:20:23] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.58, 7.79, 7.06 [06:23:22] PROBLEM - diamowiki.ga - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - diamowiki.ga All nameservers failed to answer the query. [06:23:46] PROBLEM - mwtask111 Current Load on mwtask111 is WARNING: WARNING - load average: 1.72, 1.71, 1.24 [06:24:23] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.98, 8.17, 7.42 [06:27:46] RECOVERY - mwtask111 Current Load on mwtask111 is OK: OK - load average: 1.29, 1.64, 1.33 [06:28:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [06:30:22] [02CreateWiki] 07lens0021 reviewed pull request 03#283 commit - 13https://github.com/miraheze/CreateWiki/pull/283#discussion_r815276317 [06:31:35] [02CreateWiki] 07lens0021 synchronize pull request 03#283: Convert to PSR-4 and use AutoloadNamespaces - 13https://github.com/miraheze/CreateWiki/pull/283 [06:31:52] [02CreateWiki] 07lens0021 reviewed pull request 03#283 commit - 13https://github.com/miraheze/CreateWiki/pull/283#discussion_r815276317 [06:34:52] miraheze/CreateWiki - lens0021 the build has errored. [06:35:55] [02CreateWiki] 07lens0021 synchronize pull request 03#283: Convert to PSR-4 and use AutoloadNamespaces - 13https://github.com/miraheze/CreateWiki/pull/283 [06:39:46] PROBLEM - mwtask111 Current Load on mwtask111 is WARNING: WARNING - load average: 1.79, 1.62, 1.41 [06:39:55] [02CreateWiki] 07lens0021 commented on pull request 03#283: Convert to PSR-4 and use AutoloadNamespaces - 13https://github.com/miraheze/CreateWiki/pull/283#issuecomment-1051693713 [06:41:08] miraheze/CreateWiki - lens0021 the build passed. [06:41:46] PROBLEM - mwtask111 Current Load on mwtask111 is CRITICAL: CRITICAL - load average: 2.03, 1.78, 1.49 [06:43:46] PROBLEM - mwtask111 Current Load on mwtask111 is WARNING: WARNING - load average: 1.70, 1.73, 1.51 [06:45:46] RECOVERY - mwtask111 Current Load on mwtask111 is OK: OK - load average: 1.46, 1.62, 1.49 [06:49:42] PROBLEM - db111 Current Load on db111 is CRITICAL: CRITICAL - load average: 28.81, 11.82, 6.92 [06:53:46] PROBLEM - mwtask111 Current Load on mwtask111 is CRITICAL: CRITICAL - load average: 2.67, 1.87, 1.59 [06:53:59] !log DELETED and DROPPED tolololpediawiki (reset request) [06:54:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:57:46] PROBLEM - mwtask111 Current Load on mwtask111 is WARNING: WARNING - load average: 1.48, 1.76, 1.62 [06:59:35] !log [reception@mwtask111] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=tolololpediawiki /home/reception/idtampvan_pages_full.xml --username-prefix=wikia:tampvan --report 1 --no-updates (START) [06:59:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:59:46] RECOVERY - mwtask111 Current Load on mwtask111 is OK: OK - load average: 1.21, 1.50, 1.54 [07:03:42] PROBLEM - db111 Current Load on db111 is WARNING: WARNING - load average: 5.67, 7.66, 7.97 [07:09:46] PROBLEM - mwtask111 Current Load on mwtask111 is WARNING: WARNING - load average: 1.83, 1.75, 1.63 [07:11:42] PROBLEM - db111 Current Load on db111 is CRITICAL: CRITICAL - load average: 10.65, 7.11, 7.29 [07:11:46] RECOVERY - mwtask111 Current Load on mwtask111 is OK: OK - load average: 1.54, 1.68, 1.62 [07:16:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [07:16:46] PROBLEM - thenintendowiki.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'thenintendowiki.org' expires in 15 day(s) (Mon 14 Mar 2022 07:13:50 GMT +0000). [07:21:09] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.74, 1.95, 1.33 [07:21:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [07:23:34] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/54f0b9aecac4...2ccd8841fbdb [07:23:35] [02miraheze/ssl] 07MirahezeSSLBot 032ccd884 - Bot: Update SSL cert for thenintendowiki.org [07:25:09] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.97, 1.48, 1.29 [07:27:42] PROBLEM - db111 Current Load on db111 is WARNING: WARNING - load average: 4.06, 6.10, 7.75 [07:28:15] !log [reception@mwtask111] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=tolololpediawiki /home/reception/idtampvan_pages_full.xml --username-prefix=wikia:tampvan --report 1 --no-updates (END - exit=0) [07:28:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:29:10] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.50, 2.97, 2.46 [07:31:07] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.08, 2.57, 2.37 [07:31:42] PROBLEM - db111 Current Load on db111 is CRITICAL: CRITICAL - load average: 9.67, 6.34, 7.34 [07:40:16] PROBLEM - www.scum-wiki.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'scum-wiki.com' expires in 15 day(s) (Mon 14 Mar 2022 07:22:50 GMT +0000). [07:40:29] PROBLEM - sunrin.net - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'sunrin.net' expires in 15 day(s) (Mon 14 Mar 2022 07:28:36 GMT +0000). [07:45:35] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/2ccd8841fbdb...bec4f42417e1 [07:45:37] [02miraheze/ssl] 07MirahezeSSLBot 03bec4f42 - Bot: Update SSL cert for sunrin.net [07:47:22] PROBLEM - smashbroswiki.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'smashbroswiki.com' expires in 15 day(s) (Mon 14 Mar 2022 07:16:01 GMT +0000). [07:48:38] PROBLEM - dkwiki.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'dkwiki.org' expires in 15 day(s) (Mon 14 Mar 2022 07:24:59 GMT +0000). [07:49:42] PROBLEM - db111 Current Load on db111 is WARNING: WARNING - load average: 4.93, 5.67, 7.88 [07:51:51] [02CreateWiki] 07Universal-Omega reviewed pull request 03#283 commit - 13https://github.com/miraheze/CreateWiki/pull/283#discussion_r815282927 [07:54:41] PROBLEM - scum-wiki.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'scum-wiki.com' expires in 15 day(s) (Mon 14 Mar 2022 07:22:50 GMT +0000). [07:54:52] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/bec4f42417e1...beb0f7ada516 [07:54:53] [02miraheze/ssl] 07MirahezeSSLBot 03beb0f7a - Bot: Update SSL cert for smashbroswiki.com [07:55:42] PROBLEM - db111 Current Load on db111 is CRITICAL: CRITICAL - load average: 11.34, 7.84, 7.90 [08:01:20] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/beb0f7ada516...4187b37ec8d5 [08:01:21] [02miraheze/ssl] 07MirahezeSSLBot 034187b37 - Bot: Update SSL cert for dkwiki.org [08:01:28] [02CreateWiki] 07lens0021 synchronize pull request 03#283: Convert to PSR-4 and use AutoloadNamespaces - 13https://github.com/miraheze/CreateWiki/pull/283 [08:02:25] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 73, in check_records nameserversans = dns_resolver.resolve(root_domain, 'NS') File "/usr/l [08:02:25] n3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query bellinrattin.it. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [08:03:29] [02CreateWiki] 07lens0021 reviewed pull request 03#283 commit - 13https://github.com/miraheze/CreateWiki/pull/283#discussion_r815283834 [08:03:44] [02CreateWiki] 07lens0021 reviewed pull request 03#283 commit - 13https://github.com/miraheze/CreateWiki/pull/283#discussion_r815283834 [08:05:42] PROBLEM - db111 Current Load on db111 is WARNING: WARNING - load average: 4.29, 6.32, 7.59 [08:05:56] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/4187b37ec8d5...71670dec653c [08:05:58] [02miraheze/ssl] 07MirahezeSSLBot 0371670de - Bot: Update SSL cert for scum-wiki.com [08:07:29] miraheze/CreateWiki - lens0021 the build passed. [08:09:52] !log [reception@mwtask111] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=tolololpediawiki (START) [08:09:58] !log [reception@mwtask111] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=tolololpediawiki (END - exit=256) [08:09:58] RECOVERY - sunrin.net - LetsEncrypt on sslhost is OK: OK - Certificate 'sunrin.net' will expire on Fri 27 May 2022 06:45:30 GMT +0000. [08:10:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:10:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:11:42] RECOVERY - db111 Current Load on db111 is OK: OK - load average: 5.19, 5.32, 6.69 [08:15:42] PROBLEM - db111 Current Load on db111 is CRITICAL: CRITICAL - load average: 13.89, 8.14, 7.40 [08:16:19] RECOVERY - thenintendowiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'thenintendowiki.org' will expire on Fri 27 May 2022 06:23:28 GMT +0000. [08:23:21] PROBLEM - cloud11 Puppet on cloud11 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [08:31:19] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp21.miraheze.org - CNAME OK [08:33:42] PROBLEM - db111 Current Load on db111 is WARNING: WARNING - load average: 5.83, 6.51, 8.00 [08:38:48] RECOVERY - www.scum-wiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'scum-wiki.com' will expire on Fri 27 May 2022 07:05:51 GMT +0000. [08:43:42] PROBLEM - db111 Current Load on db111 is CRITICAL: CRITICAL - load average: 13.31, 8.86, 7.89 [08:45:23] RECOVERY - smashbroswiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'smashbroswiki.com' will expire on Fri 27 May 2022 06:54:46 GMT +0000. [08:45:42] PROBLEM - db111 Current Load on db111 is WARNING: WARNING - load average: 4.98, 7.51, 7.53 [08:46:38] RECOVERY - dkwiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'dkwiki.org' will expire on Fri 27 May 2022 07:01:14 GMT +0000. [08:49:42] PROBLEM - db111 Current Load on db111 is CRITICAL: CRITICAL - load average: 13.52, 9.87, 8.34 [08:51:21] RECOVERY - cloud11 Puppet on cloud11 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [08:52:41] RECOVERY - scum-wiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'scum-wiki.com' will expire on Fri 27 May 2022 07:05:51 GMT +0000. [08:55:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [08:58:32] PROBLEM - mw102 MediaWiki Rendering on mw102 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:00:32] RECOVERY - mw102 MediaWiki Rendering on mw102 is OK: HTTP OK: HTTP/1.1 200 OK - 22295 bytes in 0.433 second response time [09:00:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [09:03:42] PROBLEM - db111 Current Load on db111 is WARNING: WARNING - load average: 1.76, 5.39, 7.33 [09:05:42]