[00:01:38] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 11.04, 8.96, 7.63 [00:01:41] RECOVERY - matomo101 Disk Space on matomo101 is OK: DISK OK - free space: / 2015 MB (21% inode=80%); [00:02:20] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.74, 1.77, 1.76 [00:03:33] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.34, 8.41, 7.60 [00:03:36] PROBLEM - mw101 Puppet on mw101 is CRITICAL: CRITICAL: Puppet has 430 failures. Last run 2 minutes ago with 430 failures. Failed resources (up to 3 shown): File[icclopedia.org],File[icclopedia.org_private],File[fr.gyaanipedia.com],File[fr.gyaanipedia.com_private] [00:04:03] [02miraheze/ssl] 07MacFan4000 pushed 031 commit to 03MacFan4000-patch-1 [+0/-1/±0] 13https://github.com/miraheze/ssl/commit/de845b5d43e3 [00:04:05] [02miraheze/ssl] 07MacFan4000 03de845b5 - Delete diamowiki.ga.crt [00:04:06] [02ssl] 07MacFan4000 created branch 03MacFan4000-patch-1 - 13https://github.com/miraheze/ssl [00:04:20] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.60, 1.35, 1.60 [00:04:38] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [00:05:36] [02ssl] 07MacFan4000 opened pull request 03#489: Remove diamowiki.ga and wiki.kotiolut.info - 13https://github.com/miraheze/ssl/pull/489 [00:06:13] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.87, 4.23, 3.22 [00:08:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.19, 3.69, 3.14 [00:09:33] RECOVERY - mw101 Puppet on mw101 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:10:11] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.73, 8.48, 7.76 [00:10:11] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.64, 3.36, 3.08 [00:14:05] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 5.25, 7.92, 7.78 [00:14:07] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.20, 8.51, 8.07 [00:15:12] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.09, 8.17, 7.37 [00:16:02] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.74, 8.19, 8.00 [00:17:10] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 6.74, 7.56, 7.25 [00:19:55] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.01, 9.18, 8.22 [00:21:48] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.12, 9.49, 8.60 [00:23:47] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.86, 9.77, 8.69 [00:25:38] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.61, 9.30, 8.65 [00:25:43] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.29, 10.37, 9.01 [00:29:35] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 7.45, 9.59, 9.06 [00:31:24] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.19, 9.92, 9.16 [00:31:31] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.24, 10.05, 9.28 [00:33:19] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.85, 10.57, 9.45 [00:35:26] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 7.73, 8.97, 9.03 [00:39:04] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.63, 9.87, 9.63 [00:39:38] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [00:41:01] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 11.08, 10.16, 9.75 [00:41:26] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.11, 7.58, 8.37 [00:43:01] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 5.44, 8.53, 9.20 [00:43:38] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [00:45:52] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.57, 3.80, 3.15 [00:47:51] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.91, 3.88, 3.27 [00:48:00] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.59, 3.41, 2.82 [00:48:20] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.32, 8.82, 8.61 [00:49:01] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.10, 8.99, 9.09 [00:49:50] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.66, 3.95, 3.35 [00:50:16] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.89, 9.15, 8.75 [00:51:01] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 7.23, 8.34, 8.84 [00:51:49] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.57, 3.83, 3.38 [00:54:09] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.44, 9.17, 8.81 [00:54:44] PROBLEM - diamowiki.ga - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 123, in main rdns_hostname = get_reverse_dnshostname(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 108, in get_reverse_dnshostname resolved_ip_addr = str(dns_resolver.resolve(hostn [00:54:44] AA')[0]) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 1043, in resolve timeout = self._compute_timeout(start, lifetime) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 950, in _compute_timeout raise Timeout(timeout=duration)dns.exception.Timeout: The DNS operation timed out after 5.406595468521118 seconds [00:57:20] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.34, 3.62, 3.15 [00:58:00] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.84, 3.29, 3.05 [00:58:01] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.49, 8.99, 8.84 [00:59:16] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.58, 3.90, 3.30 [01:01:01] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.49, 7.66, 8.40 [01:01:11] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.92, 3.81, 3.33 [01:02:00] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.14, 3.56, 3.24 [01:03:07] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.09, 3.19, 3.16 [01:03:38] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:03:47] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.46, 3.26, 3.39 [01:03:49] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.86, 8.13, 8.46 [01:04:00] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.90, 3.23, 3.15 [01:05:55] [02miraheze/ssl] 07MacFan4000 pushed 031 commit to 03MacFan4000-patch-1 [+0/-1/±0] 13https://github.com/miraheze/ssl/compare/de845b5d43e3...4f2e53a16b60 [01:05:56] [02miraheze/ssl] 07MacFan4000 034f2e53a - Delete wiki.kotiolut.info.crt [01:05:58] [02ssl] 07MacFan4000 synchronize pull request 03#489: Remove diamowiki.ga and wiki.kotiolut.info - 13https://github.com/miraheze/ssl/pull/489 [01:06:59] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.90, 3.63, 3.33 [01:07:41] [02miraheze/ssl] 07MacFan4000 pushed 031 commit to 03MacFan4000-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/4f2e53a16b60...ca2267e31b04 [01:07:42] [02miraheze/ssl] 07MacFan4000 03ca2267e - Update certs.yaml [01:07:44] [02ssl] 07MacFan4000 synchronize pull request 03#489: Remove diamowiki.ga and wiki.kotiolut.info - 13https://github.com/miraheze/ssl/pull/489 [01:07:47] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.21, 4.06, 3.70 [01:08:55] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.55, 3.26, 3.23 [01:09:47] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.53, 3.84, 3.66 [01:10:38] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.29, 8.94, 8.74 [01:11:35] [02ssl] 07MacFan4000 deleted branch 03MacFan4000-patch-1 - 13https://github.com/miraheze/ssl [01:11:37] [02miraheze/ssl] 07MacFan4000 pushed 031 commit to 03master [+0/-2/±1] 13https://github.com/miraheze/ssl/compare/81b3d603bbbc...0eeb810a6c43 [01:11:38] [02miraheze/ssl] 07MacFan4000 030eeb810 - Remove diamowiki.ga and wiki.kotiolut.info (#489) [01:11:40] [02ssl] 07MacFan4000 closed pull request 03#489: Remove diamowiki.ga and wiki.kotiolut.info - 13https://github.com/miraheze/ssl/pull/489 [01:11:41] [02miraheze/ssl] 07MacFan4000 deleted branch 03MacFan4000-patch-1 [01:13:47] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.15, 3.10, 3.40 [01:15:24] PROBLEM - mw121 Puppet on mw121 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[wiki.kotiolut.info_private] [01:17:38] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:18:23] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.86, 9.22, 8.94 [01:22:08] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.15, 8.50, 8.03 [01:22:15] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.36, 9.75, 9.27 [01:22:25] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.92, 1.54, 1.17 [01:22:27] PROBLEM - mw112 Puppet on mw112 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 3 minutes ago with 2 failures. Failed resources (up to 3 shown): File[diamowiki.ga_private],File[wiki.kotiolut.info_private] [01:22:28] PROBLEM - test101 Puppet on test101 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 3 minutes ago with 2 failures. Failed resources (up to 3 shown): File[diamowiki.ga_private],File[wiki.kotiolut.info_private] [01:23:00] PROBLEM - cp31 Puppet on cp31 is CRITICAL: CRITICAL: Puppet has 3 failures. Last run 3 minutes ago with 3 failures. Failed resources (up to 3 shown): File[diamowiki.ga_private],File[wiki.kotiolut.info],File[wiki.kotiolut.info_private] [01:23:18] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.98, 8.32, 8.17 [01:24:00] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.93, 3.22, 3.06 [01:24:21] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.18, 1.37, 1.15 [01:24:39] PROBLEM - diamowiki.ga - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - diamowiki.ga All nameservers failed to answer the query. [01:25:13] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.85, 8.19, 8.14 [01:26:02] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.05, 8.35, 8.09 [01:26:55] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 73, in check_records nameserversans = dns_resolver.resolve(root_domain, 'NS') File "/usr/l [01:26:55] n3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query bellinrattin.it. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [01:30:36] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.21, 2.48, 2.79 [01:32:14] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.02, 7.51, 8.34 [01:32:38] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:39:38] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:40:00] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.08, 8.16, 7.83 [01:41:54] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.17, 8.39, 7.97 [01:42:02] RECOVERY - mw121 Puppet on mw121 is OK: OK: Puppet is currently enabled, last run 36 seconds ago with 0 failures [01:49:40] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.51, 9.20, 8.52 [01:50:25] RECOVERY - cp31 Puppet on cp31 is OK: OK: Puppet is currently enabled, last run 19 seconds ago with 0 failures [01:50:29] RECOVERY - mw112 Puppet on mw112 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [01:51:05] RECOVERY - test101 Puppet on test101 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [01:51:35] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.64, 8.76, 8.43 [01:55:27] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.58, 8.30, 8.32 [01:56:11] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.43, 3.38, 2.99 [01:56:19] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp21.miraheze.org - CNAME OK [02:00:01] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.70, 3.46, 3.14 [02:01:26] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.59, 8.82, 8.51 [02:02:01] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.44, 3.78, 3.27 [02:03:26] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.48, 8.28, 8.35 [02:04:01] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.37, 3.55, 3.25 [02:04:14] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.76, 3.32, 2.96 [02:04:14] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.33, 3.40, 3.06 [02:06:01] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.89, 3.23, 3.16 [02:06:09] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.13, 2.83, 2.82 [02:06:14] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.79, 3.47, 3.12 [02:09:38] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [02:10:15] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.14, 3.02, 3.04 [02:11:49] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.12, 8.15, 7.70 [02:13:44] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.75, 7.96, 7.69 [02:18:01] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.48, 3.37, 3.17 [02:20:01] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.11, 2.95, 3.04 [02:25:02] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.38, 3.66, 3.30 [02:25:22] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.12, 2.99, 2.60 [02:25:24] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.56, 9.05, 8.30 [02:26:38] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [02:26:58] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.73, 3.62, 3.32 [02:27:17] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.71, 2.94, 2.64 [02:27:24] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.02, 8.32, 8.12 [02:28:54] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.00, 3.26, 3.22 [02:31:38] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [02:32:49] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.84, 3.50, 3.31 [02:33:07] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.26, 3.35, 2.86 [02:34:45] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.32, 3.61, 3.36 [02:35:07] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.56, 3.22, 2.86 [02:36:42] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.01, 3.06, 3.20 [02:37:07] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.62, 2.60, 2.68 [02:49:07] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.08, 2.95, 2.61 [02:51:07] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.02, 2.86, 2.62 [02:52:38] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:02:38] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:09:38] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:10:39] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.72, 3.61, 3.30 [03:12:34] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.42, 4.24, 3.58 [03:14:28] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.15, 3.74, 3.47 [03:14:38] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:16:23] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.30, 3.12, 3.26 [03:20:38] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:29:26] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.19, 8.71, 7.84 [03:30:38] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:33:26] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.00, 8.77, 8.10 [03:33:39] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:37:26] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.63, 8.31, 8.07 [03:38:39] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:46:39] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:48:37] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.76, 1.42, 1.22 [03:50:36] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.34, 1.38, 1.23 [03:51:39] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:57:55] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.53, 7.89, 7.43 [03:59:49] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.10, 7.75, 7.44 [04:05:39] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.02, 2.43, 1.52 [04:07:33] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.07, 1.92, 1.43 [04:09:30] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.71, 1.59, 1.37 [04:20:21] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.89, 1.79, 1.45 [04:22:08] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.67, 3.42, 3.14 [04:22:21] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.09, 1.50, 1.38 [04:24:04] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.78, 3.20, 3.09 [05:55:48] icinga-miraheze: has shut up for a few minutes now [06:33:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.00, 7.61, 6.67 [06:34:38] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [06:35:20] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.08, 7.04, 6.58 [06:39:38] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [06:56:14] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - dnd.bellinrattin.it All nameservers failed to answer the query. [06:57:42] [02mw-config] 07Reception123 reviewed pull request 03#4490 commit - 13https://github.com/miraheze/mw-config/pull/4490#discussion_r823399565 [06:59:35] !log [reception@mwtask111] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=torberawiki --report 1 --username-prefix=w /home/reception/Wikipedia-20220126141500.xml (START) [06:59:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:04:49] PROBLEM - mwtask111 Current Load on mwtask111 is CRITICAL: CRITICAL - load average: 2.28, 1.92, 1.53 [07:07:19] [02mw-config] 07ugochimobi synchronize pull request 03#4490: Update with missing default Kartographer params - 13https://github.com/miraheze/mw-config/pull/4490 [07:07:51] !log [reception@mwtask111] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=torberawiki --report 1 --username-prefix=w /home/reception/Wikipedia-20220126141500.xml (END - exit=0) [07:07:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:08:37] miraheze/mw-config - ugochimobi the build passed. [07:08:53] [02mw-config] 07ugochimobi reviewed pull request 03#4490 commit - 13https://github.com/miraheze/mw-config/pull/4490#discussion_r823405334 [07:14:49] PROBLEM - mwtask111 Current Load on mwtask111 is WARNING: WARNING - load average: 0.71, 1.60, 1.79 [07:16:49] RECOVERY - mwtask111 Current Load on mwtask111 is OK: OK - load average: 0.42, 1.15, 1.60 [07:24:59] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp20.miraheze.org - CNAME OK [07:39:44] Reception123: ^ [07:40:56] ugochimobi: what about RhinosF1 's comments? [07:41:47] .shrug [07:41:47] ¯\_(ツ)_/¯ [07:42:47] Not shrug [07:43:01] Your pr no merge if comments aren't resolved [07:43:22] We don't add defaults to LS.php unless they're needed for ManageWiki [07:43:48] ugochimobi: ^ [07:46:41] RhinosF1: yeah, adding to ManageWiki was my former request though [07:47:51] but Reception123 said since I am requesting a lot of configuration and I'm the only one, then it can be added to LS.php [07:48:28] and the reason why I said they aren't default is because, we didn't set those params up at all [07:49:05] like, they don't even appear on our settings at all, so I wonder how the default would be set when the params aren't even appearing at all [07:49:44] ugochimobi: but just because it's not in our config [07:49:50] Doesn't mean it's not set [07:49:58] For core, DefaultSettings.php applies [07:50:08] For extensions, it comes from extension.json [07:50:32] You can ask Reception123 if they can prove it in eval for you [07:51:22] Yeah, if it's already the default in the extension, adding it to LS as a default does absolutely nothing [07:51:35] the default is only added if you want to add a different value for your wiki (or for ManageWiki purposes) [07:51:38] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [07:52:30] Reception123: oh, what you're trying to tell me is that, those configurations are default from the extension? [07:53:19] that's what RhinosF1 says. I personally haven't checked but have no reason to doubt [07:53:37] but it would be nice if we have it on ManageWiki though, at least this Kartographer [07:56:38] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [08:02:46] I know, but unfortunately I think that too many settings in ManageWiki would make it load slower/lag for people which we obviously don't want, so if the setting doesn't have at least two people who need it I think it's best to keep it in LS for now [08:24:19] Reception123: Ohkay [08:26:14] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 86, in check_records cname = str(dns_resolver.resolve(hostname, 'CNAME')[0]) File "/usr/li [08:26:15] 3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query dnd.bellinrattin.it. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [08:27:43] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [08:37:23] [02mw-config] 07ugochimobi commented on pull request 03#4490: Update with missing default Kartographer params - 13https://github.com/miraheze/mw-config/pull/4490#issuecomment-1063801014 [08:37:24] [02mw-config] 07ugochimobi closed pull request 03#4490: Update with missing default Kartographer params - 13https://github.com/miraheze/mw-config/pull/4490 [08:37:38] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [09:16:38] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [09:21:38] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [09:24:14] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp21.miraheze.org - CNAME OK [09:55:38] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [10:00:38] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [10:17:38] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [10:22:38] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [10:25:52] PROBLEM - puppet111 Puppet on puppet111 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[postgresql-contrib-13] [10:53:51] RECOVERY - puppet111 Puppet on puppet111 is OK: OK: Puppet is currently enabled, last run 44 seconds ago with 0 failures [11:08:23] [02mw-config] 07ugochimobi opened pull request 03#4499: Adding missing Mobilefrontend configs - 13https://github.com/miraheze/mw-config/pull/4499 [11:09:26] miraheze/mw-config - ugochimobi the build passed. [11:26:14] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.21, 3.07, 2.31 [11:26:33] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 3.19, 2.07, 1.38 [11:27:41] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 73, in check_records nameserversans = dns_resolver.resolve(root_domain, 'NS') File "/usr/l [11:27:41] n3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query bellinrattin.it. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [11:28:01] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.92, 3.38, 2.56 [11:28:14] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.93, 3.12, 2.41 [11:28:32] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.59, 1.96, 1.43 [11:30:01] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.54, 3.03, 2.53 [11:30:31] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.93, 1.59, 1.36 [11:34:14] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.72, 2.65, 2.48 [11:53:54] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.11, 3.49, 3.00 [11:55:50] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.58, 3.11, 2.91 [11:56:25] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp21.miraheze.org - CNAME OK [12:05:38] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [12:09:37] [02miraheze/landing] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/landing/compare/a9f7e308acad...88b275c9e4bc [12:09:38] [02miraheze/landing] 07translatewiki 0388b275c - Localisation updates from https://translatewiki.net. [12:09:40] [02miraheze/CreateWiki] 07translatewiki pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/CreateWiki/compare/95cd75ac6026...251e4e2adb89 [12:09:41] [02miraheze/CreateWiki] 07translatewiki 03251e4e2 - Localisation updates from https://translatewiki.net. [12:09:43] [02miraheze/ManageWiki] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/c1e596ea510a...f86d703c133e [12:09:44] [02miraheze/ManageWiki] 07translatewiki 03f86d703 - Localisation updates from https://translatewiki.net. [12:09:46] [02miraheze/DataDump] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/DataDump/compare/7494ade6912c...b9d7aaa998da [12:09:47] [02miraheze/DataDump] 07translatewiki 03b9d7aaa - Localisation updates from https://translatewiki.net. [12:09:49] [02miraheze/WikiDiscover] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/WikiDiscover/compare/a7081ac15360...348f5af53244 [12:09:50] [02miraheze/WikiDiscover] 07translatewiki 03348f5af - Localisation updates from https://translatewiki.net. [12:09:52] [02miraheze/MirahezeMagic] 07translatewiki pushed 031 commit to 03master [+0/-0/±6] 13https://github.com/miraheze/MirahezeMagic/compare/17db333b4446...9a5bef26fd7f [12:09:53] [02miraheze/MirahezeMagic] 07translatewiki 039a5bef2 - Localisation updates from https://translatewiki.net. [12:10:38] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [12:12:48] miraheze/landing - translatewiki the build passed. [12:13:40] miraheze/ManageWiki - translatewiki the build has errored. [12:14:54] miraheze/MirahezeMagic - translatewiki the build has errored. [12:16:12] miraheze/CreateWiki - translatewiki the build has errored. [12:16:27] miraheze/WikiDiscover - translatewiki the build has errored. [12:20:26] miraheze/DataDump - translatewiki the build passed. [12:22:39] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [12:22:49] PROBLEM - mwtask111 Current Load on mwtask111 is WARNING: WARNING - load average: 1.94, 1.68, 1.23 [12:24:49] RECOVERY - mwtask111 Current Load on mwtask111 is OK: OK - load average: 1.48, 1.60, 1.26 [12:27:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.80, 7.91, 6.98 [12:29:20] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.92, 7.95, 7.14 [12:32:39] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [12:43:01] [02mw-config] 07ugochimobi synchronize pull request 03#4498: T8710: entityDataCachePaths configurations - 13https://github.com/miraheze/mw-config/pull/4498 [12:44:09] miraheze/mw-config - ugochimobi the build passed. [12:47:47] [02mw-config] 07ugochimobi reviewed pull request 03#4498 commit - 13https://github.com/miraheze/mw-config/pull/4498#discussion_r823682201 [12:48:49] PROBLEM - mwtask111 Current Load on mwtask111 is WARNING: WARNING - load average: 1.96, 1.75, 1.51 [12:52:50] PROBLEM - mwtask111 Current Load on mwtask111 is CRITICAL: CRITICAL - load average: 4.64, 2.64, 1.88 [13:08:49] PROBLEM - mwtask111 Current Load on mwtask111 is WARNING: WARNING - load average: 0.52, 1.31, 1.96 [13:10:31] RhinosF1: welcome back :p [13:10:53] ugochimobi: I was in an exam [13:11:24] RhinosF1: oh, how was it? [13:11:48] ugochimobi: meh [13:12:47] RhinosF1: lol, should I say "I can image"? [13:12:49] RECOVERY - mwtask111 Current Load on mwtask111 is OK: OK - load average: 0.52, 0.81, 1.59 [13:12:56] Lol, I can only imagine [13:16:38] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.80, 3.17, 2.85 [13:18:33] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.38, 2.76, 2.74 [13:21:53] ugochimobi: a level chemistry [13:26:49] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.21, 1.78, 1.34 [13:28:48] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.57, 1.60, 1.31 [13:34:01] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.97, 3.49, 3.13 [13:36:01] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.69, 3.20, 3.07 [13:39:12] RhinosF1: ah, now I can relate [13:54:44] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.74, 4.04, 3.40 [13:57:38] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [13:58:33] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.99, 3.97, 3.50 [14:00:28] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.58, 4.37, 3.67 [14:02:38] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [14:03:46] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.45, 3.85, 3.37 [14:04:17] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.09, 3.72, 3.63 [14:07:39] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.12, 3.13, 3.20 [14:10:29] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.20, 1.64, 1.21 [14:12:28] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.69, 1.25, 1.11 [14:13:39] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [14:14:01] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.17, 2.92, 3.30 [14:18:29] .pull [14:18:34] oh [14:18:39] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [14:19:26] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.36, 8.33, 7.05 [14:21:26] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.12, 7.86, 7.04 [14:25:50] RhinosF1: .pull or .pr? can it link to a PR? lol [14:32:38] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [14:34:30] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.79, 3.27, 2.84 [14:36:26] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.59, 2.93, 2.76 [14:36:50] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.82, 3.69, 3.22 [14:37:38] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [14:38:45] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.72, 3.29, 3.12 [14:43:24] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.71, 9.04, 8.17 [14:43:49] ugochimobi: phab.MirahezeBots.org [14:43:51] But ye [14:44:08] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.47, 3.13, 2.90 [14:44:28] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.80, 3.85, 3.42 [14:45:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.60, 8.59, 8.12 [14:46:03] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.04, 3.20, 2.93 [14:46:38] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [14:47:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.62, 9.07, 8.33 [14:47:58] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.39, 2.86, 2.84 [14:48:17] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.23, 3.28, 3.30 [14:49:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.77, 8.69, 8.27 [14:49:50] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.91, 8.54, 7.69 [14:50:05] PROBLEM - gp.ct777.cf - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - gp.ct777.cf All nameservers failed to answer the query. [14:51:45] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.87, 7.90, 7.56 [14:53:20] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.49, 8.19, 8.18 [14:55:31] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.87, 8.95, 8.18 [14:56:09] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.87, 1.50, 1.09 [14:57:25] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.99, 8.28, 8.04 [14:58:08] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.52, 1.48, 1.13 [14:59:45] The external account ("GitHub") you just authenticated with is not configured to allow registration on this Phabricator install. An administrator may have recently disabled it. [15:00:03] RhinosF1: Error using GitHub [15:01:09] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.09, 3.40, 3.00 [15:04:01] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.10, 3.82, 3.43 [15:05:02] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.18, 3.28, 3.10 [15:06:01] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.05, 3.48, 3.34 [15:06:38] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [15:08:01] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.95, 4.88, 3.88 [15:12:01] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.33, 3.61, 3.60 [15:13:24] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.53, 8.59, 7.86 [15:14:01] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.28, 3.78, 3.65 [15:14:46] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.80, 3.21, 3.02 [15:15:24] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.39, 8.38, 7.86 [15:16:01] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.74, 3.38, 3.52 [15:16:38] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [15:16:42] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.17, 2.85, 2.92 [15:18:40] RECOVERY - gp.ct777.cf - reverse DNS on sslhost is OK: SSL OK - gp.ct777.cf reverse DNS resolves to cp21.miraheze.org - CNAME OK [15:20:01] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.21, 3.35, 3.44 [15:21:38] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [15:22:01] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.18, 3.50, 3.50 [15:22:33] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.18, 3.48, 3.17 [15:23:03] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 2.32, 2.71, 1.59 [15:23:24] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.79, 9.13, 8.41 [15:24:01] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.29, 3.10, 3.36 [15:24:29] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.28, 3.89, 3.37 [15:25:03] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 0.71, 1.95, 1.44 [15:25:28] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.63, 9.12, 8.59 [15:25:39] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [15:26:26] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.72, 3.33, 3.22 [15:29:03] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.56, 1.45, 1.39 [15:29:24] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.46, 10.02, 9.07 [15:31:20] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.57, 7.78, 8.18 [15:31:24] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.07, 9.56, 9.01 [15:36:14] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.57, 3.38, 3.23 [15:37:24] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.46, 7.70, 8.36 [15:38:14] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.73, 3.09, 3.14 [15:40:39] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [15:42:18] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.03, 3.50, 3.28 [15:43:24] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.19, 8.85, 8.69 [15:43:38] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [15:44:01] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.96, 3.42, 3.22 [15:44:14] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.92, 3.52, 3.30 [15:46:01] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.17, 2.94, 3.07 [15:48:14] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.16, 3.32, 3.28 [15:53:24] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.29, 7.76, 8.30 [15:53:27] [02mw-config] 07ugochimobi synchronize pull request 03#4499: Adding missing Mobilefrontend configs - 13https://github.com/miraheze/mw-config/pull/4499 [15:55:08] miraheze/mw-config - ugochimobi the build passed. [15:58:01] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.57, 3.96, 3.34 [15:58:14] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.11, 3.22, 3.11 [15:59:44] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.87, 8.66, 8.23 [16:00:01] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.16, 3.59, 3.28 [16:01:40] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.56, 8.00, 8.04 [16:02:15] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.68, 2.93, 3.06 [16:03:22] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.47, 6.46, 5.07 [16:04:01] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.32, 3.30, 3.23 [16:05:22] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 4.58, 5.70, 4.96 [16:05:33] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.46, 9.63, 8.71 [16:07:28] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.50, 9.54, 8.78 [16:11:44] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.23, 9.81, 8.73 [16:13:38] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.53, 9.52, 8.75 [16:17:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.23, 9.53, 9.00 [16:17:44] [02mw-config] 07ugochimobi opened pull request 03#4500: Updating with TextExtracts params for GP - 13https://github.com/miraheze/mw-config/pull/4500 [16:18:15] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.23, 8.71, 8.10 [16:19:02] miraheze/mw-config - ugochimobi the build passed. [16:19:24] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.69, 10.10, 9.21 [16:19:41] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.75, 1.52, 1.27 [16:20:11] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.95, 8.83, 8.23 [16:21:41] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.58, 1.54, 1.30 [16:22:07] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.11, 9.23, 8.44 [16:23:01] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.38, 8.85, 7.93 [16:23:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.30, 9.98, 9.41 [16:24:02] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 7.39, 8.73, 8.37 [16:25:58] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.57, 7.98, 8.14 [16:27:01] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.88, 8.26, 7.89 [16:27:56] [02mw-config] 07ugochimobi opened pull request 03#4501: ULS settings for GP - 13https://github.com/miraheze/mw-config/pull/4501 [16:28:38] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [16:29:05] miraheze/mw-config - ugochimobi the build passed. [16:29:07] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.01, 3.22, 2.80 [16:29:39] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.00, 9.07, 8.01 [16:29:51] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.16, 8.76, 8.42 [16:30:14] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.58, 3.74, 3.29 [16:31:01] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.42, 8.76, 8.21 [16:31:07] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.89, 3.27, 2.86 [16:31:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.18, 10.75, 9.91 [16:32:14] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.11, 3.70, 3.35 [16:32:38] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [16:32:39] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.90, 8.56, 7.80 [16:33:07] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.01, 2.97, 2.79 [16:33:24] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.38, 9.47, 9.62 [16:33:32] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 7.07, 8.06, 7.85 [16:33:43] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 8.43, 8.49, 8.37 [16:34:14] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.46, 3.31, 3.25 [16:34:39] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.30, 8.04, 7.71 [16:35:01] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 5.67, 7.78, 7.98 [16:35:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.33, 9.70, 9.70 [16:37:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.24, 9.98, 9.80 [16:41:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 6.78, 8.76, 9.40 [16:45:09] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.83, 4.13, 3.44 [16:45:24] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.20, 9.75, 9.41 [16:47:05] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.48, 4.34, 3.64 [16:47:26] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.99, 1.76, 1.36 [16:48:58] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.19, 3.34, 3.28 [16:49:02] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.10, 3.93, 3.57 [16:49:26] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.84, 1.39, 1.27 [16:51:24] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.55, 9.83, 9.61 [16:52:54] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.69, 3.24, 3.36 [16:53:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.84, 10.07, 9.68 [16:53:46] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.23, 8.60, 8.25 [16:55:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.38, 9.35, 9.47 [16:55:41] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.53, 8.32, 8.20 [16:56:36] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.20, 4.24, 3.61 [16:56:49] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.19, 3.87, 3.58 [16:57:19] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.84, 1.64, 1.12 [16:57:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.56, 9.64, 9.55 [16:57:21] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.70, 3.67, 3.14 [16:59:16] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.31, 3.52, 3.15 [16:59:19] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.59, 1.24, 1.03 [16:59:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.72, 9.87, 9.66 [17:00:25] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.35, 3.94, 3.66 [17:01:11] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.59, 3.34, 3.13 [17:02:38] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.18, 3.79, 3.71 [17:03:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.44, 9.94, 9.72 [17:06:09] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.37, 3.90, 3.66 [17:06:30] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.85, 3.93, 3.75 [17:07:11] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.26, 8.59, 8.38 [17:07:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.55, 9.46, 9.60 [17:08:03] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.52, 3.38, 3.50 [17:08:27] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.96, 3.70, 3.68 [17:09:06] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.06, 8.18, 8.26 [17:09:24] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.18, 9.28, 9.26 [17:10:01] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.69, 3.87, 3.66 [17:10:23] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.60, 4.09, 3.83 [17:11:24] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.79, 9.23, 9.25 [17:11:54] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.10, 3.94, 3.45 [17:14:16] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.79, 3.66, 3.76 [17:15:44] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.26, 3.20, 3.26 [17:16:01] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.52, 3.63, 3.72 [17:17:38] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [17:19:41] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.86, 1.55, 1.32 [17:20:01] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.15, 3.50, 3.61 [17:20:38] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [17:21:03] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 2.31, 1.55, 1.11 [17:21:41] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.17, 1.38, 1.28 [17:22:01] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.69, 3.29, 3.50 [17:22:08] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.46, 9.04, 8.32 [17:22:14] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.87, 2.78, 3.32 [17:23:03] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.66, 1.22, 1.04 [17:24:01] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.28, 3.11, 3.40 [17:25:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.63, 9.30, 9.25 [17:25:24] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.22, 8.64, 8.77 [17:26:00] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.10, 8.30, 8.20 [17:27:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.29, 9.35, 9.28 [17:27:24] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.30, 8.87, 8.85 [17:28:01] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.22, 3.36, 3.44 [17:28:45] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.02, 8.62, 7.96 [17:29:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.05, 9.38, 9.29 [17:29:28] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.18, 8.41, 7.64 [17:30:01] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.09, 2.85, 3.24 [17:30:41] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.43, 8.46, 7.95 [17:31:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.69, 9.07, 9.18 [17:31:28] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.40, 8.94, 7.91 [17:32:38] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 7.33, 8.26, 7.96 [17:33:27] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 7.73, 8.56, 7.91 [17:34:29] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 11.97, 9.53, 8.50 [17:35:24] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.70, 7.82, 8.38 [17:35:27] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 6.99, 8.21, 7.88 [17:36:24] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.53, 8.43, 8.23 [17:43:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.72, 9.27, 9.04 [17:45:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.39, 9.25, 9.06 [17:50:19] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.04, 8.92, 8.35 [17:51:02] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.87, 8.58, 8.49 [17:51:22] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.96, 6.67, 5.64 [17:53:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.73, 9.27, 9.02 [17:53:22] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 6.36, 6.47, 5.68 [17:55:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.08, 8.35, 8.70 [17:56:45] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.36, 8.47, 8.50 [17:58:02] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.56, 9.17, 8.61 [17:59:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.80, 9.50, 9.07 [17:59:58] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.50, 9.06, 8.63 [18:00:12] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.87, 3.92, 3.43 [18:00:33] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.69, 8.77, 8.65 [18:01:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.79, 8.68, 8.81 [18:03:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.62, 9.33, 9.03 [18:04:01] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.36, 3.26, 3.27 [18:05:03] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 0.71, 1.74, 1.31 [18:05:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.50, 9.23, 9.05 [18:05:59] [02mw-config] 07ugochimobi opened pull request 03#4502: Wikibase: Adding missing setups in favour of GD & GP - 13https://github.com/miraheze/mw-config/pull/4502 [18:07:03] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.62, 1.42, 1.25 [18:07:12] miraheze/mw-config - ugochimobi the build passed. [18:07:41] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.99, 8.34, 8.47 [18:10:38] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [18:11:35] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.06, 8.53, 8.54 [18:11:58] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.65, 9.68, 9.06 [18:13:39] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [18:13:52] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 6.49, 8.50, 8.70 [18:17:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.68, 9.33, 9.05 [18:18:39] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [18:19:01] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.59, 8.43, 7.98 [18:19:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.24, 9.35, 9.10 [18:19:26] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.76, 10.42, 9.34 [18:19:35] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.36, 7.86, 8.36 [18:20:20] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.08, 9.09, 8.18 [18:21:39] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [18:22:16] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.19, 8.78, 8.18 [18:22:39] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.20, 3.63, 3.36 [18:23:01] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.26, 8.02, 7.90 [18:23:07] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.18, 3.48, 3.06 [18:23:26] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.14, 9.61, 9.27 [18:24:33] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.20, 3.39, 3.29 [18:25:07] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.63, 3.14, 2.99 [18:25:24] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.39, 9.11, 8.83 [18:25:26] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.11, 10.09, 9.48 [18:26:09] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 6.96, 8.16, 8.08 [18:27:26] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.42, 9.79, 9.44 [18:29:24] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.19, 9.63, 9.12 [18:31:24] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.84, 9.85, 9.28 [18:33:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.20, 8.98, 8.83 [18:33:24] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.43, 10.41, 9.57 [18:35:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.20, 8.44, 8.67 [18:35:24] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 6.76, 9.07, 9.18 [18:37:26] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.62, 7.36, 8.40 [18:39:20] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.96, 7.89, 8.41 [18:43:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.89, 9.02, 8.76 [18:45:24] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.76, 7.76, 8.40 [18:46:38] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [18:47:20] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.52, 7.92, 8.37 [18:51:06] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.99, 8.17, 7.80 [18:51:26] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.30, 8.68, 8.48 [18:52:13] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.54, 8.52, 8.57 [18:52:38] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [18:53:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.57, 9.05, 8.68 [18:53:26] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.74, 8.42, 8.41 [18:53:42] PROBLEM - mwtask111 Current Load on mwtask111 is CRITICAL: CRITICAL - load average: 2.15, 1.69, 1.43 [18:54:07] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.70, 9.29, 8.84 [18:55:01] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.71, 7.88, 7.79 [18:55:37] PROBLEM - mwtask111 Current Load on mwtask111 is WARNING: WARNING - load average: 1.68, 1.75, 1.49 [18:57:26] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.76, 8.68, 8.52 [18:57:32] RECOVERY - mwtask111 Current Load on mwtask111 is OK: OK - load average: 1.38, 1.64, 1.48 [18:59:26] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.60, 8.31, 8.41 [18:59:39] PROBLEM - matomo101 Disk Space on matomo101 is WARNING: DISK WARNING - free space: / 1036 MB (10% inode=80%); [19:01:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.97, 9.58, 9.17 [19:01:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.98, 9.93, 9.46 [19:02:38] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [19:03:06] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.55, 8.88, 8.20 [19:05:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.05, 9.44, 9.17 [19:07:01] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 7.96, 8.84, 8.38 [19:07:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.65, 9.21, 9.12 [19:07:27] Reception123: how's today been for you? [19:09:01] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.21, 7.82, 8.05 [19:09:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.98, 9.81, 9.35 [19:09:39] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [19:11:04] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.67, 8.22, 8.24 [19:11:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.02, 9.38, 9.24 [19:12:19] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.93, 8.51, 8.37 [19:14:15] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.99, 8.14, 8.26 [19:14:39] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [19:15:01] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.58, 8.48, 8.20 [19:17:01] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.24, 7.96, 8.04 [19:17:38] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [19:20:13] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.78, 1.55, 1.29 [19:22:13] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.13, 1.39, 1.26 [19:29:24] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.18, 9.42, 9.08 [19:29:45] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.56, 8.67, 8.20 [19:31:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.45, 9.14, 8.83 [19:31:24] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.63, 8.82, 8.91 [19:32:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.54, 3.11, 2.82 [19:32:58] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.16, 8.57, 8.04 [19:33:24] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.98, 9.67, 9.21 [19:33:36] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 7.32, 8.68, 8.37 [19:34:09] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.50, 2.85, 2.76 [19:34:57] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.79, 8.89, 8.22 [19:35:10] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.01, 6.47, 5.73 [19:35:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.31, 9.39, 8.99 [19:35:24] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.70, 9.72, 9.29 [19:35:32] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.51, 8.37, 8.30 [19:36:57] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.68, 8.36, 8.10 [19:39:06] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 6.10, 6.22, 5.79 [19:41:24] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.63, 10.31, 9.56 [19:42:18] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.97, 8.49, 7.96 [19:42:55] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.07, 8.72, 8.31 [19:44:33] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.10, 3.65, 3.12 [19:45:26] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.09, 8.87, 8.47 [19:46:29] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.18, 3.08, 2.97 [19:47:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.45, 9.53, 9.14 [19:48:07] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 6.64, 8.01, 7.96 [19:49:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.40, 9.01, 8.99 [19:49:59] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.91, 1.62, 1.32 [19:50:53] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.04, 8.32, 8.30 [19:51:17] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.57, 8.80, 8.40 [19:51:26] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 7.81, 9.44, 8.95 [19:51:58] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.43, 1.55, 1.34 [19:53:12] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.22, 8.37, 8.28 [19:55:24] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.80, 9.56, 9.80 [19:57:03] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.66, 8.99, 8.54 [19:57:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.21, 9.93, 9.38 [19:57:24] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.26, 10.12, 9.97 [19:59:24] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.47, 9.84, 9.88 [19:59:57] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.42, 8.85, 8.25 [20:00:50] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.95, 9.42, 8.70 [20:01:01] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.55, 7.97, 8.25 [20:01:57] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 6.98, 8.20, 8.09 [20:02:50] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 7.83, 9.18, 8.74 [20:03:24] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.09, 10.03, 9.90 [20:04:44] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.26, 3.69, 3.35 [20:06:49] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 6.31, 7.62, 8.21 [20:07:01] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.23, 9.00, 8.68 [20:10:28] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.23, 3.84, 3.49 [20:12:22] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.01, 3.16, 3.28 [20:13:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.13, 9.36, 9.93 [20:13:26] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.35, 7.78, 8.37 [20:15:01] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.36, 8.29, 8.50 [20:15:24] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.87, 9.46, 9.82 [20:17:24] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.16, 9.98, 9.96 [20:19:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.41, 9.37, 9.61 [20:21:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.33, 9.43, 9.62 [20:23:14] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.51, 9.01, 8.72 [20:23:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.27, 10.07, 9.83 [20:23:24] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.35, 9.97, 10.00 [20:25:01] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.95, 8.77, 8.62 [20:25:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.21, 9.67, 9.71 [20:25:24] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.02, 9.99, 10.00 [20:27:05] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 5.49, 7.56, 8.22 [20:27:24] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 6.98, 8.94, 9.62 [20:28:44] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.92, 3.51, 3.26 [20:29:01] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.04, 7.71, 8.26 [20:30:39] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.04, 3.75, 3.38 [20:30:59] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.93, 8.96, 8.67 [20:31:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.76, 9.80, 9.61 [20:32:33] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.87, 3.43, 3.31 [20:32:54] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.05, 8.34, 8.48 [20:33:37] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.73, 3.11, 2.78 [20:34:28] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.79, 2.93, 3.14 [20:35:19] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.01, 1.72, 1.30 [20:35:32] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.20, 2.94, 2.75 [20:36:48] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.15, 8.59, 8.58 [20:37:19] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.54, 1.34, 1.22 [20:37:41] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.04, 8.09, 7.82 [20:39:41] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 4.92, 7.14, 7.53 [20:40:39] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.24, 7.66, 8.20 [20:41:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.62, 9.48, 9.82 [20:41:24] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.51, 8.65, 8.98 [20:41:53] RhinosF1: what is icinga? [20:42:17] ugochimobi: a monitoring tool [20:43:12] RhinosF1: it monitors our various servers? [20:43:19] or what does it monitors? [20:43:24] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.62, 8.56, 8.91 [20:44:01] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.86, 4.58, 3.73 [20:45:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.12, 9.40, 9.67 [20:45:24] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.96, 9.58, 9.22 [20:47:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.02, 8.94, 9.47 [20:47:24] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.40, 9.41, 9.22 [20:48:35] ugochimobi: our servers [20:48:41] And custom domains [20:49:05] RhinosF1: oh, I see [20:49:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.13, 9.61, 9.64 [20:49:24] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.84, 9.97, 9.45 [20:49:26] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.54, 8.80, 8.15 [20:50:01] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.51, 3.68, 3.63 [20:50:20] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.40, 9.06, 8.55 [20:51:21] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.35, 8.79, 8.21 [20:51:37] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.12, 8.80, 8.15 [20:52:01] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.82, 3.91, 3.70 [20:52:16] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.58, 9.44, 8.74 [20:54:01] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.35, 3.60, 3.61 [20:54:12] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.64, 9.39, 8.80 [20:56:01] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.34, 3.66, 3.62 [20:57:35] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 11.13, 9.94, 8.82 [20:58:01] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.54, 3.66, 3.13 [20:58:44] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.10, 8.62, 8.29 [20:59:24] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.10, 9.80, 9.77 [20:59:35] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.69, 9.73, 8.88 [20:59:57] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.18, 3.39, 3.09 [20:59:59] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.29, 9.62, 9.07 [21:00:01] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.51, 3.47, 3.59 [21:01:01] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.84, 8.49, 8.49 [21:01:35] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 11.02, 10.40, 9.24 [21:01:55] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.18, 8.96, 8.88 [21:03:24] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.33, 9.60, 9.68 [21:03:34] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 7.95, 9.37, 8.99 [21:03:51] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.13, 9.33, 9.02 [21:03:52] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.06, 3.76, 3.35 [21:05:01] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.54, 9.23, 8.82 [21:05:24] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.35, 9.62, 9.69 [21:05:47] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 7.22, 8.59, 8.79 [21:06:30] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.42, 8.21, 8.22 [21:07:24] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.98, 9.97, 9.80 [21:07:43] [02mw-config] 07ugochimobi synchronize pull request 03#4502: Wikibase: Adding missing setups in favour of GD & GP - 13https://github.com/miraheze/mw-config/pull/4502 [21:07:45] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.63, 3.22, 3.23 [21:08:52] miraheze/mw-config - ugochimobi the build passed. [21:11:40] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.11, 3.97, 3.50 [21:12:01] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.84, 4.55, 3.98 [21:13:02] RhinosF1: ^ [21:13:36] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.91, 3.68, 3.43 [21:14:01] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.66, 3.97, 3.84 [21:14:21] +1 [21:15:01] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.51, 7.97, 8.40 [21:15:17] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.84, 8.55, 8.23 [21:15:24] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.60, 9.50, 9.82 [21:15:32] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.25, 3.84, 3.52 [21:17:24] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.29, 9.59, 9.79 [21:17:26] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.10, 9.42, 9.00 [21:19:01] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.87, 8.50, 8.53 [21:19:10] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 7.73, 8.27, 8.20 [21:19:25] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.00, 3.31, 3.43 [21:19:30] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 6.97, 7.83, 8.47 [21:20:01] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.26, 3.55, 3.64 [21:21:01] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.05, 8.21, 8.41 [21:21:24] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.21, 9.89, 9.90 [21:22:01] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.71, 3.50, 3.60 [21:23:17] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.34, 3.09, 3.33 [21:23:24] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.00, 10.25, 10.02 [21:23:29] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.07, 8.41, 8.60 [21:24:01] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.24, 2.96, 3.39 [21:25:01] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 11.29, 9.60, 8.92 [21:25:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.56, 9.59, 9.98 [21:27:01] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 7.82, 9.24, 8.90 [21:27:28] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.66, 8.09, 8.43 [21:30:01] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.02, 3.63, 3.50 [21:31:05] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.49, 3.61, 3.44 [21:31:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.79, 9.88, 9.93 [21:31:26] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.12, 9.76, 9.63 [21:32:01] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.88, 3.62, 3.50 [21:33:01] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.23, 3.16, 3.30 [21:33:24] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.21, 9.65, 9.96 [21:34:01] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 7.40, 4.61, 3.84 [21:35:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.90, 9.66, 9.86 [21:36:01] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.65, 3.80, 3.65 [21:37:26] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.01, 9.57, 9.55 [21:37:37] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.59, 6.81, 6.18 [21:38:49] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.78, 8.53, 8.37 [21:39:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.57, 10.06, 9.97 [21:39:26] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.68, 9.44, 9.49 [21:40:46] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.60, 9.29, 8.67 [21:41:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.69, 9.53, 9.76 [21:41:24] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.33, 9.98, 9.97 [21:41:34] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.46, 7.29, 6.46 [21:42:01] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.12, 2.68, 3.20 [21:42:42] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.02, 8.61, 8.49 [21:43:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.28, 9.69, 9.78 [21:43:24] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.11, 9.32, 9.73 [21:43:31] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.95, 7.26, 6.56 [21:44:38] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 7.88, 8.35, 8.41 [21:45:29] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.38, 6.60, 6.40 [21:48:01] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.55, 3.58, 3.40 [21:49:24] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.12, 9.49, 9.67 [21:49:26] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.75, 9.81, 9.28 [21:50:01] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.77, 3.68, 3.46 [21:50:30] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 7.94, 8.52, 8.50 [21:51:01] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.83, 9.52, 9.12 [21:51:24] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.68, 9.31, 9.59 [21:51:26] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.81, 9.85, 9.37 [21:52:01] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.05, 3.10, 3.28 [21:52:27] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.16, 8.43, 8.47 [21:53:01] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.06, 9.18, 9.04 [21:55:24] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.54, 9.59, 9.60 [21:57:24] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.51, 9.83, 9.71 [22:01:19] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.91, 9.03, 8.23 [22:01:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.33, 9.01, 9.74 [22:03:19] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.82, 8.78, 8.23 [22:03:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.16, 9.66, 9.89 [22:05:01] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 11.46, 9.33, 9.01 [22:05:18] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.11, 8.31, 8.14 [22:05:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.13, 9.87, 9.96 [22:07:01] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 7.80, 8.66, 8.80 [22:07:24] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.36, 9.21, 9.25 [22:08:39] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.37, 3.73, 3.43 [22:09:24] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 6.90, 8.62, 9.05 [22:10:34] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.71, 4.94, 3.90 [22:11:24] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.12, 9.51, 9.31 [22:13:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.70, 9.68, 9.63 [22:13:24] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.86, 9.78, 9.45 [22:15:01] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.14, 7.82, 8.39 [22:15:24] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.86, 10.42, 9.74 [22:16:17] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.52, 3.81, 3.80 [22:19:26] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.66, 9.65, 9.12 [22:21:01] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.11, 9.01, 8.71 [22:21:26] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.91, 9.70, 9.20 [22:22:01] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.67, 2.95, 3.39 [22:25:01] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.29, 9.56, 9.04 [22:25:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.28, 9.56, 9.80 [22:25:24] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.69, 9.89, 9.88 [22:29:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.24, 10.53, 10.08 [22:29:24] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.32, 9.62, 9.68 [22:31:24] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.91, 9.78, 9.74 [22:35:01] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 11.36, 9.18, 8.89 [22:35:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.64, 9.68, 9.90 [22:37:01] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 7.94, 8.62, 8.73 [22:37:26] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 5.77, 7.49, 8.23 [22:39:01] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.85, 7.76, 8.38 [22:39:24] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.10, 9.34, 9.42 [22:43:01] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.42, 8.65, 8.60 [22:43:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.02, 9.19, 9.50 [22:43:24] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.48, 9.38, 9.47 [22:45:08] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.27, 9.01, 8.38 [22:45:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.45, 8.55, 9.22 [22:46:53] RhinosF1: okay [22:49:07] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.83, 8.24, 8.21 [22:51:01] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.06, 9.02, 8.72 [22:51:26] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.75, 9.10, 8.52 [22:53:01] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.12, 8.82, 8.69 [22:53:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.93, 9.12, 8.62 [22:55:50] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.84, 6.53, 5.83 [22:57:01] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.91, 8.12, 8.47 [22:57:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.26, 9.30, 9.08 [22:57:48] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 6.14, 6.27, 5.81 [22:59:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.23, 9.36, 8.86 [22:59:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.16, 8.57, 8.85 [23:00:02] !log [@test101] starting deploy of {'l10nupdate': True} to all [23:00:03] !log [@mwtask111] starting deploy of {'l10nupdate': True} to all [23:00:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:00:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:02:52] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.80, 8.58, 8.00 [23:03:03] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 7.72, 8.94, 8.84 [23:03:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.03, 9.76, 9.25 [23:03:24] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.17, 9.54, 9.33 [23:05:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.53, 9.32, 9.15 [23:07:24] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.82, 9.72, 9.47 [23:09:02] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 5.68, 7.33, 8.21 [23:09:24] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.48, 9.71, 9.48 [23:09:26] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.40, 7.98, 8.48 [23:09:50] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.18, 1.70, 1.39 [23:09:51] !log [@test101] finished deploy of {'l10nupdate': True} to all - SUCCESS in 589s [23:09:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:11:49] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.41, 1.56, 1.37 [23:12:34] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 7.66, 8.37, 8.24 [23:13:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.67, 9.63, 9.31 [23:15:24] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.60, 8.88, 9.29 [23:15:26] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.67, 9.00, 8.79 [23:17:24] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.66, 9.39, 9.41 [23:17:38] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [23:19:07] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.45, 3.43, 2.96 [23:19:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.56, 9.88, 9.58 [23:19:45] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.42, 1.86, 1.54 [23:20:12] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.75, 3.56, 3.26 [23:21:07] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.41, 3.26, 2.97 [23:21:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.42, 8.71, 8.40 [23:21:44] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.36, 1.67, 1.51 [23:22:06] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.73, 3.11, 3.12 [23:22:58] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.91, 8.85, 8.36 [23:23:26] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.08, 10.26, 9.44 [23:23:35] PROBLEM - mwtask111 Current Load on mwtask111 is WARNING: WARNING - load average: 1.85, 1.76, 1.25 [23:25:24] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.33, 9.56, 9.70 [23:25:26] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.90, 9.90, 9.39 [23:25:30] RECOVERY - mwtask111 Current Load on mwtask111 is OK: OK - load average: 1.03, 1.51, 1.22 [23:26:52] !log [@mwtask111] finished deploy of {'l10nupdate': True} to all - SUCCESS in 1609s [23:26:57] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.01, 8.19, 8.25 [23:27:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:27:06] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 7.75, 8.52, 8.35 [23:27:11] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 6.96, 8.22, 8.36 [23:29:01] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.35, 9.32, 8.67 [23:29:26] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.57, 9.59, 9.33 [23:30:56] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.32, 9.35, 8.71 [23:31:01] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.71, 8.96, 8.62 [23:32:55] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 6.24, 8.32, 8.42 [23:33:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.78, 9.62, 9.47 [23:33:26] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.42, 9.75, 9.47 [23:33:59] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.20, 4.05, 3.31 [23:35:05] PROBLEM - cp30 Stunnel HTTP for mw111 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:35:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 6.92, 8.70, 9.16 [23:35:47] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 3.97, 4.47, 3.67 [23:36:01] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.09, 3.64, 3.34 [23:37:00] RECOVERY - cp30 Stunnel HTTP for mw111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 0.315 second response time [23:37:01] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.52, 8.28, 8.40 [23:37:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.80, 10.03, 9.57 [23:37:43] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.26, 3.66, 3.46 [23:37:49] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.12, 3.48, 3.30 [23:38:01] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.41, 3.15, 3.19 [23:39:24] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.66, 9.54, 9.59 [23:39:39] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.75, 3.37, 3.38 [23:39:44] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.09, 3.40, 3.29 [23:41:26] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.85, 9.29, 9.12 [23:43:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.07, 9.98, 9.73 [23:43:26] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.45, 9.39, 9.19 [23:45:30] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.70, 3.47, 3.38 [23:47:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.96, 10.40, 9.93 [23:47:27] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.31, 2.95, 3.19 [23:47:51] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.38, 8.89, 8.46 [23:49:26] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.90, 9.98, 9.38 [23:50:44] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.40, 8.96, 8.60 [23:51:26] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.09, 9.65, 9.34 [23:51:50] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.33, 8.26, 8.31 [23:53:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.97, 9.87, 9.92 [23:55:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 9.44, 10.11, 10.02 [23:55:26] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.14, 9.73, 9.44 [23:57:26] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.42, 9.87, 9.54 [23:58:25] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.51, 8.96, 8.45 [23:59:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.43, 9.93, 10.00 [23:59:24] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.65, 9.54, 9.93 [23:59:26] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.65, 10.14, 9.68 [23:59:48] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.50, 9.14, 8.58