[00:00:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.69, 3.34, 3.08 [00:00:36] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.15, 3.36, 3.36 [00:01:21] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.86, 1.43, 1.29 [00:02:13] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.04, 3.01, 2.98 [00:03:21] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.32, 1.39, 1.29 [00:04:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [00:06:10] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.20, 4.10, 3.38 [00:06:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.39, 3.98, 3.72 [00:07:40] [02mw-config] 07AgentIsai opened pull request 03#4642: T9145: Add protection level for collegecitoyenwiki and knightnwiki - 13https://github.com/miraheze/mw-config/pull/4642 [00:08:36] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.59, 4.59, 3.79 [00:10:10] miraheze/ImportDump - Universal-Omega the build passed. [00:10:44] miraheze/mw-config - AgentIsai the build passed. [00:10:52] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.20, 1.77, 1.38 [00:11:21] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 2.00, 1.77, 1.48 [00:11:57] PROBLEM - es101 Current Load on es101 is WARNING: WARNING - load average: 3.43, 3.14, 2.21 [00:11:59] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-1/±0] 13https://github.com/miraheze/ImportDump/compare/184934edde67...537ff7a0639d [00:12:01] [02miraheze/ImportDump] 07Universal-Omega 03537ff7a - Delete ImportDumpNotificationsManager.php [00:12:03] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [00:12:15] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/537ff7a0639d...95a771f2bfc0 [00:12:16] [02miraheze/ImportDump] 07Universal-Omega 0395a771f - Update ServiceWiring.php [00:12:18] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [00:12:45] [02ImportDump] 07Universal-Omega edited pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [00:12:52] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.73, 1.50, 1.33 [00:13:21] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.26, 1.56, 1.44 [00:13:57] RECOVERY - es101 Current Load on es101 is OK: OK - load average: 2.75, 3.03, 2.28 [00:14:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [00:14:35] [02miraheze/ImportDump] 07github-actions[bot] pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/95a771f2bfc0...ca1ac73ae47a [00:14:36] [02miraheze/ImportDump] 07github-actions 03ca1ac73 - CI: lint code to MediaWiki standards [00:14:37] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.34, 3.66, 3.70 [00:14:38] [02ImportDump] 07github-actions[bot] synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [00:16:05] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.71, 3.56, 3.55 [00:16:27] miraheze/ImportDump - Universal-Omega the build has errored. [00:18:40] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.77, 10.51, 10.07 [00:20:36] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.92, 11.52, 10.49 [00:20:39] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.22, 1.84, 1.26 [00:22:33] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.12, 11.31, 10.54 [00:22:37] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.98, 3.98, 3.75 [00:22:39] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.57, 1.72, 1.29 [00:23:21] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.53, 1.78, 1.51 [00:23:58] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/ca1ac73ae47a...e69ea8ac3681 [00:23:59] [02miraheze/ImportDump] 07Universal-Omega 03e69ea8a - Update en.json [00:24:01] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [00:24:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [00:24:02] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/e69ea8ac3681...4890cc374be9 [00:24:04] [02miraheze/ImportDump] 07Universal-Omega 034890cc3 - Update qqq.json [00:24:06] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [00:24:37] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.70, 3.92, 3.76 [00:24:39] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.23, 1.56, 1.28 [00:25:21] [02ImportDump] 07Universal-Omega edited pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [00:25:21] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.22, 1.60, 1.48 [00:25:23] [02ImportDump] 07Universal-Omega edited pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [00:26:37] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.13, 4.14, 3.85 [00:28:00] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.20, 3.75, 3.59 [00:28:22] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.03, 9.84, 10.14 [00:29:59] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.83, 3.34, 3.46 [00:33:57] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.95, 2.83, 3.24 [00:34:03] miraheze/ImportDump - Universal-Omega the build passed. [00:34:36] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.02, 3.71, 3.83 [00:35:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [00:36:11] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.85, 11.41, 10.64 [00:39:32] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/4890cc374be9...80f60f508491 [00:39:33] [02miraheze/ImportDump] 07Universal-Omega 0380f60f5 - Implement notifications [00:39:36] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [00:40:36] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.15, 3.17, 3.49 [00:41:53] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.42, 2.72, 2.90 [00:42:00] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 14.21, 11.97, 11.00 [00:42:01] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.67, 2.81, 1.95 [00:42:16] [02ImportDump] 07Universal-Omega edited pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [00:42:20] [02ImportDump] 07Universal-Omega edited pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [00:42:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.46, 3.62, 3.94 [00:42:24] [02ImportDump] 07Universal-Omega edited pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [00:42:28] [02ImportDump] 07Universal-Omega edited pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [00:42:37] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.28, 2.84, 3.33 [00:43:56] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.22, 11.06, 10.77 [00:44:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.22, 4.29, 4.12 [00:45:53] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.85, 2.57, 2.82 [00:48:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.84, 3.79, 3.94 [00:49:10] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.80, 2.04, 1.65 [00:49:49] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.61, 1.88, 1.84 [00:50:58] miraheze/ImportDump - Universal-Omega the build passed. [00:53:45] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.73, 11.55, 10.99 [00:53:55] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.76, 10.78, 9.48 [00:55:00] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.79, 1.98, 1.78 [00:55:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [00:55:54] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.65, 10.73, 9.63 [00:57:38] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.63, 1.21, 1.56 [00:57:53] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 13.85, 11.84, 10.16 [00:59:45] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.96, 11.68, 11.30 [00:59:53] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.53, 10.98, 10.05 [01:00:21] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.18, 2.94, 3.35 [01:00:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:01:29] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.16, 1.66, 1.72 [01:03:53] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 8.77, 9.51, 9.65 [01:05:45] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 15.06, 12.13, 11.43 [01:06:39] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.05, 1.87, 1.83 [01:07:21] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.96, 1.46, 1.64 [01:07:45] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.68, 11.18, 11.17 [01:08:28] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/80f60f508491...75f450fe0fa2 [01:08:29] [02miraheze/ImportDump] 07Universal-Omega 0375f450f - Update extension.json [01:08:31] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [01:08:39] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.66, 1.78, 1.80 [01:11:45] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.42, 11.94, 11.47 [01:13:45] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.42, 11.19, 11.27 [01:14:44] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.88, 3.60, 3.16 [01:15:00] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.46, 3.94, 3.52 [01:16:43] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.03, 2.98, 2.98 [01:16:50] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+1/-0/±0] 13https://github.com/miraheze/ImportDump/compare/75f450fe0fa2...480b3b0be78d [01:16:51] [02miraheze/ImportDump] 07Universal-Omega 03480b3b0 - Create EchoNewRequestPresentationModel.php [01:16:53] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [01:17:23] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.86, 1.59, 1.56 [01:17:36] miraheze/ImportDump - Universal-Omega the build passed. [01:18:27] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/480b3b0be78d...e3b41e95fa28 [01:18:29] [02miraheze/ImportDump] 07Universal-Omega 03e3b41e9 - Update Main.php [01:18:31] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [01:18:39] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.52, 1.93, 1.82 [01:19:16] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/e3b41e95fa28...e5305c0a4b88 [01:19:18] [02miraheze/ImportDump] 07Universal-Omega 03e5305c0 - Update SpecialRequestImportDump.php [01:19:19] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [01:19:21] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.96, 1.38, 1.49 [01:20:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:20:51] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.43, 3.97, 3.62 [01:21:19] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 86, in check_records cname = str(dns_resolver.resolve(hostname, 'CNAME')[0]) File "/usr/li [01:21:19] 3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query dnd.bellinrattin.it. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [01:21:31] [02miraheze/ImportDump] 07github-actions[bot] pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±2] 13https://github.com/miraheze/ImportDump/compare/e5305c0a4b88...dafb9ebb5e58 [01:21:33] [02miraheze/ImportDump] 07github-actions 03dafb9eb - CI: lint code to MediaWiki standards [01:21:34] [02ImportDump] 07github-actions[bot] synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [01:22:39] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.44, 1.87, 1.84 [01:22:39] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.75, 3.53, 3.26 [01:22:49] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.92, 3.61, 3.53 [01:23:01] PROBLEM - cloud11 Puppet on cloud11 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [01:23:59] miraheze/ImportDump - Universal-Omega the build has errored. [01:24:38] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.45, 4.13, 3.53 [01:24:46] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.01, 3.95, 3.67 [01:26:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:26:37] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.75, 3.60, 3.41 [01:26:43] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.31, 3.36, 3.49 [01:27:21] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.42, 1.87, 1.72 [01:27:48] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/dafb9ebb5e58...a7d71209080c [01:27:50] [02miraheze/ImportDump] 07Universal-Omega 03a7d7120 - Update en.json [01:27:51] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [01:28:02] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/a7d71209080c...0d191982a8c1 [01:28:03] [02miraheze/ImportDump] 07Universal-Omega 030d19198 - Update qqq.json [01:28:05] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [01:28:36] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.12, 3.20, 3.29 [01:28:39] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.12, 1.40, 1.63 [01:28:40] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.59, 3.10, 3.38 [01:29:21] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.16, 1.59, 1.63 [01:29:31] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/0d191982a8c1...e2363a2b0773 [01:29:33] [02miraheze/ImportDump] 07Universal-Omega 03e2363a2 - Update extension.json [01:29:34] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [01:29:45] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.23, 10.85, 10.91 [01:31:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:32:36] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.14, 3.47, 3.30 [01:33:43] miraheze/ImportDump - Universal-Omega the build has errored. [01:33:45] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.03, 10.70, 10.86 [01:34:32] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/e2363a2b0773...24fc76ec3a4e [01:34:34] [02miraheze/ImportDump] 07Universal-Omega 0324fc76e - Update en.json [01:34:36] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [01:36:20] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/24fc76ec3a4e...12838a599e27 [01:36:21] [02miraheze/ImportDump] 07Universal-Omega 0312838a5 - Update SpecialRequestImportDump.php [01:36:23] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [01:38:37] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.22, 3.35, 3.33 [01:40:27] miraheze/ImportDump - Universal-Omega the build has errored. [01:42:01] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/12838a599e27...614d99e91ef3 [01:42:02] [02miraheze/ImportDump] 07Universal-Omega 03614d99e - Update extension.json [01:42:04] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [01:42:24] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/614d99e91ef3...11b43b7a68ed [01:42:25] [02miraheze/ImportDump] 07Universal-Omega 0311b43b7 - Update extension.json [01:42:27] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [01:44:21] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/11b43b7a68ed...3fd3bdd83428 [01:44:23] [02miraheze/ImportDump] 07Universal-Omega 033fd3bdd - Update SpecialRequestImportDump.php [01:44:24] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [01:47:32] miraheze/ImportDump - Universal-Omega the build has errored. [01:47:36] [02ImportDump] 07Universal-Omega edited pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [01:47:45] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.45, 9.22, 9.99 [01:48:32] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/3fd3bdd83428...a760228652db [01:48:33] [02miraheze/ImportDump] 07Universal-Omega 03a760228 - Update extension.json [01:48:35] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [01:48:50] [02ImportDump] 07Universal-Omega edited pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [01:48:52] [02ImportDump] 07Universal-Omega edited pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [01:48:54] [02ImportDump] 07Universal-Omega edited pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [01:48:56] [02ImportDump] 07Universal-Omega edited pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [01:48:57] [02ImportDump] 07Universal-Omega edited pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [01:50:15] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp21.miraheze.org - CNAME OK [01:51:01] RECOVERY - cloud11 Puppet on cloud11 is OK: OK: Puppet is currently enabled, last run 40 seconds ago with 0 failures [01:52:13] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.88, 1.78, 1.55 [01:52:27] miraheze/ImportDump - Universal-Omega the build has errored. [01:53:40] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/a760228652db...a0163c475ea8 [01:53:42] [02miraheze/ImportDump] 07Universal-Omega 03a0163c4 - Update SpecialRequestImportDump.php [01:53:43] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [01:54:10] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.08, 1.50, 1.48 [01:58:42] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.09, 3.76, 3.50 [02:00:39] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.01, 3.11, 3.29 [02:04:31] miraheze/ImportDump - Universal-Omega the build passed. [02:16:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.95, 4.67, 3.74 [02:18:39] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.15, 1.79, 1.58 [02:20:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.94, 3.98, 3.68 [02:20:39] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.65, 1.78, 1.61 [02:22:39] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.52, 1.70, 1.60 [02:26:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.46, 3.85, 3.66 [02:26:37] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.52, 3.72, 3.14 [02:28:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.18, 3.35, 3.51 [02:28:36] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.90, 3.34, 3.07 [02:30:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.88, 4.40, 3.85 [02:32:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.14, 3.39, 3.55 [02:36:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.04, 3.89, 3.68 [02:36:39] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.82, 1.72, 1.62 [02:37:57] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.73, 4.17, 3.41 [02:38:36] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 7.22, 5.29, 3.97 [02:38:39] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.66, 1.70, 1.63 [02:41:55] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.74, 3.73, 3.42 [02:42:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 1.99, 3.86, 3.92 [02:42:37] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 1.68, 3.87, 3.73 [02:42:39] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.82, 1.78, 1.68 [02:44:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.23, 3.85, 3.89 [02:46:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.62, 3.84, 3.89 [02:46:39] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.22, 1.94, 1.77 [02:47:53] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.11, 3.04, 3.24 [02:48:36] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.31, 2.67, 3.27 [02:52:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.08, 3.65, 3.71 [02:56:36] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.52, 3.41, 3.39 [02:56:39] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.65, 1.88, 1.88 [02:56:41] miraheze/MirahezeMagic - Universal-Omega the build passed. [02:58:36] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.09, 3.82, 3.55 [03:00:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.37, 3.97, 3.95 [03:00:36] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.39, 3.31, 3.39 [03:02:39] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.27, 1.46, 1.68 [03:06:53] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/a0163c475ea8...4a3e0e22e332 [03:06:54] [02miraheze/ImportDump] 07Universal-Omega 034a3e0e2 - Update ImportDumpRequestViewer.php [03:06:56] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [03:08:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:10:47] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.94, 3.46, 3.19 [03:12:46] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.98, 3.17, 3.11 [03:13:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:17:45] miraheze/ImportDump - Universal-Omega the build passed. [03:22:22] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.06, 2.87, 3.27 [03:24:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:25:15] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.72, 9.82, 8.82 [03:29:08] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.72, 9.66, 9.01 [03:29:32] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:31:13] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.30, 4.05, 3.60 [03:31:36] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.49, 3.50, 3.08 [03:31:37] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.71, 3.53, 3.13 [03:33:10] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.83, 3.48, 3.44 [03:33:35] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.13, 3.25, 3.03 [03:37:04] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.67, 3.79, 3.56 [03:39:00] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.49, 3.56, 3.52 [03:42:55] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.14, 3.02, 3.33 [03:43:02] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.47, 3.21, 3.22 [03:48:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:48:39] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.11, 1.62, 1.40 [03:50:39] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.77, 1.71, 1.46 [03:52:39] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.50, 1.63, 1.46 [03:53:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [04:00:25] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.83, 3.42, 3.22 [04:02:22] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.30, 3.20, 3.15 [04:18:39] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.33, 1.88, 1.62 [04:20:09] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.42, 3.25, 2.79 [04:21:00] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.99, 3.59, 3.17 [04:22:08] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.24, 3.12, 2.79 [04:22:39] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.80, 1.96, 1.73 [04:22:58] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.38, 4.12, 3.40 [04:24:39] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.50, 2.06, 1.79 [04:24:54] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.56, 3.63, 3.32 [04:28:49] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.02, 3.28, 3.24 [04:34:39] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.74, 1.94, 1.91 [04:44:39] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.35, 1.48, 1.69 [04:50:39] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.01, 1.86, 1.79 [04:52:39] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.25, 1.63, 1.71 [04:54:39] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.15, 1.49, 1.65 [05:01:58] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.91, 1.58, 1.09 [05:03:56] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.92, 1.32, 1.05 [05:19:35] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.12, 1.75, 1.53 [05:20:25] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 86, in check_records cname = str(dns_resolver.resolve(hostname, 'CNAME')[0]) File "/usr/li [05:20:25] 3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query dnd.bellinrattin.it. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [05:21:32] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.62, 1.64, 1.51 [05:24:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:29:21] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/90e34e64de1a...31f81c93b1ea [05:29:23] [02miraheze/mw-config] 07Universal-Omega 0331f81c9 - T9150: set DefaultUserOptions for mariowiki [05:29:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:30:26] miraheze/mw-config - Universal-Omega the build passed. [05:34:11] [02mw-config] 07Universal-Omega closed pull request 03#4642: T9145: Add protection level for collegecitoyenwiki and knightnwiki - 13https://github.com/miraheze/mw-config/pull/4642 [05:34:15] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/31f81c93b1ea...275938e55933 [05:34:17] [02miraheze/mw-config] 07AgentIsai 03275938e - T9145: Add protection level (#4642) [05:35:08] miraheze/mw-config - Universal-Omega the build passed. [05:35:21] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.68, 1.84, 1.38 [05:36:22] [02mw-config] 07Universal-Omega closed pull request 03#4632: GlobalCache: don't use wg for redis ip - 13https://github.com/miraheze/mw-config/pull/4632 [05:36:23] [02miraheze/mw-config] 07Universal-Omega deleted branch 03RhinosF1-patch-1 [05:36:25] [02mw-config] 07Universal-Omega deleted branch 03RhinosF1-patch-1 - 13https://github.com/miraheze/mw-config [05:36:26] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/275938e55933...2b1e09e2ab1c [05:36:28] [02miraheze/mw-config] 07RhinosF1 032b1e09e - GlobalCache: don't use wg for redis ip (#4632) [05:37:19] [02mw-config] 07Universal-Omega closed pull request 03#4639: set wgExtraLanguageNames to "qqq" for gpcommonswiki and gratisdatawiki - 13https://github.com/miraheze/mw-config/pull/4639 [05:37:21] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.68, 1.38, 1.26 [05:37:23] miraheze/mw-config - Universal-Omega the build passed. [05:37:23] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/2b1e09e2ab1c...23e02ad6171c [05:37:24] [02miraheze/mw-config] 07ugochimobi 0323e02ad - set wgExtraLanguageNames to "qqq" for gpcommonswiki and gratisdatawiki (#4639) [05:38:26] miraheze/mw-config - Universal-Omega the build passed. [05:40:00] [02mw-config] 07Universal-Omega reviewed pull request 03#4612 commit - 13https://github.com/miraheze/mw-config/pull/4612#discussion_r859402679 [05:40:04] [02mw-config] 07Universal-Omega reviewed pull request 03#4612 commit - 13https://github.com/miraheze/mw-config/pull/4612#discussion_r859402765 [05:40:30] [02mw-config] 07Universal-Omega reviewed pull request 03#4640 commit - 13https://github.com/miraheze/mw-config/pull/4640#discussion_r859403544 [05:41:23] [02mw-config] 07Universal-Omega reviewed pull request 03#4624 commit - 13https://github.com/miraheze/mw-config/pull/4624#discussion_r859404001 [05:42:17] [02mw-config] 07Universal-Omega closed pull request 03#4641: setting up entitysource for gratispaideiawiki, gpcommonswiki, gratisd… - 13https://github.com/miraheze/mw-config/pull/4641 [05:42:19] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/23e02ad6171c...bffd26fc7099 [05:42:20] [02miraheze/mw-config] 07ugochimobi 03bffd26f - setting up entitysource for gratispaideiawiki, gpcommonswiki, gratisdatawiki (#4641) [05:43:21] miraheze/mw-config - Universal-Omega the build passed. [05:49:20] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp20.miraheze.org - CNAME OK [05:50:10] !log [@test101] starting deploy of {'config': True} to all [05:50:11] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 0s [05:50:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:50:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:50:42] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.42, 2.03, 1.69 [05:52:18] !log [@mwtask111] starting deploy of {'config': True} to all [05:52:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:52:27] !log [@mwtask111] finished deploy of {'config': True} to all - SUCCESS in 9s [05:52:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:52:39] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.56, 1.82, 1.65 [05:54:39] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.36, 1.66, 1.61 [05:58:49] PROBLEM - wiki.mistleague.io - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.mistleague.io' expires in 15 day(s) (Fri 13 May 2022 05:32:23 GMT +0000). [06:02:59] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/557f8c5f25a8...0ed78a46e724 [06:03:00] [02miraheze/ssl] 07MirahezeSSLBot 030ed78a4 - Bot: Update SSL cert for wiki.mistleague.io [06:04:39] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.83, 1.69, 1.62 [06:04:54] RhinosF1, CosmicAlpha, around? [06:05:19] Yes [06:05:28] I have a request to enable Semantic MediaWiki on a wiki, but need an SRE to run the mwscript on all MW servers [06:06:12] dmehus: I just went mobile like 2 minutes ago so I'm not. [06:06:13] Cant run script for half an hour dmehus [06:06:39] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.71, 2.06, 1.76 [06:07:24] CosmicAlpha, RhinosF1, ack. It's a small wiki, okay if I enable it and ping you both with the wiki to run the script on so I can sleep? [06:08:01] It'd only be temporarily inaccessible for ~30 minutes or so [06:09:03] dmehus: can wait till tomorrow if you want though? [06:09:56] dmehus: no do not do that [06:10:48] CosmicAlpha, RhinosF1, ack, okay, I mean it's a small wiki used by probably 1 person so no impacts, but okay, will do it tomorrow [06:20:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [06:25:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [06:25:42] PROBLEM - puppet111 Puppet on puppet111 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[postgresql-contrib-13] [06:28:38] RECOVERY - wiki.mistleague.io - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.mistleague.io' will expire on Tue 26 Jul 2022 05:02:49 GMT +0000. [06:29:12] PROBLEM - tech.teojingyao.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'tech.teojingyao.com' expires in 15 day(s) (Fri 13 May 2022 06:06:20 GMT +0000). [06:36:12] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/0ed78a46e724...36a25d1e0dbd [06:36:13] [02miraheze/ssl] 07MirahezeSSLBot 0336a25d1 - Bot: Update SSL cert for tech.teojingyao.com [06:41:35] PROBLEM - wiki.chippyapps.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.chippyapps.com' expires in 15 day(s) (Fri 13 May 2022 06:10:32 GMT +0000). [06:48:12] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/36a25d1e0dbd...beddce27139f [06:48:14] [02miraheze/ssl] 07MirahezeSSLBot 03beddce2 - Bot: Update SSL cert for wiki.chippyapps.com [06:52:37] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.45, 3.14, 2.73 [06:53:41] RECOVERY - puppet111 Puppet on puppet111 is OK: OK: Puppet is currently enabled, last run 2 seconds ago with 0 failures [06:54:36] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.01, 2.80, 2.66 [06:57:54] RECOVERY - tech.teojingyao.com - LetsEncrypt on sslhost is OK: OK - Certificate 'tech.teojingyao.com' will expire on Tue 26 Jul 2022 05:36:04 GMT +0000. [07:10:39] RECOVERY - wiki.chippyapps.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.chippyapps.com' will expire on Tue 26 Jul 2022 05:48:03 GMT +0000. [07:20:14] [02mw-config] 07ugochimobi reviewed pull request 03#4612 commit - 13https://github.com/miraheze/mw-config/pull/4612#discussion_r859464942 [07:26:16] [02ImportDump] 07Universal-Omega edited pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [07:27:56] [02mw-config] 07ugochimobi reviewed pull request 03#4612 commit - 13https://github.com/miraheze/mw-config/pull/4612#discussion_r859471450 [07:29:00] [02mw-config] 07Universal-Omega reviewed pull request 03#4612 commit - 13https://github.com/miraheze/mw-config/pull/4612#discussion_r859472302 [07:29:36] [02mw-config] 07Universal-Omega reviewed pull request 03#4612 commit - 13https://github.com/miraheze/mw-config/pull/4612#discussion_r859472807 [07:30:19] [02mw-config] 07ugochimobi reviewed pull request 03#4612 commit - 13https://github.com/miraheze/mw-config/pull/4612#discussion_r859473407 [07:31:15] [02mw-config] 07ugochimobi reviewed pull request 03#4612 commit - 13https://github.com/miraheze/mw-config/pull/4612#discussion_r859474221 [07:32:01] PROBLEM - sammaditthi.cyou - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'sammaditthi.cyou' expires in 15 day(s) (Fri 13 May 2022 07:16:05 GMT +0000). [07:32:26] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/beddce27139f...7ccfb12b3a45 [07:32:27] [02miraheze/ssl] 07MirahezeSSLBot 037ccfb12 - Bot: Update SSL cert for sammaditthi.cyou [07:32:52] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.72, 3.20, 2.63 [07:34:11] PROBLEM - proficientprofit.click - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'www.proficientprofit.click' expires in 15 day(s) (Fri 13 May 2022 07:11:40 GMT +0000). [07:34:46] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.61, 3.04, 2.64 [07:38:50] PROBLEM - it.famepedia.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'it.famepedia.org' expires in 15 day(s) (Fri 13 May 2022 07:14:28 GMT +0000). [07:39:08] PROBLEM - www.proficientprofit.click - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'www.proficientprofit.click' expires in 15 day(s) (Fri 13 May 2022 07:11:40 GMT +0000). [07:45:19] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/7ccfb12b3a45...e3c8c4b0c828 [07:45:20] [02miraheze/ssl] 07MirahezeSSLBot 03e3c8c4b - Bot: Update SSL cert for it.famepedia.org [07:51:44] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/e3c8c4b0c828...3aa7cf54f884 [07:51:45] [02miraheze/ssl] 07MirahezeSSLBot 033aa7cf5 - Bot: Update SSL cert for www.proficientprofit.click [08:00:32] RECOVERY - sammaditthi.cyou - LetsEncrypt on sslhost is OK: OK - Certificate 'sammaditthi.cyou' will expire on Tue 26 Jul 2022 06:32:17 GMT +0000. [08:08:10] RECOVERY - it.famepedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'it.famepedia.org' will expire on Tue 26 Jul 2022 06:45:09 GMT +0000. [08:13:44] [02mw-config] 07ugochimobi opened pull request 03#4643: set localEntitySourceName for gratisdatawiki and gpcommonswiki - 13https://github.com/miraheze/mw-config/pull/4643 [08:15:01] miraheze/mw-config - ugochimobi the build passed. [08:15:04] [02mw-config] 07ugochimobi commented on pull request 03#4643: set localEntitySourceName for gratisdatawiki and gpcommonswiki - 13https://github.com/miraheze/mw-config/pull/4643#issuecomment-1110692676 [08:23:27] [02mw-config] 07ugochimobi synchronize pull request 03#4643: set localEntitySourceName for gratisdatawiki and gpcommonswiki - 13https://github.com/miraheze/mw-config/pull/4643 [08:24:30] miraheze/mw-config - ugochimobi the build passed. [08:32:33] RECOVERY - proficientprofit.click - LetsEncrypt on sslhost is OK: OK - Certificate 'www.proficientprofit.click' will expire on Tue 26 Jul 2022 06:51:35 GMT +0000. [08:38:25] RECOVERY - www.proficientprofit.click - LetsEncrypt on sslhost is OK: OK - Certificate 'www.proficientprofit.click' will expire on Tue 26 Jul 2022 06:51:35 GMT +0000. [08:39:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.79, 3.29, 2.91 [08:41:09] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.20, 2.89, 2.81 [08:50:36] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.43, 2.82, 2.48 [08:52:36] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.91, 2.57, 2.44 [08:56:43] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.41, 3.50, 3.03 [08:58:40] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.01, 3.02, 2.91 [09:01:39] [02mw-config] 07Universal-Omega closed pull request 03#4643: set localEntitySourceName for gratisdatawiki and gpcommonswiki - 13https://github.com/miraheze/mw-config/pull/4643 [09:01:43] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/bffd26fc7099...093318c01297 [09:01:44] [02miraheze/mw-config] 07ugochimobi 03093318c - set localEntitySourceName for gratisdatawiki and gpcommonswiki (#4643) [09:02:54] miraheze/mw-config - Universal-Omega the build passed. [09:05:08] [02mw-config] 07ugochimobi opened pull request 03#4644: set wgPageLanguageUseDB to true for gpcommonswiki and gratisdatawiki - 13https://github.com/miraheze/mw-config/pull/4644 [09:05:58] [02mw-config] 07Universal-Omega commented on pull request 03#4644: set wgPageLanguageUseDB to true for gpcommonswiki and gratisdatawiki - 13https://github.com/miraheze/mw-config/pull/4644#issuecomment-1110754233 [09:06:02] [02mw-config] 07Universal-Omega closed pull request 03#4644: set wgPageLanguageUseDB to true for gpcommonswiki and gratisdatawiki - 13https://github.com/miraheze/mw-config/pull/4644 [09:06:16] miraheze/mw-config - ugochimobi the build passed. [09:06:56] [02mw-config] 07ugochimobi commented on pull request 03#4644: set wgPageLanguageUseDB to true for gpcommonswiki and gratisdatawiki - 13https://github.com/miraheze/mw-config/pull/4644#issuecomment-1110755354 [09:08:19] [02mw-config] 07ugochimobi edited a comment on pull request 03#4644: set wgPageLanguageUseDB to true for gpcommonswiki and gratisdatawiki - 13https://github.com/miraheze/mw-config/pull/4644#issuecomment-1110755354 [09:10:39] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.50, 1.52, 1.96 [09:18:39] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.06, 1.77, 1.88 [09:19:06] !log [@test101] starting deploy of {'config': True} to all [09:19:07] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 1s [09:19:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:19:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:20:39] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.65, 1.77, 1.87 [09:22:43] !log [@mwtask111] starting deploy of {'config': True} to all [09:22:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:22:51] !log [@mwtask111] finished deploy of {'config': True} to all - SUCCESS in 8s [09:22:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:23:54] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03revert-4643-patch-67 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/2919078993f4 [09:23:55] [02miraheze/mw-config] 07Universal-Omega 032919078 - Revert "set localEntitySourceName for gratisdatawiki and gpcommonswiki (#4643)" [09:23:58] [02mw-config] 07Universal-Omega created branch 03revert-4643-patch-67 - 13https://github.com/miraheze/mw-config [09:24:02] [02mw-config] 07Universal-Omega opened pull request 03#4645: Revert "set localEntitySourceName for gratisdatawiki and gpcommonswiki" - 13https://github.com/miraheze/mw-config/pull/4645 [09:24:12] [02mw-config] 07Universal-Omega closed pull request 03#4645: Revert "set localEntitySourceName for gratisdatawiki and gpcommonswiki" - 13https://github.com/miraheze/mw-config/pull/4645 [09:24:13] [02mw-config] 07Universal-Omega deleted branch 03revert-4643-patch-67 - 13https://github.com/miraheze/mw-config [09:24:15] [02miraheze/mw-config] 07Universal-Omega deleted branch 03revert-4643-patch-67 [09:24:16] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/093318c01297...48bad7686b0a [09:24:18] [02miraheze/mw-config] 07Universal-Omega 0348bad76 - Revert "set localEntitySourceName for gratisdatawiki and gpcommonswiki (#4643)" (#4645) [09:24:49] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03revert-4641-patch-65 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/aa7565fc7abd [09:24:50] [02miraheze/mw-config] 07Universal-Omega 03aa7565f - Revert "setting up entitysource for gratispaideiawiki, gpcommonswiki, gratisdatawiki (#4641)" [09:24:53] [02mw-config] 07Universal-Omega created branch 03revert-4641-patch-65 - 13https://github.com/miraheze/mw-config [09:24:57] [02mw-config] 07Universal-Omega opened pull request 03#4646: Revert "setting up entitysource for gratispaideiawiki, gpcommonswiki, gratisd…" - 13https://github.com/miraheze/mw-config/pull/4646 [09:25:07] miraheze/mw-config - Universal-Omega the build passed. [09:25:14] [02mw-config] 07Universal-Omega closed pull request 03#4646: Revert "setting up entitysource for gratispaideiawiki, gpcommonswiki, gratisd…" - 13https://github.com/miraheze/mw-config/pull/4646 [09:25:15] [02miraheze/mw-config] 07Universal-Omega deleted branch 03revert-4641-patch-65 [09:25:18] [02mw-config] 07Universal-Omega deleted branch 03revert-4641-patch-65 - 13https://github.com/miraheze/mw-config [09:25:19] miraheze/mw-config - Universal-Omega the build passed. [09:25:59] miraheze/mw-config - Universal-Omega the build passed. [09:26:17] miraheze/mw-config - Universal-Omega the build passed. [09:26:39] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.34, 1.45, 1.69 [09:32:39] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.80, 1.72, 1.73 [09:41:47] PROBLEM - cloud12 Puppet on cloud12 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [09:46:39] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.13, 1.88, 1.82 [09:49:15] !log [@test101] starting deploy of {'config': True} to all [09:49:17] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 1s [09:49:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:49:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:52:31] !log [@mwtask111] starting deploy of {'config': True} to all [09:52:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:52:39] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.61, 1.90, 1.88 [09:52:40] !log [@mwtask111] finished deploy of {'config': True} to all - SUCCESS in 9s [09:52:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:00:39] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.33, 1.45, 1.66 [10:01:14] PROBLEM - poserdazfreebies.orain.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'orain.org' expires in 15 day(s) (Fri 13 May 2022 09:54:55 GMT +0000). [10:04:38] PROBLEM - miraheze.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'miraheze.com' expires in 15 day(s) (Fri 13 May 2022 09:57:30 GMT +0000). [10:09:47] RECOVERY - cloud12 Puppet on cloud12 is OK: OK: Puppet is currently enabled, last run 19 seconds ago with 0 failures [10:12:41] PROBLEM - isv.orain.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'orain.org' expires in 15 day(s) (Fri 13 May 2022 09:54:55 GMT +0000). [10:14:29] PROBLEM - orain.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'orain.org' expires in 15 day(s) (Fri 13 May 2022 09:54:55 GMT +0000). [10:19:26] PROBLEM - allthetropes.orain.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'orain.org' expires in 15 day(s) (Fri 13 May 2022 09:54:55 GMT +0000). [10:30:31] PROBLEM - miraheze.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'miraheze.wiki' expires in 15 day(s) (Fri 13 May 2022 10:00:27 GMT +0000). [10:47:06] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.77, 3.23, 2.79 [10:48:39] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.99, 1.66, 1.43 [10:49:03] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.50, 2.89, 2.72 [10:50:39] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.26, 1.91, 1.55 [10:51:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [10:52:39] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.45, 1.72, 1.52 [10:53:11] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.56, 10.55, 9.04 [10:54:39] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.37, 1.58, 1.49 [10:55:07] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.71, 10.89, 9.35 [10:57:12] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.20, 3.14, 2.60 [10:59:00] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.18, 9.60, 9.24 [11:01:10] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.59, 3.27, 2.82 [11:01:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [11:07:38] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 3.45, 2.19, 1.64 [11:09:38] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.51, 1.99, 1.64 [11:11:37] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.40, 2.26, 1.79 [11:15:03] [02mw-config] 07ugochimobi opened pull request 03#4647: T9149: add "bw" to wgExtraLanguageNames for wikibenwiki - 13https://github.com/miraheze/mw-config/pull/4647 [11:15:36] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.14, 1.69, 1.66 [11:16:22] miraheze/mw-config - ugochimobi the build passed. [11:16:39] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.03, 1.73, 1.57 [11:19:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.65, 3.33, 2.91 [11:19:34] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.21, 1.95, 1.77 [11:21:09] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.31, 3.10, 2.89 [11:21:33] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.05, 1.56, 1.65 [11:25:00] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.14, 4.11, 3.29 [11:26:39] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.89, 2.00, 1.85 [11:26:56] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.48, 3.25, 2.92 [11:26:58] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.54, 3.34, 3.10 [11:28:55] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.30, 2.98, 2.87 [11:32:36] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.65, 3.22, 2.87 [11:32:46] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.26, 3.64, 3.33 [11:34:36] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.58, 2.56, 2.67 [11:34:43] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.39, 2.88, 3.08 [11:35:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [11:40:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [11:42:36] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.49, 2.99, 2.75 [11:44:36] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.38, 3.32, 2.89 [11:44:39] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.42, 1.49, 1.66 [11:46:37] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.63, 2.61, 2.68 [11:47:23] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.54, 1.79, 1.63 [11:48:39] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.50, 1.91, 1.78 [11:49:22] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.09, 1.76, 1.63 [11:51:22] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.51, 1.61, 1.58 [11:51:43] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.77, 3.16, 2.81 [11:51:45] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.82, 10.00, 9.14 [11:52:39] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.34, 1.74, 1.76 [11:53:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [11:53:42] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.08, 3.37, 2.92 [11:53:45] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.96, 9.54, 9.07 [11:54:39] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.27, 1.56, 1.69 [11:55:33] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 4.43, 2.22, 1.44 [11:55:41] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.85, 3.06, 2.86 [11:57:19] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.11, 1.78, 1.63 [11:57:33] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.51, 1.83, 1.39 [11:58:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [11:59:18] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.56, 1.71, 1.63 [11:59:33] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.93, 1.51, 1.33 [12:01:18] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 1.79, 2.30, 1.89 [12:01:45] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.94, 10.56, 9.69 [12:03:17] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.45, 1.95, 1.81 [12:03:45] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.09, 11.33, 10.07 [12:05:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [12:05:45] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.12, 11.23, 10.22 [12:07:45] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.22, 10.17, 9.95 [12:11:14] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.55, 1.53, 1.66 [12:11:31] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.85, 3.26, 3.04 [12:13:30] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.10, 3.24, 3.06 [12:15:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [12:20:39] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.21, 1.71, 1.48 [12:22:36] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.23, 9.53, 8.56 [12:22:42] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.75, 1.73, 1.51 [12:24:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.75, 3.42, 3.28 [12:24:36] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 9.04, 9.54, 8.69 [12:24:39] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.13, 1.53, 1.47 [12:26:21] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.79, 3.15, 3.19 [12:28:40] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.97, 10.34, 9.78 [12:29:15] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.02, 3.85, 3.20 [12:29:21] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.08, 3.77, 3.07 [12:30:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.83, 3.76, 3.44 [12:30:36] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.21, 10.86, 10.02 [12:31:09] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.45, 3.85, 3.29 [12:31:20] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 4.00, 3.63, 3.09 [12:32:33] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.23, 10.55, 10.01 [12:33:04] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.38, 3.01, 3.06 [12:33:06] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.18, 1.81, 1.65 [12:33:19] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.95, 3.32, 3.04 [12:34:21] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.67, 3.18, 3.28 [12:35:05] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.05, 1.50, 1.55 [12:41:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [12:42:02] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.78, 1.66, 1.59 [12:44:01] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.68, 1.86, 1.66 [12:46:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [12:50:39] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.35, 1.94, 1.66 [12:52:39] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.49, 1.80, 1.64 [12:53:58] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.72, 1.94, 1.90 [12:54:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [12:54:39] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.45, 1.68, 1.62 [12:55:57] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 3.03, 2.40, 2.07 [12:57:47] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.04, 9.62, 10.04 [12:59:56] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.25, 1.95, 1.97 [13:01:55] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.50, 2.18, 2.05 [13:02:39] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.73, 1.75, 1.68 [13:02:49] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.23, 3.51, 3.04 [13:03:09] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.77, 4.11, 3.13 [13:03:55] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 0.90, 1.76, 1.92 [13:04:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [13:05:05] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.72, 3.84, 3.09 [13:08:40] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.79, 3.96, 3.50 [13:08:52] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.23, 3.65, 3.32 [13:09:03] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.52, 3.22, 3.00 [13:10:37] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.99, 3.31, 3.32 [13:10:47] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.46, 2.92, 3.09 [13:11:52] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.89, 1.28, 1.67 [13:14:28] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.09, 3.68, 3.46 [13:16:25] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.61, 3.90, 3.59 [13:16:39] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.42, 1.98, 1.82 [13:21:25] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.90, 3.82, 3.47 [13:21:48] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.87, 1.66, 1.63 [13:22:21] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.52, 10.88, 10.15 [13:22:39] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.62, 2.00, 1.92 [13:23:48] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.67, 1.96, 1.74 [13:24:18] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.67, 10.12, 9.96 [13:24:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 3.76, 4.16, 3.83 [13:25:14] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.15, 3.72, 3.48 [13:25:47] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.52, 1.76, 1.69 [13:27:46] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.60, 1.37, 1.56 [13:29:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [13:30:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.26, 3.89, 3.85 [13:30:57] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.79, 3.82, 3.66 [13:34:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [13:34:39] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.70, 1.54, 1.68 [13:34:51] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.66, 3.13, 3.39 [13:36:21] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.70, 2.88, 3.36 [13:42:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.62, 3.48, 3.48 [13:42:36] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.11, 3.54, 3.48 [13:44:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.23, 3.47, 3.46 [13:48:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.15, 3.62, 3.56 [13:48:39] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.81, 1.48, 1.47 [13:50:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [13:50:37] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.39, 3.01, 3.29 [13:50:39] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.53, 1.52, 1.48 [13:52:21] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.97, 3.00, 3.34 [13:55:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [13:57:35] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.14, 1.90, 1.56 [14:01:34] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.87, 1.91, 1.63 [14:03:33] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.00, 1.57, 1.54 [14:07:31] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 1.98, 2.08, 1.77 [14:08:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [14:09:31] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.13, 1.71, 1.67 [14:10:35] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.21, 10.57, 9.70 [14:11:30] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.97, 1.48, 1.59 [14:12:32] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.28, 10.13, 9.65 [14:15:26] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.27, 3.41, 2.91 [14:16:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.35, 3.66, 3.40 [14:17:25] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.36, 3.28, 2.92 [14:17:44] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.26, 10.36, 8.84 [14:18:21] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.33, 3.19, 3.26 [14:19:38] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.14, 10.43, 9.03 [14:20:39] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.29, 1.87, 1.57 [14:21:32] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 9.32, 10.05, 9.07 [14:21:33] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 3.37, 2.38, 1.55 [14:22:39] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.51, 1.72, 1.55 [14:23:18] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.75, 10.65, 10.08 [14:23:33] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.09, 1.79, 1.43 [14:24:39] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.57, 1.67, 1.55 [14:25:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.17, 3.51, 3.40 [14:25:15] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.39, 11.66, 10.52 [14:25:33] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.99, 1.54, 1.38 [14:25:34] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.47, 9.48, 8.71 [14:26:24] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.79, 1.89, 1.73 [14:27:09] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.09, 3.33, 3.35 [14:27:16] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 15.07, 12.34, 10.21 [14:27:33] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 9.74, 9.49, 8.81 [14:29:10] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.07, 11.29, 10.08 [14:30:22] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.09, 1.65, 1.69 [14:31:04] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.76, 11.91, 11.11 [14:33:01] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 9.67, 10.20, 9.90 [14:34:20] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.78, 1.78, 1.74 [14:35:52] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.83, 3.39, 3.41 [14:37:49] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.30, 3.69, 3.51 [14:38:50] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.89, 11.80, 11.27 [14:39:46] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.19, 3.61, 3.51 [14:40:18] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.15, 1.80, 1.75 [14:42:43] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.27, 11.94, 11.49 [14:43:40] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.44, 3.26, 3.40 [14:44:18] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.37, 1.76, 1.76 [14:45:17] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.99, 1.73, 1.61 [14:46:17] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.94, 1.43, 1.63 [14:47:14] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.37, 1.91, 1.69 [14:48:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [14:48:33] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.90, 11.50, 11.35 [14:50:29] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.63, 11.68, 11.44 [14:54:17] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.72, 2.30, 1.90 [14:54:22] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.19, 11.47, 11.37 [14:55:00] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.68, 1.93, 1.82 [14:55:20] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.84, 4.00, 3.32 [14:56:04] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.95, 3.71, 3.27 [14:57:13] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.95, 4.85, 4.02 [14:57:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [14:58:17] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.52, 1.98, 1.87 [14:59:09] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.78, 3.85, 3.41 [15:00:02] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.83, 3.27, 3.20 [15:00:11] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.83, 11.98, 11.65 [15:00:50] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.20, 2.02, 1.89 [15:02:17] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.49, 1.56, 1.70 [15:02:46] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.72, 1.90, 1.86 [15:02:57] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.35, 3.18, 3.24 [15:04:04] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.49, 11.32, 11.39 [15:06:59] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.91, 3.78, 3.88 [15:07:57] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.92, 10.53, 11.10 [15:08:56] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.26, 4.16, 4.00 [15:10:39] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.32, 1.48, 1.68 [15:12:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [15:12:50] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.43, 3.75, 3.88 [15:13:53] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.57, 3.42, 3.21 [15:14:47] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.26, 3.95, 3.93 [15:15:45] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.34, 8.71, 10.06 [15:15:53] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.32, 3.07, 3.11 [15:16:44] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.02, 3.53, 3.78 [15:17:19] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.88, 9.93, 8.65 [15:18:39] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.88, 2.01, 1.78 [15:19:17] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.80, 8.99, 8.46 [15:20:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [15:20:38] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.81, 3.83, 3.83 [15:22:35] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.94, 3.97, 3.89 [15:22:39] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.25, 1.84, 1.79 [15:22:59] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.00, 3.93, 3.37 [15:24:39] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.10, 1.58, 1.70 [15:25:33] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.83, 1.21, 0.94 [15:26:47] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.19, 3.16, 3.19 [15:27:33] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 1.06, 1.22, 0.99 [15:30:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [15:32:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.01, 3.86, 3.77 [15:34:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.11, 3.55, 3.66 [15:35:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [15:36:33] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.72, 9.99, 9.64 [15:40:21] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.21, 2.98, 3.35 [15:40:26] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.45, 11.61, 10.35 [15:42:22] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.93, 11.11, 10.33 [15:44:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.63, 3.89, 3.63 [15:48:12] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.15, 11.45, 10.74 [15:48:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.04, 3.72, 3.63 [15:48:39] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.44, 1.72, 1.48 [15:50:08] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.37, 11.53, 10.86 [15:52:39] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.67, 1.81, 1.59 [15:54:39] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.57, 1.66, 1.55 [15:55:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [15:57:54] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.65, 11.13, 10.80 [15:59:17] PROBLEM - ns1 Puppet on ns1 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [16:00:21] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.81, 2.88, 3.38 [16:01:41] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 13.30, 11.55, 9.89 [16:01:47] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.62, 11.63, 11.11 [16:02:45] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.40, 10.77, 9.60 [16:03:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [16:03:40] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.77, 10.21, 9.59 [16:04:44] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 9.04, 10.16, 9.53 [16:05:39] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 9.60, 9.79, 9.49 [16:05:45] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.25, 11.92, 11.30 [16:07:45] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.92, 11.83, 11.34 [16:09:27] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.66, 9.83, 9.21 [16:11:21] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.38, 10.35, 9.45 [16:13:16] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.55, 10.51, 9.63 [16:15:10] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 9.30, 9.93, 9.51 [16:15:45] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.46, 11.68, 11.45 [16:16:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.90, 3.43, 3.40 [16:17:45] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.86, 11.67, 11.47 [16:18:21] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.68, 3.16, 3.31 [16:18:37] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.68, 10.35, 9.57 [16:20:36] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.18, 10.64, 9.78 [16:20:39] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.85, 1.75, 1.59 [16:21:45] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.81, 11.98, 11.61 [16:22:35] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.53, 9.60, 9.51 [16:22:39] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.56, 1.65, 1.57 [16:23:26] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.67, 3.34, 3.14 [16:24:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.67, 3.42, 3.38 [16:25:17] RECOVERY - ns1 Puppet on ns1 is OK: OK: Puppet is currently enabled, last run 22 seconds ago with 0 failures [16:25:21] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.91, 3.17, 3.10 [16:26:21] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.06, 3.37, 3.37 [16:28:39] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.74, 1.67, 1.60 [16:29:10] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.56, 3.44, 3.22 [16:30:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.79, 3.61, 3.49 [16:31:04] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.85, 3.24, 3.17 [16:32:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.21, 3.70, 3.53 [16:34:21] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.12, 3.24, 3.39 [16:35:27] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.41, 10.56, 10.01 [16:37:26] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 8.42, 9.89, 9.85 [16:43:10] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.99, 10.29, 9.84 [16:44:18] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.81, 2.98, 2.78 [16:44:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.93, 3.45, 3.27 [16:44:39] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.16, 1.93, 1.78 [16:45:10] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.18, 10.27, 9.16 [16:45:45] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.05, 11.26, 11.90 [16:46:14] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.82, 10.14, 9.53 [16:46:37] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.21, 3.44, 3.12 [16:47:01] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 13.13, 11.59, 10.44 [16:48:13] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.73, 9.54, 9.38 [16:48:16] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.29, 3.69, 3.10 [16:49:36] PROBLEM - cp31 Stunnel HTTP for mw111 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:49:45] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.82, 11.93, 11.97 [16:50:15] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.58, 3.62, 3.15 [16:50:32] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:50:37] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.19, 3.40, 3.18 [16:51:00] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.93, 11.35, 10.64 [16:51:10] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.55, 9.45, 9.24 [16:51:18] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.02, 10.37, 10.05 [16:51:39] RECOVERY - cp31 Stunnel HTTP for mw111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14640 bytes in 6.281 second response time [16:52:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.16, 3.71, 3.62 [16:52:33] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14634 bytes in 4.124 second response time [16:54:13] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.01, 3.26, 3.11 [16:54:36] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.46, 3.68, 3.37 [16:56:07] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 14.17, 11.50, 10.21 [16:56:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.76, 3.98, 3.73 [16:56:37] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.16, 4.11, 3.56 [16:56:39] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.48, 1.84, 1.93 [16:57:00] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.42, 10.98, 10.57 [16:57:45] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.23, 11.36, 11.84 [16:58:06] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.91, 10.29, 9.92 [16:58:10] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.71, 3.44, 3.23 [16:58:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.75, 3.53, 3.60 [16:58:37] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.32, 3.68, 3.46 [16:59:00] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.37, 10.26, 10.35 [16:59:14] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 8.78, 9.83, 10.04 [17:00:09] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.35, 3.07, 3.12 [17:00:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.40, 4.15, 3.79 [17:00:36] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.99, 4.11, 3.64 [17:02:04] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 14.14, 11.67, 10.50 [17:02:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.71, 3.89, 3.74 [17:02:37] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.13, 3.82, 3.59 [17:03:45] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.32, 11.81, 11.79 [17:04:03] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.59, 10.17, 10.10 [17:04:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.16, 3.82, 3.72 [17:04:39] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.28, 1.41, 1.67 [17:05:01] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.15, 9.38, 9.99 [17:06:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.07, 3.53, 3.62 [17:07:09] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.62, 10.46, 10.26 [17:08:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.20, 3.59, 3.62 [17:09:08] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.79, 9.46, 9.92 [17:10:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.30, 3.29, 3.49 [17:12:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.22, 3.36, 3.47 [17:13:45] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.70, 11.17, 11.79 [17:14:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.66, 3.28, 3.42 [17:15:56] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.76, 10.35, 9.99 [17:16:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.39, 4.55, 3.88 [17:17:55] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.29, 11.18, 10.35 [17:18:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.71, 3.78, 3.68 [17:18:36] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.78, 3.04, 3.28 [17:19:45] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.43, 11.60, 11.71 [17:19:54] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.98, 10.99, 10.38 [17:20:39] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.86, 1.66, 1.55 [17:21:45] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.56, 11.61, 11.70 [17:22:30] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.95, 10.68, 10.34 [17:22:39] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.31, 1.51, 1.50 [17:23:45] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 14.89, 12.88, 12.16 [17:24:21] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.14, 2.80, 3.27 [17:25:45] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.32, 11.45, 11.73 [17:25:50] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.06, 11.73, 10.84 [17:26:19] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 13.05, 11.56, 10.74 [17:27:49] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.90, 10.73, 10.56 [17:28:13] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.07, 11.31, 10.75 [17:32:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.77, 3.54, 3.39 [17:33:45] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.16, 10.64, 11.11 [17:33:56] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 7.58, 9.42, 10.16 [17:34:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.62, 3.88, 3.53 [17:34:57] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.59, 3.13, 2.98 [17:36:51] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.25, 3.64, 3.19 [17:37:45] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.86, 11.08, 11.22 [17:37:45] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.54, 10.55, 10.42 [17:38:46] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.33, 3.09, 3.04 [17:41:45] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.24, 4.06, 3.41 [17:42:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.36, 3.98, 3.72 [17:43:44] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.92, 3.56, 3.30 [17:44:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 9.63, 5.27, 4.17 [17:46:37] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.86, 3.71, 3.40 [17:47:17] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 9.33, 9.87, 10.20 [17:48:36] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.64, 3.34, 3.30 [17:49:37] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 10.16, 9.73, 10.09 [17:49:41] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.48, 3.15, 3.26 [17:50:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.98, 3.95, 4.00 [17:50:39] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.25, 1.89, 1.59 [17:52:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.03, 4.14, 4.07 [17:52:39] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.60, 1.83, 1.61 [17:53:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [17:54:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.14, 3.79, 3.95 [17:54:39] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.45, 1.69, 1.58 [17:55:45] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.17, 11.36, 11.05 [17:56:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.35, 4.08, 4.04 [17:58:04] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.10, 2.23, 1.53 [17:58:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.08, 3.67, 3.89 [17:59:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [17:59:45] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.71, 11.63, 11.29 [18:00:01] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.63, 1.96, 1.52 [18:00:34] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.25, 3.59, 3.38 [18:01:49] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.08, 10.29, 9.85 [18:01:58] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.77, 1.55, 1.42 [18:02:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.01, 3.90, 3.94 [18:02:33] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.29, 3.60, 3.42 [18:03:20] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.88, 3.69, 3.36 [18:04:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.70, 3.60, 3.83 [18:04:32] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.89, 3.33, 3.34 [18:05:38] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.51, 9.71, 9.74 [18:05:45] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.65, 11.42, 11.21 [18:06:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.80, 4.39, 4.06 [18:07:09] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.43, 3.96, 3.52 [18:07:45] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.91, 11.15, 11.14 [18:08:30] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 3.39, 4.13, 3.71 [18:08:39] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.48, 2.01, 1.71 [18:09:03] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.83, 3.47, 3.39 [18:09:40] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.07, 9.83, 9.27 [18:09:45] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.00, 11.69, 11.32 [18:10:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.71, 3.83, 3.95 [18:10:29] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.07, 3.39, 3.49 [18:10:57] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.99, 3.04, 3.25 [18:11:30] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/4a3e0e22e332...f1fc23ec6d15 [18:11:32] [02miraheze/ImportDump] 07Universal-Omega 03f1fc23e - Add private and locked functionality [18:11:33] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [18:11:39] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 8.27, 9.16, 9.10 [18:12:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.50, 4.61, 4.22 [18:12:28] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.45, 3.16, 3.39 [18:13:45] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.01, 11.49, 11.36 [18:13:57] PROBLEM - ping6 on ns1 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 127.98 ms [18:16:00] PROBLEM - ping6 on ns1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 132.11 ms [18:17:06] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/f1fc23ec6d15...4c0404e18c69 [18:17:07] [02miraheze/ImportDump] 07Universal-Omega 034c0404e - Add manual private and locked functionality [18:17:09] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [18:18:03] PROBLEM - ping6 on ns1 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 129.44 ms [18:20:05] PROBLEM - ping6 on ns1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 128.75 ms [18:21:11] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/4c0404e18c69...0894207c85ca [18:21:12] [02miraheze/ImportDump] 07Universal-Omega 030894207 - Update importdump_requests.sql [18:21:14] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [18:22:52] [02ImportDump] 07Universal-Omega edited pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [18:23:25] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.32, 3.49, 3.35 [18:23:45] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.22, 11.66, 11.39 [18:24:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [18:27:14] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.82, 3.36, 3.33 [18:27:45] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.02, 11.41, 11.39 [18:28:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.31, 3.75, 3.97 [18:29:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [18:30:57] miraheze/ImportDump - Universal-Omega the build passed. [18:34:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [18:36:27] PROBLEM - ping6 on ns1 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 140.40 ms [18:37:45] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.54, 11.73, 11.37 [18:38:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.20, 3.45, 3.59 [18:38:29] PROBLEM - ping6 on ns1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 137.99 ms [18:39:45] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.93, 11.79, 11.44 [18:40:33] PROBLEM - ping6 on ns1 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 149.98 ms [18:40:37] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.95, 3.91, 3.39 [18:41:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [18:42:10] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 7.33, 4.22, 3.38 [18:44:39] PROBLEM - ping6 on ns1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 214.94 ms [18:47:45] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.39, 11.49, 11.27 [18:48:07] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.41, 3.82, 3.49 [18:48:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.87, 3.98, 3.95 [18:48:36] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.39, 3.71, 3.59 [18:49:45] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.92, 11.32, 11.21 [18:50:06] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.56, 3.94, 3.56 [18:50:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.24, 4.54, 4.16 [18:50:36] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.34, 4.07, 3.75 [18:50:47] PROBLEM - ping6 on ns1 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 135.21 ms [18:51:45] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.50, 11.65, 11.34 [18:52:06] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.62, 3.43, 3.42 [18:52:37] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.26, 3.81, 3.69 [18:52:50] PROBLEM - ping6 on ns1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 135.08 ms [18:53:45] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.17, 11.07, 11.17 [18:54:04] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.82, 3.20, 3.33 [18:54:37] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.11, 3.84, 3.71 [18:55:45] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.30, 11.45, 11.29 [18:56:36] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.28, 3.86, 3.75 [18:58:59] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.40, 10.13, 9.39 [18:59:45] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.71, 10.47, 10.95 [19:00:36] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.18, 4.58, 4.02 [19:02:04] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.78, 4.01, 3.61 [19:02:45] PROBLEM - phab121 NTP time on phab121 is WARNING: NTP WARNING: Offset 0.1051973104 secs [19:02:59] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.70, 9.18, 9.21 [19:05:45] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.89, 11.47, 11.19 [19:07:08] PROBLEM - ping6 on ns1 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 131.46 ms [19:07:45] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.62, 11.14, 11.10 [19:09:10] PROBLEM - ping6 on ns1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 134.57 ms [19:10:36] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.81, 3.59, 3.96 [19:11:05] RECOVERY - phab121 NTP time on phab121 is OK: NTP OK: Offset 0.09628596902 secs [19:11:14] PROBLEM - ping6 on ns1 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 132.40 ms [19:11:33] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.74, 10.38, 9.42 [19:13:16] PROBLEM - ping6 on ns1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 132.89 ms [19:15:22] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 7.84, 9.48, 9.31 [19:15:58] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.97, 3.80, 3.97 [19:16:37] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.20, 3.48, 3.75 [19:17:42] [02miraheze/mw-config] 07MacFan4000 pushed 031 commit to 03revert-4595-patch-2 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/be2a9029dcb8 [19:17:44] [02miraheze/mw-config] 07MacFan4000 03be2a902 - Revert "revert unauthorized changes made without consensus (#4595)" [19:17:45] [02mw-config] 07MacFan4000 created branch 03revert-4595-patch-2 - 13https://github.com/miraheze/mw-config [19:18:03] [02mw-config] 07MacFan4000 opened pull request 03#4648: Revert "revert unauthorized changes made without consensus" per passed proposal - 13https://github.com/miraheze/mw-config/pull/4648 [19:18:36] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.93, 3.54, 3.74 [19:19:20] miraheze/mw-config - MacFan4000 the build passed. [19:21:05] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.48, 10.76, 9.83 [19:21:45] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.01, 10.81, 10.68 [19:21:55] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.03, 2.54, 3.37 [19:22:37] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.10, 2.90, 3.39 [19:23:01] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.90, 10.22, 9.73 [19:23:45] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.13, 10.98, 10.77 [19:25:01] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 9.35, 9.83, 9.64 [19:26:26] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.50, 1.79, 1.33 [19:26:36] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.82, 3.90, 3.74 [19:27:45] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.28, 11.55, 11.07 [19:28:23] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.65, 1.39, 1.24 [19:28:36] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 7.20, 4.89, 4.11 [19:29:45] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.69, 11.65, 11.17 [19:29:53] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.06, 3.55, 3.52 [19:31:53] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.95, 3.67, 3.57 [19:33:53] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.34, 3.90, 3.66 [19:35:53] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.55, 3.81, 3.66 [19:37:53] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.55, 3.92, 3.70 [19:41:45] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.24, 9.07, 10.19 [19:41:50] RECOVERY - ping6 on ns1 is OK: PING OK - Packet loss = 0%, RTA = 119.77 ms [19:43:21] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/0894207c85ca...8d743c099afb [19:43:22] [02miraheze/ImportDump] 07Universal-Omega 038d743c0 - Update ImportDumpRequestManager.php [19:43:24] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [19:44:01] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/8d743c099afb...0b300cff855d [19:44:02] [02miraheze/ImportDump] 07Universal-Omega 030b300cf - Update ImportDumpRequestViewer.php [19:44:05] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [19:45:58] PROBLEM - ping6 on ns1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 120.15 ms [19:46:11] [02miraheze/ImportDump] 07github-actions[bot] pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/0b300cff855d...13a5e8a59557 [19:46:13] [02miraheze/ImportDump] 07github-actions 0313a5e8a - CI: lint code to MediaWiki standards [19:46:14] [02ImportDump] 07github-actions[bot] synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [19:47:55] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/13a5e8a59557...c255dfd6eb61 [19:47:57] [02miraheze/ImportDump] 07Universal-Omega 03c255dfd - Update ImportDumpRequestViewer.php [19:47:58] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [19:49:53] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.77, 3.57, 3.74 [19:50:03] RECOVERY - ping6 on ns1 is OK: PING OK - Packet loss = 0%, RTA = 119.77 ms [19:50:25] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - dnd.bellinrattin.it All nameservers failed to answer the query. [19:50:40] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.83, 10.34, 10.29 [19:51:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [19:52:37] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.39, 3.27, 3.94 [19:53:53] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.22, 2.76, 3.35 [19:56:59] miraheze/ImportDump - Universal-Omega the build passed. [19:57:25] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/c255dfd6eb61...df2f7a571820 [19:57:26] [02miraheze/ImportDump] 07Universal-Omega 03df2f7a5 - Update ImportDumpRequestViewer.php [19:57:28] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [19:59:02] [02miraheze/ImportDump] 07github-actions[bot] pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/df2f7a571820...cf8c423d4839 [19:59:04] [02miraheze/ImportDump] 07github-actions 03cf8c423 - CI: lint code to MediaWiki standards [19:59:05] [02ImportDump] 07github-actions[bot] synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [20:00:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.94, 3.29, 3.99 [20:01:21] miraheze/ImportDump - Universal-Omega the build has errored. [20:01:31] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.61, 9.98, 9.04 [20:03:30] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.68, 9.47, 8.97 [20:04:15] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.60, 9.87, 10.18 [20:04:23] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [20:04:25] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/cf8c423d4839...ae8f27798e91 [20:04:26] [02miraheze/ImportDump] 07Universal-Omega 03ae8f277 - Update ImportDumpRequestViewer.php [20:04:36] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.48, 2.93, 3.37 [20:08:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [20:08:07] miraheze/ImportDump - Universal-Omega the build has errored. [20:09:38] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/ae8f27798e91...ca95a3ed5c19 [20:09:39] [02miraheze/ImportDump] 07Universal-Omega 03ca95a3e - Update ImportDumpRequestViewer.php [20:09:42] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [20:10:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.31, 3.29, 3.55 [20:12:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.41, 3.46, 3.60 [20:13:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [20:13:33] miraheze/ImportDump - Universal-Omega the build has errored. [20:13:46] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/ca95a3ed5c19...229bcefb34ef [20:13:48] [02miraheze/ImportDump] 07Universal-Omega 03229bcef - Update en.json [20:13:50] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [20:14:07] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/229bcefb34ef...30ebd8299fb9 [20:14:09] [02miraheze/ImportDump] 07Universal-Omega 0330ebd82 - Update qqq.json [20:14:12] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [20:15:52] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/30ebd8299fb9...b7e5c978c758 [20:15:53] [02miraheze/ImportDump] 07Universal-Omega 03b7e5c97 - Update ImportDumpRequestViewer.php [20:15:56] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [20:18:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.80, 4.51, 3.92 [20:19:08] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.19, 3.51, 3.27 [20:19:20] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 73, in check_records nameserversans = dns_resolver.resolve(root_domain, 'NS') File "/usr/l [20:19:20] n3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query bellinrattin.it. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [20:20:07] miraheze/ImportDump - Universal-Omega the build has errored. [20:20:43] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 7.69, 4.24, 3.46 [20:22:42] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.85, 3.56, 3.31 [20:23:00] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [20:23:03] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/b7e5c978c758...abe8a2f842d3 [20:23:04] [02miraheze/ImportDump] 07Universal-Omega 03abe8a2f - Update ImportDumpRequestViewer.php [20:24:03] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [20:24:05] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/abe8a2f842d3...8f26c22bc0fb [20:24:06] [02miraheze/ImportDump] 07Universal-Omega 038f26c22 - Update ImportDumpRequestQueuePager.php [20:24:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [20:24:41] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.40, 3.98, 3.49 [20:26:03] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/8f26c22bc0fb...3effae2b9f0f [20:26:05] [02miraheze/ImportDump] 07Universal-Omega 033effae2 - Update ImportDumpRequestManager.php [20:26:07] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [20:30:38] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.16, 3.89, 3.64 [20:32:37] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.14, 4.23, 3.78 [20:33:19] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.38, 10.01, 9.11 [20:33:57] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [20:34:00] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/3effae2b9f0f...7fd588439910 [20:34:01] [02miraheze/ImportDump] 07Universal-Omega 037fd5884 - Update SpecialImportDumpRequestQueue.php [20:34:03] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/7fd588439910...807740dcad7e [20:34:04] [02miraheze/ImportDump] 07Universal-Omega 03807740d - Update ImportDumpRequestViewer.php [20:34:06] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [20:34:36] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.61, 3.57, 3.59 [20:34:36] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.39, 3.93, 3.90 [20:35:45] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.06, 10.77, 10.01 [20:37:08] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.76, 9.95, 9.34 [20:37:15] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.65, 9.66, 9.20 [20:37:45] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.84, 10.17, 9.87 [20:38:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.70, 3.64, 3.97 [20:38:34] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.77, 3.11, 3.39 [20:38:38] miraheze/ImportDump - Universal-Omega the build has errored. [20:39:07] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 9.34, 9.75, 9.35 [20:41:01] [02ImportDump] 07Universal-Omega edited pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [20:41:45] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.17, 11.45, 10.50 [20:44:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.39, 4.00, 3.96 [20:44:46] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.48, 10.05, 9.03 [20:45:45] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.10, 11.25, 10.66 [20:46:37] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.47, 3.86, 3.68 [20:46:46] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 10.06, 10.04, 9.15 [20:48:36] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.73, 3.81, 3.68 [20:50:36] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.63, 4.39, 3.92 [20:51:27] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.34, 4.06, 3.54 [20:52:36] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.49, 3.60, 3.68 [20:53:26] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.17, 3.26, 3.31 [20:54:29] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/commit/f1b69e54e799 [20:54:30] [02miraheze/CreateWiki] 07Universal-Omega 03f1b69e5 - Fix testGetCreationDate by setting fake timestamp [20:54:32] [02CreateWiki] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/CreateWiki [20:54:33] [02CreateWiki] 07Universal-Omega opened pull request 03#318: Fix testGetCreationDate by setting fake timestamp - 13https://github.com/miraheze/CreateWiki/pull/318 [20:56:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.11, 3.53, 3.86 [20:56:36] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.18, 2.95, 3.40 [20:57:45] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.13, 10.78, 10.65 [21:01:45] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 7.15, 9.93, 10.46 [21:03:45] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.68, 9.20, 10.12 [21:04:22] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.42, 2.83, 3.36 [21:04:52] miraheze/CreateWiki - Universal-Omega the build passed. [21:05:20] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/11ad7901c4bd...5a7d1ce65e1c [21:05:21] [02miraheze/mw-config] 07Universal-Omega 035a7d1ce - Remove forced default for $wgHiddenPrefs [21:06:28] miraheze/mw-config - Universal-Omega the build passed. [21:06:47] miraheze/ImportDump - Universal-Omega the build passed. [21:07:40] !log [universalomega@test101] starting deploy of {'pull': 'config', 'config': True} to all [21:07:42] !log [universalomega@test101] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 1s [21:07:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:07:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:09:34] [02CreateWiki] 07Universal-Omega closed pull request 03#318: Fix testGetCreationDate by setting fake timestamp - 13https://github.com/miraheze/CreateWiki/pull/318 [21:09:36] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/e44c1bf8d69a...25158d1cca5f [21:09:37] [02miraheze/CreateWiki] 07Universal-Omega 0325158d1 - Fix testGetCreationDate by setting fake timestamp (#318) [21:09:39] [02CreateWiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/CreateWiki [21:09:40] [02miraheze/CreateWiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [21:11:45] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.70, 10.72, 10.43 [21:17:45] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.89, 11.46, 10.74 [21:17:56] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [21:17:58] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/807740dcad7e...56848848039c [21:17:59] [02miraheze/ImportDump] 07Universal-Omega 035684884 - Update extension.json [21:18:01] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.67, 4.41, 3.74 [21:18:12] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.52, 3.63, 3.18 [21:18:21] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/56848848039c...74106129f5f7 [21:18:23] [02miraheze/ImportDump] 07Universal-Omega 037410612 - Update Main.php [21:18:24] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [21:18:25] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp20.miraheze.org - CNAME OK [21:18:55] miraheze/CreateWiki - Universal-Omega the build passed. [21:19:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [21:19:45] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.73, 10.56, 10.52 [21:20:11] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.89, 3.38, 3.14 [21:21:55] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.38, 3.80, 3.63 [21:22:20] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/74106129f5f7...63ddeb9b9941 [21:22:21] [02miraheze/ImportDump] 07Universal-Omega 0363ddeb9 - Update extension.json [21:22:23] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [21:22:30] !log [@mwtask111] starting deploy of {'config': True} to all [21:22:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:22:56] !log [@mwtask111] finished deploy of {'config': True} to all - SUCCESS in 26s [21:23:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:24:32] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [21:25:45] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.44, 11.23, 10.78 [21:26:18] [02ImportDump] 07Universal-Omega edited pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [21:27:45] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.75, 11.04, 10.77 [21:28:36] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.97, 3.47, 3.17 [21:30:36] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.42, 3.07, 3.06 [21:30:44] [02ImportDump] 07Universal-Omega edited pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [21:31:54] miraheze/ImportDump - Universal-Omega the build passed. [21:32:39] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.46, 1.54, 1.97 [21:33:14] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.83, 10.17, 9.33 [21:33:36] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.10, 10.55, 9.66 [21:34:21] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.38, 9.68, 8.62 [21:35:08] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.86, 9.88, 9.34 [21:35:34] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.39, 4.20, 3.71 [21:36:19] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.22, 9.22, 8.59 [21:36:36] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.31, 4.19, 3.54 [21:37:34] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.86, 9.71, 9.54 [21:37:45] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.36, 12.06, 11.28 [21:38:00] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.04, 3.95, 3.38 [21:40:36] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.90, 3.76, 3.53 [21:42:37] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 7.10, 4.75, 3.89 [21:43:00] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.12, 10.44, 9.69 [21:43:45] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.46, 11.64, 11.37 [21:46:39] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.03, 1.88, 1.89 [21:49:01] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 9.69, 10.20, 9.83 [21:51:39] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/63ddeb9b9941...879128352999 [21:51:41] [02miraheze/ImportDump] 07Universal-Omega 038791283 - Don't notify actors of their own actions [21:51:42] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [21:54:32] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [21:54:39] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.80, 2.00, 1.99 [21:54:57] [02mw-config] 07MacFan4000 closed pull request 03#4648: Revert "revert unauthorized changes made without consensus" per passed proposal - 13https://github.com/miraheze/mw-config/pull/4648 [21:54:58] [02miraheze/mw-config] 07MacFan4000 deleted branch 03revert-4595-patch-2 [21:55:00] [02mw-config] 07MacFan4000 deleted branch 03revert-4595-patch-2 - 13https://github.com/miraheze/mw-config [21:55:00] !log [macfan@mwtask111] starting deploy of {'config': True} to all [21:55:01] [02miraheze/mw-config] 07MacFan4000 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/5a7d1ce65e1c...93a089e43757 [21:55:03] [02miraheze/mw-config] 07MacFan4000 0393a089e - Revert "revert unauthorized changes made without consensus (#4595)" (#4648) [21:55:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:55:18] !log [macfan@mwtask111] finished deploy of {'config': True} to all - SUCCESS in 18s [21:55:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:56:03] miraheze/mw-config - MacFan4000 the build passed. [21:56:48] !log [macfan@mwtask111] starting deploy of {'config': True} to all [21:57:00] !log [macfan@mwtask111] finished deploy of {'config': True} to all - SUCCESS in 11s [21:57:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:57:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:00:36] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.57, 3.62, 3.97 [22:00:39] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.14, 1.97, 1.97 [22:01:53] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.73, 3.34, 3.87 [22:02:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [22:02:19] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.52, 10.38, 9.60 [22:02:39] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.91, 1.91, 1.95 [22:02:57] miraheze/ImportDump - Universal-Omega the build passed. [22:03:45] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 14.61, 11.24, 10.81 [22:04:18] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.82, 9.71, 9.47 [22:05:53] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.91, 3.99, 3.97 [22:06:37] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.10, 3.71, 3.85 [22:07:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [22:07:45] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.53, 10.76, 10.77 [22:08:38] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.82, 1.50, 1.25 [22:10:35] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.68, 1.50, 1.27 [22:11:45] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.90, 9.31, 10.19 [22:12:39] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.13, 1.36, 1.65 [22:16:36] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.74, 3.68, 3.89 [22:17:00] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.19, 9.91, 9.22 [22:17:53] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.55, 3.45, 3.84 [22:18:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [22:18:39] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.10, 1.79, 1.73 [22:19:00] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.25, 9.45, 8.61 [22:19:01] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 9.15, 9.87, 9.30 [22:20:00] !log [@test101] starting deploy of {'config': True} to all [22:20:02] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 1s [22:20:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:20:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:20:29] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.15, 10.51, 8.99 [22:20:36] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.70, 3.70, 3.80 [22:20:58] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 10.02, 9.57, 8.75 [22:21:45] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.82, 10.51, 10.24 [22:22:28] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.25, 10.21, 9.06 [22:22:36] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.47, 3.41, 3.67 [22:22:39] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.28, 1.73, 1.74 [22:23:45] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.06, 11.28, 10.57 [22:24:27] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 8.38, 9.29, 8.85 [22:24:39] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.14, 1.53, 1.66 [22:25:53] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.54, 2.75, 3.32 [22:26:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.14, 3.26, 3.87 [22:27:45] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.25, 11.34, 10.80 [22:28:36] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.00, 3.34, 3.50 [22:30:37] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.98, 3.39, 3.49 [22:31:45] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.20, 11.74, 11.10 [22:31:53] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.91, 3.42, 3.39 [22:32:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.12, 3.53, 3.75 [22:32:37] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.88, 2.81, 3.26 [22:33:53] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.29, 3.09, 3.28 [22:34:53] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/879128352999...437a07a20840 [22:34:54] [02miraheze/ImportDump] 07Universal-Omega 03437a07a - Move sendNotification for statusUpdate to ImportDumpRequestViewer [22:34:56] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [22:36:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.65, 3.64, 3.76 [22:37:35] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/437a07a20840...c7b0661759c3 [22:37:36] [02miraheze/ImportDump] 07Universal-Omega 03c7b0661 - Add comments with changes when edited and support notifications for requests re-opened [22:37:38] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [22:37:45] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.20, 11.40, 11.17 [22:38:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [22:39:26] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/c7b0661759c3...a3912c826c1b [22:39:27] [02miraheze/ImportDump] 07Universal-Omega 03a3912c8 - Update ImportDumpRequestViewer.php [22:39:29] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [22:40:19] miraheze/ImportDump - Universal-Omega the build has errored. [22:42:09] miraheze/ImportDump - Universal-Omega the build has errored. [22:42:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.11, 3.49, 3.65 [22:42:48] PROBLEM - cloud10 Puppet on cloud10 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [22:44:12] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.21, 9.53, 8.92 [22:45:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [22:45:55] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.74, 2.22, 1.58 [22:46:10] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.72, 9.20, 8.87 [22:46:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.07, 3.95, 3.85 [22:47:42] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/a3912c826c1b...af7fc5bcd733 [22:47:43] [02miraheze/ImportDump] 07Universal-Omega 03af7fc5b - Update ImportDumpRequestViewer.php [22:47:45] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [22:47:52] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.69, 1.62, 1.44 [22:48:39] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.43, 1.78, 1.51 [22:50:25] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - dnd.bellinrattin.it All nameservers failed to answer the query. [22:50:34] miraheze/ImportDump - Universal-Omega the build has errored. [22:51:58] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/af7fc5bcd733...aa61f68070be [22:51:59] [02miraheze/ImportDump] 07Universal-Omega 03aa61f68 - Update ImportDumpRequestViewer.php [22:52:01] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [22:52:39] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.58, 1.85, 1.62 [22:54:21] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.89, 2.98, 3.38 [22:54:39] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.44, 1.69, 1.59 [22:59:31] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/aa61f68070be...a9d904426040 [22:59:32] [02miraheze/ImportDump] 07Universal-Omega 03a9d9044 - Update qqq.json [22:59:34] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [22:59:39] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/a9d904426040...441322c71298 [22:59:40] [02miraheze/ImportDump] 07Universal-Omega 03441322c - Update en.json [22:59:42] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [23:00:02] !log [@test101] starting deploy of {'l10nupdate': True} to all [23:00:03] !log [@mwtask111] starting deploy of {'l10nupdate': True} to all [23:00:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:00:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:00:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.71, 3.60, 3.50 [23:00:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [23:02:19] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/441322c71298...6ea764969b0c [23:02:20] [02miraheze/ImportDump] 07Universal-Omega 036ea7649 - Update en.json [23:02:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.29, 3.82, 3.60 [23:02:22] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [23:06:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.82, 3.96, 3.70 [23:06:49] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/6ea764969b0c...0a8eaaf12e2a [23:06:50] [02miraheze/ImportDump] 07Universal-Omega 030a8eaaf - Update en.json [23:06:52] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [23:08:21] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.73, 1.97, 1.48 [23:08:39] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.90, 1.76, 1.67 [23:09:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [23:09:33] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.29, 10.21, 9.54 [23:10:47] RECOVERY - cloud10 Puppet on cloud10 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [23:11:45] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.51, 11.19, 10.79 [23:11:51] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.60, 9.58, 8.49 [23:12:17] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.98, 1.46, 1.38 [23:12:47] [02mediawiki] 07alistair3149 commented on pull request 03#6509: Bump skins/Citizen from `2eae3f9` to `9041cc6` - 13https://github.com/miraheze/mediawiki/pull/6509#issuecomment-1111566103 [23:13:22] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.72, 9.88, 9.60 [23:13:38] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/0a8eaaf12e2a...dba0136d81d6 [23:13:39] [02miraheze/ImportDump] 07Universal-Omega 03dba0136 - Update ImportDumpRequestViewer.php [23:13:41] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [23:13:45] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.06, 10.78, 10.69 [23:13:48] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.49, 9.08, 8.42 [23:14:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [23:14:39] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 3.72, 2.35, 1.90 [23:15:07] miraheze/ImportDump - Universal-Omega the build has errored. [23:16:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.44, 3.86, 3.66 [23:17:43] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.90, 3.56, 3.19 [23:18:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.91, 3.64, 3.62 [23:19:20] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 86, in check_records cname = str(dns_resolver.resolve(hostname, 'CNAME')[0]) File "/usr/li [23:19:20] 3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query dnd.bellinrattin.it. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [23:19:38] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.06, 3.34, 3.15 [23:20:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.66, 3.94, 3.72 [23:21:45] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.16, 11.27, 10.92 [23:22:26] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/dba0136d81d6...7f13b88726f7 [23:22:27] [02miraheze/ImportDump] 07Universal-Omega 037f13b88 - Update ImportDumpRequestViewer.php [23:22:29] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [23:23:45] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.44, 11.23, 10.94 [23:24:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.00, 3.94, 3.81 [23:24:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [23:24:39] !log [@mwtask111] finished deploy of {'l10nupdate': True} to all - SUCCESS in 1475s [23:24:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:27:45] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.35, 11.49, 11.06 [23:27:57] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/7f13b88726f7...5adbc29eb117 [23:27:59] [02miraheze/ImportDump] 07Universal-Omega 035adbc29 - Update EchoRequestStatusUpdatePresentationModel.php [23:28:00] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [23:28:04] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/5adbc29eb117...26b055420fbe [23:28:06] [02miraheze/ImportDump] 07Universal-Omega 0326b0554 - Update ImportDumpRequestViewer.php [23:28:07] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [23:29:45] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.83, 10.80, 10.86 [23:31:29] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.64, 10.75, 9.50 [23:32:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.56, 3.84, 3.72 [23:33:28] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 9.75, 10.16, 9.43 [23:34:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.91, 3.92, 3.77 [23:34:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [23:36:16] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/26b055420fbe...1ff6fe7134dd [23:36:17] [02miraheze/ImportDump] 07Universal-Omega 031ff6fe7 - Update EchoRequestStatusUpdatePresentationModel.php [23:36:19] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [23:36:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 3.75, 4.01, 3.83 [23:36:26] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/1ff6fe7134dd...494b8792b9a2 [23:36:28] [02miraheze/ImportDump] 07Universal-Omega 03494b879 - Update EchoRequestStatusUpdatePresentationModel.php [23:36:29] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [23:38:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.60, 3.84, 3.79 [23:38:30] [02miraheze/ImportDump] 07github-actions[bot] pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/494b8792b9a2...b73126e15c33 [23:38:31] [02miraheze/ImportDump] 07github-actions 03b73126e - CI: lint code to MediaWiki standards [23:38:32] [02ImportDump] 07github-actions[bot] synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [23:40:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 3.85, 4.02, 3.87 [23:40:52] miraheze/ImportDump - Universal-Omega the build has errored. [23:41:44] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/b73126e15c33...e0171c297d83 [23:41:45] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.24, 9.27, 10.15 [23:41:46] [02miraheze/ImportDump] 07Universal-Omega 03e0171c2 - Update en.json [23:41:47] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [23:42:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.35, 3.33, 3.63 [23:44:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [23:44:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 7.07, 4.16, 3.86 [23:44:21] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/e0171c297d83...73cffe73a803 [23:44:23] [02miraheze/ImportDump] 07Universal-Omega 0373cffe7 - Update en.json [23:44:25] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [23:48:25] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp21.miraheze.org - CNAME OK [23:48:37] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/73cffe73a803...9a780f1d8036 [23:48:39] [02miraheze/ImportDump] 07Universal-Omega 039a780f1 - Update en.json [23:48:40] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [23:48:50] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/9a780f1d8036...39f08fe1e00f [23:48:52] [02miraheze/ImportDump] 07Universal-Omega 0339f08fe - Update EchoNewRequestPresentationModel.php [23:48:53] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [23:49:10] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/39f08fe1e00f...bc700e3955bc [23:49:12] [02miraheze/ImportDump] 07Universal-Omega 03bc700e3 - Update EchoRequestCommentPresentationModel.php [23:49:13] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [23:49:40] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/bc700e3955bc...4f60b59d8a94 [23:49:42] [02miraheze/ImportDump] 07Universal-Omega 034f60b59 - Update EchoRequestStatusUpdatePresentationModel.php [23:49:44] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [23:50:09] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.44, 3.52, 3.18 [23:50:23] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/4f60b59d8a94...9b3d2fb253c1 [23:50:25] [02miraheze/ImportDump] 07Universal-Omega 039b3d2fb - Update ImportDumpRequestManager.php [23:50:26] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [23:50:40] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/9b3d2fb253c1...159bca4d183d [23:50:42] [02miraheze/ImportDump] 07Universal-Omega 03159bca4 - Update EchoNewRequestPresentationModel.php [23:50:43] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [23:50:53] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/159bca4d183d...1d35d33c2782 [23:50:55] [02miraheze/ImportDump] 07Universal-Omega 031d35d33 - Update EchoRequestCommentPresentationModel.php [23:50:56] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [23:51:05] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/1d35d33c2782...d08c71a0887a [23:51:06] [02miraheze/ImportDump] 07Universal-Omega 03d08c71a - Update EchoRequestStatusUpdatePresentationModel.php [23:51:08] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [23:51:21] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.67, 1.91, 1.41 [23:51:45] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.98, 10.03, 9.92 [23:51:57] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/d08c71a0887a...ed0071ebf76a [23:51:59] [02miraheze/ImportDump] 07Universal-Omega 03ed0071e - Update SpecialRequestImportDump.php [23:52:00] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [23:53:21] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.92, 1.91, 1.48 [23:54:13] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.26, 3.65, 3.12 [23:54:32] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/ed0071ebf76a...ce3084b49b4a [23:54:34] [02miraheze/ImportDump] 07Universal-Omega 03ce3084b - Update en.json [23:54:36] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [23:55:21] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.39, 1.64, 1.43 [23:56:12] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.98, 3.92, 3.29 [23:56:14] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/ce3084b49b4a...cceac20b0346 [23:56:16] [02miraheze/ImportDump] 07Universal-Omega 03cceac20 - Update qqq.json [23:56:17] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [23:56:54] !log [@test101] finished deploy of {'l10nupdate': True} to all - SUCCESS in 3412s [23:57:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:57:41] [02ImportDump] 07Universal-Omega edited pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [23:57:46] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.58, 3.91, 3.58 [23:58:11] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.01, 3.77, 3.30 [23:59:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [23:59:45] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.56, 9.14, 9.77