[00:01:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [00:03:30] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 1.44, 2.75, 3.70 [00:04:20] PROBLEM - mw101 Puppet on mw101 is CRITICAL: CRITICAL: Puppet has 305 failures. Last run 3 minutes ago with 305 failures. Failed resources (up to 3 shown): File[steamdecklinux.wiki_private],File[wiki-asterix.cf],File[wiki-asterix.cf_private],File[otcg.ml] [00:04:25] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.26, 3.48, 3.56 [00:05:29] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.59, 3.88, 3.99 [00:08:23] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.75, 3.38, 3.49 [00:10:23] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.10, 3.19, 3.40 [00:11:02] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.61, 3.37, 3.87 [00:13:03] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.56, 4.12, 4.08 [00:14:21] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.55, 3.30, 3.43 [00:16:20] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.10, 2.97, 3.30 [00:19:29] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.51, 3.35, 3.88 [00:21:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [00:22:08] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.51, 8.95, 8.01 [00:26:07] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.15, 8.46, 8.06 [00:30:14] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 4.00, 3.34, 3.16 [00:31:29] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.43, 2.92, 3.40 [00:31:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [00:32:13] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.83, 2.80, 2.99 [00:32:25] RECOVERY - mw101 Puppet on mw101 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:36:11] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.66, 3.52, 3.27 [00:38:11] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.21, 3.73, 3.37 [00:40:10] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.69, 3.35, 3.27 [00:40:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [00:43:29] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.01, 4.11, 3.67 [00:44:41] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.56, 8.81, 7.74 [00:45:29] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.13, 3.78, 3.61 [00:46:37] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 8.10, 8.12, 7.60 [00:47:29] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.11, 3.88, 3.66 [00:49:03] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.91, 3.69, 3.97 [00:49:29] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.96, 3.92, 3.70 [00:53:03] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.86, 4.13, 4.08 [00:55:29] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.41, 2.94, 3.33 [00:55:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [00:58:53] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.47, 8.86, 8.20 [00:59:03] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.59, 3.57, 3.87 [00:59:29] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.66, 3.44, 3.46 [01:00:48] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.46, 8.23, 8.05 [01:01:29] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.39, 3.66, 3.52 [01:02:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:03:29] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.34, 3.56, 3.50 [01:04:26] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.34, 8.78, 7.75 [01:06:26] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.33, 8.40, 7.75 [01:07:29] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.55, 3.53, 3.46 [01:09:29] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.16, 3.21, 3.35 [01:12:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:13:03] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.96, 3.92, 3.66 [01:17:03] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.08, 3.53, 3.62 [01:19:33] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.89, 9.94, 8.50 [01:21:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:21:32] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.96, 9.85, 8.65 [01:26:24] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.36, 3.74, 3.35 [01:26:44] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.17, 8.69, 8.08 [01:27:03] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.37, 3.79, 3.60 [01:27:32] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.94, 8.39, 8.35 [01:28:23] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.71, 3.59, 3.33 [01:29:03] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.50, 3.84, 3.65 [01:30:34] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.52, 8.24, 8.06 [01:31:03] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.71, 3.09, 3.40 [01:31:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:32:22] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.24, 2.89, 3.11 [01:44:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:49:02] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.42, 3.82, 3.27 [01:50:13] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.15, 4.04, 3.33 [01:50:16] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.60, 10.08, 8.66 [01:51:02] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.67, 3.47, 3.21 [01:52:12] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 7.90, 9.12, 8.48 [01:52:12] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.98, 3.89, 3.36 [01:53:02] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.08, 3.78, 3.35 [01:54:08] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 5.89, 8.26, 8.26 [01:54:12] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.34, 4.44, 3.60 [01:55:02] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.38, 3.56, 3.32 [01:57:02] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.64, 3.30, 3.26 [01:58:10] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.17, 3.84, 3.55 [01:59:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [02:00:10] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.23, 3.94, 3.62 [02:02:09] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.59, 3.63, 3.56 [02:03:11] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.42, 8.38, 7.78 [02:05:31] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.03, 8.66, 7.97 [02:06:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [02:07:28] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.00, 8.44, 7.97 [02:08:56] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.07, 8.40, 8.06 [02:11:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [02:14:04] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.26, 3.06, 3.39 [02:14:42] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.38, 8.90, 8.36 [02:16:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [02:20:12] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.51, 8.23, 7.86 [02:22:01] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.71, 3.58, 3.44 [02:22:08] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.82, 8.22, 7.91 [02:22:22] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.43, 8.39, 8.39 [02:23:34] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.09, 3.47, 3.38 [02:23:42] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.52, 8.26, 8.08 [02:24:00] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.46, 3.19, 3.31 [02:25:30] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.02, 3.06, 3.25 [02:25:42] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.16, 7.83, 7.95 [02:35:14] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.97, 3.58, 3.33 [02:36:26] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.91, 8.59, 8.03 [02:36:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [02:37:11] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.87, 3.36, 3.28 [02:39:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [02:40:26] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.19, 8.29, 8.08 [02:49:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [02:51:07] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.37, 9.07, 8.43 [02:51:11] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.51, 8.14, 7.91 [02:51:48] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.73, 3.26, 3.10 [02:52:13] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.13, 3.43, 3.14 [02:53:47] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.12, 3.29, 3.14 [02:54:12] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.86, 3.19, 3.08 [02:55:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [02:56:56] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.72, 8.38, 8.14 [02:57:45] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.69, 3.48, 3.23 [02:58:50] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.89, 8.01, 8.21 [02:59:44] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.57, 2.74, 2.98 [03:00:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:06:32] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.01, 8.20, 8.01 [03:08:27] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.48, 8.04, 7.98 [03:09:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:11:42] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.14, 8.44, 7.87 [03:14:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:15:31] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.58, 8.34, 8.10 [03:15:42] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.63, 8.07, 7.89 [03:17:26] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.65, 8.21, 8.08 [03:18:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:23:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:30:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:33:55] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.19, 3.50, 2.90 [03:34:29] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.81, 3.62, 3.10 [03:35:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:35:54] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.68, 3.35, 2.93 [03:36:29] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.20, 3.30, 3.03 [03:40:04] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.92, 8.71, 8.05 [03:41:59] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.57, 8.01, 7.86 [03:42:31] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.52, 8.89, 8.29 [03:44:25] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.39, 7.97, 8.02 [03:55:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [04:00:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [04:29:33] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.40, 3.75, 2.70 [04:31:32] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.44, 3.39, 2.68 [04:35:31] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.57, 2.78, 2.63 [04:36:07] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.82, 7.61, 7.20 [04:38:07] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.86, 7.74, 7.31 [04:45:35] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.99, 3.93, 3.16 [04:47:32] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.45, 3.69, 3.16 [04:51:24] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.37, 4.14, 3.39 [04:53:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.63, 3.97, 3.42 [04:55:17] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.34, 3.96, 3.47 [04:56:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [04:58:56] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.82, 4.88, 3.66 [04:59:20] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.38, 4.22, 3.37 [05:01:19] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.50, 3.45, 3.19 [05:01:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:03:18] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.24, 3.10, 3.09 [05:08:52] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.34, 3.84, 3.83 [05:09:03] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.29, 3.76, 3.82 [05:14:50] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.06, 2.81, 3.37 [05:21:02] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.05, 2.99, 3.36 [05:29:03] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.18, 3.68, 3.54 [05:35:02] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.83, 2.90, 3.27 [05:43:38] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.17, 3.46, 3.06 [05:45:37] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.23, 3.33, 3.06 [05:47:03] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.39, 4.02, 3.47 [05:47:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:49:03] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.85, 3.74, 3.45 [05:49:35] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.20, 3.58, 3.31 [05:51:34] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.81, 3.40, 3.27 [05:52:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:53:02] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.73, 2.87, 3.18 [05:57:31] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.40, 3.58, 3.39 [05:58:09] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - dnd.bellinrattin.it All nameservers failed to answer the query. [06:01:29] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.31, 3.31, 3.36 [06:23:54] PROBLEM - mwtask111 Current Load on mwtask111 is WARNING: WARNING - load average: 1.96, 1.54, 1.10 [06:25:54] RECOVERY - mwtask111 Current Load on mwtask111 is OK: OK - load average: 1.46, 1.51, 1.14 [06:26:22] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.53, 3.02, 2.89 [06:27:42] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp21.miraheze.org - CNAME OK [06:28:22] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.73, 2.69, 2.79 [06:47:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.80, 3.12, 2.69 [06:49:02] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.66, 3.67, 2.85 [06:49:13] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.11, 3.12, 2.74 [06:51:03] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.85, 3.50, 2.88 [06:53:02] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.59, 3.18, 2.84 [07:22:59] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.73, 3.84, 3.00 [07:24:58] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.95, 3.41, 2.94 [07:32:55] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.15, 3.30, 3.10 [08:49:54] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.67, 3.45, 2.91 [08:51:50] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.25, 3.06, 2.83 [09:14:14] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.48, 3.74, 2.86 [09:15:08] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.81, 3.50, 2.89 [09:16:13] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.28, 3.62, 2.92 [09:17:04] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.87, 3.60, 3.00 [09:20:12] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.63, 3.23, 2.93 [09:23:02] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.08, 3.18, 3.06 [09:44:29] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.32, 3.40, 2.78 [09:46:29] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.35, 2.98, 2.70 [10:39:03] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.11, 3.73, 2.93 [10:41:02] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.04, 3.64, 3.01 [10:45:02] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.82, 3.38, 3.06 [10:45:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [10:55:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [10:59:30] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.74, 3.28, 2.69 [10:59:54] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 7.14, 4.42, 3.34 [11:00:03] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.18, 3.76, 2.89 [11:02:02] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.70, 3.27, 2.82 [11:03:29] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.09, 3.32, 2.87 [11:03:42] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 86, in check_records cname = str(dns_resolver.resolve(hostname, 'CNAME')[0]) File "/usr/li [11:03:42] 3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query dnd.bellinrattin.it. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [11:10:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [11:11:30] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.38, 3.64, 3.16 [11:11:57] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.13, 3.95, 3.29 [11:13:29] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.71, 3.54, 3.17 [11:13:56] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.57, 3.81, 3.33 [11:15:29] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.41, 3.57, 3.21 [11:15:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [11:15:56] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.35, 3.33, 3.21 [11:17:30] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.61, 3.54, 3.24 [11:19:29] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.75, 3.13, 3.12 [11:29:03] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 1.53, 2.61, 3.74 [11:33:03] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.66, 2.15, 3.30 [11:36:07] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.83, 9.21, 7.99 [11:38:07] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.44, 8.48, 7.87 [11:41:42] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.48, 8.35, 7.54 [11:43:42] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.03, 8.37, 7.66 [11:44:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [11:49:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [12:02:54] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [12:03:42] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp21.miraheze.org - CNAME OK [12:05:24] PROBLEM - mon111 Current Load on mon111 is CRITICAL: CRITICAL - load average: 2.93, 13.61, 8.43 [12:11:19] PROBLEM - mon111 Current Load on mon111 is WARNING: WARNING - load average: 1.50, 4.77, 6.00 [12:12:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.06, 8.49, 7.73 [12:12:54] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [12:14:40] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.20, 7.76, 7.54 [12:15:16] RECOVERY - mon111 Current Load on mon111 is OK: OK - load average: 1.01, 2.66, 4.84 [12:19:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [12:20:34] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.23, 9.30, 8.44 [12:22:34] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.41, 8.39, 8.20 [12:22:58] PROBLEM - mwtask111 Current Load on mwtask111 is CRITICAL: CRITICAL - load average: 2.26, 1.86, 1.35 [12:25:12] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.91, 1.50, 1.09 [12:26:54] PROBLEM - mwtask111 Current Load on mwtask111 is WARNING: WARNING - load average: 1.95, 1.90, 1.49 [12:27:08] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.93, 1.28, 1.06 [12:27:21] PROBLEM - wiki.pixlies.net - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.pixlies.net' expires in 15 day(s) (Sun 10 Apr 2022 12:16:04 GMT +0000). [12:29:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [12:32:34] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.90, 8.19, 8.04 [12:32:52] RECOVERY - mwtask111 Current Load on mwtask111 is OK: OK - load average: 1.37, 1.64, 1.52 [12:33:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [12:34:32] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.83, 8.71, 8.20 [12:34:34] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.65, 8.17, 8.06 [12:36:32] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.70, 9.16, 8.41 [12:37:57] PROBLEM - wildbowiki.net - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wildbowiki.net' expires in 15 day(s) (Sun 10 Apr 2022 12:24:39 GMT +0000). [12:38:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [12:38:32] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.46, 8.38, 8.21 [12:41:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [12:43:32] PROBLEM - wiki.lu9.io - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.lu9.io' expires in 15 day(s) (Sun 10 Apr 2022 12:28:29 GMT +0000). [12:44:27] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.02, 8.02, 7.56 [12:46:26] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.16, 8.76, 7.89 [12:48:24] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.17, 8.33, 7.83 [12:50:34] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.67, 8.25, 8.01 [12:52:52] PROBLEM - mwtask111 Current Load on mwtask111 is CRITICAL: CRITICAL - load average: 2.41, 1.83, 1.58 [12:54:53] PROBLEM - mwtask111 Current Load on mwtask111 is WARNING: WARNING - load average: 1.73, 1.81, 1.61 [12:56:05] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.17, 8.38, 7.82 [12:56:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [12:56:34] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.64, 8.16, 8.10 [12:59:05] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.66, 9.00, 8.49 [12:59:56] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.73, 8.29, 7.93 [13:00:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [13:00:34] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.64, 8.49, 8.24 [13:00:52] RECOVERY - mwtask111 Current Load on mwtask111 is OK: OK - load average: 1.32, 1.58, 1.59 [13:01:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.10, 8.76, 8.48 [13:04:34] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.59, 8.08, 8.14 [13:04:44] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 86, in check_records cname = str(dns_resolver.resolve(hostname, 'CNAME')[0]) File "/usr/li [13:04:44] 3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query dnd.bellinrattin.it. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [13:05:44] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.55, 9.02, 8.29 [13:08:44] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.66, 8.29, 8.41 [13:09:05] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.68, 9.49, 8.68 [13:10:34] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.41, 8.67, 8.34 [13:11:04] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.09, 8.39, 8.40 [13:11:31] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 6.91, 8.52, 8.35 [13:12:34] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.32, 8.07, 8.15 [13:13:27] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.92, 8.04, 8.19 [13:15:32] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.75, 8.94, 8.61 [13:17:28] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.11, 8.27, 8.40 [13:20:34] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.70, 8.23, 8.01 [13:22:34] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 8.25, 7.74, 7.83 [13:25:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [13:29:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [13:32:56] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.06, 8.58, 8.27 [13:33:26] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.31, 9.76, 8.56 [13:34:51] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.17, 8.31, 8.22 [13:36:20] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.33, 8.43, 7.99 [13:38:18] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.98, 8.20, 7.95 [13:38:45] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.18, 8.76, 8.40 [13:39:26] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.42, 9.83, 9.09 [13:40:40] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.61, 9.87, 8.86 [13:43:26] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.16, 10.88, 9.63 [13:44:10] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 14.51, 10.21, 8.69 [13:44:35] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.71, 9.26, 8.26 [13:45:26] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 6.58, 9.60, 9.34 [13:45:47] PROBLEM - mw112 MediaWiki Rendering on mw112 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:45:52] PROBLEM - cp31 Stunnel HTTP for mw112 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:46:33] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.21, 7.98, 7.91 [13:46:52] PROBLEM - cp21 Stunnel HTTP for mw112 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:46:54] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.08, 3.41, 3.09 [13:46:56] PROBLEM - cp20 Stunnel HTTP for mw112 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:47:15] PROBLEM - cp30 Stunnel HTTP for mw112 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:48:32] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.79, 9.99, 9.53 [13:48:48] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.35, 3.39, 3.10 [13:48:54] RECOVERY - cp21 Stunnel HTTP for mw112 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 3.238 second response time [13:48:58] RECOVERY - cp20 Stunnel HTTP for mw112 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 3.905 second response time [13:49:12] RECOVERY - cp30 Stunnel HTTP for mw112 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 0.618 second response time [13:49:53] RECOVERY - mw112 MediaWiki Rendering on mw112 is OK: HTTP OK: HTTP/1.1 200 OK - 22336 bytes in 0.375 second response time [13:49:57] RECOVERY - cp31 Stunnel HTTP for mw112 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 0.314 second response time [13:50:27] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 1.71, 2.28, 1.35 [13:50:42] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.62, 3.34, 3.11 [13:52:04] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 6.37, 9.14, 9.18 [13:52:26] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.03, 1.86, 1.31 [13:52:36] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.44, 4.18, 3.45 [13:53:08] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.29, 3.93, 3.26 [13:54:25] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.48, 1.34, 1.19 [13:54:26] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.00, 8.59, 8.12 [13:54:29] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.49, 3.68, 3.37 [13:55:06] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.09, 3.27, 3.10 [13:55:26] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.78, 7.65, 8.33 [13:56:23] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.02, 3.21, 3.24 [13:58:23] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.88, 8.26, 8.09 [14:00:32] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.95, 9.27, 9.00 [14:00:58] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.05, 3.74, 3.34 [14:01:54] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.64, 7.79, 8.39 [14:02:19] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.74, 8.74, 8.34 [14:02:32] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.95, 9.41, 9.09 [14:02:56] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.41, 3.68, 3.37 [14:03:50] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp21.miraheze.org - CNAME OK [14:04:18] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.59, 9.30, 8.58 [14:04:54] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.01, 4.91, 3.88 [14:06:16] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.66, 8.88, 8.52 [14:06:18] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.50, 3.83, 3.50 [14:06:32] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.58, 9.67, 9.24 [14:06:58] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.29, 3.91, 3.25 [14:08:32] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.65, 9.92, 9.41 [14:08:52] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.33, 3.62, 3.22 [14:10:47] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.94, 2.96, 3.02 [14:10:48] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.47, 3.96, 3.80 [14:12:18] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.61, 2.93, 3.27 [14:14:10] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.35, 8.32, 8.47 [14:14:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [14:14:32] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.78, 9.96, 9.53 [14:16:32] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.69, 9.78, 9.52 [14:16:42] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.77, 2.91, 3.36 [14:21:30] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 7.88, 8.73, 8.45 [14:21:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [14:22:05] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.57, 8.50, 8.45 [14:23:28] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.75, 8.13, 8.25 [14:24:05] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.49, 8.47, 8.45 [14:27:08] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.56, 3.46, 3.10 [14:28:05] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.05, 8.66, 8.55 [14:28:18] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.22, 4.19, 3.51 [14:28:26] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.32, 3.92, 3.49 [14:30:05] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.76, 8.32, 8.44 [14:31:18] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.05, 8.42, 8.24 [14:33:16] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.01, 7.96, 8.10 [14:33:26] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.19, 8.64, 8.14 [14:34:05] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.25, 9.24, 8.83 [14:37:26] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.69, 8.28, 8.13 [14:38:32] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.01, 9.07, 9.03 [14:38:37] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.36, 3.86, 3.65 [14:40:32] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.04, 8.54, 8.84 [14:41:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [14:42:05] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.39, 8.36, 8.50 [14:42:18] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.64, 3.92, 3.93 [14:44:10] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.58, 3.58, 3.89 [14:44:18] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.12, 4.18, 4.03 [14:44:32] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 5.82, 7.75, 8.49 [14:44:37] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.57, 3.02, 3.35 [14:46:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [14:48:18] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.81, 3.81, 3.95 [14:54:01] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.12, 9.41, 8.40 [14:54:04] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.26, 3.47, 3.66 [14:55:56] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.01, 8.82, 8.32 [14:56:04] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.14, 3.44, 3.64 [14:58:18] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.39, 2.86, 3.40 [14:59:47] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.61, 7.95, 8.09 [15:00:05] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.69, 8.68, 8.54 [15:02:04] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.65, 3.05, 3.38 [15:02:05] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 5.84, 7.62, 8.16 [15:04:51] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 86, in check_records cname = str(dns_resolver.resolve(hostname, 'CNAME')[0]) File "/usr/li [15:04:52] 3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query dnd.bellinrattin.it. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [15:06:34] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.46, 8.80, 8.46 [15:10:25] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.96, 8.24, 8.31 [15:20:18] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.84, 4.10, 3.42 [15:21:53] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.99, 8.28, 8.20 [15:25:47] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.68, 8.90, 8.45 [15:25:50] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.73, 9.35, 8.64 [15:26:18] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.82, 3.71, 3.52 [15:27:49] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.43, 9.23, 8.70 [15:28:18] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.72, 3.28, 3.38 [15:29:39] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.06, 8.20, 8.30 [15:31:46] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.71, 9.90, 9.08 [15:34:18] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.09, 3.54, 3.44 [15:34:25] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp20.miraheze.org - CNAME OK [15:37:42] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.26, 9.49, 9.19 [15:38:18] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.05, 3.51, 3.48 [15:39:40] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.45, 9.95, 9.40 [15:39:58] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.27, 8.38, 7.94 [15:41:15] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.58, 8.35, 8.13 [15:41:26] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.45, 8.78, 8.33 [15:41:39] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.40, 9.48, 9.31 [15:42:19] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.02, 3.49, 3.48 [15:43:11] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.34, 8.35, 8.16 [15:43:26] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.82, 8.29, 8.20 [15:43:54] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.06, 9.60, 8.53 [15:45:52] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 7.25, 8.71, 8.35 [15:46:18] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.52, 3.73, 3.61 [15:47:50] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.02, 9.14, 8.53 [15:49:00] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.45, 9.09, 8.49 [15:49:34] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.37, 3.42, 3.07 [15:51:32] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.61, 3.01, 2.96 [15:52:52] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.88, 8.43, 8.36 [15:54:18] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.63, 8.81, 8.44 [15:55:26] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.67, 3.29, 3.06 [15:55:42] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 7.11, 9.28, 9.03 [15:56:45] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.46, 9.29, 8.70 [15:57:24] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.22, 2.97, 2.98 [15:57:40] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.35, 9.74, 9.22 [15:58:18] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.01, 2.79, 3.27 [15:58:41] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.21, 8.64, 8.55 [15:59:38] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.44, 9.31, 9.13 [16:00:05] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.67, 7.87, 8.17 [16:00:36] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.48, 8.30, 8.43 [16:03:23] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.61, 9.38, 9.05 [16:05:21] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.10, 9.32, 9.08 [16:05:53] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 73, in check_records nameserversans = dns_resolver.resolve(root_domain, 'NS') File "/usr/l [16:05:53] n3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query bellinrattin.it. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [16:05:53] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.26, 8.92, 8.49 [16:07:49] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 7.83, 8.56, 8.42 [16:09:00] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.47, 3.74, 3.45 [16:09:44] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 5.81, 7.68, 8.11 [16:10:53] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.73, 3.47, 3.39 [16:11:17] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.51, 9.55, 9.14 [16:11:27] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.80, 7.96, 8.50 [16:11:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [16:12:16] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.69, 9.10, 8.66 [16:14:41] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.66, 4.83, 3.93 [16:14:47] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.45, 3.10, 2.88 [16:15:14] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.95, 9.79, 9.43 [16:16:04] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.74, 3.89, 3.28 [16:16:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [16:16:41] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.02, 3.60, 3.08 [16:18:03] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.35, 9.51, 8.93 [16:18:04] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.17, 3.26, 3.13 [16:18:29] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 1.32, 3.38, 3.58 [16:18:37] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.26, 3.01, 2.92 [16:19:17] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.35, 8.85, 8.53 [16:19:59] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.38, 8.97, 8.80 [16:21:15] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.10, 8.02, 8.26 [16:24:18] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.41, 3.91, 3.75 [16:25:07] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.49, 8.52, 8.66 [16:26:18] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.73, 3.71, 3.69 [16:26:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [16:27:06] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.58, 8.77, 8.72 [16:27:42] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.74, 9.52, 9.04 [16:31:03] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.32, 8.07, 8.48 [16:31:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [16:32:18] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.60, 3.55, 3.55 [16:34:18] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.52, 8.43, 8.00 [16:34:18] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.52, 3.42, 3.49 [16:34:58] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.38, 8.57, 8.66 [16:35:25] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 6.56, 8.97, 9.18 [16:35:26] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - dnd.bellinrattin.it All nameservers failed to answer the query. [16:36:14] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.84, 8.38, 8.05 [16:36:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [16:38:56] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.88, 8.16, 8.47 [16:40:18] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.36, 3.49, 3.45 [16:42:18] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.51, 3.59, 3.50 [16:42:42] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.81, 3.88, 3.36 [16:43:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [16:44:18] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.11, 3.80, 3.57 [16:46:20] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.17, 3.50, 3.48 [16:46:59] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.77, 7.87, 8.48 [16:47:49] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.03, 8.83, 8.29 [16:48:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [16:49:44] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.13, 8.75, 8.31 [16:50:44] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.73, 9.05, 8.76 [16:51:40] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.37, 8.41, 8.25 [16:52:18] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.48, 3.13, 3.35 [16:54:31] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.64, 3.93, 3.73 [16:54:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [16:54:41] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.50, 8.11, 8.43 [16:58:37] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.00, 8.85, 8.68 [16:59:36] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.45, 9.10, 8.75 [17:00:25] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.66, 4.10, 3.77 [17:00:35] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.86, 9.58, 8.97 [17:00:52] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.48, 3.24, 3.12 [17:02:23] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.91, 3.87, 3.72 [17:02:46] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.18, 2.79, 2.96 [17:04:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [17:04:59] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 73, in check_records nameserversans = dns_resolver.resolve(root_domain, 'NS') File "/usr/l [17:04:59] n3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query bellinrattin.it. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [17:05:23] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.87, 8.16, 8.41 [17:06:31] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.61, 9.20, 9.08 [17:08:17] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.29, 3.51, 3.53 [17:09:16] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.91, 8.88, 8.68 [17:09:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [17:09:38] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.64, 3.86, 3.45 [17:10:15] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.97, 3.33, 3.47 [17:11:32] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.04, 3.55, 3.39 [17:12:13] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.14, 3.01, 3.34 [17:13:08] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.75, 7.65, 8.24 [17:13:26] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.27, 3.12, 3.25 [17:14:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [17:16:24] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.88, 8.05, 8.50 [17:20:19] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.40, 9.06, 8.82 [17:22:58] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.85, 3.35, 3.41 [17:24:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [17:24:56] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.73, 3.15, 3.33 [17:26:15] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.35, 7.98, 8.43 [17:28:50] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.03, 3.53, 3.47 [17:30:48] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.09, 3.01, 3.29 [17:34:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [17:34:33] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp21.miraheze.org - CNAME OK [17:36:05] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.55, 8.87, 8.64 [17:38:05] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.31, 8.33, 8.48 [17:40:18] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.59, 3.37, 2.96 [17:41:34] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.63, 4.25, 3.66 [17:42:18] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.88, 3.11, 2.91 [17:43:32] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.01, 3.73, 3.54 [17:46:18] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.91, 3.59, 3.14 [17:46:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [17:47:28] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.98, 4.29, 3.78 [17:48:18] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.48, 3.12, 3.02 [17:51:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [17:53:22] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.57, 3.87, 3.82 [17:57:18] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.22, 4.85, 4.20 [17:57:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [17:58:37] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.35, 4.10, 3.39 [17:59:06] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.18, 4.02, 3.52 [18:00:36] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.10, 3.90, 3.41 [18:00:46] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.45, 8.92, 8.21 [18:01:00] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.61, 3.87, 3.52 [18:01:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.72, 3.93, 3.99 [18:02:42] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.86, 8.34, 8.07 [18:04:26] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.66, 8.79, 7.87 [18:04:37] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.06, 3.36, 3.29 [18:04:47] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.35, 3.35, 3.37 [18:06:05] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.45, 8.52, 8.04 [18:06:21] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 7.43, 8.60, 7.94 [18:06:35] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.32, 8.57, 8.24 [18:08:05] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.12, 9.09, 8.28 [18:08:17] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.73, 8.16, 7.87 [18:08:32] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.01, 8.34, 8.19 [18:09:07] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.91, 3.62, 3.71 [18:12:05] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.08, 9.02, 8.44 [18:13:02] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.93, 3.90, 3.81 [18:20:00] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.73, 3.74, 3.41 [18:20:05] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.68, 8.31, 8.38 [18:20:55] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.13, 2.78, 3.32 [18:21:54] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.90, 3.40, 3.32 [18:22:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [18:22:32] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.01, 8.53, 8.31 [18:22:52] PROBLEM - mwtask111 Current Load on mwtask111 is CRITICAL: CRITICAL - load average: 2.15, 1.74, 1.32 [18:24:32] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.74, 8.12, 8.19 [18:24:52] RECOVERY - mwtask111 Current Load on mwtask111 is OK: OK - load average: 1.52, 1.62, 1.33 [18:25:06] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-3 [+1/-0/±0] 13https://github.com/miraheze/CreateWiki/commit/bc10c82dd349 [18:25:08] [02miraheze/CreateWiki] 07Universal-Omega 03bc10c82 - Create new CreateWikiRegexConstraint class [18:25:09] [02CreateWiki] 07Universal-Omega created branch 03Universal-Omega-patch-3 - 13https://github.com/miraheze/CreateWiki [18:25:11] [02CreateWiki] 07Universal-Omega opened pull request 03#312: Create new CreateWikiRegexConstraint class - 13https://github.com/miraheze/CreateWiki/pull/312 [18:26:37] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.90, 9.03, 8.34 [18:26:46] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.73, 3.25, 3.33 [18:27:31] miraheze/CreateWiki - Universal-Omega the build has errored. [18:28:18] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.42, 3.04, 3.07 [18:28:33] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.21, 9.35, 8.53 [18:29:07] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-3 [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/bc10c82dd349...ab3a3348f6e9 [18:29:08] [02miraheze/CreateWiki] 07Universal-Omega 03ab3a334 - Update SpecialRequestWiki.php [18:29:10] [02CreateWiki] 07Universal-Omega synchronize pull request 03#312: Create new CreateWikiRegexConstraint class - 13https://github.com/miraheze/CreateWiki/pull/312 [18:29:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [18:30:18] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.63, 3.52, 3.22 [18:30:43] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.15, 3.90, 3.55 [18:31:28] miraheze/CreateWiki - Universal-Omega the build has errored. [18:32:24] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.63, 9.57, 8.78 [18:34:18] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.10, 3.32, 3.22 [18:34:39] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.47, 3.91, 3.66 [18:34:55] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-3 [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/ab3a3348f6e9...4c0c56998a24 [18:34:56] [02miraheze/CreateWiki] 07Universal-Omega 034c0c569 - Update mediawiki-tests.yml [18:34:57] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.78, 9.02, 8.38 [18:34:58] [02CreateWiki] 07Universal-Omega synchronize pull request 03#312: Create new CreateWikiRegexConstraint class - 13https://github.com/miraheze/CreateWiki/pull/312 [18:36:15] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 11.05, 10.20, 9.18 [18:36:37] [02miraheze/.github] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/.github/commit/d6338d2566f9 [18:36:39] [02miraheze/.github] 07Universal-Omega 03d6338d2 - CI: use quibble-with-supervisord entrypoint [18:36:40] [02.github] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/.github [18:36:42] [02.github] 07Universal-Omega opened pull request 03#7: CI: use quibble-with-supervisord entrypoint - 13https://github.com/miraheze/.github/pull/7 [18:36:44] [02miraheze/CreateWiki] 07github-actions[bot] pushed 031 commit to 03Universal-Omega-patch-3 [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/4c0c56998a24...81a6e05f9a65 [18:36:45] [02miraheze/CreateWiki] 07github-actions 0381a6e05 - CI: lint code to MediaWiki standards [18:36:47] [02CreateWiki] 07github-actions[bot] synchronize pull request 03#312: Create new CreateWikiRegexConstraint class - 13https://github.com/miraheze/CreateWiki/pull/312 [18:36:49] [02.github] 07Universal-Omega edited pull request 03#7: CI: use `quibble-with-supervisord` entrypoint - 13https://github.com/miraheze/.github/pull/7 [18:37:06] [02.github] 07Universal-Omega edited pull request 03#7: Use `quibble-with-supervisord` entrypoint - 13https://github.com/miraheze/.github/pull/7 [18:37:14] [02.github] 07Universal-Omega edited pull request 03#7: CI: use `quibble-with-supervisord` entrypoint - 13https://github.com/miraheze/.github/pull/7 [18:38:09] [02.github] 07Universal-Omega closed pull request 03#7: CI: use `quibble-with-supervisord` entrypoint - 13https://github.com/miraheze/.github/pull/7 [18:38:10] [02miraheze/.github] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/.github/compare/efab5ba3bb7e...a5cf26ab8c40 [18:38:12] [02miraheze/.github] 07Universal-Omega 03a5cf26a - CI: use `quibble-with-supervisord` entrypoint [18:38:13] [02miraheze/.github] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [18:38:15] [02.github] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/.github [18:38:28] [02miraheze/SpriteSheet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/SpriteSheet/compare/09674d16f4e8...ebeda3312a3f [18:38:29] [02miraheze/SpriteSheet] 07Universal-Omega 03ebeda33 - Update workflow [18:38:31] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/0b477c9c532c...589443ec26be [18:38:32] [02miraheze/MirahezeMagic] 07Universal-Omega 03589443e - Update workflow [18:38:34] [02miraheze/RemovePII] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/RemovePII/compare/ffc34b130f12...e0680542e3a8 [18:38:35] [02miraheze/RemovePII] 07Universal-Omega 03e068054 - Update workflow [18:38:37] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/0911307cb99a...bd9141d827de [18:38:37] miraheze/CreateWiki - Universal-Omega the build has errored. [18:38:38] [02miraheze/ManageWiki] 07Universal-Omega 03bd9141d - Update workflow [18:38:40] [02miraheze/CustomHeader] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/CustomHeader/compare/a147a82d6582...ba41ba693e80 [18:38:41] [02miraheze/CustomHeader] 07Universal-Omega 03ba41ba6 - Update workflow [18:38:43] [02miraheze/GlobalNewFiles] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/GlobalNewFiles/compare/e992e833b181...94a76e414286 [18:38:44] [02miraheze/GlobalNewFiles] 07Universal-Omega 0394a76e4 - Update workflow [18:38:46] [02miraheze/WikiDiscover] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/WikiDiscover/compare/795a48959261...9da3832cc620 [18:38:47] [02miraheze/WikiDiscover] 07Universal-Omega 039da3832 - Update workflow [18:38:49] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/b738d13cf023...843f871b98d5 [18:38:50] [02miraheze/CreateWiki] 07Universal-Omega 03843f871 - Update workflow [18:38:52] [02miraheze/PDFEmbed] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/PDFEmbed/compare/a385a0a7d6f2...ec357ab46f78 [18:38:53] [02miraheze/PDFEmbed] 07Universal-Omega 03ec357ab - Update workflow [18:38:55] [02miraheze/DataDump] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/DataDump/compare/c11b01e1da4e...22880cc40481 [18:38:56] [02miraheze/DataDump] 07Universal-Omega 0322880cc - Update workflow [18:38:58] [02miraheze/RottenLinks] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/RottenLinks/compare/6f6f99dabb74...5d3589b84ab1 [18:38:59] [02miraheze/RottenLinks] 07Universal-Omega 035d3589b - Update workflow [18:39:01] [02miraheze/IncidentReporting] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/IncidentReporting/compare/42b131ee59ed...be76a9139d17 [18:39:02] [02miraheze/IncidentReporting] 07Universal-Omega 03be76a91 - Update workflow [18:39:04] [02miraheze/MatomoAnalytics] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/MatomoAnalytics/compare/1d16d208d053...091931358bc5 [18:39:05] [02miraheze/MatomoAnalytics] 07Universal-Omega 030919313 - Update workflow [18:39:07] [02miraheze/YouTube] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/YouTube/compare/13540ef742a1...3e15254b1858 [18:39:08] [02miraheze/YouTube] 07Universal-Omega 033e15254 - Update workflow [18:40:06] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 7.20, 9.41, 9.14 [18:40:33] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.76, 2.92, 3.35 [18:40:53] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.79, 8.44, 8.40 [18:42:03] [02CreateWiki] 07Universal-Omega synchronize pull request 03#312: Create new CreateWikiRegexConstraint class - 13https://github.com/miraheze/CreateWiki/pull/312 [18:42:04] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-3 [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/81a6e05f9a65...2f0861e67718 [18:42:06] [02miraheze/CreateWiki] 07Universal-Omega 032f0861e - Update CreateWikiRegexConstraint.php [18:43:21] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.93, 8.85, 8.53 [18:44:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [18:47:48] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.14, 7.25, 8.25 [18:49:08] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.75, 8.32, 8.42 [18:49:54] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.82, 8.98, 8.21 [18:50:44] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.57, 8.64, 8.35 [18:51:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [18:52:52] PROBLEM - mwtask111 Current Load on mwtask111 is CRITICAL: CRITICAL - load average: 2.24, 1.75, 1.51 [18:53:50] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 5.32, 7.84, 7.99 [18:54:52] RECOVERY - mwtask111 Current Load on mwtask111 is OK: OK - load average: 1.56, 1.68, 1.52 [18:55:49] miraheze/SpriteSheet - Universal-Omega the build passed. [18:56:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [18:56:40] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.22, 8.24, 8.28 [18:59:26] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.50, 8.59, 8.36 [18:59:42] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.66, 8.61, 8.29 [19:00:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [19:01:40] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 8.04, 8.32, 8.22 [19:04:31] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.49, 9.73, 8.85 [19:05:26] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 11.95, 10.20, 9.03 [19:05:35] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.05, 9.01, 8.53 [19:06:30] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.24, 9.42, 8.84 [19:07:26] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.62, 9.54, 8.91 [19:08:48] miraheze/RemovePII - Universal-Omega the build passed. [19:08:49] miraheze/GlobalNewFiles - Universal-Omega the build passed. [19:08:56] miraheze/PDFEmbed - Universal-Omega the build passed. [19:09:03] miraheze/ManageWiki - Universal-Omega the build passed. [19:09:04] miraheze/DataDump - Universal-Omega the build passed. [19:09:25] miraheze/YouTube - Universal-Omega the build passed. [19:09:28] miraheze/CustomHeader - Universal-Omega the build passed. [19:09:31] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.17, 9.17, 8.67 [19:09:34] miraheze/RottenLinks - Universal-Omega the build passed. [19:09:44] miraheze/WikiDiscover - Universal-Omega the build passed. [19:10:12] miraheze/IncidentReporting - Universal-Omega the build passed. [19:10:25] miraheze/MatomoAnalytics - Universal-Omega the build passed. [19:12:32] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.06, 8.80, 8.38 [19:13:18] miraheze/MirahezeMagic - Universal-Omega the build passed. [19:13:27] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.78, 9.93, 9.12 [19:15:03] miraheze/CreateWiki - Universal-Omega the build passed. [19:15:25] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.46, 10.05, 9.25 [19:15:26] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.78, 8.10, 8.47 [19:16:32] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.90, 9.44, 8.74 [19:17:23] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.35, 9.62, 9.18 [19:18:32] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.78, 9.77, 8.94 [19:19:21] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.65, 10.25, 9.45 [19:20:32] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.93, 9.32, 8.87 [19:21:19] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.22, 9.75, 9.37 [19:21:50] miraheze/CreateWiki - Universal-Omega the build passed. [19:24:32] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.81, 9.36, 8.92 [19:25:26] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.37, 8.54, 8.36 [19:26:15] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.68, 9.38, 8.99 [19:27:26] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.07, 7.98, 8.18 [19:28:14] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.77, 9.20, 8.96 [19:32:32] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.23, 9.59, 9.35 [19:34:10] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.60, 9.55, 9.14 [19:35:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [19:36:08] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.54, 8.85, 8.94 [19:39:01] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.93, 7.65, 8.37 [19:44:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [19:46:05] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.95, 8.08, 8.48 [19:48:53] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.69, 3.46, 3.05 [19:49:47] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.82, 8.91, 8.52 [19:50:47] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.63, 3.89, 3.25 [19:52:37] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.31, 3.60, 3.02 [19:54:22] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 3.74, 4.23, 3.54 [19:54:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [19:54:37] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.65, 3.31, 2.99 [19:55:41] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.29, 9.21, 8.73 [19:56:20] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.21, 3.54, 3.37 [19:57:39] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.85, 9.14, 8.75 [19:58:23] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.98, 3.35, 3.40 [19:58:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [20:00:05] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.76, 8.63, 8.53 [20:00:17] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 8.85, 5.32, 4.05 [20:04:05] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.17, 9.96, 9.09 [20:04:32] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.71, 9.19, 8.89 [20:05:04] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.66, 8.37, 7.81 [20:05:33] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.86, 7.90, 8.36 [20:06:05] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.06, 9.56, 9.05 [20:06:08] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - dnd.bellinrattin.it All nameservers failed to answer the query. [20:06:32] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.56, 9.01, 8.87 [20:08:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [20:08:55] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.09, 8.23, 7.89 [20:10:32] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.76, 9.81, 9.15 [20:12:32] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.63, 9.91, 9.29 [20:14:04] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.59, 3.74, 3.89 [20:14:43] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.68, 8.57, 8.15 [20:16:04] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.68, 4.10, 4.00 [20:16:32] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.46, 9.40, 9.15 [20:16:38] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.18, 7.67, 7.87 [20:18:32] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.33, 9.15, 9.08 [20:19:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [20:20:04] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.85, 3.79, 3.91 [20:20:19] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.33, 8.88, 8.63 [20:22:04] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.15, 4.36, 4.11 [20:22:17] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.62, 9.25, 8.77 [20:24:16] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 7.48, 8.50, 8.55 [20:26:05] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.62, 9.38, 9.11 [20:26:32] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.45, 9.41, 9.08 [20:28:12] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.10, 9.42, 8.91 [20:28:32] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.63, 9.54, 9.18 [20:30:09] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.04, 9.10, 8.87 [20:35:42] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp21.miraheze.org - CNAME OK [20:36:32] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.46, 8.01, 8.46 [20:37:04] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.06, 9.12, 8.60 [20:38:04] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 1.76, 3.19, 3.90 [20:38:05] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 6.76, 9.14, 9.30 [20:40:55] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.83, 8.35, 8.44 [20:41:58] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.44, 7.96, 8.46 [20:42:05] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.23, 9.34, 9.33 [20:44:04] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.92, 3.45, 3.69 [20:44:05] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.21, 9.09, 9.23 [20:46:04] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.87, 3.42, 3.64 [20:48:04] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.92, 4.47, 4.01 [20:50:04] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.77, 3.84, 3.84 [20:52:30] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.66, 9.01, 8.58 [20:53:06] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.19, 4.03, 3.42 [20:55:00] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.22, 3.66, 3.34 [20:56:04] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.34, 2.70, 3.32 [20:56:21] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.95, 8.26, 8.36 [20:57:17] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.68, 9.12, 8.53 [20:59:13] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.32, 8.88, 8.53 [20:59:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [21:00:04] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.61, 3.44, 3.51 [21:00:13] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.73, 9.12, 8.69 [21:00:41] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.29, 4.28, 3.65 [21:02:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [21:02:34] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 7.60, 8.51, 8.40 [21:02:35] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.83, 3.95, 3.59 [21:04:04] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.53, 7.94, 8.32 [21:04:05] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.12, 9.97, 9.16 [21:04:34] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.79, 8.28, 8.33 [21:06:04] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.27, 3.82, 3.65 [21:06:05] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.70, 9.12, 8.93 [21:06:23] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.81, 4.18, 3.75 [21:06:55] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.72, 8.30, 8.47 [21:08:04] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.73, 3.55, 3.58 [21:08:18] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.25, 3.96, 3.73 [21:10:05] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.44, 9.19, 8.96 [21:10:18] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.14, 3.88, 3.71 [21:10:49] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.68, 9.76, 9.01 [21:12:05] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.88, 8.53, 8.73 [21:12:18] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.11, 3.72, 3.68 [21:12:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.70, 9.38, 8.97 [21:14:18] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.09, 3.78, 3.70 [21:16:04] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.91, 3.09, 3.32 [21:18:34] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.12, 8.57, 8.34 [21:19:25] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.60, 4.08, 3.33 [21:20:04] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.27, 3.80, 3.56 [21:20:05] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.27, 7.99, 8.41 [21:20:18] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.52, 3.72, 3.79 [21:21:12] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-3 [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/2f0861e67718...f28b80c2a684 [21:21:13] [02miraheze/CreateWiki] 07Universal-Omega 03f28b80c - Update CreateWikiRegexConstraint.php [21:21:15] [02CreateWiki] 07Universal-Omega synchronize pull request 03#312: Create new CreateWikiRegexConstraint class - 13https://github.com/miraheze/CreateWiki/pull/312 [21:22:18] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.34, 4.14, 3.94 [21:22:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [21:24:04] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.71, 3.99, 3.69 [21:24:05] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.49, 8.75, 8.67 [21:24:18] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.68, 3.99, 3.91 [21:24:32] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.36, 8.91, 8.86 [21:24:34] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.67, 8.23, 8.34 [21:25:28] miraheze/CreateWiki - Universal-Omega the build has errored. [21:25:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [21:25:35] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-3 [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/f28b80c2a684...7a2b75c412df [21:25:37] [02miraheze/CreateWiki] 07Universal-Omega 037a2b75c - Update RequestWikiAIJob.php [21:25:38] [02CreateWiki] 07Universal-Omega synchronize pull request 03#312: Create new CreateWikiRegexConstraint class - 13https://github.com/miraheze/CreateWiki/pull/312 [21:26:18] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.09, 4.22, 4.01 [21:28:32] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.61, 8.88, 8.86 [21:28:34] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.91, 9.31, 8.72 [21:30:04] miraheze/CreateWiki - Universal-Omega the build has errored. [21:30:04] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.14, 3.69, 3.60 [21:30:05] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.37, 8.27, 8.46 [21:32:04] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.24, 3.27, 3.45 [21:32:34] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.25, 9.20, 8.83 [21:34:04] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.06, 3.70, 3.56 [21:34:34] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.44, 9.18, 8.84 [21:35:00] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-3 [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/7a2b75c412df...9ab23d1bb59f [21:35:02] [02miraheze/CreateWiki] 07Universal-Omega 039ab23d1 - Update CreateWikiRegexConstraint.php [21:35:03] [02CreateWiki] 07Universal-Omega synchronize pull request 03#312: Create new CreateWikiRegexConstraint class - 13https://github.com/miraheze/CreateWiki/pull/312 [21:36:04] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.10, 3.46, 3.49 [21:38:04] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.02, 3.59, 3.53 [21:38:05] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.50, 8.67, 8.61 [21:38:31] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-3 [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/9ab23d1bb59f...026c2cf535ab [21:38:32] [02miraheze/CreateWiki] 07Universal-Omega 03026c2cf - Update RequestWikiAIJob.php [21:38:34] [02CreateWiki] 07Universal-Omega synchronize pull request 03#312: Create new CreateWikiRegexConstraint class - 13https://github.com/miraheze/CreateWiki/pull/312 [21:38:34] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.12, 9.30, 8.99 [21:39:11] miraheze/CreateWiki - Universal-Omega the build has errored. [21:40:04] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.01, 3.39, 3.47 [21:40:18] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.53, 3.70, 3.99 [21:40:36] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.66, 3.63, 3.95 [21:41:26] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-3 [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/026c2cf535ab...d8e650697749 [21:41:28] [02miraheze/CreateWiki] 07Universal-Omega 03d8e6506 - Update WikiRequest.php [21:41:29] [02CreateWiki] 07Universal-Omega synchronize pull request 03#312: Create new CreateWikiRegexConstraint class - 13https://github.com/miraheze/CreateWiki/pull/312 [21:42:04] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.87, 2.94, 3.30 [21:44:34] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.53, 8.00, 8.47 [21:45:11] miraheze/CreateWiki - Universal-Omega the build has errored. [21:45:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [21:46:37] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.17, 2.54, 3.33 [21:49:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [21:50:05] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.51, 7.74, 8.36 [21:50:34] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.94, 8.44, 8.40 [21:52:18] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.30, 3.31, 3.50 [21:52:21] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.92, 8.45, 7.92 [21:52:32] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.75, 7.82, 8.44 [21:52:34] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 8.05, 8.18, 8.30 [21:56:12] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.82, 8.00, 7.91 [21:56:18] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.88, 2.75, 3.24 [21:59:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [22:02:00] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.61, 8.64, 8.21 [22:03:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [22:05:52] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.22, 7.64, 7.93 [22:07:46] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.87, 3.92, 3.36 [22:08:18] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.57, 3.42, 3.22 [22:08:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [22:09:44] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.45, 3.50, 3.26 [22:11:17] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.55, 8.68, 8.45 [22:11:42] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.70, 3.17, 3.17 [22:12:18] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.40, 3.17, 3.18 [22:13:13] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.05, 8.24, 8.32 [22:20:57] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.15, 8.42, 8.20 [22:22:53] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.75, 7.89, 8.04 [22:28:47] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.15, 8.43, 8.05 [22:30:46] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.24, 8.40, 8.09 [22:31:26] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.31, 8.56, 7.91 [22:33:26] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.67, 7.87, 7.74 [22:35:28] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.91, 8.18, 8.04 [22:36:47] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - dnd.bellinrattin.it All nameservers failed to answer the query. [22:37:24] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.25, 7.50, 7.82 [22:38:09] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-3 [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/d8e650697749...09bbc2d32968 [22:38:11] [02miraheze/CreateWiki] 07Universal-Omega 0309bbc2d - Update CreateWikiRegexConstraint.php [22:38:12] [02CreateWiki] 07Universal-Omega synchronize pull request 03#312: Create new CreateWikiRegexConstraint class - 13https://github.com/miraheze/CreateWiki/pull/312 [22:39:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [22:42:46] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.68, 8.51, 8.03 [22:43:13] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.79, 9.10, 8.40 [22:44:44] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.42, 8.03, 7.90 [22:46:31] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.07, 8.53, 8.31 [22:48:30] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.85, 8.14, 8.18 [22:49:00] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.77, 8.21, 8.24 [22:49:44] miraheze/CreateWiki - Universal-Omega the build passed. [22:50:36] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.89, 8.53, 8.14 [22:52:34] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.59, 8.35, 8.13 [22:54:24] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.82, 8.53, 8.37 [22:54:27] [02CreateWiki] 07Universal-Omega edited pull request 03#312: Create new CreateWikiRegexConstraint class - 13https://github.com/miraheze/CreateWiki/pull/312 [22:54:47] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.03, 3.53, 3.37 [22:56:34] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.23, 8.83, 8.44 [22:56:41] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.29, 3.09, 3.22 [22:59:11] [02miraheze/CreateWiki] 07Universal-Omega pushed 032 commits to 03Universal-Omega-patch-3 [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/09bbc2d32968...c9d14d7b2499 [22:59:12] [02miraheze/CreateWiki] 07Universal-Omega 03c9d14d7 - Merge branch 'master' into Universal-Omega-patch-3 [22:59:14] [02CreateWiki] 07Universal-Omega synchronize pull request 03#312: Create new CreateWikiRegexConstraint class - 13https://github.com/miraheze/CreateWiki/pull/312 [23:00:01] !log [@test101] starting deploy of {'l10nupdate': True} to all [23:00:06] !log [@mwtask111] starting deploy of {'l10nupdate': True} to all [23:00:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:00:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:00:34] [02miraheze/RemovePII] 07Universal-Omega pushed 034 commits to 03Universal-Omega-patch-1 [+0/-0/±4] 13https://github.com/miraheze/RemovePII/compare/57497a23a7cf...08f44b35af7a [23:00:34] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.12, 8.28, 8.34 [23:00:35] [02miraheze/RemovePII] 07Universal-Omega 0308f44b3 - Merge branch 'master' into Universal-Omega-patch-1 [23:00:37] [02RemovePII] 07Universal-Omega synchronize pull request 03#54: Always guarantee realname is removed - 13https://github.com/miraheze/RemovePII/pull/54 [23:01:12] [02miraheze/RemovePII] 07Universal-Omega pushed 036 commits to 031_38-support [+0/-0/±7] 13https://github.com/miraheze/RemovePII/compare/74cf8ac132dc...98b8070d1301 [23:01:13] [02miraheze/RemovePII] 07Universal-Omega 0398b8070 - Merge branch 'master' into 1_38-support [23:01:14] [02RemovePII] 07Universal-Omega synchronize pull request 03#53: Add 1.38 support - 13https://github.com/miraheze/RemovePII/pull/53 [23:02:55] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 0325 commits to 03RhinosF1-patch-1 [+12/-0/±108] 13https://github.com/miraheze/MirahezeMagic/compare/6e325dac07cf...71e04ba79eef [23:02:56] [02miraheze/MirahezeMagic] 07Universal-Omega 0371e04ba - Merge branch 'master' into RhinosF1-patch-1 [23:02:58] [02MirahezeMagic] 07Universal-Omega synchronize pull request 03#313: Recaptcha: use enterprise version - 13https://github.com/miraheze/MirahezeMagic/pull/313 [23:04:24] [02miraheze/ManageWiki] 07Universal-Omega pushed 0311 commits to 03Universal-Omega-patch-1 [+0/-0/±19] 13https://github.com/miraheze/ManageWiki/compare/3f8f4e6380b6...6aebce92c6ab [23:04:25] [02miraheze/ManageWiki] 07Universal-Omega 036aebce9 - Merge branch 'master' into Universal-Omega-patch-1 [23:04:27] [02ManageWiki] 07Universal-Omega synchronize pull request 03#345: Remove deprecated class alias - 13https://github.com/miraheze/ManageWiki/pull/345 [23:04:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [23:06:15] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 5.82, 7.93, 8.34 [23:06:20] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp20.miraheze.org - CNAME OK [23:07:12] miraheze/RemovePII - Universal-Omega the build passed. [23:10:26] [02miraheze/RemovePII] 07Universal-Omega pushed 031 commit to 031_38-support [+0/-0/±1] 13https://github.com/miraheze/RemovePII/compare/98b8070d1301...9e68de0ad2e7 [23:10:27] [02miraheze/RemovePII] 07Universal-Omega 039e68de0 - Update SpecialRemovePII.php [23:10:29] [02RemovePII] 07Universal-Omega synchronize pull request 03#53: Add 1.38 support - 13https://github.com/miraheze/RemovePII/pull/53 [23:13:04] [02miraheze/RemovePII] 07Universal-Omega pushed 031 commit to 031_38-support [+0/-0/±1] 13https://github.com/miraheze/RemovePII/compare/9e68de0ad2e7...229c4f92fdb3 [23:13:06] [02miraheze/RemovePII] 07Universal-Omega 03229c4f9 - Update SpecialRemovePII.php [23:13:07] [02RemovePII] 07Universal-Omega synchronize pull request 03#53: Add 1.38 support - 13https://github.com/miraheze/RemovePII/pull/53 [23:13:48] miraheze/ManageWiki - Universal-Omega the build passed. [23:15:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [23:16:22] miraheze/MirahezeMagic - Universal-Omega the build has errored. [23:16:40] miraheze/RemovePII - Universal-Omega the build passed. [23:17:01] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-4 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/c5ffa48e6eff [23:17:03] [02miraheze/mw-config] 07Universal-Omega 03c5ffa48 - Disallow `centralauth-suppress` right in ManageWiki [23:17:04] [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-4 - 13https://github.com/miraheze/mw-config [23:17:06] [02mw-config] 07Universal-Omega opened pull request 03#4522: Disallow `centralauth-suppress` right in ManageWiki - 13https://github.com/miraheze/mw-config/pull/4522 [23:18:15] miraheze/mw-config - Universal-Omega the build passed. [23:19:32] !log [@test101] finished deploy of {'l10nupdate': True} to all - SUCCESS in 1170s [23:19:40] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.86, 1.46, 0.88 [23:19:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:20:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [23:21:40] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 0.42, 1.06, 0.81 [23:23:20] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.92, 3.99, 3.59 [23:23:51] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.32, 8.60, 8.45 [23:24:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [23:25:46] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.92, 7.75, 8.14 [23:27:13] !log [@mwtask111] finished deploy of {'l10nupdate': True} to all - SUCCESS in 1627s [23:27:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:30:56] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.93, 3.18, 3.36 [23:34:37] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.12, 3.55, 3.03 [23:36:37] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.87, 3.22, 2.97 [23:39:28] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.73, 3.97, 3.57 [23:39:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [23:41:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.13, 3.67, 3.51 [23:43:16] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.94, 3.34, 3.40 [23:46:39] [02CreateWiki] 07lens0021 reviewed pull request 03#312 commit - 13https://github.com/miraheze/CreateWiki/pull/312#discussion_r835665960 [23:46:41] [02CreateWiki] 07lens0021 reviewed pull request 03#312 commit - 13https://github.com/miraheze/CreateWiki/pull/312#discussion_r835666160 [23:46:42] [02CreateWiki] 07lens0021 reviewed pull request 03#312 commit - 13https://github.com/miraheze/CreateWiki/pull/312#discussion_r835663479 [23:46:44] [02CreateWiki] 07lens0021 reviewed pull request 03#312 commit - 13https://github.com/miraheze/CreateWiki/pull/312#discussion_r835667531 [23:47:19] PROBLEM - matomo101 Disk Space on matomo101 is WARNING: DISK WARNING - free space: / 1036 MB (10% inode=80%); [23:50:01] [02CreateWiki] 07lens0021 reviewed pull request 03#312 commit - 13https://github.com/miraheze/CreateWiki/pull/312#discussion_r835666160 [23:59:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki