[00:00:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.62, 3.49, 3.52 [00:00:14] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.32, 4.24, 3.71 [00:01:32] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 3.85, 4.16, 3.89 [00:02:11] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.30, 1.86, 1.56 [00:02:12] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.75, 10.70, 10.25 [00:03:17] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.43, 6.43, 6.47 [00:03:32] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.54, 4.00, 3.87 [00:04:10] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.09, 1.66, 1.53 [00:04:12] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 9.06, 9.88, 9.99 [00:04:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.12, 3.71, 3.62 [00:04:44] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.61, 1.86, 1.95 [00:05:32] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.91, 4.43, 4.02 [00:05:56] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.45, 11.78, 11.22 [00:06:07] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.94, 4.42, 3.90 [00:06:14] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.71, 4.27, 3.84 [00:07:56] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.71, 10.59, 10.85 [00:08:05] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.86, 1.73, 1.58 [00:10:03] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.15, 1.56, 1.53 [00:16:44] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.12, 1.79, 1.84 [00:17:56] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.53, 9.30, 10.06 [00:18:32] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk [00:21:33] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.74, 8.89, 8.28 [00:23:27] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.86, 8.54, 8.23 [00:32:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.36, 3.53, 3.99 [00:32:19] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query dnd.bellinrattin.it. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [00:33:40] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.18, 1.95, 1.60 [00:35:39] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.96, 1.53, 1.48 [00:38:14] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.21, 3.78, 3.92 [00:40:31] PROBLEM - es101 Current Load on es101 is WARNING: WARNING - load average: 3.45, 3.09, 2.58 [00:42:31] PROBLEM - es101 Current Load on es101 is CRITICAL: CRITICAL - load average: 4.23, 3.50, 2.80 [00:43:19] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 5.18, 3.48, 2.16 [00:44:31] PROBLEM - es101 Current Load on es101 is WARNING: WARNING - load average: 3.29, 3.46, 2.88 [00:44:44] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.64, 1.81, 1.96 [00:45:19] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 1.93, 2.81, 2.07 [00:46:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.69, 3.60, 3.87 [00:46:31] RECOVERY - es101 Current Load on es101 is OK: OK - load average: 3.27, 3.38, 2.91 [00:48:44] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.78, 2.19, 2.07 [00:50:14] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.52, 3.68, 3.81 [00:54:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.83, 3.63, 3.79 [00:56:44] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.58, 1.88, 2.00 [00:59:18] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.26, 1.73, 1.59 [01:00:12] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.06, 9.88, 9.06 [01:00:14] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.09, 3.75, 3.75 [01:01:22] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp20.miraheze.org - CNAME OK [01:02:12] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 13.99, 11.38, 9.72 [01:02:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.35, 3.22, 3.56 [01:03:15] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.40, 1.85, 1.65 [01:04:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.07, 3.18, 3.87 [01:04:12] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.81, 10.44, 9.58 [01:04:14] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.83, 2.81, 3.37 [01:05:13] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.37, 1.61, 1.58 [01:05:32] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.87, 3.33, 3.92 [01:06:12] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.90, 9.56, 9.36 [01:16:07] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.05, 2.80, 3.37 [01:16:44] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.31, 1.89, 1.87 [01:17:32] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.78, 2.87, 3.37 [01:20:58] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.71, 1.51, 1.42 [01:23:32] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.25, 3.67, 3.53 [01:24:41] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.51, 10.57, 10.05 [01:24:44] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.82, 2.00, 1.99 [01:24:55] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.94, 1.42, 1.42 [01:25:32] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.79, 3.23, 3.38 [01:30:36] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.57, 3.58, 3.41 [01:32:31] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.94, 3.06, 3.25 [01:34:19] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.62, 10.06, 10.06 [01:34:53] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.44, 3.35, 3.07 [01:36:49] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.87, 3.33, 3.10 [01:38:15] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.83, 3.79, 3.50 [01:40:10] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.52, 3.83, 3.53 [01:40:44] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.13, 1.84, 1.83 [01:42:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.47, 3.69, 3.52 [01:42:44] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.68, 1.80, 1.81 [01:45:57] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.06, 6.91, 6.13 [01:46:07] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.23, 3.35, 3.40 [01:46:44] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.30, 1.93, 1.85 [01:47:53] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 6.79, 6.71, 6.14 [01:50:07] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.52, 3.80, 3.55 [01:51:24] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.83, 3.82, 3.43 [01:52:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.93, 3.56, 3.51 [01:52:10] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.07, 3.44, 3.31 [01:55:16] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.47, 4.11, 3.59 [01:56:02] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.92, 4.19, 3.63 [01:56:07] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.02, 3.78, 3.60 [01:56:44] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.53, 1.86, 1.94 [01:58:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.13, 3.25, 3.44 [01:59:09] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.08, 3.85, 3.63 [02:00:07] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.36, 3.08, 3.36 [02:03:46] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.52, 3.70, 3.74 [02:04:44] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.15, 2.00, 1.96 [02:04:57] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.27, 3.79, 3.64 [02:06:44] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.84, 1.96, 1.95 [02:07:39] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.27, 4.21, 3.91 [02:08:44] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.06, 2.01, 1.97 [02:10:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.90, 3.83, 3.52 [02:10:30] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.09, 2.10, 1.67 [02:10:45] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.58, 3.40, 3.55 [02:12:07] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.92, 3.22, 3.34 [02:12:09] PROBLEM - bast101 NTP time on bast101 is CRITICAL: NTP CRITICAL: Offset 0.6051762402 secs [02:12:44] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.80, 1.98, 1.98 [02:13:35] PROBLEM - bast121 NTP time on bast121 is CRITICAL: NTP CRITICAL: Offset 0.6052296758 secs [02:14:26] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.38, 1.81, 1.65 [02:16:07] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.03, 4.27, 3.73 [02:16:25] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.22, 1.96, 1.72 [02:18:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.42, 3.88, 3.65 [02:18:09] RECOVERY - bast101 NTP time on bast101 is OK: NTP OK: Offset 0.001177072525 secs [02:18:44] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.95, 2.28, 2.07 [02:19:35] RECOVERY - bast121 NTP time on bast121 is OK: NTP OK: Offset 0.001228451729 secs [02:20:26] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.40, 3.10, 3.40 [02:20:49] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.22, 1.82, 1.40 [02:22:47] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.37, 1.65, 1.39 [02:24:07] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.61, 4.22, 3.77 [02:24:21] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.85, 3.73, 3.59 [02:25:32] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.59, 3.69, 3.95 [02:26:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.90, 3.70, 3.63 [02:27:32] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.42, 4.33, 4.12 [02:28:07] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.72, 4.49, 3.93 [02:28:14] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.53, 4.14, 3.74 [02:28:15] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.86, 1.68, 1.79 [02:30:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.45, 4.00, 3.82 [02:30:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.18, 3.33, 3.49 [02:31:32] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.61, 3.65, 3.93 [02:32:07] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 7.32, 4.96, 4.16 [02:32:12] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.92, 1.35, 1.64 [02:32:14] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.82, 3.72, 3.59 [02:33:32] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.33, 4.61, 4.29 [02:34:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.34, 3.41, 3.49 [02:34:44] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.83, 1.77, 1.96 [02:36:14] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.15, 3.19, 3.39 [02:39:32] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.36, 3.48, 3.89 [02:40:44] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.12, 1.85, 1.93 [02:42:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.58, 3.39, 3.72 [02:42:44] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.65, 1.75, 1.88 [02:46:07] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.48, 3.62, 3.71 [02:46:57] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.23, 1.72, 1.65 [02:48:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.47, 3.37, 3.62 [02:48:45] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.15, 1.84, 1.86 [02:48:55] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.04, 1.54, 1.60 [02:49:32] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.17, 3.68, 3.82 [02:51:32] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.69, 3.79, 3.85 [02:53:32] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.14, 4.24, 4.00 [02:56:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.35, 3.46, 3.38 [02:56:17] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.57, 10.33, 9.56 [02:58:13] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.78, 10.09, 9.56 [02:58:44] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.49, 1.90, 1.95 [03:00:14] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.64, 3.14, 3.28 [03:00:33] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query bellinrattin.it. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [03:04:07] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.05, 3.02, 3.37 [03:05:32] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.27, 3.72, 3.95 [03:05:57] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.77, 10.91, 10.12 [03:09:56] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.92, 10.01, 9.95 [03:12:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.30, 3.60, 3.54 [03:14:07] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.82, 4.10, 3.73 [03:14:53] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.61, 3.46, 3.27 [03:15:32] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.30, 4.27, 3.99 [03:16:44] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.05, 1.70, 1.76 [03:16:49] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.06, 3.28, 3.22 [03:18:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.12, 3.82, 3.73 [03:19:29] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.50, 7.25, 6.47 [03:19:32] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.16, 3.93, 3.93 [03:21:26] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.97, 6.86, 6.40 [03:23:22] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 6.22, 6.61, 6.36 [03:23:32] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.09, 3.81, 3.86 [03:23:35] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 4.08, 2.30, 1.72 [03:24:07] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.73, 4.60, 4.01 [03:25:34] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.36, 1.79, 1.60 [03:26:33] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 3.98, 4.33, 3.73 [03:27:17] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.87, 6.94, 6.56 [03:27:34] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.04, 1.54, 1.52 [03:28:44] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.69, 1.87, 1.92 [03:29:36] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp20.miraheze.org - CNAME OK [03:31:10] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 6.01, 6.48, 6.46 [03:32:12] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.90, 9.48, 8.35 [03:32:21] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.77, 3.78, 3.72 [03:34:12] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.06, 8.99, 8.31 [03:37:32] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 1.94, 3.43, 3.92 [03:38:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.43, 3.67, 3.95 [03:38:14] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.26, 3.99, 3.79 [03:39:32] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 3.91, 3.96, 4.07 [03:40:07] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.36, 3.88, 3.98 [03:42:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.16, 3.53, 3.84 [03:42:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.68, 3.56, 3.67 [03:43:32] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.79, 3.42, 3.83 [03:44:07] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.65, 3.82, 3.89 [03:44:44] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.02, 1.77, 1.78 [03:46:44] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.96, 1.82, 1.80 [03:48:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.72, 3.89, 3.92 [03:48:44] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 3.11, 2.25, 1.96 [03:50:14] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.25, 3.06, 3.40 [03:51:32] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.07, 2.71, 3.36 [03:54:07] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.40, 3.85, 3.83 [03:55:32] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.50, 3.45, 3.54 [03:56:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 1.82, 3.09, 3.55 [03:58:07] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.77, 2.73, 3.37 [03:58:13] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.37, 1.54, 1.27 [04:00:12] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.54, 1.54, 1.30 [04:01:32] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.77, 3.60, 3.52 [04:04:44] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.91, 1.94, 2.00 [04:05:32] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.39, 3.50, 3.50 [04:06:44] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.01, 1.99, 2.00 [04:07:32] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.47, 3.14, 3.36 [04:08:44] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.87, 1.96, 1.99 [04:18:44] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.10, 1.93, 1.94 [04:24:44] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.61, 1.94, 1.97 [04:36:37] PROBLEM - phab121 Current Load on phab121 is CRITICAL: CRITICAL - load average: 2.14, 2.51, 1.35 [04:43:56] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.67, 10.38, 9.65 [04:45:56] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.84, 9.66, 9.48 [04:46:15] PROBLEM - phab121 Current Load on phab121 is WARNING: WARNING - load average: 0.18, 1.74, 1.81 [04:48:13] RECOVERY - phab121 Current Load on phab121 is OK: OK - load average: 0.20, 1.24, 1.61 [04:48:44] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.44, 2.09, 1.92 [04:49:07] !log [reception@mwtask111] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=dragcavewiki --no-updates --username-prefix=wikia:dragcave /mnt/mediawiki-static/metawiki/ImportDump/dragcavewiki-20220629013931.xml (START) [04:49:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:50:09] !log [reception@mwtask111] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=dragcavewiki --no-updates --username-prefix=wikia:dragcave /mnt/mediawiki-static/metawiki/ImportDump/dragcavewiki-20220629013931.xml (END - exit=0) [04:50:10] !log [reception@mwtask111] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=dragcavewiki (START) [04:50:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:50:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:52:46] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.80, 3.73, 3.15 [04:54:44] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.67, 1.94, 1.94 [04:55:36] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.71, 1.55, 1.27 [04:56:36] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.87, 3.06, 3.03 [04:57:34] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.85, 1.31, 1.22 [04:59:32] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.80, 3.37, 3.19 [05:03:32] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.71, 3.13, 3.14 [05:06:44] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.62, 1.52, 1.70 [05:09:32] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.22, 3.78, 3.44 [05:11:32] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.25, 3.21, 3.27 [05:12:44] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.21, 1.87, 1.78 [05:14:44] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.78, 1.79, 1.76 [05:18:44] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.99, 2.22, 1.92 [05:20:06] !log [reception@mwtask111] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=dragcavewiki (END - exit=0) [05:20:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:20:53] !log [reception@mwtask111] sudo -u www-data php /srv/mediawiki/w/maintenance/updateArticleCount.php --wiki=celebswiki (END - exit=0) [05:20:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:21:02] !log [reception@mwtask111] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=celebswiki (END - exit=0) [05:21:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:31:29] [02miraheze/dns] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/dns/compare/7f59acf9be2a...7ef587765602 [05:31:30] [url] Comparing 7f59acf9be2a...7ef587765602 · miraheze/dns · GitHub | github.com [05:31:31] [02miraheze/dns] 07Reception123 037ef5877 - depool gb [05:36:38] [02miraheze/dns] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/dns/compare/7ef587765602...44fe4e9d9b85 [05:36:39] [url] Comparing 7ef587765602...44fe4e9d9b85 · miraheze/dns · GitHub | github.com [05:36:39] [02miraheze/dns] 07Reception123 0344fe4e9 - revert depool gb [05:39:52] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.15, 2.59, 1.62 [05:41:18] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.86, 4.45, 3.52 [05:42:30] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.39, 4.14, 3.39 [05:42:44] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.78, 5.08, 3.89 [05:42:44] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.50, 1.85, 1.97 [05:46:44] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.10, 1.92, 1.97 [05:53:40] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.85, 1.81, 1.82 [05:56:47] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.72, 3.92, 3.97 [05:57:37] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.69, 1.32, 1.63 [05:58:43] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.90, 4.49, 4.15 [06:02:44] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.56, 1.71, 1.95 [06:06:44] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.24, 1.91, 1.97 [06:07:54] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.52, 3.54, 3.99 [06:10:20] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.48, 3.30, 3.91 [06:11:46] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.24, 3.92, 4.00 [06:12:16] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.92, 4.01, 4.10 [06:15:27] !log ALTER TABLE searchindex ADD FULLTEXT INDEX si_title (si_title), ADD FULLTEXT INDEX si_text (si_text); (catholichymnswiki) [06:15:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:16:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 1.91, 3.19, 3.77 [06:19:32] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.18, 3.74, 3.94 [06:21:32] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.40, 3.91, 3.97 [06:22:14] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.99, 3.46, 3.63 [06:24:20] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.05, 10.20, 9.42 [06:26:16] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.88, 9.98, 9.42 [06:38:13] PROBLEM - phab121 Current Load on phab121 is CRITICAL: CRITICAL - load average: 2.89, 2.71, 1.35 [06:42:13] RECOVERY - phab121 Current Load on phab121 is OK: OK - load average: 0.34, 1.42, 1.13 [06:46:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.35, 3.52, 4.00 [06:48:21] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.91, 6.51, 5.53 [06:50:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.95, 3.05, 3.91 [06:53:32] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.69, 3.31, 3.92 [06:56:14] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.09, 3.20, 3.50 [06:57:32] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.70, 4.21, 4.09 [06:58:07] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.11, 3.35, 3.63 [06:58:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.69, 3.44, 3.55 [06:58:21] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 4.88, 6.21, 6.01 [06:59:32] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.64, 3.61, 3.89 [06:59:33] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query dnd.bellinrattin.it. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [07:00:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.90, 3.33, 3.57 [07:00:14] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.21, 3.00, 3.37 [07:04:14] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.73, 3.80, 3.60 [07:06:15] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.06, 3.10, 3.37 [07:07:32] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.06, 3.29, 3.60 [07:10:07] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.45, 2.89, 3.32 [07:11:32] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.85, 3.63, 3.66 [07:14:07] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.19, 3.48, 3.44 [07:15:09] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.95, 3.58, 3.46 [07:15:32] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.44, 3.67, 3.65 [07:16:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.78, 3.42, 3.44 [07:17:32] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.81, 3.46, 3.58 [07:19:01] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.43, 3.09, 3.31 [07:21:32] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.28, 3.47, 3.53 [07:23:32] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.74, 3.53, 3.55 [07:25:32] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.79, 2.92, 3.32 [07:26:07] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.68, 3.17, 3.35 [07:28:36] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - dnd.bellinrattin.it All nameservers failed to answer the query. [07:30:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.24, 3.65, 3.54 [07:32:07] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.06, 3.12, 3.36 [07:34:34] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.63, 3.66, 3.41 [07:36:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.47, 3.83, 3.63 [07:38:27] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.38, 3.86, 3.53 [07:40:07] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.83, 3.79, 3.62 [07:40:19] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.17, 3.61, 3.39 [07:42:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.22, 3.44, 3.51 [07:42:15] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.47, 3.56, 3.40 [07:42:19] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.93, 3.96, 3.66 [07:44:07] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.27, 3.67, 3.57 [07:46:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.20, 3.66, 3.59 [07:46:07] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.26, 3.09, 3.26 [07:46:28] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 2.58, 3.01, 1.80 [07:50:07] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.70, 4.06, 3.71 [07:51:58] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.51, 3.55, 3.34 [07:52:14] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.34, 3.79, 3.59 [07:53:54] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.55, 3.24, 3.26 [07:54:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.01, 3.77, 3.69 [07:54:12] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.88, 1.58, 1.58 [07:54:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.43, 3.29, 3.43 [07:56:14] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.43, 2.61, 3.16 [07:57:39] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp20.miraheze.org - CNAME OK [08:00:07] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.38, 3.18, 3.40 [08:06:07] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.51, 3.69, 3.47 [08:06:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.61, 3.34, 3.17 [08:08:02] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 4.10, 2.16, 1.69 [08:08:14] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.38, 3.33, 3.18 [08:10:02] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.70, 1.93, 1.66 [08:10:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.49, 3.53, 3.43 [08:12:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.73, 3.59, 3.35 [08:14:02] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.43, 1.37, 1.52 [08:14:07] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.06, 3.05, 3.31 [08:14:14] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.45, 3.01, 3.15 [08:14:21] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.78, 6.21, 4.98 [08:16:21] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.13, 5.74, 4.96 [08:22:07] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 7.14, 4.56, 3.75 [08:23:05] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 9.94, 6.16, 4.32 [08:24:02] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 1.81, 2.05, 1.74 [08:24:14] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.17, 4.45, 3.76 [08:28:02] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.16, 1.72, 1.69 [08:30:02] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.82, 1.41, 1.58 [08:40:13] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 1.62, 2.14, 1.30 [08:42:11] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.01, 1.67, 1.22 [09:00:15] PROBLEM - phab121 Current Load on phab121 is CRITICAL: CRITICAL - load average: 5.22, 2.77, 1.29 [09:02:13] PROBLEM - phab121 Current Load on phab121 is WARNING: WARNING - load average: 0.95, 1.98, 1.17 [09:04:13] RECOVERY - phab121 Current Load on phab121 is OK: OK - load average: 0.57, 1.44, 1.07 [09:12:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.65, 3.42, 3.92 [09:26:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.45, 3.59, 3.94 [09:28:14] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 3.39, 3.88, 4.03 [09:30:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.38, 3.31, 3.80 [09:32:07] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.49, 4.12, 3.83 [09:32:14] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.27, 4.27, 4.09 [09:34:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.20, 3.83, 3.77 [09:34:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.71, 3.81, 3.95 [09:36:14] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.11, 3.95, 3.99 [09:38:07] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.28, 3.72, 3.70 [09:38:44] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.52, 1.60, 2.00 [09:40:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.27, 3.72, 3.72 [09:42:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.54, 3.69, 3.94 [09:44:07] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.33, 3.59, 3.62 [09:46:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.48, 3.22, 3.49 [09:46:44] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.11, 1.76, 1.91 [09:47:32] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.78, 3.61, 3.96 [09:50:07] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.21, 3.39, 3.47 [09:52:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.72, 3.45, 3.47 [09:52:14] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.24, 2.73, 3.36 [09:54:07] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.04, 2.97, 3.30 [09:54:08] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.10, 10.45, 9.54 [09:58:44] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.62, 1.83, 1.96 [09:59:32] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.44, 3.91, 3.74 [10:00:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.21, 3.41, 3.37 [10:01:32] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.74, 3.86, 3.74 [10:02:14] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.63, 3.23, 3.31 [10:05:56] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.86, 9.76, 9.76 [10:10:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.28, 3.48, 3.32 [10:10:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.41, 3.76, 3.55 [10:12:07] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.86, 3.08, 3.18 [10:13:24] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.47, 10.46, 8.63 [10:14:44] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.50, 1.59, 1.70 [10:15:24] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.12, 9.22, 8.40 [10:16:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.63, 3.48, 3.32 [10:16:14] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.04, 3.28, 3.37 [10:18:07] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.48, 3.07, 3.18 [10:18:44] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.78, 2.07, 1.86 [10:20:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.93, 3.42, 3.39 [10:22:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.76, 3.74, 3.42 [10:22:14] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.77, 3.29, 3.36 [10:24:07] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.29, 3.23, 3.28 [10:24:44] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.30, 1.95, 1.92 [10:25:32] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.88, 3.64, 3.56 [10:28:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.83, 3.52, 3.41 [10:28:14] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.21, 3.86, 3.54 [10:29:32] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.42, 3.86, 3.70 [10:30:07] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.15, 4.23, 3.69 [10:30:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.55, 3.81, 3.57 [10:30:36] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query dnd.bellinrattin.it. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [10:34:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.61, 3.92, 3.71 [10:34:14] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.77, 3.23, 3.38 [10:35:32] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.08, 3.78, 3.71 [10:37:32] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.58, 3.64, 3.66 [10:39:32] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.62, 3.90, 3.75 [10:40:07] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.58, 3.07, 3.40 [10:40:44] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.20, 1.84, 1.80 [10:41:32] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.21, 3.71, 3.71 [10:42:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.62, 3.27, 3.31 [10:42:44] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.66, 1.78, 1.79 [10:44:14] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.41, 2.99, 3.21 [10:44:44] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.06, 1.88, 1.83 [10:47:32] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.63, 3.65, 3.61 [10:48:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.69, 3.44, 3.34 [10:49:32] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.63, 3.59, 3.59 [10:50:14] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.40, 3.09, 3.22 [10:50:57] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.04, 3.93, 3.61 [10:51:32] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.54, 4.34, 3.86 [10:52:19] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.76, 1.62, 1.44 [10:52:52] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.36, 3.37, 3.45 [10:53:32] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.86, 3.75, 3.70 [10:54:16] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.18, 1.68, 1.48 [10:56:13] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.49, 1.63, 1.49 [10:56:41] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.86, 2.91, 3.26 [10:59:32] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.50, 3.61, 3.64 [10:59:39] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - dnd.bellinrattin.it All nameservers failed to answer the query. [11:01:32] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.15, 3.03, 3.42 [11:02:09] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.23, 1.75, 1.55 [11:03:32] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.83, 3.04, 3.38 [11:04:09] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.74, 1.38, 1.44 [11:07:32] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.54, 3.29, 3.41 [11:08:44] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.43, 1.84, 1.98 [11:09:32] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.10, 2.97, 3.29 [11:16:44] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.25, 1.84, 1.91 [11:18:57] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.64, 3.13, 2.95 [11:20:51] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.08, 3.05, 2.94 [11:24:44] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.43, 1.88, 1.96 [11:28:41] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp21.miraheze.org - CNAME OK [11:30:19] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.16, 3.97, 3.39 [11:32:15] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.80, 3.43, 3.26 [11:34:11] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.38, 3.75, 3.39 [11:34:44] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.60, 1.94, 1.90 [11:36:07] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.30, 3.53, 3.35 [11:36:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.16, 10.89, 9.80 [11:36:44] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.82, 1.89, 1.89 [11:38:04] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.04, 3.68, 3.42 [11:38:20] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.12, 10.50, 9.78 [11:40:16] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.54, 9.86, 9.63 [11:41:56] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.47, 3.55, 3.42 [11:42:44] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.45, 10.47, 9.05 [11:44:44] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 6.88, 9.18, 8.76 [11:45:01] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.66, 3.37, 3.05 [11:45:48] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.94, 4.07, 3.60 [11:46:07] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.44, 3.82, 3.38 [11:46:44] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.07, 1.71, 1.77 [11:47:44] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.76, 3.49, 3.45 [11:48:07] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.73, 3.01, 3.14 [11:48:53] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.77, 3.15, 3.07 [11:49:41] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.57, 3.12, 3.31 [11:54:37] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 3.71, 3.77, 2.17 [11:54:44] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.56, 1.98, 1.95 [12:00:25] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 0.93, 1.96, 1.86 [12:02:21] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.24, 6.76, 5.61 [12:04:17] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.87, 1.42, 1.67 [12:04:21] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 6.45, 6.62, 5.70 [12:04:44] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.28, 1.91, 1.88 [12:08:21] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.35, 6.85, 6.05 [12:08:44] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.69, 1.83, 1.87 [12:10:21] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.86, 6.73, 6.12 [12:10:44] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.29, 1.89, 1.87 [12:14:21] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.01, 7.13, 6.45 [12:14:38] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.22, 9.69, 8.56 [12:14:44] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.93, 1.90, 1.89 [12:16:21] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.03, 6.60, 6.35 [12:17:32] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.38, 3.69, 3.27 [12:18:26] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 9.86, 9.71, 8.84 [12:18:44] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.88, 2.22, 2.00 [12:19:32] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.28, 3.29, 3.18 [12:20:21] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.90, 7.10, 6.64 [12:23:32] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.98, 3.61, 3.37 [12:24:21] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.66, 6.67, 6.63 [12:24:44] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.53, 1.99, 2.00 [12:25:32] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.59, 3.22, 3.25 [12:28:45] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.01, 10.43, 9.62 [12:30:41] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.69, 10.29, 9.68 [12:32:36] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.54, 9.68, 9.53 [12:32:44] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 1.93, 2.02, 2.00 [12:34:44] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.82, 1.99, 1.99 [12:42:13] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.51, 3.89, 3.45 [12:44:09] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.71, 3.37, 3.30 [12:44:44] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.02, 1.89, 1.92 [12:46:44] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.94, 1.92, 1.93 [12:48:14] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.40, 3.76, 3.17 [12:48:44] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.19, 2.08, 1.99 [12:50:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.00, 3.75, 3.26 [12:50:59] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.28, 3.72, 3.49 [12:54:14] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.27, 4.09, 3.49 [12:54:20] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.14, 4.14, 3.51 [12:54:51] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.97, 4.65, 3.86 [12:57:56] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.61, 10.68, 10.03 [12:58:10] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.02, 3.72, 3.51 [12:58:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 1.82, 3.66, 3.54 [12:58:44] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.36, 3.60, 3.63 [12:58:44] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.44, 1.83, 1.98 [12:59:56] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.44, 9.88, 9.81 [13:02:07] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.86, 3.21, 3.34 [13:02:14] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.96, 2.92, 3.28 [13:04:32] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.03, 2.77, 3.26 [13:05:56] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.88, 10.21, 9.98 [13:06:45] [02dns] 07MacFan4000 opened pull request 03#291: add en.wikiyri.org - 13https://github.com/miraheze/dns/pull/291 [13:06:46] [url] Page not found · GitHub · GitHub | github.com [13:07:56] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.29, 10.02, 9.94 [13:14:09] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.78, 1.54, 1.24 [13:16:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.80, 3.26, 3.05 [13:16:09] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.19, 1.38, 1.21 [13:16:44] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.10, 1.71, 1.74 [13:17:56] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.34, 10.28, 9.95 [13:18:07] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.77, 2.63, 2.84 [13:24:44] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.71, 1.98, 1.93 [13:24:58] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.79, 1.81, 1.52 [13:26:32] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 2.75, 2.21, 1.48 [13:26:44] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.47, 9.78, 8.87 [13:27:50] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.18, 4.26, 3.45 [13:28:28] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.41, 1.83, 1.43 [13:28:44] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 9.51, 9.60, 8.92 [13:28:53] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.07, 1.50, 1.47 [13:29:36] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query bellinrattin.it. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [13:29:46] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.02, 3.68, 3.33 [13:30:24] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.43, 1.37, 1.31 [13:31:42] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.08, 3.10, 3.16 [13:31:56] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.69, 10.09, 10.15 [13:38:26] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.23, 3.51, 3.24 [13:39:32] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.08, 3.69, 3.40 [13:41:32] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.50, 3.76, 3.47 [13:42:15] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.31, 4.17, 3.57 [13:45:56] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.24, 10.07, 9.98 [13:46:12] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.58, 10.27, 9.35 [13:46:21] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.95, 6.36, 5.82 [13:46:44] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.14, 1.79, 1.77 [13:47:32] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.21, 3.21, 3.32 [13:48:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.93, 3.73, 3.61 [13:48:12] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.19, 9.67, 9.26 [13:49:35] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 1.97, 2.18, 1.35 [13:50:21] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 6.75, 6.63, 6.08 [13:51:32] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.35, 4.07, 3.63 [13:51:35] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.77, 1.89, 1.33 [13:51:56] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.48, 11.22, 10.47 [13:52:07] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.99, 3.06, 3.38 [13:52:29] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.39, 3.66, 3.30 [13:53:56] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.36, 11.19, 10.54 [13:54:21] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.78, 7.48, 6.56 [13:54:25] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.36, 3.59, 3.32 [13:55:09] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.78, 1.93, 1.57 [13:55:34] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.19, 1.55, 1.32 [13:56:07] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.37, 3.45, 3.47 [13:56:12] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.17, 10.92, 9.95 [13:56:21] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.73, 7.96, 6.85 [13:56:21] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.22, 3.24, 3.21 [13:58:39] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - dnd.bellinrattin.it All nameservers failed to answer the query. [13:58:44] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.77, 1.99, 1.99 [13:59:56] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.26, 11.53, 10.86 [14:00:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.75, 3.47, 3.51 [14:00:12] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.62, 10.86, 10.15 [14:01:01] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.29, 1.82, 1.68 [14:01:56] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.82, 10.49, 10.56 [14:02:58] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.21, 1.58, 1.61 [14:03:32] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.44, 3.90, 3.86 [14:04:12] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.29, 9.62, 9.82 [14:05:56] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.63, 10.97, 10.66 [14:06:14] PROBLEM - phab121 Current Load on phab121 is CRITICAL: CRITICAL - load average: 6.05, 2.90, 1.26 [14:06:32] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk [14:07:09] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.28, 3.97, 3.60 [14:07:32] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.86, 4.19, 3.94 [14:07:56] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.09, 9.46, 10.15 [14:08:21] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.90, 7.89, 7.55 [14:09:32] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.30, 3.83, 3.85 [14:10:13] PROBLEM - phab121 Current Load on phab121 is WARNING: WARNING - load average: 0.60, 1.93, 1.27 [14:10:44] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.10, 1.87, 1.90 [14:12:13] RECOVERY - phab121 Current Load on phab121 is OK: OK - load average: 0.14, 1.31, 1.12 [14:14:07] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.57, 3.74, 3.59 [14:15:32] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.00, 4.59, 4.12 [14:16:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.71, 3.91, 3.68 [14:16:49] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.86, 3.86, 3.84 [14:17:52] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.08, 10.91, 10.14 [14:18:07] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.52, 4.30, 3.84 [14:19:46] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.13, 10.83, 10.19 [14:20:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.23, 3.83, 3.72 [14:20:42] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.16, 3.72, 3.78 [14:21:32] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk [14:21:41] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.20, 10.01, 9.98 [14:21:56] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.25, 10.81, 10.37 [14:22:21] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 4.89, 5.74, 6.58 [14:22:38] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.29, 3.28, 3.62 [14:24:25] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.76, 1.66, 1.33 [14:24:34] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.72, 3.99, 3.84 [14:26:23] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.66, 1.66, 1.37 [14:27:56] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.26, 9.70, 10.07 [14:28:07] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.04, 3.55, 3.58 [14:31:56] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.78, 10.66, 10.37 [14:32:19] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.41, 3.79, 3.82 [14:33:15] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.09, 1.79, 1.50 [14:34:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.22, 3.92, 3.78 [14:35:13] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.04, 1.40, 1.38 [14:36:14] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.20, 3.87, 3.84 [14:36:14] PROBLEM - phab121 Current Load on phab121 is CRITICAL: CRITICAL - load average: 3.51, 2.29, 1.30 [14:37:56] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.71, 9.76, 10.12 [14:38:07] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.51, 4.44, 4.02 [14:38:13] PROBLEM - phab121 Current Load on phab121 is WARNING: WARNING - load average: 1.29, 1.85, 1.26 [14:38:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.97, 3.61, 3.75 [14:40:13] RECOVERY - phab121 Current Load on phab121 is OK: OK - load average: 0.60, 1.41, 1.17 [14:40:14] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.61, 4.28, 3.97 [14:42:21] PROBLEM - db121 Current Load on db121 is WARNING: WARNING - load average: 7.89, 6.65, 4.41 [14:44:44] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.64, 1.78, 1.97 [14:46:17] RECOVERY - db121 Current Load on db121 is OK: OK - load average: 2.70, 5.22, 4.39 [14:46:44] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.07, 10.25, 9.56 [14:46:44] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.42, 2.00, 2.02 [14:49:56] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.32, 10.17, 10.10 [14:50:14] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.91, 10.75, 9.83 [14:51:33] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk [14:51:56] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.71, 9.95, 10.02 [14:52:12] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.33, 10.36, 9.82 [14:52:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.17, 3.23, 3.82 [14:54:12] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.81, 11.15, 10.16 [14:54:14] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.47, 3.71, 3.92 [14:56:12] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.95, 10.45, 10.01 [14:56:33] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.77, 1.54, 1.32 [14:56:44] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.32, 1.84, 2.00 [14:57:33] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp21.miraheze.org - CNAME OK [14:58:12] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.57, 9.61, 9.75 [14:58:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.23, 3.73, 3.89 [14:58:30] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.16, 1.37, 1.28 [14:58:44] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 9.82, 9.96, 9.90 [15:01:32] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.61, 3.46, 3.88 [15:04:02] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.92, 1.57, 1.23 [15:04:12] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 13.15, 11.67, 10.58 [15:04:45] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 14.31, 11.40, 10.52 [15:05:38] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.68, 10.54, 10.22 [15:06:02] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.91, 1.32, 1.18 [15:06:12] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.91, 11.07, 10.50 [15:06:14] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.19, 2.77, 3.38 [15:07:33] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 13.70, 11.23, 10.48 [15:08:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.60, 3.34, 3.95 [15:08:36] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.72, 11.45, 10.75 [15:09:29] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.03, 10.92, 10.47 [15:09:32] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.91, 2.85, 3.38 [15:10:07] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.18, 3.52, 3.93 [15:10:14] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.41, 3.54, 3.57 [15:11:25] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 13.68, 11.93, 10.89 [15:12:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.05, 3.65, 3.63 [15:13:21] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.56, 11.60, 10.89 [15:13:32] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.66, 3.69, 3.65 [15:16:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.02, 3.71, 3.96 [15:18:12] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.19, 11.39, 10.81 [15:18:44] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.40, 1.94, 1.87 [15:20:07] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.40, 4.02, 4.02 [15:20:12] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.42, 10.37, 10.51 [15:20:14] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.06, 3.69, 3.60 [15:22:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.67, 3.89, 3.98 [15:22:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.37, 3.18, 3.42 [15:23:32] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 7.50, 4.37, 3.84 [15:24:07] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.64, 4.22, 4.08 [15:24:12] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.08, 9.44, 10.13 [15:24:14] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.87, 3.92, 3.67 [15:24:56] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 6.25, 8.64, 9.87 [15:26:33] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk [15:26:44] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.67, 1.94, 1.96 [15:27:54] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.23, 7.13, 6.13 [15:28:02] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 4.92, 2.32, 1.56 [15:29:32] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.43, 3.84, 3.84 [15:29:50] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.04, 6.91, 6.17 [15:29:56] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.09, 9.26, 10.04 [15:30:02] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.58, 1.87, 1.49 [15:31:32] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.18, 4.16, 3.96 [15:32:02] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.67, 1.40, 1.36 [15:32:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.62, 3.70, 3.77 [15:32:44] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.26, 1.88, 1.90 [15:34:14] PROBLEM - phab121 Current Load on phab121 is CRITICAL: CRITICAL - load average: 5.79, 2.99, 1.39 [15:35:39] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.30, 7.41, 6.58 [15:36:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.56, 3.53, 3.86 [15:36:44] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.83, 1.87, 1.90 [15:37:32] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.03, 3.61, 3.80 [15:37:36] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.89, 7.31, 6.66 [15:38:07] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.49, 3.82, 3.91 [15:38:13] RECOVERY - phab121 Current Load on phab121 is OK: OK - load average: 0.52, 1.50, 1.13 [15:39:32] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.57, 7.88, 6.95 [15:40:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.40, 3.45, 3.78 [15:40:12] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.65, 9.89, 9.73 [15:41:28] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.91, 7.52, 6.93 [15:41:32] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.21, 2.68, 3.36 [15:42:12] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.41, 10.70, 10.04 [15:42:14] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.33, 2.89, 3.33 [15:42:45] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.86, 10.53, 10.23 [15:43:22] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.81, 1.48, 1.41 [15:44:07] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.13, 3.46, 3.68 [15:44:12] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.30, 10.64, 10.09 [15:44:44] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.17, 1.86, 1.87 [15:45:19] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.27, 1.38, 1.38 [15:45:21] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 10.03, 7.68, 7.05 [15:45:32] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.75, 4.03, 3.71 [15:48:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.62, 3.50, 3.68 [15:48:12] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.29, 11.33, 10.47 [15:49:14] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.00, 7.52, 7.14 [15:49:32] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.15, 3.44, 3.54 [15:50:12] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.01, 11.03, 10.45 [15:50:28] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.73, 11.38, 10.67 [15:51:11] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.43, 7.82, 7.29 [15:51:24] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.45, 9.62, 8.96 [15:51:32] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.76, 3.93, 3.69 [15:52:07] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.61, 3.91, 3.79 [15:53:07] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.25, 7.44, 7.23 [15:53:24] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 8.27, 8.94, 8.79 [15:54:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.89, 3.71, 3.50 [15:54:19] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.90, 10.80, 10.65 [15:56:02] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk [15:56:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.48, 3.65, 3.71 [15:56:09] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.58, 2.11, 1.70 [15:58:07] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.36, 4.12, 3.89 [15:58:09] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.78, 1.68, 1.60 [15:58:14] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.99, 4.10, 3.67 [15:58:56] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 3.89, 5.81, 6.64 [15:59:01] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.85, 2.39, 1.68 [16:00:59] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.81, 1.79, 1.54 [16:02:12] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 13.27, 11.45, 10.78 [16:02:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.76, 3.71, 3.63 [16:02:57] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.43, 1.66, 1.52 [16:04:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.26, 3.57, 3.77 [16:04:12] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.43, 10.65, 10.57 [16:05:32] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.23, 3.88, 3.98 [16:05:56] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.76, 11.06, 10.67 [16:06:07] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.88, 3.93, 3.87 [16:07:32] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 3.67, 3.98, 4.02 [16:07:56] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.66, 10.55, 10.53 [16:08:03] [02miraheze/ssl] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-1/±0] 13https://github.com/miraheze/ssl/commit/8c73bbfb164c [16:08:04] [02miraheze/ssl] 07Universal-Omega 038c73bbf - Remove data.memipedia.ga cert [16:08:06] [02ssl] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/ssl [16:08:06] [url] Page not found · GitHub · GitHub | github.com [16:08:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.80, 3.71, 3.79 [16:08:14] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.58, 3.00, 3.34 [16:08:32] [02ssl] 07Universal-Omega opened pull request 03#557: Remove data.memipedia.ga cert - 13https://github.com/miraheze/ssl/pull/557 [16:08:32] [url] Page not found · GitHub · GitHub | github.com [16:09:16] [02miraheze/ssl] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/8c73bbfb164c...1f2b15267c50 [16:09:16] [url] Comparing 8c73bbfb164c...1f2b15267c50 · miraheze/ssl · GitHub | github.com [16:09:17] [02miraheze/ssl] 07Universal-Omega 031f2b152 - Update certs.yaml [16:09:20] [02ssl] 07Universal-Omega synchronize pull request 03#557: Remove data.memipedia.ga cert - 13https://github.com/miraheze/ssl/pull/557 [16:09:20] [url] Page not found · GitHub · GitHub | github.com [16:09:32] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.04, 3.30, 3.76 [16:10:49] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.73, 2.11, 1.73 [16:11:32] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.38, 3.64, 3.82 [16:13:24] [02miraheze/ssl] 07Universal-Omega pushed 031 commit to 03master [+0/-1/±1] 13https://github.com/miraheze/ssl/compare/3dfe31ec83ea...9a868856a345 [16:13:25] [url] Comparing 3dfe31ec83ea...9a868856a345 · miraheze/ssl · GitHub | github.com [16:13:25] [02miraheze/ssl] 07Universal-Omega 039a86885 - Remove data.memipedia.ga cert (#557) [16:13:27] [02miraheze/ssl] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [16:13:29] [02ssl] 07Universal-Omega closed pull request 03#557: Remove data.memipedia.ga cert - 13https://github.com/miraheze/ssl/pull/557 [16:13:29] [url] Page not found · GitHub · GitHub | github.com [16:13:30] [02ssl] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/ssl [16:13:30] ... [16:13:32] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.52, 3.58, 3.78 [16:13:49] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.65, 10.32, 9.58 [16:14:07] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.02, 3.61, 3.66 [16:14:09] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 3.86, 2.37, 1.71 [16:14:14] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.44, 4.15, 3.71 [16:14:46] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.03, 1.69, 1.65 [16:15:32] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.66, 4.62, 4.14 [16:15:45] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.89, 9.98, 9.56 [16:16:09] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.41, 1.96, 1.64 [16:20:09] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.96, 1.52, 1.54 [16:20:12] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.07, 10.50, 10.41 [16:21:34] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.16, 11.08, 10.14 [16:21:56] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.28, 11.42, 10.98 [16:22:12] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.17, 10.23, 10.33 [16:23:30] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.50, 10.73, 10.12 [16:23:56] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.71, 11.17, 10.95 [16:24:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.06, 3.81, 3.84 [16:24:09] PROBLEM - mw112 Puppet on mw112 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/ssl/localcerts/data.memipedia.ga.crt] [16:24:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.39, 3.50, 3.75 [16:24:59] PROBLEM - cp31 Puppet on cp31 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/ssl/localcerts/data.memipedia.ga.crt] [16:25:19] PROBLEM - test101 Puppet on test101 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/ssl/localcerts/data.memipedia.ga.crt] [16:26:12] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.29, 9.24, 9.94 [16:27:01] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.38, 1.81, 1.62 [16:27:22] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.14, 9.39, 9.73 [16:28:14] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.85, 3.74, 3.77 [16:28:21] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 11.52, 8.56, 6.64 [16:29:52] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/3cfa636b10c3...dca0226286e6 [16:29:53] [url] Comparing 3cfa636b10c3...dca0226286e6 · miraheze/mw-config · GitHub | github.com [16:29:54] [02miraheze/mw-config] 07Universal-Omega 03dca0226 - Enable HitCounters debug logging [16:30:06] !log [universalomega@mwtask111] starting deploy of {'pull': 'config', 'config': True} to all [16:30:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:30:19] Anyone around to help with a log in issue? [16:30:28] !log [universalomega@mwtask111] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 22s [16:30:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:31:02] miraheze/mw-config - Universal-Omega the build passed. [16:31:07] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.10, 9.10, 9.97 [16:31:30] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.31, 1.45, 1.51 [16:31:30] CosmicAlpha: Available? [16:31:42] Sario: yep [16:32:43] RhinosF1 set up an "official" account to use on the Fossbots wiki, but the temp password isn't working. [16:33:00] The account is RyanK (FOSSBots) [16:33:08] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.38, 10.48, 10.16 [16:33:37] I've already tried a password reset, but I'm still getting an incorrect password error when I try to sign in [16:34:32] Hmm...... [16:34:52] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.22, 4.23, 3.96 [16:35:25] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.42, 3.27, 3.56 [16:35:27] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.31, 3.82, 3.96 [16:36:17] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/dca0226286e6...b185114e280f [16:36:17] [url] Comparing dca0226286e6...b185114e280f · miraheze/mw-config · GitHub | github.com [16:36:18] [02miraheze/mw-config] 07Universal-Omega 03b185114 - Revert "Enable HitCounters debug logging" [16:36:30] Looking Sario [16:36:36] Thanks [16:36:40] !log [universalomega@mwtask111] starting deploy of {'pull': 'config', 'config': True} to all [16:36:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:36:50] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.75, 3.67, 3.79 [16:36:51] !log [universalomega@mwtask111] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 11s [16:37:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:37:19] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.61, 2.74, 3.34 [16:37:33] miraheze/mw-config - Universal-Omega the build passed. [16:38:23] Yeah all I see in logs is "authentication for 'RyanK (FOSSBots)' failed, bad pass". Let me see something. [16:39:00] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.83, 10.98, 10.40 [16:40:52] Sario: did you try logging in to loginwiki or metawiki? [16:40:58] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.66, 10.50, 10.30 [16:41:10] CosmicAlpha: I'm on loginwiki right now [16:41:44] Sario: login failed the same there as well then? [16:41:49] Yes [16:42:37] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.56, 10.00, 9.70 [16:42:40] Hmm... [16:42:56] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.62, 9.63, 10.02 [16:43:01] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.13, 3.36, 3.45 [16:44:32] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.59, 9.62, 9.61 [16:46:49] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.65, 3.26, 3.40 [16:46:50] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.26, 3.61, 3.60 [16:48:35] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.88, 3.00, 3.35 [16:48:43] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.40, 3.17, 3.44 [16:51:02] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk [16:51:09] RECOVERY - mw112 Puppet on mw112 is OK: OK: Puppet is currently enabled, last run 48 seconds ago with 0 failures [16:51:20] RECOVERY - cp31 Puppet on cp31 is OK: OK: Puppet is currently enabled, last run 32 seconds ago with 0 failures [16:51:31] [02miraheze/ssl] 07MacFan4000 pushed 031 commit to 03MacFan4000-patch-1 [+0/-1/±0] 13https://github.com/miraheze/ssl/commit/08e2b25de67e [16:51:32] [02miraheze/ssl] 07MacFan4000 0308e2b25 - remove 6 domains [16:51:34] [02ssl] 07MacFan4000 created branch 03MacFan4000-patch-1 - 13https://github.com/miraheze/ssl [16:51:34] [url] Page not found · GitHub · GitHub | github.com [16:51:37] [02ssl] 07MacFan4000 opened pull request 03#558: remove 6 domains - 13https://github.com/miraheze/ssl/pull/558 [16:51:37] [url] Page not found · GitHub · GitHub | github.com [16:52:30] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 4.96, 6.22, 7.70 [16:52:31] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.06, 3.53, 3.52 [16:52:47] [02miraheze/ssl] 07MacFan4000 pushed 031 commit to 03MacFan4000-patch-1 [+0/-1/±0] 13https://github.com/miraheze/ssl/compare/08e2b25de67e...4d63759bf057 [16:52:47] [url] Comparing 08e2b25de67e...4d63759bf057 · miraheze/ssl · GitHub | github.com [16:52:48] [02miraheze/ssl] 07MacFan4000 034d63759 - Delete spiral.wiki.crt [16:52:50] [02ssl] 07MacFan4000 synchronize pull request 03#558: remove 6 domains - 13https://github.com/miraheze/ssl/pull/558 [16:52:50] [url] Page not found · GitHub · GitHub | github.com [16:52:57] RECOVERY - test101 Puppet on test101 is OK: OK: Puppet is currently enabled, last run 43 seconds ago with 0 failures [16:53:30] [02miraheze/ssl] 07MacFan4000 pushed 031 commit to 03MacFan4000-patch-1 [+0/-1/±0] 13https://github.com/miraheze/ssl/compare/4d63759bf057...b04c8cb4995f [16:53:30] [url] Comparing 4d63759bf057...b04c8cb4995f · miraheze/ssl · GitHub | github.com [16:53:31] [02miraheze/ssl] 07MacFan4000 03b04c8cb - Delete sunrin.net.crt [16:53:33] [02ssl] 07MacFan4000 synchronize pull request 03#558: remove 6 domains - 13https://github.com/miraheze/ssl/pull/558 [16:53:34] [url] Page not found · GitHub · GitHub | github.com [16:54:25] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.64, 3.53, 3.52 [16:55:25] [02miraheze/ssl] 07MacFan4000 pushed 031 commit to 03MacFan4000-patch-1 [+0/-1/±0] 13https://github.com/miraheze/ssl/compare/b04c8cb4995f...7148961445da [16:55:25] [url] Comparing b04c8cb4995f...7148961445da · miraheze/ssl · GitHub | github.com [16:55:26] [02miraheze/ssl] 07MacFan4000 037148961 - Delete factorio-mods.tk.crt [16:55:28] [02ssl] 07MacFan4000 synchronize pull request 03#558: remove 6 domains - 13https://github.com/miraheze/ssl/pull/558 [16:55:28] [url] Page not found · GitHub · GitHub | github.com [16:56:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.62, 3.62, 3.55 [16:56:24] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.70, 3.55, 3.52 [16:56:27] [02miraheze/ssl] 07MacFan4000 pushed 031 commit to 03MacFan4000-patch-1 [+0/-1/±0] 13https://github.com/miraheze/ssl/compare/7148961445da...0d6821daf3b4 [16:56:28] [url] Comparing 7148961445da...0d6821daf3b4 · miraheze/ssl · GitHub | github.com [16:56:29] [02miraheze/ssl] 07MacFan4000 030d6821d - Delete irishfreemaninfo.com.crt [16:56:30] [02ssl] 07MacFan4000 synchronize pull request 03#558: remove 6 domains - 13https://github.com/miraheze/ssl/pull/558 [16:56:31] [url] Page not found · GitHub · GitHub | github.com [16:56:54] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.19, 1.84, 1.52 [16:56:54] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.96, 10.73, 10.01 [16:57:35] [02miraheze/ssl] 07MacFan4000 pushed 031 commit to 03MacFan4000-patch-1 [+0/-1/±0] 13https://github.com/miraheze/ssl/compare/0d6821daf3b4...9cfe1911bf4c [16:57:36] [url] Comparing 0d6821daf3b4...9cfe1911bf4c · miraheze/ssl · GitHub | github.com [16:57:37] [02miraheze/ssl] 07MacFan4000 039cfe191 - Delete wiki.mistleague.io.crt [16:57:38] [02ssl] 07MacFan4000 synchronize pull request 03#558: remove 6 domains - 13https://github.com/miraheze/ssl/pull/558 [16:57:39] [url] Page not found · GitHub · GitHub | github.com [16:58:12] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.67, 3.97, 3.66 [16:58:20] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 4.25, 5.20, 6.80 [16:58:54] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.50, 1.68, 1.49 [17:00:06] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.30, 3.71, 3.61 [17:00:44] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.62, 1.75, 2.00 [17:02:06] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.31, 4.28, 3.85 [17:02:15] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.21, 4.04, 3.73 [17:02:22] [02miraheze/ssl] 07MacFan4000 pushed 031 commit to 03MacFan4000-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/9cfe1911bf4c...a62aa64a4ba9 [17:02:22] [url] Comparing 9cfe1911bf4c...a62aa64a4ba9 · miraheze/ssl · GitHub | github.com [17:02:23] [02miraheze/ssl] 07MacFan4000 03a62aa64 - Update certs.yaml [17:02:25] [02ssl] 07MacFan4000 synchronize pull request 03#558: remove 6 domains - 13https://github.com/miraheze/ssl/pull/558 [17:02:25] [url] Page not found · GitHub · GitHub | github.com [17:02:52] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.18, 9.64, 9.84 [17:03:33] [02miraheze/ssl] 07MacFan4000 pushed 031 commit to 03MacFan4000-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/a62aa64a4ba9...8bea2ea63e44 [17:03:34] [url] Comparing a62aa64a4ba9...8bea2ea63e44 · miraheze/ssl · GitHub | github.com [17:03:35] [02miraheze/ssl] 07MacFan4000 038bea2ea - Update redirects.yaml [17:03:36] [02ssl] 07MacFan4000 synchronize pull request 03#558: remove 6 domains - 13https://github.com/miraheze/ssl/pull/558 [17:03:37] [url] Page not found · GitHub · GitHub | github.com [17:04:06] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.44, 3.92, 3.77 [17:04:08] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 13.74, 9.15, 7.86 [17:04:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.61, 3.82, 3.68 [17:04:24] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.32, 2.90, 3.25 [17:04:47] [02miraheze/ssl] 07MacFan4000 pushed 031 commit to 03master [+0/-6/±2] 13https://github.com/miraheze/ssl/compare/9a868856a345...a04d393f3580 [17:04:47] [url] Comparing 9a868856a345...a04d393f3580 · miraheze/ssl · GitHub | github.com [17:04:48] [02miraheze/ssl] 07MacFan4000 03a04d393 - remove 6 domains (#558) [17:04:50] [02miraheze/ssl] 07MacFan4000 deleted branch 03MacFan4000-patch-1 [17:04:51] [02ssl] 07MacFan4000 closed pull request 03#558: remove 6 domains - 13https://github.com/miraheze/ssl/pull/558 [17:04:52] [url] Page not found · GitHub · GitHub | github.com [17:04:53] [02ssl] 07MacFan4000 deleted branch 03MacFan4000-patch-1 - 13https://github.com/miraheze/ssl [17:04:53] [url] Page not found · GitHub · GitHub | github.com [17:06:10] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.62, 3.99, 3.75 [17:06:49] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.05, 10.36, 10.07 [17:08:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.93, 3.85, 3.72 [17:08:26] [02dns] 07MacFan4000 opened pull request 03#292: Delete spiral.wiki zone - 13https://github.com/miraheze/dns/pull/292 [17:08:27] [url] Page not found · GitHub · GitHub | github.com [17:08:28] PROBLEM - mw111 Puppet on mw111 is CRITICAL: CRITICAL: Puppet has 5 failures. Last run 2 minutes ago with 5 failures. Failed resources (up to 3 shown): File[/etc/ssl/private/factorio-mods.tk.key],File[/etc/ssl/private/wiki.mistleague.io.key],File[/etc/ssl/private/sunrin.net.key],File[/etc/ssl/private/wiki.thesohnlandgov.info.key] [17:09:10] that will fix itself next puppet run [17:10:53] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.13, 10.75, 9.37 [17:12:02] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.29, 3.81, 3.70 [17:12:47] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.21, 9.46, 9.79 [17:12:51] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 9.01, 10.18, 9.33 [17:14:06] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.68, 4.06, 3.79 [17:14:26] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.49, 1.53, 1.70 [17:15:12] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.31, 4.31, 3.69 [17:16:52] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.39, 9.40, 9.04 [17:18:19] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 3.14, 2.20, 1.92 [17:18:52] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.78, 8.96, 8.94 [17:20:54] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.57, 3.99, 3.75 [17:22:48] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.72, 4.68, 4.02 [17:23:29] PROBLEM - mw111 MediaWiki Rendering on mw111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:23:31] PROBLEM - cp30 Stunnel HTTP for mw111 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:23:36] PROBLEM - cp31 Stunnel HTTP for mw111 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:23:51] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:25:26] RECOVERY - mw111 MediaWiki Rendering on mw111 is OK: HTTP OK: HTTP/1.1 200 OK - 27096 bytes in 3.102 second response time [17:25:29] RECOVERY - cp30 Stunnel HTTP for mw111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 2.691 second response time [17:25:35] RECOVERY - cp31 Stunnel HTTP for mw111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 3.162 second response time [17:25:49] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 2.153 second response time [17:26:40] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.58, 10.23, 9.75 [17:26:54] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.17, 1.89, 1.49 [17:31:11] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.40, 1.73, 1.92 [17:31:18] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.42, 1.63, 1.48 [17:31:25] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.64, 3.72, 3.86 [17:31:58] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.60, 10.58, 9.76 [17:32:40] CosmicAlpha: any luck yet? [17:32:41] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.42, 3.38, 3.94 [17:33:13] Sario: nope, I could try resetting it, but you said that did not even work for you, so I really have no idea here. [17:33:21] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.66, 3.75, 3.83 [17:33:57] CosmicAlpha: since it hasn't been used yet, could it be deleted and recreated? [17:34:20] CosmicAlpha: mark the email confirmed [17:34:26] Then it can be reset [17:34:33] RhinosF1: Oh. [17:34:37] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.16, 3.74, 4.00 [17:34:53] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.94, 11.11, 10.34 [17:35:07] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk [17:35:18] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.42, 3.50, 3.72 [17:35:23] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.13, 3.62, 3.96 [17:36:33] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.52, 3.63, 3.93 [17:36:51] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.44, 11.37, 10.55 [17:37:14] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.53, 4.23, 3.94 [17:37:17] RECOVERY - mw111 Puppet on mw111 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [17:37:21] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.00, 4.12, 4.10 [17:38:29] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.83, 4.28, 4.13 [17:38:56] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.08, 1.86, 1.88 [17:39:39] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.30, 10.62, 9.45 [17:41:02] RhinosF1, Sario: done [17:41:18] !log User::newFromName( 'RyanK (FOSSBots)' )->confirmEmail(); using eval.php [17:41:37] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.87, 11.41, 9.87 [17:41:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:41:44] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.20, 10.96, 10.33 [17:42:18] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 4.17, 5.57, 7.92 [17:43:05] Sario: do it from botswiki [17:43:34] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.84, 11.13, 9.95 [17:43:41] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.38, 10.54, 10.24 [17:46:51] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 2.76, 2.71, 1.75 [17:47:29] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.40, 10.04, 9.79 [17:47:29] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.67, 1.98, 1.47 [17:49:29] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.56, 1.76, 1.45 [17:49:34] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.23, 9.56, 9.95 [17:50:46] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.58, 1.59, 1.51 [17:51:09] PROBLEM - cp31 Stunnel HTTP for mw111 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:51:24] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:51:29] PROBLEM - cp30 Stunnel HTTP for mw111 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:51:36] PROBLEM - cp21 Stunnel HTTP for mw111 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:52:58] PROBLEM - mw111 MediaWiki Rendering on mw111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:53:28] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.05, 1.95, 1.60 [17:53:30] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 8.976 second response time [17:53:32] RECOVERY - cp30 Stunnel HTTP for mw111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 9.146 second response time [17:53:42] RECOVERY - cp21 Stunnel HTTP for mw111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 8.135 second response time [17:53:49] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.01, 5.33, 6.59 [17:54:57] RECOVERY - mw111 MediaWiki Rendering on mw111 is OK: HTTP OK: HTTP/1.1 200 OK - 27096 bytes in 2.940 second response time [17:55:14] RECOVERY - cp31 Stunnel HTTP for mw111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.828 second response time [17:55:28] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.97, 1.98, 1.65 [17:57:27] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.12, 1.64, 1.57 [17:57:50] [02miraheze/IncidentReporting] 07Universal-Omega pushed 0316 commits to 03Universal-Omega-patch-1 [+2/-2/±27] 13https://github.com/miraheze/IncidentReporting/compare/3a114e8352ab...508d6be52b04 [17:57:51] [url] Comparing 3a114e8352ab...508d6be52b04 · miraheze/IncidentReporting · GitHub | github.com [17:57:52] [02miraheze/IncidentReporting] 07Universal-Omega 03508d6be - Merge branch 'master' into Universal-Omega-patch-1 [17:57:53] [02IncidentReporting] 07Universal-Omega synchronize pull request 03#40: Modernise IncidentReportingOOUIForm - 13https://github.com/miraheze/IncidentReporting/pull/40 [17:57:54] ... [17:58:35] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.97, 3.41, 3.98 [17:58:38] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.36, 10.99, 10.56 [18:00:37] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.64, 10.61, 10.48 [18:00:50] miraheze/IncidentReporting - Universal-Omega the build has errored. [18:01:20] CosmicAlpha, RhinosF1 it's all set up now, thanks for the help [18:02:20] [02miraheze/IncidentReporting] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/IncidentReporting/compare/508d6be52b04...59e1962ce299 [18:02:21] [url] Comparing 508d6be52b04...59e1962ce299 · miraheze/IncidentReporting · GitHub | github.com [18:02:22] [02miraheze/IncidentReporting] 07Universal-Omega 0359e1962 - Update IncidentReportingOOUIForm.php [18:02:23] [02IncidentReporting] 07Universal-Omega synchronize pull request 03#40: Modernise IncidentReportingOOUIForm - 13https://github.com/miraheze/IncidentReporting/pull/40 [18:02:24] [url] Page not found · GitHub · GitHub | github.com [18:02:30] Great [18:02:39] [02miraheze/IncidentReporting] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/IncidentReporting/compare/59e1962ce299...935728d5f87f [18:02:40] [url] Comparing 59e1962ce299...935728d5f87f · miraheze/IncidentReporting · GitHub | github.com [18:02:41] [02miraheze/IncidentReporting] 07Universal-Omega 03935728d - Update extension.json [18:02:42] [02IncidentReporting] 07Universal-Omega synchronize pull request 03#40: Modernise IncidentReportingOOUIForm - 13https://github.com/miraheze/IncidentReporting/pull/40 [18:02:43] [url] Page not found · GitHub · GitHub | github.com [18:03:33] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.75, 10.36, 9.81 [18:04:20] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.14, 3.50, 3.98 [18:04:24] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.06, 3.88, 3.97 [18:05:18] Sario: Great, glad it works now! [18:05:33] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.66, 9.22, 9.45 [18:06:20] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.24, 3.59, 3.86 [18:06:39] miraheze/IncidentReporting - Universal-Omega the build passed. [18:06:52] [02miraheze/IncidentReporting] 07Universal-Omega pushed 031 commit to 03master [+0/-1/±6] 13https://github.com/miraheze/IncidentReporting/compare/5a0a47d3cc68...0ab470d11c6a [18:06:53] [url] Comparing 5a0a47d3cc68...0ab470d11c6a · miraheze/IncidentReporting · GitHub | github.com [18:06:54] [02miraheze/IncidentReporting] 07Universal-Omega 030ab470d - Modernise IncidentReportingOOUIForm (#40) [18:06:55] [02IncidentReporting] 07Universal-Omega closed pull request 03#40: Modernise IncidentReportingOOUIForm - 13https://github.com/miraheze/IncidentReporting/pull/40 [18:06:56] [url] Page not found · GitHub · GitHub | github.com [18:07:08] [02miraheze/IncidentReporting] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [18:07:10] [02IncidentReporting] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/IncidentReporting [18:07:10] [url] Page not found · GitHub · GitHub | github.com [18:10:06] miraheze/IncidentReporting - Universal-Omega the build passed. [18:10:24] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.54, 1.81, 1.68 [18:10:39] [02miraheze/MatomoAnalytics] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/MatomoAnalytics/commit/3995c7fa8915 [18:10:41] [02miraheze/MatomoAnalytics] 07Universal-Omega 033995c7f - Update MatomoAnalyticsOOUIForm.php [18:10:42] [02MatomoAnalytics] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/MatomoAnalytics [18:10:43] [url] Page not found · GitHub · GitHub | github.com [18:10:59] [02MatomoAnalytics] 07Universal-Omega opened pull request 03#79: Modernise MatomoAnalyticsOOUIForm - 13https://github.com/miraheze/MatomoAnalytics/pull/79 [18:10:59] ... [18:11:49] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:12:10] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.35, 4.35, 4.06 [18:12:24] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.08, 2.23, 1.86 [18:13:17] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 1.29, 2.11, 1.66 [18:13:23] PROBLEM - mw111 MediaWiki Rendering on mw111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:13:28] [02miraheze/MatomoAnalytics] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/MatomoAnalytics/compare/3995c7fa8915...4762de22348c [18:13:29] [url] Comparing 3995c7fa8915...4762de22348c · miraheze/MatomoAnalytics · GitHub | github.com [18:13:30] [02miraheze/MatomoAnalytics] 07Universal-Omega 034762de2 - Update extension.json [18:13:38] [02MatomoAnalytics] 07Universal-Omega synchronize pull request 03#79: Modernise MatomoAnalyticsOOUIForm - 13https://github.com/miraheze/MatomoAnalytics/pull/79 [18:13:38] [url] Page not found · GitHub · GitHub | github.com [18:13:47] [02miraheze/IncidentReporting] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/IncidentReporting/commit/d851864b7de8 [18:13:49] [02miraheze/IncidentReporting] 07Universal-Omega 03d851864 - Bump version [18:13:52] [02IncidentReporting] 07Universal-Omega opened pull request 03#44: Bump version - 13https://github.com/miraheze/IncidentReporting/pull/44 [18:13:52] ... [18:13:53] PROBLEM - cp31 Stunnel HTTP for mw111 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:14:05] miraheze/MatomoAnalytics - Universal-Omega the build has errored. [18:14:08] [02IncidentReporting] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/IncidentReporting [18:14:08] [url] Page not found · GitHub · GitHub | github.com [18:14:11] PROBLEM - cp21 Stunnel HTTP for mw111 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:14:20] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 8.99, 5.45, 4.49 [18:14:23] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.13, 1.81, 1.75 [18:14:47] [02miraheze/IncidentReporting] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/IncidentReporting/compare/d851864b7de8...423149871b8a [18:14:48] [url] Comparing d851864b7de8...423149871b8a · miraheze/IncidentReporting · GitHub | github.com [18:14:48] [02miraheze/IncidentReporting] 07Universal-Omega 034231498 - Update CHANGELOG.md [18:14:50] [02IncidentReporting] 07Universal-Omega synchronize pull request 03#44: Bump version - 13https://github.com/miraheze/IncidentReporting/pull/44 [18:14:50] [url] Page not found · GitHub · GitHub | github.com [18:15:14] [02miraheze/IncidentReporting] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/IncidentReporting/compare/0ab470d11c6a...a6680c0d9c76 [18:15:15] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.11, 1.78, 1.60 [18:15:15] [url] Comparing 0ab470d11c6a...a6680c0d9c76 · miraheze/IncidentReporting · GitHub | github.com [18:15:16] [02miraheze/IncidentReporting] 07Universal-Omega 03a6680c0 - Bump version (#44) [18:15:17] [02miraheze/IncidentReporting] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [18:15:19] [02IncidentReporting] 07Universal-Omega closed pull request 03#44: Bump version - 13https://github.com/miraheze/IncidentReporting/pull/44 [18:15:19] [url] Page not found · GitHub · GitHub | github.com [18:15:20] [02IncidentReporting] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/IncidentReporting [18:15:21] [url] Page not found · GitHub · GitHub | github.com [18:15:24] RECOVERY - mw111 MediaWiki Rendering on mw111 is OK: HTTP OK: HTTP/1.1 200 OK - 27096 bytes in 4.478 second response time [18:15:51] RECOVERY - cp31 Stunnel HTTP for mw111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.451 second response time [18:15:53] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.022 second response time [18:15:58] [02miraheze/MatomoAnalytics] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/MatomoAnalytics/compare/4762de22348c...f2023479285c [18:15:59] [url] Comparing 4762de22348c...f2023479285c · miraheze/MatomoAnalytics · GitHub | github.com [18:16:00] [02miraheze/MatomoAnalytics] 07Universal-Omega 03f202347 - Update extension.json [18:16:02] [02MatomoAnalytics] 07Universal-Omega synchronize pull request 03#79: Modernise MatomoAnalyticsOOUIForm - 13https://github.com/miraheze/MatomoAnalytics/pull/79 [18:16:03] miraheze/MatomoAnalytics - Universal-Omega the build has errored. [18:16:03] [url] Page not found · GitHub · GitHub | github.com [18:16:10] RECOVERY - cp21 Stunnel HTTP for mw111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.349 second response time [18:16:23] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.66, 1.48, 1.64 [18:17:13] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.16, 1.53, 1.53 [18:17:55] https://meta.miraheze.org/wiki/User_talk:Dmehus#Unblocking_Eric_Bagwell_at_Greatest_Movies_Wiki,_Awful_Movies_Wiki,_Best_TV_Shows_Wiki,_Terrible_TV_Shows_Wiki,_Awesome_Games_Wiki_and_Crappy_Games_Wiki. is the same long title but its from may [18:17:56] [url] User talk:Dmehus - Miraheze Meta | meta.miraheze.org [18:17:58] [02miraheze/MatomoAnalytics] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/MatomoAnalytics/compare/f2023479285c...01522d8f48f7 [18:17:58] [url] Comparing f2023479285c...01522d8f48f7 · miraheze/MatomoAnalytics · GitHub | github.com [18:17:59] [02miraheze/MatomoAnalytics] 07Universal-Omega 0301522d8 - Update SpecialAnalytics.php [18:18:03] [02MatomoAnalytics] 07Universal-Omega synchronize pull request 03#79: Modernise MatomoAnalyticsOOUIForm - 13https://github.com/miraheze/MatomoAnalytics/pull/79 [18:18:03] oops wrong chan [18:18:03] [url] Page not found · GitHub · GitHub | github.com [18:18:33] miraheze/IncidentReporting - Universal-Omega the build passed. [18:19:15] [02MatomoAnalytics] 07Universal-Omega synchronize pull request 03#79: Modernise MatomoAnalyticsOOUIForm - 13https://github.com/miraheze/MatomoAnalytics/pull/79 [18:19:15] [url] Page not found · GitHub · GitHub | github.com [18:19:18] miraheze/MatomoAnalytics - Universal-Omega the build has errored. [18:19:19] [02miraheze/MatomoAnalytics] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/MatomoAnalytics/compare/01522d8f48f7...a254cb5cea57 [18:19:20] [url] Comparing 01522d8f48f7...a254cb5cea57 · miraheze/MatomoAnalytics · GitHub | github.com [18:19:21] [02miraheze/MatomoAnalytics] 07Universal-Omega 03a254cb5 - Update MatomoAnalyticsViewer.php [18:19:40] [02miraheze/MatomoAnalytics] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-1/±0] 13https://github.com/miraheze/MatomoAnalytics/compare/a254cb5cea57...59294e71dc9a [18:19:40] [url] Comparing a254cb5cea57...59294e71dc9a · miraheze/MatomoAnalytics · GitHub | github.com [18:19:41] [02miraheze/MatomoAnalytics] 07Universal-Omega 0359294e7 - Delete ext.matomoanalytics.oouiform.edit.ooui.js [18:19:43] [02MatomoAnalytics] 07Universal-Omega synchronize pull request 03#79: Modernise MatomoAnalyticsOOUIForm - 13https://github.com/miraheze/MatomoAnalytics/pull/79 [18:19:43] [url] Page not found · GitHub · GitHub | github.com [18:20:09] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.83, 3.87, 4.00 [18:20:25] miraheze/IncidentReporting - Universal-Omega the build passed. [18:20:33] miraheze/MatomoAnalytics - Universal-Omega the build has errored. [18:21:06] [02miraheze/MatomoAnalytics] 07github-actions[bot] pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/MatomoAnalytics/compare/59294e71dc9a...ff2869e5cea3 [18:21:06] [url] Comparing 59294e71dc9a...ff2869e5cea3 · miraheze/MatomoAnalytics · GitHub | github.com [18:21:07] [02miraheze/MatomoAnalytics] 07github-actions 03ff2869e - CI: lint code to MediaWiki standards [18:21:09] [02MatomoAnalytics] 07github-actions[bot] synchronize pull request 03#79: Modernise MatomoAnalyticsOOUIForm - 13https://github.com/miraheze/MatomoAnalytics/pull/79 [18:21:09] [url] Page not found · GitHub · GitHub | github.com [18:22:05] [02miraheze/MatomoAnalytics] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/MatomoAnalytics/compare/ff2869e5cea3...a08cd97dbb7d [18:22:05] [url] Comparing ff2869e5cea3...a08cd97dbb7d · miraheze/MatomoAnalytics · GitHub | github.com [18:22:06] [02miraheze/MatomoAnalytics] 07Universal-Omega 03a08cd97 - Update ext.matomoanalytics.oouiform.ooui.js [18:22:08] [02MatomoAnalytics] 07Universal-Omega synchronize pull request 03#79: Modernise MatomoAnalyticsOOUIForm - 13https://github.com/miraheze/MatomoAnalytics/pull/79 [18:22:08] [url] Page not found · GitHub · GitHub | github.com [18:22:09] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.49, 4.24, 4.11 [18:22:09] miraheze/MatomoAnalytics - Universal-Omega the build has errored. [18:22:34] PROBLEM - cp21 Stunnel HTTP for mw111 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:22:45] PROBLEM - cp30 Stunnel HTTP for mw111 on cp30 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 328 bytes in 0.282 second response time [18:23:07] [02miraheze/MatomoAnalytics] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/MatomoAnalytics/compare/a08cd97dbb7d...7a0e4c54ec2c [18:23:07] [url] Comparing a08cd97dbb7d...7a0e4c54ec2c · miraheze/MatomoAnalytics · GitHub | github.com [18:23:08] [02miraheze/MatomoAnalytics] 07Universal-Omega 037a0e4c5 - Update ext.matomoanalytics.oouiform.ooui.less [18:23:12] [02MatomoAnalytics] 07Universal-Omega synchronize pull request 03#79: Modernise MatomoAnalyticsOOUIForm - 13https://github.com/miraheze/MatomoAnalytics/pull/79 [18:23:12] [url] Page not found · GitHub · GitHub | github.com [18:23:43] PROBLEM - mw111 MediaWiki Rendering on mw111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:24:09] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.44, 3.66, 3.93 [18:24:23] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.72, 11.78, 11.16 [18:24:26] [02miraheze/MatomoAnalytics] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/MatomoAnalytics/compare/7a0e4c54ec2c...7007e236c829 [18:24:27] [url] Comparing 7a0e4c54ec2c...7007e236c829 · miraheze/MatomoAnalytics · GitHub | github.com [18:24:28] [02miraheze/MatomoAnalytics] 07Universal-Omega 037007e23 - Update CHANGELOG.md [18:24:29] [02MatomoAnalytics] 07Universal-Omega synchronize pull request 03#79: Modernise MatomoAnalyticsOOUIForm - 13https://github.com/miraheze/MatomoAnalytics/pull/79 [18:24:30] [url] Page not found · GitHub · GitHub | github.com [18:24:38] RECOVERY - cp21 Stunnel HTTP for mw111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 6.765 second response time [18:24:40] miraheze/MatomoAnalytics - Universal-Omega the build has errored. [18:24:42] [02miraheze/MatomoAnalytics] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/MatomoAnalytics/compare/7007e236c829...58077cba54e1 [18:24:43] [url] Comparing 7007e236c829...58077cba54e1 · miraheze/MatomoAnalytics · GitHub | github.com [18:24:44] [02miraheze/MatomoAnalytics] 07Universal-Omega 0358077cb - Update extension.json [18:24:45] [02MatomoAnalytics] 07Universal-Omega synchronize pull request 03#79: Modernise MatomoAnalyticsOOUIForm - 13https://github.com/miraheze/MatomoAnalytics/pull/79 [18:24:46] [url] Page not found · GitHub · GitHub | github.com [18:24:46] RECOVERY - cp30 Stunnel HTTP for mw111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 7.122 second response time [18:24:57] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.28, 9.67, 8.73 [18:25:50] miraheze/MatomoAnalytics - Universal-Omega the build has errored. [18:26:04] [02miraheze/MatomoAnalytics] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/MatomoAnalytics/compare/58077cba54e1...7a54dce4c05a [18:26:05] [url] Comparing 58077cba54e1...7a54dce4c05a · miraheze/MatomoAnalytics · GitHub | github.com [18:26:06] [02miraheze/MatomoAnalytics] 07Universal-Omega 037a54dce - Update extension.json [18:26:08] [02MatomoAnalytics] 07Universal-Omega synchronize pull request 03#79: Modernise MatomoAnalyticsOOUIForm - 13https://github.com/miraheze/MatomoAnalytics/pull/79 [18:26:08] [url] Page not found · GitHub · GitHub | github.com [18:26:09] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.46, 4.08, 4.05 [18:26:22] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.55, 11.66, 11.19 [18:26:52] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.76, 9.21, 8.69 [18:27:12] miraheze/MatomoAnalytics - Universal-Omega the build has errored. [18:27:49] RECOVERY - mw111 MediaWiki Rendering on mw111 is OK: HTTP OK: HTTP/1.1 200 OK - 27096 bytes in 2.483 second response time [18:28:09] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.95, 3.80, 3.96 [18:28:20] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.45, 3.36, 3.96 [18:28:21] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.69, 12.07, 11.40 [18:28:38] miraheze/MatomoAnalytics - Universal-Omega the build has errored. [18:28:55] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.43, 2.11, 1.76 [18:29:57] [02miraheze/MatomoAnalytics] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/MatomoAnalytics/compare/7a54dce4c05a...a6ac768081af [18:29:58] [url] Comparing 7a54dce4c05a...a6ac768081af · miraheze/MatomoAnalytics · GitHub | github.com [18:29:59] [02miraheze/MatomoAnalytics] 07Universal-Omega 03a6ac768 - Update MatomoAnalyticsViewer.php [18:30:09] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.77, 4.14, 4.06 [18:30:19] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.32, 11.64, 11.32 [18:30:22] [02MatomoAnalytics] 07Universal-Omega synchronize pull request 03#79: Modernise MatomoAnalyticsOOUIForm - 13https://github.com/miraheze/MatomoAnalytics/pull/79 [18:30:23] [url] Page not found · GitHub · GitHub | github.com [18:30:42] [02miraheze/MatomoAnalytics] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/MatomoAnalytics/compare/a6ac768081af...774251f29973 [18:30:43] [url] Comparing a6ac768081af...774251f29973 · miraheze/MatomoAnalytics · GitHub | github.com [18:30:44] [02miraheze/MatomoAnalytics] 07Universal-Omega 03774251f - Update MatomoAnalyticsViewer.php [18:30:46] [02MatomoAnalytics] 07Universal-Omega synchronize pull request 03#79: Modernise MatomoAnalyticsOOUIForm - 13https://github.com/miraheze/MatomoAnalytics/pull/79 [18:30:46] [url] Page not found · GitHub · GitHub | github.com [18:32:09] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.20, 3.34, 3.77 [18:32:18] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.48, 11.98, 11.48 [18:32:43] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.25, 1.72, 1.68 [18:33:29] miraheze/MatomoAnalytics - Universal-Omega the build has errored. [18:34:20] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.43, 3.45, 3.76 [18:34:42] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.20, 1.55, 1.62 [18:36:20] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.25, 3.42, 3.71 [18:36:45] [02miraheze/MatomoAnalytics] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/MatomoAnalytics/compare/774251f29973...5c860d0e0cc8 [18:36:46] [url] Comparing 774251f29973...5c860d0e0cc8 · miraheze/MatomoAnalytics · GitHub | github.com [18:36:47] [02miraheze/MatomoAnalytics] 07Universal-Omega 035c860d0 - Update package-lock.json [18:36:48] [02MatomoAnalytics] 07Universal-Omega synchronize pull request 03#79: Modernise MatomoAnalyticsOOUIForm - 13https://github.com/miraheze/MatomoAnalytics/pull/79 [18:36:49] [url] Page not found · GitHub · GitHub | github.com [18:37:55] [02miraheze/MatomoAnalytics] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/MatomoAnalytics/compare/5c860d0e0cc8...6434e01b238d [18:37:55] [url] Comparing 5c860d0e0cc8...6434e01b238d · miraheze/MatomoAnalytics · GitHub | github.com [18:37:56] [02miraheze/MatomoAnalytics] 07Universal-Omega 036434e01 - Update package.json [18:37:58] [02MatomoAnalytics] 07Universal-Omega synchronize pull request 03#79: Modernise MatomoAnalyticsOOUIForm - 13https://github.com/miraheze/MatomoAnalytics/pull/79 [18:37:58] [url] Page not found · GitHub · GitHub | github.com [18:38:20] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.48, 3.90, 3.86 [18:40:09] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.08, 4.13, 3.94 [18:41:16] miraheze/MatomoAnalytics - Universal-Omega the build passed. [18:42:09] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.45, 3.48, 3.72 [18:42:20] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.39, 3.93, 3.89 [18:44:11] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.26, 11.59, 11.69 [18:44:20] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.05, 4.29, 4.02 [18:45:20] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/commit/03c4fab96384 [18:45:22] [02miraheze/CreateWiki] 07Universal-Omega 0303c4fab - Update CreateWikiOOUIForm.php [18:45:23] [02CreateWiki] 07Universal-Omega created branch 03Universal-Omega-patch-2 - 13https://github.com/miraheze/CreateWiki [18:45:24] [url] Page not found · GitHub · GitHub | github.com [18:45:32] [02CreateWiki] 07Universal-Omega opened pull request 03#324: Modernise CreateWikiOOUIForm - 13https://github.com/miraheze/CreateWiki/pull/324 [18:45:32] ... [18:45:33] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.87, 9.96, 9.46 [18:46:10] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.33, 11.91, 11.79 [18:46:54] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/03c4fab96384...d222ecf95e10 [18:46:55] [url] Comparing 03c4fab96384...d222ecf95e10 · miraheze/CreateWiki · GitHub | github.com [18:46:56] [02miraheze/CreateWiki] 07Universal-Omega 03d222ecf - Update extension.json [18:46:57] [02CreateWiki] 07Universal-Omega synchronize pull request 03#324: Modernise CreateWikiOOUIForm - 13https://github.com/miraheze/CreateWiki/pull/324 [18:46:58] [url] Page not found · GitHub · GitHub | github.com [18:47:25] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-1/±0] 13https://github.com/miraheze/CreateWiki/compare/d222ecf95e10...0b966a856cbb [18:47:25] [url] Comparing d222ecf95e10...0b966a856cbb · miraheze/CreateWiki · GitHub | github.com [18:47:26] [02miraheze/CreateWiki] 07Universal-Omega 030b966a8 - Delete ext.createwiki.oouiform.edit.ooui.js [18:47:27] [02CreateWiki] 07Universal-Omega synchronize pull request 03#324: Modernise CreateWikiOOUIForm - 13https://github.com/miraheze/CreateWiki/pull/324 [18:47:28] [url] Page not found · GitHub · GitHub | github.com [18:49:04] [02miraheze/CreateWiki] 07github-actions[bot] pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/0b966a856cbb...11fe3088d33b [18:49:04] [url] Comparing 0b966a856cbb...11fe3088d33b · miraheze/CreateWiki · GitHub | github.com [18:49:05] [02miraheze/CreateWiki] 07github-actions 0311fe308 - CI: lint code to MediaWiki standards [18:49:07] [02CreateWiki] 07github-actions[bot] synchronize pull request 03#324: Modernise CreateWikiOOUIForm - 13https://github.com/miraheze/CreateWiki/pull/324 [18:49:07] [url] Page not found · GitHub · GitHub | github.com [18:49:28] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 9.43, 10.13, 9.69 [18:50:10] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.93, 11.98, 11.85 [18:50:20] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.77, 3.71, 3.86 [18:50:26] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.46, 10.37, 9.44 [18:50:53] miraheze/CreateWiki - Universal-Omega the build has errored. [18:52:09] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.72, 12.72, 12.14 [18:54:26] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 9.89, 10.20, 9.58 [18:54:28] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/11fe3088d33b...d8ab423d3323 [18:54:28] [url] Comparing 11fe3088d33b...d8ab423d3323 · miraheze/CreateWiki · GitHub | github.com [18:54:29] [02miraheze/CreateWiki] 07Universal-Omega 03d8ab423 - Update ext.createwiki.oouiform.ooui.js [18:54:31] [02CreateWiki] 07Universal-Omega synchronize pull request 03#324: Modernise CreateWikiOOUIForm - 13https://github.com/miraheze/CreateWiki/pull/324 [18:54:31] [url] Page not found · GitHub · GitHub | github.com [18:56:09] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.05, 2.88, 3.33 [18:57:45] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/d8ab423d3323...cdec5b706ab4 [18:57:46] [url] Comparing d8ab423d3323...cdec5b706ab4 · miraheze/CreateWiki · GitHub | github.com [18:57:47] [02miraheze/CreateWiki] 07Universal-Omega 03cdec5b7 - Update ext.createwiki.oouiform.ooui.less [18:57:48] [02CreateWiki] 07Universal-Omega synchronize pull request 03#324: Modernise CreateWikiOOUIForm - 13https://github.com/miraheze/CreateWiki/pull/324 [18:57:49] [url] Page not found · GitHub · GitHub | github.com [19:00:13] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/cdec5b706ab4...080a81becfdf [19:00:14] [url] Comparing cdec5b706ab4...080a81becfdf · miraheze/CreateWiki · GitHub | github.com [19:00:15] [02miraheze/CreateWiki] 07Universal-Omega 03080a81b - Update SpecialRequestWikiQueue.php [19:00:17] [02CreateWiki] 07Universal-Omega synchronize pull request 03#324: Modernise CreateWikiOOUIForm - 13https://github.com/miraheze/CreateWiki/pull/324 [19:00:17] [url] Page not found · GitHub · GitHub | github.com [19:02:09] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.96, 3.50, 3.45 [19:02:39] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/080a81becfdf...0075fe59f668 [19:02:40] [url] Comparing 080a81becfdf...0075fe59f668 · miraheze/CreateWiki · GitHub | github.com [19:02:41] [02miraheze/CreateWiki] 07Universal-Omega 030075fe5 - Update RequestWikiRequestViewer.php [19:02:42] [02CreateWiki] 07Universal-Omega synchronize pull request 03#324: Modernise CreateWikiOOUIForm - 13https://github.com/miraheze/CreateWiki/pull/324 [19:02:43] [url] Page not found · GitHub · GitHub | github.com [19:04:06] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.97, 11.55, 11.96 [19:04:21] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.57, 7.28, 6.24 [19:05:17] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.85, 10.03, 9.40 [19:06:05] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 14.35, 12.45, 12.23 [19:06:16] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.46, 7.14, 6.30 [19:06:22] PROBLEM - cp30 Stunnel HTTP for mw111 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:06:43] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-3 [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/commit/165d27b5544d [19:06:45] [02miraheze/MirahezeMagic] 07Universal-Omega 03165d27b - Update MirahezeSurvey modules [19:06:46] [02MirahezeMagic] 07Universal-Omega created branch 03Universal-Omega-patch-3 - 13https://github.com/miraheze/MirahezeMagic [19:06:47] [url] Page not found · GitHub · GitHub | github.com [19:06:53] [02MirahezeMagic] 07Universal-Omega opened pull request 03#350: Update MirahezeSurvey modules - 13https://github.com/miraheze/MirahezeMagic/pull/350 [19:06:54] ... [19:07:14] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 10.09, 9.91, 9.42 [19:08:08] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.95, 3.23, 3.35 [19:08:17] RECOVERY - cp30 Stunnel HTTP for mw111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.321 second response time [19:10:34] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.00, 3.69, 3.94 [19:10:52] miraheze/CreateWiki - Universal-Omega the build passed. [19:11:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.75, 9.26, 8.77 [19:12:34] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.25, 3.87, 3.97 [19:13:13] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.39, 10.56, 9.51 [19:13:22] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 9.88, 9.46, 8.91 [19:13:53] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.74, 6.73, 6.49 [19:14:00] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.06, 11.16, 11.86 [19:15:11] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.13, 10.47, 9.62 [19:15:35] [02miraheze/MatomoAnalytics] 07Universal-Omega pushed 031 commit to 03master [+0/-1/±9] 13https://github.com/miraheze/MatomoAnalytics/compare/d4d335858e1f...79ddfa3c9104 [19:15:36] [url] Comparing d4d335858e1f...79ddfa3c9104 · miraheze/MatomoAnalytics · GitHub | github.com [19:15:37] [02miraheze/MatomoAnalytics] 07Universal-Omega 0379ddfa3 - Modernise MatomoAnalyticsOOUIForm (#79) [19:15:38] [02MatomoAnalytics] 07Universal-Omega closed pull request 03#79: Modernise MatomoAnalyticsOOUIForm - 13https://github.com/miraheze/MatomoAnalytics/pull/79 [19:15:39] [url] Page not found · GitHub · GitHub | github.com [19:15:40] [02miraheze/MatomoAnalytics] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [19:15:41] [02MatomoAnalytics] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/MatomoAnalytics [19:15:42] [url] Page not found · GitHub · GitHub | github.com [19:15:44] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 3.36, 4.70, 2.91 [19:16:03] miraheze/MirahezeMagic - Universal-Omega the build passed. [19:16:34] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.74, 3.56, 3.86 [19:17:09] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.43, 9.93, 9.53 [19:18:20] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.73, 4.05, 3.78 [19:18:34] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.49, 4.36, 4.11 [19:18:52] miraheze/MatomoAnalytics - Universal-Omega the build passed. [19:19:49] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 5.89, 6.87, 6.66 [19:21:49] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 6.77, 6.75, 6.63 [19:21:55] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.50, 10.81, 11.21 [19:22:20] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.50, 3.84, 3.75 [19:23:22] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-1/±6] 13https://github.com/miraheze/CreateWiki/compare/be8c885153a8...e281042fa060 [19:23:22] [url] Comparing be8c885153a8...e281042fa060 · miraheze/CreateWiki · GitHub | github.com [19:23:23] [02miraheze/CreateWiki] 07Universal-Omega 03e281042 - Modernise CreateWikiOOUIForm (#324) [19:23:25] [02miraheze/CreateWiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 [19:23:26] [02CreateWiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 - 13https://github.com/miraheze/CreateWiki [19:23:27] [url] Page not found · GitHub · GitHub | github.com [19:23:28] [02CreateWiki] 07Universal-Omega closed pull request 03#324: Modernise CreateWikiOOUIForm - 13https://github.com/miraheze/CreateWiki/pull/324 [19:23:29] ... [19:23:30] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/7b0944aff5fd...171f5782195a [19:23:30] [url] Comparing 7b0944aff5fd...171f5782195a · miraheze/MirahezeMagic · GitHub | github.com [19:23:31] [02miraheze/MirahezeMagic] 07Universal-Omega 03171f578 - Update MirahezeSurvey modules (#350) [19:23:33] [02MirahezeMagic] 07Universal-Omega closed pull request 03#350: Update MirahezeSurvey modules - 13https://github.com/miraheze/MirahezeMagic/pull/350 [19:23:33] [url] Page not found · GitHub · GitHub | github.com [19:23:34] [02miraheze/MirahezeMagic] 07Universal-Omega deleted branch 03Universal-Omega-patch-3 [19:23:36] [02MirahezeMagic] 07Universal-Omega deleted branch 03Universal-Omega-patch-3 - 13https://github.com/miraheze/MirahezeMagic [19:23:36] [url] Page not found · GitHub · GitHub | github.com [19:25:53] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.19, 11.35, 11.37 [19:26:20] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.99, 3.88, 3.74 [19:27:46] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_38 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/2a9470c46df9...e869f9ea5729 [19:27:47] [url] Comparing 2a9470c46df9...e869f9ea5729 · miraheze/mediawiki · GitHub | github.com [19:27:48] [02miraheze/mediawiki] 07Universal-Omega 03e869f9e - Update CreateWiki [19:27:51] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.71, 11.70, 11.49 [19:28:18] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_38 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/e869f9ea5729...e41d409b67ea [19:28:19] [url] Comparing e869f9ea5729...e41d409b67ea · miraheze/mediawiki · GitHub | github.com [19:28:20] [02miraheze/mediawiki] 07Universal-Omega 03e41d409 - Update MirahezeMagic [19:28:20] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.25, 3.36, 3.58 [19:28:44] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.83, 3.42, 3.37 [19:28:52] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_38 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/e41d409b67ea...f8c71713f692 [19:28:53] [url] Comparing e41d409b67ea...f8c71713f692 · miraheze/mediawiki · GitHub | github.com [19:28:54] [02miraheze/mediawiki] 07Universal-Omega 03f8c7171 - Update IncidentReporting [19:29:26] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_38 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/f8c71713f692...97b73e75d9bc [19:29:27] [url] Comparing f8c71713f692...97b73e75d9bc · miraheze/mediawiki · GitHub | github.com [19:29:27] [02miraheze/mediawiki] 07Universal-Omega 0397b73e7 - Update MatomoAnalytics [19:29:50] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.27, 11.66, 11.52 [19:30:07] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk [19:30:20] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.46, 3.60, 3.62 [19:30:32] !log [universalomega@test101] starting deploy of {'world': True} to all [19:30:34] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.45, 3.61, 3.98 [19:30:41] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.00, 3.38, 3.36 [19:30:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:30:56] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 0.74, 1.33, 1.99 [19:31:33] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 13.36, 10.84, 10.08 [19:31:49] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.50, 12.04, 11.67 [19:32:20] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.81, 3.36, 3.54 [19:32:34] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.34, 4.01, 4.09 [19:33:10] miraheze/MirahezeMagic - Universal-Omega the build passed. [19:33:19] miraheze/CreateWiki - Universal-Omega the build passed. [19:33:33] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.40, 10.80, 10.18 [19:33:48] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.39, 11.40, 11.49 [19:34:20] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.56, 2.71, 3.28 [19:34:34] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.51, 3.46, 3.88 [19:34:43] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.52, 0.89, 1.66 [19:35:47] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.52, 12.23, 11.78 [19:35:52] !log [universalomega@mwtask111] starting deploy of {'world': True} to all [19:36:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:37:22] !log [universalomega@test101] finished deploy of {'world': True} to all - SUCCESS in 409s [19:37:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:37:45] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.63, 11.45, 11.54 [19:38:34] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.59, 3.68, 3.83 [19:39:33] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 9.21, 9.72, 9.92 [19:40:06] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.67, 1.77, 1.43 [19:40:34] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.72, 3.74, 3.84 [19:42:06] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.17, 1.65, 1.43 [19:42:34] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.08, 3.82, 3.84 [19:43:42] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.33, 11.57, 11.53 [19:44:34] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.25, 3.16, 3.59 [19:45:41] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.77, 10.68, 11.22 [19:48:34] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.00, 2.92, 3.37 [19:48:50] !log [universalomega@mwtask111] finished deploy of {'world': True} to all - SUCCESS in 777s [19:48:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:49:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.50, 10.60, 9.85 [19:50:26] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.38, 9.93, 8.81 [19:52:26] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 10.10, 9.81, 8.90 [19:52:34] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.94, 4.29, 3.80 [19:53:13] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.35, 4.23, 3.59 [19:54:42] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.94, 1.69, 1.50 [19:55:09] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.32, 3.85, 3.52 [19:56:34] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.08, 3.46, 3.60 [19:56:42] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.19, 1.86, 1.58 [19:56:56] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-6 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/216d9758ef1e [19:56:58] [02miraheze/mw-config] 07Universal-Omega 03216d975 - Return current set servers if already set in SIteConfiguration [19:56:59] [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-6 - 13https://github.com/miraheze/mw-config [19:57:00] [url] Page not found · GitHub · GitHub | github.com [19:57:22] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 9.41, 10.10, 9.93 [19:57:36] [02mw-config] 07Universal-Omega opened pull request 03#4805: Return current set servers if already set in SIteConfiguration - 13https://github.com/miraheze/mw-config/pull/4805 [19:57:37] [url] Page not found · GitHub · GitHub | github.com [19:57:39] !log [universalomega@test101] starting deploy of {'pull': 'config', 'branch': 'Universal-Omega-patch-6', 'config': True} to all [19:57:43] !log [universalomega@test101] finished deploy of {'pull': 'config', 'branch': 'Universal-Omega-patch-6', 'config': True} to all - SUCCESS in 4s [19:57:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:58:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:58:24] [02miraheze/mw-config] 07github-actions[bot] pushed 031 commit to 03Universal-Omega-patch-6 [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/216d9758ef1e...a5c306136b7c [19:58:25] [url] Comparing 216d9758ef1e...a5c306136b7c · miraheze/mw-config · GitHub | github.com [19:58:26] [02miraheze/mw-config] 07github-actions 03a5c3061 - CI: lint code to MediaWiki standards [19:58:27] [02mw-config] 07github-actions[bot] synchronize pull request 03#4805: Return current set servers if already set in SIteConfiguration - 13https://github.com/miraheze/mw-config/pull/4805 [19:58:28] [url] Page not found · GitHub · GitHub | github.com [19:58:34] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.66, 4.45, 3.98 [19:58:42] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.03, 1.49, 1.47 [19:59:01] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.77, 4.81, 3.94 [19:59:02] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk [19:59:05] miraheze/mw-config - Universal-Omega the build passed. [20:00:09] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.33, 3.68, 3.43 [20:02:19] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.84, 11.24, 10.32 [20:04:09] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.18, 3.16, 3.30 [20:04:17] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.86, 10.94, 10.34 [20:04:48] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.21, 3.87, 3.78 [20:05:09] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-6 [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/a5c306136b7c...6ffa4564dd5f [20:05:10] [url] Comparing a5c306136b7c...6ffa4564dd5f · miraheze/mw-config · GitHub | github.com [20:05:11] [02miraheze/mw-config] 07Universal-Omega 036ffa456 - Update MirahezeFunctions.php [20:05:12] [02mw-config] 07Universal-Omega synchronize pull request 03#4805: Return current set servers if already set in SIteConfiguration - 13https://github.com/miraheze/mw-config/pull/4805 [20:05:13] [url] Page not found · GitHub · GitHub | github.com [20:05:22] !log [universalomega@test101] starting deploy of {'pull': 'config', 'branch': 'Universal-Omega-patch-6', 'config': True} to all [20:05:26] !log [universalomega@test101] finished deploy of {'pull': 'config', 'branch': 'Universal-Omega-patch-6', 'config': True} to all - SUCCESS in 3s [20:05:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:05:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:06:14] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 9.14, 10.02, 10.05 [20:06:14] miraheze/mw-config - Universal-Omega the build passed. [20:08:09] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.51, 4.01, 3.59 [20:08:34] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.20, 3.88, 3.98 [20:08:40] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.37, 4.09, 3.85 [20:09:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.81, 10.29, 10.07 [20:10:34] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.60, 4.27, 4.12 [20:11:14] PROBLEM - test101 JobChron Service on test101 is CRITICAL: PROCS CRITICAL: 0 processes with args 'redisJobChronService' [20:11:22] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.45, 11.18, 10.43 [20:11:35] PROBLEM - test101 JobRunner Service on test101 is CRITICAL: PROCS CRITICAL: 0 processes with args 'redisJobRunnerService' [20:12:08] PROBLEM - test101 Redis Process on test101 is CRITICAL: PROCS CRITICAL: 0 processes with args 'redis-server' [20:12:09] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.06, 3.86, 3.64 [20:12:11] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.83, 10.85, 9.52 [20:13:00] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.93, 10.95, 10.45 [20:13:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.69, 10.79, 10.39 [20:14:09] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.81, 10.10, 9.41 [20:16:23] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.65, 3.78, 3.93 [20:17:22] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.64, 10.00, 10.16 [20:17:22] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 14.05, 11.65, 10.99 [20:18:09] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.03, 3.88, 3.71 [20:18:14] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.35, 9.90, 9.02 [20:18:20] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.15, 4.00, 3.99 [20:19:21] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.62, 11.43, 10.98 [20:19:42] [02mw-config] 07Universal-Omega labeled pull request 03#4805: Return current set servers if already set in SIteConfiguration - 13https://github.com/miraheze/mw-config/pull/4805 [20:19:43] [url] Page not found · GitHub · GitHub | github.com [20:19:45] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/b185114e280f...28ac5332c0d2 [20:19:46] [url] Comparing b185114e280f...28ac5332c0d2 · miraheze/mw-config · GitHub | github.com [20:19:47] [02miraheze/mw-config] 07Universal-Omega 0328ac533 - Return current set servers if already set in SIteConfiguration (#4805) [20:19:49] [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-6 [20:19:50] [02mw-config] 07Universal-Omega closed pull request 03#4805: Return current set servers if already set in SIteConfiguration - 13https://github.com/miraheze/mw-config/pull/4805 [20:19:50] ... [20:19:52] [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-6 - 13https://github.com/miraheze/mw-config [20:19:52] [url] Page not found · GitHub · GitHub | github.com [20:20:05] !log [universalomega@test101] starting deploy of {'pull': 'config', 'branch': 'master', 'config': True} to all [20:20:07] !log [universalomega@test101] finished deploy of {'pull': 'config', 'branch': 'master', 'config': True} to all - SUCCESS in 2s [20:20:09] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.70, 3.31, 3.51 [20:20:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:20:14] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.18, 8.79, 8.74 [20:20:20] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.64, 3.71, 3.87 [20:20:26] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.01, 10.13, 9.29 [20:20:33] !log [universalomega@mwtask111] starting deploy of {'pull': 'config', 'config': True} to all [20:20:49] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 10.15, 10.04, 10.19 [20:20:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:21:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:21:06] miraheze/mw-config - Universal-Omega the build passed. [20:21:07] !log [universalomega@mwtask111] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 33s [20:21:19] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.31, 11.75, 11.15 [20:21:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:22:20] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 3.81, 4.03, 3.99 [20:22:26] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 9.46, 9.90, 9.31 [20:23:14] RECOVERY - test101 JobChron Service on test101 is OK: PROCS OK: 1 process with args 'redisJobChronService' [20:23:18] PROBLEM - cp31 Stunnel HTTP for mw111 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:23:18] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.20, 11.93, 11.32 [20:23:22] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.28, 10.16, 10.22 [20:23:35] RECOVERY - test101 JobRunner Service on test101 is OK: PROCS OK: 1 process with args 'redisJobRunnerService' [20:23:37] PROBLEM - cp30 Stunnel HTTP for mw111 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:23:38] PROBLEM - cp21 Stunnel HTTP for mw111 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:23:56] PROBLEM - mw111 MediaWiki Rendering on mw111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:24:08] RECOVERY - test101 Redis Process on test101 is OK: PROCS OK: 1 process with args 'redis-server' [20:24:09] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.29, 3.93, 3.74 [20:24:12] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:25:17] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.59, 12.54, 11.62 [20:25:22] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.78, 9.56, 9.98 [20:25:45] RECOVERY - cp21 Stunnel HTTP for mw111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 9.448 second response time [20:26:09] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.81, 3.73, 3.68 [20:26:16] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 7.232 second response time [20:26:20] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.71, 3.91, 4.00 [20:27:23] RECOVERY - cp31 Stunnel HTTP for mw111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.416 second response time [20:27:37] RECOVERY - cp30 Stunnel HTTP for mw111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.305 second response time [20:28:00] RECOVERY - mw111 MediaWiki Rendering on mw111 is OK: HTTP OK: HTTP/1.1 200 OK - 27096 bytes in 1.095 second response time [20:29:15] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.25, 11.79, 11.57 [20:33:12] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.21, 11.89, 11.63 [20:33:19] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.52, 10.32, 9.73 [20:34:27] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.51, 10.28, 10.14 [20:34:34] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.82, 3.57, 3.91 [20:35:14] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 8.71, 9.66, 9.56 [20:36:24] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.19, 9.48, 9.86 [20:38:09] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.05, 3.39, 3.48 [20:38:34] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.85, 3.87, 3.89 [20:40:09] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.89, 3.88, 3.67 [20:40:20] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.29, 3.91, 3.85 [20:42:20] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.05, 3.21, 3.60 [20:44:09] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.85, 3.84, 3.66 [20:44:20] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.50, 4.02, 3.83 [20:46:20] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.38, 3.80, 3.78 [20:47:49] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.91, 6.96, 6.19 [20:48:09] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.01, 3.53, 3.59 [20:49:14] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.27, 1.49, 1.99 [20:51:49] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 9.83, 7.58, 6.57 [20:52:00] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.96, 10.37, 9.80 [20:52:34] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.29, 3.51, 3.90 [20:53:14] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 0.53, 1.05, 1.70 [20:53:49] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.40, 6.76, 6.40 [20:54:20] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.68, 3.98, 3.83 [20:55:54] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 9.59, 9.93, 9.77 [20:56:20] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.37, 3.28, 3.58 [20:57:11] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.01, 11.56, 11.87 [20:58:09] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.70, 3.08, 3.38 [20:58:20] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.90, 2.78, 3.36 [20:59:11] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.68, 12.13, 12.05 [20:59:49] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.90, 7.08, 6.54 [21:01:49] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 6.33, 6.80, 6.51 [21:03:41] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.93, 10.36, 9.95 [21:04:52] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/171f5782195a...d38b6aea52fc [21:04:53] [url] Comparing 171f5782195a...d38b6aea52fc · miraheze/MirahezeMagic · GitHub | github.com [21:04:54] [02miraheze/MirahezeMagic] 07Universal-Omega 03d38b6ae - Move modules to execute [21:05:38] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.45, 9.73, 9.77 [21:06:34] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.91, 3.52, 3.57 [21:07:11] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.16, 11.24, 11.75 [21:07:51] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query dnd.bellinrattin.it. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [21:10:09] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.74, 4.66, 3.86 [21:10:34] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.59, 3.95, 3.76 [21:11:11] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.72, 12.12, 11.96 [21:12:34] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.92, 4.20, 3.87 [21:14:07] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.70, 10.34, 9.34 [21:14:21] PROBLEM - lakehub.ga - LetsEncrypt on sslhost is CRITICAL: connect to address lakehub.ga and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [21:14:37] miraheze/MirahezeMagic - Universal-Omega the build passed. [21:15:11] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.68, 11.81, 11.86 [21:16:09] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.73, 3.57, 3.64 [21:16:34] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.93, 3.89, 3.80 [21:17:46] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.83, 1.48, 1.18 [21:18:02] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.60, 9.64, 9.30 [21:18:34] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.45, 3.95, 3.83 [21:20:09] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.13, 4.29, 3.87 [21:20:56] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.88, 3.47, 3.25 [21:21:57] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_38 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/97b73e75d9bc...508d1d535c0f [21:21:57] [url] Comparing 97b73e75d9bc...508d1d535c0f · miraheze/mediawiki · GitHub | github.com [21:21:58] [02miraheze/mediawiki] 07Universal-Omega 03508d1d5 - Update MirahezeMagic [21:22:52] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.93, 4.29, 3.57 [21:23:11] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.90, 11.95, 11.78 [21:23:41] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.33, 1.79, 1.40 [21:24:09] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.18, 3.86, 3.81 [21:25:11] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.83, 11.85, 11.77 [21:25:40] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.33, 1.56, 1.36 [21:26:44] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.67, 3.66, 3.50 [21:28:09] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.76, 4.34, 3.98 [21:28:32] PROBLEM - lakehub.ga - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lakehub.ga could not be found [21:29:11] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.28, 11.65, 11.65 [21:32:09] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.22, 3.61, 3.80 [21:32:32] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.63, 4.20, 3.78 [21:34:14] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.15, 10.22, 8.84 [21:36:09] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.14, 3.78, 3.84 [21:36:14] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.31, 9.95, 8.90 [21:36:23] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.74, 3.69, 3.69 [21:37:11] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.56, 12.00, 11.87 [21:37:31] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp21.miraheze.org - CNAME OK [21:38:14] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.68, 8.90, 8.66 [21:40:20] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.56, 4.07, 3.82 [21:42:20] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.32, 3.71, 3.72 [21:44:09] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.65, 3.13, 3.54 [21:44:20] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.39, 3.97, 3.81 [21:44:34] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.54, 3.07, 3.85 [21:46:08] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.42, 2.86, 3.39 [21:49:02] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk [21:49:35] PROBLEM - test101 JobRunner Service on test101 is CRITICAL: PROCS CRITICAL: 0 processes with args 'redisJobRunnerService' [21:50:08] PROBLEM - test101 Redis Process on test101 is CRITICAL: PROCS CRITICAL: 0 processes with args 'redis-server' [21:50:34] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.54, 4.16, 3.98 [21:51:22] PROBLEM - test101 Puppet on test101 is WARNING: WARNING: Puppet is currently disabled, message: reason not specified, last run 22 seconds ago with 0 failures [21:51:35] RECOVERY - test101 JobRunner Service on test101 is OK: PROCS OK: 1 process with args 'redisJobRunnerService' [21:52:08] RECOVERY - test101 Redis Process on test101 is OK: PROCS OK: 1 process with args 'redis-server' [21:52:20] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.07, 3.93, 3.94 [21:52:34] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.66, 3.78, 3.86 [21:58:20] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 3.92, 4.05, 3.98 [22:00:58] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.69, 10.41, 9.94 [22:02:20] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.14, 3.93, 3.98 [22:03:11] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.01, 11.12, 10.74 [22:04:20] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 7.10, 5.05, 4.37 [22:04:34] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.35, 4.11, 3.87 [22:04:53] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.64, 9.89, 9.89 [22:05:40] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 1.33, 2.38, 1.74 [22:06:56] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.77, 3.50, 3.42 [22:07:11] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.12, 11.13, 10.81 [22:08:53] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.12, 4.23, 3.70 [22:11:29] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.76, 10.06, 9.15 [22:11:40] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.39, 10.99, 10.38 [22:11:40] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.54, 1.64, 1.66 [22:13:11] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.75, 11.46, 11.00 [22:15:11] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.96, 11.68, 11.14 [22:15:25] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.10, 9.61, 9.23 [22:16:39] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.94, 3.89, 3.78 [22:17:33] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.29, 9.50, 9.92 [22:18:33] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk [22:22:28] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.12, 3.70, 3.67 [22:22:33] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.67, 1.85, 1.44 [22:23:11] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.15, 11.48, 11.19 [22:24:24] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.12, 3.43, 3.57 [22:24:32] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.28, 1.67, 1.43 [22:25:11] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.52, 11.47, 11.22 [22:26:21] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.29, 7.04, 6.15 [22:28:16] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 4.77, 6.16, 5.92 [22:28:17] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.45, 3.62, 3.59 [22:30:13] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.73, 3.36, 3.50 [22:30:20] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.89, 3.58, 3.94 [22:32:10] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.45, 3.01, 3.35 [22:32:34] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 1.88, 3.24, 3.87 [22:35:11] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.05, 10.67, 10.78 [22:36:34] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.94, 4.09, 4.03 [22:37:11] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.26, 10.82, 10.82 [22:38:09] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.66, 3.24, 3.28 [22:38:20] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.11, 3.66, 3.75 [22:40:09] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.11, 2.79, 3.11 [22:40:20] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.55, 3.42, 3.64 [22:40:34] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.97, 3.81, 3.95 [22:45:11] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.85, 8.86, 9.94 [22:46:20] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.02, 3.51, 3.58 [22:46:34] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.13, 3.71, 3.79 [22:48:20] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.90, 3.39, 3.54 [22:48:33] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk [22:48:34] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.33, 3.69, 3.79 [22:50:09] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.21, 3.44, 3.26 [22:52:09] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.20, 3.74, 3.36 [22:54:09] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.39, 3.59, 3.35 [22:54:34] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.26, 4.31, 4.02 [22:54:51] How long do CSRF tokens stay good for on Miraheze? [22:56:09] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.88, 2.88, 3.12 [22:56:16] Shut up icinga [22:56:17] Blocked [22:56:20] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.10, 3.05, 3.38 [22:56:34] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.07, 3.85, 3.89 [22:58:34] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 9.46, 5.86, 4.61 [23:00:09] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.66, 4.55, 3.71 [23:00:20] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.63, 4.86, 4.01 [23:04:39] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 5.83, 5.01, 3.60 [23:05:11] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.66, 10.77, 10.01 [23:05:23] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.33, 2.07, 1.67 [23:06:39] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 6.01, 5.41, 3.92 [23:07:11] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.64, 11.14, 10.24 [23:09:22] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.62, 2.00, 1.74 [23:10:39] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 3.71, 5.13, 4.19 [23:12:39] RECOVERY - db112 Current Load on db112 is OK: OK - load average: 4.15, 4.80, 4.18 [23:13:21] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.25, 1.69, 1.68 [23:19:06] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.80, 1.83, 1.51 [23:19:11] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.40, 11.45, 10.72 [23:21:11] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.83, 11.01, 10.64 [23:23:03] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.12, 1.44, 1.42 [23:27:33] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk [23:28:26] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.35, 9.86, 8.71 [23:30:26] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 9.31, 9.50, 8.71 [23:30:54] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.64, 2.41, 1.79 [23:34:51] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.30, 1.74, 1.66 [23:35:11] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.92, 11.51, 11.11 [23:36:49] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.15, 1.90, 1.72 [23:37:11] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.44, 11.26, 11.08 [23:38:48] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.08, 1.64, 1.65 [23:42:35] PROBLEM - cloud10 Puppet on cloud10 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [23:44:41] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.84, 1.74, 1.68 [23:46:40] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.92, 1.44, 1.58 [23:49:11] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.31, 11.65, 11.27 [23:50:35] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.59, 2.23, 1.88 [23:51:11] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.94, 11.48, 11.26 [23:52:33] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.13, 1.83, 1.78 [23:54:31] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 5.50, 2.56, 2.01 [23:55:15] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.90, 1.59, 1.05 [23:57:14] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.28, 1.49, 1.09 [23:58:28] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 0.69, 1.63, 1.76