[00:00:31] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.24, 2.02, 1.97 [00:00:50] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.38, 3.62, 3.76 [00:02:32] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.84, 1.95, 1.96 [00:03:40] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.50, 3.40, 3.44 [00:04:32] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.95, 2.34, 2.10 [00:04:50] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.95, 4.55, 4.07 [00:05:40] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.10, 3.96, 3.63 [00:07:40] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.24, 4.27, 3.91 [00:09:37] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.93, 3.75, 3.76 [00:09:40] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.22, 3.54, 3.60 [00:10:47] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.57, 1.76, 1.99 [00:10:50] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.21, 3.85, 3.96 [00:11:33] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.40, 4.06, 3.87 [00:12:50] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.87, 4.01, 4.00 [00:13:30] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.71, 3.61, 3.73 [00:14:38] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.01, 1.76, 1.92 [00:15:26] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.42, 4.25, 3.94 [00:15:40] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.30, 4.12, 3.82 [00:17:23] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.73, 3.60, 3.74 [00:19:19] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.21, 4.02, 3.89 [00:19:40] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.34, 3.66, 3.70 [00:21:16] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.76, 3.95, 3.88 [00:22:04] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/commit/6ca5b1173d4a [00:22:05] [02miraheze/ImportDump] 07Universal-Omega 036ca5b11 - Make interwiki prefix optional [00:22:07] [02ImportDump] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/ImportDump [00:22:07] [url] Page not found · GitHub · GitHub | github.com [00:22:09] [02ImportDump] 07Universal-Omega opened pull request 03#17: Make interwiki prefix optional - 13https://github.com/miraheze/ImportDump/pull/17 [00:22:09] ... [00:22:52] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/6ca5b1173d4a...591e9d37664b [00:22:53] [url] Comparing 6ca5b1173d4a...591e9d37664b · miraheze/ImportDump · GitHub | github.com [00:22:54] [02miraheze/ImportDump] 07Universal-Omega 03591e9d3 - Update en.json [00:22:55] [02ImportDump] 07Universal-Omega synchronize pull request 03#17: Make interwiki prefix optional - 13https://github.com/miraheze/ImportDump/pull/17 [00:22:56] [url] Page not found · GitHub · GitHub | github.com [00:23:12] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.66, 4.03, 3.91 [00:24:51] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 1.92, 3.22, 3.79 [00:25:08] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.71, 3.56, 3.74 [00:27:40] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.96, 3.77, 3.62 [00:28:01] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/591e9d37664b...6d719b91e789 [00:28:02] [url] Comparing 591e9d37664b...6d719b91e789 · miraheze/ImportDump · GitHub | github.com [00:28:02] [02miraheze/ImportDump] 07Universal-Omega 036d719b9 - Update ImportDumpRequestManager.php [00:28:04] [02ImportDump] 07Universal-Omega synchronize pull request 03#17: Make interwiki prefix optional - 13https://github.com/miraheze/ImportDump/pull/17 [00:28:04] [url] Page not found · GitHub · GitHub | github.com [00:28:19] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/6d719b91e789...b392c10a02e3 [00:28:19] [url] Comparing 6d719b91e789...b392c10a02e3 · miraheze/ImportDump · GitHub | github.com [00:28:20] [02miraheze/ImportDump] 07Universal-Omega 03b392c10 - Update en.json [00:28:22] [02ImportDump] 07Universal-Omega synchronize pull request 03#17: Make interwiki prefix optional - 13https://github.com/miraheze/ImportDump/pull/17 [00:28:22] [url] Page not found · GitHub · GitHub | github.com [00:28:39] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/b392c10a02e3...a3d3ebe2d9b2 [00:28:40] [url] Comparing b392c10a02e3...a3d3ebe2d9b2 · miraheze/ImportDump · GitHub | github.com [00:28:40] [02miraheze/ImportDump] 07Universal-Omega 03a3d3ebe - Update qqq.json [00:28:42] [02ImportDump] 07Universal-Omega synchronize pull request 03#17: Make interwiki prefix optional - 13https://github.com/miraheze/ImportDump/pull/17 [00:28:42] [url] Page not found · GitHub · GitHub | github.com [00:29:40] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.40, 3.45, 3.51 [00:30:58] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.32, 3.26, 3.50 [00:31:40] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.13, 3.47, 3.49 [00:31:57] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.17, 1.67, 1.97 [00:32:02] [02ImportDump] 07Universal-Omega synchronize pull request 03#17: Make interwiki prefix optional - 13https://github.com/miraheze/ImportDump/pull/17 [00:32:02] [url] Page not found · GitHub · GitHub | github.com [00:32:03] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/a3d3ebe2d9b2...b22330b86042 [00:32:04] [url] Comparing a3d3ebe2d9b2...b22330b86042 · miraheze/ImportDump · GitHub | github.com [00:32:05] [02miraheze/ImportDump] 07Universal-Omega 03b22330b - Update ImportDumpRequestManager.php [00:32:54] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.27, 3.39, 3.52 [00:33:40] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.57, 3.00, 3.31 [00:34:31] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.62, 1.78, 2.00 [00:36:30] [02ImportDump] 07Universal-Omega synchronize pull request 03#17: Make interwiki prefix optional - 13https://github.com/miraheze/ImportDump/pull/17 [00:36:31] [url] Page not found · GitHub · GitHub | github.com [00:36:32] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/b22330b86042...d0ef4e1c345d [00:36:32] [url] Comparing b22330b86042...d0ef4e1c345d · miraheze/ImportDump · GitHub | github.com [00:36:33] [02miraheze/ImportDump] 07Universal-Omega 03d0ef4e1 - Update en.json [00:39:39] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.62, 2.06, 1.94 [00:40:40] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.22, 3.78, 3.59 [00:40:51] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.13, 3.77, 3.72 [00:44:35] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.55, 3.68, 3.46 [00:45:26] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.41, 1.97, 1.96 [00:46:33] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.32, 4.36, 3.74 [00:46:36] miraheze/ImportDump - Universal-Omega the build passed. [00:48:31] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.04, 1.77, 1.80 [00:50:39] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.39, 3.87, 3.93 [00:51:26] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.11, 1.31, 1.65 [00:52:27] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.16, 3.74, 3.78 [00:52:31] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.98, 1.99, 1.89 [00:56:50] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.71, 3.78, 4.00 [00:58:39] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.61, 2.77, 3.37 [01:00:32] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.07, 1.84, 1.84 [01:02:18] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.01, 2.83, 3.35 [01:02:31] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.47, 1.68, 1.78 [01:02:39] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.84, 3.30, 3.49 [01:03:26] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.44, 1.95, 1.71 [01:05:26] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.26, 1.62, 1.62 [01:06:39] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.41, 3.02, 3.34 [01:10:50] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.28, 3.86, 3.78 [01:12:39] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.46, 3.27, 3.42 [01:12:50] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.28, 3.72, 3.75 [01:14:31] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.28, 1.55, 1.68 [01:18:32] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.62, 2.00, 1.83 [01:18:39] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.94, 2.99, 3.32 [01:18:50] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.07, 2.80, 3.34 [01:24:32] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.75, 1.98, 1.92 [01:28:39] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.15, 3.84, 3.52 [01:28:47] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.86, 3.89, 3.25 [01:29:42] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.52, 3.61, 3.45 [01:30:39] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.52, 3.83, 3.57 [01:30:45] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.92, 3.71, 3.25 [01:31:38] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.62, 3.91, 3.57 [01:32:44] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.43, 3.76, 3.31 [01:34:39] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.81, 3.26, 3.38 [01:34:42] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.24, 3.32, 3.21 [01:35:31] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.64, 3.88, 3.68 [01:37:26] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.43, 2.22, 1.75 [01:42:32] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.33, 1.54, 1.68 [01:43:16] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.98, 2.84, 3.30 [01:43:26] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.86, 1.64, 1.67 [01:48:31] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.49, 2.03, 1.84 [01:49:01] PROBLEM - www.wikitipp.de - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query www.wikitipp.de. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [01:50:18] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.21, 1.89, 1.74 [01:52:14] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.60, 1.77, 1.72 [01:56:05] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.70, 2.12, 1.86 [01:58:00] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.30, 1.75, 1.75 [01:59:15] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.85, 3.80, 3.23 [02:01:13] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.21, 3.17, 3.06 [02:02:32] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.50, 1.85, 1.99 [02:03:47] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.30, 1.95, 1.84 [02:05:04] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.32, 1.94, 1.49 [02:07:53] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.92, 3.97, 3.46 [02:09:04] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.14, 1.75, 1.54 [02:09:33] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.27, 1.94, 1.94 [02:11:04] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.78, 1.41, 1.43 [02:15:39] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.07, 4.41, 3.72 [02:16:32] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.35, 3.42, 3.28 [02:18:29] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.55, 3.18, 3.22 [02:18:32] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.60, 2.08, 1.99 [02:21:04] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.93, 1.92, 1.62 [02:21:26] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 12.47, 4.94, 2.93 [02:22:24] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 8.30, 5.38, 4.03 [02:22:47] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.22, 4.53, 3.62 [02:23:04] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.60, 1.41, 1.47 [02:24:32] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.70, 1.98, 1.99 [02:35:00] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.87, 9.63, 7.98 [02:37:00] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 9.34, 9.38, 8.08 [02:42:31] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.05, 1.83, 1.83 [02:43:26] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.74, 1.64, 2.00 [02:44:32] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.79, 1.82, 1.82 [02:45:26] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.50, 2.09, 2.13 [02:47:01] RECOVERY - www.wikitipp.de - reverse DNS on sslhost is OK: SSL OK - www.wikitipp.de reverse DNS resolves to cp21.miraheze.org - CNAME OK [02:47:26] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.23, 1.74, 1.99 [02:48:32] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.44, 2.06, 1.91 [02:51:26] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.63, 2.11, 2.07 [02:52:19] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.74, 3.39, 3.98 [02:55:26] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.18, 1.86, 2.00 [02:56:32] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.73, 1.96, 1.97 [02:58:13] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.27, 4.19, 4.05 [03:01:26] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.53, 1.18, 1.66 [03:06:31] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.38, 1.46, 1.69 [03:08:04] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.70, 3.89, 4.00 [03:09:03] PROBLEM - bast121 NTP time on bast121 is CRITICAL: NTP CRITICAL: Offset 0.5944933891 secs [03:10:39] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.03, 3.50, 4.00 [03:13:58] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.19, 3.60, 3.79 [03:14:39] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.83, 4.42, 4.21 [03:17:54] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.98, 3.49, 3.72 [03:20:32] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.92, 2.41, 1.99 [03:22:39] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.61, 3.42, 3.88 [03:26:32] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.54, 1.95, 1.94 [03:26:39] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.24, 4.00, 4.02 [03:27:45] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.55, 3.70, 3.59 [03:32:32] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.09, 1.94, 1.92 [03:32:39] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.95, 3.63, 3.88 [03:33:40] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.69, 3.75, 3.64 [03:38:03] PROBLEM - wiki.mistleague.io - LetsEncrypt on sslhost is CRITICAL: connect to address wiki.mistleague.io and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [03:38:39] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.66, 3.70, 3.77 [03:39:40] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.19, 4.29, 3.81 [03:41:03] RECOVERY - bast121 NTP time on bast121 is OK: NTP OK: Offset -0.007194072008 secs [03:41:29] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.47, 1.76, 1.44 [03:41:40] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.07, 3.80, 3.70 [03:42:39] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.64, 3.41, 3.66 [03:43:26] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.10, 1.47, 1.37 [03:44:39] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.24, 3.52, 3.65 [03:44:50] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.50, 3.50, 3.89 [03:46:51] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.05, 4.16, 4.08 [03:49:40] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.06, 4.19, 3.88 [03:51:04] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.82, 1.58, 1.30 [03:51:40] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.86, 3.98, 3.83 [03:52:14] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.89, 1.70, 1.54 [03:53:09] [02MirahezeMagic] 07AgentIsai opened pull request 03#346: Add CentralAuth message for Firefox users - 13https://github.com/miraheze/MirahezeMagic/pull/346 [03:53:09] [url] Page not found · GitHub · GitHub | github.com [03:53:40] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.27, 4.27, 3.97 [03:54:09] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.46, 1.60, 1.52 [03:54:21] [02MirahezeMagic] 07AgentIsai synchronize pull request 03#346: Add CentralAuth message for Firefox users - 13https://github.com/miraheze/MirahezeMagic/pull/346 [03:54:21] ... [03:55:04] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.12, 1.49, 1.34 [03:56:03] [02MirahezeMagic] 07AgentIsai synchronize pull request 03#346: Add CentralAuth message for Firefox users - 13https://github.com/miraheze/MirahezeMagic/pull/346 [03:56:04] [url] Page not found · GitHub · GitHub | github.com [03:59:40] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.58, 3.56, 3.79 [04:00:32] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.72, 1.87, 2.00 [04:02:39] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.36, 3.23, 3.73 [04:02:50] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.41, 3.37, 3.88 [04:03:07] miraheze/MirahezeMagic - AgentIsai the build passed. [04:05:21] miraheze/MirahezeMagic - AgentIsai the build passed. [04:06:08] miraheze/MirahezeMagic - AgentIsai the build passed. [04:09:40] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.85, 2.57, 3.20 [04:10:51] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.52, 2.86, 3.40 [04:12:39] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.42, 2.96, 3.40 [04:16:39] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.96, 3.52, 3.51 [04:18:32] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.18, 1.81, 1.78 [04:18:39] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.77, 3.15, 3.37 [04:22:32] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.78, 1.98, 1.88 [04:22:39] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.40, 4.56, 3.88 [04:23:27] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.42, 4.09, 3.53 [04:23:45] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.05, 4.61, 3.76 [04:25:25] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.06, 3.87, 3.53 [04:27:23] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.38, 4.35, 3.74 [04:28:32] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.04, 2.03, 1.94 [04:30:32] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.65, 1.92, 1.91 [04:37:21] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.09, 9.99, 8.73 [04:38:31] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.11, 1.73, 1.79 [04:39:19] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.60, 9.80, 8.81 [04:40:26] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 1.87, 2.02, 1.52 [04:40:32] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.55, 1.65, 1.75 [04:42:21] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.82, 1.56, 1.40 [04:46:32] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.65, 1.61, 1.70 [04:49:03] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 1.99, 2.99, 3.83 [04:50:31] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.72, 2.20, 1.92 [04:52:32] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.60, 1.99, 1.88 [04:52:39] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.09, 2.81, 3.85 [04:54:31] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.15, 2.09, 1.93 [04:54:57] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.65, 3.51, 3.73 [04:56:31] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.73, 1.92, 1.89 [04:56:39] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.92, 4.39, 4.22 [05:06:46] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.53, 3.37, 3.91 [05:08:39] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.33, 3.23, 3.84 [05:08:51] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.68, 3.03, 3.87 [05:10:32] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.55, 1.59, 1.69 [05:18:34] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.69, 3.00, 3.37 [05:19:19] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 3.08, 2.25, 1.92 [05:20:50] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.11, 3.55, 3.61 [05:22:39] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.81, 4.16, 3.80 [05:24:27] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.54, 3.56, 3.49 [05:24:39] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.27, 3.83, 3.74 [05:26:25] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.20, 3.32, 3.40 [05:30:19] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.18, 3.91, 3.64 [05:30:51] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.66, 1.87, 1.97 [05:30:59] RECOVERY - mw102 APT on mw102 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [05:31:30] !log apt upgrade on mw*, mwtask111, and test101 [05:31:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:31:40] RECOVERY - test101 APT on test101 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [05:31:49] RECOVERY - mw101 APT on mw101 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [05:32:05] RECOVERY - mw112 APT on mw112 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [05:32:17] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.63, 3.40, 3.49 [05:32:21] RECOVERY - mw121 APT on mw121 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [05:32:22] RECOVERY - mw111 APT on mw111 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [05:32:47] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.13, 2.06, 2.03 [05:32:47] RECOVERY - mw122 APT on mw122 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [05:32:51] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.62, 3.90, 3.93 [05:33:05] RECOVERY - mwtask111 APT on mwtask111 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [05:34:14] [02ImportDump] 07Reception123 closed pull request 03#17: Make interwiki prefix optional - 13https://github.com/miraheze/ImportDump/pull/17 [05:34:14] [url] Page not found · GitHub · GitHub | github.com [05:34:15] [02miraheze/ImportDump] 07Reception123 pushed 031 commit to 03master [+0/-0/±4] 13https://github.com/miraheze/ImportDump/compare/e04abb380d78...608fa117152b [05:34:16] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.11, 3.71, 3.59 [05:34:16] [url] Comparing e04abb380d78...608fa117152b · miraheze/ImportDump · GitHub | github.com [05:34:17] [02miraheze/ImportDump] 07Universal-Omega 03608fa11 - Make interwiki prefix optional (#17) [05:34:18] [02ImportDump] 07Reception123 deleted branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/ImportDump [05:34:19] [url] Page not found · GitHub · GitHub | github.com [05:34:20] [02miraheze/ImportDump] 07Reception123 deleted branch 03Universal-Omega-patch-1 [05:34:42] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.79, 1.98, 2.00 [05:36:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.28, 3.18, 3.41 [05:38:12] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.99, 2.90, 3.28 [05:39:58] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_38 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/f8a23061f3ca...d34e8c507cf4 [05:39:59] [url] Comparing f8a23061f3ca...d34e8c507cf4 · miraheze/mediawiki · GitHub | github.com [05:40:00] [02miraheze/mediawiki] 07Universal-Omega 03d34e8c5 - Update ImportDump [05:40:39] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.07, 3.15, 3.38 [05:40:41] !log [universalomega@mwtask111] starting deploy of {'world': True, 'l10n': True, 'lang': 'en'} to all [05:40:45] !log [universalomega@test101] starting deploy of {'world': True, 'l10n': True, 'lang': 'en'} to all [05:40:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:40:51] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.05, 3.87, 3.83 [05:40:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:42:06] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.18, 3.48, 3.46 [05:42:32] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.33, 2.05, 2.01 [05:42:50] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.71, 3.70, 3.76 [05:42:57] miraheze/ImportDump - Reception123 the build passed. [05:44:04] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.37, 3.09, 3.32 [05:46:01] !log [universalomega@test101] finished deploy of {'world': True, 'l10n': True, 'lang': 'en'} to all - SUCCESS in 316s [05:46:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:47:18] !log [universalomega@mwtask111] finished deploy of {'world': True, 'l10n': True, 'lang': 'en'} to all - SUCCESS in 396s [05:47:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:50:50] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.70, 3.53, 3.54 [05:52:39] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.04, 3.46, 3.30 [05:52:50] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.91, 3.40, 3.48 [05:54:39] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.25, 2.94, 3.13 [05:54:50] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.12, 3.17, 3.38 [05:58:50] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.16, 3.66, 3.52 [06:00:31] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.41, 1.63, 1.93 [06:00:50] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.83, 3.38, 3.43 [06:02:51] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.56, 3.99, 3.65 [06:04:50] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.18, 3.23, 3.41 [06:06:32] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.42, 1.94, 1.95 [06:06:51] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.30, 2.83, 3.24 [06:09:20] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.01, 3.78, 3.30 [06:10:34] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.16, 3.82, 3.40 [06:10:51] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.48, 4.52, 3.86 [06:11:16] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.32, 3.63, 3.31 [06:12:32] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.14, 3.54, 3.35 [06:12:50] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.99, 3.88, 3.70 [06:13:13] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.34, 3.13, 3.16 [06:14:30] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.06, 3.26, 3.26 [06:20:50] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.44, 2.85, 3.26 [06:28:16] PROBLEM - sunrin.net - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for sunrin.net could not be found [06:31:45] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.50, 3.43, 3.26 [06:32:11] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.70, 3.41, 3.09 [06:33:42] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.03, 3.88, 3.44 [06:35:38] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.37, 3.64, 3.40 [06:36:07] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.42, 4.11, 3.41 [06:37:37] !log sudo -u www-data php /srv/mediawiki/w/extensions/CentralAuth/maintenance/populateGlobalEditCount.php --wiki=metawiki (start) [06:37:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:38:06] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.64, 3.55, 3.29 [06:39:31] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.24, 3.34, 3.34 [06:40:04] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.02, 3.90, 3.43 [06:42:02] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.66, 3.43, 3.32 [06:44:00] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.14, 3.25, 3.26 [06:46:21] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.81, 3.37, 3.32 [06:47:29] !log [universalomega@mwtask111] sudo -u www-data php /srv/mediawiki/w/extensions/CentralAuth/maintenance/populateGlobalEditCount.php --wiki=metawiki (END - exit=256) [06:47:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:48:01] Reception123: Wikimedia\Rdbms\DBConnectionError from line 1460 of /srv/mediawiki/w/includes/libs/rdbms/loadbalancer/LoadBalancer.php: Cannot access the database: Unknown database 'testdelete1wiki' (db101) (db101) [06:48:44] It must not have been removed from CentralAuth tables during a database drop or something. [06:48:54] or maybe CreateWiki tables? [06:50:14] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.73, 3.81, 3.50 [06:50:14] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.67, 3.99, 3.43 [06:50:58] CosmicAlpha: yeah maybe it was done the wrong way? [06:51:22] Reception123: I think you solved it once before by deleting non existent wikis from a user on centralauth before? [06:51:22] Though I think it would have to be removed manually in that case [06:52:10] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.64, 3.31, 3.35 [06:52:11] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.76, 3.38, 3.27 [06:55:39] !log DELETE FROM localuser WHERE lu_wiki='testdelete1wiki'; [06:55:44] Reception123: ^ [06:55:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:58:19] !log [universalomega@mwtask111] sudo -u www-data php /srv/mediawiki/w/extensions/CentralAuth/maintenance/populateGlobalEditCount.php --wiki=metawiki --start=296000 (END - exit=0) [06:58:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:11:40] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.29, 3.52, 3.27 [07:13:37] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.74, 2.89, 3.07 [07:27:13] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.77, 4.51, 3.41 [07:28:11] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.63, 3.50, 3.05 [07:28:13] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.23, 3.94, 3.12 [07:30:08] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.74, 3.62, 3.16 [07:32:09] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.65, 3.84, 3.28 [07:33:03] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.53, 3.81, 3.51 [07:34:07] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.15, 4.10, 3.46 [07:35:57] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.44, 4.22, 3.51 [07:41:46] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.63, 3.94, 3.64 [07:42:00] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.77, 3.57, 3.58 [07:44:50] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.59, 2.75, 3.24 [07:45:39] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.51, 3.73, 3.60 [07:45:56] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.07, 2.90, 3.31 [07:47:36] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.88, 3.24, 3.42 [07:49:32] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.99, 3.02, 3.31 [07:51:48] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.89, 3.96, 3.58 [07:54:50] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.95, 4.03, 3.50 [07:55:24] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.35, 4.65, 3.85 [07:56:50] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.22, 3.94, 3.56 [07:58:50] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.72, 4.38, 3.77 [08:01:40] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.65, 3.81, 3.88 [08:02:50] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.95, 3.64, 3.60 [08:03:10] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.99, 3.76, 3.83 [08:08:50] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.18, 3.00, 3.35 [08:08:59] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.07, 2.66, 3.31 [08:09:40] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.38, 2.67, 3.31 [08:20:50] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.94, 3.71, 3.46 [08:24:51] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.10, 3.34, 3.35 [08:39:45] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.32, 4.04, 3.53 [08:40:17] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.66, 3.51, 3.21 [08:41:42] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.39, 3.64, 3.44 [08:42:16] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.35, 3.04, 3.07 [08:43:38] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.13, 3.00, 3.22 [08:51:26] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.01, 3.39, 3.26 [08:56:58] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.71, 3.82, 3.39 [08:57:14] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.96, 3.69, 3.47 [08:59:11] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.25, 3.32, 3.37 [09:00:55] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.86, 3.13, 3.24 [09:12:38] PROBLEM - wiki.wisrail.de - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.wisrail.de All nameservers failed to answer the query. [09:12:51] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.19, 3.09, 2.99 [09:14:51] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.02, 2.93, 2.94 [09:22:11] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.92, 4.22, 3.38 [09:23:08] PROBLEM - wiki.mineland.eu - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query mineland.eu. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [09:24:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.05, 3.69, 3.28 [09:24:32] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.62, 1.80, 1.97 [09:26:04] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.12, 3.14, 3.12 [09:28:50] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.82, 3.45, 3.09 [09:29:40] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.43, 3.58, 3.18 [09:32:50] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.50, 3.20, 3.09 [09:35:40] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.18, 3.21, 3.16 [09:38:32] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.31, 1.88, 1.85 [09:40:32] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.88, 1.86, 1.85 [09:41:17] RECOVERY - wiki.wisrail.de - reverse DNS on sslhost is OK: SSL OK - wiki.wisrail.de reverse DNS resolves to cp21.miraheze.org - CNAME OK [09:46:32] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.03, 1.88, 1.85 [09:46:39] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.11, 3.61, 3.26 [09:47:39] PROBLEM - wiki.digitalefitheid.nl - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.digitalefitheid.nl' expires in 15 day(s) (Sat 09 Jul 2022 09:35:14 GMT +0000). [09:48:35] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.67, 3.50, 3.25 [09:48:39] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.53, 3.58, 3.29 [09:49:10] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/254829cfa052...ae52af1ac561 [09:49:11] [url] Comparing 254829cfa052...ae52af1ac561 · miraheze/ssl · GitHub | github.com [09:49:11] [02miraheze/ssl] 07MirahezeSSLBot 03ae52af1 - Bot: Update SSL cert for wiki.digitalefitheid.nl [09:49:37] PROBLEM - wiki.iurevar.world - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.iurevar.world' expires in 15 day(s) (Sat 09 Jul 2022 09:43:48 GMT +0000). [09:50:33] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.50, 3.89, 3.41 [09:50:39] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.86, 4.05, 3.49 [09:51:34] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.59, 4.11, 3.48 [09:52:31] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.64, 3.70, 3.40 [09:53:00] RECOVERY - wiki.mineland.eu - reverse DNS on sslhost is OK: SSL OK - wiki.mineland.eu reverse DNS resolves to cp21.miraheze.org - CNAME OK [09:54:05] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/ae52af1ac561...6fa4aff40644 [09:54:05] [url] Comparing ae52af1ac561...6fa4aff40644 · miraheze/ssl · GitHub | github.com [09:54:06] [02miraheze/ssl] 07MirahezeSSLBot 036fa4aff - Bot: Update SSL cert for wiki.iurevar.world [09:54:39] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.98, 3.82, 3.55 [09:55:27] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.22, 3.78, 3.50 [09:56:27] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.18, 3.26, 3.29 [09:56:32] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.41, 1.88, 1.96 [09:56:39] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.53, 3.08, 3.32 [09:57:15] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 6.93, 7.23, 3.61 [09:57:23] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.56, 3.36, 3.38 [10:00:57] PROBLEM - wiki.teessidehackspace.org.uk - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.teessidehackspace.org.uk' expires in 15 day(s) (Sat 09 Jul 2022 09:33:00 GMT +0000). [10:01:29] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/6fa4aff40644...7d5e95b62379 [10:01:29] [url] Comparing 6fa4aff40644...7d5e95b62379 · miraheze/ssl · GitHub | github.com [10:01:30] [02miraheze/ssl] 07MirahezeSSLBot 037d5e95b - Bot: Update SSL cert for wiki.teessidehackspace.org.uk [10:04:32] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.40, 1.43, 1.69 [10:10:12] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.42, 3.16, 2.99 [10:12:10] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.39, 2.86, 2.90 [10:15:15] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.27, 1.31, 1.93 [10:17:15] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 3.63, 2.28, 2.21 [10:20:32] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.65, 2.13, 1.83 [10:21:07] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 5.45, 4.07, 2.18 [10:21:15] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 0.55, 1.37, 1.85 [10:24:32] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.45, 1.89, 1.82 [10:25:15] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.03, 1.78, 1.92 [10:27:15] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.22, 1.55, 1.81 [10:30:32] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.07, 1.81, 1.80 [10:30:38] RECOVERY - wiki.teessidehackspace.org.uk - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.teessidehackspace.org.uk' will expire on Wed 21 Sep 2022 09:01:23 GMT +0000. [10:31:07] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 0.84, 1.70, 1.78 [10:31:15] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.20, 1.98, 1.91 [10:32:47] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.65, 4.10, 3.22 [10:33:07] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.54, 1.31, 1.62 [10:33:15] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.43, 1.80, 1.85 [10:33:42] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.79, 3.91, 3.20 [10:33:54] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.25, 3.21, 2.73 [10:34:32] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.98, 1.90, 1.83 [10:35:38] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.30, 3.81, 3.25 [10:35:50] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.41, 3.34, 2.84 [10:36:32] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.03, 1.95, 1.86 [10:36:43] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.93, 3.67, 3.27 [10:37:15] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.30, 1.43, 1.68 [10:37:34] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.51, 3.31, 3.13 [10:37:47] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.78, 2.75, 2.68 [10:38:42] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.62, 3.28, 3.17 [10:40:32] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.66, 1.84, 1.84 [10:45:58] RECOVERY - wiki.digitalefitheid.nl - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.digitalefitheid.nl' will expire on Wed 21 Sep 2022 08:49:04 GMT +0000. [10:48:32] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.62, 2.05, 1.91 [10:48:46] RECOVERY - wiki.iurevar.world - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.iurevar.world' will expire on Wed 21 Sep 2022 08:53:59 GMT +0000. [10:56:32] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.68, 1.91, 1.94 [11:08:27] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query dnd.bellinrattin.it. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [11:10:32] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.39, 1.51, 1.69 [11:13:23] [02miraheze/CreateWiki] 07translatewiki pushed 031 commit to 03master [+0/-0/±3] 13https://github.com/miraheze/CreateWiki/compare/d9b7b043f0ee...02aee6a8d279 [11:13:24] [url] Comparing d9b7b043f0ee...02aee6a8d279 · miraheze/CreateWiki · GitHub | github.com [11:13:25] [02miraheze/CreateWiki] 07translatewiki 0302aee6a - Localisation updates from https://translatewiki.net. [11:13:25] [url] Main page - translatewiki.net | translatewiki.net [11:13:27] [02miraheze/MirahezeMagic] 07translatewiki pushed 031 commit to 03master [+0/-0/±3] 13https://github.com/miraheze/MirahezeMagic/compare/05e0f6b85985...3a41d66a0ecc [11:13:27] [url] Comparing 05e0f6b85985...3a41d66a0ecc · miraheze/MirahezeMagic · GitHub | github.com [11:13:28] [02miraheze/MirahezeMagic] 07translatewiki 033a41d66 - Localisation updates from https://translatewiki.net. [11:13:28] [url] Main page - translatewiki.net | translatewiki.net [11:13:44] PROBLEM - fc.songcontests.eu - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - fc.songcontests.eu All nameservers failed to answer the query. [11:20:32] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.32, 1.97, 1.80 [11:22:16] PROBLEM - wiki.thunis.eu - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query wiki.thunis.eu. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [11:23:10] miraheze/CreateWiki - translatewiki the build passed. [11:23:28] miraheze/MirahezeMagic - translatewiki the build passed. [11:26:32] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.57, 1.90, 1.84 [11:37:37] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp20.miraheze.org - CNAME OK [11:43:04] PROBLEM - fc.songcontests.eu - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query songcontests.eu. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [11:46:32] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.20, 1.54, 1.69 [11:50:32] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 3.29, 2.20, 1.91 [11:51:32] RECOVERY - wiki.thunis.eu - reverse DNS on sslhost is OK: SSL OK - wiki.thunis.eu reverse DNS resolves to cp20.miraheze.org - CNAME OK [11:52:43] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.83, 3.68, 3.18 [11:53:37] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.10, 3.42, 3.18 [11:54:40] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.34, 3.22, 3.07 [11:55:33] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.42, 3.05, 3.07 [11:58:32] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.30, 1.84, 1.91 [11:59:15] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.90, 1.67, 1.30 [12:03:15] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.35, 1.58, 1.36 [12:08:32] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.39, 1.48, 1.70 [12:12:25] RECOVERY - fc.songcontests.eu - reverse DNS on sslhost is OK: SSL OK - fc.songcontests.eu reverse DNS resolves to cp21.miraheze.org - CNAME OK [12:16:32] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.25, 1.85, 1.76 [12:19:50] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.96, 3.42, 2.99 [12:21:47] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.18, 3.15, 2.93 [12:34:32] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 2.00, 1.95, 2.00 [12:35:23] PROBLEM - gluster111 Disk Space on gluster111 is CRITICAL: DISK CRITICAL - free space: / 48047 MB (5% inode=79%); [12:35:23] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.73, 3.44, 3.23 [12:37:20] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.08, 3.78, 3.35 [12:39:16] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.11, 3.41, 3.26 [12:41:12] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.75, 3.17, 3.19 [12:48:32] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.55, 1.98, 1.94 [12:54:32] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.78, 1.91, 1.95 [12:58:50] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 10.98, 5.37, 3.70 [13:00:15] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 7.03, 4.60, 3.29 [13:01:34] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.27, 4.58, 3.51 [13:03:07] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 3.60, 1.99, 1.39 [13:06:09] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.80, 3.74, 3.28 [13:07:07] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.36, 1.71, 1.41 [13:07:23] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.65, 3.95, 3.56 [13:08:07] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.50, 3.25, 3.15 [13:08:32] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.05, 1.86, 1.83 [13:09:07] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.65, 1.37, 1.33 [13:10:32] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.55, 1.74, 1.79 [13:11:16] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.41, 3.17, 3.33 [13:12:50] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.81, 3.69, 3.83 [13:15:58] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.48, 3.23, 3.13 [13:16:50] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.77, 3.97, 3.87 [13:17:56] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.42, 3.60, 3.26 [13:18:32] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.39, 1.93, 1.82 [13:18:51] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.98, 3.63, 3.76 [13:19:54] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.38, 3.15, 3.14 [13:20:04] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.54, 3.55, 3.43 [13:20:51] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.11, 3.64, 3.74 [13:23:49] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.18, 3.63, 3.37 [13:23:57] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.10, 3.60, 3.46 [13:24:32] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.59, 1.96, 1.91 [13:24:51] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.43, 3.90, 3.86 [13:25:47] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.62, 3.99, 3.53 [13:25:53] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.77, 3.62, 3.48 [13:26:05] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.99, 1.74, 1.34 [13:28:02] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.78, 1.43, 1.28 [13:28:50] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.48, 3.84, 3.82 [13:29:46] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.61, 4.04, 3.66 [13:30:50] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.18, 3.80, 3.82 [13:31:41] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.47, 3.30, 3.38 [13:31:42] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.21, 3.61, 3.54 [13:35:35] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.70, 2.92, 3.30 [13:38:32] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.33, 1.83, 1.79 [13:40:32] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.45, 1.67, 1.74 [13:42:50] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.08, 2.74, 3.25 [13:48:32] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.39, 2.05, 1.86 [13:55:40] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.15, 3.79, 3.39 [13:55:45] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.76, 4.79, 3.95 [13:56:01] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.38, 4.11, 3.53 [13:56:32] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.87, 1.98, 1.93 [13:57:58] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.30, 3.90, 3.53 [13:59:40] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.53, 3.16, 3.22 [14:01:51] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.80, 4.60, 3.89 [14:02:32] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.02, 1.89, 1.89 [14:04:32] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.83, 1.86, 1.88 [14:06:32] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.19, 2.00, 1.93 [14:07:40] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.08, 4.00, 3.56 [14:09:37] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.91, 3.99, 3.93 [14:10:32] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.80, 1.94, 1.92 [14:11:33] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.87, 4.21, 4.01 [14:15:08] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.74, 3.51, 3.88 [14:15:26] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.24, 3.81, 3.91 [14:17:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.44, 4.45, 4.13 [14:18:32] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.98, 2.25, 2.02 [14:19:40] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.56, 3.97, 3.88 [14:21:15] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.40, 3.92, 3.99 [14:23:40] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.00, 4.15, 3.97 [14:24:38] PROBLEM - wiki.dunmoore.net - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.dunmoore.net could not be found [14:25:40] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.50, 3.89, 3.89 [14:26:51] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.21, 4.02, 3.93 [14:27:40] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.62, 4.05, 3.94 [14:28:32] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.56, 1.89, 2.00 [14:30:50] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.26, 3.73, 3.86 [14:31:40] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.76, 3.95, 3.97 [14:32:32] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.07, 1.95, 2.00 [14:34:32] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.51, 1.82, 1.95 [14:38:43] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.38, 4.13, 3.72 [14:39:40] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.02, 3.75, 3.73 [14:43:40] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.67, 3.36, 3.60 [14:44:39] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.72, 3.63, 3.65 [14:45:40] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.88, 3.89, 3.75 [14:46:39] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.96, 4.55, 3.99 [14:47:40] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.92, 3.76, 3.74 [14:48:32] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.34, 1.86, 1.80 [14:48:39] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.73, 3.85, 3.80 [14:51:40] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.64, 3.69, 3.67 [14:52:39] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 3.90, 4.03, 3.87 [14:52:50] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.37, 4.00, 3.70 [14:53:39] PROBLEM - wiki.dunmoore.net - LetsEncrypt on sslhost is CRITICAL: connect to address wiki.dunmoore.net and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [14:54:32] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.68, 1.97, 1.91 [14:54:39] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 1.94, 3.34, 3.65 [14:54:50] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.13, 3.75, 3.65 [14:55:40] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.72, 3.65, 3.66 [14:56:18] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 1.33, 2.03, 1.43 [14:57:40] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.43, 3.77, 3.69 [14:58:07] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.18, 10.07, 9.07 [14:58:14] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.24, 1.79, 1.41 [15:00:04] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.92, 10.08, 9.19 [15:00:09] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.96, 1.52, 1.35 [15:00:39] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.02, 3.71, 3.69 [15:00:50] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.24, 3.83, 3.68 [15:01:40] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.10, 3.73, 3.74 [15:02:39] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.14, 3.15, 3.49 [15:02:50] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.92, 3.42, 3.54 [15:04:39] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.42, 2.95, 3.37 [15:06:50] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.61, 4.01, 3.72 [15:07:40] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.93, 4.09, 3.83 [15:08:39] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.91, 4.16, 3.77 [15:09:40] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.09, 3.69, 3.72 [15:10:39] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.73, 3.60, 3.61 [15:10:51] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.57, 3.74, 3.67 [15:13:40] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.17, 2.41, 3.19 [15:14:32] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.35, 1.54, 1.70 [15:14:50] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.34, 2.92, 3.35 [15:16:39] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.81, 4.01, 3.69 [15:18:50] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.16, 3.42, 3.49 [15:19:41] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.79, 3.42, 3.39 [15:20:32] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 3.15, 2.27, 1.94 [15:21:40] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.26, 3.05, 3.26 [15:22:39] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.97, 3.86, 3.77 [15:22:49] RECOVERY - wiki.dunmoore.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.dunmoore.net' will expire on Wed 20 Jul 2022 10:50:20 GMT +0000. [15:26:32] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.50, 1.95, 1.93 [15:26:50] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.43, 4.26, 3.79 [15:27:40] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.37, 3.55, 3.37 [15:29:15] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.17, 2.04, 1.69 [15:29:40] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.87, 3.71, 3.45 [15:31:15] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.59, 1.97, 1.72 [15:33:15] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.89, 1.57, 1.60 [15:33:15] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.09, 10.54, 9.26 [15:33:40] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.17, 3.68, 3.48 [15:35:40] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.77, 3.23, 3.33 [15:36:39] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.26, 3.19, 3.39 [15:36:50] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.43, 3.65, 3.74 [15:37:02] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 9.77, 9.97, 9.32 [15:38:52] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query dnd.bellinrattin.it. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [15:41:40] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.37, 3.69, 3.51 [15:42:50] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.49, 3.76, 3.72 [15:44:03] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.79, 1.97, 1.74 [15:44:32] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.07, 1.79, 1.76 [15:44:50] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.40, 3.22, 3.52 [15:45:40] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.85, 3.24, 3.37 [15:45:59] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.80, 1.59, 1.63 [15:46:50] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.43, 3.53, 3.59 [15:47:34] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.55, 3.85, 3.53 [15:49:30] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.51, 3.29, 3.36 [15:53:26] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.31, 4.08, 3.65 [15:53:40] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.53, 4.39, 3.70 [15:55:26] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.15, 1.61, 1.30 [15:55:45] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.49, 9.86, 9.38 [15:57:26] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.86, 1.75, 1.39 [15:57:40] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.26, 3.80, 3.62 [15:57:42] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.87, 9.76, 9.40 [15:59:40] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.51, 3.89, 3.66 [16:00:51] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.09, 3.98, 4.00 [16:01:00] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.43, 9.07, 8.54 [16:01:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.16, 3.82, 3.81 [16:01:26] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.09, 1.50, 1.39 [16:02:50] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.18, 4.41, 4.17 [16:03:00] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 6.60, 8.23, 8.31 [16:03:40] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.91, 3.60, 3.61 [16:05:04] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.11, 3.85, 3.82 [16:05:13] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.32, 10.13, 9.26 [16:07:27] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.74, 11.01, 10.05 [16:07:40] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.13, 5.12, 4.20 [16:09:10] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 9.25, 9.78, 9.33 [16:09:16] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 5.48, 4.17, 2.53 [16:11:16] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 7.39, 5.48, 3.22 [16:11:22] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.38, 9.87, 9.83 [16:12:32] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.30, 1.74, 1.93 [16:12:35] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.91, 11.01, 9.16 [16:13:06] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.47, 11.18, 9.99 [16:14:29] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.93, 11.61, 9.59 [16:15:04] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.16, 10.81, 10.00 [16:16:22] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.19, 10.99, 9.60 [16:16:32] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.08, 1.82, 1.92 [16:21:16] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 5.57, 5.95, 4.68 [16:22:03] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.42, 9.94, 9.54 [16:22:58] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.78, 9.84, 9.92 [16:23:02] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk [16:23:16] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 6.20, 5.89, 4.80 [16:23:58] PROBLEM - wiki.dunmoore.net - LetsEncrypt on sslhost is CRITICAL: connect to address wiki.dunmoore.net and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [16:25:16] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 1.52, 4.25, 4.33 [16:27:07] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.74, 1.36, 1.24 [16:28:32] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.36, 1.74, 1.93 [16:29:07] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.73, 1.13, 1.17 [16:30:53] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.61, 9.75, 9.64 [16:32:50] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.05, 9.42, 9.53 [16:33:02] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk [16:33:07] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.75, 1.48, 1.30 [16:35:07] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 1.42, 1.41, 1.29 [16:35:40] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.20, 3.30, 3.98 [16:36:39] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.09, 3.25, 3.94 [16:36:43] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.07, 10.48, 9.93 [16:37:12] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - dnd.bellinrattin.it All nameservers failed to answer the query. [16:37:40] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.78, 3.81, 4.08 [16:38:32] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.16, 1.89, 1.88 [16:38:39] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.58, 3.53, 3.94 [16:40:32] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.65, 1.80, 1.85 [16:40:38] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.17, 9.89, 9.83 [16:40:39] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.81, 3.63, 3.93 [16:41:40] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.80, 3.49, 3.92 [16:44:34] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.88, 10.60, 10.15 [16:44:39] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.54, 4.16, 4.06 [16:45:59] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.16, 6.97, 5.90 [16:46:39] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.99, 3.67, 3.89 [16:48:32] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.61, 2.12, 1.95 [16:48:34] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.87, 9.76, 9.93 [16:48:50] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.74, 3.29, 3.86 [16:49:53] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.89, 6.61, 6.01 [16:50:50] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.37, 3.70, 3.93 [16:51:40] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.60, 3.70, 3.74 [16:53:40] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.02, 3.34, 3.60 [16:53:43] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.27, 7.62, 6.57 [16:55:26] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.82, 1.44, 1.21 [16:55:40] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.31, 7.53, 6.67 [16:56:31] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.52, 1.94, 1.98 [16:57:15] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.77, 1.67, 1.49 [16:57:26] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.00, 1.25, 1.17 [16:58:20] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.01, 1.87, 1.56 [16:59:15] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.01, 1.47, 1.44 [17:00:15] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 1.09, 1.59, 1.49 [17:00:39] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.15, 3.39, 3.49 [17:00:50] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.74, 3.73, 3.86 [17:01:00] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 13.77, 10.82, 9.44 [17:01:24] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.61, 10.48, 10.21 [17:01:40] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.77, 3.09, 3.40 [17:02:50] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.59, 3.75, 3.83 [17:03:00] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.45, 10.36, 9.46 [17:03:21] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.08, 10.10, 10.11 [17:04:31] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.04, 1.71, 1.82 [17:04:39] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.35, 3.30, 3.44 [17:04:50] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.40, 3.41, 3.69 [17:05:00] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.47, 9.54, 9.26 [17:06:21] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp20.miraheze.org - CNAME OK [17:06:31] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.67, 1.70, 1.80 [17:06:39] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.40, 3.07, 3.34 [17:08:32] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.33, 1.83, 1.83 [17:10:32] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.56, 1.69, 1.78 [17:10:39] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.72, 3.47, 3.43 [17:11:14] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 6.32, 6.40, 6.70 [17:12:39] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.53, 3.24, 3.36 [17:14:50] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.12, 3.66, 3.58 [17:15:27] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.45, 3.46, 3.34 [17:16:39] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.16, 3.70, 3.51 [17:16:51] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.36, 3.51, 3.54 [17:17:25] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.72, 3.38, 3.34 [17:18:32] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.73, 2.02, 1.87 [17:20:39] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.06, 3.35, 3.40 [17:20:50] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.42, 3.08, 3.35 [17:21:54] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.72, 9.88, 9.79 [17:23:26] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.10, 1.82, 1.45 [17:25:26] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.42, 1.58, 1.40 [17:25:49] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.80, 9.64, 9.76 [17:28:50] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 4.00, 3.42, 3.31 [17:32:08] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.94, 3.61, 3.37 [17:33:49] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.07, 1.70, 1.38 [17:34:06] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.66, 3.87, 3.49 [17:34:51] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.97, 4.44, 3.73 [17:35:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.64, 3.72, 3.49 [17:35:34] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.91, 10.72, 10.12 [17:35:45] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.42, 1.59, 1.37 [17:36:04] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.68, 3.71, 3.47 [17:37:31] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.05, 9.95, 9.91 [17:38:02] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.57, 4.11, 3.63 [17:38:31] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.83, 1.94, 1.99 [17:39:15] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.90, 3.84, 3.56 [17:40:01] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.22, 3.91, 3.63 [17:41:12] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.47, 3.43, 3.43 [17:43:57] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.35, 3.77, 3.62 [17:44:29] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.95, 10.92, 9.91 [17:45:04] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.29, 3.93, 3.62 [17:45:50] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.31, 2.11, 1.77 [17:46:32] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.23, 1.90, 1.93 [17:47:53] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.22, 3.95, 3.77 [17:48:57] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.39, 3.94, 3.73 [17:49:41] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.94, 1.65, 1.67 [17:50:06] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-3 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/b455a90ff634 [17:50:08] [02miraheze/mw-config] 07Universal-Omega 03b455a90 - Start actor table schema migration on beta [17:50:09] [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-3 - 13https://github.com/miraheze/mw-config [17:50:09] [url] Page not found · GitHub · GitHub | github.com [17:50:11] [02mw-config] 07Universal-Omega opened pull request 03#4790: Start actor table schema migration on beta - 13https://github.com/miraheze/mw-config/pull/4790 [17:50:11] [url] Page not found · GitHub · GitHub | github.com [17:50:54] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 3.29, 4.21, 3.89 [17:51:02] [02mw-config] 07Universal-Omega edited pull request 03#4790: Start actor table schema migration on beta - 13https://github.com/miraheze/mw-config/pull/4790 [17:51:03] [url] Page not found · GitHub · GitHub | github.com [17:51:04] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.97, 1.66, 1.20 [17:51:15] miraheze/mw-config - Universal-Omega the build passed. [17:55:04] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.01, 1.49, 1.25 [17:56:29] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.82, 9.98, 10.04 [17:59:13] !log [universalomega@test101] sudo -u www-data php /srv/mediawiki/w/maintenance/sql.php --wiki=betawiki /srv/mediawiki/w/maintenance/archives/patch-drop-rev_page_id.sql (END - exit=0) [17:59:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:59:40] !log [universalomega@test101] sudo -u www-data php /srv/mediawiki/w/maintenance/sql.php --wiki=betawiki /srv/mediawiki/w/maintenance/archives/patch-drop-page_restrictions-pr_user.sql (END - exit=0) [17:59:42] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.23, 3.93, 3.82 [17:59:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:00:39] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.12, 3.69, 3.90 [18:00:50] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.66, 3.59, 3.90 [18:02:15] !log [universalomega@mwtask111] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.json /srv/mediawiki/w/maintenance/sql.php /srv/mediawiki/w/maintenance/archives/patch-drop-page_restrictions-pr_user.sql (START) [18:02:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:02:39] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.70, 4.36, 4.12 [18:02:50] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 8.02, 5.11, 4.41 [18:04:32] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.53, 1.89, 2.00 [18:04:39] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.95, 3.79, 3.94 [18:05:40] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.72, 3.79, 3.84 [18:06:32] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.49, 2.11, 2.07 [18:07:40] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.27, 3.74, 3.80 [18:08:39] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.10, 3.96, 3.93 [18:09:04] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.65, 1.94, 1.57 [18:09:40] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.51, 3.61, 3.74 [18:11:04] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.37, 1.67, 1.51 [18:12:39] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.59, 3.74, 3.83 [18:14:39] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.66, 3.93, 3.88 [18:15:40] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.43, 2.89, 3.37 [18:19:40] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.02, 3.58, 3.55 [18:20:34] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.71, 11.41, 10.28 [18:20:39] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.56, 3.93, 3.90 [18:20:41] PROBLEM - mwtask111 Current Load on mwtask111 is CRITICAL: CRITICAL - load average: 4.05, 3.46, 2.48 [18:21:40] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.17, 3.43, 3.50 [18:22:41] PROBLEM - mwtask111 Current Load on mwtask111 is WARNING: WARNING - load average: 3.89, 3.65, 2.68 [18:23:40] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.35, 3.09, 3.37 [18:24:34] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.27, 11.84, 10.77 [18:24:51] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.25, 3.74, 3.97 [18:26:34] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.38, 12.07, 10.98 [18:26:39] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.28, 2.84, 3.38 [18:26:41] RECOVERY - mwtask111 Current Load on mwtask111 is OK: OK - load average: 2.69, 3.32, 2.79 [18:31:17] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.79, 1.84, 1.38 [18:32:33] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.83, 3.33, 3.30 [18:33:15] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.29, 1.68, 1.38 [18:34:31] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.62, 2.99, 3.18 [18:38:50] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.00, 3.91, 3.74 [18:39:15] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.59, 1.89, 1.55 [18:40:50] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.03, 3.72, 3.70 [18:41:15] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.21, 1.68, 1.52 [18:42:34] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.95, 11.30, 11.47 [18:44:39] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.75, 3.47, 3.35 [18:46:18] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.01, 3.64, 3.39 [18:48:16] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.44, 3.13, 3.23 [18:48:39] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.18, 3.82, 3.54 [18:50:39] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.13, 3.16, 3.33 [18:52:50] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.54, 3.65, 3.56 [18:54:34] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.73, 11.84, 11.41 [18:54:41] PROBLEM - mwtask111 Current Load on mwtask111 is CRITICAL: CRITICAL - load average: 4.28, 3.60, 3.07 [18:54:50] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.56, 3.49, 3.50 [18:56:41] PROBLEM - mwtask111 Current Load on mwtask111 is WARNING: WARNING - load average: 3.41, 3.47, 3.09 [18:58:34] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.70, 11.55, 11.40 [18:58:41] RECOVERY - mwtask111 Current Load on mwtask111 is OK: OK - load average: 3.02, 3.20, 3.03 [18:58:50] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.81, 3.94, 3.63 [18:59:02] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk [19:00:50] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.86, 3.76, 3.60 [19:02:50] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.31, 4.04, 3.70 [19:04:34] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.39, 11.79, 11.57 [19:04:55] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.97, 4.23, 3.58 [19:05:23] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.51, 3.60, 3.37 [19:06:50] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.36, 3.98, 3.79 [19:06:54] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.75, 3.88, 3.52 [19:07:00] !log [universalomega@mwtask111] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.json /srv/mediawiki/w/maintenance/sql.php /srv/mediawiki/w/maintenance/archives/patch-drop-page_restrictions-pr_user.sql (END - exit=0) [19:07:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:07:19] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.50, 3.31, 3.30 [19:08:34] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.35, 11.06, 11.38 [19:09:04] !log [universalomega@mwtask111] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.json /srv/mediawiki/w/maintenance/sql.php /srv/mediawiki/w/maintenance/archives/patch-drop-rev_page_id.sql (START) [19:09:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:09:58] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query dnd.bellinrattin.it. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [19:10:50] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.77, 3.94, 3.58 [19:14:02] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk [19:14:46] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.83, 3.60, 3.54 [19:17:06] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.30, 3.86, 3.54 [19:18:50] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.07, 3.96, 3.79 [19:20:40] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.68, 4.01, 3.71 [19:22:34] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.47, 10.94, 10.81 [19:23:26] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.84, 2.80, 1.93 [19:24:34] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.68, 10.92, 10.80 [19:24:52] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.64, 3.93, 3.87 [19:29:26] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.04, 1.76, 1.75 [19:30:31] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.80, 3.67, 3.79 [19:31:26] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.07, 1.49, 1.65 [19:31:28] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.22, 9.54, 9.01 [19:32:34] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.93, 9.25, 10.11 [19:33:22] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 9.94, 9.78, 9.17 [19:34:27] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.91, 3.76, 3.74 [19:36:39] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.87, 3.03, 3.39 [19:38:24] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.23, 3.58, 3.68 [19:38:34] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.83, 10.62, 10.41 [19:39:08] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - dnd.bellinrattin.it All nameservers failed to answer the query. [19:40:22] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.67, 3.72, 3.70 [19:41:06] PROBLEM - cloud12 Puppet on cloud12 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [19:42:20] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.98, 3.65, 3.67 [19:42:39] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.65, 3.49, 3.44 [19:44:34] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.85, 9.51, 10.01 [19:44:39] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.44, 4.52, 3.82 [19:46:16] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.59, 4.60, 4.04 [19:50:12] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.26, 3.88, 3.92 [19:54:34] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.88, 10.51, 10.16 [19:56:39] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.31, 3.78, 3.95 [19:59:01] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 7.63, 6.06, 4.17 [20:00:39] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.45, 3.60, 3.80 [20:00:59] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 5.58, 5.79, 4.30 [20:02:34] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.23, 11.24, 10.61 [20:02:57] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.83, 4.85, 4.14 [20:03:00] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.34, 9.56, 8.79 [20:04:39] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.73, 3.49, 3.70 [20:05:00] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 9.82, 9.38, 8.81 [20:05:21] !log [universalomega@mwtask111] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.json /srv/mediawiki/w/maintenance/sql.php /srv/mediawiki/w/maintenance/archives/patch-drop-rev_page_id.sql (END - exit=0) [20:05:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:07:55] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.34, 3.67, 3.64 [20:08:34] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.76, 11.88, 11.19 [20:09:06] RECOVERY - cloud12 Puppet on cloud12 is OK: OK: Puppet is currently enabled, last run 13 seconds ago with 0 failures [20:09:53] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.57, 3.15, 3.44 [20:13:50] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.04, 3.17, 3.40 [20:14:34] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.41, 11.56, 11.20 [20:14:39] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.97, 3.92, 3.72 [20:14:51] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.77, 3.50, 3.93 [20:16:34] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.74, 10.99, 11.05 [20:18:39] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.88, 3.55, 3.64 [20:20:34] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.20, 11.38, 11.20 [20:20:39] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.18, 4.04, 3.82 [20:20:50] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.29, 3.83, 3.93 [20:21:36] !log [universalomega@test101] sudo -u www-data php /srv/mediawiki/w/maintenance/refreshImageMetadata.php --wiki=betawiki --force --mediatype=OFFICE --mime=image/* --batch-size=1 --sleep=1 (END - exit=0) [20:21:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:22:34] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.83, 11.39, 11.21 [20:24:10] !log [universalomega@mwtask111] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.json /srv/mediawiki/w/maintenance/refreshImageMetadata.php --force --mediatype=OFFICE --mime=image/* --batch-size=1 --sleep=1 (START) [20:24:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:24:39] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.53, 3.57, 3.71 [20:28:39] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.92, 2.95, 3.40 [20:32:28] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.11, 3.63, 3.39 [20:32:39] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.05, 3.48, 3.51 [20:34:26] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.45, 3.23, 3.28 [20:34:39] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.36, 3.09, 3.37 [20:36:34] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.38, 11.59, 11.23 [20:38:20] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.55, 3.60, 3.43 [20:38:39] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.01, 4.00, 3.72 [20:40:34] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.39, 11.56, 11.31 [20:42:16] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.80, 3.28, 3.35 [20:42:39] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.91, 3.82, 3.74 [20:44:00] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.85, 1.58, 1.33 [20:44:50] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.16, 3.61, 3.94 [20:45:56] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.15, 1.34, 1.27 [20:46:11] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.65, 3.37, 3.36 [20:48:09] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.38, 3.00, 3.23 [20:48:39] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.52, 4.13, 3.83 [20:50:34] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.55, 10.86, 10.82 [20:52:03] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.70, 3.94, 3.60 [20:52:34] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.37, 10.72, 10.79 [20:52:39] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.79, 3.83, 3.81 [20:54:01] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.70, 3.11, 3.34 [21:00:34] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.62, 9.44, 10.13 [21:00:39] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.23, 2.73, 3.27 [21:00:50] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.44, 2.94, 3.37 [21:04:34] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.21, 11.04, 10.59 [21:04:50] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.91, 3.59, 3.56 [21:06:34] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.20, 10.59, 10.50 [21:06:44] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.60, 3.53, 3.38 [21:08:51] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.11, 3.72, 3.60 [21:09:02] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.90, 10.34, 9.75 [21:10:34] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.29, 9.50, 10.05 [21:10:39] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.61, 3.73, 3.43 [21:10:40] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.02, 3.95, 3.58 [21:11:00] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 9.44, 10.11, 9.74 [21:11:53] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.92, 10.74, 9.65 [21:12:39] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.69, 3.97, 3.64 [21:12:50] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.20, 3.81, 3.69 [21:14:39] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.24, 3.77, 3.57 [21:15:50] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 9.48, 10.12, 9.65 [21:16:39] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 3.73, 4.18, 3.77 [21:16:50] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.04, 3.75, 3.68 [21:18:50] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.09, 3.51, 3.60 [21:20:34] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.70, 10.27, 9.97 [21:20:50] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 9.59, 5.59, 4.34 [21:22:39] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.42, 3.76, 3.80 [21:23:26] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.72, 1.56, 1.30 [21:24:34] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.11, 10.15, 10.05 [21:25:26] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.70, 1.67, 1.38 [21:26:25] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.25, 4.22, 3.77 [21:28:50] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.69, 3.76, 3.92 [21:30:21] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.84, 3.54, 3.61 [21:30:39] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.89, 4.12, 3.92 [21:32:39] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.06, 3.73, 3.80 [21:34:39] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.21, 3.92, 3.86 [21:35:44] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query bellinrattin.it. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [21:36:16] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.25, 3.97, 3.76 [21:36:34] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.29, 10.15, 9.86 [21:38:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.92, 3.62, 3.66 [21:38:50] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.66, 3.68, 3.76 [21:40:32] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.78, 1.74, 1.99 [21:40:34] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.77, 10.19, 9.97 [21:40:50] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.92, 3.49, 3.69 [21:42:10] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.34, 4.71, 4.06 [21:44:39] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.57, 3.54, 3.79 [21:46:06] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.76, 3.58, 3.75 [21:48:32] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.77, 2.04, 1.98 [21:48:34] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.13, 10.73, 10.17 [21:48:39] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.91, 2.53, 3.30 [21:48:50] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.49, 2.90, 3.37 [21:50:03] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.40, 2.67, 3.30 [21:50:34] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.79, 10.54, 10.15 [21:54:34] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.04, 11.24, 10.53 [21:56:32] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.63, 1.95, 2.00 [21:56:34] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.22, 11.31, 10.65 [21:57:53] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.26, 3.39, 3.33 [21:59:51] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.61, 2.94, 3.16 [22:04:34] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.76, 11.58, 10.99 [22:05:09] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp20.miraheze.org - CNAME OK [22:05:31] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.11, 3.87, 3.54 [22:06:34] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.37, 10.85, 10.81 [22:07:15] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.33, 3.53, 3.29 [22:08:53] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/608fa117152b...da7e42649e2f [22:08:53] [url] Comparing 608fa117152b...da7e42649e2f · miraheze/ImportDump · GitHub | github.com [22:08:54] [02miraheze/ImportDump] 07Universal-Omega 03da7e426 - mark request as not valid if the file is not found [22:09:12] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.73, 3.21, 3.19 [22:11:20] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.89, 3.99, 3.69 [22:14:32] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.39, 1.50, 1.68 [22:14:35] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.94, 3.71, 3.52 [22:16:03] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.34, 3.68, 3.38 [22:16:33] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.61, 4.19, 3.72 [22:17:09] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.04, 3.85, 3.69 [22:18:32] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.83, 2.13, 1.90 [22:19:14] miraheze/ImportDump - Universal-Omega the build passed. [22:20:29] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.10, 3.87, 3.74 [22:21:52] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.89, 3.64, 3.47 [22:22:58] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.26, 3.71, 3.80 [22:23:49] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.94, 3.16, 3.31 [22:26:23] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.33, 2.99, 3.39 [22:26:32] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.46, 1.94, 1.97 [22:28:34] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.58, 8.93, 9.89 [22:28:50] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.39, 2.81, 3.36 [22:30:41] PROBLEM - db121 Current Load on db121 is WARNING: WARNING - load average: 7.73, 5.45, 3.66 [22:32:41] PROBLEM - db121 Current Load on db121 is CRITICAL: CRITICAL - load average: 8.28, 6.50, 4.27 [22:36:12] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.48, 3.40, 3.23 [22:36:50] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.09, 3.80, 3.51 [22:38:11] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.64, 3.51, 3.30 [22:38:41] PROBLEM - db121 Current Load on db121 is WARNING: WARNING - load average: 4.44, 6.88, 5.37 [22:38:50] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.42, 3.31, 3.37 [22:40:09] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.06, 2.98, 3.13 [22:40:41] RECOVERY - db121 Current Load on db121 is OK: OK - load average: 3.77, 5.85, 5.18 [22:42:32] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.30, 1.95, 1.86 [22:42:50] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.46, 3.24, 3.30 [22:44:51] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.90, 4.03, 3.60 [22:45:15] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.68, 3.60, 3.24 [22:46:01] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.42, 3.55, 3.41 [22:46:50] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.22, 3.35, 3.41 [22:47:11] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.03, 3.04, 3.08 [22:47:59] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.44, 3.21, 3.30 [22:48:17] !log [universalomega@mwtask111] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.json /srv/mediawiki/w/maintenance/refreshImageMetadata.php --force --mediatype=OFFICE --mime=image/* --batch-size=1 --sleep=1 (END - exit=0) [22:48:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:48:32] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk [22:50:35] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/a7cf44782979...3ea89d7e7883 [22:50:36] [url] Comparing a7cf44782979...3ea89d7e7883 · miraheze/mw-config · GitHub | github.com [22:50:37] [02miraheze/mw-config] 07Universal-Omega 033ea89d7 - $wgEnablePartialBlocks -> `$wgEnablePartialActionBlocks` [22:50:38] !log [@test101] starting deploy of {'config': True} to all [22:50:39] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 0s [22:50:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:50:50] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.89, 4.13, 3.71 [22:50:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:51:43] miraheze/mw-config - Universal-Omega the build passed. [22:51:54] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.24, 3.68, 3.46 [22:52:12] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.40, 1.63, 1.27 [22:52:43] !log [@mwtask111] starting deploy of {'config': True} to all [22:52:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:52:54] !log [@mwtask111] finished deploy of {'config': True} to all - SUCCESS in 11s [22:52:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:53:26] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.89, 1.66, 1.37 [22:53:52] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.38, 3.04, 3.25 [22:54:50] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.20, 3.52, 3.57 [22:55:26] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.70, 1.64, 1.39 [22:56:07] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.34, 1.60, 1.35 [22:58:32] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk [22:58:50] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.76, 4.39, 3.91 [23:00:51] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.60, 3.80, 3.76 [23:06:51] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.07, 4.04, 3.81 [23:07:40] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.11, 4.13, 3.62 [23:08:42] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 3.73, 4.14, 3.61 [23:09:26] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 1.86, 2.79, 2.04 [23:10:32] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.53, 1.73, 1.96 [23:10:39] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.22, 3.62, 3.49 [23:10:50] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.03, 3.56, 3.66 [23:11:40] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.36, 3.54, 3.54 [23:12:39] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.00, 3.12, 3.33 [23:12:50] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.14, 3.84, 3.73 [23:15:26] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.03, 1.72, 1.79 [23:15:40] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.96, 3.07, 3.39 [23:16:39] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.29, 3.82, 3.62 [23:16:50] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.48, 3.36, 3.57 [23:17:26] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.03, 1.79, 1.81 [23:18:32] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.27, 1.97, 1.95 [23:19:26] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.32, 1.56, 1.72 [23:20:39] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.41, 3.04, 3.34 [23:21:26] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.60, 1.57, 1.70 [23:22:32] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.83, 2.00, 1.98 [23:22:51] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.29, 3.17, 3.39 [23:30:50] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.46, 3.47, 3.51 [23:33:27] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.84, 10.13, 9.32 [23:35:24] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.81, 10.98, 9.72 [23:35:26] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.91, 2.32, 1.81 [23:36:50] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.82, 2.86, 3.28 [23:37:22] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.12, 11.10, 9.92 [23:37:26] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.63, 1.93, 1.72 [23:39:26] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.17, 1.67, 1.65 [23:43:26] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 1.08, 2.20, 2.00 [23:45:12] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.21, 9.82, 9.76 [23:45:26] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.86, 1.73, 1.85 [23:48:31] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.35, 2.01, 1.85 [23:51:26] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.26, 1.84, 1.85 [23:53:26] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.26, 1.68, 1.80 [23:53:59] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.31, 7.30, 6.08 [23:54:31] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.53, 1.94, 1.91 [23:55:26] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.56, 1.32, 1.66 [23:55:56] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.66, 7.36, 6.24 [23:57:53] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 9.05, 8.06, 6.64