[00:00:19] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.98, 10.26, 9.96 [00:00:21] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.26, 4.01, 3.57 [00:00:22] RECOVERY - gluster121 Puppet on gluster121 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:01:35] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.53, 3.49, 3.48 [00:01:44] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.03, 3.75, 3.51 [00:02:17] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.43, 9.99, 9.90 [00:02:21] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.47, 3.57, 3.45 [00:03:35] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.33, 3.84, 3.61 [00:04:21] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.17, 4.16, 3.68 [00:05:12] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 5.68, 5.86, 5.36 [00:07:51] PROBLEM - es101 Current Load on es101 is CRITICAL: CRITICAL - load average: 4.07, 3.53, 2.71 [00:09:07] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 3.45, 4.61, 4.96 [00:09:28] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.44, 3.20, 3.40 [00:11:51] PROBLEM - es101 Current Load on es101 is WARNING: WARNING - load average: 3.14, 3.47, 2.89 [00:13:26] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.23, 3.90, 3.62 [00:13:51] PROBLEM - es101 Current Load on es101 is CRITICAL: CRITICAL - load average: 4.17, 3.75, 3.07 [00:14:54] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 6.03, 4.93, 4.88 [00:15:51] PROBLEM - es101 Current Load on es101 is WARNING: WARNING - load average: 3.81, 3.66, 3.11 [00:16:21] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.67, 3.93, 3.94 [00:16:38] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_38 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/694635fb1e53...73d7f3278912 [00:16:38] [url] Comparing 694635fb1e53...73d7f3278912 · miraheze/mediawiki · GitHub | github.com [00:16:39] [02miraheze/mediawiki] 07Universal-Omega 0373d7f32 - Update ImportDump [00:16:48] !log [universalomega@test101] starting deploy of {'world': True} to all [00:16:52] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 4.53, 4.96, 4.91 [00:16:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:17:00] !log [universalomega@mwtask111] starting deploy of {'world': True} to all [00:17:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:18:21] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.73, 4.19, 4.02 [00:19:31] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.80, 1.58, 1.34 [00:21:31] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.91, 1.32, 1.28 [00:21:51] RECOVERY - es101 Current Load on es101 is OK: OK - load average: 1.86, 3.02, 3.08 [00:22:32] !log [universalomega@test101] finished deploy of {'world': True} to all - SUCCESS in 343s [00:22:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:23:26] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.27, 3.52, 3.69 [00:24:35] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.68, 11.39, 10.85 [00:24:35] !log [universalomega@mwtask111] finished deploy of {'world': True} to all - SUCCESS in 455s [00:24:39] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.83, 1.44, 1.21 [00:24:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:26:35] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.39, 1.43, 1.24 [00:27:26] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.77, 2.60, 3.28 [00:28:35] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.12, 10.98, 10.88 [00:31:35] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.12, 3.60, 3.97 [00:32:21] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.74, 3.55, 3.93 [00:32:22] PROBLEM - gluster121 Puppet on gluster121 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [00:36:21] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.60, 4.02, 4.02 [00:38:21] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.84, 3.58, 3.86 [00:38:35] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.25, 9.44, 10.09 [00:39:35] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.91, 3.85, 3.90 [00:40:21] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.96, 4.55, 4.19 [00:41:32] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk [00:41:35] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.15, 3.66, 3.83 [00:42:15] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.83, 4.39, 3.76 [00:43:35] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.62, 4.03, 3.94 [00:48:03] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.30, 3.97, 3.81 [00:48:35] PROBLEM - gluster101 Puppet on gluster101 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [00:49:35] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.87, 3.94, 3.99 [00:51:35] PROBLEM - matomo101 Current Load on matomo101 is WARNING: WARNING - load average: 3.71, 3.36, 2.78 [00:51:35] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.56, 4.70, 4.26 [00:51:56] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.07, 3.87, 3.79 [00:53:35] RECOVERY - matomo101 Current Load on matomo101 is OK: OK - load average: 2.57, 3.11, 2.77 [00:55:48] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.79, 3.81, 3.83 [00:57:44] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.52, 4.23, 3.98 [00:59:20] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.66, 10.45, 10.15 [01:01:36] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.63, 3.84, 3.93 [01:02:38] PROBLEM - gluster111 Puppet on gluster111 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [01:05:16] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.49, 11.45, 10.66 [01:05:31] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 1.61, 2.26, 1.64 [01:07:14] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.93, 11.56, 10.79 [01:07:31] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 0.95, 1.73, 1.51 [01:09:26] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.12, 3.95, 3.82 [01:09:31] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.09, 1.86, 1.58 [01:11:31] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.67, 1.39, 1.44 [01:12:01] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/commit/ac7d3140debe [01:12:03] [02miraheze/ImportDump] 07Universal-Omega 03ac7d314 - Add public and unlocked success messages [01:12:04] [02ImportDump] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/ImportDump [01:12:05] [url] Page not found · GitHub · GitHub | github.com [01:12:06] [02ImportDump] 07Universal-Omega opened pull request 03#7: Add public and unlocked success messages - 13https://github.com/miraheze/ImportDump/pull/7 [01:12:06] [url] Page not found · GitHub · GitHub | github.com [01:13:26] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.66, 3.62, 3.74 [01:14:38] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/ac7d3140debe...2d05eb460ae0 [01:14:39] [url] Comparing ac7d3140debe...2d05eb460ae0 · miraheze/ImportDump · GitHub | github.com [01:14:40] [02miraheze/ImportDump] 07Universal-Omega 032d05eb4 - Update en.json [01:14:41] [02ImportDump] 07Universal-Omega synchronize pull request 03#7: Add public and unlocked success messages - 13https://github.com/miraheze/ImportDump/pull/7 [01:14:41] [url] Page not found · GitHub · GitHub | github.com [01:14:50] miraheze/ImportDump - Universal-Omega the build has errored. [01:15:38] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/2d05eb460ae0...5c9378a462e4 [01:15:38] [url] Comparing 2d05eb460ae0...5c9378a462e4 · miraheze/ImportDump · GitHub | github.com [01:15:39] [02miraheze/ImportDump] 07Universal-Omega 035c9378a - Update qqq.json [01:15:41] [02ImportDump] 07Universal-Omega synchronize pull request 03#7: Add public and unlocked success messages - 13https://github.com/miraheze/ImportDump/pull/7 [01:15:41] [url] Page not found · GitHub · GitHub | github.com [01:15:43] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.39, 6.55, 5.68 [01:16:35] RECOVERY - gluster101 Puppet on gluster101 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [01:17:43] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.37, 7.31, 6.08 [01:18:14] miraheze/ImportDump - Universal-Omega the build has errored. [01:18:21] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.97, 3.55, 3.91 [01:19:06] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.37, 9.55, 10.13 [01:19:26] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.41, 3.52, 3.64 [01:19:35] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.43, 3.47, 3.92 [01:19:43] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.61, 7.34, 6.23 [01:21:43] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 9.70, 8.15, 6.66 [01:22:20] [02ImportDump] 07Universal-Omega synchronize pull request 03#7: Add public and unlocked success messages - 13https://github.com/miraheze/ImportDump/pull/7 [01:22:21] [url] Page not found · GitHub · GitHub | github.com [01:22:22] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/5c9378a462e4...56358106ca40 [01:22:22] [url] Comparing 5c9378a462e4...56358106ca40 · miraheze/ImportDump · GitHub | github.com [01:22:23] [02miraheze/ImportDump] 07Universal-Omega 035635810 - Update ImportDumpRequestViewer.php [01:23:27] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.77, 3.48, 3.59 [01:23:35] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.01, 3.72, 3.93 [01:24:06] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/56358106ca40...aa222f8f82b1 [01:24:07] [url] Comparing 56358106ca40...aa222f8f82b1 · miraheze/ImportDump · GitHub | github.com [01:24:08] [02miraheze/ImportDump] 07Universal-Omega 03aa222f8 - Update ImportDumpRequestViewer.php [01:24:09] [02ImportDump] 07Universal-Omega synchronize pull request 03#7: Add public and unlocked success messages - 13https://github.com/miraheze/ImportDump/pull/7 [01:24:10] [url] Page not found · GitHub · GitHub | github.com [01:25:04] [02ImportDump] 07Universal-Omega synchronize pull request 03#7: Add public and unlocked success messages - 13https://github.com/miraheze/ImportDump/pull/7 [01:25:04] [url] Page not found · GitHub · GitHub | github.com [01:25:06] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/aa222f8f82b1...01f50eff32c7 [01:25:06] [url] Comparing aa222f8f82b1...01f50eff32c7 · miraheze/ImportDump · GitHub | github.com [01:25:07] [02miraheze/ImportDump] 07Universal-Omega 0301f50ef - Update ImportDumpRequestViewer.php [01:25:26] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.06, 3.61, 3.62 [01:28:21] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.75, 4.05, 3.87 [01:28:22] RECOVERY - gluster121 Puppet on gluster121 is OK: OK: Puppet is currently enabled, last run 20 seconds ago with 0 failures [01:29:26] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.91, 3.75, 3.71 [01:30:21] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.37, 3.78, 3.79 [01:32:21] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.97, 4.23, 3.96 [01:33:19] miraheze/ImportDump - Universal-Omega the build passed. [01:33:29] [02ImportDump] 07Universal-Omega closed pull request 03#7: Add public and unlocked success messages - 13https://github.com/miraheze/ImportDump/pull/7 [01:33:29] [url] Page not found · GitHub · GitHub | github.com [01:33:30] [02miraheze/ImportDump] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [01:33:32] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±3] 13https://github.com/miraheze/ImportDump/compare/d954fef918df...c85449a3bd81 [01:33:32] [url] Comparing d954fef918df...c85449a3bd81 · miraheze/ImportDump · GitHub | github.com [01:33:33] [02miraheze/ImportDump] 07Universal-Omega 03c85449a - Add public and unlocked success messages (#7) [01:33:35] [02ImportDump] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/ImportDump [01:33:35] [url] Page not found · GitHub · GitHub | github.com [01:34:21] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.88, 3.83, 3.85 [01:35:35] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.91, 3.64, 3.93 [01:39:26] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.98, 3.03, 3.39 [01:39:35] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.17, 3.87, 3.95 [01:41:35] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.10, 3.69, 3.88 [01:42:14] miraheze/ImportDump - Universal-Omega the build passed. [01:43:26] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.85, 3.79, 3.65 [01:43:35] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.18, 3.90, 3.91 [01:44:21] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.74, 4.23, 3.91 [01:45:26] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 3.68, 4.12, 3.82 [01:45:35] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.74, 3.55, 3.79 [01:46:21] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.18, 3.75, 3.77 [01:47:26] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.76, 3.98, 3.80 [01:47:35] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.28, 4.25, 4.01 [01:49:26] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.37, 4.01, 3.82 [01:51:26] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.37, 3.62, 3.69 [01:52:21] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.80, 4.58, 4.08 [01:54:21] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.81, 3.83, 3.86 [01:56:21] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.13, 3.88, 3.87 [01:57:26] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.41, 3.89, 3.75 [01:58:21] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.22, 3.67, 3.79 [01:58:38] RECOVERY - gluster111 Puppet on gluster111 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [01:59:26] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.39, 3.30, 3.55 [02:00:22] PROBLEM - gluster121 Puppet on gluster121 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [02:01:26] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.49, 3.47, 3.56 [02:01:30] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.72, 10.07, 8.74 [02:01:35] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.97, 3.81, 4.00 [02:03:26] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.38, 3.40, 3.53 [02:03:26] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 9.54, 9.67, 8.75 [02:03:43] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 5.07, 6.77, 7.91 [02:05:26] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.71, 3.69, 3.61 [02:07:26] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.94, 3.60, 3.60 [02:07:35] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.15, 3.45, 3.74 [02:09:35] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.39, 3.55, 3.76 [02:11:43] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 4.28, 4.99, 6.56 [02:12:21] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.19, 3.87, 3.63 [02:14:21] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.13, 3.41, 3.49 [02:15:31] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.21, 2.05, 1.47 [02:15:35] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.14, 4.13, 3.99 [02:17:27] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_38 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/73d7f3278912...520fec8b5e01 [02:17:28] [url] Comparing 73d7f3278912...520fec8b5e01 · miraheze/mediawiki · GitHub | github.com [02:17:29] [02miraheze/mediawiki] 07Universal-Omega 03520fec8 - Update ImportDump [02:17:31] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.69, 1.86, 1.47 [02:17:42] !log [universalomega@mwtask111] starting deploy of {'world': True, 'l10n': True, 'lang': 'en'} to all [02:17:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:17:49] !log [universalomega@test101] starting deploy of {'world': True, 'l10n': True, 'lang': 'en'} to all [02:17:52] [02mw-config] 07LuciferianThomas reviewed pull request 03#4730 commit - 13https://github.com/miraheze/mw-config/pull/4730#discussion_r900673803 [02:17:53] [url] T9334: set up wgDefaultLanguageVariant and wgDisabledVariants for hkrailwiki by ugochimobi · Pull Request #4730 · miraheze/mw-config · GitHub | github.com [02:17:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:18:21] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.22, 3.80, 3.59 [02:18:54] [02mw-config] 07LuciferianThomas reviewed pull request 03#4730 commit - 13https://github.com/miraheze/mw-config/pull/4730#discussion_r900673803 [02:18:54] [url] T9334: set up wgDefaultLanguageVariant and wgDisabledVariants for hkrailwiki by ugochimobi · Pull Request #4730 · miraheze/mw-config · GitHub | github.com [02:19:26] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.71, 3.16, 3.36 [02:19:35] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.06, 4.00, 3.99 [02:20:18] [02mw-config] 07LuciferianThomas reviewed pull request 03#4730 commit - 13https://github.com/miraheze/mw-config/pull/4730#discussion_r900674859 [02:20:19] [url] T9334: set up wgDefaultLanguageVariant and wgDisabledVariants for hkrailwiki by ugochimobi · Pull Request #4730 · miraheze/mw-config · GitHub | github.com [02:20:21] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.64, 3.53, 3.51 [02:21:23] [02mw-config] 07Universal-Omega synchronize pull request 03#4730: T9334: set up wgDefaultLanguageVariant and wgDisabledVariants for hkrailwiki - 13https://github.com/miraheze/mw-config/pull/4730 [02:21:23] [url] Page not found · GitHub · GitHub | github.com [02:21:31] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.06, 1.51, 1.42 [02:22:18] [02mw-config] 07Universal-Omega reviewed pull request 03#4730 commit - 13https://github.com/miraheze/mw-config/pull/4730#discussion_r900676704 [02:22:18] [url] T9334: set up wgDefaultLanguageVariant and wgDisabledVariants for hkrailwiki by ugochimobi · Pull Request #4730 · miraheze/mw-config · GitHub | github.com [02:22:25] miraheze/mw-config - Universal-Omega the build passed. [02:22:40] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/feb07826bb2a...b4257fd97e5f [02:22:41] [url] Comparing feb07826bb2a...b4257fd97e5f · miraheze/mw-config · GitHub | github.com [02:22:42] [02miraheze/mw-config] 07ugochimobi 03b4257fd - T9334: set up wgDefaultLanguageVariant and wgDisabledVariants for hkrailwiki (#4730) [02:22:43] [02mw-config] 07Universal-Omega closed pull request 03#4730: T9334: set up wgDefaultLanguageVariant and wgDisabledVariants for hkrailwiki - 13https://github.com/miraheze/mw-config/pull/4730 [02:22:44] [url] Page not found · GitHub · GitHub | github.com [02:23:37] !log [universalomega@test101] finished deploy of {'world': True, 'l10n': True, 'lang': 'en'} to all - SUCCESS in 348s [02:23:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:23:49] miraheze/mw-config - Universal-Omega the build passed. [02:24:15] !log [@mwtask111] starting deploy of {'config': True} to all [02:24:21] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.47, 4.33, 3.80 [02:24:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:24:23] !log [@mwtask111] finished deploy of {'config': True} to all - SUCCESS in 7s [02:24:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:24:46] !log [universalomega@mwtask111] finished deploy of {'world': True, 'l10n': True, 'lang': 'en'} to all - SUCCESS in 423s [02:24:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:25:26] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.09, 3.38, 3.41 [02:27:10] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.33, 1.93, 1.61 [02:27:25] !log [@test101] starting deploy of {'config': True} to all [02:27:26] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.02, 3.20, 3.34 [02:27:26] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 1s [02:27:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:27:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:28:21] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.31, 3.76, 3.69 [02:28:22] RECOVERY - gluster121 Puppet on gluster121 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [02:29:06] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.68, 1.48, 1.48 [02:29:35] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.61, 3.89, 3.77 [02:31:35] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.58, 3.65, 3.70 [02:32:21] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.45, 3.77, 3.67 [02:33:35] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.49, 4.18, 3.90 [02:34:21] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.15, 3.39, 3.54 [02:36:21] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.89, 2.86, 3.33 [02:42:05] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.52, 3.41, 3.28 [02:42:21] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.80, 4.02, 3.71 [02:44:01] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.72, 3.86, 3.46 [02:44:21] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.66, 3.53, 3.57 [02:45:57] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.81, 3.79, 3.48 [02:46:21] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.32, 3.91, 3.71 [02:48:21] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.64, 3.68, 3.64 [02:48:35] PROBLEM - gluster101 Puppet on gluster101 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/apt/trusted.gpg.d/puppetlabs.gpg] [02:49:49] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.93, 4.45, 3.75 [02:50:21] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.11, 4.48, 3.95 [02:51:43] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.84, 6.83, 6.55 [02:51:46] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.96, 3.93, 3.65 [02:52:21] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.51, 3.89, 3.79 [02:53:43] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.74, 6.33, 6.40 [02:54:17] PROBLEM - cloud11 Puppet on cloud11 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [02:55:38] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.69, 2.88, 3.31 [02:56:21] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.05, 2.79, 3.34 [02:56:27] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.64, 10.30, 9.60 [02:57:43] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.67, 7.03, 6.66 [03:00:21] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.29, 3.46, 3.48 [03:01:31] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.86, 9.95, 8.87 [03:01:43] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.49, 6.73, 6.66 [03:02:21] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.43, 3.45, 3.48 [03:03:27] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 9.41, 9.69, 8.90 [03:04:21] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.94, 11.07, 10.16 [03:05:35] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.78, 3.49, 3.93 [03:05:43] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.92, 7.25, 6.92 [03:06:20] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.62, 11.41, 10.41 [03:06:21] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.97, 4.12, 3.73 [03:08:21] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.46, 3.56, 3.57 [03:11:35] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.40, 2.51, 3.37 [03:11:43] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.27, 7.40, 7.06 [03:11:58] PROBLEM - cloud12 Puppet on cloud12 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [03:12:16] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.04, 9.87, 10.09 [03:14:21] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.84, 2.79, 3.27 [03:16:35] RECOVERY - gluster101 Puppet on gluster101 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [03:20:16] RECOVERY - cloud11 Puppet on cloud11 is OK: OK: Puppet is currently enabled, last run 27 seconds ago with 0 failures [03:26:35] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 13.16, 9.94, 8.61 [03:27:43] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.10, 7.84, 8.00 [03:28:32] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.54, 10.03, 8.80 [03:29:43] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 9.67, 8.63, 8.27 [03:30:30] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 5.60, 8.56, 8.43 [03:31:32] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.90, 10.12, 9.05 [03:33:27] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.35, 3.50, 3.27 [03:33:27] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.12, 10.54, 9.31 [03:33:43] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.58, 7.65, 7.95 [03:35:24] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.89, 10.38, 9.41 [03:35:26] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.72, 3.78, 3.38 [03:35:43] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.20, 7.64, 7.89 [03:37:19] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 9.25, 9.92, 9.35 [03:37:25] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.47, 3.63, 3.38 [03:37:43] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.18, 7.73, 7.91 [03:39:57] RECOVERY - cloud12 Puppet on cloud12 is OK: OK: Puppet is currently enabled, last run 38 seconds ago with 0 failures [03:43:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.49, 3.89, 3.54 [03:51:17] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.58, 3.64, 3.73 [03:53:43] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 4.89, 6.05, 6.67 [03:54:20] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.91, 1.66, 1.30 [03:55:15] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.16, 3.42, 3.58 [03:56:20] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.03, 1.48, 1.28 [03:57:14] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.12, 2.97, 3.40 [04:16:03] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.18, 3.53, 3.35 [04:18:32] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.71, 7.03, 6.58 [04:22:00] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.84, 3.77, 3.48 [04:22:21] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 10.36, 8.40, 7.19 [04:23:26] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.51, 3.55, 3.07 [04:23:59] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.65, 3.54, 3.42 [04:25:58] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.60, 3.18, 3.31 [04:26:10] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.47, 8.00, 7.31 [04:27:26] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.18, 3.38, 3.12 [04:30:21] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.20, 3.57, 3.18 [04:31:26] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.97, 3.61, 3.26 [04:31:53] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.41, 7.97, 7.48 [04:31:53] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.67, 3.45, 3.37 [04:32:21] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.58, 3.75, 3.28 [04:33:52] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.44, 3.01, 3.22 [04:39:26] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.78, 3.28, 3.26 [04:40:21] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.66, 3.54, 3.43 [04:42:21] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.41, 3.74, 3.50 [04:44:21] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.84, 3.33, 3.38 [04:45:44] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.74, 3.82, 3.50 [04:49:26] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.55, 3.63, 3.35 [04:49:43] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.98, 7.89, 7.87 [04:50:21] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.89, 3.65, 3.52 [04:51:26] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.76, 3.21, 3.23 [04:51:41] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.58, 3.89, 3.59 [04:52:21] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.88, 3.13, 3.35 [04:55:39] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.55, 3.67, 3.55 [04:57:37] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.29, 3.85, 3.63 [04:57:43] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.65, 7.98, 7.85 [04:58:56] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/b4257fd97e5f...047641f908ee [04:58:56] [url] Comparing b4257fd97e5f...047641f908ee · miraheze/mw-config · GitHub | github.com [04:58:57] [02miraheze/mw-config] 07Universal-Omega 03047641f - Add `-y` to `$wgImportDumpScriptCommand` [04:59:36] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.58, 3.35, 3.47 [04:59:43] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.93, 7.99, 7.88 [05:00:01] miraheze/mw-config - Universal-Omega the build passed. [05:00:21] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.37, 3.81, 3.59 [05:00:22] PROBLEM - gluster121 Puppet on gluster121 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [05:00:39] PROBLEM - gluster111 Puppet on gluster111 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [05:01:35] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.37, 3.81, 3.62 [05:01:43] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.76, 8.25, 7.99 [05:03:35] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.44, 3.17, 3.40 [05:04:21] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.55, 3.13, 3.36 [05:07:18] [02mw-config] 07Reception123 synchronize pull request 03#4728: T9328: set base of wgMinervaShowCategories to true for criticalrolewiki - 13https://github.com/miraheze/mw-config/pull/4728 [05:07:18] [url] Page not found · GitHub · GitHub | github.com [05:07:35] [02mw-config] 07Reception123 closed pull request 03#4728: T9328: set base of wgMinervaShowCategories to true for criticalrolewiki - 13https://github.com/miraheze/mw-config/pull/4728 [05:07:35] [url] Page not found · GitHub · GitHub | github.com [05:07:36] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/047641f908ee...17484426d16b [05:07:37] [url] Comparing 047641f908ee...17484426d16b · miraheze/mw-config · GitHub | github.com [05:07:38] [02miraheze/mw-config] 07ugochimobi 031748442 - T9328: set base of wgMinervaShowCategories to true for criticalrolewiki (#4728) [05:08:24] miraheze/mw-config - Reception123 the build passed. [05:09:00] miraheze/mw-config - Reception123 the build passed. [05:11:43] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.43, 7.35, 7.83 [05:12:21] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03Reception123-patch-1 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/500c8009738a [05:12:23] [02miraheze/mw-config] 07Reception123 03500c800 - set wgEditSubmitButtonLabelPublish true on ysmwikiwiki T9369 [05:12:24] [02mw-config] 07Reception123 created branch 03Reception123-patch-1 - 13https://github.com/miraheze/mw-config [05:12:25] [url] Page not found · GitHub · GitHub | github.com [05:12:26] [02mw-config] 07Reception123 opened pull request 03#4779: set wgEditSubmitButtonLabelPublish true on ysmwikiwiki T9369 - 13https://github.com/miraheze/mw-config/pull/4779 [05:12:26] [url] Page not found · GitHub · GitHub | github.com [05:13:01] [02miraheze/mw-config] 07github-actions[bot] pushed 031 commit to 03Reception123-patch-1 [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/500c8009738a...d5fb4f682628 [05:13:02] [url] Comparing 500c8009738a...d5fb4f682628 · miraheze/mw-config · GitHub | github.com [05:13:02] [02miraheze/mw-config] 07github-actions 03d5fb4f6 - CI: lint code to MediaWiki standards [05:13:04] [02mw-config] 07github-actions[bot] synchronize pull request 03#4779: set wgEditSubmitButtonLabelPublish true on ysmwikiwiki T9369 - 13https://github.com/miraheze/mw-config/pull/4779 [05:13:04] ... [05:13:37] miraheze/mw-config - Reception123 the build passed. [05:14:53] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/17484426d16b...029327bba42b [05:14:54] [url] Comparing 17484426d16b...029327bba42b · miraheze/mw-config · GitHub | github.com [05:14:55] [02miraheze/mw-config] 07Reception123 03029327b - set wgEditSubmitButtonLabelPublish true on ysmwikiwiki T9369 (#4779) [05:14:56] [02mw-config] 07Reception123 closed pull request 03#4779: set wgEditSubmitButtonLabelPublish true on ysmwikiwiki T9369 - 13https://github.com/miraheze/mw-config/pull/4779 [05:14:56] [url] Page not found · GitHub · GitHub | github.com [05:14:58] [02miraheze/mw-config] 07Reception123 deleted branch 03Reception123-patch-1 [05:14:59] [02mw-config] 07Reception123 deleted branch 03Reception123-patch-1 - 13https://github.com/miraheze/mw-config [05:14:59] [url] Page not found · GitHub · GitHub | github.com [05:15:43] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.09, 7.66, 7.85 [05:15:53] miraheze/mw-config - Reception123 the build passed. [05:21:40] PROBLEM - matomo101 Current Load on matomo101 is CRITICAL: CRITICAL - load average: 16.03, 7.32, 4.00 [05:21:59] PROBLEM - matomo101 HTTPS on matomo101 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 358 bytes in 6.382 second response time [05:22:00] PROBLEM - cp30 Stunnel HTTP for matomo101 on cp30 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 358 bytes in 0.788 second response time [05:22:23] !log [@mwtask111] starting deploy of {'config': True} to all [05:22:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:22:33] !log [@mwtask111] finished deploy of {'config': True} to all - SUCCESS in 9s [05:22:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:23:43] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.00, 7.41, 7.76 [05:23:50] !log [@test101] starting deploy of {'config': True} to all [05:23:52] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 2s [05:23:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:23:58] RECOVERY - matomo101 HTTPS on matomo101 is OK: HTTP OK: HTTP/1.1 200 OK - 99077 bytes in 0.803 second response time [05:23:59] RECOVERY - cp30 Stunnel HTTP for matomo101 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 99046 bytes in 0.976 second response time [05:24:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:25:05] !log set view to public for a file on phab [05:25:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:27:04] PROBLEM - cp20 Stunnel HTTP for matomo101 on cp20 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 358 bytes in 0.303 second response time [05:27:12] PROBLEM - matomo101 APT on matomo101 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [05:28:01] PROBLEM - matomo101 HTTPS on matomo101 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 358 bytes in 0.766 second response time [05:28:01] PROBLEM - cp30 Stunnel HTTP for matomo101 on cp30 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 358 bytes in 0.914 second response time [05:28:07] PROBLEM - cp21 Stunnel HTTP for matomo101 on cp21 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 358 bytes in 0.119 second response time [05:28:11] !log [reception@mwtask111] sudo -u www-data php /srv/mediawiki/w/maintenance/deleteBatch.php --wiki=godherjawiki --r=Requested at T9394, overriding for new images /home/reception/godherja/dellist.txt (START) [05:28:12] !log [reception@mwtask111] sudo -u www-data php /srv/mediawiki/w/maintenance/deleteBatch.php --wiki=godherjawiki --r=Requested at T9394, overriding for new images /home/reception/godherja/dellist.txt (END - exit=256) [05:28:21] PROBLEM - matomo101 SSH on matomo101 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:28:22] RECOVERY - gluster121 Puppet on gluster121 is OK: OK: Puppet is currently enabled, last run 55 seconds ago with 0 failures [05:28:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:28:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:28:33] PROBLEM - cp31 Stunnel HTTP for matomo101 on cp31 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 358 bytes in 1.463 second response time [05:30:01] RECOVERY - matomo101 HTTPS on matomo101 is OK: HTTP OK: HTTP/1.1 200 OK - 99077 bytes in 2.018 second response time [05:30:02] RECOVERY - cp30 Stunnel HTTP for matomo101 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 99069 bytes in 2.641 second response time [05:30:06] RECOVERY - cp21 Stunnel HTTP for matomo101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 2.562 second response time [05:30:18] RECOVERY - matomo101 SSH on matomo101 is OK: SSH OK - OpenSSH_8.4p1 Debian-5 (protocol 2.0) [05:30:29] RECOVERY - cp31 Stunnel HTTP for matomo101 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 99046 bytes in 0.740 second response time [05:30:42] !log ran the above manually [05:30:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:31:11] RECOVERY - cp20 Stunnel HTTP for matomo101 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 0.313 second response time [05:31:17] RECOVERY - matomo101 APT on matomo101 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [05:34:21] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.72, 3.96, 3.15 [05:34:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.79, 3.63, 3.06 [05:34:35] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.45, 10.43, 8.92 [05:35:26] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.21, 3.74, 2.92 [05:36:35] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.69, 9.94, 8.94 [05:37:26] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.38, 3.53, 2.94 [05:37:43] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 4.76, 5.79, 6.78 [05:38:19] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.88, 3.74, 3.28 [05:38:21] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.59, 3.96, 3.36 [05:39:27] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.22, 3.62, 3.03 [05:39:53] !log sudo -u www-data php /srv/mediawiki/w/maintenance/importImages.php --wiki=godherjawiki --search-recursively /home/reception/godherja --sleep --comment="Re-importing images per T9394" [05:39:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:40:18] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.11, 3.71, 3.31 [05:41:26] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.65, 3.29, 2.99 [05:42:17] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.73, 3.29, 3.20 [05:46:21] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.78, 3.35, 3.31 [05:52:27] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.52, 10.10, 9.46 [05:54:25] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.62, 10.04, 9.53 [05:55:35] PROBLEM - matomo101 Current Load on matomo101 is WARNING: WARNING - load average: 1.31, 2.41, 3.80 [05:58:39] RECOVERY - gluster111 Puppet on gluster111 is OK: OK: Puppet is currently enabled, last run 54 seconds ago with 0 failures [05:59:35] RECOVERY - matomo101 Current Load on matomo101 is OK: OK - load average: 1.22, 1.83, 3.25 [06:02:22] PROBLEM - gluster121 Puppet on gluster121 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [06:21:35] PROBLEM - matomo101 Current Load on matomo101 is CRITICAL: CRITICAL - load average: 4.75, 3.60, 2.95 [06:23:26] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.77, 3.32, 2.96 [06:23:35] RECOVERY - matomo101 Current Load on matomo101 is OK: OK - load average: 1.22, 2.68, 2.70 [06:25:27] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.38, 2.88, 2.83 [06:27:58] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.90, 10.81, 10.22 [06:28:22] RECOVERY - gluster121 Puppet on gluster121 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [06:32:39] PROBLEM - gluster111 Puppet on gluster111 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [06:35:53] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.61, 10.02, 10.09 [06:39:43] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.81, 7.11, 6.41 [06:41:43] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 9.47, 7.82, 6.75 [06:43:37] PROBLEM - matomo101 Current Load on matomo101 is CRITICAL: CRITICAL - load average: 10.71, 5.52, 3.46 [06:44:53] PROBLEM - matomo101 APT on matomo101 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [06:44:54] PROBLEM - cp30 Stunnel HTTP for matomo101 on cp30 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 358 bytes in 0.448 second response time [06:45:03] PROBLEM - cp20 Stunnel HTTP for matomo101 on cp20 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 358 bytes in 0.038 second response time [06:46:57] RECOVERY - cp30 Stunnel HTTP for matomo101 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 99046 bytes in 5.229 second response time [06:48:54] RECOVERY - matomo101 APT on matomo101 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [06:49:09] RECOVERY - cp20 Stunnel HTTP for matomo101 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 0.310 second response time [06:52:56] PROBLEM - cp30 Stunnel HTTP for matomo101 on cp30 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 358 bytes in 0.338 second response time [06:53:07] PROBLEM - cp20 Stunnel HTTP for matomo101 on cp20 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 358 bytes in 0.030 second response time [06:53:19] PROBLEM - matomo101 APT on matomo101 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [06:53:22] PROBLEM - cp31 Stunnel HTTP for matomo101 on cp31 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 358 bytes in 5.349 second response time [06:53:31] PROBLEM - matomo101 HTTPS on matomo101 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:53:32] PROBLEM - cp21 Stunnel HTTP for matomo101 on cp21 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 358 bytes in 8.500 second response time [06:53:43] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.88, 7.88, 7.59 [06:55:44] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.02, 7.80, 7.58 [06:57:26] PROBLEM - matomo101 PowerDNS Recursor on matomo101 is CRITICAL: CRITICAL - Plugin timed out while executing system call [06:58:39] RECOVERY - gluster111 Puppet on gluster111 is OK: OK: Puppet is currently enabled, last run 20 seconds ago with 0 failures [06:59:23] RECOVERY - matomo101 PowerDNS Recursor on matomo101 is OK: DNS OK: 1.489 second response time. miraheze.org returns 198.244.148.90,2001:41d0:801:2000::1b80,2001:41d0:801:2000::4c25,51.195.220.68 [06:59:26] RECOVERY - cp31 Stunnel HTTP for matomo101 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 99046 bytes in 9.376 second response time [07:03:41] PROBLEM - cp31 Stunnel HTTP for matomo101 on cp31 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 358 bytes in 7.607 second response time [07:09:17] RECOVERY - cp30 Stunnel HTTP for matomo101 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 99046 bytes in 0.842 second response time [07:09:19] RECOVERY - cp20 Stunnel HTTP for matomo101 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 0.342 second response time [07:09:32] RECOVERY - cp31 Stunnel HTTP for matomo101 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 0.874 second response time [07:09:38] RECOVERY - matomo101 HTTPS on matomo101 is OK: HTTP OK: HTTP/1.1 200 OK - 99077 bytes in 0.313 second response time [07:09:41] RECOVERY - cp21 Stunnel HTTP for matomo101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 99061 bytes in 0.266 second response time [07:09:43] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.14, 7.95, 7.94 [07:10:08] RECOVERY - matomo101 APT on matomo101 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [07:18:21] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.34, 4.04, 3.43 [07:18:35] PROBLEM - gluster101 Puppet on gluster101 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [07:19:43] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 3.73, 4.93, 6.43 [07:20:21] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.07, 3.54, 3.32 [07:22:21] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.36, 3.71, 3.39 [07:24:21] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.25, 3.32, 3.28 [07:30:21] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.61, 3.41, 3.34 [07:32:21] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.99, 2.94, 3.18 [07:41:59] PROBLEM - matomo101 Current Load on matomo101 is WARNING: WARNING - load average: 1.56, 1.86, 3.85 [07:43:13] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.93, 3.58, 3.06 [07:44:21] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.19, 3.64, 3.34 [07:45:12] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.92, 3.27, 3.01 [07:45:57] RECOVERY - matomo101 Current Load on matomo101 is OK: OK - load average: 1.78, 1.70, 3.32 [07:46:21] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.92, 3.29, 3.24 [07:46:35] RECOVERY - gluster101 Puppet on gluster101 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [07:52:21] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.99, 3.41, 3.34 [07:54:21] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.01, 3.27, 3.29 [08:00:38] PROBLEM - gluster111 Puppet on gluster111 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [08:02:21] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.91, 3.44, 3.29 [08:04:21] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.14, 2.96, 3.13 [08:10:06] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.54, 3.28, 2.82 [08:11:56] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.54, 3.86, 3.32 [08:12:02] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.80, 3.20, 2.85 [08:14:21] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.64, 3.58, 3.29 [08:16:21] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.89, 3.30, 3.22 [08:17:53] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.42, 2.77, 3.06 [08:18:35] PROBLEM - gluster101 Puppet on gluster101 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [08:27:31] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.92, 1.69, 1.19 [08:29:30] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.93, 1.44, 1.16 [08:44:25] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.35, 2.38, 1.64 [08:44:35] RECOVERY - gluster101 Puppet on gluster101 is OK: OK: Puppet is currently enabled, last run 6 seconds ago with 0 failures [08:45:26] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.09, 3.61, 2.85 [08:46:24] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 0.98, 1.89, 1.55 [08:48:22] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.18, 1.70, 1.53 [08:49:26] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.99, 3.16, 2.87 [09:09:08] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 7.61, 4.52, 3.52 [09:11:04] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.51, 3.93, 3.42 [09:11:36] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.81, 3.56, 3.21 [09:12:28] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.98, 4.46, 3.55 [09:13:00] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.08, 4.69, 3.74 [09:13:33] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.92, 4.38, 3.58 [09:14:27] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.99, 3.83, 3.43 [09:14:56] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.69, 3.89, 3.57 [09:15:30] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.52, 3.72, 3.43 [09:16:26] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.83, 3.22, 3.26 [09:16:52] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.69, 3.24, 3.37 [09:17:27] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.51, 3.39, 3.34 [09:25:12] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.33, 3.49, 3.41 [09:27:09] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.20, 3.32, 3.35 [09:31:00] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.20, 3.68, 3.52 [09:32:22] PROBLEM - gluster121 Puppet on gluster121 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [09:32:57] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.32, 3.23, 3.37 [09:53:00] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.77, 9.89, 8.67 [09:54:58] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.76, 9.25, 8.60 [09:58:22] RECOVERY - gluster121 Puppet on gluster121 is OK: OK: Puppet is currently enabled, last run 36 seconds ago with 0 failures [09:58:39] RECOVERY - gluster111 Puppet on gluster111 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [10:12:11] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.93, 3.10, 2.74 [10:16:03] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.97, 2.83, 2.74 [10:18:35] PROBLEM - gluster101 Puppet on gluster101 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [10:21:48] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.65, 3.26, 2.89 [10:23:22] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.44, 3.56, 3.22 [10:23:47] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.78, 2.96, 2.82 [10:25:19] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.11, 3.81, 3.35 [10:26:23] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.19, 1.79, 1.37 [10:28:22] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.55, 1.71, 1.39 [10:29:13] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.56, 3.79, 3.44 [10:29:38] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.63, 3.48, 3.04 [10:30:21] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.93, 1.42, 1.32 [10:31:34] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.70, 3.08, 2.94 [10:31:42] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.61, 3.38, 3.08 [10:33:07] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.62, 2.97, 3.21 [10:33:41] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.38, 3.19, 3.03 [10:38:16] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.86, 1.70, 1.45 [10:40:15] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.62, 1.52, 1.41 [10:44:11] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 3.06, 2.03, 1.63 [10:46:10] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.93, 1.93, 1.64 [10:47:35] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.91, 3.92, 3.23 [10:47:40] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.02, 4.20, 3.43 [10:48:09] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.67, 2.05, 1.71 [10:49:35] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.91, 3.28, 3.06 [10:49:37] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.89, 3.37, 3.20 [10:50:08] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.29, 1.69, 1.62 [10:57:24] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 3.40, 2.32, 1.46 [10:59:23] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.07, 1.80, 1.37 [11:01:23] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 2.59, 1.87, 1.44 [11:03:22] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.76, 1.47, 1.34 [11:11:04] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.85, 3.26, 2.89 [11:11:09] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.69, 3.46, 3.15 [11:13:00] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.50, 2.96, 2.82 [11:13:06] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.50, 3.14, 3.07 [11:16:35] RECOVERY - gluster101 Puppet on gluster101 is OK: OK: Puppet is currently enabled, last run 42 seconds ago with 0 failures [11:27:11] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 2.16, 1.58, 1.31 [11:29:10] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 1.17, 1.49, 1.31 [11:30:38] PROBLEM - gluster111 Puppet on gluster111 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [11:35:38] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.75, 1.74, 1.51 [11:37:37] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.17, 1.45, 1.43 [11:38:24] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.70, 3.54, 2.96 [11:40:21] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.51, 2.94, 2.80 [11:44:21] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.36, 3.64, 3.12 [11:48:21] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.15, 3.42, 3.15 [11:49:29] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.64, 1.99, 1.75 [11:51:29] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.99, 1.57, 1.62 [11:52:21] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.63, 3.11, 3.11 [11:56:21] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 8.38, 5.03, 3.80 [11:57:54] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.41, 4.60, 3.53 [11:58:41] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 7.25, 5.15, 3.76 [12:09:29] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.82, 1.63, 1.43 [12:09:31] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.90, 10.18, 9.17 [12:09:48] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.07, 3.83, 3.90 [12:11:29] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.99, 9.94, 9.20 [12:13:29] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 5.91, 4.22, 2.48 [12:13:46] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.22, 3.88, 3.90 [12:16:06] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.96, 3.64, 3.83 [12:19:43] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.05, 3.79, 3.90 [12:21:29] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 0.76, 1.63, 1.89 [12:21:42] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 3.96, 4.02, 3.97 [12:23:41] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.63, 3.87, 3.92 [12:26:21] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.37, 3.48, 4.00 [12:27:29] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.75, 1.27, 1.64 [12:27:43] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.54, 3.62, 3.72 [12:28:21] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.35, 4.21, 4.23 [12:28:39] RECOVERY - gluster111 Puppet on gluster111 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [12:30:22] PROBLEM - gluster121 Puppet on gluster121 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [12:31:35] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.81, 3.47, 3.65 [12:35:27] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.07, 3.58, 3.63 [12:35:35] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.33, 4.67, 4.14 [12:37:26] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.10, 3.58, 3.64 [12:39:26] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.02, 4.23, 3.87 [12:47:26] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.53, 3.57, 3.78 [12:49:35] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.65, 3.77, 3.94 [12:51:35] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.79, 4.02, 4.00 [12:53:26] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.02, 3.67, 3.74 [13:00:22] RECOVERY - gluster121 Puppet on gluster121 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [13:19:39] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.05, 10.20, 9.21 [13:27:34] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.40, 10.18, 9.61 [13:29:26] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.00, 3.53, 3.98 [13:31:26] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.20, 4.04, 4.10 [13:33:35] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.31, 3.54, 3.99 [13:35:35] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.68, 4.42, 4.25 [13:47:26] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 1.72, 3.16, 3.87 [13:50:39] PROBLEM - wiki.rosestulipsandliberty.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.rosestulipsandliberty.com' expires in 15 day(s) (Mon 04 Jul 2022 13:19:57 GMT +0000). [13:51:35] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.41, 3.64, 3.95 [13:53:31] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.63, 1.74, 1.10 [13:53:35] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.47, 3.78, 3.95 [13:55:31] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.47, 1.24, 0.99 [13:56:27] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/18c14061492f...999bfa074ab9 [13:56:28] [url] Comparing 18c14061492f...999bfa074ab9 · miraheze/ssl · GitHub | github.com [13:56:29] [02miraheze/ssl] 07MirahezeSSLBot 03999bfa0 - Bot: Update SSL cert for wiki.rosestulipsandliberty.com [13:57:26] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.13, 3.74, 3.76 [14:05:40] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.64, 1.71, 1.53 [14:07:39] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.92, 1.52, 1.49 [14:18:35] PROBLEM - gluster101 Puppet on gluster101 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [14:27:29] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.48, 1.80, 1.55 [14:29:26] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.27, 3.46, 3.96 [14:31:29] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.03, 1.56, 1.51 [14:32:22] PROBLEM - gluster121 Puppet on gluster121 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [14:35:35] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.26, 3.62, 3.93 [14:37:26] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.02, 3.24, 3.57 [14:39:26] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.57, 3.29, 3.57 [14:39:35] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.40, 4.07, 4.06 [14:43:04] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.77, 10.17, 8.97 [14:44:35] RECOVERY - gluster101 Puppet on gluster101 is OK: OK: Puppet is currently enabled, last run 10 seconds ago with 0 failures [14:45:04] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 9.65, 9.61, 8.89 [14:47:35] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.07, 3.82, 3.99 [14:48:56] RECOVERY - wiki.rosestulipsandliberty.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.rosestulipsandliberty.com' will expire on Fri 16 Sep 2022 12:56:22 GMT +0000. [14:49:26] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.95, 4.25, 3.93 [14:51:26] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.36, 3.90, 3.85 [14:52:21] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.59, 3.89, 4.00 [14:55:26] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 7.02, 4.82, 4.18 [14:57:35] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.48, 2.75, 3.39 [14:58:21] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.02, 3.54, 3.78 [14:58:22] RECOVERY - gluster121 Puppet on gluster121 is OK: OK: Puppet is currently enabled, last run 19 seconds ago with 0 failures [15:00:35] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.47, 10.56, 9.27 [15:01:35] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.60, 3.09, 3.41 [15:02:21] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.81, 3.52, 3.74 [15:02:35] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.68, 10.50, 9.41 [15:03:26] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.85, 3.60, 3.86 [15:07:26] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.10, 4.08, 4.01 [15:08:21] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.36, 3.90, 3.83 [15:08:35] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.83, 10.20, 9.62 [15:09:09] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 4.23, 2.94, 1.86 [15:09:26] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.93, 3.51, 3.80 [15:09:35] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.41, 3.71, 3.54 [15:11:26] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.21, 4.03, 3.97 [15:12:21] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.49, 3.75, 3.79 [15:12:35] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.32, 10.43, 9.86 [15:13:06] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.25, 1.94, 1.69 [15:13:26] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.97, 3.81, 3.88 [15:14:21] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.79, 3.79, 3.78 [15:15:26] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.06, 4.05, 3.97 [15:17:04] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.74, 1.37, 1.52 [15:17:26] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.57, 3.51, 3.78 [15:18:21] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.18, 3.99, 3.95 [15:19:35] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.27, 3.49, 3.65 [15:20:35] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.88, 9.53, 9.76 [15:25:35] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.50, 3.44, 3.55 [15:27:35] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.22, 2.97, 3.37 [15:28:21] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.78, 4.23, 3.97 [15:29:31] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.94, 10.44, 10.06 [15:29:58] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.25, 1.93, 1.37 [15:30:21] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.28, 3.79, 3.84 [15:31:26] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.21, 2.89, 3.32 [15:31:30] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.18, 9.93, 9.92 [15:31:53] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.97, 1.64, 1.33 [15:37:24] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.09, 10.25, 10.01 [15:38:21] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.22, 3.39, 3.56 [15:41:21] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.60, 9.88, 9.93 [15:42:20] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.47, 1.71, 1.27 [15:42:21] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.80, 3.93, 3.53 [15:43:27] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.16, 3.57, 3.37 [15:44:17] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.22, 3.21, 3.31 [15:44:20] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.94, 1.54, 1.27 [15:44:21] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.68, 3.88, 3.76 [15:48:35] PROBLEM - gluster101 Puppet on gluster101 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [15:51:23] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.34, 3.78, 3.56 [15:53:21] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.13, 3.24, 3.40 [15:54:21] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.02, 3.07, 3.39 [15:55:39] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.26, 1.90, 1.55 [15:58:21] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.73, 4.80, 4.00 [15:59:17] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.58, 4.02, 3.66 [15:59:37] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.34, 1.75, 1.58 [15:59:48] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.32, 3.54, 3.18 [16:01:16] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.51, 3.58, 3.54 [16:01:36] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.61, 1.96, 1.67 [16:01:44] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.47, 3.43, 3.18 [16:02:21] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.68, 3.95, 3.87 [16:03:35] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.06, 1.57, 1.56 [16:03:40] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.52, 3.10, 3.08 [16:05:14] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.19, 3.80, 3.63 [16:06:21] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.92, 4.50, 4.09 [16:07:13] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.02, 3.52, 3.55 [16:08:21] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.71, 3.82, 3.89 [16:10:21] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.20, 4.56, 4.14 [16:11:11] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.98, 4.16, 3.79 [16:13:26] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.04, 4.06, 3.55 [16:16:26] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.81, 1.61, 1.53 [16:17:08] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.17, 3.77, 3.75 [16:17:26] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.95, 3.65, 3.51 [16:18:25] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.95, 1.37, 1.45 [16:21:06] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.50, 3.87, 3.76 [16:21:26] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.85, 3.93, 3.63 [16:22:21] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.74, 2.22, 1.80 [16:23:27] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.18, 3.65, 3.57 [16:24:21] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.74, 3.50, 3.85 [16:25:04] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.40, 3.62, 3.69 [16:27:26] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.26, 3.16, 3.36 [16:28:21] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.36, 3.70, 3.84 [16:30:17] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.27, 1.72, 1.77 [16:31:26] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.37, 3.53, 3.45 [16:32:16] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.04, 1.98, 1.87 [16:33:26] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.10, 3.26, 3.36 [16:34:15] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 0.87, 1.60, 1.74 [16:34:21] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.30, 3.91, 3.94 [16:34:58] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.16, 2.86, 3.27 [16:36:14] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.48, 1.86, 1.81 [16:38:12] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.27, 1.63, 1.73 [16:38:21] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.70, 4.36, 4.09 [16:38:55] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.67, 3.58, 3.45 [16:39:38] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.51, 10.42, 9.61 [16:40:11] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.52, 1.53, 1.68 [16:40:54] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.60, 3.20, 3.32 [16:42:21] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.38, 10.63, 9.61 [16:44:19] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.71, 10.01, 9.51 [16:44:21] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.66, 3.45, 3.78 [16:46:35] RECOVERY - gluster101 Puppet on gluster101 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [16:49:48] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.65, 3.51, 3.38 [16:50:21] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 7.91, 4.55, 4.04 [16:53:46] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.62, 3.10, 3.26 [16:55:27] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.04, 11.31, 10.51 [16:57:26] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.88, 11.05, 10.51 [17:02:21] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.46, 3.84, 3.89 [17:03:38] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.64, 4.01, 3.60 [17:05:37] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.61, 3.56, 3.49 [17:06:51] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.31, 3.46, 3.29 [17:07:36] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.50, 3.21, 3.37 [17:08:38] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.05, 9.89, 9.41 [17:08:47] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.65, 3.18, 3.21 [17:10:21] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.71, 3.93, 3.91 [17:10:32] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.55, 6.88, 6.13 [17:10:38] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.24, 9.31, 9.27 [17:12:21] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.27, 3.36, 3.71 [17:13:15] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.80, 9.71, 10.19 [17:14:21] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.16, 7.35, 6.46 [17:16:15] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.16, 6.53, 6.26 [17:20:21] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.03, 4.53, 3.98 [17:24:21] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.64, 3.86, 3.86 [17:26:21] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.02, 3.97, 3.90 [17:28:21] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.19, 3.46, 3.73 [17:30:03] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.59, 1.70, 2.00 [17:34:03] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.05, 1.77, 1.96 [17:38:21] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.09, 3.78, 3.69 [17:40:21] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.13, 3.17, 3.47 [17:44:21] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.81, 2.83, 3.29 [17:46:03] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.82, 1.93, 1.99 [17:48:03] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.80, 2.24, 2.10 [17:53:45] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.88, 9.86, 8.97 [17:55:44] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.75, 10.84, 9.43 [17:56:07] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.33, 3.69, 3.45 [17:58:21] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 6.41, 4.33, 2.77 [17:59:41] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.19, 11.56, 10.09 [18:00:01] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.60, 3.21, 3.32 [18:01:40] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.52, 11.54, 10.24 [18:03:38] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.55, 11.16, 10.26 [18:04:03] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.50, 1.70, 1.98 [18:04:10] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.93, 10.72, 9.34 [18:05:59] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.45, 3.71, 3.20 [18:06:03] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.26, 1.84, 2.00 [18:06:10] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.13, 3.62, 3.11 [18:06:16] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.70, 10.32, 9.11 [18:07:36] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.38, 11.67, 10.65 [18:07:42] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.22, 3.77, 3.52 [18:07:55] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.05, 3.49, 3.18 [18:08:06] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.75, 10.18, 9.42 [18:08:09] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.95, 3.64, 3.17 [18:08:16] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.75, 9.58, 8.98 [18:09:34] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.74, 11.34, 10.66 [18:09:39] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.71, 3.67, 3.51 [18:10:08] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.93, 4.20, 3.44 [18:11:36] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.65, 3.93, 3.61 [18:11:48] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.72, 3.19, 3.13 [18:12:00] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.36, 11.20, 9.97 [18:13:59] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.32, 11.14, 10.09 [18:15:42] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.19, 3.75, 3.38 [18:16:05] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.46, 3.31, 3.31 [18:19:24] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.05, 3.91, 3.74 [18:19:28] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.76, 9.87, 10.15 [18:19:34] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.40, 3.50, 3.39 [18:21:21] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.21, 3.92, 3.75 [18:21:30] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.69, 3.23, 3.30 [18:21:51] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.38, 9.62, 9.96 [18:22:20] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.49, 2.32, 1.50 [18:23:18] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.57, 3.57, 3.66 [18:23:24] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.90, 10.25, 10.26 [18:23:59] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.73, 3.66, 3.48 [18:24:20] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.36, 1.95, 1.46 [18:25:15] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.81, 4.37, 3.94 [18:25:58] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.36, 3.40, 3.39 [18:26:20] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.03, 1.60, 1.39 [18:27:21] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.65, 11.61, 10.76 [18:28:21] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.54, 4.21, 3.72 [18:29:05] [02puppet] 07Universal-Omega opened pull request 03#2680: Add chameleon composer - 13https://github.com/miraheze/puppet/pull/2680 [18:29:05] [url] Page not found · GitHub · GitHub | github.com [18:29:55] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.04, 4.31, 3.77 [18:30:17] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.23, 3.91, 3.68 [18:31:18] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.65, 11.41, 10.92 [18:32:13] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 3.69, 4.03, 3.76 [18:32:22] PROBLEM - gluster121 Puppet on gluster121 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:33:53] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.04, 3.53, 3.61 [18:34:09] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.35, 3.88, 3.74 [18:35:15] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.90, 12.20, 11.32 [18:37:14] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.65, 11.79, 11.26 [18:37:46] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.92, 9.65, 9.45 [18:37:51] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.53, 3.02, 3.39 [18:39:46] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.89, 9.89, 9.57 [18:39:57] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.26, 3.79, 3.69 [18:40:51] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.31, 3.57, 3.96 [18:43:46] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.58, 10.68, 9.96 [18:43:49] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.20, 3.75, 3.72 [18:45:46] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.53, 10.01, 9.81 [18:46:41] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.08, 4.36, 4.14 [18:49:38] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.30, 2.88, 3.37 [18:50:21] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 1.33, 4.11, 5.74 [18:50:36] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 1.84, 3.23, 3.74 [18:53:03] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.43, 1.88, 1.42 [18:54:21] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 0.80, 2.39, 4.66 [18:54:22] PROBLEM - buildabearwiki.info - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'buildabearwiki.info' expires in 15 day(s) (Mon 04 Jul 2022 18:36:48 GMT +0000). [18:54:29] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.91, 3.53, 3.70 [18:56:26] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.73, 3.46, 3.65 [18:57:01] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.27, 9.37, 10.10 [18:58:23] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.02, 3.66, 3.70 [18:58:33] PROBLEM - discordian.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'discordian.wiki' expires in 15 day(s) (Mon 04 Jul 2022 18:40:49 GMT +0000). [18:59:18] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.16, 1.59, 1.45 [18:59:25] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/999bfa074ab9...b4d5e4202ac5 [18:59:25] [url] Comparing 999bfa074ab9...b4d5e4202ac5 · miraheze/ssl · GitHub | github.com [18:59:26] [02miraheze/ssl] 07MirahezeSSLBot 03b4d5e42 - Bot: Update SSL cert for buildabearwiki.info [19:00:21] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.98, 3.23, 3.53 [19:00:22] RECOVERY - gluster121 Puppet on gluster121 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [19:00:44] PROBLEM - cp20 Varnish Backends on cp20 is CRITICAL: 1 backends are down. mw121 [19:00:57] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.09, 10.46, 10.35 [19:01:40] PROBLEM - cp21 Varnish Backends on cp21 is CRITICAL: 1 backends are down. mw101 [19:01:55] Reception123: if around, do you mind merging https://github.com/miraheze/puppet/pull/2678 and https://github.com/miraheze/puppet/pull/2680? [19:01:55] [url] Add GrowthExperiments jobs to jobQueueCollector by Universal-Omega · Pull Request #2678 · miraheze/puppet · GitHub | github.com [19:01:56] [url] Add chameleon composer by Universal-Omega · Pull Request #2680 · miraheze/puppet · GitHub | github.com [19:02:06] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.12, 10.08, 9.14 [19:02:39] RECOVERY - cp20 Varnish Backends on cp20 is OK: All 14 backends are healthy [19:02:55] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.64, 10.36, 10.35 [19:03:15] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.89, 1.87, 1.61 [19:03:29] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/b4d5e4202ac5...5e4f8386ac2b [19:03:30] [url] Comparing b4d5e4202ac5...5e4f8386ac2b · miraheze/ssl · GitHub | github.com [19:03:31] [02miraheze/ssl] 07MirahezeSSLBot 035e4f838 - Bot: Update SSL cert for discordian.wiki [19:03:40] RECOVERY - cp21 Varnish Backends on cp21 is OK: All 14 backends are healthy [19:04:04] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 9.90, 10.15, 9.30 [19:04:54] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.37, 11.11, 10.63 [19:06:53] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.56, 10.07, 10.31 [19:06:59] [02miraheze/ssl] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+1/-0/±0] 13https://github.com/miraheze/ssl/commit/871440a7e465 [19:07:00] [02miraheze/ssl] 07Universal-Omega 03871440a - Add wiki.minebox.fr cert [19:07:02] [02ssl] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/ssl [19:07:02] [url] Page not found · GitHub · GitHub | github.com [19:07:03] [02ssl] 07Universal-Omega opened pull request 03#550: Add wiki.minebox.fr cert - 13https://github.com/miraheze/ssl/pull/550 [19:07:04] [url] Page not found · GitHub · GitHub | github.com [19:07:13] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.32, 1.59, 1.56 [19:07:52] [02miraheze/ssl] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/871440a7e465...29588889779b [19:07:52] [url] Comparing 871440a7e465...29588889779b · miraheze/ssl · GitHub | github.com [19:07:53] [02miraheze/ssl] 07Universal-Omega 032958888 - Update certs.yaml [19:07:55] [02ssl] 07Universal-Omega synchronize pull request 03#550: Add wiki.minebox.fr cert - 13https://github.com/miraheze/ssl/pull/550 [19:07:55] [url] Page not found · GitHub · GitHub | github.com [19:08:41] [02ssl] 07Universal-Omega closed pull request 03#550: Add wiki.minebox.fr cert - 13https://github.com/miraheze/ssl/pull/550 [19:08:41] [url] Page not found · GitHub · GitHub | github.com [19:08:42] [02miraheze/ssl] 07Universal-Omega pushed 031 commit to 03master [+1/-0/±1] 13https://github.com/miraheze/ssl/compare/5e4f8386ac2b...25c60452ed9f [19:08:43] [url] Comparing 5e4f8386ac2b...25c60452ed9f · miraheze/ssl · GitHub | github.com [19:08:44] [02miraheze/ssl] 07Universal-Omega 0325c6045 - Add wiki.minebox.fr cert (#550) [19:08:45] [02miraheze/ssl] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [19:08:47] [02ssl] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/ssl [19:08:47] [url] Page not found · GitHub · GitHub | github.com [19:08:51] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 5.85, 8.54, 9.71 [19:09:26] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.45, 3.06, 3.03 [19:11:01] [02miraheze/ssl] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+1/-0/±0] 13https://github.com/miraheze/ssl/commit/925a87b3bce7 [19:11:03] [02miraheze/ssl] 07Universal-Omega 03925a87b - Add wiki.exputra.com cert [19:11:04] [02ssl] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/ssl [19:11:05] [url] Page not found · GitHub · GitHub | github.com [19:11:06] [02ssl] 07Universal-Omega opened pull request 03#551: Add wiki.exputra.com cert - 13https://github.com/miraheze/ssl/pull/551 [19:11:06] ... [19:11:26] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.90, 3.04, 3.03 [19:11:39] [02miraheze/ssl] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/925a87b3bce7...a3be58b26989 [19:11:40] [url] Comparing 925a87b3bce7...a3be58b26989 · miraheze/ssl · GitHub | github.com [19:11:41] [02miraheze/ssl] 07Universal-Omega 03a3be58b - Update certs.yaml [19:11:42] [02ssl] 07Universal-Omega synchronize pull request 03#551: Add wiki.exputra.com cert - 13https://github.com/miraheze/ssl/pull/551 [19:11:43] [url] Page not found · GitHub · GitHub | github.com [19:12:04] [02ssl] 07Universal-Omega closed pull request 03#551: Add wiki.exputra.com cert - 13https://github.com/miraheze/ssl/pull/551 [19:12:04] ... [19:12:05] [02miraheze/ssl] 07Universal-Omega pushed 031 commit to 03master [+1/-0/±1] 13https://github.com/miraheze/ssl/compare/25c60452ed9f...699cba1ba760 [19:12:06] [url] Comparing 25c60452ed9f...699cba1ba760 · miraheze/ssl · GitHub | github.com [19:12:07] [02miraheze/ssl] 07Universal-Omega 03699cba1 - Add wiki.exputra.com cert (#551) [19:12:08] [02miraheze/ssl] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [19:12:10] [02ssl] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/ssl [19:12:10] [url] Page not found · GitHub · GitHub | github.com [19:16:21] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.42, 4.09, 3.75 [19:16:29] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.41, 3.58, 3.13 [19:17:26] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.33, 3.46, 3.18 [19:18:28] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.78, 3.51, 3.15 [19:20:27] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.19, 4.21, 3.43 [19:21:26] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.55, 3.16, 3.14 [19:22:21] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.85, 3.88, 3.76 [19:22:26] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.73, 3.78, 3.36 [19:24:21] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.19, 4.06, 3.85 [19:24:25] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.80, 4.21, 3.57 [19:26:21] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.47, 3.51, 3.68 [19:26:24] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.64, 3.61, 3.42 [19:28:03] RECOVERY - discordian.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'discordian.wiki' will expire on Fri 16 Sep 2022 18:03:24 GMT +0000. [19:28:08] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query bellinrattin.it. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [19:30:34] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.54, 3.40, 3.40 [19:31:16] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.36, 3.77, 3.72 [19:32:36] PROBLEM - db121 Current Load on db121 is WARNING: WARNING - load average: 7.76, 6.52, 4.21 [19:32:52] PROBLEM - gluster121 Puppet on gluster121 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [19:33:09] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.85, 4.04, 3.47 [19:34:26] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.03, 3.50, 3.46 [19:34:33] PROBLEM - db121 Current Load on db121 is CRITICAL: CRITICAL - load average: 9.46, 7.59, 4.88 [19:36:29] RECOVERY - db121 Current Load on db121 is OK: OK - load average: 4.17, 6.51, 4.82 [19:36:46] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/029327bba42b...7fc5e137db7d [19:36:47] [url] Comparing 029327bba42b...7fc5e137db7d · miraheze/mw-config · GitHub | github.com [19:36:48] [02miraheze/mw-config] 07Universal-Omega 037fc5e13 - logging: add "Parsoid"; make "slow-parsoid" info; remove override for "Parser" [19:37:52] miraheze/mw-config - Universal-Omega the build passed. [19:38:21] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.10, 4.45, 3.82 [19:38:44] [02puppet] 07Reception123 closed pull request 03#2680: Add chameleon composer - 13https://github.com/miraheze/puppet/pull/2680 [19:38:45] [url] Page not found · GitHub · GitHub | github.com [19:38:46] [02miraheze/puppet] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/74b1084ac56c...66f13b7a06db [19:38:46] [url] Comparing 74b1084ac56c...66f13b7a06db · miraheze/puppet · GitHub | github.com [19:38:47] [02miraheze/puppet] 07Universal-Omega 0366f13b7 - Add chameleon composer (#2680) [19:39:02] [02miraheze/puppet] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/66f13b7a06db...0eba3f864fb3 [19:39:03] [url] Comparing 66f13b7a06db...0eba3f864fb3 · miraheze/puppet · GitHub | github.com [19:39:04] [02miraheze/puppet] 07Universal-Omega 030eba3f8 - Add GrowthExperiments jobs to jobQueueCollector (#2678) [19:39:05] [02puppet] 07Reception123 closed pull request 03#2678: Add GrowthExperiments jobs to jobQueueCollector - 13https://github.com/miraheze/puppet/pull/2678 [19:39:06] [url] Page not found · GitHub · GitHub | github.com [19:39:14] Thanks Reception123 [19:39:59] no problem [19:40:51] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.99, 3.87, 3.66 [19:42:47] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.19, 4.54, 3.96 [19:44:42] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.46, 3.77, 3.74 [19:44:51] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.09, 3.46, 3.81 [19:48:08] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.29, 3.67, 3.86 [19:48:33] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.87, 3.78, 3.72 [19:48:44] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.93, 4.38, 4.04 [19:49:59] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/c4c60b52d725 [19:50:01] [02miraheze/mw-config] 07Universal-Omega 03c4c60b5 - Wrap username-prefix value in quotes for `$wgImportDumpScriptCommand` [19:50:02] [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-2 - 13https://github.com/miraheze/mw-config [19:50:03] [url] Page not found · GitHub · GitHub | github.com [19:50:04] [02mw-config] 07Universal-Omega opened pull request 03#4780: Wrap username-prefix value in quotes for `$wgImportDumpScriptCommand` - 13https://github.com/miraheze/mw-config/pull/4780 [19:50:04] [url] Page not found · GitHub · GitHub | github.com [19:50:28] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.54, 3.92, 3.81 [19:50:43] !log [@test101] starting deploy of {'config': True} to all [19:50:44] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 1s [19:50:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:50:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:51:05] miraheze/mw-config - Universal-Omega the build passed. [19:51:53] [02mw-config] 07Universal-Omega closed pull request 03#4780: Wrap username-prefix value in quotes for `$wgImportDumpScriptCommand` - 13https://github.com/miraheze/mw-config/pull/4780 [19:51:54] ... [19:51:55] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/7fc5e137db7d...d67b4dd01f68 [19:51:55] [url] Comparing 7fc5e137db7d...d67b4dd01f68 · miraheze/mw-config · GitHub | github.com [19:51:56] [02miraheze/mw-config] 07Universal-Omega 03d67b4dd - Wrap username-prefix value in quotes for `$wgImportDumpScriptCommand` (#4780) [19:51:58] [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 [19:51:59] [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 - 13https://github.com/miraheze/mw-config [19:52:00] [url] Page not found · GitHub · GitHub | github.com [19:52:26] !log [@mwtask111] starting deploy of {'config': True} to all [19:52:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:52:37] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.97, 3.66, 3.85 [19:52:44] !log [@mwtask111] finished deploy of {'config': True} to all - SUCCESS in 18s [19:52:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:53:04] miraheze/mw-config - Universal-Omega the build passed. [19:54:05] RECOVERY - buildabearwiki.info - LetsEncrypt on sslhost is OK: OK - Certificate 'buildabearwiki.info' will expire on Fri 16 Sep 2022 17:59:19 GMT +0000. [19:55:17] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.87, 1.67, 1.32 [19:55:37] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/d67b4dd01f68...c96513258e78 [19:55:38] [url] Comparing d67b4dd01f68...c96513258e78 · miraheze/mw-config · GitHub | github.com [19:55:39] [02miraheze/mw-config] 07Universal-Omega 03c965132 - map mh to miraheze.org in `$wgImportDumpInterwikiMap` [19:56:31] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.14, 3.48, 3.70 [19:56:36] miraheze/mw-config - Universal-Omega the build passed. [19:56:53] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.43, 1.76, 1.95 [19:57:17] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.88, 1.39, 1.25 [19:58:04] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.60, 3.55, 3.63 [19:58:05] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp20.miraheze.org - CNAME OK [19:58:10] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.18, 3.96, 3.72 [19:58:45] RECOVERY - gluster121 Puppet on gluster121 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [20:00:01] PROBLEM - matomo101 Current Load on matomo101 is WARNING: WARNING - load average: 3.63, 3.13, 2.59 [20:00:04] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.50, 3.22, 3.50 [20:00:05] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.46, 3.80, 3.69 [20:00:23] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.14, 4.00, 3.92 [20:02:01] RECOVERY - matomo101 Current Load on matomo101 is OK: OK - load average: 2.79, 2.93, 2.58 [20:02:04] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.97, 3.03, 3.39 [20:02:25] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.72, 9.78, 8.59 [20:04:24] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.68, 9.20, 8.51 [20:05:37] !log [@mwtask111] starting deploy of {'config': True} to all [20:05:40] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.58, 10.12, 8.96 [20:05:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:05:45] !log [@mwtask111] finished deploy of {'config': True} to all - SUCCESS in 8s [20:05:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:07:50] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.70, 3.02, 3.35 [20:08:54] .in 10h ImportDump desc + update guides [20:08:55] Reception123: Okay, will remind at 2022-06-19 - 08:08:54CEST [20:09:33] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.14, 9.88, 9.14 [20:10:49] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 0.62, 1.19, 1.57 [20:14:50] !log [universalomega@mwtask111] starting deploy of {'world': True} to all [20:14:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:15:56] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.67, 3.06, 3.40 [20:16:24] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.79, 10.24, 9.60 [20:18:37] PROBLEM - mwtask111 MediaWiki Rendering on mwtask111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:18:39] PROBLEM - gluster101 Puppet on gluster101 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [20:19:06] PROBLEM - cp21 Stunnel HTTP for mwtask111 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:19:10] PROBLEM - cp20 Stunnel HTTP for mwtask111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:19:13] PROBLEM - cp31 Stunnel HTTP for mwtask111 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:19:17] !log [@test101] starting deploy of {'config': True} to all [20:19:18] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 0s [20:19:22] PROBLEM - cp30 Stunnel HTTP for mwtask111 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:19:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:19:28] PROBLEM - mwtask111 APT on mwtask111 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [20:19:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:19:51] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.12, 3.97, 3.69 [20:20:14] PROBLEM - mwtask111 Current Load on mwtask111 is CRITICAL: CRITICAL - load average: 15.38, 7.57, 3.80 [20:20:17] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.91, 11.70, 10.30 [20:22:13] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.57, 11.68, 10.46 [20:22:48] PROBLEM - mwtask111 php-fpm on mwtask111 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [20:22:49] PROBLEM - mwtask111 PowerDNS Recursor on mwtask111 is CRITICAL: CRITICAL - Plugin timed out while executing system call [20:22:53] PROBLEM - mwtask111 SSH on mwtask111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:23:06] CosmicAlpha: you on task ^ [20:23:45] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.82, 3.84, 3.70 [20:23:52] RhinosF1: Trying to, I have a deploy running, but it kinda froze on me, ctrl+c not working, and I can't open a new ssh session. [20:24:15] CosmicAlpha: yeah it's locked up [20:24:25] It'll likely need a reboot if it's frozen [20:24:28] PROBLEM - mwtask111 Puppet on mwtask111 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [20:24:32] From promox [20:24:42] paladox, Reception123: ^ [20:24:43] RECOVERY - mwtask111 php-fpm on mwtask111 is OK: PROCS OK: 3 processes with command name 'php-fpm7.4' [20:24:45] RECOVERY - mwtask111 PowerDNS Recursor on mwtask111 is OK: DNS OK: 0.815 seconds response time. miraheze.org returns 198.244.148.90,2001:41d0:801:2000::1b80,2001:41d0:801:2000::4c25,51.195.220.68 [20:24:50] Working again RhinosF1 [20:24:52] RECOVERY - mwtask111 SSH on mwtask111 is OK: SSH OK - OpenSSH_8.4p1 Debian-5 (protocol 2.0) [20:25:03] CosmicAlpha: hmm [20:25:16] Might be worth seeing if you can tell what was running [20:26:27] RECOVERY - mwtask111 Puppet on mwtask111 is OK: OK: Puppet is currently enabled, last run 20 minutes ago with 0 failures [20:26:42] RECOVERY - mwtask111 APT on mwtask111 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [20:26:45] RECOVERY - mwtask111 MediaWiki Rendering on mwtask111 is OK: HTTP OK: HTTP/1.1 200 OK - 29923 bytes in 0.484 second response time [20:27:30] RECOVERY - cp21 Stunnel HTTP for mwtask111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15891 bytes in 0.058 second response time [20:27:33] RECOVERY - cp20 Stunnel HTTP for mwtask111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15891 bytes in 0.022 second response time [20:27:41] RECOVERY - cp31 Stunnel HTTP for mwtask111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15897 bytes in 0.313 second response time [20:27:45] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.02, 4.50, 3.96 [20:27:49] RECOVERY - cp30 Stunnel HTTP for mwtask111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15891 bytes in 0.331 second response time [20:28:03] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.09, 11.84, 10.91 [20:29:43] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.56, 3.34, 3.22 [20:29:59] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.91, 10.82, 10.62 [20:31:08] !log [universalomega@mwtask111] finished deploy of {'world': True} to all - SUCCESS in 977s [20:31:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:31:40] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.84, 3.18, 3.17 [20:31:45] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.61, 3.58, 3.74 [20:35:45] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.39, 3.47, 3.62 [20:39:45] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.82, 3.56, 3.65 [20:41:22] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.87, 3.60, 3.42 [20:41:37] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.67, 9.39, 10.03 [20:41:45] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.15, 4.01, 3.82 [20:42:32] PROBLEM - mwtask111 Current Load on mwtask111 is WARNING: WARNING - load average: 0.56, 1.24, 4.00 [20:43:20] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.56, 3.21, 3.29 [20:43:45] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.23, 3.39, 3.61 [20:44:39] RECOVERY - gluster101 Puppet on gluster101 is OK: OK: Puppet is currently enabled, last run 44 seconds ago with 0 failures [20:45:45] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.20, 3.83, 3.75 [20:46:23] RECOVERY - mwtask111 Current Load on mwtask111 is OK: OK - load average: 0.28, 0.74, 3.19 [20:47:08] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.32, 3.71, 3.26 [20:50:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.37, 3.63, 3.46 [20:50:38] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.78, 1.96, 1.19 [20:50:59] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.47, 3.41, 3.30 [20:52:04] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.97, 4.06, 3.63 [20:54:37] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.61, 1.92, 1.37 [20:56:04] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.43, 3.94, 3.69 [20:58:04] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.91, 4.56, 3.93 [20:58:41] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.44, 4.18, 3.68 [21:00:04] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.80, 3.85, 3.75 [21:00:36] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.98, 3.72, 3.57 [21:02:04] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.23, 4.25, 3.89 [21:02:24] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.73, 9.80, 8.75 [21:03:30] PROBLEM - mwtask111 Check Gluster Clients on mwtask111 is CRITICAL: PROCS CRITICAL: 0 processes with args '/usr/sbin/glusterfs' [21:04:04] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.56, 3.93, 3.82 [21:04:25] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.97, 9.47, 8.76 [21:04:34] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.39, 1.95, 1.59 [21:07:05] !log sudo systemctl stop mirahezerenewssl on mwtask111 [21:07:05] !log sudo systemctl disable mirahezerenewssl on mwtask111 [21:07:05] !log sudo systemctl daemon-reload on mwtask111 [21:07:06] !log sudo systemctl reset-failed on mwtask111 [21:07:06] !log sudo rm /usr/lib/systemd/system/mirahezerenewssl.service on mwtask111 [21:07:06] !log sudo rm /usr/local/bin/mirahezerenewssl.py on mwtask111 [21:07:06] !log reboot mwtask111 [21:07:07] !log mount /mnt/mediawiki-static on mwtask111 [21:07:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:07:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:07:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:07:30] RECOVERY - mwtask111 Check Gluster Clients on mwtask111 is OK: PROCS OK: 1 process with args '/usr/sbin/glusterfs' [21:07:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:07:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:07:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:07:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:07:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:08:04] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.42, 4.12, 3.86 [21:09:45] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.77, 3.45, 3.86 [21:10:04] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.52, 3.58, 3.70 [21:10:13] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.96, 3.23, 3.39 [21:11:45] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.40, 3.72, 3.90 [21:12:32] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.59, 1.90, 1.73 [21:13:45] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.67, 3.60, 3.83 [21:14:04] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.05, 3.39, 3.56 [21:14:06] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.18, 3.65, 3.50 [21:14:32] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.22, 1.98, 1.77 [21:16:01] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.42, 3.53, 3.47 [21:16:04] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.81, 3.48, 3.57 [21:16:31] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.74, 1.87, 1.76 [21:17:56] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.37, 3.32, 3.39 [21:18:31] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.64, 2.19, 1.89 [21:20:04] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.22, 3.15, 3.39 [21:21:45] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.81, 4.17, 3.84 [21:23:45] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.11, 3.86, 3.78 [21:27:45] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.15, 4.29, 3.94 [21:28:28] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.39, 1.92, 1.99 [21:28:53] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.57, 4.21, 3.70 [21:29:45] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.10, 3.72, 3.77 [21:29:50] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.90, 3.94, 3.71 [21:30:51] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.81, 3.89, 3.66 [21:36:25] PROBLEM - prometheus101 APT on prometheus101 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [21:36:43] PROBLEM - prometheus101 Current Load on prometheus101 is CRITICAL: CRITICAL - load average: 4.83, 2.71, 1.42 [21:37:50] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.53, 3.08, 3.39 [21:40:25] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.09, 1.32, 1.65 [21:40:37] RECOVERY - prometheus101 APT on prometheus101 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [21:41:45] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.21, 3.55, 3.54 [21:43:45] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.61, 3.50, 3.52 [21:44:33] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.25, 4.40, 3.84 [21:45:45] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.36, 3.76, 3.61 [21:46:41] PROBLEM - prometheus101 Current Load on prometheus101 is WARNING: WARNING - load average: 0.25, 1.53, 1.80 [21:47:23] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 3.96, 2.35, 1.94 [21:47:45] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.83, 3.53, 3.55 [21:48:28] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.15, 3.72, 3.70 [21:48:40] RECOVERY - prometheus101 Current Load on prometheus101 is OK: OK - load average: 0.25, 1.08, 1.60 [21:55:45] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.91, 4.41, 3.88 [21:56:16] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 4.00, 4.00, 3.60 [21:56:47] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/c96513258e78...b9a465d029f1 [21:56:48] [url] Comparing c96513258e78...b9a465d029f1 · miraheze/mw-config · GitHub | github.com [21:56:49] [02miraheze/mw-config] 07Universal-Omega 03b9a465d - make `$wgRSSCacheAge` an int [21:57:20] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.61, 1.92, 1.95 [21:57:45] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.32, 3.90, 3.75 [21:58:03] miraheze/mw-config - Universal-Omega the build passed. [21:58:11] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.26, 4.36, 3.78 [21:59:20] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.40, 2.05, 1.98 [21:59:45] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.50, 4.39, 3.97 [22:00:07] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.07, 3.85, 3.66 [22:01:45] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.56, 3.74, 3.78 [22:01:47] PROBLEM - gluster111 Puppet on gluster111 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [22:03:45] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.72, 4.11, 3.90 [22:04:07] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.37, 3.57, 3.55 [22:05:45] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.96, 3.80, 3.83 [22:06:05] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.22, 3.58, 3.57 [22:07:08] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.38, 10.81, 9.82 [22:07:18] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.59, 1.88, 1.95 [22:09:30] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.84, 1.72, 1.39 [22:09:50] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.65, 3.12, 3.39 [22:11:24] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.89, 1.40, 1.31 [22:11:45] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.84, 2.58, 3.27 [22:12:04] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.09, 2.75, 3.21 [22:14:54] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.11, 9.33, 9.66 [22:19:15] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.21, 1.95, 1.91 [22:20:18] !log [@test101] starting deploy of {'config': True} to all [22:20:19] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 0s [22:20:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:20:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:22:02] !log [@mwtask111] starting deploy of {'config': True} to all [22:22:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:22:11] !log [@mwtask111] finished deploy of {'config': True} to all - SUCCESS in 8s [22:22:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:25:27] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.99, 2.00, 1.53 [22:27:25] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.72, 1.55, 1.42 [22:27:45] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.25, 3.62, 3.30 [22:29:45] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.46, 3.79, 3.42 [22:29:47] RECOVERY - gluster111 Puppet on gluster111 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [22:31:11] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.60, 1.90, 1.96 [22:31:45] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.63, 4.12, 3.58 [22:37:10] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.18, 1.86, 1.91 [22:37:45] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.15, 3.74, 3.64 [22:39:09] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.73, 1.76, 1.86 [22:39:17] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 1.35, 3.21, 2.41 [22:43:45] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.66, 4.06, 3.76 [22:45:08] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.58, 3.81, 3.38 [22:45:11] !log [universalomega@test101] starting deploy of {'pull': 'config', 'config': True, 'ignoretime': True} to all [22:45:13] !log [universalomega@test101] finished deploy of {'pull': 'config', 'config': True, 'ignoretime': True} to all - SUCCESS in 1s [22:45:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:45:17] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.67, 1.61, 1.94 [22:45:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:46:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.08, 3.74, 3.29 [22:47:04] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.38, 3.61, 3.35 [22:47:07] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.78, 2.02, 1.88 [22:47:45] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.01, 3.50, 3.61 [22:48:19] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.54, 3.27, 3.17 [22:48:59] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.30, 3.11, 3.20 [22:49:45] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.43, 3.77, 3.68 [22:51:45] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.92, 3.70, 3.66 [22:55:17] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.76, 1.21, 1.62 [22:55:45] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.83, 3.99, 3.73 [22:57:45] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.32, 3.82, 3.70 [22:59:45] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.08, 3.88, 3.73 [23:01:45] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 1.98, 3.15, 3.48 [23:02:51] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 14.39, 9.56, 6.74 [23:03:17] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 1.66, 2.41, 2.03 [23:03:45] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.15, 2.87, 3.34 [23:05:17] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.10, 1.94, 1.90 [23:07:48] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.91, 4.31, 3.71 [23:08:33] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.91, 3.78, 3.43 [23:09:45] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.71, 4.24, 3.77 [23:10:28] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.68, 4.28, 3.64 [23:10:51] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 4.67, 7.18, 6.91 [23:11:01] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.43, 1.83, 1.96 [23:11:17] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.81, 2.12, 1.92 [23:12:23] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.85, 3.66, 3.48 [23:12:51] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 3.97, 6.17, 6.58 [23:13:17] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.20, 1.72, 1.80 [23:17:17] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.61, 1.26, 1.60 [23:17:35] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.50, 3.56, 3.69 [23:17:45] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.97, 3.96, 3.89 [23:18:10] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.95, 3.24, 3.37 [23:18:59] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.67, 2.02, 1.94 [23:21:45] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.30, 4.14, 3.97 [23:23:27] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.21, 3.56, 3.59 [23:24:57] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.72, 1.98, 1.99 [23:25:25] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.93, 3.48, 3.54 [23:27:09] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.14, 1.74, 1.48 [23:28:50] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.21, 3.75, 3.51 [23:29:20] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.11, 3.72, 3.62 [23:30:45] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.53, 3.67, 3.51 [23:31:01] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.22, 1.59, 1.49 [23:31:45] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.23, 3.98, 3.99 [23:33:15] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.99, 3.86, 3.68 [23:34:36] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.93, 3.08, 3.34 [23:37:09] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.47, 2.83, 3.28 [23:42:52] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.47, 1.54, 1.68 [23:43:45] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.39, 3.43, 3.54 [23:45:45] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.96, 3.48, 3.54 [23:48:50] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.45, 2.03, 1.84 [23:49:45] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.68, 3.84, 3.66 [23:51:45] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.29, 3.35, 3.51 [23:51:57] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.27, 3.78, 3.37 [23:52:49] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.71, 1.98, 1.89 [23:53:53] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.56, 3.29, 3.24 [23:53:56] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.82, 1.63, 1.47 [23:55:55] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.92, 1.43, 1.43 [23:57:45] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.45, 3.03, 3.35