[00:02:13] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.80, 9.63, 9.20 [00:03:06] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.83, 4.90, 3.34 [00:04:10] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.94, 9.16, 9.07 [00:05:25] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.89, 6.61, 6.36 [00:09:30] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK [00:13:22] PROBLEM - mw132 Current Load on mw132 is CRITICAL: CRITICAL - load average: 17.11, 12.17, 7.90 [00:13:41] PROBLEM - mw142 Current Load on mw142 is CRITICAL: CRITICAL - load average: 15.13, 10.29, 7.03 [00:13:45] PROBLEM - mw132 nutcracker process on mw132 is CRITICAL: PROCS CRITICAL: 0 processes with UID = 115 (nutcracker), command name 'nutcracker' [00:13:51] PROBLEM - mw132 MediaWiki Rendering on mw132 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 8191 bytes in 0.228 second response time [00:13:54] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.93, 11.83, 10.10 [00:14:11] PROBLEM - mw131 Current Load on mw131 is WARNING: WARNING - load average: 10.50, 11.35, 8.10 [00:14:40] PROBLEM - mw142 nutcracker process on mw142 is CRITICAL: PROCS CRITICAL: 0 processes with UID = 115 (nutcracker), command name 'nutcracker' [00:14:56] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 16.22, 12.35, 10.07 [00:15:17] PROBLEM - graylog131 Current Load on graylog131 is CRITICAL: CRITICAL - load average: 7.46, 4.51, 2.46 [00:15:20] PROBLEM - mw132 Current Load on mw132 is WARNING: WARNING - load average: 8.07, 10.42, 7.77 [00:15:20] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 12.64, 4.59, 2.16 [00:15:41] RECOVERY - mw142 Current Load on mw142 is OK: OK - load average: 8.88, 10.20, 7.44 [00:16:11] RECOVERY - mw131 Current Load on mw131 is OK: OK - load average: 6.18, 9.58, 7.86 [00:16:23] [02miraheze/mw-config] 07AgentIsai pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/035229c23e62...a1910c61fa0e [00:16:25] [02miraheze/mw-config] 07AgentIsai 03a1910c6 - Update what users require 2FA on metawiki and mirror that on metawikibeta [00:16:29] PROBLEM - mw142 MediaWiki Rendering on mw142 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 8191 bytes in 0.260 second response time [00:16:52] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.33, 3.77, 3.78 [00:16:52] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.69, 10.88, 9.80 [00:17:15] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 2.60, 3.47, 2.04 [00:17:20] miraheze/mw-config - AgentIsai the build passed. [00:17:52] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.98, 11.19, 10.38 [00:18:49] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 3.54, 4.04, 3.89 [00:19:10] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 0.87, 2.50, 1.85 [00:19:12] PROBLEM - os131 Current Load on os131 is CRITICAL: CRITICAL - load average: 4.30, 3.60, 2.14 [00:19:16] RECOVERY - mw132 Current Load on mw132 is OK: OK - load average: 8.43, 10.00, 8.25 [00:20:47] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.15, 3.41, 3.68 [00:21:38] PROBLEM - db131 Current Load on db131 is WARNING: WARNING - load average: 7.68, 6.13, 3.66 [00:21:51] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.11, 9.18, 9.77 [00:22:41] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.17, 9.32, 9.56 [00:23:16] PROBLEM - mw132 Current Load on mw132 is CRITICAL: CRITICAL - load average: 17.14, 13.48, 10.01 [00:23:38] RECOVERY - db131 Current Load on db131 is OK: OK - load average: 5.28, 5.98, 3.93 [00:24:43] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.80, 2.50, 3.25 [00:25:12] RECOVERY - os131 Current Load on os131 is OK: OK - load average: 1.95, 3.28, 2.57 [00:25:16] RECOVERY - mw132 Current Load on mw132 is OK: OK - load average: 4.31, 9.91, 9.13 [00:25:55] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 8.89, 6.60, 4.38 [00:26:50] PROBLEM - os141 Current Load on os141 is WARNING: WARNING - load average: 3.43, 3.22, 2.47 [00:27:20] PROBLEM - cp23 Varnish Backends on cp23 is CRITICAL: 1 backends are down. mw132 [00:27:35] !log [@test131] starting deploy of {'config': True} to all [00:27:36] !log [@test131] finished deploy of {'config': True} to all - SUCCESS in 1s [00:27:45] RECOVERY - mw132 nutcracker process on mw132 is OK: PROCS OK: 1 process with UID = 115 (nutcracker), command name 'nutcracker' [00:27:52] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 21.08, 14.56, 11.54 [00:27:53] RECOVERY - mw132 MediaWiki Rendering on mw132 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.334 second response time [00:27:55] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 4.04, 5.52, 4.25 [00:28:11] [02puppet] 07AgentIsai opened pull request 03#3217: Allow mediawiki-admins to restart Nutcracker - 13https://github.com/miraheze/puppet/pull/3217 [00:28:31] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 19.41, 15.14, 11.69 [00:28:35] PROBLEM - cp33 Varnish Backends on cp33 is CRITICAL: 1 backends are down. mw132 [00:28:44] PROBLEM - cp22 Varnish Backends on cp22 is CRITICAL: 1 backends are down. mw132 [00:28:46] PROBLEM - os141 Current Load on os141 is CRITICAL: CRITICAL - load average: 4.28, 3.52, 2.67 [00:29:19] !log [void@mw142] restart nutcracker service (here and on mw132) [00:29:20] RECOVERY - cp23 Varnish Backends on cp23 is OK: All 14 backends are healthy [00:29:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:30:12] RECOVERY - mw142 MediaWiki Rendering on mw142 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.392 second response time [00:30:35] RECOVERY - cp33 Varnish Backends on cp33 is OK: All 14 backends are healthy [00:30:40] RECOVERY - mw142 nutcracker process on mw142 is OK: PROCS OK: 1 process with UID = 115 (nutcracker), command name 'nutcracker' [00:30:42] PROBLEM - os141 Current Load on os141 is WARNING: WARNING - load average: 3.51, 3.64, 2.82 [00:30:44] RECOVERY - cp22 Varnish Backends on cp22 is OK: All 14 backends are healthy [00:31:55] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 9.62, 7.31, 5.26 [00:33:17] [02puppet] 07AgentIsai opened pull request 03#3218: Always restart nutcracker - 13https://github.com/miraheze/puppet/pull/3218 [00:33:52] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.28, 11.53, 11.19 [00:33:55] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 7.97, 7.65, 5.65 [00:36:34] PROBLEM - os141 Current Load on os141 is CRITICAL: CRITICAL - load average: 4.37, 3.92, 3.18 [00:37:55] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 4.42, 6.24, 5.58 [00:39:17] PROBLEM - graylog131 Current Load on graylog131 is WARNING: WARNING - load average: 1.23, 3.18, 4.00 [00:40:08] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.21, 10.88, 11.26 [00:41:55] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 7.76, 7.51, 6.28 [00:43:17] RECOVERY - graylog131 Current Load on graylog131 is OK: OK - load average: 1.43, 2.02, 3.31 [00:43:55] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 10.39, 8.80, 6.91 [00:45:57] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.78, 3.85, 3.02 [00:47:52] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.17, 8.89, 9.98 [00:47:55] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.93, 3.71, 3.06 [00:47:56] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.04, 8.69, 10.05 [00:48:28] !log [@mwtask141] starting deploy of {'config': True} to all [00:48:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:49:17] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 51s [00:49:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:49:54] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.72, 2.97, 2.87 [00:53:56] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.76, 10.23, 10.25 [00:55:56] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.19, 10.65, 10.39 [00:57:56] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.92, 9.82, 10.11 [00:57:58] PROBLEM - os141 Current Load on os141 is WARNING: WARNING - load average: 2.37, 3.52, 3.81 [00:58:52] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.36, 10.37, 10.20 [01:00:49] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.19, 10.78, 10.35 [01:01:56] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.55, 10.88, 10.45 [01:02:46] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.38, 10.53, 10.34 [01:03:56] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 15.04, 12.05, 10.90 [01:05:55] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 5.96, 7.12, 7.98 [01:07:46] PROBLEM - os141 Current Load on os141 is CRITICAL: CRITICAL - load average: 4.13, 3.47, 3.61 [01:08:39] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.91, 11.35, 10.75 [01:09:44] PROBLEM - os141 Current Load on os141 is WARNING: WARNING - load average: 3.04, 3.30, 3.54 [01:11:41] RECOVERY - os141 Current Load on os141 is OK: OK - load average: 1.90, 2.86, 3.35 [01:14:34] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.15, 3.64, 3.18 [01:15:55] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 8.01, 6.54, 7.11 [01:16:28] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 6.92, 11.65, 11.69 [01:18:26] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.13, 12.22, 11.88 [01:18:35] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.53, 2.78, 2.94 [01:19:31] PROBLEM - os141 Current Load on os141 is CRITICAL: CRITICAL - load average: 6.40, 4.47, 3.77 [01:20:23] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.11, 11.19, 11.56 [01:21:08] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.45, 6.97, 6.28 [01:21:56] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.46, 11.43, 11.96 [01:23:06] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.63, 6.22, 6.07 [01:27:27] PROBLEM - os141 Current Load on os141 is WARNING: WARNING - load average: 3.50, 3.88, 3.80 [01:28:20] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 6.83, 3.43, 1.83 [01:28:35] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.63, 3.43, 3.17 [01:29:55] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 3.52, 6.41, 7.64 [01:30:35] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.41, 3.11, 3.08 [01:31:26] RECOVERY - os141 Current Load on os141 is OK: OK - load average: 0.25, 2.06, 3.09 [01:32:20] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.05, 3.82, 2.39 [01:33:55] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 1.61, 3.79, 6.27 [01:33:56] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 15.78, 11.55, 11.39 [01:34:20] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.67, 2.67, 2.14 [01:36:02] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.32, 11.24, 10.88 [01:39:34] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.05, 3.64, 2.99 [01:39:56] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.85, 11.44, 11.51 [01:39:57] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.93, 10.85, 10.88 [01:41:34] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.87, 3.35, 2.97 [01:41:55] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.93, 11.91, 11.25 [01:45:52] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.64, 11.44, 11.17 [01:47:31] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 8.00, 6.79, 6.25 [01:47:34] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.12, 4.56, 3.55 [01:47:52] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.50, 11.97, 11.40 [01:47:56] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.20, 11.27, 11.29 [01:49:29] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 11.81, 8.23, 6.81 [01:51:26] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.87, 7.08, 6.56 [01:51:51] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.57, 11.90, 11.52 [01:53:52] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.56, 13.45, 12.15 [01:54:34] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.22, 3.90, 3.13 [01:55:21] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.45, 6.36, 6.41 [01:58:47] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1030324996 secs [02:00:34] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.54, 3.91, 3.51 [02:01:34] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.89, 3.53, 3.88 [02:02:35] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.29, 2.96, 3.21 [02:03:51] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.41, 11.23, 11.78 [02:03:55] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 9.66, 5.74, 4.05 [02:04:32] [02miraheze/mw-config] 07AgentIsai pushed 031 commit to 03AgentIsai-patch-1 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/d8183eeec761 [02:04:34] [02miraheze/mw-config] 07AgentIsai 03d8183ee - Set WebAuthn config [02:04:36] [02mw-config] 07AgentIsai created branch 03AgentIsai-patch-1 - 13https://github.com/miraheze/mw-config [02:05:52] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.02, 11.64, 11.86 [02:07:28] [02mw-config] 07AgentIsai opened pull request 03#5232: Set WebAuthn configuration to allow security key login on all *.miraheze.org - 13https://github.com/miraheze/mw-config/pull/5232 [02:07:52] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.76, 11.58, 11.83 [02:07:55] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 1.80, 4.86, 4.20 [02:08:25] miraheze/mw-config - AgentIsai the build passed. [02:09:52] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 17.31, 13.37, 12.43 [02:11:34] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.28, 2.35, 3.21 [02:21:51] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.77, 10.70, 11.70 [02:22:23] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.71, 3.24, 3.05 [02:24:22] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.97, 2.81, 2.91 [02:28:47] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.08157649636 secs [02:35:36] [02mw-config] 07AgentIsai closed pull request 03#5232: Set WebAuthn configuration to allow security key login on all *.miraheze.org - 13https://github.com/miraheze/mw-config/pull/5232 [02:35:39] [02miraheze/mw-config] 07AgentIsai pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/a1910c61fa0e...82a21742af18 [02:35:41] [02miraheze/mw-config] 07AgentIsai 0382a2174 - Set WebAuthn configuration to allow security key login on all *.miraheze.org (#5232) [02:35:43] [02miraheze/mw-config] 07AgentIsai deleted branch 03AgentIsai-patch-1 [02:35:44] [02mw-config] 07AgentIsai deleted branch 03AgentIsai-patch-1 - 13https://github.com/miraheze/mw-config [02:36:44] miraheze/mw-config - AgentIsai the build passed. [02:39:13] !log [agent@mwtask141] starting deploy of {'pull': 'config', 'config': True} to all [02:39:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:39:26] !log [agent@mwtask141] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 13s [02:39:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:39:56] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.93, 10.76, 11.95 [02:41:51] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.72, 10.92, 10.86 [02:43:52] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.39, 9.74, 10.46 [02:51:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.75, 6.49, 5.61 [02:53:05] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.05, 5.81, 5.46 [02:57:12] !log [@test131] starting deploy of {'config': True} to all [02:57:13] !log [@test131] finished deploy of {'config': True} to all - SUCCESS in 0s [02:57:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:57:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:57:52] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.61, 9.81, 10.14 [02:59:56] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.18, 8.67, 10.12 [03:05:56] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.20, 11.63, 10.89 [03:07:47] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.74, 4.42, 3.48 [03:07:56] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.66, 11.20, 10.80 [03:09:45] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.91, 3.60, 3.30 [03:11:43] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.24, 2.75, 3.02 [03:12:44] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.14, 11.85, 10.68 [03:14:41] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.22, 10.27, 10.25 [03:15:56] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 5.80, 8.33, 9.72 [03:16:38] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.78, 9.62, 10.02 [03:18:47] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.140298903 secs [03:30:18] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.32, 10.43, 9.98 [03:30:23] [02mw-config] 07MacFan4000 commented on pull request 03#5232: Set WebAuthn configuration to allow security key login on all *.miraheze.org - 13https://github.com/miraheze/mw-config/pull/5232#issuecomment-1560409633 [03:30:39] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.10, 10.31, 9.89 [03:32:01] [02mw-config] 07MacFan4000 edited a comment on pull request 03#5232: Set WebAuthn configuration to allow security key login on all *.miraheze.org - 13https://github.com/miraheze/mw-config/pull/5232#issuecomment-1560409633 [03:32:15] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.56, 10.75, 10.12 [03:32:18] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.87, 3.14, 2.75 [03:32:35] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.31, 9.84, 9.77 [03:34:13] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.89, 10.89, 10.24 [03:34:16] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 7.99, 4.19, 3.14 [03:36:29] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.09, 10.48, 10.10 [03:36:46] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query uk.religiononfire.mar.in.ua. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [03:38:07] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.99, 9.96, 10.02 [03:38:47] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.08565050364 secs [03:40:10] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.86, 3.34, 3.15 [03:40:21] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.47, 9.64, 9.85 [03:42:00] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.45, 10.26, 10.11 [03:43:57] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.15, 9.62, 9.90 [04:01:11] PROBLEM - scum-wiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Cannot make SSL connection. [04:01:51] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1173188686 secs [04:04:23] [02mw-config] 07AgentIsai commented on pull request 03#5232: Set WebAuthn configuration to allow security key login on all *.miraheze.org - 13https://github.com/miraheze/mw-config/pull/5232#issuecomment-1560428745 [04:05:31] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [04:05:58] [02miraheze/mw-config] 07AgentIsai pushed 031 commit to 03revert-5232-AgentIsai-patch-1 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/e83d253ebe09 [04:06:01] [02miraheze/mw-config] 07AgentIsai 03e83d253 - Revert "Set WebAuthn configuration to allow security key login on all *.miraheze.org (#5232)" [04:06:03] [02mw-config] 07AgentIsai created branch 03revert-5232-AgentIsai-patch-1 - 13https://github.com/miraheze/mw-config [04:06:26] [02mw-config] 07AgentIsai opened pull request 03#5233: Revert "Set WebAuthn configuration to allow security key login on all *.miraheze.org" - 13https://github.com/miraheze/mw-config/pull/5233 [04:06:32] [02mw-config] 07AgentIsai closed pull request 03#5233: Revert "Set WebAuthn configuration to allow security key login on all *.miraheze.org" - 13https://github.com/miraheze/mw-config/pull/5233 [04:06:35] [02miraheze/mw-config] 07AgentIsai deleted branch 03revert-5232-AgentIsai-patch-1 [04:06:38] [02mw-config] 07AgentIsai deleted branch 03revert-5232-AgentIsai-patch-1 - 13https://github.com/miraheze/mw-config [04:06:40] [02miraheze/mw-config] 07AgentIsai pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/82a21742af18...64381439a7de [04:06:41] [02miraheze/mw-config] 07AgentIsai 036438143 - Revert "Set WebAuthn configuration to allow security key login on all *.miraheze.org" (#5233) [04:07:32] miraheze/mw-config - AgentIsai the build passed. [04:07:37] miraheze/mw-config - AgentIsai the build passed. [04:11:01] !log [@mwtask141] starting deploy of {'config': True} to all [04:11:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:11:08] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 7s [04:11:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:26:36] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.22, 3.47, 2.86 [04:27:12] !log [@test131] starting deploy of {'config': True} to all [04:27:13] !log [@test131] finished deploy of {'config': True} to all - SUCCESS in 0s [04:27:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:27:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:28:35] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.24, 2.92, 2.72 [04:31:51] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.09428989887 secs [04:32:34] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.16, 3.91, 3.16 [04:34:22] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.37, 3.73, 2.95 [04:34:35] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.82, 3.05, 2.93 [04:35:19] PROBLEM - scum-wiki.com - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - scum-wiki.com reverse DNS resolves to any-in-2001-4860-4802-38--15.1e100.net [04:36:20] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 2.72, 4.20, 3.29 [04:38:18] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.68, 3.37, 3.09 [05:00:21] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 17.92, 8.69, 4.19 [05:04:08] PROBLEM - matomo121 HTTPS on matomo121 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 358 bytes in 0.012 second response time [05:06:20] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.07, 3.21, 3.12 [05:12:38] PROBLEM - db112 Disk Space on db112 is CRITICAL: DISK CRITICAL - free space: / 7873 MB (5% inode=99%); [05:15:09] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.86, 6.50, 5.85 [05:17:06] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.47, 6.24, 5.84 [05:21:34] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.01, 3.41, 2.60 [05:23:34] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.90, 2.81, 2.47 [05:30:20] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.69, 3.74, 2.55 [05:32:20] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.31, 2.78, 2.34 [05:35:32] PROBLEM - mail121 webmail.miraheze.org HTTPS on mail121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:37:42] [02miraheze/mw-config] 07AgentIsai pushed 031 commit to 03AgentIsai-patch-1 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/97539b4017cd [05:37:45] [02miraheze/mw-config] 07AgentIsai 0397539b4 - Update GlobalSettings.php [05:37:46] [02mw-config] 07AgentIsai created branch 03AgentIsai-patch-1 - 13https://github.com/miraheze/mw-config [05:37:54] [02mw-config] 07AgentIsai opened pull request 03#5234: srewiki configs - 13https://github.com/miraheze/mw-config/pull/5234 [05:38:07] [02mw-config] 07AgentIsai closed pull request 03#5234: srewiki configs - 13https://github.com/miraheze/mw-config/pull/5234 [05:38:10] [02miraheze/mw-config] 07AgentIsai pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/64381439a7de...11f7a36bbd3a [05:38:11] [02miraheze/mw-config] 07AgentIsai 0311f7a36 - srewiki configs (#5234) [05:38:12] [02miraheze/mw-config] 07AgentIsai deleted branch 03AgentIsai-patch-1 [05:38:15] [02mw-config] 07AgentIsai deleted branch 03AgentIsai-patch-1 - 13https://github.com/miraheze/mw-config [05:38:41] !log [agent@mwtask141] starting deploy of {'pull': 'config', 'config': True} to all [05:38:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:38:53] miraheze/mw-config - AgentIsai the build passed. [05:38:56] !log [agent@mwtask141] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 15s [05:39:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:39:10] miraheze/mw-config - AgentIsai the build passed. [05:41:56] [02miraheze/mw-config] 07AgentIsai pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/11f7a36bbd3a...871b8a563e2e [05:41:59] [02miraheze/mw-config] 07AgentIsai 03871b8a5 - Use LDAP on srewiki [05:42:00] !log [agent@mwtask141] starting deploy of {'pull': 'config', 'config': True} to all [05:42:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:42:07] !log [agent@mwtask141] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 7s [05:42:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:43:05] miraheze/mw-config - AgentIsai the build passed. [05:48:07] [02mw-config] 07AgentIsai created branch 03AgentIsai-patch-1 - 13https://github.com/miraheze/mw-config [05:48:08] [02miraheze/mw-config] 07AgentIsai pushed 031 commit to 03AgentIsai-patch-1 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/08c9ecacd36a [05:48:11] [02miraheze/mw-config] 07AgentIsai 0308c9eca - srewiki configs [05:48:14] [02mw-config] 07AgentIsai opened pull request 03#5235: srewiki configs - 13https://github.com/miraheze/mw-config/pull/5235 [05:48:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.04, 6.76, 6.32 [05:48:51] [02mw-config] 07AgentIsai closed pull request 03#5235: srewiki configs - 13https://github.com/miraheze/mw-config/pull/5235 [05:48:53] [02miraheze/mw-config] 07AgentIsai pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/871b8a563e2e...23b89cf34435 [05:48:53] !log [agent@mwtask141] starting deploy of {'pull': 'config', 'config': True} to all [05:48:55] [02miraheze/mw-config] 07AgentIsai 0323b89cf - srewiki configs (#5235) [05:48:57] [02miraheze/mw-config] 07AgentIsai deleted branch 03AgentIsai-patch-1 [05:49:00] [02mw-config] 07AgentIsai deleted branch 03AgentIsai-patch-1 - 13https://github.com/miraheze/mw-config [05:49:01] !log [agent@mwtask141] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 7s [05:49:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:49:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:49:12] miraheze/mw-config - AgentIsai the build passed. [05:49:56] miraheze/mw-config - AgentIsai the build passed. [05:50:18] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 10.21, 7.50, 6.61 [05:52:16] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.12, 7.21, 6.61 [05:54:14] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.41, 6.66, 6.48 [05:55:55] [02miraheze/mw-config] 07AgentIsai pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/23b89cf34435...bbf3a364c2e1 [05:55:56] [02miraheze/mw-config] 07AgentIsai 03bbf3a36 - Set wgMWOAuthCentralWiki to false for LDAP wikis [05:56:03] !log [agent@mwtask141] starting deploy of {'pull': 'config', 'config': True} to all [05:56:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:56:09] !log [agent@mwtask141] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 6s [05:56:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:56:53] miraheze/mw-config - AgentIsai the build passed. [05:57:07] !log [@test131] starting deploy of {'config': True} to all [05:57:08] !log [@test131] finished deploy of {'config': True} to all - SUCCESS in 0s [05:57:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:57:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:19:34] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.86, 6.74, 6.45 [06:21:32] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.78, 6.56, 6.43 [06:26:17] RECOVERY - matomo121 HTTPS on matomo121 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 3.937 second response time [06:26:20] !log rm -rf /srv/backups/db on db112 (out of disk space) [06:26:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:28:02] RECOVERY - mail121 webmail.miraheze.org HTTPS on mail121 is OK: HTTP OK: HTTP/1.1 200 OK - 6281 bytes in 0.233 second response time [06:38:47] [02miraheze/mw-config] 07AgentIsai pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/bbf3a364c2e1...80f178fcd2b8 [06:38:50] [02miraheze/mw-config] 07AgentIsai 0380f178f - Make srewiki share users with ldapwikiwiki [06:39:31] !log [agent@mwtask141] starting deploy of {'pull': 'config', 'config': True} to all [06:39:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:39:40] !log [agent@mwtask141] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 9s [06:39:42] miraheze/mw-config - AgentIsai the build passed. [06:39:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:42:09] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.54, 3.36, 2.94 [06:44:05] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.99, 3.23, 2.95 [06:56:48] !log [@test131] starting deploy of {'config': True} to all [06:56:49] !log [@test131] finished deploy of {'config': True} to all - SUCCESS in 1s [06:56:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:57:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:00:20] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.75, 3.32, 2.13 [07:02:20] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.97, 2.47, 1.97 [07:23:55] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 9.10, 6.28, 3.62 [07:25:55] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 1.77, 4.51, 3.29 [08:56:20] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.86, 2.46, 1.59 [08:58:20] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.46, 2.09, 1.56 [09:07:55] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 7.24, 4.97, 2.70 [09:09:55] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 2.15, 4.09, 2.67 [09:22:21] [02ManageWiki] 07amire80 opened pull request 03#405: Restore "are" in managewiki-header-extensions - 13https://github.com/miraheze/ManageWiki/pull/405 [09:26:05] miraheze/ManageWiki - amire80 the build passed. [09:35:56] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.31, 9.57, 8.26 [09:36:46] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query mar.in.ua. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [09:37:56] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.88, 8.86, 8.15 [09:49:23] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.29, 7.19, 6.48 [09:51:21] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.89, 6.54, 6.32 [10:05:31] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK [10:42:10] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.82, 7.33, 6.65 [10:48:04] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.69, 6.80, 6.60 [10:49:51] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1436245143 secs [11:16:23] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.05, 6.81, 6.57 [11:18:21] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.70, 6.51, 6.47 [11:22:13] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.71, 7.04, 6.73 [11:23:51] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.09083643556 secs [11:24:11] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.80, 6.34, 6.52 [11:27:51] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.2148298323 secs [11:28:04] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.31, 7.08, 6.82 [11:30:04] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.60, 6.41, 6.60 [11:48:56] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.42, 9.00, 7.53 [11:56:46] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.84, 7.32, 7.34 [12:00:58] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 7.78, 4.31, 2.52 [12:02:54] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.84, 3.92, 2.60 [12:04:16] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 15.59, 11.98, 9.81 [12:04:50] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.79, 3.06, 2.43 [12:08:32] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.00, 7.25, 7.17 [12:10:29] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.51, 6.82, 7.02 [12:10:41] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.80, 11.99, 9.93 [12:12:00] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.34, 11.89, 10.74 [12:12:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.77, 7.61, 7.26 [12:13:51] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.09650278091 secs [12:13:56] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.14, 12.87, 11.25 [12:14:24] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.95, 7.78, 7.37 [12:25:56] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.05, 11.33, 11.71 [12:31:56] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.77, 11.57, 11.63 [12:32:04] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.10, 7.13, 7.04 [12:34:04] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.29, 7.13, 7.04 [12:36:04] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.45, 7.69, 7.26 [12:38:04] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.18, 7.14, 7.11 [12:39:55] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 10.00, 6.69, 3.49 [12:39:56] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.43, 10.82, 11.61 [12:43:55] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 6.90, 7.69, 4.67 [12:45:55] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 1.48, 5.39, 4.20 [12:45:56] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.75, 10.95, 11.35 [12:47:56] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.49, 10.72, 11.23 [12:48:04] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.56, 6.33, 6.79 [12:49:56] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.03, 12.40, 11.80 [12:52:04] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.73, 8.04, 7.40 [12:53:51] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset -0.109968096 secs [12:54:04] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.38, 7.74, 7.39 [12:56:04] PROBLEM - wiki.joust.ro - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.joust.ro All nameservers failed to answer the query. [12:58:04] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.95, 7.68, 7.40 [13:02:04] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.16, 7.16, 7.27 [13:04:04] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.53, 7.39, 7.32 [13:05:51] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset -0.07337221503 secs [13:08:04] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.13, 7.55, 7.40 [13:20:04] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.08, 7.88, 7.48 [13:21:02] [02miraheze/dns] 07Reception123 pushed 031 commit to 03master [+1/-0/±0] 13https://github.com/miraheze/dns/compare/d6d91359425b...71334eeb4c8b [13:21:03] [02miraheze/dns] 07Reception123 0371334ee - Add DNS zone for theenglishlakes.uk [13:23:04] [02miraheze/dns] 07Reception123 pushed 032 commits to 03master [+1/-1/±0] 13https://github.com/miraheze/dns/compare/71334eeb4c8b...96b2c106b2b8 [13:23:05] [02miraheze/dns] 07Reception123 03ec960bc - Revert "Add DNS zone for theenglishlakes.uk" [13:23:06] [02miraheze/dns] 07Reception123 0396b2c10 - Add DNS zone for theenglishlakes.uk [13:24:11] [02miraheze/dns] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/dns/compare/96b2c106b2b8...6b48a9bd4fc6 [13:24:14] [02miraheze/dns] 07Reception123 036b48a9b - Revert "Revert "Add DNS zone for theenglishlakes.uk"" [13:24:54] [02miraheze/dns] 07Reception123 pushed 031 commit to 03master [+1/-1/±0] 13https://github.com/miraheze/dns/compare/6b48a9bd4fc6...000ac64edd02 [13:24:57] [02miraheze/dns] 07Reception123 03000ac64 - Rename TESTtheenglishlakes.uk to theenglishlakes.uk [13:28:56] PROBLEM - ns1 Puppet on ns1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[gdnsd-syntax] [13:31:24] [02miraheze/mw-config] 07AgentIsai pushed 031 commit to 03revert-5233-revert-5232-AgentIsai-patch-1 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/45cfca5da304 [13:31:27] [02miraheze/mw-config] 07AgentIsai 0345cfca5 - Revert "Revert "Set WebAuthn configuration to allow security key login on all *.miraheze.org" (#5233)" [13:31:30] [02mw-config] 07AgentIsai created branch 03revert-5233-revert-5232-AgentIsai-patch-1 - 13https://github.com/miraheze/mw-config [13:31:46] [02mw-config] 07AgentIsai opened pull request 03#5236: Set WebAuthn configuration to allow security key login on all *.betaheze.org - 13https://github.com/miraheze/mw-config/pull/5236 [13:32:04] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.70, 7.55, 7.75 [13:32:40] [02mw-config] 07AgentIsai synchronize pull request 03#5236: Set WebAuthn configuration to allow security key login on all *.betaheze.org - 13https://github.com/miraheze/mw-config/pull/5236 [13:32:41] [02miraheze/mw-config] 07AgentIsai pushed 031 commit to 03revert-5233-revert-5232-AgentIsai-patch-1 [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/45cfca5da304...3a518c08dc92 [13:32:43] [02miraheze/mw-config] 07AgentIsai 033a518c0 - Set only on Betaheze [13:32:44] miraheze/mw-config - AgentIsai the build passed. [13:32:51] [02mw-config] 07AgentIsai closed pull request 03#5236: Set WebAuthn configuration to allow security key login on all *.betaheze.org - 13https://github.com/miraheze/mw-config/pull/5236 [13:32:52] [02miraheze/mw-config] 07AgentIsai deleted branch 03revert-5233-revert-5232-AgentIsai-patch-1 [13:32:53]