[00:01:53] [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-4 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/1c54ec71141a [00:01:53] [02miraheze/mw-config] 07paladox 031c54ec7 - Use new nutcracker config [00:01:56] [02mw-config] 07paladox created branch 03paladox-patch-4 - 13https://github.com/miraheze/mw-config [00:01:59] [02mw-config] 07paladox opened pull request 03#5384: Use new nutcracker config - 13https://github.com/miraheze/mw-config/pull/5384 [00:02:27] [02puppet] 07paladox closed pull request 03#3523: nutcracker: create one pool for memcache servers - 13https://github.com/miraheze/puppet/pull/3523 [00:02:29] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-13 [00:02:32] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/puppet/compare/4ce221e7513c...27b58370225a [00:02:33] [02miraheze/puppet] 07paladox 0327b5837 - nutcracker: create one pool for memcache servers (#3523) [00:02:34] [02puppet] 07paladox deleted branch 03paladox-patch-13 - 13https://github.com/miraheze/puppet [00:02:54] miraheze/mw-config - paladox the build passed. [00:04:07] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 18.52, 9.41, 4.20 [00:05:34] PROBLEM - swiftac111 Current Load on swiftac111 is WARNING: WARNING - load average: 7.82, 6.99, 6.58 [00:07:27] PROBLEM - mw132 Current Load on mw132 is CRITICAL: CRITICAL - load average: 17.38, 10.71, 7.11 [00:07:34] PROBLEM - os131 PowerDNS Recursor on os131 is CRITICAL: CRITICAL - Plugin timed out while executing system call [00:07:34] PROBLEM - swiftac111 Current Load on swiftac111 is CRITICAL: CRITICAL - load average: 8.09, 7.49, 6.83 [00:07:37] PROBLEM - cp35 Varnish Backends on cp35 is CRITICAL: 8 backends are down. mw131 mw132 mw141 mw142 mw133 mw134 mw143 mediawiki [00:07:41] PROBLEM - os131 Current Load on os131 is CRITICAL: LOAD CRITICAL - total load average: 6.30, 3.56, 1.84 [00:08:08] PROBLEM - mw131 Current Load on mw131 is CRITICAL: CRITICAL - load average: 19.72, 12.59, 8.24 [00:08:09] PROBLEM - graylog131 Current Load on graylog131 is CRITICAL: LOAD CRITICAL - total load average: 15.22, 8.47, 4.47 [00:08:11] [02mw-config] 07paladox closed pull request 03#5384: Use new nutcracker config - 13https://github.com/miraheze/mw-config/pull/5384 [00:08:14] [02miraheze/mw-config] 07paladox deleted branch 03paladox-patch-4 [00:08:15] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/c3c401695549...dc557c52c400 [00:08:18] [02miraheze/mw-config] 07paladox 03dc557c5 - Use new nutcracker config (#5384) [00:08:19] [02mw-config] 07paladox deleted branch 03paladox-patch-4 - 13https://github.com/miraheze/mw-config [00:08:24] !log [paladox@mwtask141] starting deploy of {'pull': 'config', 'config': True} to all [00:08:28] PROBLEM - mw141 Current Load on mw141 is CRITICAL: CRITICAL - load average: 13.90, 9.73, 6.73 [00:08:36] PROBLEM - graylog131 PowerDNS Recursor on graylog131 is CRITICAL: CRITICAL - Plugin timed out while executing system call [00:08:39] PROBLEM - mw133 Current Load on mw133 is CRITICAL: CRITICAL - load average: 20.80, 12.81, 7.65 [00:08:53] PROBLEM - mw134 MediaWiki Rendering on mw134 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:08:55] PROBLEM - mw142 Current Load on mw142 is WARNING: WARNING - load average: 11.72, 10.56, 6.95 [00:08:56] PROBLEM - mw134 Current Load on mw134 is CRITICAL: CRITICAL - load average: 13.94, 11.45, 7.61 [00:08:58] PROBLEM - os141 Current Load on os141 is CRITICAL: LOAD CRITICAL - total load average: 4.70, 3.78, 2.09 [00:09:07] miraheze/mw-config - paladox the build passed. [00:09:31] PROBLEM - cp25 Varnish Backends on cp25 is CRITICAL: 5 backends are down. mw132 mw141 mw142 mw134 mw143 [00:09:34] PROBLEM - swiftac111 Current Load on swiftac111 is WARNING: WARNING - load average: 7.54, 7.45, 6.89 [00:09:41] !log [paladox@mwtask141] DEPLOY ABORTED: Canary check failed for publictestwiki.com@localhost [00:09:44] !log [paladox@mwtask141] starting deploy of {'pull': 'config', 'config': True} to all [00:09:57] !log [paladox@mwtask141] starting deploy of {'pull': 'config', 'config': True, 'force': True} to all [00:10:01] PROBLEM - cp34 Varnish Backends on cp34 is CRITICAL: 4 backends are down. mw141 mw142 mw134 mw143 [00:10:03] PROBLEM - mw143 Current Load on mw143 is CRITICAL: CRITICAL - load average: 20.23, 11.80, 7.05 [00:10:11] PROBLEM - mw141 MediaWiki Rendering on mw141 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:10:38] PROBLEM - cp24 Varnish Backends on cp24 is CRITICAL: 8 backends are down. mw131 mw132 mw141 mw142 mw133 mw134 mw143 mediawiki [00:10:50] PROBLEM - mw133 MediaWiki Rendering on mw133 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:10:53] PROBLEM - mw142 Current Load on mw142 is CRITICAL: CRITICAL - load average: 19.22, 14.46, 8.86 [00:11:10] PROBLEM - mwtask141 MediaWiki Rendering on mwtask141 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:11:34] PROBLEM - swiftac111 Current Load on swiftac111 is CRITICAL: CRITICAL - load average: 8.11, 7.73, 7.07 [00:12:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:12:39] !log [paladox@mwtask141] finished deploy of {'pull': 'config', 'config': True, 'force': True} to all - SUCCESS in 162s [00:12:47] RECOVERY - mw133 MediaWiki Rendering on mw133 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.417 second response time [00:12:50] RECOVERY - graylog131 PowerDNS Recursor on graylog131 is OK: DNS OK: 0.497 seconds response time. miraheze.org returns 2001:41d0:801:2000::3a18,2001:41d0:801:2000::5d68,51.195.201.140,51.89.139.24 [00:12:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:12:59] RECOVERY - mw134 MediaWiki Rendering on mw134 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.388 second response time [00:13:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:13:09] RECOVERY - mwtask141 MediaWiki Rendering on mwtask141 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.408 second response time [00:13:31] RECOVERY - cp25 Varnish Backends on cp25 is OK: All 15 backends are healthy [00:13:34] PROBLEM - swiftac111 Current Load on swiftac111 is WARNING: WARNING - load average: 7.04, 7.53, 7.08 [00:13:37] RECOVERY - cp35 Varnish Backends on cp35 is OK: All 15 backends are healthy [00:14:01] RECOVERY - cp34 Varnish Backends on cp34 is OK: All 15 backends are healthy [00:14:18] RECOVERY - mw141 MediaWiki Rendering on mw141 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.891 second response time [00:14:28] PROBLEM - mw141 Current Load on mw141 is WARNING: WARNING - load average: 7.90, 11.82, 9.06 [00:14:38] RECOVERY - cp24 Varnish Backends on cp24 is OK: All 15 backends are healthy [00:14:39] PROBLEM - mw133 Current Load on mw133 is WARNING: WARNING - load average: 5.92, 10.95, 8.71 [00:14:49] PROBLEM - mw142 Current Load on mw142 is WARNING: WARNING - load average: 7.90, 11.85, 9.15 [00:14:56] PROBLEM - mw134 Current Load on mw134 is WARNING: WARNING - load average: 9.62, 11.82, 9.20 [00:15:03] PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 3.74, 3.19, 2.55 [00:15:27] PROBLEM - mw132 Current Load on mw132 is WARNING: WARNING - load average: 5.67, 11.18, 9.55 [00:16:02] RECOVERY - mw143 Current Load on mw143 is OK: OK - load average: 5.26, 9.42, 7.69 [00:16:07] PROBLEM - mw131 Current Load on mw131 is WARNING: WARNING - load average: 5.16, 10.81, 9.74 [00:16:09] RECOVERY - os131 PowerDNS Recursor on os131 is OK: DNS OK: 0.536 seconds response time. miraheze.org returns 2001:41d0:801:2000::3a18,2001:41d0:801:2000::5d68,51.195.201.140,51.89.139.24 [00:16:28] RECOVERY - mw141 Current Load on mw141 is OK: OK - load average: 4.74, 9.37, 8.50 [00:16:39] RECOVERY - mw133 Current Load on mw133 is OK: OK - load average: 3.47, 8.41, 8.05 [00:16:47] RECOVERY - mw142 Current Load on mw142 is OK: OK - load average: 5.26, 9.53, 8.63 [00:16:56] RECOVERY - mw134 Current Load on mw134 is OK: OK - load average: 6.40, 9.68, 8.72 [00:16:56] PROBLEM - os141 Current Load on os141 is WARNING: LOAD WARNING - total load average: 3.79, 3.95, 2.92 [00:17:27] RECOVERY - mw132 Current Load on mw132 is OK: OK - load average: 5.16, 9.13, 8.99 [00:18:07] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 3.27, 6.68, 6.94 [00:18:07] RECOVERY - mw131 Current Load on mw131 is OK: OK - load average: 6.01, 9.35, 9.33 [00:19:03] PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: LOAD CRITICAL - total load average: 4.96, 3.91, 2.98 [00:19:34] RECOVERY - swiftac111 Current Load on swiftac111 is OK: OK - load average: 6.62, 6.64, 6.80 [00:19:50] PROBLEM - os131 Current Load on os131 is WARNING: LOAD WARNING - total load average: 2.96, 3.71, 3.11 [00:20:07] RECOVERY - db112 Current Load on db112 is OK: OK - load average: 3.15, 5.46, 6.45 [00:20:57] PROBLEM - os141 Current Load on os141 is CRITICAL: LOAD CRITICAL - total load average: 4.23, 4.05, 3.19 [00:21:03] PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 3.11, 3.61, 2.98 [00:23:06] RECOVERY - matomo121 Current Load on matomo121 is OK: LOAD OK - total load average: 2.54, 3.37, 2.97 [00:24:56] PROBLEM - os141 Current Load on os141 is WARNING: LOAD WARNING - total load average: 3.09, 3.92, 3.36 [00:25:55] PROBLEM - os131 Current Load on os131 is CRITICAL: LOAD CRITICAL - total load average: 4.50, 4.05, 3.44 [00:27:10] !log [@test131] starting deploy of {'config': True} to all [00:27:12] !log [@test131] finished deploy of {'config': True} to all - SUCCESS in 1s [00:27:15] RECOVERY - www.twistwoodtaleswiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'www.twistwoodtaleswiki.com' will expire on Wed 20 Dec 2023 22:08:34 GMT +0000. [00:27:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:27:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:28:57] RECOVERY - os141 Current Load on os141 is OK: LOAD OK - total load average: 2.85, 3.30, 3.24 [00:29:03] PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 3.74, 3.51, 3.16 [00:31:03] RECOVERY - matomo121 Current Load on matomo121 is OK: LOAD OK - total load average: 2.78, 3.32, 3.14 [00:35:34] PROBLEM - swiftac111 Current Load on swiftac111 is WARNING: WARNING - load average: 7.27, 6.66, 6.51 [00:37:03] PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 3.30, 3.66, 3.33 [00:39:04] PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: LOAD CRITICAL - total load average: 4.19, 3.88, 3.45 [00:39:34] RECOVERY - swiftac111 Current Load on swiftac111 is OK: OK - load average: 6.79, 6.74, 6.58 [00:40:03] PROBLEM - os131 Current Load on os131 is WARNING: LOAD WARNING - total load average: 3.01, 3.75, 3.97 [00:43:03] PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 3.04, 3.71, 3.49 [00:45:03] RECOVERY - matomo121 Current Load on matomo121 is OK: LOAD OK - total load average: 2.47, 3.30, 3.37 [00:46:03] RECOVERY - os131 Current Load on os131 is OK: LOAD OK - total load average: 1.87, 2.61, 3.39 [00:47:57] PROBLEM - graylog131 Current Load on graylog131 is WARNING: LOAD WARNING - total load average: 1.83, 2.24, 3.88 [00:53:57] RECOVERY - graylog131 Current Load on graylog131 is OK: LOAD OK - total load average: 1.02, 1.78, 3.18 [00:55:03] PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 3.49, 3.41, 3.34 [00:57:03] RECOVERY - matomo121 Current Load on matomo121 is OK: LOAD OK - total load average: 2.47, 3.26, 3.31 [00:58:52] PROBLEM - www.twistwoodtaleswiki.com - LetsEncrypt on sslhost is CRITICAL: connect to address www.twistwoodtaleswiki.com and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [01:05:34] PROBLEM - swiftac111 Current Load on swiftac111 is WARNING: WARNING - load average: 7.55, 6.93, 6.56 [01:15:34] RECOVERY - swiftac111 Current Load on swiftac111 is OK: OK - load average: 6.09, 6.65, 6.70 [01:35:34] PROBLEM - swiftac111 Current Load on swiftac111 is WARNING: WARNING - load average: 7.60, 6.79, 6.44 [01:43:34] RECOVERY - swiftac111 Current Load on swiftac111 is OK: OK - load average: 6.22, 6.66, 6.60 [01:51:30] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 11.70, 9.23, 8.60 [01:57:20] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 8.90, 9.52, 8.98 [01:58:17] RECOVERY - www.twistwoodtaleswiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'www.twistwoodtaleswiki.com' will expire on Wed 20 Dec 2023 22:08:34 GMT +0000. [02:07:34] PROBLEM - swiftac111 Current Load on swiftac111 is WARNING: WARNING - load average: 7.67, 7.04, 6.58 [02:13:34] RECOVERY - swiftac111 Current Load on swiftac111 is OK: OK - load average: 5.55, 6.61, 6.59 [02:29:54] PROBLEM - www.twistwoodtaleswiki.com - LetsEncrypt on sslhost is CRITICAL: connect to address www.twistwoodtaleswiki.com and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [02:33:34] PROBLEM - swiftac111 Current Load on swiftac111 is WARNING: WARNING - load average: 7.01, 6.52, 6.34 [02:40:21] PROBLEM - db121 Current Load on db121 is WARNING: WARNING - load average: 7.21, 5.02, 3.01 [02:43:34] RECOVERY - swiftac111 Current Load on swiftac111 is OK: OK - load average: 6.05, 6.69, 6.61 [02:44:21] RECOVERY - db121 Current Load on db121 is OK: OK - load average: 1.97, 4.37, 3.31 [02:50:25] PROBLEM - wiki.andreijiroh.uk.eu.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.andreijiroh.uk.eu.org' expires in 15 day(s) (Wed 13 Dec 2023 02:41:49 GMT +0000). [02:50:44] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/3ddaf1aa45f0...b5174447620b [02:50:45] [02miraheze/ssl] 07MirahezeSSLBot 03b517444 - Bot: Update SSL cert for wiki.andreijiroh.uk.eu.org [02:53:10] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 10.22, 9.64, 8.82 [02:55:07] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 8.27, 9.18, 8.75 [03:03:52] PROBLEM - mw142 Current Load on mw142 is WARNING: WARNING - load average: 10.27, 8.45, 5.34 [03:04:57] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 11.21, 9.98, 9.23 [03:05:03] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query. [03:05:34] PROBLEM - swiftac111 Current Load on swiftac111 is WARNING: WARNING - load average: 6.85, 6.54, 6.32 [03:05:52] RECOVERY - mw142 Current Load on mw142 is OK: OK - load average: 4.95, 7.00, 5.18 [03:06:57] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 7.61, 9.37, 9.12 [03:08:55] PROBLEM - mw141 Current Load on mw141 is WARNING: WARNING - load average: 10.72, 10.46, 6.67 [03:10:53] RECOVERY - mw141 Current Load on mw141 is OK: OK - load average: 6.06, 8.73, 6.49 [03:13:34] RECOVERY - swiftac111 Current Load on swiftac111 is OK: OK - load average: 6.04, 6.64, 6.54 [03:33:35] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 11.23, 10.26, 9.67 [03:34:52] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is WARNING: SSL WARNING - rDNS OK but records conflict. {'NS': ['NS.ANKH.FR.eu.org.', 'NS1.eu.org.', 'NS1.ERIOMEM.NET.'], 'CNAME': 'bouncingwiki.miraheze.org.'} [03:35:30] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 6.20, 8.97, 9.29 [03:39:34] PROBLEM - swiftac111 Current Load on swiftac111 is WARNING: WARNING - load average: 7.44, 7.00, 6.59 [03:43:34] RECOVERY - swiftac111 Current Load on swiftac111 is OK: OK - load average: 5.95, 6.63, 6.56 [03:48:29] RECOVERY - wiki.andreijiroh.uk.eu.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.andreijiroh.uk.eu.org' will expire on Sun 25 Feb 2024 01:50:36 GMT +0000. [04:03:40] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 10.85, 10.28, 9.47 [04:04:40] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query. [04:05:34] PROBLEM - swiftac111 Current Load on swiftac111 is WARNING: WARNING - load average: 7.68, 6.81, 6.42 [04:05:37] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 6.78, 9.23, 9.19 [04:11:06] PROBLEM - mw141 Current Load on mw141 is WARNING: WARNING - load average: 9.10, 11.93, 8.45 [04:13:03] RECOVERY - mw141 Current Load on mw141 is OK: OK - load average: 3.82, 9.14, 7.84 [04:13:34] RECOVERY - swiftac111 Current Load on swiftac111 is OK: OK - load average: 6.11, 6.64, 6.58 [04:18:10] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 10.77, 9.92, 9.17 [04:20:07] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 9.81, 9.90, 9.26 [04:34:29] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is WARNING: SSL WARNING - rDNS OK but records conflict. {'NS': ['ns.ankh.fr.eu.org.', 'ns1.eu.org.', 'ns1.eriomem.net.'], 'CNAME': 'bouncingwiki.miraheze.org.'} [04:35:34] PROBLEM - swiftac111 Current Load on swiftac111 is WARNING: WARNING - load average: 7.80, 6.62, 6.29 [04:42:23] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 10.69, 10.37, 9.85 [04:44:43] PROBLEM - swiftproxy111 APT on swiftproxy111 is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [04:46:17] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 9.48, 9.95, 9.80 [04:47:34] RECOVERY - swiftac111 Current Load on swiftac111 is OK: OK - load average: 6.11, 6.63, 6.61 [04:48:23] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/27b58370225a...ddeaf72a7c48 [04:48:24] [02miraheze/puppet] 07paladox 03ddeaf72 - Fix [04:52:59] PROBLEM - cloud11 APT on cloud11 is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [04:55:15] PROBLEM - swiftac111 APT on swiftac111 is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [04:55:57] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 10.85, 10.52, 10.08 [05:05:40] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 4.80, 8.47, 9.53 [05:06:18] PROBLEM - swiftac111 Current Load on swiftac111 is CRITICAL: CRITICAL - load average: 8.05, 6.95, 6.57 [05:08:16] PROBLEM - swiftac111 Current Load on swiftac111 is WARNING: WARNING - load average: 7.13, 7.02, 6.65 [05:08:21] PROBLEM - db121 Current Load on db121 is CRITICAL: CRITICAL - load average: 9.65, 5.52, 2.97 [05:10:21] RECOVERY - db121 Current Load on db121 is OK: OK - load average: 3.91, 4.99, 3.11 [05:14:11] RECOVERY - swiftac111 Current Load on swiftac111 is OK: OK - load average: 5.65, 6.53, 6.60 [05:35:50] PROBLEM - swiftac111 Current Load on swiftac111 is WARNING: WARNING - load average: 7.68, 6.70, 6.40 [05:43:43] RECOVERY - swiftac111 Current Load on swiftac111 is OK: OK - load average: 6.03, 6.54, 6.50 [06:06:24] PROBLEM - swiftac111 Current Load on swiftac111 is WARNING: WARNING - load average: 7.66, 6.99, 6.49 [06:08:22] PROBLEM - swiftac111 Current Load on swiftac111 is CRITICAL: CRITICAL - load average: 8.09, 7.34, 6.68 [06:10:20] PROBLEM - swiftac111 Current Load on swiftac111 is WARNING: WARNING - load average: 6.95, 7.27, 6.74 [06:14:16] RECOVERY - swiftac111 Current Load on swiftac111 is OK: OK - load average: 5.39, 6.54, 6.58 [06:20:57] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 10.61, 10.27, 9.33 [06:36:57] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 9.67, 10.07, 10.00 [06:42:46] PROBLEM - swiftac111 Current Load on swiftac111 is WARNING: WARNING - load average: 6.58, 6.88, 6.62 [06:44:44] RECOVERY - swiftac111 Current Load on swiftac111 is OK: OK - load average: 5.86, 6.50, 6.51 [06:44:57] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 10.76, 10.22, 10.02 [06:46:57] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 8.52, 9.74, 9.88 [06:50:57] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 10.33, 10.15, 10.03 [06:56:57] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 9.67, 10.17, 10.10 [07:06:57] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 10.68, 9.60, 9.51 [07:08:57] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 9.91, 9.55, 9.50 [07:09:18] PROBLEM - swiftac111 Current Load on swiftac111 is WARNING: WARNING - load average: 7.09, 6.86, 6.53 [07:13:14] RECOVERY - swiftac111 Current Load on swiftac111 is OK: OK - load average: 5.77, 6.55, 6.50 [07:27:00] RECOVERY - www.twistwoodtaleswiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'www.twistwoodtaleswiki.com' will expire on Wed 20 Dec 2023 22:08:34 GMT +0000. [07:34:21] PROBLEM - db121 Current Load on db121 is WARNING: WARNING - load average: 6.82, 5.15, 3.10 [07:34:53] PROBLEM - swiftac111 Current Load on swiftac111 is WARNING: WARNING - load average: 7.12, 6.55, 6.27 [07:36:21] RECOVERY - db121 Current Load on db121 is OK: OK - load average: 1.63, 3.81, 2.86 [07:40:10] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 10.58, 9.09, 8.74 [07:42:07] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 9.75, 9.29, 8.86 [07:42:14] PROBLEM - cloud12 Puppet on cloud12 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [07:42:46] RECOVERY - swiftac111 Current Load on swiftac111 is OK: OK - load average: 6.12, 6.67, 6.47 [07:58:38] PROBLEM - www.twistwoodtaleswiki.com - LetsEncrypt on sslhost is CRITICAL: connect to address www.twistwoodtaleswiki.com and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [08:01:30] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 10.50, 10.09, 9.52 [08:06:23] PROBLEM - swiftac111 Current Load on swiftac111 is WARNING: WARNING - load average: 7.44, 6.74, 6.38 [08:09:17] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 9.51, 9.89, 9.66 [08:10:14] RECOVERY - cloud12 Puppet on cloud12 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [08:12:18] RECOVERY - swiftac111 Current Load on swiftac111 is OK: OK - load average: 6.20, 6.75, 6.54 [08:20:57] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 11.12, 10.34, 9.92 [08:26:57] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 9.41, 10.17, 10.02 [08:28:20] RECOVERY - www.twistwoodtaleswiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'www.twistwoodtaleswiki.com' will expire on Wed 20 Dec 2023 22:08:34 GMT +0000. [08:35:55] PROBLEM - swiftac111 Current Load on swiftac111 is CRITICAL: CRITICAL - load average: 8.07, 6.99, 6.50 [08:37:53] PROBLEM - swiftac111 Current Load on swiftac111 is WARNING: WARNING - load average: 7.20, 7.12, 6.62 [08:40:57] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 11.47, 9.41, 8.96 [08:43:48] RECOVERY - swiftac111 Current Load on swiftac111 is OK: OK - load average: 5.66, 6.62, 6.61 [08:46:57] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 9.76, 9.93, 9.40 [09:07:34] PROBLEM - swiftac111 Current Load on swiftac111 is WARNING: WARNING - load average: 7.63, 6.95, 6.52 [09:13:34] RECOVERY - swiftac111 Current Load on swiftac111 is OK: OK - load average: 5.52, 6.57, 6.56 [09:14:57] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 10.86, 9.72, 9.13 [09:20:57] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 9.81, 10.12, 9.54 [09:36:29] PROBLEM - swiftac111 Current Load on swiftac111 is WARNING: WARNING - load average: 7.56, 6.93, 6.52 [09:42:24] RECOVERY - swiftac111 Current Load on swiftac111 is OK: OK - load average: 5.70, 6.75, 6.63 [09:45:17] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 11.57, 10.35, 9.78 [09:55:00] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 7.19, 9.67, 9.87 [09:59:25] PROBLEM - www.twistwoodtaleswiki.com - LetsEncrypt on sslhost is CRITICAL: connect to address www.twistwoodtaleswiki.com and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [10:00:21] PROBLEM - db121 Current Load on db121 is WARNING: WARNING - load average: 7.30, 6.04, 3.71 [10:02:21] RECOVERY - db121 Current Load on db121 is OK: OK - load average: 1.70, 4.40, 3.40 [10:02:23] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query. [10:04:57] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 11.97, 9.46, 9.15 [10:06:57] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 12.34, 10.34, 9.51 [10:09:55] PROBLEM - swiftac111 Current Load on swiftac111 is WARNING: WARNING - load average: 7.17, 6.95, 6.65 [10:10:57] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 11.41, 11.02, 9.99 [10:12:57] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 8.10, 10.06, 9.77 [10:13:51] RECOVERY - swiftac111 Current Load on swiftac111 is OK: OK - load average: 6.31, 6.71, 6.64 [10:32:11] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is WARNING: SSL WARNING - rDNS OK but records conflict. {'NS': ['NS.ANKH.FR.eu.org.', 'NS1.eu.org.', 'NS1.ERIOMEM.NET.'], 'CNAME': 'bouncingwiki.miraheze.org.'} [10:40:57] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 11.03, 10.12, 9.78 [10:41:34] PROBLEM - swiftac111 Current Load on swiftac111 is WARNING: WARNING - load average: 7.45, 7.03, 6.58 [10:42:57] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 9.64, 9.97, 9.77 [10:43:34] RECOVERY - swiftac111 Current Load on swiftac111 is OK: OK - load average: 5.97, 6.65, 6.49 [10:58:50] RECOVERY - www.twistwoodtaleswiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'www.twistwoodtaleswiki.com' will expire on Wed 20 Dec 2023 22:08:34 GMT +0000. [11:00:57] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 11.08, 10.41, 10.00 [11:05:34] PROBLEM - swiftac111 Current Load on swiftac111 is WARNING: WARNING - load average: 7.09, 6.40, 6.20 [11:08:57] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 9.82, 10.16, 10.08 [11:12:57] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 10.16, 10.22, 10.13 [11:14:57] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 9.87, 10.15, 10.12 [11:15:34] RECOVERY - swiftac111 Current Load on swiftac111 is OK: OK - load average: 6.42, 6.65, 6.54 [11:30:27] PROBLEM - www.twistwoodtaleswiki.com - LetsEncrypt on sslhost is CRITICAL: connect to address www.twistwoodtaleswiki.com and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [11:30:32] RECOVERY - ewgf.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'ewgf.wiki' will expire on Wed 20 Dec 2023 22:59:05 GMT +0000. [11:35:34] PROBLEM - swiftac111 Current Load on swiftac111 is WARNING: WARNING - load average: 7.73, 6.78, 6.42 [11:39:37] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 11.31, 10.46, 9.83 [11:45:34] RECOVERY - swiftac111 Current Load on swiftac111 is OK: OK - load average: 6.18, 6.66, 6.65 [11:51:17] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 6.00, 9.39, 9.84 [11:59:01] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 10.22, 8.87, 9.10 [12:00:57] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 9.91, 9.18, 9.19 [12:02:30] PROBLEM - ewgf.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address ewgf.wiki and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [12:05:34] PROBLEM - swiftac111 Current Load on swiftac111 is WARNING: WARNING - load average: 7.19, 6.65, 6.37 [12:08:57] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 12.01, 10.58, 9.79 [12:10:57] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 10.70, 10.51, 9.86 [12:13:34] RECOVERY - swiftac111 Current Load on swiftac111 is OK: OK - load average: 6.25, 6.74, 6.59 [12:18:57] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 12.36, 11.27, 10.43 [12:22:57] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 10.68, 11.43, 10.72 [12:35:34] PROBLEM - swiftac111 Current Load on swiftac111 is WARNING: WARNING - load average: 7.43, 6.74, 6.50 [12:38:57] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 12.80, 11.76, 11.18 [12:40:57] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 12.00, 11.76, 11.25 [12:45:34] RECOVERY - swiftac111 Current Load on swiftac111 is OK: OK - load average: 5.38, 6.39, 6.57 [12:46:57] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 12.06, 11.75, 11.40 [12:48:57] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 11.90, 11.77, 11.45 [12:50:57] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 12.30, 11.89, 11.53 [12:52:57] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 11.88, 11.84, 11.56 [13:00:57] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 12.41, 10.20, 10.55 [13:03:33] PROBLEM - cheeseepedia.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'cheeseepedia.org' expires in 15 day(s) (Wed 13 Dec 2023 12:51:23 GMT +0000). [13:04:08] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/b5174447620b...8fdacfc991fc [13:04:10] [02miraheze/ssl] 07MirahezeSSLBot 038fdacfc - Bot: Update SSL cert for cheeseepedia.org [13:04:24] PROBLEM - swiftac111 Current Load on swiftac111 is WARNING: WARNING - load average: 7.64, 6.88, 6.61 [13:08:57] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 11.66, 11.73, 11.22 [13:16:13] RECOVERY - swiftac111 Current Load on swiftac111 is OK: OK - load average: 5.72, 6.38, 6.65 [13:22:14] PROBLEM - franchise.franchising.org.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - franchise.franchising.org.ua All nameservers failed to answer the query. [13:27:59] [02CreateWiki] 07OAuthority synchronize pull request 03#447: add migration questions (T10844) - 13https://github.com/miraheze/CreateWiki/pull/447 [13:28:53] [02CreateWiki] 07OAuthority synchronize pull request 03#447: add migration questions (T10844) - 13https://github.com/miraheze/CreateWiki/pull/447 [13:29:12] [02CreateWiki] 07OAuthority synchronize pull request 03#447: add migration questions (T10844) - 13https://github.com/miraheze/CreateWiki/pull/447 [13:30:57] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 9.29, 9.29, 10.20 [13:32:07] RECOVERY - cheeseepedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'cheeseepedia.org' will expire on Sun 25 Feb 2024 12:03:37 GMT +0000. [13:35:54] PROBLEM - swiftac111 Current Load on swiftac111 is WARNING: WARNING - load average: 7.47, 6.77, 6.46 [13:36:57] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 10.40, 10.15, 10.29 [13:44:24] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.29, 6.79, 5.79 [13:46:57] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 13.49, 11.92, 11.02 [13:48:57] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 11.91, 11.86, 11.11 [13:49:42] RECOVERY - swiftac111 Current Load on swiftac111 is OK: OK - load average: 6.14, 6.70, 6.74 [13:50:24] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.95, 7.07, 6.30 [13:52:11] RECOVERY - franchise.franchising.org.ua - reverse DNS on sslhost is OK: SSL OK - franchise.franchising.org.ua reverse DNS resolves to cp24.miraheze.org - CNAME OK [13:52:24] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.58, 6.19, 6.07 [13:54:57] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 5.23, 8.84, 10.18 [14:02:57] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 10.59, 9.34, 9.63 [14:05:34] PROBLEM - swiftac111 Current Load on swiftac111 is WARNING: WARNING - load average: 7.62, 6.63, 6.45 [14:06:57] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 9.66, 9.78, 9.78 [14:12:57] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 10.34, 10.03, 9.85 [14:13:34] RECOVERY - swiftac111 Current Load on swiftac111 is OK: OK - load average: 5.95, 6.55, 6.55 [14:26:57] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 9.68, 10.04, 10.10 [14:35:34] PROBLEM - swiftac111 Current Load on swiftac111 is WARNING: WARNING - load average: 7.06, 6.72, 6.41 [14:38:57] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 10.69, 9.20, 9.03 [14:40:57] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 9.20, 9.13, 9.02 [14:45:34] RECOVERY - swiftac111 Current Load on swiftac111 is OK: OK - load average: 6.15, 6.78, 6.68 [14:56:38] PROBLEM - cp24 Varnish Backends on cp24 is CRITICAL: 2 backends are down. mw141 mw142 [14:56:44] PROBLEM - mw141 Current Load on mw141 is CRITICAL: CRITICAL - load average: 12.45, 10.60, 6.49 [14:58:38] RECOVERY - cp24 Varnish Backends on cp24 is OK: All 15 backends are healthy [14:58:42] RECOVERY - mw141 Current Load on mw141 is OK: OK - load average: 4.60, 8.10, 6.06 [14:58:57] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 11.52, 10.68, 9.96 [15:02:57] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 9.26, 10.14, 9.93 [15:06:23] RECOVERY - wiki.anglish.info - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.anglish.info' will expire on Mon 18 Dec 2023 21:25:31 GMT +0000. [15:07:35] PROBLEM - swiftac111 Current Load on swiftac111 is WARNING: WARNING - load average: 7.69, 6.74, 6.39 [15:11:34] PROBLEM - swiftac111 Current Load on swiftac111 is CRITICAL: CRITICAL - load average: 8.21, 7.33, 6.70 [15:13:34] PROBLEM - swiftac111 Current Load on swiftac111 is WARNING: WARNING - load average: 6.27, 6.84, 6.60 [15:14:57] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 10.77, 8.97, 8.85 [15:15:34] RECOVERY - swiftac111 Current Load on swiftac111 is OK: OK - load average: 5.96, 6.48, 6.49 [15:23:31] PROBLEM - cp25 Varnish Backends on cp25 is CRITICAL: 1 backends are down. mw141 [15:23:38] PROBLEM - mw141 Current Load on mw141 is CRITICAL: CRITICAL - load average: 15.36, 12.07, 7.98 [15:25:31] RECOVERY - cp25 Varnish Backends on cp25 is OK: All 15 backends are healthy [15:25:36] RECOVERY - mw141 Current Load on mw141 is OK: OK - load average: 5.79, 9.52, 7.53 [15:30:57] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 8.90, 9.94, 9.84 [15:35:34] PROBLEM - swiftac111 Current Load on swiftac111 is WARNING: WARNING - load average: 7.19, 6.54, 6.34 [15:37:48] PROBLEM - mw134 Current Load on mw134 is WARNING: WARNING - load average: 8.99, 10.50, 7.79 [15:38:57] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 11.18, 10.41, 10.05 [15:39:44] RECOVERY - mw134 Current Load on mw134 is OK: OK - load average: 3.57, 7.95, 7.18 [15:43:34] RECOVERY - swiftac111 Current Load on swiftac111 is OK: OK - load average: 5.87, 6.64, 6.53 [15:44:57] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 12.18, 11.32, 10.55 [15:46:57] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 11.10, 11.24, 10.62 [15:56:57] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 12.18, 11.24, 10.79 [16:04:57] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 11.47, 11.71, 11.25 [16:07:52] PROBLEM - mw142 Current Load on mw142 is CRITICAL: CRITICAL - load average: 10.59, 12.79, 8.30 [16:08:44] PROBLEM - wiki.anglish.info - LetsEncrypt on sslhost is CRITICAL: connect to address wiki.anglish.info and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [16:09:54] PROBLEM - mw142 Current Load on mw142 is WARNING: WARNING - load average: 9.50, 11.11, 8.19 [16:11:52] PROBLEM - mw142 Current Load on mw142 is CRITICAL: CRITICAL - load average: 9.18, 12.12, 9.03 [16:12:42] PROBLEM - mw141 Current Load on mw141 is WARNING: WARNING - load average: 6.94, 10.23, 8.03 [16:13:52] RECOVERY - mw142 Current Load on mw142 is OK: OK - load average: 4.73, 9.47, 8.44 [16:14:40] RECOVERY - mw141 Current Load on mw141 is OK: OK - load average: 6.28, 8.63, 7.69 [16:14:57] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 5.51, 7.85, 9.67 [16:20:57] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 11.38, 9.96, 9.94 [16:24:57] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 9.52, 9.90, 9.94 [16:27:34] RECOVERY - www.twistwoodtaleswiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'www.twistwoodtaleswiki.com' will expire on Wed 20 Dec 2023 22:08:34 GMT +0000. [16:27:40] PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: LOAD CRITICAL - total load average: 4.15, 3.52, 2.95 [16:29:38] PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 3.41, 3.49, 3.01 [16:30:57] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 12.38, 10.83, 10.28 [16:31:35] RECOVERY - matomo121 Current Load on matomo121 is OK: LOAD OK - total load average: 3.34, 3.37, 3.02 [16:32:57] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 11.21, 10.91, 10.38 [16:34:00] [02CreateWiki] 07OAuthority synchronize pull request 03#447: add migration questions (T10844) - 13https://github.com/miraheze/CreateWiki/pull/447 [16:34:41] [02CreateWiki] 07OAuthority commented on pull request 03#447: add migration questions (T10844) - 13https://github.com/miraheze/CreateWiki/pull/447#issuecomment-1828190890 [16:34:52] [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-4 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/476a30ed92b5 [16:34:55] [02miraheze/mw-config] 07paladox 03476a30e - Fix $smwgMainCacheType for new nutcracker config [16:34:57] [02mw-config] 07paladox created branch 03paladox-patch-4 - 13https://github.com/miraheze/mw-config [16:34:59] [02mw-config] 07paladox opened pull request 03#5385: Fix $smwgMainCacheType for new nutcracker config - 13https://github.com/miraheze/mw-config/pull/5385 [16:35:08] [02mw-config] 07paladox closed pull request 03#5385: Fix $smwgMainCacheType for new nutcracker config - 13https://github.com/miraheze/mw-config/pull/5385 [16:35:11] [02miraheze/mw-config] 07paladox deleted branch 03paladox-patch-4 [16:35:12] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/dc557c52c400...b6716b9ccaa1 [16:35:14] [02miraheze/mw-config] 07paladox 03b6716b9 - Fix $smwgMainCacheType for new nutcracker config (#5385) [16:35:17] [02mw-config] 07paladox deleted branch 03paladox-patch-4 - 13https://github.com/miraheze/mw-config [16:35:22] !log [paladox@mwtask141] starting deploy of {'pull': 'config', 'config': True} to all [16:35:26] PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: LOAD CRITICAL - total load average: 4.12, 3.62, 3.18 [16:35:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:35:36] !log [paladox@mwtask141] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 14s [16:35:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:35:42] !log [paladox@mwtask141] starting deploy of {'config': True} to all [16:35:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:35:50] !log [paladox@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 7s [16:35:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:35:58] miraheze/mw-config - paladox the build passed. [16:36:07] miraheze/mw-config - paladox the build passed. [16:37:23] RECOVERY - matomo121 Current Load on matomo121 is OK: LOAD OK - total load average: 2.58, 3.35, 3.14 [16:37:42] RECOVERY - wiki.anglish.info - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.anglish.info' will expire on Mon 18 Dec 2023 21:25:31 GMT +0000. [16:39:59] PROBLEM - swiftac111 Current Load on swiftac111 is WARNING: WARNING - load average: 7.23, 6.86, 6.47 [16:42:57] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 6.56, 9.40, 9.98 [16:43:55] RECOVERY - swiftac111 Current Load on swiftac111 is OK: OK - load average: 5.82, 6.55, 6.46 [16:46:05] !log [paladox@test131] starting deploy of {'pull': 'config', 'config': True} to all [16:46:07] !log [paladox@test131] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 2s [16:46:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:46:14] !log [paladox@test131] starting deploy of {'config': True} to all [16:46:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:46:15] !log [paladox@test131] finished deploy of {'config': True} to all - SUCCESS in 0s [16:46:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:46:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:52:57] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 10.90, 9.45, 9.30 [16:58:57] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 13.05, 11.48, 10.22 [16:59:12] PROBLEM - www.twistwoodtaleswiki.com - LetsEncrypt on sslhost is CRITICAL: connect to address www.twistwoodtaleswiki.com and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [16:59:40] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query. [17:00:57] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 11.55, 11.55, 10.41 [17:08:28] PROBLEM - wiki.anglish.info - LetsEncrypt on sslhost is CRITICAL: connect to address wiki.anglish.info and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [17:08:57] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 12.86, 11.16, 10.52 [17:12:57] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 11.77, 11.67, 10.91 [17:16:57] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 6.99, 8.68, 9.85 [17:18:33] PROBLEM - db121 Current Load on db121 is CRITICAL: CRITICAL - load average: 8.57, 5.92, 3.69 [17:20:31] RECOVERY - db121 Current Load on db121 is OK: OK - load average: 6.70, 6.30, 4.11 [17:23:53] PROBLEM - franchise.franchising.org.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query franchise.franchising.org.ua. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [17:24:57] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 11.42, 9.92, 9.71 [17:29:29] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is WARNING: SSL WARNING - rDNS OK but records conflict. {'NS': ['NS.ANKH.FR.eu.org.', 'NS1.eu.org.', 'NS1.ERIOMEM.NET.'], 'CNAME': 'bouncingwiki.miraheze.org.'} [17:36:57] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 8.80, 9.77, 9.99 [17:37:06] PROBLEM - swiftac111 Current Load on swiftac111 is WARNING: WARNING - load average: 7.72, 6.97, 6.41 [17:43:01] RECOVERY - swiftac111 Current Load on swiftac111 is OK: OK - load average: 6.09, 6.68, 6.49 [17:44:57] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 11.05, 10.27, 10.08 [17:53:50] RECOVERY - franchise.franchising.org.ua - reverse DNS on sslhost is OK: SSL OK - franchise.franchising.org.ua reverse DNS resolves to cp25.miraheze.org - CNAME OK [17:56:11] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_40 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/8d68b7c532a3...920a142dbcca [17:56:13] [02miraheze/mediawiki] 07paladox 03920a142 - Update SemanticMediaWiki [17:57:24] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_41 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/01553f510343...3332b2dcb681 [17:57:26] [02miraheze/mediawiki] 07paladox 033332b2d - Update SemanticMediaWiki [17:58:43] !log [paladox@mwtask141] starting deploy of {'world': True, 'l10n': True} to all [17:58:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:59:17] !log [paladox@test131] starting deploy of {'world': True, 'l10n': True} to all [17:59:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:00:32] RECOVERY - ewgf.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'ewgf.wiki' will expire on Wed 20 Dec 2023 22:59:05 GMT +0000. [18:01:15] !log [paladox@test131] finished deploy of {'world': True, 'l10n': True} to all - SUCCESS in 117s [18:01:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:05:26]