[00:00:56] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.46, 3.84, 3.72 [00:02:05] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 3.89, 3.55, 3.14 [00:02:23] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 5.59, 3.70, 1.90 [00:02:25] PROBLEM - widedata.org - LetsEncrypt on sslhost is CRITICAL: connect to address widedata.org and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [00:02:55] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.86, 3.47, 3.60 [00:03:22] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.00, 12.23, 10.41 [00:03:32] PROBLEM - cloud12 Current Load on cloud12 is WARNING: WARNING - load average: 41.56, 32.20, 21.66 [00:05:02] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.27, 3.48, 3.16 [00:05:16] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.50, 2.92, 2.33 [00:05:20] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.23, 10.43, 9.96 [00:05:32] RECOVERY - cloud12 Current Load on cloud12 is OK: OK - load average: 18.10, 26.31, 20.78 [00:06:03] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 2.80, 3.23, 3.10 [00:06:23] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.03, 2.90, 2.05 [00:07:02] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 3.17, 3.34, 3.14 [00:07:18] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.87, 9.32, 9.59 [00:09:15] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.56, 2.90, 2.48 [00:12:48] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.79, 3.05, 3.34 [00:15:02] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.33, 3.41, 3.24 [00:16:44] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.23, 3.42, 3.46 [00:17:02] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.29, 3.01, 3.11 [00:18:42] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 3.15, 3.24, 3.38 [00:18:53] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 5.37, 4.11, 2.26 [00:26:34] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.08, 3.62, 3.47 [00:26:39] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 0.74, 3.85, 3.25 [00:27:15] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.38, 3.62, 3.36 [00:28:33] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.71, 3.29, 3.37 [00:28:35] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 0.47, 2.74, 2.92 [00:29:11] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.92, 3.34, 3.29 [00:30:45] !log [universalomega@mwtask141] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.json /srv/mediawiki/w/extensions/MirahezeMagic/maintenance/fixStaticUrls.php (END - exit=0) [00:30:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:31:26] RECOVERY - widedata.org - LetsEncrypt on sslhost is OK: OK - Certificate 'widedata.org' will expire on Fri 24 Feb 2023 05:04:05 GMT +0000. [00:33:36] !log [universalomega@mwtask141] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.json /srv/mediawiki/w/extensions/MirahezeMagic/maintenance/updatePrivateAuthUrls.php (START) [00:33:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:36:25] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.74, 3.38, 3.34 [00:38:23] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 3.02, 3.22, 3.28 [00:38:27] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.53, 3.38, 3.17 [00:42:19] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.84, 3.16, 3.14 [00:45:47] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+15/-25/±16] 13https://github.com/miraheze/puppet/compare/34f919cbcd48...b6302605b6e0 [00:45:48] [url] Comparing 34f919cbcd48...b6302605b6e0 · miraheze/puppet · GitHub | github.com [00:45:48] [02miraheze/puppet] 07paladox 03b630260 - update [00:45:50] [02puppet] 07paladox synchronize pull request 03#3065: Testing... - 13https://github.com/miraheze/puppet/pull/3065 [00:45:51] [url] Page not found · GitHub · GitHub | github.com [00:46:25] [02puppet] 07paladox edited pull request 03#3065: Add support for role based hiera - 13https://github.com/miraheze/puppet/pull/3065 [00:46:25] [url] Page not found · GitHub · GitHub | github.com [00:47:50] [02puppet] 07paladox edited pull request 03#3065: Add support for role based hiera - 13https://github.com/miraheze/puppet/pull/3065 [00:47:51] [url] Page not found · GitHub · GitHub | github.com [00:48:56] [02puppet] 07paladox edited pull request 03#3065: Add support for role based hiera - 13https://github.com/miraheze/puppet/pull/3065 [00:48:57] ... [00:49:01] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1076572239 secs [00:52:04] PROBLEM - mw141 NTP time on mw141 is CRITICAL: NTP CRITICAL: Offset 0.6748496592 secs [00:53:43] [02puppet] 07paladox edited pull request 03#3065: Add support for role based hiera - 13https://github.com/miraheze/puppet/pull/3065 [00:53:44] [url] Page not found · GitHub · GitHub | github.com [01:01:35] !log [universalomega@mwtask141] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.json /srv/mediawiki/w/extensions/MirahezeMagic/maintenance/updatePrivateAuthUrls.php (END - exit=0) [01:01:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:03:01] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.07765224576 secs [01:12:51] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.24, 3.52, 3.33 [01:14:50] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 3.08, 3.34, 3.29 [01:17:24] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.69, 3.37, 3.11 [01:18:45] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.53, 3.80, 3.47 [01:19:19] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.01, 3.55, 3.20 [01:21:15] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.87, 3.31, 3.15 [01:22:42] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.42, 3.68, 3.51 [01:22:52] RECOVERY - mw141 NTP time on mw141 is OK: NTP OK: Offset -0.004115402699 secs [01:24:40] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.59, 3.27, 3.38 [01:28:46] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.39, 9.93, 8.28 [01:30:46] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.05, 9.24, 8.24 [01:32:25] PROBLEM - widedata.org - LetsEncrypt on sslhost is CRITICAL: connect to address widedata.org and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [01:45:18] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.49, 3.65, 3.49 [01:47:17] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.48, 3.32, 3.40 [01:51:12] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.30, 3.47, 3.45 [01:51:13] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 3.61, 3.48, 2.94 [01:53:10] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.04, 2.97, 3.27 [01:53:12] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 3.33, 3.23, 2.90 [02:04:05] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 3.88, 3.66, 3.19 [02:06:04] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 2.77, 3.30, 3.12 [02:12:00] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 3.99, 3.81, 3.40 [02:13:50] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.82, 4.30, 3.67 [02:13:59] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 3.52, 4.01, 3.54 [02:15:02] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.37, 3.48, 3.08 [02:15:15] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 6.00, 4.55, 3.70 [02:15:59] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 2.89, 3.77, 3.52 [02:17:02] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.49, 3.46, 3.12 [02:19:02] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.70, 3.16, 3.05 [02:19:06] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.13, 3.44, 3.45 [02:21:44] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.57, 3.99, 3.84 [02:21:59] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 3.02, 3.28, 3.38 [02:22:57] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.70, 3.15, 3.34 [02:31:38] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.77, 2.98, 3.36 [02:34:32] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.48, 3.12, 3.09 [02:38:22] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.34, 3.52, 3.24 [02:38:56] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.70, 3.17, 2.36 [02:40:56] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.94, 2.68, 2.28 [02:41:59] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 3.70, 3.58, 3.35 [02:42:13] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.90, 3.81, 3.42 [02:43:59] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 2.75, 3.32, 3.29 [02:44:09] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.15, 3.79, 3.45 [02:45:10] PROBLEM - mw121 Puppet on mw121 is WARNING: WARNING: Puppet last ran 1 hour ago [02:45:24] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.84, 3.94, 3.60 [02:51:19] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.23, 3.84, 3.63 [02:53:18] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.04, 3.60, 3.57 [02:54:02] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.88, 3.66, 3.64 [02:55:16] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.14, 3.80, 3.64 [02:56:02] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.12, 3.81, 3.70 [02:56:26] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.15, 2.99, 2.10 [02:57:14] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.33, 3.59, 3.58 [02:58:26] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.72, 2.69, 2.12 [02:59:23] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=companhiaballwiki --no-updates --username-prefix=mh:companhiaball /home/universalomega/ImportDump/companhiaballwiki-20221214010020.xml (START) [02:59:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:59:59] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 4.48, 3.90, 3.45 [03:01:12] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.29, 3.02, 3.36 [03:01:59] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 2.82, 3.57, 3.39 [03:03:59] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 2.56, 3.16, 3.26 [03:04:02] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.73, 3.53, 3.71 [03:12:02] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.91, 3.02, 3.35 [03:15:10] RECOVERY - mw121 Puppet on mw121 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [03:16:02] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.83, 3.69, 3.56 [03:21:03] !log MariaDB [mhglobal]> UPDATE gnf_files SET files_url=REPLACE(files_url, 'static-new.miraheze.org', 'static.miraheze.org') WHERE files_url LIKE '%static-new.miraheze.org%'; [03:21:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:26:06] [02miraheze/ssl] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/5644c5be2050...9bfa190041e5 [03:26:07] [url] Comparing 5644c5be2050...9bfa190041e5 · miraheze/ssl · GitHub | github.com [03:26:08] [02miraheze/ssl] 07Universal-Omega 039bfa190 - Remove static-new redirect [03:27:43] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03master [+0/-1/±0] 13https://github.com/miraheze/MirahezeMagic/compare/04d4228c0701...501f4a9b0ab3 [03:27:43] [url] Comparing 04d4228c0701...501f4a9b0ab3 · miraheze/MirahezeMagic · GitHub | github.com [03:27:46] [02miraheze/MirahezeMagic] 07Universal-Omega 03501f4a9 - Delete fixStaticUrls.php [03:28:02] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.89, 3.25, 3.40 [03:37:26] miraheze/MirahezeMagic - Universal-Omega the build passed. [03:44:17] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=companhiaballwiki --no-updates --username-prefix=mh:companhiaball /home/universalomega/ImportDump/companhiaballwiki-20221214010020.xml (END - exit=0) [03:44:18] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=companhiaballwiki (START) [03:44:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:44:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:46:02] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.91, 3.27, 3.15 [03:48:02] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 6.38, 4.02, 3.41 [03:50:54] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 3.76, 4.07, 3.27 [03:51:28] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.87, 4.41, 3.70 [03:55:37] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.50, 3.93, 3.67 [03:59:53] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.70, 3.57, 3.62 [04:00:29] RECOVERY - widedata.org - LetsEncrypt on sslhost is OK: OK - Certificate 'widedata.org' will expire on Fri 24 Feb 2023 05:04:05 GMT +0000. [04:00:45] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 2.72, 3.53, 3.49 [04:01:22] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.74, 3.04, 3.35 [04:02:42] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 2.98, 3.22, 3.37 [04:03:47] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.30, 2.90, 3.33 [04:13:07] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.60, 3.38, 3.32 [04:15:07] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 3.18, 3.30, 3.30 [04:16:24] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=companhiaballwiki (END - exit=0) [04:16:25] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=companhiaballwiki --active --update (END - exit=0) [04:16:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:16:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:19:25] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.15, 3.63, 2.86 [04:21:25] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.58, 3.21, 2.80 [04:31:18] PROBLEM - widedata.org - LetsEncrypt on sslhost is CRITICAL: connect to address widedata.org and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [04:45:15] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.96, 3.29, 2.96 [04:47:15] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.59, 3.07, 2.93 [04:48:38] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*kcwmworldwiki* on mw*, test131, and mwtask141 [04:48:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:48:47] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='kcwmworldwiki'; [04:48:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:48:53] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='kcwmworldwiki'; [04:48:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:48:59] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='kcwmworldwiki'; [04:49:04] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='kcwmworldwiki'; [04:49:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:49:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:49:12] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='kcwmworldwiki'; [04:49:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:49:17] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='kcwmworldwiki'; [04:49:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:49:26] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='kcwmworldwiki'; [04:49:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:51:12] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=kcwmworldwiki --missing (START) [04:51:13] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=kcwmworldwiki --missing (END - exit=0) [04:51:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:51:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:51:23] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=kcwmworldwiki --missing (START) [04:51:24] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=kcwmworldwiki --missing (END - exit=0) [04:51:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:51:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:51:59] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=kcwmworldwiki --missing (START) [04:52:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:52:29] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=kcwmworldwiki --missing (END - exit=0) [04:52:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:00:14] RECOVERY - widedata.org - LetsEncrypt on sslhost is OK: OK - Certificate 'widedata.org' will expire on Fri 24 Feb 2023 05:04:05 GMT +0000. [05:10:07] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.77, 3.30, 3.14 [05:12:01] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.12, 3.48, 3.22 [05:15:51] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.51, 3.72, 3.40 [05:19:40] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.88, 3.24, 3.27 [05:31:06] PROBLEM - widedata.org - LetsEncrypt on sslhost is CRITICAL: connect to address widedata.org and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [06:00:24] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 6.68, 4.23, 2.18 [06:02:22] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 2.62, 3.43, 2.12 [06:04:21] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.81, 2.46, 1.92 [06:04:55] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.2021282315 secs [06:08:55] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset -0.01918104291 secs [06:09:07] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.47, 3.47, 3.17 [06:09:15] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.94, 3.17, 2.78 [06:11:07] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.58, 4.00, 3.40 [06:11:15] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.96, 3.83, 3.06 [06:12:59] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=kcwmworldwiki --no-updates /home/universalomega/ImportDump/kcwmworldwiki-20221214061210.xml (START) [06:13:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:13:07] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.93, 3.90, 3.44 [06:13:16] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.43, 3.21, 2.93 [06:14:28] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=kcwmworldwiki --no-updates /home/universalomega/ImportDump/kcwmworldwiki-20221214061210.xml (END - exit=0) [06:14:29] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=kcwmworldwiki (START) [06:14:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:14:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:17:07] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.52, 3.33, 3.32 [06:17:15] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.70, 3.68, 3.19 [06:17:41] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=kcwmworldwiki (END - exit=0) [06:17:42] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=kcwmworldwiki --active --update (END - exit=0) [06:17:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:17:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:19:15] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 3.04, 3.35, 3.12 [06:28:00] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.01, 2.91, 1.85 [06:29:58] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.53, 2.29, 1.75 [06:34:58] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.01, 3.43, 3.26 [06:36:55] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.70, 3.26, 3.22 [06:41:13] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=minelandwiki --no-updates /home/reception/wiki-wikiminelandeu_w-20220810/wikiminelandeu_w-20220810-history.xml (START) [06:41:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:45:28] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=minelandwiki --no-updates /home/reception/wiki-wikiminelandeu_w-20220810/wikiminelandeu_w-20220810-history.xml (END - exit=256) [06:45:29] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=minelandwiki (START) [06:45:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:45:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:49:15] [02miraheze/dns] 07Reception123 pushed 031 commit to 03master [+1/-0/±0] 13https://github.com/miraheze/dns/compare/cbdc1044fb07...c35d5dd1e090 [06:49:15] [url] Comparing cbdc1044fb07...c35d5dd1e090 · miraheze/dns · GitHub | github.com [06:49:16] [02miraheze/dns] 07Reception123 03c35d5dd - add eoa-wiki.ga zone [06:50:30] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=minelandwiki (END - exit=0) [06:50:31] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=minelandwiki --active --update (END - exit=0) [06:50:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:50:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:52:35] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+1/-0/±1] 13https://github.com/miraheze/ssl/compare/9bfa190041e5...ddc9237fe1ad [06:52:36] [url] Comparing 9bfa190041e5...ddc9237fe1ad · miraheze/ssl · GitHub | github.com [06:52:37] [02miraheze/ssl] 07MirahezeSSLBot 03ddc9237 - Bot: Add SSL cert for wiki.pulsus.cc [06:52:45] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+1/-0/±1] 13https://github.com/miraheze/ssl/compare/ddc9237fe1ad...5560f8df9478 [06:52:46] [url] Comparing ddc9237fe1ad...5560f8df9478 · miraheze/ssl · GitHub | github.com [06:52:46] [02miraheze/ssl] 07MirahezeSSLBot 035560f8d - Bot: Add SSL cert for open-justice.info [06:53:17] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+1/-0/±1] 13https://github.com/miraheze/ssl/compare/5560f8df9478...33eca7b991c5 [06:53:18] [url] Comparing 5560f8df9478...33eca7b991c5 · miraheze/ssl · GitHub | github.com [06:53:19] [02miraheze/ssl] 07MirahezeSSLBot 0333eca7b - Bot: Add SSL cert for eoa-wiki.ga [06:56:43] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/61072cfcd3d9...60598d9b5202 [06:56:44] [url] Comparing 61072cfcd3d9...60598d9b5202 · miraheze/puppet · GitHub | github.com [06:56:46] [02miraheze/puppet] 07Universal-Omega 0360598d9 - ssl-certificate: `git reset --hard origin/master` [06:58:40] !log set a phab view policy to public (file) [06:58:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:59:53] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.38, 2.97, 1.76 [07:02:25] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=amicalwiki --no-updates /home/reception/dumpamical.xml (START) [07:02:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:03:52] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.31, 2.81, 2.05 [07:09:16] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.95, 10.42, 7.61 [07:11:09] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=amicalwiki --no-updates /home/reception/dumpamical.xml (END - exit=0) [07:11:10] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=amicalwiki (START) [07:11:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:11:16] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.93, 9.48, 7.61 [07:11:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:11:48] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*chuadangawiki* on mw*, test131, and mwtask141 [07:11:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:11:56] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='chuadangawiki'; [07:12:01] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='chuadangawiki'; [07:12:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:12:07] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='chuadangawiki'; [07:12:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:12:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:12:13] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='chuadangawiki'; [07:12:19] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='chuadangawiki'; [07:12:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:12:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:12:26] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='chuadangawiki'; [07:12:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:12:37] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='chuadangawiki'; [07:12:42] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*taleofheroeswiki* on mw*, test131, and mwtask141 [07:12:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:12:48] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='taleofheroeswiki'; [07:12:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:12:54] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='taleofheroeswiki'; [07:12:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:13:00] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='taleofheroeswiki'; [07:13:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:13:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:13:09] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='taleofheroeswiki'; [07:13:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:13:17] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='taleofheroeswiki'; [07:13:23] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='taleofheroeswiki'; [07:13:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:13:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:13:30] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='taleofheroeswiki'; [07:13:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:15:53] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.96, 3.41, 3.15 [07:16:54] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=amicalwiki (END - exit=0) [07:16:55] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=amicalwiki --active --update (END - exit=0) [07:17:01] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=chuadangawiki --missing (START) [07:17:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:17:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:17:06] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=chuadangawiki --missing (END - exit=0) [07:17:07] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=taleofheroeswiki --missing (START) [07:17:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:17:12] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=taleofheroeswiki --missing (END - exit=0) [07:17:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:17:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:17:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:17:50] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 3.13, 3.32, 3.15 [07:29:47] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 5.70, 4.20, 2.43 [07:35:36] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.18, 3.27, 2.76 [07:37:47] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.85, 3.64, 3.30 [07:40:38] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.89, 3.58, 3.06 [07:43:46] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.65, 3.94, 3.43 [07:44:34] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.43, 3.24, 3.06 [07:45:41] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.40, 3.87, 3.54 [07:47:39] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.03, 3.50, 3.44 [07:47:43] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.15, 3.60, 3.43 [07:49:41] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.83, 3.38, 3.37 [07:51:36] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.88, 3.24, 3.34 [07:59:03] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 8.20, 3.89, 2.31 [08:08:46] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 0.49, 3.68, 3.70 [08:10:42] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.33, 2.56, 3.28 [08:12:16] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.56, 3.32, 3.09 [08:14:15] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.82, 3.24, 3.10 [08:30:21] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.87, 3.41, 2.69 [08:32:21] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.02, 2.53, 2.46 [08:41:04] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.63, 3.42, 3.29 [08:43:04] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.85, 3.21, 3.23 [08:43:47] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.16, 3.48, 3.21 [08:45:45] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.82, 3.25, 3.16 [09:08:19] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 5.03, 3.94, 3.51 [09:12:15] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.95, 3.86, 3.57 [09:22:42] RECOVERY - widedata.org - LetsEncrypt on sslhost is OK: OK - Certificate 'widedata.org' will expire on Fri 24 Feb 2023 05:04:05 GMT +0000. [09:24:03] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 3.16, 3.23, 3.38 [09:28:21] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 8.71, 3.69, 1.91 [09:29:56] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.70, 3.46, 3.41 [09:31:55] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.44, 3.74, 3.51 [09:33:53] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.88, 3.41, 3.42 [09:34:21] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.43, 3.03, 2.29 [09:35:51] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 3.23, 3.31, 3.37 [09:35:59] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.54, 3.24, 2.96 [09:37:57] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.78, 3.12, 2.95 [09:41:46] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.86, 3.59, 3.46 [09:43:44] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.14, 3.73, 3.52 [09:45:42] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.25, 3.50, 3.46 [09:49:39] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.40, 3.09, 3.32 [10:00:22] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 11.53, 6.58, 3.39 [10:06:21] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.65, 3.06, 2.94 [10:17:05] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.46, 2.92, 2.70 [10:19:04] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 3.00, 2.99, 2.75 [10:24:48] PROBLEM - widedata.org - LetsEncrypt on sslhost is CRITICAL: connect to address widedata.org and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [10:53:52] RECOVERY - widedata.org - LetsEncrypt on sslhost is OK: OK - Certificate 'widedata.org' will expire on Fri 24 Feb 2023 05:04:05 GMT +0000. [11:09:01] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 18.77, 7.77, 3.80 [11:22:13] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 3.50, 3.24, 2.81 [11:22:59] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.54, 2.51, 3.95 [11:24:08] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 3.06, 3.13, 2.82 [11:24:51] PROBLEM - widedata.org - LetsEncrypt on sslhost is CRITICAL: connect to address widedata.org and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [11:25:03] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.74, 3.37, 3.12 [11:26:59] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.53, 1.46, 3.19 [11:27:01] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.06, 3.72, 3.29 [11:29:00] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.80, 3.39, 3.22 [11:29:37] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.81, 3.82, 3.43 [11:31:35] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.56, 3.68, 3.42 [11:33:33] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.41, 3.24, 3.29 [11:36:06] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.73, 3.23, 2.98 [11:37:28] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.98, 3.77, 3.50 [11:38:04] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.53, 2.95, 2.91 [11:45:21] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.36, 3.73, 3.53 [11:47:03] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=succovwiki --no-updates --username-prefix=mh:succov /home/reception/ImportDump/succovwiki-20221214104645.xml (START) [11:47:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [11:47:19] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=succovwiki --missing (START) [11:47:20] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.49, 3.18, 3.35 [11:47:24] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=succovwiki --missing (END - exit=0) [11:47:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [11:47:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [11:48:56] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=succovwiki --no-updates --username-prefix=mh:succov /home/reception/ImportDump/succovwiki-20221214104645.xml (END - exit=0) [11:48:57] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=succovwiki (START) [11:49:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [11:49:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [11:49:33] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=succovwiki (END - exit=0) [11:49:34] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=succovwiki --active --update (END - exit=0) [11:49:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [11:49:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [11:53:13] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03Reception123-patch-2 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/a85ed1e7b521 [11:53:14] [02miraheze/mw-config] 07Reception123 03a85ed1e - set wgLinkTargetParentClasses for anewc0dawiki T10133 [11:53:16] [02mw-config] 07Reception123 created branch 03Reception123-patch-2 - 13https://github.com/miraheze/mw-config [11:53:17] [url] Page not found · GitHub · GitHub | github.com [11:53:43] [02mw-config] 07Reception123 opened pull request 03#5017: set wgLinkTargetParentClasses for anewc0dawiki T10133 - 13https://github.com/miraheze/mw-config/pull/5017 [11:53:43] [url] Page not found · GitHub · GitHub | github.com [11:54:29] [02miraheze/mw-config] 07github-actions[bot] pushed 031 commit to 03Reception123-patch-2 [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/a85ed1e7b521...076519f5f400 [11:54:30] [url] Comparing a85ed1e7b521...076519f5f400 · miraheze/mw-config · GitHub | github.com [11:54:32] [02miraheze/mw-config] 07github-actions 03076519f - CI: lint code to MediaWiki standards [11:54:33] [02mw-config] 07github-actions[bot] synchronize pull request 03#5017: set wgLinkTargetParentClasses for anewc0dawiki T10133 - 13https://github.com/miraheze/mw-config/pull/5017 [11:54:33] [url] Page not found · GitHub · GitHub | github.com [11:55:07] miraheze/mw-config - Reception123 the build passed. [11:55:18] [02mw-config] 07Reception123 closed pull request 03#5017: set wgLinkTargetParentClasses for anewc0dawiki T10133 - 13https://github.com/miraheze/mw-config/pull/5017 [11:55:19] [url] Page not found · GitHub · GitHub | github.com [11:55:19] !log [reception@mwtask141] starting deploy of {'config': True} to all [11:55:19] [02miraheze/mw-config] 07Reception123 deleted branch 03Reception123-patch-2 [11:55:20] [02mw-config] 07Reception123 deleted branch 03Reception123-patch-2 - 13https://github.com/miraheze/mw-config [11:55:20] [url] Page not found · GitHub · GitHub | github.com [11:55:23] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/3ffd9262112f...821b37323466 [11:55:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [11:55:24] [url] Comparing 3ffd9262112f...821b37323466 · miraheze/mw-config · GitHub | github.com [11:55:25] !log [reception@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 6s [11:55:26] [02miraheze/mw-config] 07Reception123 03821b373 - set wgLinkTargetParentClasses for anewc0dawiki T10133 (#5017) [11:55:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [11:56:21] miraheze/mw-config - Reception123 the build passed. [11:56:59] [02miraheze/ssl] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/33eca7b991c5...d4e052211575 [11:56:59] [url] Comparing 33eca7b991c5...d4e052211575 · miraheze/ssl · GitHub | github.com [11:57:00] [02miraheze/ssl] 07Reception123 03d4e0522 - force redirect to yoshipedia.com [11:57:26] !log [@test131] starting deploy of {'config': True} to all [11:57:27] !log [@test131] finished deploy of {'config': True} to all - SUCCESS in 0s [11:57:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [11:57:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:01:07] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.99, 3.72, 3.41 [12:01:42] !log made phab file public via db [12:01:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:03:06] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.82, 3.71, 3.45 [12:04:20] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=projectdiablo2wiki --no-updates --username-prefix=mh:projectdiablo2 /home/reception/projectdiabolo/wikiprojectdiablo2com_w-20220810-history.xml (START) [12:04:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:05:04] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.22, 3.80, 3.50 [12:07:04] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.79, 3.41, 3.39 [12:07:38] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.50, 3.53, 2.34 [12:08:59] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=sotfwiki --no-updates --username-prefix=wikia:sotf /home/reception/sotf_pages_full.xml (START) [12:09:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:09:05] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 3.08, 3.27, 3.34 [12:11:02] !log [@mwtask141] starting deploy of {'config': True} to all [12:11:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:11:10] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 7s [12:11:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:13:04] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.95, 3.63, 3.46 [12:13:35] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.11, 3.82, 3.13 [12:15:07] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.51, 3.62, 3.32 [12:15:33] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.07, 2.85, 2.85 [12:19:03] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 3.14, 3.23, 3.21 [12:19:05] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.89, 3.34, 3.38 [12:22:53] RECOVERY - widedata.org - LetsEncrypt on sslhost is OK: OK - Certificate 'widedata.org' will expire on Fri 24 Feb 2023 05:04:05 GMT +0000. [12:23:58] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=sotfwiki --no-updates --username-prefix=wikia:sotf /home/reception/sotf_pages_full.xml (END - exit=0) [12:23:59] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=sotfwiki (START) [12:24:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:24:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:26:14] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=sotfwiki (END - exit=2) [12:26:18] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=sotfwiki --no-updates --username-prefix=wikia:sotf /home/reception/sotf_pages_full.xml (START) [12:26:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:26:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:26:33] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 3.48, 3.23, 2.95 [12:28:29] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 2.64, 3.00, 2.89 [12:28:30] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=sotfwiki --no-updates --username-prefix=wikia:sotf /home/reception/sotf_pages_full.xml (END - exit=0) [12:28:31] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=sotfwiki (START) [12:28:34] !log [salt-user@mwtask141] sudo -u www-data php /srv/mediawiki/w/extensions/SemanticMediaWiki/maintenance/setupStore.php --wiki=emulationwiki (END - exit=65280) [12:28:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:28:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:28:41] !log [salt-user@mw131] sudo -u www-data php /srv/mediawiki/w/extensions/SemanticMediaWiki/maintenance/setupStore.php --wiki=emulationwiki (END - exit=0) [12:28:43] !log [salt-user@mw132] sudo -u www-data php /srv/mediawiki/w/extensions/SemanticMediaWiki/maintenance/setupStore.php --wiki=emulationwiki (END - exit=0) [12:28:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:28:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:28:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:29:00] !log [salt-user@mw142] sudo -u www-data php /srv/mediawiki/w/extensions/SemanticMediaWiki/maintenance/setupStore.php --wiki=emulationwiki (END - exit=0) [12:29:01] !log [salt-user@mw121] sudo -u www-data php /srv/mediawiki/w/extensions/SemanticMediaWiki/maintenance/setupStore.php --wiki=emulationwiki (END - exit=0) [12:29:02] !log [salt-user@mw122] sudo -u www-data php /srv/mediawiki/w/extensions/SemanticMediaWiki/maintenance/setupStore.php --wiki=emulationwiki (END - exit=0) [12:29:04] !log [salt-user@mw141] sudo -u www-data php /srv/mediawiki/w/extensions/SemanticMediaWiki/maintenance/setupStore.php --wiki=emulationwiki (END - exit=0) [12:29:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:29:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:29:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:29:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:30:46] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=projectdiablo2wiki --no-updates --username-prefix=mh:projectdiablo2 /home/reception/projectdiabolo/wikiprojectdiablo2com_w-20220810-history.xml (END - exit=0) [12:30:47] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=projectdiablo2wiki (START) [12:30:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:30:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:35:20] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=sotfwiki (END - exit=0) [12:35:21] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=sotfwiki --active --update (END - exit=0) [12:35:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:35:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:37:14] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=projectdiablo2wiki (END - exit=0) [12:37:15] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=projectdiablo2wiki --active --update (END - exit=0) [12:37:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:37:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:47:42] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.96, 3.76, 3.45 [12:51:40] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.95, 3.36, 3.35 [12:55:37] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 3.14, 3.67, 3.12 [12:55:41] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.18, 4.04, 3.65 [12:57:33] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 2.17, 3.16, 3.00 [12:57:41] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.32, 3.70, 3.56 [13:02:04] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.90, 4.45, 2.97 [13:08:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.00, 3.43, 3.36 [13:09:40] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 5.65, 4.02, 3.71 [13:10:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 5.99, 4.51, 3.77 [13:12:11] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 4.00, 3.10, 2.18 [13:12:27] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.36, 3.92, 3.31 [13:12:38] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.66, 9.92, 8.11 [13:13:32] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 4.26, 4.45, 3.53 [13:14:08] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 2.23, 2.72, 2.15 [13:14:25] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 2.81, 3.47, 3.22 [13:14:38] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.14, 9.26, 8.09 [13:15:32] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 2.65, 3.85, 3.43 [13:16:23] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.88, 3.23, 3.16 [13:16:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.60, 3.86, 3.81 [13:17:37] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.53, 2.67, 3.79 [13:19:32] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 2.93, 3.25, 3.28 [13:21:32] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.92, 1.91, 3.20 [13:22:58] PROBLEM - widedata.org - LetsEncrypt on sslhost is CRITICAL: connect to address widedata.org and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [13:23:41] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.66, 3.92, 3.97 [13:25:41] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.26, 4.03, 4.00 [13:29:40] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.06, 3.69, 3.89 [13:30:52] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1512960792 secs [13:38:52] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.90, 3.17, 3.36 [13:45:40] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.75, 4.00, 3.80 [13:46:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.49, 3.89, 3.60 [13:50:19] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 3.83, 3.57, 3.22 [13:50:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.49, 3.73, 3.62 [13:51:41] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 4.00, 3.98, 3.85 [13:52:15] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 2.60, 3.37, 3.20 [13:54:53] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.06864270568 secs [13:56:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.30, 3.98, 3.73 [13:58:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.85, 3.87, 3.72 [14:00:53] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.70, 4.06, 3.80 [14:03:41] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.05, 3.66, 3.64 [14:04:32] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.04, 3.49, 3.15 [14:04:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.20, 3.91, 3.82 [14:05:32] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.83, 3.99, 2.46 [14:06:30] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.57, 3.50, 3.19 [14:07:41] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.33, 3.80, 3.72 [14:07:46] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 4.00, 3.71, 3.38 [14:08:29] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.76, 3.24, 3.14 [14:08:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.96, 4.11, 3.91 [14:11:48] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.66, 10.67, 8.91 [14:13:32] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.98, 3.59, 3.00 [14:13:34] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 2.62, 3.16, 3.27 [14:13:42] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.98, 9.53, 8.72 [14:15:32] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.75, 2.95, 2.84 [14:15:40] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.43, 3.67, 3.62 [14:17:40] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.80, 3.32, 3.49 [14:20:27] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 3.87, 3.18, 3.19 [14:21:41] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.34, 3.68, 3.59 [14:22:23] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 2.53, 2.99, 3.12 [14:29:38] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 5.07, 3.00, 2.01 [14:31:38] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.69, 3.68, 2.42 [14:33:38] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.13, 2.73, 2.22 [14:37:32] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 13.64, 8.06, 4.50 [14:37:41] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.17, 3.80, 3.92 [14:38:53] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.10, 3.54, 3.89 [14:40:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.34, 3.76, 3.92 [14:44:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.76, 3.85, 3.92 [14:45:41] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.81, 3.69, 3.72 [14:46:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 3.93, 4.03, 3.98 [14:47:32] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.83, 3.53, 3.84 [14:47:41] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.46, 3.53, 3.65 [14:49:41] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.02, 3.76, 3.73 [14:51:41] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.75, 3.40, 3.60 [14:53:32] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.01, 3.51, 3.68 [14:53:42] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.30, 3.52, 3.60 [14:54:41] PROBLEM - cp33 NTP time on cp33 is WARNING: NTP WARNING: Offset 0.1792582572 secs [14:55:32] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.91, 2.85, 3.41 [14:55:41] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.51, 3.17, 3.47 [14:57:32] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.56, 2.39, 3.17 [14:59:41] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.72, 3.08, 3.37 [15:01:38] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 16.27, 6.79, 3.30 [15:04:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.71, 3.79, 3.98 [15:06:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 3.69, 3.95, 4.02 [15:08:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.15, 3.72, 3.93 [15:10:33] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.72, 3.63, 3.51 [15:11:38] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 0.85, 3.20, 3.55 [15:12:41] RECOVERY - cp33 NTP time on cp33 is OK: NTP OK: Offset 0.0009094178677 secs [15:13:38] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.84, 2.41, 3.21 [15:14:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 5.02, 4.50, 4.17 [15:16:28] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.89, 3.96, 3.65 [15:17:16] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.20, 11.42, 9.19 [15:18:27] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 4.00, 3.96, 3.69 [15:19:12] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.72, 9.83, 8.88 [15:19:32] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 5.71, 3.79, 3.19 [15:20:25] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.35, 4.05, 3.75 [15:21:32] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 3.64, 3.64, 3.20 [15:22:24] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.26, 3.77, 3.68 [15:22:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.65, 3.86, 3.98 [15:23:32] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 2.99, 3.40, 3.17 [15:24:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 5.29, 4.18, 4.07 [15:26:11] PROBLEM - cp32 NTP time on cp32 is WARNING: NTP WARNING: Offset 0.389917016 secs [15:26:21] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.58, 4.15, 3.84 [15:26:53] PROBLEM - bast101 Puppet on bast101 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 24 minutes ago with 0 failures [15:26:59] PROBLEM - cp22 Puppet on cp22 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 13 minutes ago with 0 failures [15:27:00] PROBLEM - mw122 Puppet on mw122 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 20 minutes ago with 0 failures [15:27:04] PROBLEM - mon141 Puppet on mon141 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 3 minutes ago with 0 failures [15:27:10] PROBLEM - jobchron121 Puppet on jobchron121 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 10 minutes ago with 0 failures [15:27:11] PROBLEM - mail121 Puppet on mail121 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 15 minutes ago with 0 failures [15:27:11] PROBLEM - mw142 Puppet on mw142 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 25 minutes ago with 0 failures [15:27:13] PROBLEM - mw121 Puppet on mw121 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 14 minutes ago with 0 failures [15:27:17] PROBLEM - swiftac111 Puppet on swiftac111 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 4 minutes ago with 0 failures [15:27:30] PROBLEM - db101 Puppet on db101 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 6 minutes ago with 0 failures [15:27:30] PROBLEM - mem131 Puppet on mem131 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 3 minutes ago with 0 failures [15:27:31] PROBLEM - mw131 Puppet on mw131 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 15 minutes ago with 0 failures [15:27:32] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 3.75, 3.67, 3.34 [15:27:32] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 3.80, 4.28, 3.03 [15:27:34] PROBLEM - ns2 Puppet on ns2 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 9 minutes ago with 0 failures [15:27:35] PROBLEM - cp33 Puppet on cp33 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 1 minute ago with 0 failures [15:27:37] PROBLEM - test131 Puppet on test131 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 29 minutes ago with 0 failures [15:27:37] PROBLEM - graylog121 Puppet on graylog121 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 30 minutes ago with 0 failures [15:27:39] PROBLEM - mwtask141 Puppet on mwtask141 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 17 minutes ago with 0 failures [15:27:40] PROBLEM - cloud11 Puppet on cloud11 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 7 minutes ago with 0 failures [15:27:40] PROBLEM - cp23 Puppet on cp23 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 22 minutes ago with 0 failures [15:27:41] PROBLEM - cloud13 Puppet on cloud13 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 7 minutes ago with 0 failures [15:27:44] PROBLEM - ns1 Puppet on ns1 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 32 minutes ago with 0 failures [15:27:44] PROBLEM - swiftobject111 Puppet on swiftobject111 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 22 minutes ago with 0 failures [15:27:45] PROBLEM - matomo131 Puppet on matomo131 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 2 minutes ago with 0 failures [15:27:46] PROBLEM - mem101 Puppet on mem101 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 8 minutes ago with 0 failures [15:27:46] PROBLEM - mw141 Puppet on mw141 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 21 minutes ago with 0 failures [15:27:47] PROBLEM - puppet141 Puppet on puppet141 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [15:27:49] PROBLEM - cloud10 Puppet on cloud10 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 19 minutes ago with 0 failures [15:27:52] PROBLEM - swiftproxy111 Puppet on swiftproxy111 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 16 minutes ago with 0 failures [15:27:53] PROBLEM - db112 Puppet on db112 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 26 minutes ago with 0 failures [15:27:55] PROBLEM - cloud12 Puppet on cloud12 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 19 minutes ago with 0 failures [15:27:55] PROBLEM - swiftobject112 Puppet on swiftobject112 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 12 minutes ago with 0 failures [15:27:56] PROBLEM - db121 Puppet on db121 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 8 minutes ago with 0 failures [15:28:07] PROBLEM - prometheus131 Puppet on prometheus131 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 5 minutes ago with 0 failures [15:28:08] PROBLEM - mw132 Puppet on mw132 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 20 minutes ago with 0 failures [15:28:08] PROBLEM - phab121 Puppet on phab121 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 19 minutes ago with 0 failures [15:28:09] PROBLEM - es131 Puppet on es131 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 31 minutes ago with 0 failures [15:28:13] PROBLEM - db141 Puppet on db141 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 21 minutes ago with 0 failures [15:28:21] PROBLEM - db131 Puppet on db131 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 28 minutes ago with 0 failures [15:28:23] PROBLEM - bast121 Puppet on bast121 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 18 minutes ago with 0 failures [15:28:26] PROBLEM - cloud14 Puppet on cloud14 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 7 minutes ago with 0 failures [15:28:32] PROBLEM - ldap141 Puppet on ldap141 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 25 minutes ago with 0 failures [15:28:33] PROBLEM - es141 Puppet on es141 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 27 minutes ago with 0 failures [15:28:38] PROBLEM - swiftobject113 Puppet on swiftobject113 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 14 minutes ago with 0 failures [15:28:38] PROBLEM - reports121 Puppet on reports121 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 31 minutes ago with 0 failures [15:28:51] PROBLEM - swiftproxy131 Puppet on swiftproxy131 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 21 minutes ago with 0 failures [15:29:08] PROBLEM - swiftobject122 Puppet on swiftobject122 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 9 minutes ago with 0 failures [15:29:14] PROBLEM - swiftobject121 Puppet on swiftobject121 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 9 minutes ago with 0 failures [15:29:32] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.25, 3.68, 2.94 [15:29:47] RECOVERY - puppet141 Puppet on puppet141 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [15:29:50] PROBLEM - cp32 Puppet on cp32 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 22 minutes ago with 0 failures [15:31:32] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 2.59, 3.27, 3.27 [15:31:32] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.56, 2.85, 2.72 [15:32:16] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.01, 3.82, 3.85 [15:35:32] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 5.27, 4.06, 3.57 [15:36:11] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.62, 3.81, 3.39 [15:36:13] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.74, 4.44, 4.08 [15:37:32] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 3.32, 3.61, 3.45 [15:38:09] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.18, 3.98, 3.50 [15:39:32] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 5.54, 4.07, 3.62 [15:40:08] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 2.76, 3.53, 3.39 [15:41:32] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 2.93, 3.58, 3.50 [15:42:06] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.70, 3.28, 3.31 [15:42:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.18, 3.68, 3.97 [15:43:32] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 2.84, 3.24, 3.38 [15:44:11] RECOVERY - cp32 NTP time on cp32 is OK: NTP OK: Offset -0.01666632295 secs [15:46:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.81, 4.26, 4.11 [15:48:06] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.00, 3.79, 3.95 [15:48:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.32, 3.80, 3.96 [15:51:32] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 4.23, 3.77, 3.49 [15:52:04] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 5.14, 4.49, 4.19 [15:53:32] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 3.41, 3.61, 3.46 [15:54:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.01, 3.69, 3.83 [15:56:01] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.47, 3.81, 3.97 [15:57:32] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 3.09, 3.26, 3.35 [15:59:58] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.05, 3.82, 3.93 [16:01:56] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.01, 3.68, 3.88 [16:04:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.24, 3.45, 3.77 [16:06:36] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.63, 3.90, 3.50 [16:08:34] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.04, 3.55, 3.42 [16:10:33] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.32, 3.14, 3.28 [16:11:49] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.05, 3.59, 3.75 [16:13:48] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.42, 3.62, 3.74 [16:14:11] PROBLEM - cp32 NTP time on cp32 is WARNING: NTP WARNING: Offset -0.1215121448 secs [16:16:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.24, 3.63, 3.64 [16:18:23] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.66, 3.26, 3.24 [16:18:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.21, 3.43, 3.56 [16:19:43] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.91, 4.07, 3.87 [16:20:14] RECOVERY - widedata.org - LetsEncrypt on sslhost is OK: OK - Certificate 'widedata.org' will expire on Fri 24 Feb 2023 05:04:05 GMT +0000. [16:20:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.31, 3.65, 3.61 [16:22:09] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 4.67, 4.30, 3.65 [16:22:11] RECOVERY - cp32 NTP time on cp32 is OK: NTP OK: Offset -0.07215738297 secs [16:22:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.34, 3.61, 3.61 [16:23:41] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.53, 3.89, 3.84 [16:24:05] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 3.31, 3.85, 3.56 [16:27:58] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 2.62, 3.24, 3.38 [16:30:12] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.56, 3.04, 3.21 [16:31:42] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.11, 3.70, 3.71 [16:33:41] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.22, 3.54, 3.65 [16:34:52] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 3.04, 3.15, 3.39 [16:37:06] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.83, 8.82, 7.74 [16:37:41] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.77, 3.99, 3.79 [16:38:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.62, 3.38, 3.42 [16:39:06] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.12, 10.17, 8.35 [16:39:41] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.35, 3.73, 3.72 [16:40:52] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.94, 3.13, 3.32 [16:41:06] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.39, 10.49, 8.70 [16:43:06] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 10.04, 10.20, 8.81 [16:45:41] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.37, 3.83, 3.75 [16:48:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.79, 3.68, 3.49 [16:49:41] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.52, 3.87, 3.80 [16:49:51] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.19, 3.46, 3.17 [16:51:49] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.72, 3.47, 3.21 [16:52:09] PROBLEM - widedata.org - LetsEncrypt on sslhost is CRITICAL: connect to address widedata.org and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [16:53:47] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.74, 3.20, 3.14 [16:55:41] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 5.62, 4.41, 4.01 [16:57:12] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 3.99, 3.56, 3.35 [17:00:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.47, 3.85, 3.61 [17:01:04] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 3.12, 3.39, 3.34 [17:01:36] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.85, 3.58, 3.32 [17:01:47] PROBLEM - puppet141 Puppet on puppet141 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [17:02:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.98, 3.49, 3.50 [17:03:47] RECOVERY - puppet141 Puppet on puppet141 is OK: OK: Puppet is currently enabled, last run 8 seconds ago with 0 failures [17:07:30] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.40, 3.04, 3.19 [17:07:41] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.29, 3.75, 3.93 [17:08:35] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=joeyslikkwiki --no-updates --username-prefix=mh:joeyslikk /home/universalomega/ImportDump/joeyslikkwiki-20221214125006.xml (START) [17:08:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:08:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.16, 3.69, 3.59 [17:08:58] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=joeyslikkwiki --no-updates --username-prefix=mh:joeyslikk /home/universalomega/ImportDump/joeyslikkwiki-20221214125006.xml (END - exit=0) [17:08:59] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=joeyslikkwiki (START) [17:09:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:09:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:10:43] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=ruchiwiki --no-updates --username-prefix=mh:ruchi /home/universalomega/ImportDump/ruchiwiki-20221214170804.xml (START) [17:10:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:10:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.52, 3.46, 3.51 [17:12:26] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=joeyslikkwiki (END - exit=0) [17:12:27] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=joeyslikkwiki --active --update (END - exit=0) [17:12:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:12:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:13:47] PROBLEM - puppet141 Puppet on puppet141 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [17:14:13] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=ruchiwiki --no-updates --username-prefix=mh:ruchi /home/universalomega/ImportDump/ruchiwiki-20221214170804.xml (END - exit=0) [17:14:14] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=ruchiwiki (START) [17:14:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:14:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:15:41] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 5.79, 4.57, 4.17 [17:16:26] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=ruchiwiki (END - exit=0) [17:16:27] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=ruchiwiki --active --update (END - exit=0) [17:16:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:16:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:16:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 5.67, 4.00, 3.67 [17:18:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.36, 3.57, 3.55 [17:21:22] RECOVERY - widedata.org - LetsEncrypt on sslhost is OK: OK - Certificate 'widedata.org' will expire on Fri 24 Feb 2023 05:04:05 GMT +0000. [17:23:41] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.66, 3.49, 3.84 [17:24:52] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 3.14, 3.22, 3.39 [17:32:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.80, 3.91, 3.59 [17:33:22] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.57, 3.53, 3.11 [17:34:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.52, 3.72, 3.55 [17:35:41] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.20, 3.90, 3.82 [17:36:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.07, 4.09, 3.72 [17:37:22] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.37, 3.63, 3.26 [17:38:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.74, 3.69, 3.62 [17:39:22] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.96, 3.35, 3.20 [17:39:41] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.06, 3.66, 3.76 [17:39:47] RECOVERY - puppet141 Puppet on puppet141 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [17:42:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.45, 3.98, 3.75 [17:43:48] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 3.83, 3.46, 3.25 [17:44:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.53, 3.88, 3.74 [17:45:40] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.33, 4.06, 3.91 [17:45:44] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 2.69, 3.33, 3.23 [17:47:14] [02puppet] 07MacFan4000 opened pull request 03#3068: ssl-certificate: git pull first before attempting to push the public key - 13https://github.com/miraheze/puppet/pull/3068 [17:47:15] [url] Page not found · GitHub · GitHub | github.com [17:47:40] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.92, 3.74, 3.82 [17:51:41] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.27, 4.06, 3.95 [17:53:09] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.78, 3.48, 3.28 [17:55:07] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.56, 3.11, 3.17 [17:55:40] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.04, 3.58, 3.78 [17:55:45] [02puppet] 07Reception123 closed pull request 03#3068: ssl-certificate: git pull first before attempting to push the public key - 13https://github.com/miraheze/puppet/pull/3068 [17:55:45] [url] Page not found · GitHub · GitHub | github.com [17:55:47] [02miraheze/puppet] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/60598d9b5202...348162b666d6 [17:55:47] [url] Comparing 60598d9b5202...348162b666d6 · miraheze/puppet · GitHub | github.com [17:55:48] [02miraheze/puppet] 07MacFan4000 03348162b - ssl-certificate: git pull first before attempting to push the public key (#3068) [17:57:41] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 6.14, 4.09, 3.91 [17:59:25] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+1/-0/±1] 13https://github.com/miraheze/ssl/compare/d4e052211575...d56898ed6872 [17:59:26] [url] Comparing d4e052211575...d56898ed6872 · miraheze/ssl · GitHub | github.com [17:59:28] [02miraheze/ssl] 07MirahezeSSLBot 03d56898e - Bot: Add SSL cert for wiki.sukotuze.com [17:59:41] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.14, 3.72, 3.80 [18:00:18] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 3.98, 3.38, 3.23 [18:00:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.24, 3.59, 3.56 [18:01:42] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.58, 3.93, 3.86 [18:03:41] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.16, 3.60, 3.75 [18:04:10] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 3.14, 3.29, 3.23 [18:04:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.18, 3.66, 3.62 [18:05:41] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.06, 3.77, 3.79 [18:09:41] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.19, 3.64, 3.73 [18:15:41] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.31, 3.63, 3.67 [18:16:47] !log added reports::reports_write_key to private puppet [18:16:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:17:41] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.64, 3.51, 3.61 [18:20:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.69, 4.03, 3.69 [18:22:37] PROBLEM - widedata.org - LetsEncrypt on sslhost is CRITICAL: connect to address widedata.org and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [18:24:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.80, 3.96, 3.74 [18:25:32] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.44, 3.51, 3.33 [18:26:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.98, 4.43, 3.94 [18:27:30] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.30, 3.67, 3.40 [18:29:29] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 3.03, 3.39, 3.33 [18:31:30] PROBLEM - ping6 on ns1 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 282.60 ms [18:31:36] PROBLEM - ping6 on cp33 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 245.46 ms [18:34:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.50, 3.91, 3.96 [18:36:51] PROBLEM - ping6 on cp32 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 259.81 ms [18:38:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.61, 3.98, 3.96 [18:39:41] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.24, 3.62, 3.53 [18:41:41] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.20, 3.47, 3.49 [18:45:41] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.11, 3.82, 3.62 [18:47:41] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.42, 3.69, 3.60 [18:50:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.54, 3.87, 4.00 [18:54:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.38, 3.57, 3.82 [18:55:41] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.83, 3.10, 3.36 [18:56:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.52, 3.39, 3.72 [19:02:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.57, 3.85, 3.81 [19:06:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.03, 3.53, 3.69 [19:08:03] !log MariaDB [reports]> DROP TABLE ial; on db112 (and recreate with artisan migrate on reports121) [19:08:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:08:45] [02puppet] 07Universal-Omega closed pull request 03#3000: Upgrade TSPortal to v10 - 13https://github.com/miraheze/puppet/pull/3000 [19:08:46] [url] Page not found · GitHub · GitHub | github.com [19:08:47] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/puppet/compare/348162b666d6...b6de9cc04295 [19:08:48] [url] Comparing 348162b666d6...b6de9cc04295 · miraheze/puppet · GitHub | github.com [19:08:48] [02miraheze/puppet] 07Universal-Omega 03b6de9cc - Upgrade TSPortal to v10 (#3000) [19:08:50] [02miraheze/puppet] 07Universal-Omega deleted branch 03reports-v10 [19:08:52] [02puppet] 07Universal-Omega deleted branch 03reports-v10 - 13https://github.com/miraheze/puppet [19:08:53] [url] Page not found · GitHub · GitHub | github.com [19:14:38] RECOVERY - reports121 Puppet on reports121 is OK: OK: Puppet is currently enabled, last run 28 seconds ago with 0 failures [19:18:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.41, 3.77, 3.66 [19:20:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.00, 3.48, 3.57 [19:20:59] RECOVERY - widedata.org - LetsEncrypt on sslhost is OK: OK - Certificate 'widedata.org' will expire on Fri 24 Feb 2023 05:04:05 GMT +0000. [19:26:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.27, 3.94, 3.76 [19:27:54] !log add mediawiki::swift_temp_url_key to private puppet [19:28:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:31:04] !log add Temp-URL-Key to Swift account [19:31:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:31:35] [02puppet] 07Universal-Omega closed pull request 03#3054: mediawiki: add tempurl to PrivateSettings.php - 13https://github.com/miraheze/puppet/pull/3054 [19:31:36] [url] Page not found · GitHub · GitHub | github.com [19:31:38] [02puppet] 07Universal-Omega deleted branch 03swift-tempurl - 13https://github.com/miraheze/puppet [19:31:39] ... [19:31:39] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/puppet/compare/b6de9cc04295...8a400f591220 [19:31:40] [url] Comparing b6de9cc04295...8a400f591220 · miraheze/puppet · GitHub | github.com [19:31:40] [02miraheze/puppet] 07Universal-Omega 038a400f5 - mediawiki: add tempurl to PrivateSettings.php (#3054) [19:31:43] [02miraheze/puppet] 07Universal-Omega deleted branch 03swift-tempurl [19:34:47] PROBLEM - ping6 on cp32 is WARNING: PING WARNING - Packet loss = 0%, RTA = 177.40 ms [19:34:53] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03swift-tempurlkey [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/03a79941118c [19:34:56] [02miraheze/mw-config] 07Universal-Omega 0303a7994 - FileBackend: set `swiftTempUrlKey` [19:34:57] [02mw-config] 07Universal-Omega created branch 03swift-tempurlkey - 13https://github.com/miraheze/mw-config [19:34:57] [url] Page not found · GitHub · GitHub | github.com [19:34:58] [02mw-config] 07Universal-Omega opened pull request 03#5018: FileBackend: set `swiftTempUrlKey` - 13https://github.com/miraheze/mw-config/pull/5018 [19:34:58] [url] Page not found · GitHub · GitHub | github.com [19:36:01] miraheze/mw-config - Universal-Omega the build passed. [19:36:53] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.17, 3.82, 3.84 [19:38:47] RECOVERY - ping6 on cp32 is OK: PING OK - Packet loss = 0%, RTA = 114.95 ms [19:39:04] RECOVERY - mon141 Puppet on mon141 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:39:10] RECOVERY - jobchron121 Puppet on jobchron121 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:39:11] RECOVERY - cp32 Puppet on cp32 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:39:18] RECOVERY - swiftac111 Puppet on swiftac111 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:39:30] RECOVERY - db101 Puppet on db101 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:39:30] RECOVERY - mem131 Puppet on mem131 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:39:31] RECOVERY - mw131 Puppet on mw131 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:39:35] RECOVERY - ns2 Puppet on ns2 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:39:36] RECOVERY - cp33 Puppet on cp33 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:39:37] RECOVERY - test131 Puppet on test131 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:39:37] RECOVERY - graylog121 Puppet on graylog121 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:39:39] RECOVERY - mwtask141 Puppet on mwtask141 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:39:40] RECOVERY - cloud11 Puppet on cloud11 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:39:40] RECOVERY - cp23 Puppet on cp23 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:39:41] RECOVERY - cloud13 Puppet on cloud13 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:39:44] RECOVERY - swiftobject111 Puppet on swiftobject111 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:39:44] RECOVERY - ns1 Puppet on ns1 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:39:45] RECOVERY - matomo131 Puppet on matomo131 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:39:46] RECOVERY - mem101 Puppet on mem101 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:39:47] RECOVERY - mw141 Puppet on mw141 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:39:49] RECOVERY - cloud10 Puppet on cloud10 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:39:52] RECOVERY - swiftproxy111 Puppet on swiftproxy111 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:39:53] RECOVERY - db112 Puppet on db112 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:39:55] RECOVERY - cloud12 Puppet on cloud12 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:39:56] RECOVERY - swiftobject112 Puppet on swiftobject112 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [19:39:56] RECOVERY - db121 Puppet on db121 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:40:07] RECOVERY - prometheus131 Puppet on prometheus131 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:40:08] RECOVERY - mw132 Puppet on mw132 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [19:40:09] RECOVERY - phab121 Puppet on phab121 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:40:09] RECOVERY - es131 Puppet on es131 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:40:13] RECOVERY - db141 Puppet on db141 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:40:21] RECOVERY - db131 Puppet on db131 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:40:23] RECOVERY - bast121 Puppet on bast121 is OK: OK: Puppet is currently enabled, last run 14 seconds ago with 0 failures [19:40:26] RECOVERY - cloud14 Puppet on cloud14 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:40:32] RECOVERY - ldap141 Puppet on ldap141 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:40:33] RECOVERY - es141 Puppet on es141 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:40:35] RECOVERY - bast101 Puppet on bast101 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:40:37] RECOVERY - mw121 Puppet on mw121 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:40:39] RECOVERY - swiftobject113 Puppet on swiftobject113 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:40:41] RECOVERY - mw122 Puppet on mw122 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:40:51] RECOVERY - swiftproxy131 Puppet on swiftproxy131 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:40:59] RECOVERY - cp22 Puppet on cp22 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:41:08] RECOVERY - swiftobject122 Puppet on swiftobject122 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:41:11] RECOVERY - mw142 Puppet on mw142 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:41:11] RECOVERY - mail121 Puppet on mail121 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:41:14] RECOVERY - swiftobject121 Puppet on swiftobject121 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [19:42:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 5.75, 4.48, 4.06 [19:44:13] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.43, 3.61, 3.35 [19:46:12] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 5.96, 4.56, 3.74 [19:50:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 2.44, 3.41, 3.32 [19:52:10] PROBLEM - widedata.org - LetsEncrypt on sslhost is CRITICAL: connect to address widedata.org and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [19:53:00] PROBLEM - ping6 on cp32 is WARNING: PING WARNING - Packet loss = 0%, RTA = 143.96 ms [19:54:32] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 2.44, 3.06, 3.21 [19:56:02] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.99, 3.79, 3.82 [19:57:00] PROBLEM - ping6 on cp32 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 209.45 ms [19:57:01] [02mw-config] 07Universal-Omega closed pull request 03#5018: FileBackend: set `swiftTempUrlKey` - 13https://github.com/miraheze/mw-config/pull/5018 [19:57:02] [url] Page not found · GitHub · GitHub | github.com [19:57:03] [02miraheze/mw-config] 07Universal-Omega deleted branch 03swift-tempurlkey [19:57:06] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/821b37323466...61502e9325ff [19:57:07] [url] Comparing 821b37323466...61502e9325ff · miraheze/mw-config · GitHub | github.com [19:57:07] [02miraheze/mw-config] 07Universal-Omega 0361502e9 - FileBackend: set `swiftTempUrlKey` (#5018) [19:57:10] [02mw-config] 07Universal-Omega deleted branch 03swift-tempurlkey - 13https://github.com/miraheze/mw-config [19:57:11] ... [19:57:14] !log [universalomega@mwtask141] starting deploy of {'pull': 'config', 'config': True} to all [19:57:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:57:22] !log [@test131] starting deploy of {'config': True} to all [19:57:23] !log [@test131] finished deploy of {'config': True} to all - SUCCESS in 0s [19:57:24] !log [universalomega@mwtask141] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 9s [19:57:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:57:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:57:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:58:14] miraheze/mw-config - Universal-Omega the build passed. [20:02:45] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.23, 3.74, 3.94 [20:03:47] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.42, 3.85, 3.81 [20:06:16] RECOVERY - ping6 on ns1 is OK: PING OK - Packet loss = 0%, RTA = 110.89 ms [20:06:43] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.41, 4.12, 4.04 [20:07:39] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.98, 3.83, 3.81 [20:10:41] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.33, 3.84, 3.96 [20:12:40] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.53, 3.93, 3.97 [20:14:03] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 3.93, 3.48, 3.32 [20:14:40] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.51, 3.90, 3.96 [20:16:00] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 2.85, 3.22, 3.24 [20:16:39] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.19, 4.05, 4.01 [20:18:11] PROBLEM - wiki.ultravanilla.world - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.ultravanilla.world All nameservers failed to answer the query. [20:18:37] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.36, 3.86, 3.95 [20:19:26] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.64, 3.93, 3.74 [20:20:36] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.23, 4.28, 4.11 [20:21:26] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.72, 3.77, 3.70 [20:22:35] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.56, 3.62, 3.88 [20:23:27] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.60, 3.81, 3.71 [20:24:39] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.73, 2.29, 1.53 [20:26:32] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.47, 3.78, 3.87 [20:27:26] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.92, 3.82, 3.73 [20:28:31] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.78, 3.81, 3.87 [20:28:39] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.43, 2.80, 1.94 [20:28:57] PROBLEM - ping6 on cp32 is WARNING: PING WARNING - Packet loss = 0%, RTA = 166.29 ms [20:29:56] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.44, 2.81, 1.64 [20:30:30] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.27, 3.90, 3.89 [20:31:56] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.89, 2.45, 1.66 [20:32:56] RECOVERY - ping6 on cp32 is OK: PING OK - Packet loss = 0%, RTA = 119.11 ms [20:34:28] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.88, 3.98, 3.93 [20:37:26] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.57, 3.10, 3.39 [20:37:46] PROBLEM - ping6 on cp33 is WARNING: PING WARNING - Packet loss = 0%, RTA = 168.15 ms [20:43:26] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.02, 3.50, 3.45 [20:44:22] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 5.48, 4.27, 4.01 [20:47:26] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.48, 3.74, 3.58 [20:47:33] PROBLEM - wiki.ultravanilla.world - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.ultravanilla.world could not be found [20:51:56] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 3.38, 3.57, 3.26 [20:53:53] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 3.02, 3.29, 3.18 [20:54:01] RECOVERY - ping6 on cp33 is OK: PING OK - Packet loss = 0%, RTA = 113.91 ms [21:01:05] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/extensions/ManageWiki/maintenance/populateWikiSettings.php --wiki=famepediawiki --wgsetting=wmgWikibaseRepoDatabase --sourcelist=false --remove (END - exit=0) [21:01:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:01:26] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.34, 3.85, 3.71 [21:03:26] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.67, 3.68, 3.65 [21:03:46] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.63, 10.18, 8.49 [21:04:36] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 3.23, 3.42, 3.30 [21:05:46] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.49, 9.67, 8.51 [21:06:08] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.21, 3.74, 3.95 [21:10:25] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 3.10, 3.30, 3.29 [21:14:18] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.26, 3.64, 2.67 [21:15:26] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.61, 3.79, 3.64 [21:16:17] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.06, 2.80, 2.49 [21:16:54] PROBLEM - mw141 Current Load on mw141 is WARNING: WARNING - load average: 10.34, 9.90, 7.04 [21:18:01] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.42, 3.94, 3.90 [21:18:53] RECOVERY - mw141 Current Load on mw141 is OK: OK - load average: 6.92, 8.67, 6.91 [21:19:52] PROBLEM - wiki.seamly.net - reverse DNS on sslhost is WARNING: Timeout: The DNS operation timed out after 5.406246900558472 seconds [21:21:09] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 5.22, 4.75, 3.86 [21:22:26] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 5.08, 3.28, 2.36 [21:24:26] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 2.03, 2.74, 2.27 [21:28:56] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 2.68, 3.75, 3.81 [21:30:20] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.21, 12.10, 10.18 [21:30:55] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 16.34, 7.04, 3.43 [21:31:26] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.15, 3.86, 3.99 [21:32:19] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.60, 10.24, 9.72 [21:32:31] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*hiccupwiki* on mw*, test131, and mwtask141 [21:32:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:32:39] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='hiccupwiki'; [21:32:45] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='hiccupwiki'; [21:32:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:32:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:32:56] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='hiccupwiki'; [21:32:57] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 4.49, 3.73, 3.77 [21:33:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:33:03] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='hiccupwiki'; [21:33:09] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='hiccupwiki'; [21:33:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:33:15] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='hiccupwiki'; [21:33:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:33:23] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='hiccupwiki'; [21:33:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:33:26] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 6.04, 4.67, 4.27 [21:33:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:34:19] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.01, 9.14, 9.38 [21:34:57] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 2.77, 3.26, 3.59 [21:38:38] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.57, 2.96, 3.18 [21:39:26] [02puppet] 07MacFan4000 opened pull request 03#3069: ssl-certificate: expand/update renew option + update description for -p arg - 13https://github.com/miraheze/puppet/pull/3069 [21:39:26] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 9.84, 4.88, 2.98 [21:39:27] [url] Page not found · GitHub · GitHub | github.com [21:39:49] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=hiccupwiki --missing (START) [21:39:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:40:45] [02puppet] 07MacFan4000 synchronize pull request 03#3069: ssl-certificate: expand/update renew option + update description for -p arg - 13https://github.com/miraheze/puppet/pull/3069 [21:40:46] [url] Page not found · GitHub · GitHub | github.com [21:40:56] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 2.48, 3.01, 3.38 [21:41:26] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.59, 3.93, 2.87 [21:43:26] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.28, 3.03, 2.67 [21:43:48] [02puppet] 07MacFan4000 synchronize pull request 03#3069: ssl-certificate: expand/update renew option + update description for -p arg - 13https://github.com/miraheze/puppet/pull/3069 [21:43:49] [url] Page not found · GitHub · GitHub | github.com [21:45:27] MacFan4000: ping me when you want a review on that. [21:46:28] [02puppet] 07MacFan4000 synchronize pull request 03#3069: ssl-certificate: expand/update renew option + update description for -p arg - 13https://github.com/miraheze/puppet/pull/3069 [21:46:29] [url] Page not found · GitHub · GitHub | github.com [21:47:43] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.17, 3.67, 3.97 [21:48:22] CosmicAlpha: it's ready now (CI fixed) [21:49:24] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=hiccupwiki --missing (END - exit=0) [21:49:37] Looking MacFan4000 [21:49:42] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 3.95, 3.88, 4.02 [21:49:49] RECOVERY - wiki.seamly.net - reverse DNS on sslhost is OK: SSL OK - wiki.seamly.net reverse DNS resolves to cp22.miraheze.org - CNAME OK [21:50:21] I have another one coming as well that makes some slight changes to normal cert generation (Namely don't auto-add public keys for wildcard certs + catch non-zero exit statuses from certbot and exit the script if the generation failed (prevents from still adding to certs.yaml)) [21:50:57] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 3.63, 3.34, 3.29 [21:50:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:51:40] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.69, 3.87, 4.00 [21:52:21] MacFan4000: nice, thanks! I will want to test this first before merging probably, as I can't be certain about it. But it also doesn't break everything if the script temporarily breaks, so if you want me to merge and you do any follow-up fixes for it, I can do that also. [21:52:56] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 2.80, 3.18, 3.24 [21:58:08] sure, I can test it, though there isn't currently anything to test the full regeneration part with [21:59:23] I can at least test the normal renewal and pushing of public keys [21:59:36] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 3.69, 3.99, 4.01 [22:01:34] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.21, 3.67, 3.89 [22:05:00] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/61502e9325ff...ecec91c479cc [22:05:00] [url] Comparing 61502e9325ff...ecec91c479cc · miraheze/mw-config · GitHub | github.com [22:05:01] [02miraheze/mw-config] 07Universal-Omega 03ecec91c - T10085/T10094: set $wgDefaultUserOptions for various wikis [22:06:07] miraheze/mw-config - Universal-Omega the build passed. [22:07:26] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.79, 3.82, 3.96 [22:08:43] MacFan4000: yes there is two certs that still need fully regenerated I believe. [22:08:59] [02puppet] 07Universal-Omega closed pull request 03#3069: ssl-certificate: expand/update renew option + update description for -p arg - 13https://github.com/miraheze/puppet/pull/3069 [22:09:00] [url] Page not found · GitHub · GitHub | github.com [22:09:01] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/8a400f591220...e3e09b028a21 [22:09:02] [url] Comparing 8a400f591220...e3e09b028a21 · miraheze/puppet · GitHub | github.com [22:09:02] [02miraheze/puppet] 07MacFan4000 03e3e09b0 - ssl-certificate: expand/update renew option + update description for -p arg (#3069) [22:09:26] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.57, 4.03, 4.01 [22:10:29] !log [@mwtask141] starting deploy of {'config': True} to all [22:10:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:10:36] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 7s [22:10:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:11:26] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.58, 3.85, 3.95 [22:12:35] [02puppet] 07MacFan4000 opened pull request 03#3070: ssl-certificates: for generation handle certbot errors and don't auto… - 13https://github.com/miraheze/puppet/pull/3070 [22:12:36] [url] Page not found · GitHub · GitHub | github.com [22:12:57] [02puppet] 07MacFan4000 closed pull request 03#3070: ssl-certificates: for generation handle certbot errors and don't auto… - 13https://github.com/miraheze/puppet/pull/3070 [22:12:58] ... [22:13:26] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.05, 4.07, 4.03 [22:14:32] * MacFan4000 waits for puppet to run [22:17:25] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.17, 3.77, 3.73 [22:19:24] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.00, 3.52, 3.64 [22:25:23] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.97, 3.91, 3.75 [22:25:29] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/501f4a9b0ab3...03deb87283a1 [22:25:29] [url] Comparing 501f4a9b0ab3...03deb87283a1 · miraheze/MirahezeMagic · GitHub | github.com [22:25:32] [02miraheze/MirahezeMagic] 07Universal-Omega 0303deb87 - Add debug logs in rename wiki hook [22:26:57] !log [@test131] starting deploy of {'config': True} to all [22:26:58] !log [@test131] finished deploy of {'config': True} to all - SUCCESS in 0s [22:27:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:27:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:27:23] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.01, 3.55, 3.64 [22:27:24] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/03deb87283a1...cef793298741 [22:27:24] [url] Comparing 03deb87283a1...cef793298741 · miraheze/MirahezeMagic · GitHub | github.com [22:27:25] [02miraheze/MirahezeMagic] 07Universal-Omega 03cef7932 - Use `$newContainer` variable [22:27:26] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.18, 3.72, 3.98 [22:29:27] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.62, 3.86, 3.98 [22:29:44] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_38 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/678cf12f0560...6ad8ac138fcc [22:29:45] [url] Comparing 678cf12f0560...6ad8ac138fcc · miraheze/mediawiki · GitHub | github.com [22:29:47] [02miraheze/mediawiki] 07Universal-Omega 036ad8ac1 - Update MirahezeMagic [22:30:47] !log [universalomega@mwtask141] starting deploy of {'world': True} to all [22:30:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:33:09] !log [universalomega@mwtask141] DEPLOY ABORTED: Non-Zero Exit Code in prep, see output. [22:33:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:33:18] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_38 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/6ad8ac138fcc...e77f2f0590d6 [22:33:19] [url] Comparing 6ad8ac138fcc...e77f2f0590d6 · miraheze/mediawiki · GitHub | github.com [22:33:21] [02miraheze/mediawiki] 07Universal-Omega 03e77f2f0 - Update SocialProfile [22:33:31] !log [universalomega@mwtask141] starting deploy of {'world': True} to all [22:33:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:35:26] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.16, 3.63, 3.84 [22:35:39] miraheze/MirahezeMagic - Universal-Omega the build passed. [22:38:29] !log [universalomega@mwtask141] finished deploy of {'world': True} to all - SUCCESS in 297s [22:38:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:41:18] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/d56898ed6872...4e813e0236b7 [22:41:19] [url] Comparing d56898ed6872...4e813e0236b7 · miraheze/ssl · GitHub | github.com [22:41:20] [02miraheze/ssl] 07MirahezeSSLBot 034e813e0 - Bot: Update SSL cert for en.pornwiki.org [22:41:26] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 5.14, 3.96, 3.84 [22:41:42] well, that worked flawlessly [22:45:23] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.35, 4.20, 3.80 [22:47:05] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/4e813e0236b7...88dddc0395a5 [22:47:06] [url] Comparing 4e813e0236b7...88dddc0395a5 · miraheze/ssl · GitHub | github.com [22:47:06] [02miraheze/ssl] 07MirahezeSSLBot 0388dddc0 - Bot: Update SSL cert for miraheze.wiki [22:47:26] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.54, 3.84, 3.82 [22:49:22] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 4.92, 3.59, 3.00 [22:49:23] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.36, 3.85, 3.75 [22:51:23] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.86, 4.07, 3.84 [22:51:26] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 6.08, 4.23, 3.92 [22:52:20] [02puppet] 07MacFan4000 opened pull request 03#3071: fix detecting of new private keys during renewal - 13https://github.com/miraheze/puppet/pull/3071 [22:52:21] [url] Page not found · GitHub · GitHub | github.com [22:52:29] CosmicAlpha: ^^ [22:52:48] also the miraheze.wiki private key will need to be updated manually due to that mistake [22:53:28] I had put the detection in for wildcards but completely forgot to do that for normal certs [22:55:12] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 3.94, 4.00, 3.42 [22:57:26] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.56, 3.52, 3.74 [22:57:45] or, I guess after that PR is merged I can rerun the renewal with --no-use-key [22:57:47] PROBLEM - cp33 Puppet on cp33 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[nginx] [22:58:07] yup, thats known ^ [22:59:04] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 4.40, 3.78, 3.43 [22:59:20] PROBLEM - test131 Puppet on test131 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[nginx] [22:59:27] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.43, 4.08, 3.92 [23:01:01] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 3.76, 3.77, 3.47 [23:01:05] PROBLEM - cp23 Puppet on cp23 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[nginx] [23:01:24] !log rename ravenuniversewiki to teamplatowiki [23:01:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:02:12] !log sudo -u www-data php /srv/mediawiki/w/extensions/CreateWiki/maintenance/setContainersAccess.php --wiki=teamplatowiki [23:02:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:04:56] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 3.05, 3.33, 3.36 [23:05:50] PROBLEM - mw142 Puppet on mw142 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[nginx] [23:08:56] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 2.82, 3.58, 3.52 [23:08:57] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.10, 10.38, 8.06 [23:09:36] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/ecec91c479cc...40f30b6e10be [23:09:37] [url] Comparing ecec91c479cc...40f30b6e10be · miraheze/mw-config · GitHub | github.com [23:09:37] [02miraheze/mw-config] 07Universal-Omega 0340f30b6 - Set MirahezeMagic channel to debug [23:10:20] !log [@mwtask141] starting deploy of {'config': True} to all [23:10:21] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.23, 3.95, 2.69 [23:10:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:10:31] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 11s [23:10:36] miraheze/mw-config - Universal-Omega the build passed. [23:10:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:10:45] PROBLEM - mw141 Puppet on mw141 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[nginx] [23:11:19] PROBLEM - phab121 Puppet on phab121 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[nginx] [23:11:26] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.64, 3.87, 3.88 [23:11:40] What happened to nginx? [23:12:11] [02puppet] 07Universal-Omega closed pull request 03#3071: fix detecting of new private keys during renewal - 13https://github.com/miraheze/puppet/pull/3071 [23:12:11] [url] Page not found · GitHub · GitHub | github.com [23:12:12] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/e3e09b028a21...4a9e75eb7793 [23:12:12] [url] Comparing e3e09b028a21...4a9e75eb7793 · miraheze/puppet · GitHub | github.com [23:12:14] [02miraheze/puppet] 07MacFan4000 034a9e75e - fix detecting of new private keys during renewal (#3071) [23:12:56] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.93, 11.24, 8.92 [23:12:56] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 3.18, 3.13, 3.34 [23:14:13] PROBLEM - mwtask141 Puppet on mwtask141 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[nginx] [23:14:28] [02puppet] 07paladox synchronize pull request 03#3067: swift: use DumbRedirectHandler - 13https://github.com/miraheze/puppet/pull/3067 [23:14:29] [url] Page not found · GitHub · GitHub | github.com [23:14:31] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/486b60fa6890...4025ec19bcb7 [23:14:32] [url] Comparing 486b60fa6890...4025ec19bcb7 · miraheze/puppet · GitHub | github.com [23:14:32] [02miraheze/puppet] 07paladox 034025ec1 - Update rewrite.py [23:15:20] PROBLEM - cp22 Puppet on cp22 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[nginx] [23:15:26] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.57, 3.77, 3.80 [23:15:53] PROBLEM - mw131 Puppet on mw131 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[nginx] [23:16:36] PROBLEM - cp32 Puppet on cp32 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[nginx] [23:16:55] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.10, 9.39, 8.75 [23:17:24] [02puppet] 07paladox synchronize pull request 03#3067: swift: use DumbRedirectHandler - 13https://github.com/miraheze/puppet/pull/3067 [23:17:24] [url] Page not found · GitHub · GitHub | github.com [23:17:26] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.41, 3.23, 3.59 [23:17:27] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/4025ec19bcb7...d21ce06656b9 [23:17:27] [url] Comparing 4025ec19bcb7...d21ce06656b9 · miraheze/puppet · GitHub | github.com [23:17:30] [02miraheze/puppet] 07paladox 03d21ce06 - Update rewrite.py [23:17:47] PROBLEM - mw121 Puppet on mw121 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[nginx] [23:18:04] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.84, 3.25, 3.31 [23:19:23] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.13, 3.18, 3.87 [23:19:53] [02puppet] 07paladox synchronize pull request 03#3067: swift: use DumbRedirectHandler - 13https://github.com/miraheze/puppet/pull/3067 [23:19:54] [url] Page not found · GitHub · GitHub | github.com [23:19:55] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/d21ce06656b9...38f57e10c159 [23:19:56] [url] Comparing d21ce06656b9...38f57e10c159 · miraheze/puppet · GitHub | github.com [23:19:56] [02miraheze/puppet] 07paladox 0338f57e1 - Update rewrite.py [23:19:58] RECOVERY - widedata.org - LetsEncrypt on sslhost is OK: OK - Certificate 'widedata.org' will expire on Fri 24 Feb 2023 05:04:05 GMT +0000. [23:21:10] CosmicAlpha: I need to redo the last renewal when puppet runs - it failed to update the private key [23:21:39] [02puppet] 07paladox closed pull request 03#3067: swift: use DumbRedirectHandler - 13https://github.com/miraheze/puppet/pull/3067 [23:21:39] [url] Page not found · GitHub · GitHub | github.com [23:21:41] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/4a9e75eb7793...9f31f9a617a4 [23:21:42] [url] Comparing 4a9e75eb7793...9f31f9a617a4 · miraheze/puppet · GitHub | github.com [23:21:43] [02miraheze/puppet] 07paladox 039f31f9a - swift: use DumbRedirectHandler (#3067) [23:21:45] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-2 [23:21:46] [02puppet] 07paladox deleted branch 03paladox-patch-2 - 13https://github.com/miraheze/puppet [23:21:47] [url] Page not found · GitHub · GitHub | github.com [23:22:28] [02miraheze/puppet] 07paladox pushed 0326 commits to 03paladox-patch-1 [+19/-36/±26] 13https://github.com/miraheze/puppet/compare/b6302605b6e0...0cb3f6c4f914 [23:22:29] [url] Comparing b6302605b6e0...0cb3f6c4f914 · miraheze/puppet · GitHub | github.com [23:22:30] [02miraheze/puppet] 07paladox 03f54dcff - Testing... [23:22:33] [02miraheze/puppet] 07paladox 038b6b01f - Update role.rb [23:22:35] [02miraheze/puppet] 07paladox 036d06fb5 - Update hiera.yaml [23:22:38] [02miraheze/puppet] ... and 23 more commits. [23:22:41] [02puppet] 07paladox synchronize pull request 03#3065: Add support for role based hiera - 13https://github.com/miraheze/puppet/pull/3065 [23:22:42] [url] Page not found · GitHub · GitHub | github.com [23:23:26] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.50, 2.89, 3.32 [23:23:46] !log [universalomega@mwtask141] starting deploy of {'pull': 'config', 'config': True} to all [23:23:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:23:55] !log [universalomega@mwtask141] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 8s [23:24:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:27:23] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 6.11, 4.00, 3.87 [23:27:26] !log [@test131] starting deploy of {'config': True} to all [23:27:27] !log [@test131] finished deploy of {'config': True} to all - SUCCESS in 0s [23:27:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:27:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:27:44] RECOVERY - cp33 Puppet on cp33 is OK: OK: Puppet is currently enabled, last run 28 seconds ago with 0 failures [23:28:56] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 7.72, 4.63, 3.57 [23:29:04] RECOVERY - cp23 Puppet on cp23 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [23:29:19] RECOVERY - test131 Puppet on test131 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [23:29:27] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 7.94, 4.82, 3.91 [23:30:40] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.53, 3.40, 2.81 [23:30:55] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 4.86, 3.97, 2.59 [23:32:39] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.39, 2.91, 2.70 [23:32:54] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 2.99, 3.49, 2.57 [23:33:48] RECOVERY - mw142 Puppet on mw142 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [23:34:31] PROBLEM - cp32 NTP time on cp32 is WARNING: NTP WARNING: Offset 0.1957547665 secs [23:34:54] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 1.87, 2.79, 2.42 [23:37:15] !log rename knowledgedancewiki to redkrayolawiki [23:37:49] !log sudo -u www-data php /srv/mediawiki/w/extensions/CreateWiki/maintenance/setContainersAccess.php --wiki=redkrayolawiki [23:38:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:38:43] RECOVERY - mw141 Puppet on mw141 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [23:38:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:39:19] RECOVERY - phab121 Puppet on phab121 is OK: OK: Puppet is currently enabled, last run 26 seconds ago with 0 failures [23:39:26] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.92, 3.67, 3.81 [23:39:26] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.45, 3.97, 2.98 [23:39:51] PROBLEM - mw122 Puppet on mw122 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[nginx] [23:40:23] RECOVERY - mwtask141 Puppet on mwtask141 is OK: OK: Puppet is currently enabled, last run 48 seconds ago with 0 failures [23:40:32] PROBLEM - mw132 Puppet on mw132 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[nginx] [23:40:56] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 2.69, 3.60, 3.74 [23:40:57] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/88dddc0395a5...6ebd09e0a2b0 [23:40:57] [url] Comparing 88dddc0395a5...6ebd09e0a2b0 · miraheze/ssl · GitHub | github.com [23:41:00] [02miraheze/ssl] 07MirahezeSSLBot 036ebd09e - Bot: Update SSL cert for miraheze.wiki [23:41:26] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.98, 3.99, 3.12 [23:42:33] RECOVERY - cp32 Puppet on cp32 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [23:43:26] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.98, 3.20, 2.93 [23:43:29] RECOVERY - cp22 Puppet on cp22 is OK: OK: Puppet is currently enabled, last run 16 seconds ago with 0 failures [23:43:36] [02puppet] 07MacFan4000 opened pull request 03#3072: Ugh - 13https://github.com/miraheze/puppet/pull/3072 [23:43:37] [url] Page not found · GitHub · GitHub | github.com [23:43:43] RECOVERY - mw121 Puppet on mw121 is OK: OK: Puppet is currently enabled, last run 5 seconds ago with 0 failures [23:43:59] CosmicAlpha: ^^ [23:44:37] [02puppet] 07Universal-Omega closed pull request 03#3072: Ugh - 13https://github.com/miraheze/puppet/pull/3072 [23:44:37] [url] Page not found · GitHub · GitHub | github.com [23:44:38] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/9f31f9a617a4...43f04c66a90b [23:44:39] [url] Comparing 9f31f9a617a4...43f04c66a90b · miraheze/puppet · GitHub | github.com [23:44:40] [02miraheze/puppet] 07MacFan4000 0343f04c6 - ssl-certificate: fix spelling (#3072) [23:45:26] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.13, 3.67, 3.77 [23:47:15] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=insideearthwiki --no-updates --username-prefix=mh:insideearth /home/universalomega/ImportDump/insideearthwiki-20221214231101.xml (START) [23:47:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:47:26] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.75, 3.93, 3.88 [23:49:22] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=insideearthwiki --no-updates --username-prefix=mh:insideearth /home/universalomega/ImportDump/insideearthwiki-20221214231101.xml (END - exit=0) [23:49:23] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.17, 3.53, 3.95 [23:49:23] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=insideearthwiki (START) [23:49:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:49:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:49:57] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=insideearthwiki (END - exit=0) [23:49:58] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=insideearthwiki --active --update (END - exit=0) [23:50:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:50:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:51:23] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.20, 3.86, 4.02 [23:53:23] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.24, 3.55, 3.88 [23:55:35] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.62, 2.78, 1.89 [23:57:23] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.62, 4.21, 4.08 [23:57:35] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.10, 3.99, 2.44 [23:59:04] PROBLEM - cp23 Puppet on cp23 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[nginx] [23:59:35] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.00, 3.53, 2.46