[00:03:26] !log [agent@db151] SQL finished backing up on db151 [00:03:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:03:34] PROBLEM - cp27 HTTP 4xx/5xx ERROR Rate on cp27 is CRITICAL: CRITICAL - NGINX Error Rate is 67% [00:04:07] PROBLEM - cp26 HTTP 4xx/5xx ERROR Rate on cp26 is WARNING: WARNING - NGINX Error Rate is 50% [00:04:23] RECOVERY - cp37 Disk Space on cp37 is OK: DISK OK - free space: / 17812MiB (20% inode=98%); [00:05:34] PROBLEM - cp27 HTTP 4xx/5xx ERROR Rate on cp27 is WARNING: WARNING - NGINX Error Rate is 50% [00:05:40] RECOVERY - cp36 Disk Space on cp36 is OK: DISK OK - free space: / 17343MiB (19% inode=98%); [00:06:07] PROBLEM - cp26 HTTP 4xx/5xx ERROR Rate on cp26 is CRITICAL: CRITICAL - NGINX Error Rate is 60% [00:08:07] PROBLEM - cp26 HTTP 4xx/5xx ERROR Rate on cp26 is WARNING: WARNING - NGINX Error Rate is 44% [00:12:07] RECOVERY - cp26 HTTP 4xx/5xx ERROR Rate on cp26 is OK: OK - NGINX Error Rate is 29% [00:19:34] RECOVERY - cp27 HTTP 4xx/5xx ERROR Rate on cp27 is OK: OK - NGINX Error Rate is 37% [00:24:23] PROBLEM - apocrypha.wiki - LetsEncrypt on sslhost is CRITICAL: Name or service not knownHTTP CRITICAL - Unable to open TCP socket [00:28:23] [02miraheze/mw-config] 07AgentIsai pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/2ea13767a235...f802b058eb5f [00:28:24] [02miraheze/mw-config] 07AgentIsai 03f802b05 - Disable password policies for now [00:29:03] !log [agent@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all [00:29:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:29:11] !log [agent@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 8s [00:29:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:29:20] miraheze/mw-config - AgentIsai the build passed. [00:29:34] PROBLEM - cp27 HTTP 4xx/5xx ERROR Rate on cp27 is WARNING: WARNING - NGINX Error Rate is 40% [00:37:26] !log [agent@db161] SQL finished backing up on db161 [00:37:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:41:21] [02miraheze/mw-config] 07AgentIsai pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/f802b058eb5f...2e1e2e774115 [00:41:24] [02miraheze/mw-config] 07AgentIsai 032e1e2e7 - Test: Populate wgLocalDatabases with both deleted wikis as well [00:41:28] !log [agent@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/eval.php --wiki=metawiki (END - exit=2) [00:41:30] !log [agent@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all [00:41:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:41:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:41:37] !log [agent@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 7s [00:41:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:42:14] miraheze/mw-config - AgentIsai the build passed. [00:53:07] RECOVERY - apocrypha.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'apocrypha.wiki' will expire on Fri 01 Mar 2024 12:06:59 PM GMT +0000. [00:53:15] !log [@test151] starting deploy of {'config': True} to test151 [00:53:16] !log [@test151] finished deploy of {'config': True} to test151 - SUCCESS in 0s [00:53:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:53:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:57:34] RECOVERY - cp27 HTTP 4xx/5xx ERROR Rate on cp27 is OK: OK - NGINX Error Rate is 38% [01:07:34] PROBLEM - cp27 HTTP 4xx/5xx ERROR Rate on cp27 is WARNING: WARNING - NGINX Error Rate is 40% [01:09:34] RECOVERY - cp27 HTTP 4xx/5xx ERROR Rate on cp27 is OK: OK - NGINX Error Rate is 39% [01:32:37] [02miraheze/mw-config] 07AgentIsai pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/2e1e2e774115...12cdd7f699d1 [01:32:39] [02miraheze/mw-config] 07AgentIsai 0312cdd7f - Re-enable password policy [01:33:30] miraheze/mw-config - AgentIsai the build passed. [01:51:58] PROBLEM - cp27 HTTP 4xx/5xx ERROR Rate on cp27 is WARNING: WARNING - NGINX Error Rate is 41% [01:52:41] [02miraheze/mw-config] 07AgentIsai pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/12cdd7f699d1...3f35a03bed0a [01:52:44] [02miraheze/mw-config] 07AgentIsai 033f35a03 - Add isDeleted function [01:53:32] !log [@test151] starting deploy of {'config': True} to test151 [01:53:33] miraheze/mw-config - AgentIsai the build has errored. [01:53:33] !log [@test151] finished deploy of {'config': True} to test151 - SUCCESS in 0s [01:53:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:53:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:54:50] [02miraheze/mw-config] 07AgentIsai pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/3f35a03bed0a...fb53eeb81868 [01:54:52] [02miraheze/mw-config] 07AgentIsai 03fb53eeb - Remove unused $wgConf [01:55:49] miraheze/mw-config - AgentIsai the build passed. [01:57:18] [02miraheze/mw-config] 07AgentIsai pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/fb53eeb81868...0ba3a25ea2b9 [01:57:19] [02miraheze/mw-config] 07AgentIsai 030ba3a25 - Add $wi->deleted [01:57:28] !log [agent@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all [01:57:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:57:36] !log [agent@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 8s [01:57:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:58:19] miraheze/mw-config - AgentIsai the build passed. [02:19:34] RECOVERY - cp27 HTTP 4xx/5xx ERROR Rate on cp27 is OK: OK - NGINX Error Rate is 39% [02:23:32] !log [@test151] starting deploy of {'config': True} to test151 [02:23:33] !log [@test151] finished deploy of {'config': True} to test151 - SUCCESS in 0s [02:23:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:23:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:41:35] PROBLEM - cp27 HTTP 4xx/5xx ERROR Rate on cp27 is WARNING: WARNING - NGINX Error Rate is 40% [02:53:14] PROBLEM - apocrypha.wiki - LetsEncrypt on sslhost is CRITICAL: Name or service not knownHTTP CRITICAL - Unable to open TCP socket [02:59:06] [02miraheze/ErrorPages] 07AgentIsai pushed 031 commit to 03master [+12/-1/±4] 13https://github.com/miraheze/ErrorPages/compare/b5710b2ce36e...a4cd71417ac4 [02:59:07] [02miraheze/ErrorPages] 07AgentIsai 03a4cd714 - Merge ErrorPages main core from WikiTide [02:59:49] miraheze/ErrorPages - AgentIsai the build has errored. [03:01:19] [02miraheze/puppet] 07AgentIsai pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/9ba27b17a2b4...519afad4523b [03:01:21] [02miraheze/puppet] 07AgentIsai 03519afad - Add updated ErrorPages [03:02:18] !log [agent@mwtask181] starting deploy of {'pull': 'errorpages', 'errorpages': True} to all [03:02:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:02:26] !log [agent@mwtask181] finished deploy of {'pull': 'errorpages', 'errorpages': True} to all - SUCCESS in 7s [03:02:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:03:03] [02miraheze/mw-config] 07AgentIsai pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/0ba3a25ea2b9...5694377c3eb2 [03:03:06] [02miraheze/mw-config] 07AgentIsai 035694377 - Use DeletedWiki.php for $wi->deleted [03:03:20] !log [agent@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all [03:03:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:03:28] !log [agent@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 7s [03:03:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:03:31] PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.andreijiroh.uk.eu.org All nameservers failed to answer the query. [03:04:05] miraheze/mw-config - AgentIsai the build passed. [03:04:27] PROBLEM - mw151 HTTPS on mw151 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/2 500 [03:04:34] PROBLEM - mw182 HTTPS on mw182 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/2 500 [03:04:58] PROBLEM - cp51 HTTPS on cp51 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/2 500 [03:05:00] PROBLEM - mwtask181 HTTPS on mwtask181 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/2 500 [03:05:00] PROBLEM - mw152 HTTPS on mw152 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/2 500 [03:05:25] PROBLEM - cp26 HTTPS on cp26 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/2 500 [03:05:28] PROBLEM - mw171 HTTPS on mw171 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/2 500 [03:05:29] PROBLEM - cp37 HTTPS on cp37 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/2 500 [03:05:33] PROBLEM - cp41 HTTPS on cp41 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/2 500 [03:05:34] PROBLEM - mw181 HTTPS on mw181 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/2 500 [03:05:54] PROBLEM - mw172 HTTPS on mw172 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/2 500 [03:05:57] PROBLEM - mw161 HTTPS on mw161 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/2 500 [03:06:03] PROBLEM - cp36 HTTPS on cp36 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/2 500 [03:06:22] PROBLEM - cp27 HTTPS on cp27 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/2 500 [03:06:28] PROBLEM - mw162 HTTPS on mw162 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/2 500 [03:13:18] [02miraheze/ErrorPages] 07AgentIsai pushed 031 commit to 03master [+0/-0/±5] 13https://github.com/miraheze/ErrorPages/compare/a4cd71417ac4...3df810e317c9 [03:13:20] [02miraheze/ErrorPages] 07AgentIsai 033df810e - Fix CI and update databaseMaintenance [03:13:31] !log [agent@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all [03:13:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:13:39] !log [agent@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 8s [03:13:40] !log [agent@mwtask181] starting deploy of {'pull': 'errorpages', 'errorpages': True} to all [03:13:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:13:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:13:46] !log [agent@mwtask181] finished deploy of {'pull': 'errorpages', 'errorpages': True} to all - SUCCESS in 6s [03:13:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:13:54] RECOVERY - mw172 HTTPS on mw172 is OK: HTTP OK: HTTP/2 404 - Status line output matched "HTTP/2 404" - 285 bytes in 0.063 second response time [03:13:57] RECOVERY - mw161 HTTPS on mw161 is OK: HTTP OK: HTTP/2 404 - Status line output matched "HTTP/2 404" - 285 bytes in 0.060 second response time [03:14:03] RECOVERY - cp36 HTTPS on cp36 is OK: HTTP OK: HTTP/2 404 - Status line output matched "HTTP/2 404" - 3594 bytes in 0.039 second response time [03:14:10] miraheze/ErrorPages - AgentIsai the build passed. [03:14:22] RECOVERY - cp27 HTTPS on cp27 is OK: HTTP OK: HTTP/2 404 - Status line output matched "HTTP/2 404" - 3570 bytes in 0.905 second response time [03:14:27] RECOVERY - mw151 HTTPS on mw151 is OK: HTTP OK: HTTP/2 404 - Status line output matched "HTTP/2 404" - 285 bytes in 0.062 second response time [03:14:28] RECOVERY - mw162 HTTPS on mw162 is OK: HTTP OK: HTTP/2 404 - Status line output matched "HTTP/2 404" - 285 bytes in 0.067 second response time [03:14:34] RECOVERY - mw182 HTTPS on mw182 is OK: HTTP OK: HTTP/2 404 - Status line output matched "HTTP/2 404" - 285 bytes in 0.040 second response time [03:14:58] RECOVERY - cp51 HTTPS on cp51 is OK: HTTP OK: HTTP/2 404 - Status line output matched "HTTP/2 404" - 3571 bytes in 1.116 second response time [03:15:00] RECOVERY - mwtask181 HTTPS on mwtask181 is OK: HTTP OK: HTTP/2 404 - Status line output matched "HTTP/2 404" - 285 bytes in 0.036 second response time [03:15:00] RECOVERY - mw152 HTTPS on mw152 is OK: HTTP OK: HTTP/2 404 - Status line output matched "HTTP/2 404" - 285 bytes in 0.063 second response time [03:15:25] RECOVERY - cp26 HTTPS on cp26 is OK: HTTP OK: HTTP/2 404 - Status line output matched "HTTP/2 404" - 3570 bytes in 0.889 second response time [03:15:28] RECOVERY - mw171 HTTPS on mw171 is OK: HTTP OK: HTTP/2 404 - Status line output matched "HTTP/2 404" - 285 bytes in 0.060 second response time [03:15:29] RECOVERY - cp37 HTTPS on cp37 is OK: HTTP OK: HTTP/2 404 - Status line output matched "HTTP/2 404" - 3593 bytes in 0.069 second response time [03:15:32] RECOVERY - cp41 HTTPS on cp41 is OK: HTTP OK: HTTP/2 404 - Status line output matched "HTTP/2 404" - 3593 bytes in 0.811 second response time [03:15:34] RECOVERY - mw181 HTTPS on mw181 is OK: HTTP OK: HTTP/2 404 - Status line output matched "HTTP/2 404" - 285 bytes in 0.037 second response time [03:21:58] RECOVERY - apocrypha.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'apocrypha.wiki' will expire on Fri 01 Mar 2024 12:06:59 PM GMT +0000. [03:23:34] RECOVERY - cp27 HTTP 4xx/5xx ERROR Rate on cp27 is OK: OK - NGINX Error Rate is 38% [03:23:39] !log [@test151] starting deploy of {'config': True} to test151 [03:23:40] !log [@test151] finished deploy of {'config': True} to test151 - SUCCESS in 0s [03:23:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:23:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:28:48] !log [agent@mwtask181] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.json /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/extensions/SemanticMediaWiki/maintenance/setupStore.php (START) [03:28:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:28:56] !log [agent@mwtask181] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.json /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/extensions/SemanticMediaWiki/maintenance/setupStore.php (END - exit=2) [03:28:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:29:58] [02miraheze/mw-config] 07AgentIsai pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/5694377c3eb2...b33f34452387 [03:30:00] [02miraheze/mw-config] 07AgentIsai 03b33f344 - Ensure $deleted is not dymanic [03:30:05] !log [agent@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all [03:30:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:30:13] !log [agent@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 7s [03:30:14] !log [agent@mwtask181] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.json /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/extensions/SemanticMediaWiki/maintenance/setupStore.php (START) [03:30:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:30:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:30:23] !log [agent@mwtask181] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.json /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/extensions/SemanticMediaWiki/maintenance/setupStore.php (END - exit=2) [03:30:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:30:32] !log [agent@mwtask181] sudo -u www-data /usr/local/bin/foreachwikiindblist /home/agent/SemanticMediaWiki.json /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/extensions/SemanticMediaWiki/maintenance/setupStore.php (START) [03:30:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:30:58] miraheze/mw-config - AgentIsai the build passed. [03:32:41] !log [agent@mwtask181] sudo -u www-data /usr/local/bin/foreachwikiindblist /home/agent/SemanticMediaWiki.json /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/extensions/SemanticMediaWiki/maintenance/setupStore.php (END - exit=0) [03:32:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:33:19] RECOVERY - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.andreijiroh.uk.eu.org reverse DNS resolves to cp36.wikitide.net - CNAME OK [03:37:31] !log [agent@mwtask181] starting deploy of {'files': '../mediawiki/1.41/extensions/SemanticMediaWiki/.smw.json'} to all [03:37:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:37:38] !log [agent@mwtask181] finished deploy of {'files': '../mediawiki/1.41/extensions/SemanticMediaWiki/.smw.json'} to all - SUCCESS in 6s [03:37:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:41:19] PROBLEM - mw162 Puppet on mw162 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 2 minutes ago with 2 failures. Failed resources (up to 3 shown): Exec[git_pull_femiwiki-deploy-1.40],Exec[git_pull_femiwiki-deploy-1.41] [03:41:33] PROBLEM - mw161 Puppet on mw161 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_femiwiki-deploy-1.40] [03:53:14] PROBLEM - apocrypha.wiki - LetsEncrypt on sslhost is CRITICAL: Name or service not knownHTTP CRITICAL - Unable to open TCP socket [03:53:42] !log [@test151] starting deploy of {'config': True} to test151 [03:53:43] !log [@test151] finished deploy of {'config': True} to test151 - SUCCESS in 0s [03:53:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:53:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:07:19] RECOVERY - mw162 Puppet on mw162 is OK: OK: Puppet is currently enabled, last run 30 seconds ago with 0 failures [04:09:40] RECOVERY - mw161 Puppet on mw161 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [04:19:16] PROBLEM - mw171 Puppet on mw171 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 3 minutes ago with 2 failures. Failed resources (up to 3 shown): Exec[git_pull_femiwiki-deploy-1.40],Exec[git_pull_femiwiki-deploy-1.41] [04:21:58] RECOVERY - apocrypha.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'apocrypha.wiki' will expire on Fri 01 Mar 2024 12:06:59 PM GMT +0000. [04:39:18] PROBLEM - jobchron171 Puppet on jobchron171 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_JobRunner] [04:41:19] PROBLEM - mw162 Puppet on mw162 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 3 minutes ago with 2 failures. Failed resources (up to 3 shown): Exec[git_pull_femiwiki-deploy-1.40],Exec[git_pull_femiwiki-deploy-1.41] [04:47:16] RECOVERY - mw171 Puppet on mw171 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [05:07:19] RECOVERY - mw162 Puppet on mw162 is OK: OK: Puppet is currently enabled, last run 4 seconds ago with 0 failures [05:09:15] RECOVERY - jobchron171 Puppet on jobchron171 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [05:23:14] PROBLEM - apocrypha.wiki - LetsEncrypt on sslhost is CRITICAL: Name or service not knownHTTP CRITICAL - Unable to open TCP socket [05:51:58] RECOVERY - apocrypha.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'apocrypha.wiki' will expire on Fri 01 Mar 2024 12:06:59 PM GMT +0000. [05:55:34] PROBLEM - cp27 HTTP 4xx/5xx ERROR Rate on cp27 is WARNING: WARNING - NGINX Error Rate is 40% [06:01:23] !log [reception@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importDump.php --wiki=deadmau5wiki --no-updates --username-prefix=wikia:deadmau5 /home/reception/ImportDump/deadmau5wiki-20240206020803.xml (START) [06:01:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:06:35] !log [reception@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importDump.php --wiki=deadmau5wiki --no-updates --username-prefix=wikia:deadmau5 /home/reception/ImportDump/deadmau5wiki-20240206020803.xml (END - exit=0) [06:06:36] !log [reception@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/rebuildall.php --wiki=deadmau5wiki (START) [06:06:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:06:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:07:48] !log [reception@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/rebuildall.php --wiki=deadmau5wiki (END - exit=0) [06:07:49] !log [reception@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/initSiteStats.php --wiki=deadmau5wiki --active --update (END - exit=0) [06:07:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:07:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:11:34] RECOVERY - cp27 HTTP 4xx/5xx ERROR Rate on cp27 is OK: OK - NGINX Error Rate is 39% [06:25:34] PROBLEM - cp27 HTTP 4xx/5xx ERROR Rate on cp27 is WARNING: WARNING - NGINX Error Rate is 40% [06:29:35] RECOVERY - cp27 HTTP 4xx/5xx ERROR Rate on cp27 is OK: OK - NGINX Error Rate is 39% [06:33:34] PROBLEM - cp27 HTTP 4xx/5xx ERROR Rate on cp27 is WARNING: WARNING - NGINX Error Rate is 40% [06:39:34] RECOVERY - cp27 HTTP 4xx/5xx ERROR Rate on cp27 is OK: OK - NGINX Error Rate is 39% [06:53:14] PROBLEM - apocrypha.wiki - LetsEncrypt on sslhost is CRITICAL: Name or service not knownHTTP CRITICAL - Unable to open TCP socket [07:03:49] PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.andreijiroh.uk.eu.org All nameservers failed to answer the query. [07:21:58] RECOVERY - apocrypha.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'apocrypha.wiki' will expire on Fri 01 Mar 2024 12:06:59 PM GMT +0000. [07:33:36] RECOVERY - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.andreijiroh.uk.eu.org reverse DNS resolves to cp36.wikitide.net - CNAME OK [07:43:34] PROBLEM - cp27 HTTP 4xx/5xx ERROR Rate on cp27 is WARNING: WARNING - NGINX Error Rate is 40% [07:53:14] PROBLEM - apocrypha.wiki - LetsEncrypt on sslhost is CRITICAL: Name or service not knownHTTP CRITICAL - Unable to open TCP socket [07:55:34] RECOVERY - cp27 HTTP 4xx/5xx ERROR Rate on cp27 is OK: OK - NGINX Error Rate is 39% [08:07:34] PROBLEM - cp27 HTTP 4xx/5xx ERROR Rate on cp27 is WARNING: WARNING - NGINX Error Rate is 40% [08:11:33] PROBLEM - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query line.pm. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [08:51:14] RECOVERY - apocrypha.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'apocrypha.wiki' will expire on Fri 01 Mar 2024 12:06:59 PM GMT +0000. [09:09:20] RECOVERY - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is OK: SSL OK - wiki.mahdiruiz.line.pm reverse DNS resolves to cp37.wikitide.net - CNAME OK [09:23:14] PROBLEM - apocrypha.wiki - LetsEncrypt on sslhost is CRITICAL: Name or service not knownHTTP CRITICAL - Unable to open TCP socket [09:51:58] RECOVERY - apocrypha.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'apocrypha.wiki' will expire on Fri 01 Mar 2024 12:06:59 PM GMT +0000. [10:34:50] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-15 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/a1a4b916a465 [10:34:53] [02miraheze/puppet] 07paladox 03a1a4b91 - Remove MediaWiki 1.40 [10:34:54] [02puppet] 07paladox created branch 03paladox-patch-15 - 13https://github.com/miraheze/puppet [10:34:55] [02puppet] 07paladox opened pull request 03#3744: Remove MediaWiki 1.40 - 13https://github.com/miraheze/puppet/pull/3744 [10:35:11] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-15 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/a1a4b916a465...da7b39a8c421 [10:35:12] [02miraheze/puppet] 07paladox 03da7b39a - Update test151.yaml [10:35:13] [02puppet] 07paladox synchronize pull request 03#3744: Remove MediaWiki 1.40 - 13https://github.com/miraheze/puppet/pull/3744 [10:35:21] [02puppet] 07paladox closed pull request 03#3740: Fix rebuildVersionCache not supporting 1.41 - 13https://github.com/miraheze/puppet/pull/3740 [10:35:22] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-14 [10:35:24] [02puppet] 07paladox deleted branch 03paladox-patch-14 - 13https://github.com/miraheze/puppet [10:37:25] [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-5 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/c94919040690 [10:37:27] [02miraheze/mw-config] 07paladox 03c949190 - Disable RatePage Temorarily [10:37:28] [02mw-config] 07paladox created branch 03paladox-patch-5 - 13https://github.com/miraheze/mw-config [10:37:29] [02mw-config] 07paladox opened pull request 03#5463: Disable RatePage Temorarily - 13https://github.com/miraheze/mw-config/pull/5463 [10:37:39] [02mw-config] 07paladox closed pull request 03#5463: Disable RatePage Temorarily - 13https://github.com/miraheze/mw-config/pull/5463 [10:37:42] [02miraheze/mw-config] 07paladox deleted branch 03paladox-patch-5 [10:37:44] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/b33f34452387...f8ea8bf2151f [10:37:47] [02miraheze/mw-config] 07paladox 03f8ea8bf - Disable RatePage Temorarily (#5463) [10:37:49] [02mw-config] 07paladox deleted branch 03paladox-patch-5 - 13https://github.com/miraheze/mw-config [10:38:00] !log [paladox@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all [10:38:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:38:08] !log [paladox@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 8s [10:38:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:38:24] miraheze/mw-config - paladox the build passed. [10:38:42] miraheze/mw-config - paladox the build passed. [10:51:34] RECOVERY - cp27 HTTP 4xx/5xx ERROR Rate on cp27 is OK: OK - NGINX Error Rate is 38% [10:53:10] !log [@test151] starting deploy of {'config': True} to test151 [10:53:11] !log [@test151] finished deploy of {'config': True} to test151 - SUCCESS in 0s [10:53:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:53:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:55:41] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/f8ea8bf2151f...832849792c01 [10:55:43] !log [paladox@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all [10:55:43] [02miraheze/mw-config] 07paladox 038328497 - Remove s1 from wgCreateWikiDatabaseClustersInactive [10:55:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:55:51] !log [paladox@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 7s [10:55:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:56:37] miraheze/mw-config - paladox the build passed. [10:57:09] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/832849792c01...21f04502924c [10:57:10] !log [paladox@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all [10:57:11] [02miraheze/mw-config] 07paladox 0321f0450 - Remove db162 (s1) temporarily from Database.php [10:57:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:57:17] !log [paladox@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 7s [10:57:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:57:34] !log [paladox@mwtask181] starting deploy of {'config': True} to all [10:57:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:57:41] !log [paladox@mwtask181] finished deploy of {'config': True} to all - SUCCESS in 6s [10:57:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:58:02] miraheze/mw-config - paladox the build passed. [11:03:59] PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.andreijiroh.uk.eu.org All nameservers failed to answer the query. [11:06:40] [02miraheze/mw-config] 07AgentIsai pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/21f04502924c...5c1e332f2db5 [11:06:43] [02miraheze/mw-config] 07AgentIsai 035c1e332 - Disable AuthorProtect extension globally [11:06:58] !log [agent@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all [11:07:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [11:07:05] !log [agent@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 7s [11:07:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [11:07:39] miraheze/mw-config - AgentIsai the build passed. [11:23:08] !log [@test151] starting deploy of {'config': True} to test151 [11:23:09] !log [@test151] finished deploy of {'config': True} to test151 - SUCCESS in 0s [11:23:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [11:23:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [11:33:46] RECOVERY - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.andreijiroh.uk.eu.org reverse DNS resolves to cp37.wikitide.net - CNAME OK [12:38:27] PROBLEM - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query line.pm. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [13:07:20] RECOVERY - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is OK: SSL OK - wiki.mahdiruiz.line.pm reverse DNS resolves to cp36.wikitide.net - CNAME OK [13:11:40] PROBLEM - cp36 Disk Space on cp36 is WARNING: DISK WARNING - free space: / 9702MiB (10% inode=98%); [13:27:44] PROBLEM - kirisame-kissaten.cf - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for kirisame-kissaten.cf could not be found [14:08:23] PROBLEM - cp37 Disk Space on cp37 is WARNING: DISK WARNING - free space: / 9705MiB (10% inode=98%); [15:46:03] [02miraheze/RequestSSL] 07redbluegreenhat pushed 031 commit to 03dependabot/composer/mediawiki/mediawiki-phan-config-0.14.0 [+0/-0/±1] 13https://github.com/miraheze/RequestSSL/compare/df44123f5fc2...ac9d10424971 [15:46:04] [02miraheze/RequestSSL] 07redbluegreenhat 03ac9d104 - Update RequestSSLQueuePager.php [15:46:06] [02RequestSSL] 07redbluegreenhat synchronize pull request 03#31: Update mediawiki/mediawiki-phan-config requirement from 0.13.0 to 0.14.0 - 13https://github.com/miraheze/RequestSSL/pull/31 [15:47:14] [02miraheze/RequestSSL] 07redbluegreenhat pushed 031 commit to 03dependabot/composer/mediawiki/mediawiki-phan-config-0.14.0 [+0/-0/±1] 13https://github.com/miraheze/RequestSSL/compare/ac9d10424971...55ba1a81f08d [15:47:16] [02miraheze/RequestSSL] 07redbluegreenhat 0355ba1a8 - Update RequestSSLViewer.php [15:47:19] [02RequestSSL] 07redbluegreenhat synchronize pull request 03#31: Update mediawiki/mediawiki-phan-config requirement from 0.13.0 to 0.14.0 - 13https://github.com/miraheze/RequestSSL/pull/31 [15:50:20] miraheze/RequestSSL - redbluegreenhat the build has errored. [15:53:14] PROBLEM - apocrypha.wiki - LetsEncrypt on sslhost is CRITICAL: Name or service not knownHTTP CRITICAL - Unable to open TCP socket [16:01:23] [02miraheze/RequestSSL] 07redbluegreenhat pushed 031 commit to 03dependabot/composer/mediawiki/mediawiki-phan-config-0.14.0 [+0/-0/±1] 13https://github.com/miraheze/RequestSSL/compare/55ba1a81f08d...648bad1c46ca [16:01:25] [02miraheze/RequestSSL] 07redbluegreenhat 03648bad1 - Update RequestSSLViewer.php [16:01:26] [02RequestSSL] 07redbluegreenhat synchronize pull request 03#31: Update mediawiki/mediawiki-phan-config requirement from 0.13.0 to 0.14.0 - 13https://github.com/miraheze/RequestSSL/pull/31 [16:04:28] miraheze/RequestSSL - redbluegreenhat the build has errored. [16:10:28] [02miraheze/RequestSSL] 07redbluegreenhat pushed 031 commit to 03dependabot/composer/mediawiki/mediawiki-phan-config-0.14.0 [+0/-0/±1] 13https://github.com/miraheze/RequestSSL/compare/648bad1c46ca...6a995b4b90ad [16:10:31] [02miraheze/RequestSSL] 07redbluegreenhat 036a995b4 - Update RequestSSLViewer.php [16:10:33] [02RequestSSL] 07redbluegreenhat synchronize pull request 03#31: Update mediawiki/mediawiki-phan-config requirement from 0.13.0 to 0.14.0 - 13https://github.com/miraheze/RequestSSL/pull/31 [16:12:15] [02miraheze/RequestSSL] 07github-actions[bot] pushed 031 commit to 03dependabot/composer/mediawiki/mediawiki-phan-config-0.14.0 [+0/-0/±1] 13https://github.com/miraheze/RequestSSL/compare/6a995b4b90ad...1ea7be2c2364 [16:12:17] [02miraheze/RequestSSL] 07github-actions 031ea7be2 - CI: lint code to MediaWiki standards [16:12:20] [02RequestSSL] 07github-actions[bot] synchronize pull request 03#31: Update mediawiki/mediawiki-phan-config requirement from 0.13.0 to 0.14.0 - 13https://github.com/miraheze/RequestSSL/pull/31 [16:17:09] miraheze/RequestSSL - redbluegreenhat the build passed. [16:21:34] PROBLEM - cp27 HTTP 4xx/5xx ERROR Rate on cp27 is WARNING: WARNING - NGINX Error Rate is 40% [16:38:34] PROBLEM - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query line.pm. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [16:51:14] RECOVERY - apocrypha.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'apocrypha.wiki' will expire on Fri 01 Mar 2024 12:06:59 PM GMT +0000. [17:03:18] PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.andreijiroh.uk.eu.org All nameservers failed to answer the query. [17:07:27] RECOVERY - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is OK: SSL OK - wiki.mahdiruiz.line.pm reverse DNS resolves to cp37.wikitide.net - CNAME OK [17:33:10] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/5c1e332f2db5...69886c75cbd4 [17:33:12] [02miraheze/mw-config] 07Universal-Omega 0369886c7 - Set wgGlobalNewFilesDatabase [17:34:01] [02GlobalNewFiles] 07Universal-Omega closed pull request 03#49: Remove CreateWiki dependency - 13https://github.com/miraheze/GlobalNewFiles/pull/49 [17:34:02] [02miraheze/GlobalNewFiles] 07Universal-Omega pushed 031 commit to 03master [+0/-1/±6] 13https://github.com/miraheze/GlobalNewFiles/compare/c951955ae080...c473664fffa9 [17:34:05] [02miraheze/GlobalNewFiles] 07Universal-Omega 03c473664 - Remove CreateWiki dependency (#49) [17:34:06] [02miraheze/GlobalNewFiles] 07Universal-Omega deleted branch 03remove-CreateWiki [17:34:09] [02GlobalNewFiles] 07Universal-Omega deleted branch 03remove-CreateWiki - 13https://github.com/miraheze/GlobalNewFiles [17:34:10] miraheze/mw-config - Universal-Omega the build passed. [17:34:24] [02GlobalNewFiles] 07Universal-Omega closed pull request 03#51: Update mediawiki/mediawiki-phan-config requirement from 0.13.0 to 0.14.0 - 13https://github.com/miraheze/GlobalNewFiles/pull/51 [17:34:25] [02miraheze/GlobalNewFiles] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/GlobalNewFiles/compare/c473664fffa9...ea451998459a [17:34:27] [02miraheze/GlobalNewFiles] 07dependabot[bot] 03ea45199 - Update mediawiki/mediawiki-phan-config requirement from 0.13.0 to 0.14.0 (#51) [17:34:29] [02miraheze/GlobalNewFiles] 07Universal-Omega deleted branch 03dependabot/composer/mediawiki/mediawiki-phan-config-0.14.0 [17:34:31] [02GlobalNewFiles] 07Universal-Omega deleted branch 03dependabot/composer/mediawiki/mediawiki-phan-config-0.14.0 - 13https://github.com/miraheze/GlobalNewFiles [17:34:44] [02GlobalNewFiles] 07dependabot[bot] edited pull request 03#50: Update mediawiki/mediawiki-codesniffer requirement from 42.0.0 to 43.0.0 - 13https://github.com/miraheze/GlobalNewFiles/pull/50 [17:35:05] [02GlobalNewFiles] 07dependabot[bot] edited pull request 03#50: Update mediawiki/mediawiki-codesniffer requirement from 42.0.0 to 43.0.0 - 13https://github.com/miraheze/GlobalNewFiles/pull/50 [17:35:07] [02miraheze/GlobalNewFiles] 07dependabot[bot] pushed 031 commit to 03dependabot/composer/mediawiki/mediawiki-codesniffer-43.0.0 [+0/-0/±1] 13https://github.com/miraheze/GlobalNewFiles/compare/ef525515df61...3af359b33752 [17:35:09] [02miraheze/GlobalNewFiles] 07dependabot[bot] 033af359b - Update mediawiki/mediawiki-codesniffer requirement from 42.0.0 to 43.0.0 [17:35:11] [02GlobalNewFiles] 07dependabot[bot] synchronize pull request 03#50: Update mediawiki/mediawiki-codesniffer requirement from 42.0.0 to 43.0.0 - 13https://github.com/miraheze/GlobalNewFiles/pull/50 [17:35:13] [02GlobalNewFiles] 07dependabot[bot] edited pull request 03#50: Update mediawiki/mediawiki-codesniffer requirement from 42.0.0 to 43.0.0 - 13https://github.com/miraheze/GlobalNewFiles/pull/50 [17:35:21] [02GlobalNewFiles] 07dependabot[bot] edited pull request 03#50: Update mediawiki/mediawiki-codesniffer requirement from 42.0.0 to 43.0.0 - 13https://github.com/miraheze/GlobalNewFiles/pull/50 [17:37:02] miraheze/GlobalNewFiles - dependabot[bot] the build has errored. [17:38:36] miraheze/GlobalNewFiles - Universal-Omega the build passed. [17:44:54] [02miraheze/mw-config] 07AgentIsai pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/69886c75cbd4...d62f5dff2a8a [17:44:55] [02miraheze/mw-config] 07AgentIsai 03d62f5df - Remove outdated migration variables and add new pagelinks table migration [17:45:31] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/519afad4523b...15d7f00e7f34 [17:45:33] [02miraheze/puppet] 07Universal-Omega 0315d7f00 - mwscript: support wikibeta databases [17:45:52] !log [agent@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all [17:45:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:45:55] miraheze/mw-config - AgentIsai the build passed. [17:46:00] !log [agent@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 8s [17:46:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:46:50] miraheze/puppet - Universal-Omega the build passed. [17:53:13] !log [@test151] starting deploy of {'config': True} to test151 [17:53:14] !log [@test151] finished deploy of {'config': True} to test151 - SUCCESS in 0s [17:53:14] PROBLEM - apocrypha.wiki - LetsEncrypt on sslhost is CRITICAL: Name or service not knownHTTP CRITICAL - Unable to open TCP socket [17:53:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:53:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:08:23] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03deleted-combi [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/7f589822be07 [18:08:25] [02miraheze/mw-config] 07Universal-Omega 037f58982 - Make deleted a combi list [18:08:28] [02mw-config] 07Universal-Omega created branch 03deleted-combi - 13https://github.com/miraheze/mw-config [18:08:30] [02mw-config] 07Universal-Omega opened pull request 03#5464: Make deleted a combi list - 13https://github.com/miraheze/mw-config/pull/5464 [18:08:57] [02miraheze/mw-config] 07github-actions[bot] pushed 031 commit to 03deleted-combi [+0/-0/±2] 13https://github.com/miraheze/mw-config/compare/7f589822be07...ffe8e4ffd684 [18:09:00] [02miraheze/mw-config] 07github-actions 03ffe8e4f - CI: lint code to MediaWiki standards [18:09:01] [02mw-config] 07github-actions[bot] synchronize pull request 03#5464: Make deleted a combi list - 13https://github.com/miraheze/mw-config/pull/5464 [18:09:39] miraheze/mw-config - Universal-Omega the build passed. [18:11:47] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03cwdeleted [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/7ed1a01742ee [18:11:49] [02miraheze/mw-config] 07Universal-Omega 037ed1a01 - Add $cwDeleted, remove $wi::isDeleted [18:11:50] [02mw-config] 07Universal-Omega created branch 03cwdeleted - 13https://github.com/miraheze/mw-config [18:11:51] [02mw-config] 07Universal-Omega opened pull request 03#5465: Add $cwDeleted, remove $wi::isDeleted - 13https://github.com/miraheze/mw-config/pull/5465 [18:12:32] [02miraheze/mw-config] 07github-actions[bot] pushed 031 commit to 03cwdeleted [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/7ed1a01742ee...b8e9e7402bb0 [18:12:34] [02miraheze/mw-config] 07github-actions 03b8e9e74 - CI: lint code to MediaWiki standards [18:12:37] [02mw-config] 07github-actions[bot] synchronize pull request 03#5465: Add $cwDeleted, remove $wi::isDeleted - 13https://github.com/miraheze/mw-config/pull/5465 [18:13:05] miraheze/mw-config - Universal-Omega the build passed. [18:13:36] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03cwdeleted [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/b8e9e7402bb0...35446371f1cf [18:13:38] [02miraheze/mw-config] 07Universal-Omega 033544637 - Use $cwDeleted [18:13:40] [02mw-config] 07Universal-Omega synchronize pull request 03#5465: Add $cwDeleted, remove $wi::isDeleted - 13https://github.com/miraheze/mw-config/pull/5465 [18:14:28] [02mw-config] 07Universal-Omega labeled pull request 03#5465: Add $cwDeleted, remove $wi::isDeleted - 13https://github.com/miraheze/mw-config/pull/5465 [18:16:07] miraheze/mw-config - Universal-Omega the build passed. [18:19:35] [02mw-config] 07AgentIsai closed pull request 03#5465: Add $cwDeleted, remove $wi::isDeleted - 13https://github.com/miraheze/mw-config/pull/5465 [18:19:37] [02miraheze/mw-config] 07AgentIsai pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/mw-config/compare/d62f5dff2a8a...8b81ef3352f4 [18:19:40] [02miraheze/mw-config] 07Universal-Omega 038b81ef3 - Add $cwDeleted, remove $wi::isDeleted (#5465) [18:19:42] [02miraheze/mw-config] 07AgentIsai deleted branch 03cwdeleted [18:19:45] [02mw-config] 07AgentIsai deleted branch 03cwdeleted - 13https://github.com/miraheze/mw-config [18:20:13] !log [agent@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all [18:20:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:20:21] !log [agent@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 7s [18:20:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:20:35] [Grafana] !sre FIRING: The mediawiki job queue has more than 2500 unclaimed jobs https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [18:20:36] miraheze/mw-config - AgentIsai the build passed. [18:20:59] !log [agent@mwtask181] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.json /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/extensions/MirahezeMagic/maintenance/resetWikiCaches.php (START) [18:21:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:21:03] !log [agent@mwtask181] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.json /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/extensions/MirahezeMagic/maintenance/resetWikiCaches.php (END - exit=2) [18:21:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:21:40] !log [agent@mwtask181] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.json /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/extensions/MirahezeMagic/maintenance/resetWikiCaches.php (START) [18:21:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:21:58] RECOVERY - apocrypha.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'apocrypha.wiki' will expire on Fri 01 Mar 2024 12:06:59 PM GMT +0000. [18:23:30] !log [@test151] starting deploy of {'config': True} to test151 [18:23:31] !log [@test151] finished deploy of {'config': True} to test151 - SUCCESS in 0s [18:23:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:23:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:32:08] [02CreateWiki] 07redbluegreenhat opened pull request 03#467: T11798: Remove usage of upsert - 13https://github.com/miraheze/CreateWiki/pull/467 [18:33:34] RECOVERY - cp27 HTTP 4xx/5xx ERROR Rate on cp27 is OK: OK - NGINX Error Rate is 39% [18:37:42] [02CreateWiki] 07AgentIsai closed pull request 03#467: T11798: Remove usage of upsert - 13https://github.com/miraheze/CreateWiki/pull/467 [18:37:43] [02miraheze/CreateWiki] 07AgentIsai pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/4e9a22658f89...e17fe99e305e [18:37:46] [02miraheze/CreateWiki] 07redbluegreenhat 03e17fe99 - T11798: Remove usage of upsert (#467) [18:38:39] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03fix [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/commit/b274d7d35b03 [18:38:42] [02miraheze/MirahezeMagic] 07Universal-Omega 03b274d7d - Fix "Implicit conversion from float 0.02 to int loses precision" [18:38:45] [02MirahezeMagic] 07Universal-Omega created branch 03fix - 13https://github.com/miraheze/MirahezeMagic [18:38:45] !log [agent@test151] starting deploy of {'versions': '1.42', 'upgrade_extensions': 'CreateWiki'} to test151 [18:38:47] !log [agent@test151] finished deploy of {'versions': '1.42', 'upgrade_extensions': 'CreateWiki'} to test151 - SUCCESS in 1s [18:38:47] [02MirahezeMagic] 07Universal-Omega opened pull request 03#461: Fix "Implicit conversion from float 0.02 to int loses precision" - 13https://github.com/miraheze/MirahezeMagic/pull/461 [18:38:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:38:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:38:53] !log [agent@test151] starting deploy of {'versions': '1.41', 'upgrade_extensions': 'CreateWiki'} to test151 [18:38:54] !log [agent@test151] DEPLOY ABORTED: Non-Zero Exit Code in prep, see output. [18:38:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:38:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:39:04] miraheze/CreateWiki - redbluegreenhat the build passed. [18:40:15] [02MirahezeMagic] 07Universal-Omega commented on pull request 03#456: Fix "Implicit conversion from float 0.02 to int loses precision in" - 13https://github.com/miraheze/MirahezeMagic/pull/456#issuecomment-1930543144 [18:42:57] [02miraheze/CreateWiki] 07redbluegreenhat pushed 031 commit to 03redbluegreenhat-patch-1 [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/commit/2504a88e3723 [18:42:58] [02miraheze/CreateWiki] 07redbluegreenhat 032504a88 - Update WikiRequest.php [18:43:01] [02CreateWiki] 07redbluegreenhat created branch 03redbluegreenhat-patch-1 - 13https://github.com/miraheze/CreateWiki [18:43:04] [02CreateWiki] 07redbluegreenhat opened pull request 03#468: Update WikiRequest.php - 13https://github.com/miraheze/CreateWiki/pull/468 [18:43:08] [02CreateWiki] 07redbluegreenhat closed pull request 03#468: Update WikiRequest.php - 13https://github.com/miraheze/CreateWiki/pull/468 [18:43:10] [02miraheze/CreateWiki] 07redbluegreenhat pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/e17fe99e305e...685f069907f5 [18:43:12] [02miraheze/CreateWiki] 07redbluegreenhat 03685f069 - Update WikiRequest.php (#468) [18:43:15] [02miraheze/CreateWiki] 07redbluegreenhat deleted branch 03redbluegreenhat-patch-1 [18:43:18] [02CreateWiki] 07redbluegreenhat deleted branch 03redbluegreenhat-patch-1 - 13https://github.com/miraheze/CreateWiki [18:44:52]