[00:01:44] RECOVERY - db182 Puppet on db182 is OK: OK: Puppet is currently enabled, last run 52 seconds ago with 0 failures [00:02:59] RECOVERY - cp27 Puppet on cp27 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:03:29] PROBLEM - cp26 HTTP 4xx/5xx ERROR Rate on cp26 is CRITICAL: CRITICAL - NGINX Error Rate is 100% [00:03:51] RECOVERY - test151 Puppet on test151 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:05:10] PROBLEM - cp27 HTTP 4xx/5xx ERROR Rate on cp27 is WARNING: WARNING - NGINX Error Rate is 40% [00:05:42] RECOVERY - cp41 Puppet on cp41 is OK: OK: Puppet is currently enabled, last run 29 seconds ago with 0 failures [00:07:09] RECOVERY - cp27 HTTP 4xx/5xx ERROR Rate on cp27 is OK: OK - NGINX Error Rate is 38% [00:07:22] RECOVERY - ldap171 Puppet on ldap171 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:07:37] RECOVERY - phorge171 Puppet on phorge171 is OK: OK: Puppet is currently enabled, last run 4 seconds ago with 0 failures [00:08:11] RECOVERY - mw161 Puppet on mw161 is OK: OK: Puppet is currently enabled, last run 20 seconds ago with 0 failures [00:08:12] RECOVERY - mw162 Puppet on mw162 is OK: OK: Puppet is currently enabled, last run 46 seconds ago with 0 failures [00:08:27] RECOVERY - jobchron171 Puppet on jobchron171 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:09:32] RECOVERY - cloud18 Puppet on cloud18 is OK: OK: Puppet is currently enabled, last run 11 seconds ago with 0 failures [00:09:44] RECOVERY - os162 Puppet on os162 is OK: OK: Puppet is currently enabled, last run 21 seconds ago with 0 failures [00:10:36] [02miraheze/phabricator-extensions] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/phabricator-extensions/compare/7a0620b70302...76478d4a721e [00:10:39] [02miraheze/phabricator-extensions] 07Universal-Omega 0376478d4 - Phabricator -> Phorge [00:11:25] [02miraheze/phabricator-extensions] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/phabricator-extensions/compare/76478d4a721e...12b71e66d183 [00:11:28] [02miraheze/phabricator-extensions] 07Universal-Omega 0312b71e6 - Phabricator -> Phorge [00:11:36] miraheze/phabricator-extensions - Universal-Omega the build passed. [00:12:23] miraheze/phabricator-extensions - Universal-Omega the build passed. [00:13:11] [02miraheze/phabricator-extensions] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/phabricator-extensions/compare/12b71e66d183...e6963e9dc373 [00:13:13] [02miraheze/phabricator-extensions] 07Universal-Omega 03e6963e9 - Casing [00:13:40] RECOVERY - ns2 Puppet on ns2 is OK: OK: Puppet is currently enabled, last run 34 seconds ago with 0 failures [00:13:40] RECOVERY - swiftobject171 Puppet on swiftobject171 is OK: OK: Puppet is currently enabled, last run 32 seconds ago with 0 failures [00:14:04] miraheze/phabricator-extensions - Universal-Omega the build passed. [00:14:11] [02miraheze/phabricator-extensions] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/phabricator-extensions/compare/e6963e9dc373...515fa5e0d730 [00:14:13] [02miraheze/phabricator-extensions] 07Universal-Omega 03515fa5e - Use phorge-extensions [00:14:31] [02phabricator-extensions] 07dependabot[bot] edited pull request 03#45: Update mediawiki/mediawiki-codesniffer requirement from 42.0.0 to 43.0.0 - 13https://github.com/miraheze/phabricator-extensions/pull/45 [00:14:56] miraheze/phabricator-extensions - Universal-Omega the build passed. [00:15:06] [02phorge-extensions] 07dependabot[bot] edited pull request 03#45: Update mediawiki/mediawiki-codesniffer requirement from 42.0.0 to 43.0.0 - 13https://github.com/miraheze/phorge-extensions/pull/45 [00:15:07] [02miraheze/phorge-extensions] 07dependabot[bot] pushed 031 commit to 03dependabot/composer/mediawiki/mediawiki-codesniffer-43.0.0 [+0/-0/±1] 13https://github.com/miraheze/phorge-extensions/compare/7d3894216a22...a3c6704d8d66 [00:15:08] [02miraheze/phorge-extensions] 07dependabot[bot] 03a3c6704 - Update mediawiki/mediawiki-codesniffer requirement from 42.0.0 to 43.0.0 [00:15:09] PROBLEM - cp27 HTTP 4xx/5xx ERROR Rate on cp27 is WARNING: WARNING - NGINX Error Rate is 47% [00:15:10] [02phorge-extensions] 07dependabot[bot] synchronize pull request 03#45: Update mediawiki/mediawiki-codesniffer requirement from 42.0.0 to 43.0.0 - 13https://github.com/miraheze/phorge-extensions/pull/45 [00:15:11] [02phorge-extensions] 07dependabot[bot] edited pull request 03#45: Update mediawiki/mediawiki-codesniffer requirement from 42.0.0 to 43.0.0 - 13https://github.com/miraheze/phorge-extensions/pull/45 [00:15:20] RECOVERY - cloud17 Puppet on cloud17 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:15:35] [02phorge-extensions] 07dependabot[bot] edited pull request 03#45: Update mediawiki/mediawiki-codesniffer requirement from 42.0.0 to 43.0.0 - 13https://github.com/miraheze/phorge-extensions/pull/45 [00:15:58] miraheze/phorge-extensions - dependabot[bot] the build has errored. [00:16:52] PROBLEM - cp26 HTTP 4xx/5xx ERROR Rate on cp26 is WARNING: WARNING - NGINX Error Rate is 50% [00:22:37] RECOVERY - cp26 HTTP 4xx/5xx ERROR Rate on cp26 is OK: OK - NGINX Error Rate is 39% [00:23:10] !log [@test151] starting deploy of {'config': True} to test151 [00:23:11] !log [@test151] finished deploy of {'config': True} to test151 - SUCCESS in 0s [00:23:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:23:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:30:37] PROBLEM - cp26 HTTP 4xx/5xx ERROR Rate on cp26 is WARNING: WARNING - NGINX Error Rate is 41% [00:42:37] RECOVERY - cp26 HTTP 4xx/5xx ERROR Rate on cp26 is OK: OK - NGINX Error Rate is 36% [00:45:37] PROBLEM - apocrypha.wiki - LetsEncrypt on sslhost is CRITICAL: Name or service not knownHTTP CRITICAL - Unable to open TCP socket [00:47:09] PROBLEM - cp27 HTTP 4xx/5xx ERROR Rate on cp27 is CRITICAL: CRITICAL - NGINX Error Rate is 60% [00:49:56] PROBLEM - phorge171 phab.miraheze.wiki HTTPS on phorge171 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/1.1 500 Internal Server Error [00:51:22] [02puppet] 07Universal-Omega closed pull request 03#3733: Rename phabricator module to phorge - 13https://github.com/miraheze/puppet/pull/3733 [00:51:25] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03master [+7/-9/±4] 13https://github.com/miraheze/puppet/compare/b247ca9d0578...c3b6c4fb744f [00:51:27] [02miraheze/puppet] 07Universal-Omega 03c3b6c4f - Rename phabricator module to phorge (#3733) [00:51:29] [02miraheze/puppet] 07Universal-Omega deleted branch 03phorge [00:51:30] [02puppet] 07Universal-Omega deleted branch 03phorge - 13https://github.com/miraheze/puppet [00:51:56] RECOVERY - phorge171 phab.miraheze.wiki HTTPS on phorge171 is OK: HTTP OK: Status line output matched "HTTP/1.1 200" - 17685 bytes in 0.038 second response time [00:58:54] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/c3b6c4fb744f...6cb998b23dd1 [00:58:57] [02miraheze/puppet] 07Universal-Omega 036cb998b - phorge: install mariadb-client [01:02:35] PROBLEM - puppet181 Puppet on puppet181 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_puppet] [01:05:44] PROBLEM - phorge171 Current Load on phorge171 is CRITICAL: LOAD CRITICAL - total load average: 2.30, 1.48, 0.94 [01:07:44] RECOVERY - phorge171 Current Load on phorge171 is OK: LOAD OK - total load average: 1.01, 1.32, 0.96 [01:11:44] PROBLEM - phorge171 Current Load on phorge171 is CRITICAL: LOAD CRITICAL - total load average: 2.01, 1.70, 1.20 [01:17:33] PROBLEM - phorge171 Disk Space on phorge171 is CRITICAL: DISK CRITICAL - free space: / 706MiB (1% inode=89%); [01:19:27] PROBLEM - phorge171 Disk Space on phorge171 is WARNING: DISK WARNING - free space: / 3840MiB (8% inode=89%); [01:19:41] PROBLEM - phorge171 Current Load on phorge171 is WARNING: LOAD WARNING - total load average: 1.78, 1.96, 1.56 [01:23:15] PROBLEM - phorge171 Disk Space on phorge171 is CRITICAL: DISK CRITICAL - free space: / 1696MiB (3% inode=89%); [01:27:34] PROBLEM - cp26 HTTP 4xx/5xx ERROR Rate on cp26 is WARNING: WARNING - NGINX Error Rate is 40% [01:29:33] RECOVERY - cp26 HTTP 4xx/5xx ERROR Rate on cp26 is OK: OK - NGINX Error Rate is 38% [01:30:18] RECOVERY - puppet181 Puppet on puppet181 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [01:30:50] RECOVERY - phorge171 Disk Space on phorge171 is OK: DISK OK - free space: / 13722MiB (30% inode=93%); [01:33:21] RECOVERY - phorge171 Current Load on phorge171 is OK: LOAD OK - total load average: 1.26, 1.64, 1.65 [01:45:25] RECOVERY - apocrypha.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'apocrypha.wiki' will expire on Fri 01 Mar 2024 12:06:59 PM GMT +0000. [02:15:22] PROBLEM - cp26 HTTP 4xx/5xx ERROR Rate on cp26 is WARNING: WARNING - NGINX Error Rate is 40% [02:19:21] RECOVERY - cp26 HTTP 4xx/5xx ERROR Rate on cp26 is OK: OK - NGINX Error Rate is 39% [02:23:20] PROBLEM - cp26 HTTP 4xx/5xx ERROR Rate on cp26 is WARNING: WARNING - NGINX Error Rate is 41% [02:33:18] RECOVERY - cp26 HTTP 4xx/5xx ERROR Rate on cp26 is OK: OK - NGINX Error Rate is 39% [02:37:17] PROBLEM - cp26 HTTP 4xx/5xx ERROR Rate on cp26 is WARNING: WARNING - NGINX Error Rate is 40% [03:01:00] RECOVERY - db171 Backups SQL on db171 is OK: FILE_AGE OK: /var/log/sql-backup.log is 59 seconds old and 0 bytes [03:03:21] PROBLEM - mon181 Backups Grafana on mon181 is WARNING: FILE_AGE WARNING: /var/log/grafana-backup.log is 864178 seconds old and 92 bytes [03:13:24] PROBLEM - apocrypha.wiki - LetsEncrypt on sslhost is CRITICAL: Name or service not knownHTTP CRITICAL - Unable to open TCP socket [03:42:06] RECOVERY - apocrypha.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'apocrypha.wiki' will expire on Fri 01 Mar 2024 12:06:59 PM GMT +0000. [04:44:54] RECOVERY - cp26 HTTP 4xx/5xx ERROR Rate on cp26 is OK: OK - NGINX Error Rate is 39% [05:00:41] RECOVERY - db162 Backups SQL mhglobal on db162 is OK: FILE_AGE OK: /var/log/sql-mhglobal-backup-weekly.log is 33 seconds old and 207 bytes [05:12:42] PROBLEM - apocrypha.wiki - LetsEncrypt on sslhost is CRITICAL: Name or service not knownHTTP CRITICAL - Unable to open TCP socket [05:41:24] RECOVERY - apocrypha.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'apocrypha.wiki' will expire on Fri 01 Mar 2024 12:06:59 PM GMT +0000. [05:46:54] PROBLEM - cp26 HTTP 4xx/5xx ERROR Rate on cp26 is WARNING: WARNING - NGINX Error Rate is 40% [06:12:42] PROBLEM - apocrypha.wiki - LetsEncrypt on sslhost is CRITICAL: Name or service not knownHTTP CRITICAL - Unable to open TCP socket [06:14:01] PROBLEM - swiftac171 Current Load on swiftac171 is CRITICAL: LOAD CRITICAL - total load average: 12.40, 9.02, 4.94 [06:14:43] PROBLEM - swiftac171 Puppet on swiftac171 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [06:14:58] PROBLEM - swiftac171 APT on swiftac171 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [06:16:00] PROBLEM - swiftac171 Current Load on swiftac171 is WARNING: LOAD WARNING - total load average: 11.14, 10.65, 6.08 [06:16:40] RECOVERY - swiftac171 Puppet on swiftac171 is OK: OK: Puppet is currently enabled, last run 22 minutes ago with 0 failures [06:16:55] RECOVERY - swiftac171 APT on swiftac171 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [06:18:00] RECOVERY - swiftac171 Current Load on swiftac171 is OK: LOAD OK - total load average: 3.00, 7.70, 5.55 [06:18:51] PROBLEM - worldtriggerwiki.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'worldtriggerwiki.com' expires in 15 day(s) (Tue 20 Feb 2024 06:15:06 AM GMT +0000). [06:19:03] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/ccc96d95ac47...7de81e6316a6 [06:19:06] [02miraheze/ssl] 07MirahezeSSLBot 037de81e6 - Bot: Update SSL cert for worldtriggerwiki.com [06:28:20] PROBLEM - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query line.pm. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [06:41:24] RECOVERY - apocrypha.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'apocrypha.wiki' will expire on Fri 01 Mar 2024 12:06:59 PM GMT +0000. [06:44:35] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query. [07:13:35] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is WARNING: SSL WARNING - rDNS OK but records conflict. {'NS': ['NS.ANKH.FR.eu.org.', 'NS1.eu.org.', 'NS1.ERIOMEM.NET.'], 'CNAME': 'bouncingwiki.miraheze.org.'} [07:17:50] RECOVERY - worldtriggerwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'worldtriggerwiki.com' will expire on Sat 04 May 2024 05:18:57 AM GMT +0000. [07:28:06] RECOVERY - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is OK: SSL OK - wiki.mahdiruiz.line.pm reverse DNS resolves to cp37.wikitide.net - CNAME OK [07:42:35] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query. [08:11:36] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is WARNING: SSL WARNING - rDNS OK but records conflict. {'NS': ['NS.ANKH.FR.eu.org.', 'NS1.eu.org.', 'NS1.ERIOMEM.NET.'], 'CNAME': 'bouncingwiki.miraheze.org.'} [08:42:42] PROBLEM - apocrypha.wiki - LetsEncrypt on sslhost is CRITICAL: Name or service not knownHTTP CRITICAL - Unable to open TCP socket [09:00:02] PROBLEM - index.pdcommunity.ir - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query pdcommunity.ir. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [09:11:24] RECOVERY - apocrypha.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'apocrypha.wiki' will expire on Fri 01 Mar 2024 12:06:59 PM GMT +0000. [09:28:50] RECOVERY - index.pdcommunity.ir - reverse DNS on sslhost is OK: SSL OK - index.pdcommunity.ir reverse DNS resolves to cp37.wikitide.net - CNAME OK [09:38:56] PROBLEM - cp27 HTTP 4xx/5xx ERROR Rate on cp27 is WARNING: WARNING - NGINX Error Rate is 58% [12:35:58] PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.andreijiroh.uk.eu.org All nameservers failed to answer the query. [13:05:26] RECOVERY - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.andreijiroh.uk.eu.org reverse DNS resolves to cp36.wikitide.net - CNAME OK [13:29:36] PROBLEM - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query line.pm. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [13:32:00] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query. [13:49:04] !log [paladox@mwtask181] starting deploy of {'config': True} to all [13:49:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:49:12] !log [paladox@mwtask181] finished deploy of {'config': True} to all - SUCCESS in 7s [13:49:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:02:01] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is WARNING: SSL WARNING - rDNS OK but records conflict. {'NS': ['NS.ANKH.FR.eu.org.', 'NS1.eu.org.', 'NS1.ERIOMEM.NET.'], 'CNAME': 'bouncingwiki.miraheze.org.'} [14:50:54] PROBLEM - cp26 HTTP 4xx/5xx ERROR Rate on cp26 is CRITICAL: CRITICAL - NGINX Error Rate is 64% [14:59:15] RECOVERY - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is OK: SSL OK - wiki.mahdiruiz.line.pm reverse DNS resolves to cp36.wikitide.net - CNAME OK [16:07:42] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 146.94 ms [16:09:41] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 143.70 ms [16:58:22] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/3e7eef6257c4...2a7a27441fbe [16:58:24] [02miraheze/mw-config] 07paladox 032a7a274 - Remove cp26/27 and add cp28 to wgCdnServers [16:58:43] !log [paladox@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all [16:58:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:58:50] !log [paladox@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 7s [16:58:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:58:57] !log [paladox@mwtask181] starting deploy of {'config': True} to all [16:58:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:59:04] !log [paladox@mwtask181] finished deploy of {'config': True} to all - SUCCESS in 7s [16:59:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:59:35] miraheze/mw-config - paladox the build passed. [17:04:19] !log [reception@mwtask181] sudo -u www-data php /srv/mediawiki/1.40/maintenance/run.php /srv/mediawiki/1.40/maintenance/CirrusSearch/UpdateSearchIndexConfig.php --wiki=ndgwiki (END - exit=256) [17:04:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:04:47] !log [reception@mwtask181] sudo -u www-data php /srv/mediawiki/1.40/maintenance/run.php /srv/mediawiki/1.40/extensions/CirrusSearch/maintenance/UpdateSearchIndexConfig.php --wiki=ndgwiki (END - exit=0) [17:04:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:09:02] !log [reception@mwtask181] sudo -u www-data php /srv/mediawiki/1.40/maintenance/run.php /srv/mediawiki/1.40/maintenance/runJobs.php --wiki=ndgwiki (START) [17:09:03] !log [reception@mwtask181] sudo -u www-data php /srv/mediawiki/1.40/maintenance/run.php /srv/mediawiki/1.40/maintenance/runJobs.php --wiki=ndgwiki (END - exit=0) [17:09:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:09:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:11:12] !log [reception@mwtask181] sudo -u www-data php /srv/mediawiki/1.40/maintenance/run.php /srv/mediawiki/1.40/maintenance/deleteBatch.php --wiki=theinsanitypediawiki --r=Requested at [[phab:T11766 [17:11:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:12:59] !log [reception@mwtask181] sudo -u www-data php /srv/mediawiki/1.40/maintenance/run.php /srv/mediawiki/1.40/maintenance/deleteBatch.php --wiki=theinsanitypediawiki --r=Requested at [[phab:T11766 [17:13:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:18:16] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03wikitide-config [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/e8155109469a [17:18:17] [02miraheze/mw-config] 07Universal-Omega 03e815510 - Add configuration for WikiTide wikis [17:18:20] [02mw-config] 07Universal-Omega created branch 03wikitide-config - 13https://github.com/miraheze/mw-config [17:18:21] [02mw-config] 07Universal-Omega opened pull request 03#5457: Add configuration for WikiTide wikis - 13https://github.com/miraheze/mw-config/pull/5457 [17:19:14] miraheze/mw-config - Universal-Omega the build passed. [17:23:05] !log [@test151] starting deploy of {'config': True} to test151 [17:23:06] !log [@test151] finished deploy of {'config': True} to test151 - SUCCESS in 0s [17:23:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:23:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:42:42] PROBLEM - apocrypha.wiki - LetsEncrypt on sslhost is CRITICAL: Name or service not knownHTTP CRITICAL - Unable to open TCP socket [17:44:07] [02ManageWiki] 07redbluegreenhat commented on pull request 03#443: ManageWikiDefaultPermissions: fix description i18n - 13https://github.com/miraheze/ManageWiki/pull/443#issuecomment-1925860316 [17:45:24] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03wikitide-config [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/e8155109469a...709c14235d3c [17:45:27] [02miraheze/mw-config] 07Universal-Omega 03709c142 - Add [17:45:28] [02mw-config] 07Universal-Omega synchronize pull request 03#5457: Add configuration for WikiTide wikis - 13https://github.com/miraheze/mw-config/pull/5457 [17:46:17] miraheze/mw-config - Universal-Omega the build passed. [17:47:39] [02ManageWiki] 07redbluegreenhat reviewed pull request 03#443 commit - 13https://github.com/miraheze/ManageWiki/pull/443#discussion_r1477412584 [17:56:38] [02ManageWiki] 07redbluegreenhat closed pull request 03#443: ManageWikiDefaultPermissions: fix description i18n - 13https://github.com/miraheze/ManageWiki/pull/443 [17:56:40] [02ManageWiki] 07redbluegreenhat commented on pull request 03#443: ManageWikiDefaultPermissions: fix description i18n - 13https://github.com/miraheze/ManageWiki/pull/443#issuecomment-1925864918 [18:06:24] [02ManageWiki] 07redbluegreenhat opened pull request 03#446: Add missing i18n for managewikidefaultpermissions-view - 13https://github.com/miraheze/ManageWiki/pull/446 [18:07:29] [02ManageWiki] 07redbluegreenhat edited pull request 03#446: Add missing i18n for managewikidefaultpermissions-view - 13https://github.com/miraheze/ManageWiki/pull/446 [18:09:45] !log db182: MariaDB [phabricator_repository]> UPDATE repository SET localpath = REPLACE(localpath, '/srv/phab', '/srv/phorge'); [18:09:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:10:25] PROBLEM - cp41 HTTP 4xx/5xx ERROR Rate on cp41 is WARNING: WARNING - NGINX Error Rate is 45% [18:10:57] miraheze/ManageWiki - redbluegreenhat the build passed. [18:11:06] [02ManageWiki] 07redbluegreenhat closed pull request 03#446: Add missing i18n for managewikidefaultpermissions-view - 13https://github.com/miraheze/ManageWiki/pull/446 [18:11:07] [02miraheze/ManageWiki] 07redbluegreenhat pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/ManageWiki/compare/2f8d15341a4e...62ca5d306e31 [18:11:10] [02miraheze/ManageWiki] 07redbluegreenhat 0362ca5d3 - Add missing i18n for managewikidefaultpermissions-view (#446) [18:11:24] RECOVERY - apocrypha.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'apocrypha.wiki' will expire on Fri 01 Mar 2024 12:06:59 PM GMT +0000. [18:12:08] [[Tech:SSH fingerprints]] still need updating btw [18:12:08] https://meta.miraheze.org/wiki/Tech:SSH_fingerprints [18:12:20] RECOVERY - cp41 HTTP 4xx/5xx ERROR Rate on cp41 is OK: OK - NGINX Error Rate is 6% [18:15:16] miraheze/ManageWiki - redbluegreenhat the build passed. [18:22:30] PROBLEM - cp36 Disk Space on cp36 is WARNING: DISK WARNING - free space: / 9696MiB (10% inode=98%); [18:24:01] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/6cb998b23dd1...dbba6fe231b8 [18:24:04] [02miraheze/puppet] 07Universal-Omega 03dbba6fe - Update metamta.single-reply-handler-prefix to phorge [18:24:21] PROBLEM - cp37 Disk Space on cp37 is WARNING: DISK WARNING - free space: / 9702MiB (10% inode=98%); [18:24:57] [02miraheze/dns] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/dns/compare/d1d23432a265...74b9ab14bc05 [18:24:59] [02miraheze/dns] 07Universal-Omega 0374b9ab1 - Use phorge [18:31:27] PROBLEM - puppet181 Puppet on puppet181 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_puppet] [18:34:25] [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-5 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/18a043f04d3c [18:34:27] [02miraheze/mw-config] 07paladox 0318a043f - Set $wgHCaptchaProxy to bastion.wikitide.net [18:34:30] [02mw-config] 07paladox created branch 03paladox-patch-5 - 13https://github.com/miraheze/mw-config [18:34:33] [02mw-config] 07paladox opened pull request 03#5458: Set $wgHCaptchaProxy to bastion.wikitide.net - 13https://github.com/miraheze/mw-config/pull/5458 [18:35:09] PROBLEM - phorge171 Puppet on phorge171 is WARNING: WARNING: Puppet is currently disabled, message: reason not specified, last run 26 minutes ago with 0 failures [18:35:14] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03mysql-user-rename [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/6ce4bbce3170 [18:35:17] [02miraheze/puppet] 07Universal-Omega 036ce4bbc - Rename phabricator mysql user to phorge [18:35:18] [02puppet] 07Universal-Omega created branch 03mysql-user-rename - 13https://github.com/miraheze/puppet [18:35:19] [02puppet] 07Universal-Omega opened pull request 03#3736: Rename phabricator mysql user to phorge - 13https://github.com/miraheze/puppet/pull/3736 [18:35:34] miraheze/mw-config - paladox the build passed. [18:35:40] [02mw-config] 07paladox closed pull request 03#5458: Set $wgHCaptchaProxy to bastion.wikitide.net - 13https://github.com/miraheze/mw-config/pull/5458 [18:35:43] [02miraheze/mw-config] 07paladox deleted branch 03paladox-patch-5 [18:35:44] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/2a7a27441fbe...161478723d50 [18:35:45] [02miraheze/mw-config] 07paladox 031614787 - Set $wgHCaptchaProxy to bastion.wikitide.net (#5458) [18:35:48] [02mw-config] 07paladox deleted branch 03paladox-patch-5 - 13https://github.com/miraheze/mw-config [18:36:05] !log [paladox@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all [18:36:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:36:12] !log [paladox@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 7s [18:36:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:36:19] !log [paladox@mwtask181] starting deploy of {'config': True} to all [18:36:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:36:25] !log [paladox@mwtask181] finished deploy of {'config': True} to all - SUCCESS in 6s [18:36:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:36:34] miraheze/mw-config - paladox the build passed. [18:36:37] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03mysql-user-rename [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/6ce4bbce3170...f1d72dbd7a21 [18:36:39] [02miraheze/puppet] 07Universal-Omega 03f1d72db - Update [18:36:41] [02puppet] 07Universal-Omega synchronize pull request 03#3736: Rename phabricator mysql user to phorge - 13https://github.com/miraheze/puppet/pull/3736 [18:37:31] [02puppet] 07Universal-Omega closed pull request 03#3736: Rename phabricator mysql user to phorge - 13https://github.com/miraheze/puppet/pull/3736 [18:37:32] [02miraheze/puppet] 07Universal-Omega deleted branch 03mysql-user-rename [18:37:35] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/puppet/compare/dbba6fe231b8...7755d61c33ff [18:37:37] [02miraheze/puppet] 07Universal-Omega 037755d61 - Rename phabricator mysql user to phorge (#3736) [18:37:39] [02puppet] 07Universal-Omega deleted branch 03mysql-user-rename - 13https://github.com/miraheze/puppet [18:39:07] !log db182: RENAME USER 'phabricator'@'%' TO 'phorge'@'%'; [18:39:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:42:42] PROBLEM - apocrypha.wiki - LetsEncrypt on sslhost is CRITICAL: Name or service not knownHTTP CRITICAL - Unable to open TCP socket [18:53:38] !log [@test151] starting deploy of {'config': True} to test151 [18:53:39] !log [@test151] finished deploy of {'config': True} to test151 - SUCCESS in 0s [18:53:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:53:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:53:45] [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-5 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/f104c708bf0f [18:53:46] [02miraheze/mw-config] 07paladox 03f104c70 - Set $wgCaptchaStorageClass to CaptchaCacheStore [18:53:47] [02mw-config] 07paladox created branch 03paladox-patch-5 - 13https://github.com/miraheze/mw-config [18:53:48] [02mw-config] 07paladox opened pull request 03#5459: Set $wgCaptchaStorageClass to CaptchaCacheStore - 13https://github.com/miraheze/mw-config/pull/5459 [18:54:05] [02mw-config] 07paladox closed pull request 03#5459: Set $wgCaptchaStorageClass to CaptchaCacheStore - 13https://github.com/miraheze/mw-config/pull/5459 [18:54:08] [02miraheze/mw-config] 07paladox deleted branch 03paladox-patch-5 [18:54:10] !log [paladox@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all [18:54:11] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/161478723d50...391e038218b8 [18:54:12] [02miraheze/mw-config] 07paladox 03391e038 - Set $wgCaptchaStorageClass to CaptchaCacheStore (#5459) [18:54:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:54:13] [02mw-config] 07paladox deleted branch 03paladox-patch-5 - 13https://github.com/miraheze/mw-config [18:54:17] !log [paladox@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 7s [18:54:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:54:24] !log [paladox@mwtask181] starting deploy of {'config': True} to all [18:54:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:54:31] !log [paladox@mwtask181] finished deploy of {'config': True} to all - SUCCESS in 6s [18:54:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:54:41] miraheze/mw-config - paladox the build passed. [18:55:02] miraheze/mw-config - paladox the build passed. [19:11:24] RECOVERY - apocrypha.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'apocrypha.wiki' will expire on Fri 01 Mar 2024 12:06:59 PM GMT +0000. [19:23:13] !log [@test151] starting deploy of {'config': True} to test151 [19:23:14] !log [@test151] finished deploy of {'config': True} to test151 - SUCCESS in 0s [19:23:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:23:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:29:09] RECOVERY - phorge171 Puppet on phorge171 is OK: OK: Puppet is currently enabled, last run 8 seconds ago with 0 failures [19:29:27] RECOVERY - puppet181 Puppet on puppet181 is OK: OK: Puppet is currently enabled, last run 27 seconds ago with 0 failures [19:35:53] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 137.73 ms [19:35:55] [02miraheze/puppet] 07Universal-Omega created branch 03issue-tracker 13https://github.com/miraheze/puppet/commit/7755d61c33ff02a4ac5b950165b69aa80c82f5ae [19:35:56] [02puppet] 07Universal-Omega created branch 03issue-tracker - 13https://github.com/miraheze/puppet [19:36:43] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03issue-tracker [+1/-1/±6] 13https://github.com/miraheze/puppet/compare/7755d61c33ff...6614c4fc5cf9 [19:36:45] [02miraheze/puppet] 07Universal-Omega 036614c4f - Rename phabricator.miraheze.org to issue-tracker.miraheze.org [19:36:58] [02puppet] 07Universal-Omega opened pull request 03#3737: Rename phabricator.miraheze.org to issue-tracker.miraheze.org - 13https://github.com/miraheze/puppet/pull/3737 [19:37:52] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 157.79 ms [19:54:48] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/7755d61c33ff...bfee74ec667f [19:54:51] [02miraheze/puppet] 07Universal-Omega 03bfee74e - phorge: set ui.header-color to blue [20:15:01] RECOVERY - cp27 HTTP 4xx/5xx ERROR Rate on cp27 is OK: OK - NGINX Error Rate is 31% [20:21:09] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03staging [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/f3b587405138 [20:21:12] [02miraheze/puppet] 07Universal-Omega 03f3b5874 - Only use staging for versions if required [20:21:15] [02puppet] 07Universal-Omega created branch 03staging - 13https://github.com/miraheze/puppet [20:21:18] [02puppet] 07Universal-Omega opened pull request 03#3738: Only use staging for versions if required - 13https://github.com/miraheze/puppet/pull/3738 [20:21:56] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03staging [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/f3b587405138...7ccc3f84f9ae [20:21:59] [02miraheze/puppet] 07Universal-Omega 037ccc3f8 - Update getMWVersions.php [20:22:02] [02puppet] 07Universal-Omega synchronize pull request 03#3738: Only use staging for versions if required - 13https://github.com/miraheze/puppet/pull/3738 [20:22:48] [02puppet] 07Universal-Omega closed pull request 03#3738: Only use staging for versions if required - 13https://github.com/miraheze/puppet/pull/3738 [20:22:50] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/puppet/compare/bfee74ec667f...c1311dc77be4 [20:22:51] [02miraheze/puppet] 07Universal-Omega 03c1311dc - Only use staging for versions if required (#3738) [20:22:54] [02miraheze/puppet] 07Universal-Omega deleted branch 03staging [20:22:57] [02puppet] 07Universal-Omega deleted branch 03staging - 13https://github.com/miraheze/puppet [20:26:54] PROBLEM - cp26 HTTP 4xx/5xx ERROR Rate on cp26 is WARNING: WARNING - NGINX Error Rate is 59% [20:32:00] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query. [20:42:42] PROBLEM - apocrypha.wiki - LetsEncrypt on sslhost is CRITICAL: Name or service not knownHTTP CRITICAL - Unable to open TCP socket [21:11:24] RECOVERY - apocrypha.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'apocrypha.wiki' will expire on Fri 01 Mar 2024 12:06:59 PM GMT +0000. [21:56:46] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/391e038218b8...6d4a60c6524d [21:56:47] [02miraheze/mw-config] 07Universal-Omega 036d4a60c - Remove wgRelatedArticlesUseCirrusSearch from LS (T11777) [21:57:44] miraheze/mw-config - Universal-Omega the build passed. [21:57:56] !log [universalomega@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all [21:57:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:58:04] !log [universalomega@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 8s [21:58:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:02:00] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is WARNING: SSL WARNING - rDNS OK but records conflict. {'NS': ['NS.ANKH.FR.eu.org.', 'NS1.eu.org.', 'NS1.ERIOMEM.NET.'], 'CNAME': 'bouncingwiki.miraheze.org.'} [22:07:25] [02miraheze/mw-config] 07Universal-Omega pushed 032 commits to 03wikitide-config [+0/-0/±2] 13https://github.com/miraheze/mw-config/compare/709c14235d3c...28261000fd8b [22:07:28] [02miraheze/mw-config] 07Universal-Omega 037d36f32 - Add configuration for WikiTide wikis [22:07:29] [02miraheze/mw-config] 07Universal-Omega 032826100 - Add [22:07:30] [02mw-config] 07Universal-Omega synchronize pull request 03#5457: Add configuration for WikiTide wikis - 13https://github.com/miraheze/mw-config/pull/5457 [22:08:08] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03wikitide-config [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/28261000fd8b...8a89f95336e6 [22:08:09] [02miraheze/mw-config] 07Universal-Omega 038a89f95 - Update [22:08:11] [02mw-config] 07Universal-Omega synchronize pull request 03#5457: Add configuration for WikiTide wikis - 13https://github.com/miraheze/mw-config/pull/5457 [22:08:23] miraheze/mw-config - Universal-Omega the build passed. [22:09:02] miraheze/mw-config - Universal-Omega the build passed. [22:09:56] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03wikitide-config [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/8a89f95336e6...a8f5292a7499 [22:09:57] [02miraheze/mw-config] 07Universal-Omega 03a8f5292 - Update [22:09:58] [02mw-config] 07Universal-Omega synchronize pull request 03#5457: Add configuration for WikiTide wikis - 13https://github.com/miraheze/mw-config/pull/5457 [22:10:50] miraheze/mw-config - Universal-Omega the build passed. [22:11:30] [02mw-config] 07Universal-Omega synchronize pull request 03#5457: Add configuration for WikiTide wikis - 13https://github.com/miraheze/mw-config/pull/5457 [22:11:31] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03wikitide-config [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/a8f5292a7499...baefa628f960 [22:11:33] [02miraheze/mw-config] 07Universal-Omega 03baefa62 - Add check [22:12:23] miraheze/mw-config - Universal-Omega the build passed. [22:12:42] PROBLEM - apocrypha.wiki - LetsEncrypt on sslhost is CRITICAL: Name or service not knownHTTP CRITICAL - Unable to open TCP socket [22:14:57] [02mw-config] 07Universal-Omega closed pull request 03#5457: Add configuration for WikiTide wikis - 13https://github.com/miraheze/mw-config/pull/5457 [22:15:00] [02miraheze/mw-config] 07Universal-Omega deleted branch 03wikitide-config [22:15:01] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±3] 13https://github.com/miraheze/mw-config/compare/6d4a60c6524d...f9fbdfc09f35 [22:15:03] [02miraheze/mw-config] 07Universal-Omega 03f9fbdfc - Add configuration for WikiTide wikis (#5457) [22:15:06] !log [universalomega@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all [22:15:06] [02mw-config] 07Universal-Omega deleted branch 03wikitide-config - 13https://github.com/miraheze/mw-config [22:15:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:15:14] !log [universalomega@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 7s [22:15:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:15:56] miraheze/mw-config - Universal-Omega the build passed. [22:23:38] !log [@test151] starting deploy of {'config': True} to test151 [22:23:39] !log [@test151] finished deploy of {'config': True} to test151 - SUCCESS in 0s [22:23:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:23:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:32:42] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/f9fbdfc09f35...a19939d34080 [22:32:43] [02miraheze/mw-config] 07Universal-Omega 03a19939d - T10241: add PWA extension to ManageWikiExtensions [22:33:39] miraheze/mw-config - Universal-Omega the build passed. [22:34:54] [02mw-config] 07Universal-Omega reviewed pull request 03#5455 commit - 13https://github.com/miraheze/mw-config/pull/5455#discussion_r1477468355 [22:39:03] [02mw-config] 07Universal-Omega reviewed pull request 03#5455 commit - 13https://github.com/miraheze/mw-config/pull/5455#discussion_r1477468355 [22:44:07] [02miraheze/mediawiki-repos] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mediawiki-repos/compare/41dc0b0798d0...b686ff840d82 [22:44:09] [02miraheze/mediawiki-repos] 07Universal-Omega 03b686ff8 - Add composer for SemanticScribunto [22:45:39] [02miraheze/mediawiki-repos] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mediawiki-repos/compare/b686ff840d82...05d6e02d1302 [22:45:42] [02miraheze/mediawiki-repos] 07Universal-Omega 0305d6e02 - Add SemanticScribunto composer [22:47:04] [02mw-config] 07Universal-Omega synchronize pull request 03#5455: T10615: Add SemanticScribunto to ManageWiki - 13https://github.com/miraheze/mw-config/pull/5455 [22:47:13] [02mw-config] 07Universal-Omega closed pull request 03#5455: T10615: Add SemanticScribunto to ManageWiki - 13https://github.com/miraheze/mw-config/pull/5455 [22:47:16] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/a19939d34080...7600bc65af3f [22:47:17] [02miraheze/mw-config] 07redbluegreenhat 037600bc6 - T10615: Add SemanticScribunto to ManageWiki (#5455) [22:48:02] miraheze/mw-config - Universal-Omega the build passed. [22:48:08] miraheze/mw-config - Universal-Omega the build passed. [22:53:54] !log [@test151] starting deploy of {'config': True} to test151 [22:53:55] !log [@test151] finished deploy of {'config': True} to test151 - SUCCESS in 0s [22:53:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:53:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:02:36] !log [@mwtask181] starting deploy of {'config': True} to all [23:02:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:02:43] !log [@mwtask181] finished deploy of {'config': True} to all - SUCCESS in 7s [23:02:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:05:55] PROBLEM - mwtask181 Puppet on mwtask181 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 2 minutes ago with 2 failures. Failed resources (up to 3 shown): Exec[SemanticScribunto-REL1_40 composer],Exec[SemanticScribunto-REL1_41 composer] [23:07:23] PROBLEM - test151 Puppet on test151 is CRITICAL: CRITICAL: Puppet has 3 failures. Last run 2 minutes ago with 3 failures. Failed resources (up to 3 shown): Exec[SemanticScribunto-REL1_40 composer],Exec[SemanticScribunto-REL1_41 composer],Exec[SemanticScribunto-master composer] [23:10:44] [02miraheze/mediawiki-repos] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mediawiki-repos/compare/05d6e02d1302...d43497115b03 [23:10:46] [02miraheze/mediawiki-repos] 07Universal-Omega 03d434971 - Add SemanticMediaWiki composer [23:16:06] [02miraheze/mediawiki-repos] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mediawiki-repos/compare/d43497115b03...280143259876 [23:16:07] [02miraheze/mediawiki-repos] 07Universal-Omega 032801432 - Revert [23:22:32] [02miraheze/mediawiki-repos] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mediawiki-repos/compare/280143259876...1a393f6f4a75 [23:22:34] [02miraheze/mediawiki-repos] 07Universal-Omega 031a393f6 - Remove extension-level composer for SemanticScribunto [23:27:23] RECOVERY - test151 Puppet on test151 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [23:28:24] !log [universalomega@mwtask181] starting deploy of {'world': True, 'versions': ['1.40', '1.41']} to all [23:28:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:29:55] RECOVERY - mwtask181 Puppet on mwtask181 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [23:30:21] !log [universalomega@mwtask181] finished deploy of {'world': True, 'versions': ['1.40', '1.41']} to all - SUCCESS in 116s [23:30:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:33:55] PROBLEM - mwtask181 Puppet on mwtask181 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 13 seconds ago with 2 failures. Failed resources (up to 3 shown): Exec[git_clone_MediaWiki-REL1_40 SemanticMediaWiki],Exec[git_clone_MediaWiki-REL1_41 SemanticMediaWiki] [23:36:22] !log [universalomega@mwtask181] starting deploy of {'world': True, 'versions': ['1.40', '1.41']} to all [23:36:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:37:47] !log [universalomega@mwtask181] finished deploy of {'world': True, 'versions': ['1.40', '1.41']} to all - SUCCESS in 85s [23:37:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:37:55] RECOVERY - mwtask181 Puppet on mwtask181 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [23:40:43] RECOVERY - apocrypha.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'apocrypha.wiki' will expire on Fri 01 Mar 2024 12:06:59 PM GMT +0000. [23:51:39] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/7600bc65af3f...086b76c17334 [23:51:40] [02miraheze/mw-config] 07Universal-Omega 03086b76c - Fix + decoding [23:51:46] !log [universalomega@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all [23:51:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:51:53] !log [universalomega@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 7s [23:51:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:52:33] miraheze/mw-config - Universal-Omega the build passed. [23:53:38] !log [@test151] starting deploy of {'config': True} to test151 [23:53:39] !log [@test151] finished deploy of {'config': True} to test151 - SUCCESS in 0s [23:53:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:53:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log