[00:01:47] [02statichelp] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/statichelp/commit/a2f96c86117df337048b86b5181e52bdff9ed4a0 [00:01:47] 02statichelp/03main 07WikiTideBot 03a2f96c8 Bot: Auto-update Tech namespace pages 2026-08-28 00:01:45 [00:18:14] [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/CreateWiki/commit/74894125990e087aaabf9c675ddfcc1e49d3cd53 [00:18:14] 02CreateWiki/03main 07dependabot[bot] 037489412 Bump svgo from 4.0.2 to 4.1.0 (#851)… [00:18:16] [02CreateWiki] 07Universal-Omega merged 07dependabot[bot]'s pull request #851: Bump svgo from 4.0.2 to 4.1.0 (03main...03dependabot/npm_and_yarn/svgo-4.1.0) 13https://github.com/miraheze/CreateWiki/pull/851 [00:18:18] [02CreateWiki] 07Universal-Omega 04deleted 03dependabot/npm_and_yarn/svgo-4.1.0 at 03240912c 13https://api.github.com/repos/miraheze/CreateWiki/commit/240912c [00:25:35] miraheze/CreateWiki - Universal-Omega the build passed. [00:33:11] [02puppet] 07Universal-Omega created 03opensearch-analysis-stconvert (+1 new commit) 13https://github.com/miraheze/puppet/commit/c5699da2e58d [00:33:11] 02puppet/03opensearch-analysis-stconvert 07CosmicAlpha 03c5699da opensearch-mw: install the opensearch-analysis-stconvert plugin for CirrusSearch [00:33:25] [02puppet] 07Universal-Omega opened pull request #4972: opensearch-mw: install the opensearch-analysis-stconvert plugin for CirrusSearch (03main...03opensearch-analysis-stconvert) 13https://github.com/miraheze/puppet/pull/4972 [00:34:08] [02puppet] 07Universal-Omega pushed 1 new commit to 03opensearch-analysis-stconvert 13https://github.com/miraheze/puppet/commit/f6a7695fe3cc7b1319cd9ff72f0cf9e180439ba9 [00:34:09] 02puppet/03opensearch-analysis-stconvert 07CosmicAlpha 03f6a7695 Add [00:36:35] [02puppet] 07Universal-Omega created 03beta-nftables (+1 new commit) 13https://github.com/miraheze/puppet/commit/db2110125efd [00:36:35] 02puppet/03beta-nftables 07CosmicAlpha 03db21101 mediawiki_beta: fully switch to nftables [00:36:41] [02puppet] 07Universal-Omega opened pull request #4973: mediawiki_beta: fully switch to nftables (03main...03beta-nftables) 13https://github.com/miraheze/puppet/pull/4973 [00:38:05] [02puppet] 07Universal-Omega retitled PR #4930: "Use src_sets tather than raw firewall querying" ➜ "Use src_sets rather than raw firewall querying" 13https://github.com/miraheze/puppet/pull/4930 [01:08:46] PROBLEM - mwtask181 Check unit status of mediawiki_job_generate-sitemap-index on mwtask181 is CRITICAL: CRITICAL: Status of the systemd unit mediawiki_job_generate-sitemap-index [02:40:17] [02python-functions] 07renovate[bot] merged 03renovate/all-deps into 03main 13https://github.com/miraheze/python-functions/compare/401d0ac6385b...0fcbd050b370 [02:40:18] [02python-functions] 07renovate[bot] 04deleted 03renovate/all-deps at 030fcbd05 13https://api.github.com/repos/miraheze/python-functions/commit/0fcbd05 [06:09:07] PROBLEM - mw153 HTTPS on mw153 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Connection timed out after 10005 milliseconds [06:09:30] PROBLEM - cp201 Varnish Backends on cp201 is CRITICAL: 1 backends are down. mw153 [06:09:33] PROBLEM - mw153.fsslc.wtnet SSL Check on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:09:41] PROBLEM - cp191 Varnish Backends on cp191 is CRITICAL: 1 backends are down. mw153 [06:09:42] PROBLEM - mw153 MediaWiki Rendering on mw153 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:10:13] PROBLEM - cp171 Varnish Backends on cp171 is CRITICAL: 1 backends are down. mw153 [06:10:51] PROBLEM - mw153 Current Load on mw153 is CRITICAL: LOAD CRITICAL - total load average: 26.51, 28.69, 15.81 [06:11:04] RECOVERY - mw153 HTTPS on mw153 is OK: HTTP OK: HTTP/2 410 - Status line output matched "HTTP/2 410" - 340 bytes in 0.072 second response time [06:11:30] RECOVERY - cp201 Varnish Backends on cp201 is OK: All 32 backends are healthy [06:11:36] RECOVERY - mw153 MediaWiki Rendering on mw153 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.204 second response time [06:11:41] RECOVERY - cp191 Varnish Backends on cp191 is OK: All 32 backends are healthy [06:12:13] RECOVERY - cp171 Varnish Backends on cp171 is OK: All 32 backends are healthy [06:12:51] PROBLEM - mw153 Current Load on mw153 is WARNING: LOAD WARNING - total load average: 8.13, 20.97, 14.54 [06:14:51] RECOVERY - mw153 Current Load on mw153 is OK: LOAD OK - total load average: 6.58, 15.99, 13.48 [06:39:07] RECOVERY - mw153.fsslc.wtnet SSL Check on sslhost is OK: OK - Certificate 'CloudFlare Origin Certificate' will expire on Tue 03 Apr 2040 12:14:00 PM GMT +0000. [06:50:16] [02CreateWikiLoadout] 07lihaohong6 created 03streaming-jobs (+2 new commits) 13https://github.com/miraheze/CreateWikiLoadout/compare/abe0a0b1c6e4^...6ada9672444c [06:50:16] 02CreateWikiLoadout/03streaming-jobs 07Peter Li 03abe0a0b Use a new job to import and do a streaming import [06:50:17] 02CreateWikiLoadout/03streaming-jobs 07Peter Li 036ada967 Delete old main page [06:54:32] !log [petramagna@test151] starting deploy of {'folders': '1.46/extensions/CreateWikiLoadout'} to test151 [06:54:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:55:27] !log [petramagna@test151] starting deploy of {'folders': '1.46/extensions/CreateWikiLoadout'} to test151 [06:55:28] !log [petramagna@test151] finished deploy of {'folders': '1.46/extensions/CreateWikiLoadout'} to test151 - SUCCESS in 0s [06:55:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:55:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:56:01] [02CreateWiki] 07Reception123 pushed 1 new commit to 03main 13https://github.com/miraheze/CreateWiki/commit/546f8be7be54b0d94570fed3c0f08d102efeecd0 [06:56:01] 02CreateWiki/03main 07Reception123 03546f8be script to remove wikis whose exemptions have expired (#834)… [06:56:01] [02CreateWiki] 07Reception123 merged pull request #834: script to remove wikis whose exemptions have expired (03main...03Reception123-patch-1) 13https://github.com/miraheze/CreateWiki/pull/834 [06:56:02] [02CreateWiki] 07Reception123 04deleted 03Reception123-patch-1 at 03455c69d 13https://api.github.com/repos/miraheze/CreateWiki/commit/455c69d [06:56:46] !log [reception@mwtask181] starting deploy of {'versions': '1.45', 'upgrade_extensions': 'CreateWiki'} to all [06:56:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:00:36] !log [reception@mwtask181] starting deploy of {'versions': '1.45', 'upgrade_extensions': 'CreateWiki'} to all [07:00:37] !log [reception@mwtask181] finished deploy of {'versions': '1.45', 'upgrade_extensions': 'CreateWiki'} to all - SUCCESS in 0s [07:00:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:00:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:00:55] !log [reception@mwtask181] starting deploy of {'force_upgrade': True, 'versions': '1.45', 'upgrade_extensions': 'CreateWiki'} to all [07:00:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:02:05] !log [reception@mwtask181] finished deploy of {'force_upgrade': True, 'versions': '1.45', 'upgrade_extensions': 'CreateWiki'} to all - SUCCESS in 70s [07:02:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:03:18] miraheze/CreateWiki - Reception123 the build passed. [07:03:22] !log [reception@mwtask181] starting deploy of {'l10n': True, 'versions': '1.45'} to all [07:03:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:04:49] [02ManageWiki] 07Reception123 merged pull request #791: Add expiry option for inactive exempt wikis (03main...03Reception123-patch-2) 13https://github.com/miraheze/ManageWiki/pull/791 [07:04:49] [02ManageWiki] 07Reception123 pushed 1 new commit to 03main 13https://github.com/miraheze/ManageWiki/commit/fc7e48cc6310c2c0d228592e3a35381e024af9f7 [07:04:49] 02ManageWiki/03main 07Reception123 03fc7e48c Add expiry option for inactive exempt wikis (#791)… [07:04:51] [02ManageWiki] 07Reception123 04deleted 03Reception123-patch-2 at 030c39f85 13https://api.github.com/repos/miraheze/ManageWiki/commit/0c39f85 [07:06:56] !log [reception@mwtask181] starting deploy of {'l10n': True, 'versions': '1.45', 'upgrade_extensions': 'ManageWiki'} to all [07:07:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:07:43] !log [petramagna@test151] starting deploy of {'config': True} to test151 [07:07:44] !log [petramagna@test151] finished deploy of {'config': True} to test151 - SUCCESS in 0s [07:07:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:07:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:10:01] miraheze/ManageWiki - Reception123 the build passed. [07:11:20] !log [reception@mwtask181] finished deploy of {'l10n': True, 'versions': '1.45'} to all - SUCCESS in 478s [07:11:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:12:10] !log [reception@mwtask181] finished deploy of {'l10n': True, 'versions': '1.45', 'upgrade_extensions': 'ManageWiki'} to all - SUCCESS in 314s [07:12:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:30:10] [02WikiDiscover] 07Reception123 created 03Reception123-patch-2 (+1 new commit) 13https://github.com/miraheze/WikiDiscover/commit/81e315d3ec21 [07:30:10] 02WikiDiscover/03Reception123-patch-2 07Reception123 0381e315d add exempt expiry to Inactive exemption table [07:30:13] [02WikiDiscover] 07Reception123 opened pull request #163: add exempt expiry to Inactive exemption table (03main...03Reception123-patch-2) 13https://github.com/miraheze/WikiDiscover/pull/163 [07:34:14] miraheze/WikiDiscover - Reception123 the build passed. [07:45:52] [02mw-config] 07Reception123 created 03Reception123-patch-1 (+1 new commit) 13https://github.com/miraheze/mw-config/commit/c294836f90fe [07:45:53] 02mw-config/03Reception123-patch-1 07Reception123 03c294836 set config for DP exemption expiry [07:45:56] [02mw-config] 07Reception123 opened pull request #6512: set config for DP exemption expiry (03main...03Reception123-patch-1) 13https://github.com/miraheze/mw-config/pull/6512 [07:47:10] miraheze/mw-config - Reception123 the build passed. [07:48:48] [02mw-config] 07Reception123 merged pull request #6512: set config for DP exemption expiry (03main...03Reception123-patch-1) 13https://github.com/miraheze/mw-config/pull/6512 [07:48:48] [02mw-config] 07Reception123 pushed 1 new commit to 03main 13https://github.com/miraheze/mw-config/commit/94d9b1783b1c41db19a64fe67c689673f830409e [07:48:50] 02mw-config/03main 07Reception123 0394d9b17 set config for DP exemption expiry (#6512) [07:48:52] [02mw-config] 07Reception123 04deleted 03Reception123-patch-1 at 03c294836 13https://api.github.com/repos/miraheze/mw-config/commit/c294836 [07:48:55] !log [reception@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all [07:48:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:49:20] !log [reception@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 25s [07:49:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:50:02] miraheze/mw-config - Reception123 the build passed. [07:50:50] [02WikiDiscover] 07Reception123 pushed 1 new commit to 03Reception123-patch-2 13https://github.com/miraheze/WikiDiscover/commit/c4d46008ec166095381eb84e6e3cb8ece82a5616 [07:50:50] 02WikiDiscover/03Reception123-patch-2 07Reception123 03c4d4600 Update WikiDiscoverExemptWikisPager.php [07:55:02] miraheze/WikiDiscover - Reception123 the build passed. [07:56:13] [02CreateWikiLoadout] 07lihaohong6 pushed 1 new commit to 03streaming-jobs 13https://github.com/miraheze/CreateWikiLoadout/commit/fa655d24d1d113ef63f5cc9a0776834b51ed5345 [07:56:13] 02CreateWikiLoadout/03streaming-jobs 07Peter Li 03fa655d2 Improve help message display in RequestWiki form [07:57:21] !log [petramagna@test151] starting deploy of {'folders': '1.46/extensions/CreateWikiLoadout'} to test151 [07:57:22] !log [petramagna@test151] finished deploy of {'folders': '1.46/extensions/CreateWikiLoadout'} to test151 - SUCCESS in 0s [07:57:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:57:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:31:31] [02WikiDiscover] 07Reception123 pushed 1 new commit to 03Reception123-patch-2 13https://github.com/miraheze/WikiDiscover/commit/971665328d2c3a16ede85b2fe9e37e2bdd6f5c80 [08:31:31] 02WikiDiscover/03Reception123-patch-2 07Reception123 039716653 Update en.json [08:31:57] [02WikiDiscover] 07Reception123 pushed 1 new commit to 03Reception123-patch-2 13https://github.com/miraheze/WikiDiscover/commit/868e8bd6978684c4805c8dba0b7adc7bdde77cd0 [08:31:57] 02WikiDiscover/03Reception123-patch-2 07Reception123 03868e8bd Update qqq.json [08:34:29] miraheze/WikiDiscover - Reception123 the build has errored. [08:47:30] PROBLEM - cp201 Varnish Backends on cp201 is CRITICAL: 1 backends are down. mw193 [08:47:50] PROBLEM - mw193 MediaWiki Rendering on mw193 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:48:11] PROBLEM - mw193 HTTPS on mw193 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/2 502 [08:48:13] PROBLEM - cp171 Varnish Backends on cp171 is CRITICAL: 1 backends are down. mw193 [08:48:26] PROBLEM - cp191 Varnish Backends on cp191 is CRITICAL: 1 backends are down. mw193 [08:49:07] PROBLEM - mw193 Check unit status of php8.4-fpm_check_restart on mw193 is CRITICAL: CRITICAL: Status of the systemd unit php8.4-fpm_check_restart [08:49:30] RECOVERY - cp201 Varnish Backends on cp201 is OK: All 32 backends are healthy [08:49:35] PROBLEM - mw193 Current Load on mw193 is WARNING: LOAD WARNING - total load average: 19.86, 23.78, 14.38 [08:49:45] RECOVERY - mw193 MediaWiki Rendering on mw193 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.273 second response time [08:50:07] RECOVERY - mw193 HTTPS on mw193 is OK: HTTP OK: HTTP/2 410 - Status line output matched "HTTP/2 410" - 340 bytes in 0.084 second response time [08:50:13] RECOVERY - cp171 Varnish Backends on cp171 is OK: All 32 backends are healthy [08:50:19] I think that was an OOM [08:50:25] !log [wwr@mwtask171] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php updateSpecialPages --wiki=teflpediawiki (END - exit=0) [08:50:25] RECOVERY - cp191 Varnish Backends on cp191 is OK: All 32 backends are healthy [08:50:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:51:34] RECOVERY - mw193 Current Load on mw193 is OK: LOAD OK - total load average: 9.78, 18.74, 13.68 [08:52:16] It was php getting killed [08:52:21] It looks like it keeps OOMing [08:57:02] [02ssl] 07RhinosF1 approved pull request #928 13https://github.com/miraheze/ssl/pull/928#pullrequestreview-5049532205 [08:57:11] [02ssl] 07RhinosF1 merged 07YTFGolf's pull request #928: T15881: Redirect robloxblocktaleswiki to blocktales.miraheze.org (03main...03YTFGolf-patch-1) 13https://github.com/miraheze/ssl/pull/928 [08:57:12] [02ssl] 07RhinosF1 pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/35ea864d4280a7fa79eb53cb7e0bb81f005634e9 [08:57:12] 02ssl/03main 07WWR 0335ea864 T15881: Redirect robloxblocktaleswiki to blocktales.miraheze.org (#928)… [08:57:13] [02ssl] 07RhinosF1 04deleted 03YTFGolf-patch-1 at 03b2b1a02 13https://api.github.com/repos/miraheze/ssl/commit/b2b1a02 [08:57:37] [02CreateWikiLoadout] 07lihaohong6 pushed 1 new commit to 03streaming-jobs 13https://github.com/miraheze/CreateWikiLoadout/commit/2f2edf3c3976db7ec190436eb3ba2326b4cc2cf0 [08:57:37] 02CreateWikiLoadout/03streaming-jobs 07Peter Li 032f2edf3 Switch from using a job to a maintenance script… [08:59:04] !log [petramagna@test151] starting deploy of {'folders': '1.46/extensions/CreateWikiLoadout'} to test151 [08:59:05] !log [petramagna@test151] finished deploy of {'folders': '1.46/extensions/CreateWikiLoadout'} to test151 - SUCCESS in 0s [08:59:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:59:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:59:56] PROBLEM - matomo151 Current Load on matomo151 is WARNING: LOAD WARNING - total load average: 15.30, 13.39, 11.36 [09:00:20] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/5b6e6b9303fa015c8a806ef95825078d00f3de90 [09:00:20] 02ssl/03main 07WikiTideBot 035b6e6b9 Bot: Auto-update domain lists [09:09:55] RECOVERY - matomo151 Current Load on matomo151 is OK: LOAD OK - total load average: 11.26, 12.78, 12.33 [09:15:22] PROBLEM - mw163 HTTPS on mw163 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Connection timed out after 10005 milliseconds [09:15:30] PROBLEM - cp201 Varnish Backends on cp201 is CRITICAL: 1 backends are down. mw163 [09:15:31] PROBLEM - mw163 MediaWiki Rendering on mw163 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:16:11] PROBLEM - cp191 Varnish Backends on cp191 is CRITICAL: 1 backends are down. mw163 [09:16:13] PROBLEM - cp171 Varnish Backends on cp171 is CRITICAL: 1 backends are down. mw163 [09:17:03] PROBLEM - mw163 Current Load on mw163 is CRITICAL: LOAD CRITICAL - total load average: 19.52, 25.50, 15.93 [09:17:17] RECOVERY - mw163 HTTPS on mw163 is OK: HTTP OK: HTTP/2 410 - Status line output matched "HTTP/2 410" - 340 bytes in 0.084 second response time [09:17:26] RECOVERY - mw163 MediaWiki Rendering on mw163 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.215 second response time [09:17:30] RECOVERY - cp201 Varnish Backends on cp201 is OK: All 32 backends are healthy [09:18:10] RECOVERY - cp191 Varnish Backends on cp191 is OK: All 32 backends are healthy [09:18:13] RECOVERY - cp171 Varnish Backends on cp171 is OK: All 32 backends are healthy [09:18:59] RECOVERY - mw163 Current Load on mw163 is OK: LOAD OK - total load average: 10.33, 20.00, 15.03 [09:53:05] !log [petramagna@test151] sudo -u www-data php /srv/mediawiki/1.46/maintenance/run.php importDump --wiki=loadout1wikibeta /home/petramagna/loadout.xml --no-updates (START) [09:53:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:53:20] !log [petramagna@test151] sudo -u www-data php /srv/mediawiki/1.46/maintenance/run.php importDump --wiki=loadout1wikibeta /home/petramagna/loadout.xml --no-updates (END - exit=0) [09:53:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:58:13] [02CreateWikiLoadout] 07lihaohong6 pushed 1 new commit to 03streaming-jobs 13https://github.com/miraheze/CreateWikiLoadout/commit/3503a0a80940188fe6c27b6be7fc3756aacfb30a [09:58:13] 02CreateWikiLoadout/03streaming-jobs 07Peter Li 033503a0a Add more logger invocations for better timing tracking [09:58:30] !log [petramagna@test151] starting deploy of {'folders': '1.46/extensions/CreateWikiLoadout'} to test151 [09:58:31] !log [petramagna@test151] finished deploy of {'folders': '1.46/extensions/CreateWikiLoadout'} to test151 - SUCCESS in 0s [09:58:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:58:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:00:14] !log imported manual DP exemption expiry dates into cw_wikis [10:00:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:10:03] [02MirahezeRequests] 07Reception123 pushed 1 new commit to 03requestaccount 13https://github.com/miraheze/MirahezeRequests/commit/ab9d3c9dbe3cde0badf2b54e86705cfb4d88a87a [10:10:03] 02MirahezeRequests/03requestaccount 07Reception123 03ab9d3c9 rm unrelated files [10:11:28] !log [petramagna@test151] sudo -u www-data php /srv/mediawiki/1.46/maintenance/run.php CreateWikiLoadot:ImportLoadoutXmlDump --wiki=loadout6wikibeta --xml=/home/petramagna/loadout.xml (END - exit=256) [10:11:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:12:09] miraheze/MirahezeRequests - Reception123 the build has errored. [10:13:49] !log [petramagna@test151] sudo -u www-data php /srv/mediawiki/1.46/maintenance/run.php CreateWikiLoadout:ImportLoadoutXmlDump --wiki=loadout6wikibeta --xml=/home/petramagna/loadout.xml (END - exit=0) [10:13:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:21:02] [02MirahezeRequests] 07Reception123 pushed 1 new commit to 03requestaccount 13https://github.com/miraheze/MirahezeRequests/commit/f201d8f5104f125acbc4202bda2fcffba4a05c90 [10:21:02] 02MirahezeRequests/03requestaccount 07Reception123 03f201d8f Merge branch 'main' into requestaccount [10:23:37] miraheze/MirahezeRequests - Reception123 the build has errored. [10:43:28] [02CreateWikiLoadout] 07lihaohong6 04force-pushed 03streaming-jobs from 033503a0a to 0319e458c 13https://api.github.com/repos/miraheze/CreateWikiLoadout/commits/streaming-jobs [10:43:28] 02CreateWikiLoadout/03streaming-jobs 07Peter Li 036f41cfb Add more logger invocations for better timing tracking [10:43:29] 02CreateWikiLoadout/03streaming-jobs 07Peter Li 0319e458c Experimentally delegate to core script [10:43:53] !log [petramagna@test151] starting deploy of {'folders': '1.46/extensions/CreateWikiLoadout'} to test151 [10:43:54] !log [petramagna@test151] finished deploy of {'folders': '1.46/extensions/CreateWikiLoadout'} to test151 - SUCCESS in 0s [10:43:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:44:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:47:28] !log [petramagna@test151] starting deploy of {'l10n': True, 'extension_list': True, 'folders': '1.46/extensions/CreateWikiLoadout', 'versions': '1.46'} to test151 [10:47:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:48:21] !log [petramagna@test151] finished deploy of {'l10n': True, 'extension_list': True, 'folders': '1.46/extensions/CreateWikiLoadout', 'versions': '1.46'} to test151 - SUCCESS in 53s [10:48:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:51:20] [02CreateWikiLoadout] 07lihaohong6 merged 03streaming-jobs into 03main 13https://github.com/miraheze/CreateWikiLoadout/compare/ea4fe12f7fbb...19e458cd4ae2 [11:56:26] PROBLEM - matomo151 Current Load on matomo151 is WARNING: LOAD WARNING - total load average: 14.81, 13.87, 12.55 [12:06:05] PROBLEM - matomo151 Current Load on matomo151 is CRITICAL: LOAD CRITICAL - total load average: 16.73, 15.35, 13.95 [12:08:01] PROBLEM - matomo151 Current Load on matomo151 is WARNING: LOAD WARNING - total load average: 15.30, 15.17, 14.04 [12:11:52] PROBLEM - matomo151 Current Load on matomo151 is CRITICAL: LOAD CRITICAL - total load average: 16.21, 15.56, 14.43 [12:15:44] PROBLEM - matomo151 Current Load on matomo151 is WARNING: LOAD WARNING - total load average: 13.95, 15.21, 14.59 [12:21:44] PROBLEM - matomo151 Current Load on matomo151 is CRITICAL: LOAD CRITICAL - total load average: 16.37, 15.02, 14.58 [12:25:10] PROBLEM - db161 Current Load on db161 is CRITICAL: LOAD CRITICAL - total load average: 15.36, 12.73, 9.07 [12:27:44] PROBLEM - matomo151 Current Load on matomo151 is WARNING: LOAD WARNING - total load average: 13.04, 15.37, 15.04 [12:29:10] PROBLEM - db161 Current Load on db161 is WARNING: LOAD WARNING - total load average: 7.78, 10.51, 9.05 [12:31:10] RECOVERY - db161 Current Load on db161 is OK: LOAD OK - total load average: 7.81, 9.45, 8.83 [12:33:44] PROBLEM - matomo151 Current Load on matomo151 is CRITICAL: LOAD CRITICAL - total load average: 16.93, 15.68, 15.20 [12:52:02] PROBLEM - db161 Current Load on db161 is CRITICAL: LOAD CRITICAL - total load average: 12.23, 11.27, 9.88 [12:55:58] PROBLEM - db161 Current Load on db161 is WARNING: LOAD WARNING - total load average: 10.85, 11.23, 10.15 [12:57:56] RECOVERY - db161 Current Load on db161 is OK: LOAD OK - total load average: 7.39, 9.73, 9.72 [13:05:46] PROBLEM - db161 Current Load on db161 is WARNING: LOAD WARNING - total load average: 10.11, 10.51, 10.13 [13:07:44] RECOVERY - db161 Current Load on db161 is OK: LOAD OK - total load average: 8.89, 9.96, 9.97 [13:17:29] PROBLEM - db161 Current Load on db161 is WARNING: LOAD WARNING - total load average: 10.23, 10.73, 10.29 [13:19:27] RECOVERY - db161 Current Load on db161 is OK: LOAD OK - total load average: 8.18, 10.00, 10.09 [13:23:21] PROBLEM - db161 Current Load on db161 is WARNING: LOAD WARNING - total load average: 10.52, 10.50, 10.30 [13:27:17] PROBLEM - db161 Current Load on db161 is CRITICAL: LOAD CRITICAL - total load average: 15.01, 12.18, 10.95 [13:31:55] PROBLEM - phorge171 Current Load on phorge171 is CRITICAL: LOAD CRITICAL - total load average: 8.04, 6.33, 3.56 [13:33:11] PROBLEM - db161 Current Load on db161 is WARNING: LOAD WARNING - total load average: 9.16, 11.51, 11.24 [13:33:55] RECOVERY - phorge171 Current Load on phorge171 is OK: LOAD OK - total load average: 4.81, 5.70, 3.68 [13:39:10] PROBLEM - db161 Current Load on db161 is CRITICAL: LOAD CRITICAL - total load average: 14.09, 11.31, 10.99 [13:41:10] PROBLEM - db161 Current Load on db161 is WARNING: LOAD WARNING - total load average: 10.70, 11.63, 11.20 [13:43:10] PROBLEM - db161 Current Load on db161 is CRITICAL: LOAD CRITICAL - total load average: 12.37, 11.44, 11.14 [13:45:10] PROBLEM - db161 Current Load on db161 is WARNING: LOAD WARNING - total load average: 10.10, 10.88, 10.98 [13:47:10] PROBLEM - db161 Current Load on db161 is CRITICAL: LOAD CRITICAL - total load average: 15.97, 13.07, 11.77 [13:49:10] PROBLEM - db161 Current Load on db161 is WARNING: LOAD WARNING - total load average: 8.43, 11.44, 11.36 [13:53:10] PROBLEM - db161 Current Load on db161 is CRITICAL: LOAD CRITICAL - total load average: 12.59, 11.44, 11.32 [13:53:44] PROBLEM - matomo151 Current Load on matomo151 is WARNING: LOAD WARNING - total load average: 14.68, 15.52, 16.00 [13:55:10] PROBLEM - db161 Current Load on db161 is WARNING: LOAD WARNING - total load average: 10.35, 11.26, 11.29 [13:57:44] PROBLEM - matomo151 Current Load on matomo151 is CRITICAL: LOAD CRITICAL - total load average: 16.14, 15.90, 16.03 [13:59:10] PROBLEM - db161 Current Load on db161 is CRITICAL: LOAD CRITICAL - total load average: 13.82, 12.56, 11.75 [13:59:44] PROBLEM - matomo151 Current Load on matomo151 is WARNING: LOAD WARNING - total load average: 15.97, 15.87, 16.00 [14:01:10] PROBLEM - db161 Current Load on db161 is WARNING: LOAD WARNING - total load average: 9.51, 11.31, 11.38 [14:01:44] PROBLEM - matomo151 Current Load on matomo151 is CRITICAL: LOAD CRITICAL - total load average: 16.81, 16.15, 16.08 [14:09:10] PROBLEM - db161 Current Load on db161 is CRITICAL: LOAD CRITICAL - total load average: 13.24, 10.52, 10.70 [14:11:10] PROBLEM - db161 Current Load on db161 is WARNING: LOAD WARNING - total load average: 11.75, 10.85, 10.80 [14:15:10] PROBLEM - db161 Current Load on db161 is CRITICAL: LOAD CRITICAL - total load average: 12.51, 11.33, 10.96 [14:17:10] PROBLEM - db161 Current Load on db161 is WARNING: LOAD WARNING - total load average: 10.05, 11.03, 10.92 [14:17:44] PROBLEM - matomo151 Current Load on matomo151 is WARNING: LOAD WARNING - total load average: 15.40, 15.77, 15.95 [14:19:44] PROBLEM - matomo151 Current Load on matomo151 is CRITICAL: LOAD CRITICAL - total load average: 16.18, 16.05, 16.04 [14:21:44] PROBLEM - matomo151 Current Load on matomo151 is WARNING: LOAD WARNING - total load average: 15.68, 15.85, 15.96 [14:23:44] PROBLEM - matomo151 Current Load on matomo151 is CRITICAL: LOAD CRITICAL - total load average: 16.64, 16.07, 16.02 [14:37:10] PROBLEM - db161 Current Load on db161 is CRITICAL: LOAD CRITICAL - total load average: 64.52, 29.90, 17.59 [14:43:44] PROBLEM - matomo151 Current Load on matomo151 is WARNING: LOAD WARNING - total load average: 15.52, 15.57, 15.96 [14:45:44] PROBLEM - matomo151 Current Load on matomo151 is CRITICAL: LOAD CRITICAL - total load average: 16.62, 15.93, 16.04 [14:57:44] PROBLEM - matomo151 Current Load on matomo151 is WARNING: LOAD WARNING - total load average: 13.30, 15.47, 16.00 [14:59:44] PROBLEM - matomo151 Current Load on matomo151 is CRITICAL: LOAD CRITICAL - total load average: 15.80, 15.79, 16.06 [15:23:44] PROBLEM - matomo151 Current Load on matomo151 is WARNING: LOAD WARNING - total load average: 12.04, 14.60, 15.64 [15:26:56] [02WikiDiscover] 07Reception123 pushed 1 new commit to 03Reception123-patch-2 13https://github.com/miraheze/WikiDiscover/commit/76159b2e28a9a8facb414329695f5ae03a59d48d [15:26:56] 02WikiDiscover/03Reception123-patch-2 07Reception123 0376159b2 wrong key name [15:31:42] miraheze/WikiDiscover - Reception123 the build passed. [15:35:10] PROBLEM - db161 Current Load on db161 is WARNING: LOAD WARNING - total load average: 2.48, 3.54, 11.22 [15:38:53] [02puppet] 07Universal-Omega pushed 1 new commit to 03opensearch-analysis-stconvert 13https://github.com/miraheze/puppet/commit/1ff3e434c1a7ddbbc0f166fd21605b90e36ea015 [15:38:54] 02puppet/03opensearch-analysis-stconvert 07CosmicAlpha 031ff3e43 Update [15:39:10] RECOVERY - db161 Current Load on db161 is OK: LOAD OK - total load average: 2.76, 3.27, 9.36 [15:39:44] RECOVERY - matomo151 Current Load on matomo151 is OK: LOAD OK - total load average: 11.56, 12.35, 13.46 [16:21:32] [02puppet] 07Universal-Omega pushed 1 new commit to 03opensearch-analysis-stconvert 13https://github.com/miraheze/puppet/commit/a1e1c9004860ec905cf4a465aed63f515b8e828c [16:21:32] 02puppet/03opensearch-analysis-stconvert 07CosmicAlpha 03a1e1c90 Update URL [16:23:33] [02puppet] 07Universal-Omega pushed 1 new commit to 03opensearch-analysis-stconvert 13https://github.com/miraheze/puppet/commit/fb679d5a136786e3ce4b251b19e189efc03c5a11 [16:23:33] 02puppet/03opensearch-analysis-stconvert 07CosmicAlpha 03fb679d5 Update URL [16:29:59] [02puppet] 07Universal-Omega merged pull request #4972: opensearch-mw: install the opensearch-analysis-stconvert plugin for CirrusSearch (03main...03opensearch-analysis-stconvert) 13https://github.com/miraheze/puppet/pull/4972 [16:30:00] [02puppet] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/cb0309c475417a67c22d05be08ce2f54cdd270c0 [16:30:00] 02puppet/03main 07CosmicAlpha 03cb0309c opensearch-mw: install the opensearch-analysis-stconvert plugin for CirrusSearch [16:30:01] [02puppet] 07Universal-Omega 04deleted 03opensearch-analysis-stconvert at 03fb679d5 13https://api.github.com/repos/miraheze/puppet/commit/fb679d5 [16:33:28] [02mw-config] 07SomeMWDev created 03optimize-mirahezefunctions (+4 new commits) 13https://github.com/miraheze/mw-config/compare/c5627caa467e^...907a7167d3b4 [16:33:28] 02mw-config/03optimize-mirahezefunctions 07SomeRandomDeveloper 03c5627ca MirahezeFunctions: Only call getSitenames() once… [16:33:28] 02mw-config/03optimize-mirahezefunctions 07SomeRandomDeveloper 03f1153c9 MirahezeFunctions: Remove redundant array_search()… [16:33:28] 02mw-config/03optimize-mirahezefunctions 07SomeRandomDeveloper 0346c6e28 MirahezeFunctions: Don't check other suffixes after determining server… [16:33:30] 02mw-config/03optimize-mirahezefunctions 07SomeRandomDeveloper 03907a716 MirahezeFunctions: Skip inner loop if URL is set in data… [16:33:57] [02mw-config] 07SomeMWDev opened pull request #6513: Optimize mirahezefunctions (03main...03optimize-mirahezefunctions) 13https://github.com/miraheze/mw-config/pull/6513 [16:35:03] miraheze/mw-config - SomeMWDev the build passed. [16:35:51] [02mw-config] 07SomeMWDev retitled PR #6513: "Optimize mirahezefunctions" ➜ "Optimize MirahezeFunctions" 13https://github.com/miraheze/mw-config/pull/6513 [16:39:46] [02mw-config] 07SomeMWDev pushed 1 new commit to 03optimize-mirahezefunctions 13https://github.com/miraheze/mw-config/commit/5583b1b28896c921d0005cd664d4327a2b080882 [16:39:46] 02mw-config/03optimize-mirahezefunctions 07SomeRandomDeveloper 035583b1b MirahezeFunctions: Reduce amount of iterations in getDatabaseClusters()… [16:54:46] [02puppet] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/94ba17084b45117392f44cad8c6d175daba229fc [16:54:46] 02puppet/03main 07CosmicAlpha 0394ba170 mediawiki_beta: remove base::dns::recurse… [16:59:34] [02puppet] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/03dc4f880722a784c3d2a279f75f5017c0d22d8b [16:59:34] 02puppet/03main 07CosmicAlpha 0303dc4f8 ns1: remove recursor… [17:09:00] [02puppet] 07Universal-Omega created 03nft-fix (+1 new commit) 13https://github.com/miraheze/puppet/commit/d778d8580db8 [17:09:00] 02puppet/03nft-fix 07CosmicAlpha 03d778d85 Fix to nftables to remove untracked rules [17:09:06] [02puppet] 07Universal-Omega opened pull request #4974: Fix to nftables to remove untracked rules (03main...03nft-fix) 13https://github.com/miraheze/puppet/pull/4974 [17:10:57] [02puppet] 07Universal-Omega merged pull request #4974: Fix to nftables to remove untracked rules (03main...03nft-fix) 13https://github.com/miraheze/puppet/pull/4974 [17:10:59] [02puppet] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/e0c211edf5e898941cdd6bc22d68f32e1b6a89de [17:11:00] [02puppet] 07Universal-Omega 04deleted 03nft-fix at 03d778d85 13https://api.github.com/repos/miraheze/puppet/commit/d778d85 [17:11:02] 02puppet/03main 07CosmicAlpha 03e0c211e Fix to nftables to remove untracked rules [17:52:08] [02puppet] 07Universal-Omega pushed 1 new commit to 03beta-nftables 13https://github.com/miraheze/puppet/commit/0fca1cc51967fd0827195c61793554b677ef5561 [17:52:08] 02puppet/03beta-nftables 07CosmicAlpha 030fca1cc Merge branch 'main' into beta-nftables [17:57:03] [02puppet] 07Universal-Omega merged pull request #4973: mediawiki_beta: fully switch to nftables (03main...03beta-nftables) 13https://github.com/miraheze/puppet/pull/4973 [17:57:03] [02puppet] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/58d5192011a6c0aa05359954b9d35919c0e613a6 [17:57:04] 02puppet/03main 07CosmicAlpha 0358d5192 mediawiki_beta: fully switch to nftables [17:57:06] [02puppet] 07Universal-Omega 04deleted 03beta-nftables at 030fca1cc 13https://api.github.com/repos/miraheze/puppet/commit/0fca1cc [17:57:21] PROBLEM - test151 ferm_active on test151 is UNKNOWN: NRPE: Command 'check_ferm_active' not defined [17:58:46] [02puppet] 07Universal-Omega created 03db172-nftables (+1 new commit) 13https://github.com/miraheze/puppet/commit/d8aea243baaf [17:58:46] 02puppet/03db172-nftables 07CosmicAlpha 03d8aea24 db172: fully switch to nftables [17:58:52] [02puppet] 07Universal-Omega opened pull request #4975: db172: fully switch to nftables (03main...03db172-nftables) 13https://github.com/miraheze/puppet/pull/4975 [18:01:38] [02puppet] 07Universal-Omega merged pull request #4975: db172: fully switch to nftables (03main...03db172-nftables) 13https://github.com/miraheze/puppet/pull/4975 [18:01:40] [02puppet] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/c202bdddd99fbd8f354f77a0a3b7c54993b3ff6e [18:01:42] [02puppet] 07Universal-Omega 04deleted 03db172-nftables at 03d8aea24 13https://api.github.com/repos/miraheze/puppet/commit/d8aea24 [18:01:43] 02puppet/03main 07CosmicAlpha 03c202bdd db172: fully switch to nftables [18:03:00] PROBLEM - db172 ferm_active on db172 is UNKNOWN: NRPE: Command 'check_ferm_active' not defined [18:04:28] [02puppet] 07Universal-Omega created 03speedscope211-nftables (+1 new commit) 13https://github.com/miraheze/puppet/commit/88288ca00e69 [18:04:28] 02puppet/03speedscope211-nftables 07CosmicAlpha 0388288ca speedscope211: fully switch to nftables [18:04:34] [02puppet] 07Universal-Omega opened pull request #4976: speedscope211: fully switch to nftables (03main...03speedscope211-nftables) 13https://github.com/miraheze/puppet/pull/4976 [18:10:00] PROBLEM - speedscope211 ferm_active on speedscope211 is UNKNOWN: NRPE: Command 'check_ferm_active' not defined [18:15:28] !log [universalomega@speedscope211] Speedscope is down, I am working on a fix. [18:15:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:15:50] PROBLEM - speedscope211 Puppet on speedscope211 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 1 minute ago with 1 failures [18:17:22] PROBLEM - speedscope211 speedscope 3000 check on speedscope211 is CRITICAL: connect to address 127.0.0.1 and port 3000: Connection refused [18:17:37] PROBLEM - speedscope211 speedscope.wikitide.net HTTPS on speedscope211 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 295 bytes in 0.011 second response time [18:17:38] PROBLEM - speedscope211 HTTPS on speedscope211 is CRITICAL: HTTP CRITICAL: HTTP/2 502 - 113 bytes in 0.009 second response time [18:19:35] [02puppet] 07Universal-Omega pushed 1 new commit to 03speedscope211-nftables 13https://github.com/miraheze/puppet/commit/53aeaf88bb1976a859883341a90f5e0b68fa5c57 [18:19:36] 02puppet/03speedscope211-nftables 07CosmicAlpha 0353aeaf8 Add firewall-backend [18:25:28] [02puppet] 07Universal-Omega pushed 1 new commit to 03speedscope211-nftables 13https://github.com/miraheze/puppet/commit/20af90fd3f83e766d8c59fc651eb0bac92fa9983 [18:25:28] 02puppet/03speedscope211-nftables 07CosmicAlpha 0320af90f - [18:25:50] PROBLEM - speedscope211 Puppet on speedscope211 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[docker] [18:27:09] RECOVERY - speedscope211 speedscope 3000 check on speedscope211 is OK: TCP OK - 0.000 second response time on 127.0.0.1 port 3000 [18:27:16] RECOVERY - speedscope211 HTTPS on speedscope211 is OK: HTTP OK: HTTP/2 200 - 354 bytes in 0.013 second response time [18:27:17] RECOVERY - speedscope211 speedscope.wikitide.net HTTPS on speedscope211 is OK: HTTP OK: HTTP/1.1 200 OK - 2859 bytes in 0.026 second response time [18:27:50] RECOVERY - speedscope211 Puppet on speedscope211 is OK: OK: Puppet is currently enabled, last run 57 seconds ago with 0 failures [18:28:22] PROBLEM - graylog161 Puppet on graylog161 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:28:55] PROBLEM - os162 Puppet on os162 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:29:45] PROBLEM - mw163 Puppet on mw163 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:29:58] PROBLEM - mw151 Puppet on mw151 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:30:16] PROBLEM - os202 Puppet on os202 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:31:01] PROBLEM - cloud18 Puppet on cloud18 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:31:10] PROBLEM - db181 Puppet on db181 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:31:19] PROBLEM - ns2 Puppet on ns2 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:32:30] PROBLEM - reports171 Puppet on reports171 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:32:38] PROBLEM - os191 Puppet on os191 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:32:59] PROBLEM - mw181 Puppet on mw181 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:33:18] PROBLEM - db151 Puppet on db151 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:33:31] PROBLEM - eventgate182 Puppet on eventgate182 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:33:50] PROBLEM - os161 Puppet on os161 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:34:03] PROBLEM - swiftobject151 Puppet on swiftobject151 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:34:04] PROBLEM - mw201 Puppet on mw201 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:34:09] PROBLEM - swiftobject161 Puppet on swiftobject161 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:34:18] PROBLEM - db192 Puppet on db192 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:35:28] PROBLEM - mwtask181 Puppet on mwtask181 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:35:59] PROBLEM - cloud20 Puppet on cloud20 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:36:01] PROBLEM - mw183 Puppet on mw183 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:36:03] PROBLEM - cloud16 Puppet on cloud16 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:36:32] PROBLEM - mw182 Puppet on mw182 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:36:35] PROBLEM - ldap171 Puppet on ldap171 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:36:42] PROBLEM - mon181 Puppet on mon181 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:36:49] PROBLEM - mw152 Puppet on mw152 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:37:17] PROBLEM - cloud17 Puppet on cloud17 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:37:46] PROBLEM - swiftobject211 Puppet on swiftobject211 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:38:06] [02puppet] 07Universal-Omega pushed 1 new commit to 03speedscope211-nftables 13https://github.com/miraheze/puppet/commit/94f2aa4ca3e98978b66c573c2bcb0069a2f7baef [18:38:06] 02puppet/03speedscope211-nftables 07CosmicAlpha 0394f2aa4 Fix [18:38:19] PROBLEM - mattermost2 Puppet on mattermost2 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:38:28] PROBLEM - matomo151 Puppet on matomo151 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:38:36] PROBLEM - prometheus151 Puppet on prometheus151 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:38:55] [02puppet] 07Universal-Omega pushed 1 new commit to 03speedscope211-nftables 13https://github.com/miraheze/puppet/commit/ff7f535766e4eb1637b1b2c69c5cf65dd39e0636 [18:38:55] 02puppet/03speedscope211-nftables 07CosmicAlpha 03ff7f535 Fix [18:39:06] PROBLEM - mem201 Puppet on mem201 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:39:08] PROBLEM - swiftproxy161 Puppet on swiftproxy161 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:39:35] PROBLEM - cp201 Puppet on cp201 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:40:21] PROBLEM - mw162 Puppet on mw162 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:40:39] PROBLEM - changeprop202 Puppet on changeprop202 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:41:08] PROBLEM - swiftproxy171 Puppet on swiftproxy171 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:41:21] PROBLEM - mw202 Puppet on mw202 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:41:27] PROBLEM - mw161 Puppet on mw161 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:41:41] PROBLEM - rdb191 Puppet on rdb191 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:42:32] PROBLEM - mw172 Puppet on mw172 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:42:47] PROBLEM - mw203 Puppet on mw203 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:43:05] PROBLEM - llm191 Puppet on llm191 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:43:17] PROBLEM - puppet181 Puppet on puppet181 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:43:23] PROBLEM - swiftobject201 Puppet on swiftobject201 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:43:54] PROBLEM - mem161 Puppet on mem161 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:43:59] PROBLEM - mwtask171 Puppet on mwtask171 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:44:24] PROBLEM - cp171 Puppet on cp171 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:45:12] RECOVERY - cp171 Puppet on cp171 is OK: OK: Puppet is currently enabled, last run 12 seconds ago with 0 failures [18:45:23] RECOVERY - cp201 Puppet on cp201 is OK: OK: Puppet is currently enabled, last run 27 seconds ago with 0 failures [18:48:29] !log [universalomega@speedscope211] Speedscope fixed [18:48:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:48:51] RECOVERY - db181 Puppet on db181 is OK: OK: Puppet is currently enabled, last run 12 seconds ago with 0 failures [18:49:04] RECOVERY - cloud18 Puppet on cloud18 is OK: OK: Puppet is currently enabled, last run 29 seconds ago with 0 failures [18:49:16] RECOVERY - cloud17 Puppet on cloud17 is OK: OK: Puppet is currently enabled, last run 42 seconds ago with 0 failures [18:49:16] RECOVERY - db151 Puppet on db151 is OK: OK: Puppet is currently enabled, last run 40 seconds ago with 0 failures [18:49:29] RECOVERY - eventgate182 Puppet on eventgate182 is OK: OK: Puppet is currently enabled, last run 52 seconds ago with 0 failures [18:49:47] RECOVERY - cloud16 Puppet on cloud16 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [18:49:55] RECOVERY - db192 Puppet on db192 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [18:50:02] RECOVERY - matomo151 Puppet on matomo151 is OK: OK: Puppet is currently enabled, last run 5 seconds ago with 0 failures [18:50:05] RECOVERY - cloud20 Puppet on cloud20 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [18:50:20] RECOVERY - changeprop202 Puppet on changeprop202 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [18:50:22] RECOVERY - mattermost2 Puppet on mattermost2 is OK: OK: Puppet is currently enabled, last run 30 seconds ago with 0 failures [18:50:29] RECOVERY - graylog161 Puppet on graylog161 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [18:50:37] RECOVERY - ldap171 Puppet on ldap171 is OK: OK: Puppet is currently enabled, last run 45 seconds ago with 0 failures [18:50:53] RECOVERY - llm191 Puppet on llm191 is OK: OK: Puppet is currently enabled, last run 58 seconds ago with 0 failures [18:51:03] RECOVERY - mem201 Puppet on mem201 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [18:52:08] RECOVERY - mem161 Puppet on mem161 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [18:52:22] RECOVERY - ns2 Puppet on ns2 is OK: OK: Puppet is currently enabled, last run 58 seconds ago with 0 failures [18:52:26] RECOVERY - mon181 Puppet on mon181 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [18:53:08] RECOVERY - swiftproxy171 Puppet on swiftproxy171 is OK: OK: Puppet is currently enabled, last run 2 seconds ago with 0 failures [18:53:13] RECOVERY - swiftobject201 Puppet on swiftobject201 is OK: OK: Puppet is currently enabled, last run 10 seconds ago with 0 failures [18:53:14] PROBLEM - bast181 Current Load on bast181 is CRITICAL: LOAD CRITICAL - total load average: 5.04, 5.82, 2.73 [18:53:23] RECOVERY - prometheus151 Puppet on prometheus151 is OK: OK: Puppet is currently enabled, last run 23 seconds ago with 0 failures [18:53:25] RECOVERY - swiftobject161 Puppet on swiftobject161 is OK: OK: Puppet is currently enabled, last run 22 seconds ago with 0 failures [18:53:31] RECOVERY - swiftobject211 Puppet on swiftobject211 is OK: OK: Puppet is currently enabled, last run 30 seconds ago with 0 failures [18:53:34] RECOVERY - os161 Puppet on os161 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [18:53:38] RECOVERY - os202 Puppet on os202 is OK: OK: Puppet is currently enabled, last run 34 seconds ago with 0 failures [18:53:53] RECOVERY - swiftobject151 Puppet on swiftobject151 is OK: OK: Puppet is currently enabled, last run 51 seconds ago with 0 failures [18:54:01] PROBLEM - mw191 Puppet on mw191 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 2 minutes ago with 2 failures. Failed resources (up to 3 shown): Exec[git_pull_femiwiki-deploy-1.45],Exec[git_pull_3d2png] [18:54:15] PROBLEM - mwtask161 Puppet on mwtask161 is CRITICAL: CRITICAL: Puppet has 3 failures. Last run 2 minutes ago with 3 failures. Failed resources (up to 3 shown): Exec[git_pull_mathoid],Exec[git_pull_femiwiki-deploy-1.45],Exec[git_pull_3d2png] [18:54:24] RECOVERY - reports171 Puppet on reports171 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [18:54:29] PROBLEM - mw171 Puppet on mw171 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 2 minutes ago with 2 failures. Failed resources (up to 3 shown): Exec[git_pull_femiwiki-deploy-1.45],Exec[git_pull_3d2png] [18:54:41] RECOVERY - swiftproxy161 Puppet on swiftproxy161 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [18:54:43] PROBLEM - mw153 Puppet on mw153 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 2 minutes ago with 2 failures. Failed resources (up to 3 shown): Exec[git_pull_femiwiki-deploy-1.45],Exec[git_pull_3d2png] [18:54:51] RECOVERY - os191 Puppet on os191 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [18:54:52] RECOVERY - puppet181 Puppet on puppet181 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [18:54:56] RECOVERY - rdb191 Puppet on rdb191 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [18:54:59] RECOVERY - os162 Puppet on os162 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [18:55:08] PROBLEM - mw193 Puppet on mw193 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 3 minutes ago with 2 failures. Failed resources (up to 3 shown): Exec[git_pull_femiwiki-deploy-1.45],Exec[git_pull_3d2png] [18:55:17] PROBLEM - mw192 Puppet on mw192 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 3 minutes ago with 2 failures. Failed resources (up to 3 shown): Exec[git_pull_femiwiki-deploy-1.45],Exec[git_pull_3d2png] [18:55:26] PROBLEM - bast181 Current Load on bast181 is WARNING: LOAD WARNING - total load average: 0.60, 3.77, 2.37 [18:55:44] PROBLEM - mw173 Puppet on mw173 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 3 minutes ago with 2 failures. Failed resources (up to 3 shown): Exec[git_pull_femiwiki-deploy-1.45],Exec[git_pull_3d2png] [18:56:04] PROBLEM - mwtask151 Puppet on mwtask151 is CRITICAL: CRITICAL: Puppet has 3 failures. Last run 3 minutes ago with 3 failures. Failed resources (up to 3 shown): Exec[git_pull_mathoid],Exec[git_pull_femiwiki-deploy-1.45],Exec[git_pull_3d2png] [18:56:07] RECOVERY - mwtask171 Puppet on mwtask171 is OK: OK: Puppet is currently enabled, last run 2 seconds ago with 0 failures [18:56:11] RECOVERY - mwtask161 Puppet on mwtask161 is OK: OK: Puppet is currently enabled, last run 7 seconds ago with 0 failures [18:56:14] RECOVERY - mw193 Puppet on mw193 is OK: OK: Puppet is currently enabled, last run 11 seconds ago with 0 failures [18:56:19] RECOVERY - mw201 Puppet on mw201 is OK: OK: Puppet is currently enabled, last run 10 seconds ago with 0 failures [18:56:21] RECOVERY - mw163 Puppet on mw163 is OK: OK: Puppet is currently enabled, last run 18 seconds ago with 0 failures [18:56:27] RECOVERY - mw171 Puppet on mw171 is OK: OK: Puppet is currently enabled, last run 24 seconds ago with 0 failures [18:56:28] RECOVERY - mwtask151 Puppet on mwtask151 is OK: OK: Puppet is currently enabled, last run 23 seconds ago with 0 failures [18:56:28] RECOVERY - mw182 Puppet on mw182 is OK: OK: Puppet is currently enabled, last run 20 seconds ago with 0 failures [18:56:32] RECOVERY - mw172 Puppet on mw172 is OK: OK: Puppet is currently enabled, last run 29 seconds ago with 0 failures [18:56:41] RECOVERY - mw153 Puppet on mw153 is OK: OK: Puppet is currently enabled, last run 39 seconds ago with 0 failures [18:56:41] RECOVERY - mw192 Puppet on mw192 is OK: OK: Puppet is currently enabled, last run 1 second ago with 0 failures [18:56:41] RECOVERY - mw203 Puppet on mw203 is OK: OK: Puppet is currently enabled, last run 38 seconds ago with 0 failures [18:56:47] RECOVERY - mw173 Puppet on mw173 is OK: OK: Puppet is currently enabled, last run 41 seconds ago with 0 failures [18:56:48] RECOVERY - mw181 Puppet on mw181 is OK: OK: Puppet is currently enabled, last run 45 seconds ago with 0 failures [18:56:54] RECOVERY - mw191 Puppet on mw191 is OK: OK: Puppet is currently enabled, last run 49 seconds ago with 0 failures [18:56:54] RECOVERY - mw152 Puppet on mw152 is OK: OK: Puppet is currently enabled, last run 52 seconds ago with 0 failures [18:57:00] RECOVERY - mw161 Puppet on mw161 is OK: OK: Puppet is currently enabled, last run 55 seconds ago with 0 failures [18:57:05] RECOVERY - mw202 Puppet on mw202 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [18:57:11] RECOVERY - mw162 Puppet on mw162 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [18:57:18] RECOVERY - mw183 Puppet on mw183 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [18:57:25] RECOVERY - mwtask181 Puppet on mwtask181 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [18:57:27] RECOVERY - bast181 Current Load on bast181 is OK: LOAD OK - total load average: 0.18, 2.57, 2.10 [18:57:31] RECOVERY - mw151 Puppet on mw151 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [18:58:50] [02puppet] 07Universal-Omega retitled PR #4976: "speedscope211: fully switch to nftables" ➜ "speedscope211: fully switch to nftables and fix docker for it" 13https://github.com/miraheze/puppet/pull/4976 [18:58:59] [02puppet] 07Universal-Omega merged pull request #4976: speedscope211: fully switch to nftables and fix docker for it (03main...03speedscope211-nftables) 13https://github.com/miraheze/puppet/pull/4976 [18:59:01] [02puppet] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/176e67ea6c7a5c02525ee9214d1f97710f6fb07e [18:59:03] [02puppet] 07Universal-Omega 04deleted 03speedscope211-nftables at 03ff7f535 13https://api.github.com/repos/miraheze/puppet/commit/ff7f535 [18:59:04] 02puppet/03main 07CosmicAlpha 03176e67e speedscope211: fully switch to nftables and fix docker for it [19:02:07] PROBLEM - puppet181 Check unit status of git_pull_puppet on puppet181 is CRITICAL: CRITICAL: Status of the systemd unit git_pull_puppet [19:10:36] RECOVERY - puppet181 Check unit status of git_pull_puppet on puppet181 is OK: OK: Status of the systemd unit git_pull_puppet [19:33:32] [02puppet] 07Universal-Omega created 03no-ai-dry-run (+1 new commit) 13https://github.com/miraheze/puppet/commit/cdb9ab9dde9d [19:33:32] 02puppet/03no-ai-dry-run 07CosmicAlpha 03cdb9ab9 Disable dry run in OpenAI config [19:33:38] [02puppet] 07Universal-Omega opened pull request #4977: Disable dry run in OpenAI config (03main...03no-ai-dry-run) 13https://github.com/miraheze/puppet/pull/4977 [20:11:25] [02puppet] 07Universal-Omega merged pull request #4977: Disable dry run in OpenAI config (03main...03no-ai-dry-run) 13https://github.com/miraheze/puppet/pull/4977 [20:11:27] [02puppet] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/1a606c6898c35d50b18708c7b17620ee555b01d9 [20:11:29] [02puppet] 07Universal-Omega 04deleted 03no-ai-dry-run at 03cdb9ab9 13https://api.github.com/repos/miraheze/puppet/commit/cdb9ab9 [20:11:30] 02puppet/03main 07CosmicAlpha 031a606c6 Disable dry run in OpenAI config [21:00:22] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/a7ab41dd8e9ff83a854c0dbbeab4fb30349b3dcb [21:00:22] 02ssl/03main 07WikiTideBot 03a7ab41d Bot: Auto-update domain lists [22:11:09] [02python-functions] 07renovate[bot] created 03renovate/all-deps (+1 new commit) 13https://github.com/miraheze/python-functions/commit/a3e6251c30c1 [22:11:09] 02python-functions/03renovate/all-deps 07renovate[bot] 03a3e6251 chore(deps): update dependency coverage to v7.16.0 [22:56:29] [02mw-config] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/mw-config/commit/750044819a67f8700c3a4c6c6449f43b38847c1a [22:56:29] 02mw-config/03main 07dependabot[bot] 037500448 Update justinrainbow/json-schema requirement from 6.10.0 to 6.11.0 (#6507)… [22:56:29] [02mw-config] 07Universal-Omega merged 07dependabot[bot]'s pull request #6507: Update justinrainbow/json-schema requirement from 6.10.0 to 6.11.0 (03main...03dependabot/composer/justinrainbow/json-schema-6.11.0) 13https://github.com/miraheze/mw-config/pull/6507 [22:56:31] [02mw-config] 07Universal-Omega 04deleted 03dependabot/composer/justinrainbow/json-schema-6.11.0 at 037555919 13https://api.github.com/repos/miraheze/mw-config/commit/7555919 [22:57:40] miraheze/mw-config - Universal-Omega the build passed. [23:00:20] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/2c5be5eccedf438bd77158631cd8f43a379e791a [23:00:20] 02ssl/03main 07WikiTideBot 032c5be5e Bot: Auto-update domain lists