[00:06:03] RECOVERY - cp38 Disk Space on cp38 is OK: DISK OK - free space: / 58881MiB (12% inode=99%); [00:36:22] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks [00:36:23] mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=ysmwikiwiki 36001 --e 38000 (running for 56:13) [00:36:24] mwtask161: not running [00:36:25] mwtask171: not running [00:36:26] mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=tagpediawiki 1 --e 2000 (running for 01:14) [00:38:57] !log [blankeclair@mwtask181] runRefreshLinksChunked: [571/1178] taisakuwikiwiki exited with 1 [00:38:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:01:33] [02WikiDiscover] 07Universal-Omega created 03match (+1 new commit) 13https://github.com/miraheze/WikiDiscover/commit/86d74374fb0e [01:01:33] 02WikiDiscover/03match 07CosmicAlpha 0386d7437 Minor simplification using match [01:01:37] [02WikiDiscover] 07Universal-Omega opened pull request #137: Minor simplification using match (03master...03match) 13https://github.com/miraheze/WikiDiscover/pull/137 [01:06:14] miraheze/WikiDiscover - Universal-Omega the build passed. [01:06:49] [02WikiDiscover] 07Universal-Omega merged pull request #137: Minor simplification using match (03master...03match) 13https://github.com/miraheze/WikiDiscover/pull/137 [01:06:51] [02WikiDiscover] 07Universal-Omega pushed 1 new commit to 03master 13https://github.com/miraheze/WikiDiscover/commit/7771f0594ecd17f3ec0ba57fb8ad9ad7b4d2610d [01:06:52] 02WikiDiscover/03master 07CosmicAlpha 037771f05 Minor simplification using match (#137) [01:06:54] [02WikiDiscover] 07Universal-Omega 04deleted 03match at 0386d7437 13https://github.com/miraheze/WikiDiscover/commit/86d7437 [01:11:29] miraheze/WikiDiscover - Universal-Omega the build passed. [01:13:04] [02WikiDiscover] 07coderabbitai[bot] commented on pull request #137: --- […] 13https://github.com/miraheze/WikiDiscover/pull/137#issuecomment-2774085672 [01:18:54] [02WikiDiscover] 07Universal-Omega created 03localization (+1 new commit) 13https://github.com/miraheze/WikiDiscover/commit/2f3f54327123 [01:18:54] 02WikiDiscover/03localization 07CosmicAlpha 032f3f543 Add some missing localization [01:18:59] [02WikiDiscover] 07Universal-Omega opened pull request #138: Add some missing localization (03master...03localization) 13https://github.com/miraheze/WikiDiscover/pull/138 [01:19:06] [02WikiDiscover] 07coderabbitai[bot] commented on pull request #138: --- […] 13https://github.com/miraheze/WikiDiscover/pull/138#issuecomment-2774092031 [01:20:25] [02WikiDiscover] 07Universal-Omega pushed 1 new commit to 03localization 13https://github.com/miraheze/WikiDiscover/commit/a7fbd2ec8c30e2645aa43b61cc703d56cd95f8e4 [01:20:25] 02WikiDiscover/03localization 07CosmicAlpha 03a7fbd2e Update [01:22:58] miraheze/WikiDiscover - Universal-Omega the build has errored. [01:25:15] [02WikiDiscover] 07Universal-Omega pushed 1 new commit to 03localization 13https://github.com/miraheze/WikiDiscover/commit/96071ca0c91b740d74e764938c23a4816b36a257 [01:25:16] 02WikiDiscover/03localization 07CosmicAlpha 0396071ca Update [01:27:59] miraheze/WikiDiscover - Universal-Omega the build has errored. [01:28:09] [02WikiDiscover] 07Universal-Omega pushed 1 new commit to 03localization 13https://github.com/miraheze/WikiDiscover/commit/b481a94f466c0f78303c3fdd532e585b3c297ba7 [01:28:09] 02WikiDiscover/03localization 07CosmicAlpha 03b481a94 Update [01:30:43] miraheze/WikiDiscover - Universal-Omega the build has errored. [01:33:18] [02WikiDiscover] 07Universal-Omega pushed 1 new commit to 03localization 13https://github.com/miraheze/WikiDiscover/commit/f14c6705b7b95f0ecdd7e49f44f7f2fd32537b83 [01:33:18] 02WikiDiscover/03localization 07CosmicAlpha 03f14c670 Update [01:35:44] miraheze/WikiDiscover - Universal-Omega the build has errored. [01:36:25] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks [01:36:26] mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=ysmwikiwiki 38001 --e 40000 (running for 12:13) [01:36:27] mwtask161: not running [01:36:28] mwtask171: not running [01:36:29] mwtask181: not running [01:38:37] [02WikiDiscover] 07Universal-Omega pushed 1 new commit to 03localization 13https://github.com/miraheze/WikiDiscover/commit/e34220b013e0591b0655f5d7d378a1ca5eeb0532 [01:38:37] 02WikiDiscover/03localization 07CosmicAlpha 03e34220b Add [01:43:19] miraheze/WikiDiscover - Universal-Omega the build passed. [02:36:27] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks [02:36:28] mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=ysmwikiwiki 38001 --e 40000 (running for 01:12:15) [02:36:29] mwtask161: not running [02:36:30] mwtask171: not running [02:36:31] mwtask181: not running [03:36:29] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks [03:36:30] mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=ysmwikiwiki 40001 --e 42000 (running for 56:12) [03:36:31] mwtask161: not running [03:36:32] mwtask171: not running [03:36:33] mwtask181: not running [04:36:31] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks [04:36:32] mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=ysmwikiwiki 42001 --e 44000 (running for 39:49) [04:36:33] mwtask161: not running [04:36:34] mwtask171: not running [04:36:35] mwtask181: not running [04:44:15] > [03/04/2025 11:38] !log [blankeclair@mwtask181] runRefreshLinksChunked: [571/1178] taisakuwikiwiki exited with 1 [04:44:20] madarchod i have to get up from bed [04:44:37] yurikey: obtained [04:46:41] > The wiki database 'taisakuwikiwiki' was not found. [04:46:43] ope [04:47:05] !log [blankeclair@mwtask181] runRefreshLinksChunked: [0/606] Handling takeandholdwiki (start id: 0) [04:47:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:36:33] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks [05:36:34] mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=ysmwikiwiki 44001 --e 46000 (running for 22:53) [05:36:35] mwtask161: not running [05:36:36] mwtask171: not running [05:36:37] mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=templatewikiarchivewiki 6001 (running for 34:12) [06:36:35] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks [06:36:36] mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=ysmwikiwiki 44001 --e 46000 (running for 01:22:55) [06:36:37] mwtask161: not running [06:36:38] mwtask171: not running [06:36:39] mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=templatewikiarchivewiki 6001 (running for 01:34:14) [07:36:37] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks [07:36:38] mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=ysmwikiwiki 46001 --e 48000 (running for 58:13) [07:36:39] mwtask161: not running [07:36:40] mwtask171: not running [07:36:41] mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=tgtdwiki 1 --e 2000 (running for 00:20) [07:53:10] !log [blankeclair@mwtask181] runRefreshLinksChunked: [100/606] Handling thegodofhighschoolwiki (start id: 0) [07:53:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:36:40] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks [08:36:41] mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=ysmwikiwiki 48001 --e 50000 (running for 38:28) [08:36:42] mwtask161: not running [08:36:43] mwtask171: not running [08:36:44] mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=thestraygw2rpwiki 2001 (running for 00:00) [08:38:42] Nice [08:38:49] Exactly 00:00 it prompted at [08:48:59] PROBLEM - annapolishistorywiki.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'annapolishistorywiki.org' expires in 14 day(s) (Fri 18 Apr 2025 08:26:48 AM GMT +0000). [08:49:12] [02ssl] 07WikiTideSSLBot pushed 1 new commit to 03master 13https://github.com/miraheze/ssl/commit/02536865e21fe5b3739ab51d15704ae31bd92237 [08:49:12] 02ssl/03master 07WikiTideSSLBot 030253686 Bot: Update SSL cert for annapolishistorywiki.org [09:08:29] PROBLEM - with.cpt-ra.bid - Cloudflare on sslhost is CRITICAL: Temporary failure in name resolutionHTTP CRITICAL - Unable to open TCP socket [09:17:33] heh xD [09:23:09] morning BlankEclair [09:23:17] mornyan~ [09:36:42] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks [09:36:43] mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=ysmwikiwiki 50001 --e 52000 (running for 17:31) [09:36:44] mwtask161: not running [09:36:45] mwtask171: not running [09:36:46] mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=thppwiki 1 --e 2000 (running for 26:50) [09:46:23] [02puppet] 07RhinosF1 created 03tiny-bash (+1 new commit) 13https://github.com/miraheze/puppet/commit/53b8e9aab39f [09:46:23] 02puppet/03tiny-bash 07RhinosF1 0353b8e9a Create sql/eval/shell.sh [09:46:27] [02puppet] 07RhinosF1 opened pull request #4286: Create sql/eval/shell.sh (03master...03tiny-bash) 13https://github.com/miraheze/puppet/pull/4286 [09:46:35] [02puppet] 07coderabbitai[bot] commented on pull request #4286: --- […] 13https://github.com/miraheze/puppet/pull/4286#issuecomment-2775119964 [09:47:00] RECOVERY - annapolishistorywiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'annapolishistorywiki.org' will expire on Wed 02 Jul 2025 07:50:35 AM GMT +0000. [09:47:15] [02puppet] 07RhinosF1 pushed 1 new commit to 03tiny-bash 13https://github.com/miraheze/puppet/commit/b249ba5db8303d83edc8a2170ab9124e36441413 [09:47:16] 02puppet/03tiny-bash 07RhinosF1 03b249ba5 Create eval.sh [09:47:28] [02puppet] 07RhinosF1 pushed 1 new commit to 03tiny-bash 13https://github.com/miraheze/puppet/commit/dc8f85b4855de13aaeb028320fd4a36c5db27b7c [09:47:29] 02puppet/03tiny-bash 07RhinosF1 03dc8f85b Create shell.sh [09:49:10] [02puppet] 07RhinosF1 pushed 1 new commit to 03tiny-bash 13https://github.com/miraheze/puppet/commit/e379a289561ef0596f1aee15040f1efac61aceec [09:49:10] 02puppet/03tiny-bash 07RhinosF1 03e379a28 Update init.pp [09:52:16] [02puppet] 07RhinosF1 commented on pull request #4286: @coderabbitai review 13https://github.com/miraheze/puppet/pull/4286#issuecomment-2775137294 [09:52:22] [02puppet] 07coderabbitai[bot] commented on pull request #4286:
[…] 13https://github.com/miraheze/puppet/pull/4286#issuecomment-2775137588 [09:52:25] [02puppet] 07BlankEclair left a review on pull request #4286: What if we used this stub instead? […] 13https://github.com/miraheze/puppet/pull/4286#pullrequestreview-2739195141 [09:53:58] [02puppet] 07coderabbitai[bot] left a review on pull request #4286: **Actionable comments posted: 0** […] 13https://github.com/miraheze/puppet/pull/4286#pullrequestreview-2739200046 [10:00:54] [02puppet] 07RhinosF1 commented on pull request #4286: mwscript already validates the argument and we don't wanna allow passing an SQL file as you should log that 13https://github.com/miraheze/puppet/pull/4286#issuecomment-2775160993 [10:01:41] [02puppet] 07RhinosF1 pushed 1 new commit to 03tiny-bash 13https://github.com/miraheze/puppet/commit/2dba79d0ebfabf8fae2a1082b6f827ee6c4400b7 [10:01:41] 02puppet/03tiny-bash 07RhinosF1 032dba79d Update eval.sh [10:01:52] [02puppet] 07RhinosF1 pushed 1 new commit to 03tiny-bash 13https://github.com/miraheze/puppet/commit/9726d21995dabfcb58ba264628e9b87ca81fccba [10:01:53] 02puppet/03tiny-bash 07RhinosF1 039726d21 Update shell.sh [10:02:02] [02puppet] 07RhinosF1 pushed 1 new commit to 03tiny-bash 13https://github.com/miraheze/puppet/commit/5d386b2e19f29872c17d739f4de5f1982e0193b0 [10:02:02] 02puppet/03tiny-bash 07RhinosF1 035d386b2 Update sql.sh [10:02:32] [02puppet] 07RhinosF1 merged pull request #4286: Create sql/eval/shell.sh (03master...03tiny-bash) 13https://github.com/miraheze/puppet/pull/4286 [10:02:32] [02puppet] 07RhinosF1 pushed 1 new commit to 03master 13https://github.com/miraheze/puppet/commit/510c17c5f9a3442d9e3011935d518409efd73148 [10:02:33] 02puppet/03master 07RhinosF1 03510c17c Create sql/eval/shell.sh (#4286)… [10:02:35] [02puppet] 07RhinosF1 04deleted 03tiny-bash at 035d386b2 13https://github.com/miraheze/puppet/commit/5d386b2 [10:08:14] RECOVERY - with.cpt-ra.bid - Cloudflare on sslhost is OK: OK - Certificate 'with.cpt-ra.bid' will expire on Sat 24 May 2025 07:05:41 PM GMT +0000. [10:08:56] [02puppet] 07RhinosF1 pushed 1 new commit to 03master 13https://github.com/miraheze/puppet/commit/a98f84691ab9cd0f8dc61b329c8c093a54df8bfc [10:08:56] 02puppet/03master 07RhinosF1 03a98f846 Rename eval.sh to mweval.sh [10:09:13] [02puppet] 07RhinosF1 pushed 1 new commit to 03master 13https://github.com/miraheze/puppet/commit/cff4e389cb04f2318d1fd4192ea611e7a6256329 [10:09:13] 02puppet/03master 07RhinosF1 03cff4e38 Update init.pp [10:12:42] PROBLEM - www.allthetropes.org - Cloudflare on sslhost is CRITICAL: Name or service not knownHTTP CRITICAL - Unable to open TCP socket [10:12:43] PROBLEM - puppet181 Puppet on puppet181 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [10:12:52] PROBLEM - mw192 Puppet on mw192 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/usr/local/bin/eval] [10:14:44] RECOVERY - puppet181 Puppet on puppet181 is OK: OK: Puppet is currently enabled, last run 9 seconds ago with 0 failures [10:14:46] mw192 was a race [10:14:51] RECOVERY - mw192 Puppet on mw192 is OK: OK: Puppet is currently enabled, last run 40 seconds ago with 0 failures [10:15:03] pupept181 is fine [10:36:44] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks [10:36:45] mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=ysmwikiwiki 50001 --e 52000 (running for 01:17:33) [10:36:46] mwtask161: not running [10:36:47] mwtask171: not running [10:36:48] mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=thppwiki 4001 --e 6000 (running for 36:56) [11:05:43] PROBLEM - db171 Backups SQL on db171 is WARNING: FILE_AGE WARNING: /var/log/db-backups/db-backups/db-backups.log is 1382639 seconds old and 2698098 bytes [11:15:48] oh [11:36:46] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks [11:36:47] mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=ysmwikiwiki 52001 --e 54000 (running for 57:56) [11:36:48] mwtask161: not running [11:36:49] mwtask171: not running [11:36:50] mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=tidewiki 1 --e 2000 (running for 02:59) [11:51:35] !log [blankeclair@mwtask181] runRefreshLinksChunked: [200/606] Handling tomewiki (start id: 0) [11:51:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:10:36] [02CreateWiki] 07translatewiki pushed 1 new commit to 03master 13https://github.com/miraheze/CreateWiki/commit/02d81ae882de0341072c4745f435e887bb23f31f [12:10:36] 02CreateWiki/03master 07translatewiki.net 0302d81ae Localisation updates from https://translatewiki.net. [12:10:36] [02landing] 07translatewiki pushed 1 new commit to 03master 13https://github.com/miraheze/landing/commit/0a0c8fbe8b4ab910a75fa8fb5cc2d85a103bd8ed [12:10:36] 02landing/03master 07translatewiki.net 030a0c8fb Localisation updates from https://translatewiki.net. [12:10:37] [02DataDump] 07translatewiki pushed 1 new commit to 03master 13https://github.com/miraheze/DataDump/commit/1ca44af035adfa4dc2a1298ee31e059e821c8efc [12:10:39] 02DataDump/03master 07translatewiki.net 031ca44af Localisation updates from https://translatewiki.net. [12:10:41] [02WikiDiscover] 07translatewiki pushed 1 new commit to 03master 13https://github.com/miraheze/WikiDiscover/commit/702f0395af6ef7ad7fb4de30c51c5c84d9bb4a00 [12:10:43] 02WikiDiscover/03master 07translatewiki.net 03702f039 Localisation updates from https://translatewiki.net. [12:11:27] miraheze/landing - translatewiki the build passed. [12:15:23] miraheze/DataDump - translatewiki the build passed. [12:15:36] miraheze/WikiDiscover - translatewiki the build passed. [12:27:52] miraheze/CreateWiki - translatewiki the build passed. [12:32:37] [02mw-config] 07Aeywoo opened pull request #5893: Removing closed wikis from LocalWiki.php (07miraheze:03master...07Aeywoo:03patch-8) 13https://github.com/miraheze/mw-config/pull/5893 [12:33:25] miraheze/mw-config - Aeywoo the build passed. [12:36:48] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks [12:36:49] mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=ysmwikiwiki 54001 --e 56000 (running for 28:46) [12:36:50] mwtask161: not running [12:36:51] mwtask171: not running [12:36:52] mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=trollpastawiki 4001 --e 6000 (running for 01:11) [12:54:21] [02mw-config] 07Aeywoo opened pull request #5894: Updating Cloudflare's IPs. (07miraheze:03master...07Aeywoo:03patch-9) 13https://github.com/miraheze/mw-config/pull/5894 [12:55:12] miraheze/mw-config - Aeywoo the build passed. [12:57:00] miraheze/mw-config - Aeywoo the build passed. [13:29:58] [02ssl] 07MacFan4000 pushed 1 new commit to 03master 13https://github.com/miraheze/ssl/commit/c67d5bf757ab83f8569bdd218d90c756d779afcc [13:29:58] 02ssl/03master 07MacFan4000 03c67d5bf add wiki.interbellum.xyz and emps.wiki [13:36:51] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks [13:36:52] mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=ysmwikiwiki 54001 --e 56000 (running for 01:28:48) [13:36:53] mwtask161: not running [13:36:54] mwtask171: not running [13:36:55] mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=trollpastawiki 98001 (running for 00:53) [13:37:04] [02ssl] 07MacFan4000 pushed 1 new commit to 03master 13https://github.com/miraheze/ssl/commit/cd41b66201fc4c9852898faa9f6154f4161c6fcd [13:37:04] 02ssl/03master 07MacFan4000 03cd41b66 switch gielinorgames.wiki to cloudflare. [13:37:05] [02dns] 07MacFan4000 pushed 1 new commit to 03master 13https://github.com/miraheze/dns/commit/6263cd739fe2b04604713ea61418d664602881f5 [13:37:05] 02dns/03master 07MacFan4000 036263cd7 Remove zone for gielinorgames.wiki [13:38:01] miraheze/dns - MacFan4000 the build passed. [13:47:38] [02ssl] 07MacFan4000 pushed 1 new commit to 03master 13https://github.com/miraheze/ssl/commit/0b2f574f4c0c2091cee0661112aad7db27eb3cce [13:47:38] 02ssl/03master 07MacFan4000 030b2f574 switch allthetropes.org to cloudflare. [13:47:39] [02dns] 07MacFan4000 pushed 1 new commit to 03master 13https://github.com/miraheze/dns/commit/4ad1bbdeb655ebae7ca21a908d1a8935ea10544f [13:47:39] 02dns/03master 07MacFan4000 034ad1bbd Remove zone for allthetropes.org [13:48:37] miraheze/dns - MacFan4000 the build passed. [13:55:55] miraheze/mw-config - Aeywoo the build passed. [13:58:05] miraheze/mw-config - Aeywoo the build passed. [14:09:20] miraheze/mw-config - Aeywoo the build passed. [14:15:53] PROBLEM - ns2 Puppet on ns2 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_dns] [14:16:03] huh [14:16:27] [02mw-config] 07Aeywoo retitled PR #5893: "Removing closed wikis from LocalWiki.php" ➜ "Removing closed wikis from local wiki PHP files" 13https://github.com/miraheze/mw-config/pull/5893 [14:17:11] RECOVERY - ns2 Puppet on ns2 is OK: OK: Puppet is currently enabled, last run 5 seconds ago with 0 failures [14:36:53] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks [14:36:54] mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=ysmwikiwiki 56001 --e 58000 (running for 33:06) [14:36:55] mwtask161: not running [14:36:56] mwtask171: not running [14:36:57] mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=uncyclopediawiki 14001 --e 16000 (running for 02:37) [14:58:37] !log [blankeclair@mwtask181] runRefreshLinksChunked: [300/606] Handling unfoodfanwiki (start id: 0) [14:58:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:15:31] [02ssl] 07RhinosF1 commented on pull request #839: lgtm, the bugged thing is a CSP issue 13https://github.com/miraheze/ssl/pull/839#issuecomment-2776140224 [15:15:35] [02ssl] 07RhinosF1 merged 07TheVoltaireian's pull request #839: Redirect outlasterwiki and evicnoticewiki to outlaster.peakprecision.wiki and evicnotice.peakprecision.wiki (07miraheze:03master...07TheVoltaireian:03patch-1) 13https://github.com/miraheze/ssl/pull/839 [15:15:35] [02ssl] 07RhinosF1 pushed 1 new commit to 03master 13https://github.com/miraheze/ssl/commit/2acda3363918f9680cdb93571adcab5164fe4c41 [15:15:37] 02ssl/03master 07WildVoltaireian 032acda33 Redirect outlasterwiki and evicnoticewiki to outlaster.peakprecision.wiki and evicnotice.peakprecision.wiki (#839)… [15:36:55] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks [15:36:56] mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=ysmwikiwiki 56001 --e 58000 (running for 01:33:09) [15:36:57] mwtask161: not running [15:36:58] mwtask171: not running [15:36:59] mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=uoniawiki 1 --e 2000 (running for 01:37) [16:22:10] PROBLEM - cloud20 IPMI Sensors on cloud20 is UNKNOWN: ID | Date | Time | Name | Type | State | Event1 | Mar-05-2025 | 21:27:15 | SEL | Event Logging Disabled | Nominal | Log Area Reset/Cleared2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 8 [16:22:10] 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 ipmi_sel_parse: internal IPMI error-> Execution of /usr/sbin/ipm [16:22:10] ed with return code 1.-> /usr/sbin/ipmi-sel was executed with the following parameters: sudo /usr/sbin/ipmi-sel --output-event-state --interpret-oem-data --entity-sensor-names --sensor-types=all [16:24:08] PROBLEM - cloud20 IPMI Sensors on cloud20 is CRITICAL: IPMI Status: Critical [Inlet Temp = Critical, 399 system event log (SEL) entries present] [16:31:36] PROBLEM - cp38 Disk Space on cp38 is WARNING: DISK WARNING - free space: / 49934MiB (10% inode=99%); [16:36:58] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks [16:36:59] mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=ysmwikiwiki 56001 --e 58000 (running for 02:33:11) [16:37:00] mwtask161: not running [16:37:01] mwtask171: not running [16:37:02] mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=valsorawiki 1 --e 2000 (running for 03:26) [16:42:16] [02WikiDiscover] 07Universal-Omega pushed 1 new commit to 03localization 13https://github.com/miraheze/WikiDiscover/commit/bb35d838c7a96f56a6c34519d91c4cb3faf9ad46 [16:42:16] 02WikiDiscover/03localization 07CosmicAlpha 03bb35d83 Update [16:43:58] [02WikiDiscover] 07Universal-Omega pushed 1 new commit to 03localization 13https://github.com/miraheze/WikiDiscover/commit/e77163f1cdebbdb02a08b2aa8c57c6e6f28f1c40 [16:43:58] 02WikiDiscover/03localization 07CosmicAlpha 03e77163f Update [16:45:48] [02WikiDiscover] 07Universal-Omega pushed 1 new commit to 03localization 13https://github.com/miraheze/WikiDiscover/commit/0504cc81af9d7dd5c959407b5c9838592d818400 [16:45:48] 02WikiDiscover/03localization 07CosmicAlpha 030504cc8 Update [16:47:13] PROBLEM - matomo151 Current Load on matomo151 is WARNING: LOAD WARNING - total load average: 7.15, 6.74, 6.09 [16:49:13] RECOVERY - matomo151 Current Load on matomo151 is OK: LOAD OK - total load average: 6.02, 6.59, 6.12 [16:49:17] PROBLEM - lotrmc.ru - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'lotrmc.ru' expires in 14 day(s) (Fri 18 Apr 2025 04:19:35 PM GMT +0000). [16:49:28] [02ssl] 07WikiTideSSLBot pushed 1 new commit to 03master 13https://github.com/miraheze/ssl/commit/49de8ea829e2073158c58a183f6450f7c692a991 [16:49:28] 02ssl/03master 07WikiTideSSLBot 0349de8ea Bot: Update SSL cert for lotrmc.ru [16:50:28] miraheze/WikiDiscover - Universal-Omega the build passed. [16:55:03] [02WikiDiscover] 07Universal-Omega pushed 1 new commit to 03localization 13https://github.com/miraheze/WikiDiscover/commit/41082325d96ee26b3dce6db8f8d25289bbe898c4 [16:55:03] 02WikiDiscover/03localization 07CosmicAlpha 034108232 Update [16:57:23] [02WikiDiscover] 07Universal-Omega pushed 1 new commit to 03localization 13https://github.com/miraheze/WikiDiscover/commit/c5e9190dec1111bcc771dca4b38c077731154b6f [16:57:23] 02WikiDiscover/03localization 07CosmicAlpha 03c5e9190 Merge branch 'master' into localization [16:58:00] PROBLEM - matomo151 Current Load on matomo151 is WARNING: LOAD WARNING - total load average: 7.10, 6.87, 6.39 [16:59:55] PROBLEM - matomo151 Current Load on matomo151 is CRITICAL: LOAD CRITICAL - total load average: 8.24, 7.08, 6.51 [17:01:51] PROBLEM - matomo151 Current Load on matomo151 is WARNING: LOAD WARNING - total load average: 6.66, 6.85, 6.49 [17:02:09] miraheze/WikiDiscover - Universal-Omega the build passed. [17:05:01] [02WikiDiscover] 07Universal-Omega pushed 1 new commit to 03localization 13https://github.com/miraheze/WikiDiscover/commit/fbe6cb1e092674a53e9919e1da2163e9fcb484de [17:05:01] 02WikiDiscover/03localization 07CosmicAlpha 03fbe6cb1 Fix [17:05:41] RECOVERY - matomo151 Current Load on matomo151 is OK: LOAD OK - total load average: 5.62, 6.46, 6.41 [17:09:55] miraheze/WikiDiscover - Universal-Omega the build passed. [17:10:12] [02WikiDiscover] 07Universal-Omega merged pull request #138: Add some missing localization (03master...03localization) 13https://github.com/miraheze/WikiDiscover/pull/138 [17:10:12] [02WikiDiscover] 07Universal-Omega pushed 1 new commit to 03master 13https://github.com/miraheze/WikiDiscover/commit/13f576fb8ff2aff9828ef72f4bd6c50b99719be5 [17:10:13] 02WikiDiscover/03master 07CosmicAlpha 0313f576f Add some missing localization (#138) [17:10:15] [02WikiDiscover] 07Universal-Omega 04deleted 03localization at 03fbe6cb1 13https://github.com/miraheze/WikiDiscover/commit/fbe6cb1 [17:14:47] miraheze/WikiDiscover - Universal-Omega the build passed. [17:16:44] !log [blankeclair@mwtask181] runRefreshLinksChunked: [400/606] Handling vsimpostorwiki (start id: 0) [17:16:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:37:00] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks [17:37:01] mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=ysmwikiwiki 58001 --e 60000 (running for 48:00) [17:37:02] mwtask161: not running [17:37:03] mwtask171: not running [17:37:04] mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=wakefieldmarswiki 2001 --e 4000 (running for 06:09) [17:41:15] PROBLEM - matomo151 Current Load on matomo151 is WARNING: LOAD WARNING - total load average: 7.46, 6.33, 6.00 [17:43:13] RECOVERY - matomo151 Current Load on matomo151 is OK: LOAD OK - total load average: 6.20, 6.23, 6.00 [17:47:36] RECOVERY - lotrmc.ru - LetsEncrypt on sslhost is OK: OK - Certificate 'lotrmc.ru' will expire on Wed 02 Jul 2025 03:50:53 PM GMT +0000. [18:37:02] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks [18:37:03] mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=ysmwikiwiki 58001 --e 60000 (running for 01:48:03) [18:37:04] mwtask161: not running [18:37:05] mwtask171: not running [18:37:06] mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=walkscapewiki 2001 --e 4000 (running for 10:53) [19:37:05] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks [19:37:06] mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=ysmwikiwiki 60001 --e 62000 (running for 25:00) [19:37:07] mwtask161: not running [19:37:08] mwtask171: not running [19:37:09] mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=wgpwiki 2001 --e 4000 (running for 00:27) [19:51:34] [02WikiDiscover] 07Universal-Omega pushed 1 new commit to 03deletedwikis 13https://github.com/miraheze/WikiDiscover/commit/15780e63c1dfbd4fbdba558a2048fa9265a7d686 [19:51:34] 02WikiDiscover/03deletedwikis 07CosmicAlpha 0315780e6 Merge branch 'master' into deletedwikis [19:53:19] [02WikiDiscover] 07Universal-Omega pushed 1 new commit to 03specialmywikis-page 13https://github.com/miraheze/WikiDiscover/commit/669f2a1a088ce6852e1af0a3950f0712c4431c70 [19:53:19] 02WikiDiscover/03specialmywikis-page 07CosmicAlpha 03669f2a1 Merge branch 'master' into specialmywikis-page [19:55:56] miraheze/WikiDiscover - Universal-Omega the build has errored. [19:56:09] miraheze/WikiDiscover - Universal-Omega the build passed. [20:16:42] [02WikiDiscover] 07Universal-Omega created 03mywikis-option (+1 new commit) 13https://github.com/miraheze/WikiDiscover/commit/9ad9752fb4ab [20:16:43] 02WikiDiscover/03mywikis-option 07CosmicAlpha 039ad9752 Add myWikis option to Special:WikiDiscover [20:16:47] [02WikiDiscover] 07Universal-Omega opened pull request #139: Add myWikis option to Special:WikiDiscover (03master...03mywikis-option) 13https://github.com/miraheze/WikiDiscover/pull/139 [20:16:56] [02WikiDiscover] 07coderabbitai[bot] commented on pull request #139: --- […] 13https://github.com/miraheze/WikiDiscover/pull/139#issuecomment-2776824663 [20:18:19] [02WikiDiscover] 07Universal-Omega pushed 1 new commit to 03mywikis-option 13https://github.com/miraheze/WikiDiscover/commit/3ce30c736d659cb86e526ae93b604961a8494041 [20:18:19] 02WikiDiscover/03mywikis-option 07CosmicAlpha 033ce30c7 - [20:22:52] miraheze/WikiDiscover - Universal-Omega the build has errored. [20:22:52] [02WikiDiscover] 07Universal-Omega pushed 1 new commit to 03mywikis-option 13https://github.com/miraheze/WikiDiscover/commit/cc6106098b3e7275727aaf6d6846303656e28070 [20:22:52] 02WikiDiscover/03mywikis-option 07CosmicAlpha 03cc61060 Add [20:41:59] miraheze/WikiDiscover - Universal-Omega the build has errored. [20:41:59] [02WikiDiscover] 07Universal-Omega pushed 1 new commit to 03mywikis-option 13https://github.com/miraheze/WikiDiscover/commit/d92c832f3b0ab53554b6aaff9a6affdc45f3c6f1 [20:41:59] 02WikiDiscover/03mywikis-option 07CosmicAlpha 03d92c832 Make property [20:41:59] [02WikiDiscover] 07Universal-Omega pushed 1 new commit to 03mywikis-option 13https://github.com/miraheze/WikiDiscover/commit/539b431c8371f54e75b69d4770f8cf70ee291a1c [20:41:59] 02WikiDiscover/03mywikis-option 07CosmicAlpha 03539b431 Order [20:41:59] [02WikiDiscover] 07Universal-Omega pushed 1 new commit to 03mywikis-option 13https://github.com/miraheze/WikiDiscover/commit/267f3240628e5ffb306a026d17ba3ef3378359b1 [20:41:59] 02WikiDiscover/03mywikis-option 07CosmicAlpha 03267f324 Try [20:41:59] [02WikiDiscover] 07Universal-Omega pushed 1 new commit to 03mywikis-option 13https://github.com/miraheze/WikiDiscover/commit/15cee6def21f8b9d9e87dcec30d7625b9353c76a [20:41:59] 02WikiDiscover/03mywikis-option 07CosmicAlpha 0315cee6d Try [20:41:59] [02WikiDiscover] 07Universal-Omega pushed 1 new commit to 03mywikis-option 13https://github.com/miraheze/WikiDiscover/commit/08904410d7e8728038220b7f7e1ee01de88259e2 [20:41:59] 02WikiDiscover/03mywikis-option 07CosmicAlpha 030890441 Fix [20:41:59] miraheze/WikiDiscover - Universal-Omega the build has errored. [20:41:59] [02WikiDiscover] 07Universal-Omega pushed 1 new commit to 03mywikis-option 13https://github.com/miraheze/WikiDiscover/commit/c77fac5d027f9155d7163459b02e733bc02bf03a [20:41:59] 02WikiDiscover/03mywikis-option 07CosmicAlpha 03c77fac5 - [20:41:59] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks [20:41:59] mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=ysmwikiwiki 60001 --e 62000 (running for 01:25:02) [20:41:59] mwtask161: not running [20:41:59] mwtask171: not running [20:41:59] mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=wikibobwiki 34001 --e 36000 (running for 03:12) [20:41:59] miraheze/WikiDiscover - Universal-Omega the build passed. [21:37:09] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks [21:37:10] mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=ysmwikiwiki 62001 --e 64000 (running for 08:00) [21:37:11] mwtask161: not running [21:37:12] mwtask171: not running [21:37:13] mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=wikibobwiki 72001 --e 74000 (running for 01:17) [21:42:50] biiiig wikis [22:10:38] PROBLEM - changeprop201 Puppet on changeprop201 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 13 minutes ago with 0 failures [22:27:20] [Grafana] FIRING: The mediawiki job queue has more than 20000 unclaimed jobs https://grafana.wikitide.net/d/GtxbP1Xnk?orgId=1 [22:32:20] [Grafana] RESOLVED: High Job Queue Backlog https://grafana.wikitide.net/d/GtxbP1Xnk?orgId=1 [22:37:11] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks [22:37:12] mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=ysmwikiwiki 62001 --e 64000 (running for 01:08:02) [22:37:13] mwtask161: not running [22:37:14] mwtask171: not running [22:37:15] mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=wikibobwiki 116001 --e 118000 (running for 00:07) [23:37:13] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks [23:37:14] mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=ysmwikiwiki 62001 --e 64000 (running for 02:08:04) [23:37:15] mwtask161: not running [23:37:16] mwtask171: not running [23:37:17] mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=wizardspromisewiki 2001 --e 4000 (running for 02:47) [23:39:29] !log [blankeclair@mwtask181] runRefreshLinksChunked: [500/606] Handling woewikiwiki (start id: 0) [23:39:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log