[00:00:43] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 25.45, 22.47, 15.46
[00:02:43] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 16.95, 20.82, 15.75
[00:04:46] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 27.60, 20.97, 16.27
[00:05:52] <icinga-miraheze>	 RECOVERY - cp38 Disk Space on cp38 is OK: DISK OK - free space: / 59010MiB (12% inode=99%);
[00:06:43] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 18.34, 22.05, 17.42
[00:08:43] <icinga-miraheze>	 RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 6.32, 16.28, 15.87
[00:23:05] <MirahezeLSBot>	 !log [blankeclair@mwtask171] runRefreshLinksChunked: [300/1842] Handling mournerbackendwiki (start id: 0)
[00:23:08] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[00:30:12] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks
[00:30:13] <MirahezeLSBot>	 mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=constantnoblewiki 14601 --e 16600
[00:30:14] <MirahezeLSBot>	 mwtask161: not running
[00:30:15] <MirahezeLSBot>	 mwtask171: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=multiversalmadnessdocwiki 1 --e 2000
[00:30:16] <MirahezeLSBot>	 mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=cravesagawiki 5301 --e 7300
[01:20:18] <BlankEclair>	 time to procrastinate at school once again
[01:21:40] <MirahezeLSBot>	 !log [blankeclair@mwtask161] runRefreshLinksChunked: [0/1015] Handling renoricawiki (start id: 0)
[01:21:42] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[01:25:45] <MirahezeLSBot>	 !log [blankeclair@mwtask161] Starting import for kaiserreichwiki (XML: None; Images: kaiserreichfandomcom-20250325-wikidump/images/) (START)
[01:25:46] <MirahezeLSBot>	 !log [blankeclair@mwtask161] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php importImages --wiki=kaiserreichwiki '--comment=Importing from https://kaiserreich.fandom.com ([[phorge:T13429|T13429]])' -- kaiserreichfandomcom-20250325-wikidump/images/ (START)
[01:25:47] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[01:25:49] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[01:30:15] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks
[01:30:16] <MirahezeLSBot>	 mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=constantnoblewiki 14601 --e 16600
[01:30:17] <MirahezeLSBot>	 mwtask161: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=rhythmvisionwiki 1 --e 2000
[01:30:18] <MirahezeLSBot>	 mwtask171: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=mymensinghwiki 1 --e 2000
[01:30:19] <MirahezeLSBot>	 mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=cravesagawiki 5301 --e 7300
[01:39:20] <MirahezeLSBot>	 !log [blankeclair@mwtask161] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php importImages --wiki=kaiserreichwiki '--comment=Importing from https://kaiserreich.fandom.com ([[phorge:T13429|T13429]])' -- kaiserreichfandomcom-20250325-wikidump/images/ (END - exit=0)
[01:39:21] <MirahezeLSBot>	 !log [blankeclair@mwtask161] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php initSiteStats --wiki=kaiserreichwiki --update (START)
[01:39:22] <MirahezeLSBot>	 !log [blankeclair@mwtask161] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php initSiteStats --wiki=kaiserreichwiki --update (END - exit=0)
[01:39:22] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[01:39:23] <MirahezeLSBot>	 !log [blankeclair@mwtask161] Finished import for kaiserreichwiki (XML: None; Images: kaiserreichfandomcom-20250325-wikidump/images/) (END - exit=0)
[01:39:25] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[01:39:26] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[01:39:28] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[01:42:13] <MirahezeLSBot>	 !log [blankeclair@mwtask161] runRefreshLinksChunked: [69/1015] royalwiki exited with 1
[01:42:15] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[01:42:18] <BlankEclair>	 not nice
[01:44:10] <MirahezeLSBot>	 !log [blankeclair@mwtask161] runRefreshLinksChunked: [0/945] Handling rpalandriwiki (start id: 0)
[01:44:12] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[02:02:20] <icinga-miraheze>	 [Grafana] FIRING: The mediawiki job queue has more than 2000 unclaimed jobs https://grafana.wikitide.net/d/GtxbP1Xnk?orgId=1
[02:12:20] <icinga-miraheze>	 [Grafana] RESOLVED: High Job Queue Backlog https://grafana.wikitide.net/d/GtxbP1Xnk?orgId=1
[02:30:18] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks
[02:30:19] <MirahezeLSBot>	 mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=constantnoblewiki 14601 --e 16600
[02:30:20] <MirahezeLSBot>	 mwtask161: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=rushpediawiki 1 --e 2000
[02:30:21] <MirahezeLSBot>	 mwtask171: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=neventiawiki 1 --e 2000
[02:30:22] <MirahezeLSBot>	 mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=cravesagawiki 5301 --e 7300
[03:03:43] <MirahezeLSBot>	 !log [blankeclair@mwtask171] runRefreshLinksChunked: [400/1842] Handling ngnlzhwiki (start id: 0)
[03:03:45] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[03:06:43] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 29.78, 21.59, 15.03
[03:14:43] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 14.92, 21.77, 18.24
[03:16:43] <icinga-miraheze>	 RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 12.03, 18.37, 17.42
[03:30:21] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks
[03:30:22] <MirahezeLSBot>	 mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=constantnoblewiki 14601 --e 16600
[03:30:23] <MirahezeLSBot>	 mwtask161: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=senrishrinewiki 1 --e 2000
[03:30:24] <MirahezeLSBot>	 mwtask171: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=nmsgalactichubwiki 14001 --e 16000
[03:30:25] <MirahezeLSBot>	 mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=cravesagawiki 5301 --e 7300
[03:38:41] <MirahezeLSBot>	 !log [blankeclair@mwtask161] runRefreshLinksChunked: [100/945] Handling sfacgnwiki (start id: 0)
[03:38:43] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[04:12:43] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 25.29, 17.63, 13.82
[04:15:40] <MirahezeRelay>	 <blankeclair> i suppose i should make a thing that lists out wall time
[04:16:43] <icinga-miraheze>	 RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 14.04, 18.11, 15.15
[04:30:25] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks
[04:30:26] <MirahezeLSBot>	 mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=constantnoblewiki 16601 --e 18600
[04:30:27] <MirahezeLSBot>	 mwtask161: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=sfacgnwiki 2001 --e 4000
[04:30:28] <MirahezeLSBot>	 mwtask171: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=noctilucentwiki 2001 --e 4000
[04:30:29] <MirahezeLSBot>	 mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=cravesagawiki 5301 --e 7300
[05:07:31] <icinga-miraheze>	 PROBLEM - mwtask181 Puppet on mwtask181 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 3 minutes ago with 2 failures. Failed resources (up to 3 shown): Exec[git_pull_mathoid],Exec[git_pull_femiwiki-deploy-1.43]
[05:30:28] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks
[05:30:29] <MirahezeLSBot>	 mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=constantnoblewiki 18601 --e 20600
[05:30:30] <MirahezeLSBot>	 mwtask161: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=sfacgnwiki 2001 --e 4000
[05:30:31] <MirahezeLSBot>	 mwtask171: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=nonciclopediawiki 10001 --e 12000
[05:30:32] <MirahezeLSBot>	 mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=cravesagawiki 5301 --e 7300
[05:33:47] <icinga-miraheze>	 RECOVERY - mwtask181 Puppet on mwtask181 is OK: OK: Puppet is currently enabled, last run 47 seconds ago with 0 failures
[06:11:17] <BlankEclair>	 WTF
[06:11:23] <BlankEclair>	 [blankeclair@mwtask181:~/schemafuckfuckfuck/pagelinks]$ df -h .
[06:11:24] <BlankEclair>	 Filesystem      Size  Used Avail Use% Mounted on
[06:11:25] <BlankEclair>	 /dev/sda1       229G  219G     0 100% /
[06:12:34] <BlankEclair>	 !log manually kill refreshLinks on mwtask181
[06:12:36] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[06:16:20] <MirahezeLSBot>	 !log [blankeclair@mwtask161] runRefreshLinksChunked: [121/945] shiromachiyawiki exited with 1
[06:16:21] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[06:20:49] <BlankEclair>	 shit, i lost track of where mwtask181 was
[06:24:32] <BlankEclair>	 !log manually kill backup-all-wikis-ia.service since it ate up all of disk
[06:24:34] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[06:25:51] <BlankEclair>	 !log (previous message was pursuant to mwtask181)
[06:25:52] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[06:25:53] <BlankEclair>	 !log [blankeclair@mwtask181:/tmp]$ sudo -u www-data rm /tmp/*.tar.gz
[06:25:55] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[06:27:16] <icinga-miraheze>	 RECOVERY - mwtask181 Disk Space on mwtask181 is OK: DISK OK - free space: / 151009MiB (68% inode=95%);
[06:30:31] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks
[06:30:32] <MirahezeLSBot>	 mwtask151: sudo -u www-data php /srv/m (running for 
)
[06:30:33] <MirahezeLSBot>	 mwtask161: not running
[06:30:34] <MirahezeLSBot>	 mwtask171: sudo -u www-data php /srv/m (running for 
)
[06:30:35] <MirahezeLSBot>	 mwtask181: not running
[06:34:37] <BlankEclair>	 woa
[06:34:40] <BlankEclair>	 impressive
[07:02:43] <MirahezeLSBot>	 !log [blankeclair@mwtask181] runRefreshLinksChunked: [0/2761] Handling cravesagawiki (start id: 5300)
[07:02:45] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[07:05:41] <MirahezeLSBot>	 !log [blankeclair@mwtask161] runRefreshLinksChunked: [0/823] Handling shitcraftwiki (start id: 0)
[07:05:43] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[07:07:14] <BlankEclair>	 !log manually kill refreshLinks on mwtask181 as it's clear it's stalling
[07:07:16] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[07:07:36] <MirahezeLSBot>	 !log [blankeclair@mwtask181] runRefreshLinksChunked: [0/2761] Handling crazymariobroswiki (start id: 0)
[07:07:37] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[07:30:33] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks
[07:30:34] <MirahezeLSBot>	 mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=countryhumanswiki 2001 --e 4000 (running for 06:33)
[07:30:35] <MirahezeLSBot>	 mwtask161: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=shitcraftwiki 6001 --e 8000 (running for 02:00)
[07:30:36] <MirahezeLSBot>	 mwtask171: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=nonciclopediawiki 44001 --e 46000 (running for 01:18)
[07:30:37] <MirahezeLSBot>	 mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=csydeswiki 4001 --e 6000 (running for 06:45)
[07:39:09] <RhinosF1>	 BlankEclair: why does it keep stalling
[07:39:16] <BlankEclair>	 what kept stalling?
[07:51:05] <RhinosF1>	 BlankEclair: refreshLinks
[08:30:35] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks
[08:30:36] <MirahezeLSBot>	 mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=cpfanonwiki 18001 --e 20000 (running for 00:45)
[08:30:37] <MirahezeLSBot>	 mwtask161: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=smithwickswiki 2001 --e 4000 (running for 01:32)
[08:30:38] <MirahezeLSBot>	 mwtask171: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=nonciclopediawiki 58001 --e 60000 (running for 05:25)
[08:30:39] <MirahezeLSBot>	 mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=cyberpediawiki 40001 --e 42000 (running for 01:12)
[08:50:23] <BlankEclair>	 RhinosF1: i don't know, but i moved it to the end of the queue so we'll get around to it eventually
[09:30:37] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks
[09:30:38] <MirahezeLSBot>	 mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=criticalrolewiki 1 --e 2000 (running for 03:08)
[09:30:39] <MirahezeLSBot>	 mwtask161: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=spacewiki 4001 --e 6000 (running for 04:26)
[09:30:40] <MirahezeLSBot>	 mwtask171: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=nonciclopediawiki 74001 --e 76000 (running for 06:34)
[09:30:41] <MirahezeLSBot>	 mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=deathbattlewiki 26001 --e 28000 (running for 00:26)
[09:34:10] <icinga-miraheze>	 PROBLEM - with.cpt-ra.bid - Cloudflare on sslhost is CRITICAL: Temporary failure in name resolutionHTTP CRITICAL - Unable to open TCP socket
[09:49:25] <MirahezeLSBot>	 !log [blankeclair@mwtask161] runRefreshLinksChunked: [100/823] Handling spektrowiki (start id: 0)
[09:49:27] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[10:03:16] <icinga-miraheze>	 RECOVERY - with.cpt-ra.bid - Cloudflare on sslhost is OK: OK - Certificate 'with.cpt-ra.bid' will expire on Sat 24 May 2025 07:05:41 PM GMT +0000.
[10:30:40] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks
[10:30:41] <MirahezeLSBot>	 mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=criticalrolewiki 24001 (running for 05:09)
[10:30:42] <MirahezeLSBot>	 mwtask161: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=stampswikiwiki 2001 --e 4000 (running for 12:56)
[10:30:43] <MirahezeLSBot>	 mwtask171: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=nonciclopediawiki 90001 --e 92000 (running for 05:26)
[10:30:44] <MirahezeLSBot>	 mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=deathbattlewiki 110001 --e 112000 (running for 00:25)
[10:35:30] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 24.26, 19.09, 14.18
[10:37:26] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 20.63, 20.20, 15.21
[10:39:21] <icinga-miraheze>	 RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 16.06, 19.19, 15.45
[11:25:41] <MacFanBot>	 [02mw-config] 07BlankEclair opened pull request #5883: T13424: Redirect redlinked root userpages to non-edit versions for cgwiki and lhmnwiki (07miraheze:03master...07BlankEclair:03T13424) 13https://github.com/miraheze/mw-config/pull/5883
[11:26:34] <MacFanBot>	 [02mw-config] 07BlankEclair merged pull request #5883: T13424: Redirect redlinked root userpages to non-edit versions for cgwiki and lhmnwiki (07miraheze:03master...07BlankEclair:03T13424) 13https://github.com/miraheze/mw-config/pull/5883
[11:26:34] <MacFanBot>	 [02mw-config] 07BlankEclair pushed 1 new commit to 03master 13https://github.com/miraheze/mw-config/commit/6e6462947ac1e0abe96c601481bdc0f4a7e78614
[11:26:34] <MacFanBot>	 02mw-config/03master 07Claire 036e64629 T13424: Redirect redlinked root userpages to non-edit versions for cgwiki and lhmnwiki (#5883)
[11:26:35] <miraheze-github>	 miraheze/mw-config - BlankEclair the build passed.
[11:26:37] <MirahezeLSBot>	 !log [blankeclair@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all
[11:26:39] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[11:27:00] <MirahezeLSBot>	 !log [blankeclair@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 23s
[11:27:02] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[11:27:24] <miraheze-github>	 miraheze/mw-config - BlankEclair the build passed.
[11:28:03] <MirahezeLSBot>	 !log [blankeclair@mwtask161] runRefreshLinksChunked: [200/823] Handling swallownestwiki (start id: 0)
[11:28:05] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[11:28:43] <MacFanBot>	 [02mw-config] 07BlankEclair opened pull request #5884: Fix $this call (07miraheze:03master...07BlankEclair:03T13424-2) 13https://github.com/miraheze/mw-config/pull/5884
[11:29:18] <MacFanBot>	 [02mw-config] 07BlankEclair merged pull request #5884: Fix $this call (07miraheze:03master...07BlankEclair:03T13424-2) 13https://github.com/miraheze/mw-config/pull/5884
[11:29:19] <MacFanBot>	 [02mw-config] 07BlankEclair pushed 1 new commit to 03master 13https://github.com/miraheze/mw-config/commit/0faa40a326cfbc3c96357ec85a0743a02607b4cf
[11:29:19] <MacFanBot>	 02mw-config/03master 07Claire 030faa40a Fix $this call (#5884)
[11:29:20] <MirahezeLSBot>	 !log [blankeclair@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all
[11:29:21] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[11:29:37] <miraheze-github>	 miraheze/mw-config - BlankEclair the build passed.
[11:29:42] <MirahezeLSBot>	 !log [blankeclair@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 21s
[11:29:43] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[11:30:11] <miraheze-github>	 miraheze/mw-config - BlankEclair the build passed.
[11:30:42] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks
[11:30:43] <MirahezeLSBot>	 mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=criticalrolewiki 24001 (running for 01:05:12)
[11:30:44] <MirahezeLSBot>	 mwtask161: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=synthsvisionwiki 1 --e 2000 (running for 01:03)
[11:30:45] <MirahezeLSBot>	 mwtask171: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=nonciclopediawiki 108001 --e 110000 (running for 01:00)
[11:30:46] <MirahezeLSBot>	 mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=deathbattlewiki 194001 --e 196000 (running for 01:08)
[12:00:16] <MirahezeLSBot>	 !log [blankeclair@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php /srv/mediawiki/1.43/extensions/SemanticMediaWiki/maintenance/setupStore.php --wiki=alcoloiswiki (END - exit=0)
[12:00:18] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[12:06:07] <MirahezeLSBot>	 !log [blankeclair@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php /srv/mediawiki/1.43/extensions/SemanticMediaWiki/maintenance/setupStore.php --wiki=fracturamcwiki (END - exit=0)
[12:06:11] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[12:29:44] <MirahezeLSBot>	 !log [blankeclair@mwtask151] runRefreshLinksChunked: [100/2792] Handling dasopyawiki (start id: 0)
[12:29:46] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[12:30:44] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks
[12:30:45] <MirahezeLSBot>	 mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=datafortresswiki 1 --e 2000 (running for 00:53)
[12:30:46] <MirahezeLSBot>	 mwtask161: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=tepwiki 2001 --e 4000 (running for 02:02)
[12:30:47] <MirahezeLSBot>	 mwtask171: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=nonciclopediawiki 122001 --e 124000 (running for 04:23)
[12:30:48] <MirahezeLSBot>	 mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=deathbattlewiki 290001 --e 292000 (running for 00:16)
[13:30:46] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks
[13:30:47] <MirahezeLSBot>	 mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=dcmultiversewiki 20001 --e 22000 (running for 02:02)
[13:30:48] <MirahezeLSBot>	 mwtask161: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=tgdshowwiki 1 --e 2000 (running for 00:34)
[13:30:49] <MirahezeLSBot>	 mwtask171: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=nonciclopediawiki 142001 --e 144000 (running for 04:37)
[13:30:50] <MirahezeLSBot>	 mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=deathbattlewiki 382001 --e 384000 (running for 00:28)
[13:40:00] <MirahezeLSBot>	 !log [blankeclair@mwtask161] runRefreshLinksChunked: [300/823] Handling thecreatorsmultiversewiki (start id: 0)
[13:40:02] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[14:30:48] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks
[14:30:49] <MirahezeLSBot>	 mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=dmlwikiwiki 1 --e 2000 (running for 20:40)
[14:30:50] <MirahezeLSBot>	 mwtask161: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=thelonsdalebattalionwiki 8001 (running for 01:42)
[14:30:51] <MirahezeLSBot>	 mwtask171: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=nonciclopediawiki 164001 --e 166000 (running for 01:18)
[14:30:52] <MirahezeLSBot>	 mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=deathbattlewiki 472001 --e 474000 (running for 00:02)
[14:47:20] <icinga-miraheze>	 [Grafana] FIRING: The mediawiki job queue has more than 2000 unclaimed jobs https://grafana.wikitide.net/d/GtxbP1Xnk?orgId=1
[15:30:50] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks
[15:30:51] <MirahezeLSBot>	 mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=dmlwikiwiki 12001 --e 14000 (running for 03:23)
[15:30:52] <MirahezeLSBot>	 mwtask161: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=thesongwiki 2001 --e 4000 (running for 21:34)
[15:30:53] <MirahezeLSBot>	 mwtask171: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=nonciclopediawiki 178001 (running for 06:02)
[15:30:54] <MirahezeLSBot>	 mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=deathbattlewiki 568001 --e 570000 (running for 00:16)
[16:02:20] <icinga-miraheze>	 [Grafana] RESOLVED: High Job Queue Backlog https://grafana.wikitide.net/d/GtxbP1Xnk?orgId=1
[16:07:14] <MirahezeLSBot>	 !log [blankeclair@mwtask171] runRefreshLinksChunked: [438/1842] notbyliewikiwiki exited with 1
[16:07:16] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[16:12:48] <MirahezeLSBot>	 !log [blankeclair@mwtask151] runRefreshLinksChunked: [200/2792] Handling dpempirewiki (start id: 0)
[16:12:50] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[16:19:22] <MirahezeLSBot>	 !log [blankeclair@mwtask161] runRefreshLinksChunked: [400/823] Handling tincwiki (start id: 0)
[16:19:24] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[16:30:52] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks
[16:30:53] <MirahezeLSBot>	 mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=dragontamerwiki 6001 --e 8000 (running for 02:26)
[16:30:55] <MirahezeLSBot>	 mwtask161: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=tomicawiki 1 --e 2000 (running for 00:41)
[16:30:55] <MirahezeLSBot>	 mwtask171: not running
[16:30:56] <MirahezeLSBot>	 mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=deathbattlewiki 674001 --e 676000 (running for 01:04)
[16:31:52] <icinga-miraheze>	 PROBLEM - cp38 Disk Space on cp38 is WARNING: DISK WARNING - free space: / 49943MiB (10% inode=99%);
[16:33:33] <MacFanBot>	 [02WikiDiscover] 07Universal-Omega created 03validator (+1 new commit) 13https://github.com/miraheze/WikiDiscover/commit/60aa9a659dba
[16:33:33] <MacFanBot>	 02WikiDiscover/03validator 07CosmicAlpha 0360aa9a6 Use CreateWikiValidator to get URL
[16:33:37] <MacFanBot>	 [02WikiDiscover] 07Universal-Omega opened pull request #132: Use CreateWikiValidator to get URL (03master...03validator) 13https://github.com/miraheze/WikiDiscover/pull/132
[16:33:44] <MacFanBot>	 [02WikiDiscover] 07coderabbitai[bot] commented on pull request #132: --- […] 13https://github.com/miraheze/WikiDiscover/pull/132#issuecomment-2761873124
[16:38:22] <miraheze-github>	 miraheze/WikiDiscover - Universal-Omega the build passed.
[16:59:02] <MacFanBot>	 [02WikiDiscover] 07Universal-Omega pushed 1 new commit to 03validator 13https://github.com/miraheze/WikiDiscover/commit/0b89d46edb06bf235bb2fc7222af241619f32c60
[16:59:02] <MacFanBot>	 02WikiDiscover/03validator 07CosmicAlpha 030b89d46 Update
[17:00:19] <MacFanBot>	 [02WikiDiscover] 07Universal-Omega pushed 1 new commit to 03validator 13https://github.com/miraheze/WikiDiscover/commit/c3cc6aa6356f0ee49ce18d2bce702ef37ff22984
[17:00:19] <MacFanBot>	 02WikiDiscover/03validator 07CosmicAlpha 03c3cc6aa Update
[17:03:10] <miraheze-github>	 miraheze/WikiDiscover - Universal-Omega the build has errored.
[17:14:42] <icinga-miraheze>	 PROBLEM - wikimas.kr - LetsEncrypt on sslhost is CRITICAL: Name or service not knownHTTP CRITICAL - Unable to open TCP socket
[17:30:55] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks
[17:30:56] <MirahezeLSBot>	 mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=durawikiwiki 2001 --e 4000 (running for 00:26)
[17:30:57] <MirahezeLSBot>	 mwtask161: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=ucroniaswiki 1 --e 2000 (running for 08:17)
[17:30:58] <MirahezeLSBot>	 mwtask171: not running
[17:30:59] <MirahezeLSBot>	 mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=deathbattlewiki 748001 (running for 17:09)
[18:30:57] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks
[18:30:58] <MirahezeLSBot>	 mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=edenxiwiki 20001 --e 22000 (running for 03:15)
[18:30:59] <MirahezeLSBot>	 mwtask161: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=ucroniaswiki 14001 --e 16000 (running for 06:24)
[18:31:00] <MirahezeLSBot>	 mwtask171: not running
[18:31:01] <MirahezeLSBot>	 mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=deathbattlewiki 748001 (running for 01:17:11)
[19:06:43] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 21.38, 17.46, 11.62
[19:07:31] <MirahezeLSBot>	 !log [blankeclair@mwtask161] runRefreshLinksChunked: [500/823] Handling uf1simwiki (start id: 0)
[19:07:33] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[19:08:43] <icinga-miraheze>	 RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 19.20, 18.25, 12.64
[19:30:59] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks
[19:31:00] <MirahezeLSBot>	 mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=empiresoftheforgottenworldwiki 2001 --e 4000 (running for 06:05)
[19:31:01] <MirahezeLSBot>	 mwtask161: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=undertaledeltaruneauocwiki 2001 --e 4000 (running for 02:35)
[19:31:02] <MirahezeLSBot>	 mwtask171: not running
[19:31:03] <MirahezeLSBot>	 mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=decodedocdigitizewiki 6001 --e 8000 (running for 01:06)
[19:41:53] <MirahezeLSBot>	 !log [blankeclair@mwtask181] runRefreshLinksChunked: [100/2761] Handling denagavarwiki (start id: 0)
[19:41:55] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[19:46:46] <MacFanBot>	 [02phorge-extensions] 07paladox created 03paladox-patch-1 (+1 new commit) 13https://github.com/miraheze/phorge-extensions/commit/81caf2747aeb
[19:46:46] <MacFanBot>	 02phorge-extensions/03paladox-patch-1 07paladox 0381caf27 Include meta.miraheze.org and login.miraheze.org in OAuth CSP…
[19:46:49] <MacFanBot>	 [02phorge-extensions] 07paladox opened pull request #58: Include meta.miraheze.org and login.miraheze.org in OAuth CSP (03master...03paladox-patch-1) 13https://github.com/miraheze/phorge-extensions/pull/58
[19:46:56] <MacFanBot>	 [02phorge-extensions] 07coderabbitai[bot] commented on pull request #58: --- […] 13https://github.com/miraheze/phorge-extensions/pull/58#issuecomment-2762283494
[19:47:05] <MacFanBot>	 [02phorge-extensions] 07github-actions[bot] pushed 1 new commit to 03paladox-patch-1 13https://github.com/miraheze/phorge-extensions/commit/80f23765d197ce9fa80ec58226387455ec118556
[19:47:05] <MacFanBot>	 02phorge-extensions/03paladox-patch-1 07github-actions 0380f2376 CI: lint code to standards…
[19:47:36] <miraheze-github>	 miraheze/phorge-extensions - paladox the build passed.
[19:49:13] <MacFanBot>	 [02phorge-extensions] 07paladox merged pull request #58: Include meta.miraheze.org and login.miraheze.org in OAuth CSP (03master...03paladox-patch-1) 13https://github.com/miraheze/phorge-extensions/pull/58
[19:49:13] <MacFanBot>	 [02phorge-extensions] 07paladox pushed 1 new commit to 03master 13https://github.com/miraheze/phorge-extensions/commit/c7fc657954457ffb1473b47a9501c24755d323d7
[19:49:15] <MacFanBot>	 02phorge-extensions/03master 07paladox 03c7fc657 Include meta.miraheze.org and login.miraheze.org in OAuth CSP (#58)…
[19:49:17] <MacFanBot>	 [02phorge-extensions] 07paladox 04deleted 03paladox-patch-1 at 0380f2376 13https://github.com/miraheze/phorge-extensions/commit/80f2376
[19:50:02] <miraheze-github>	 miraheze/phorge-extensions - paladox the build passed.
[19:50:40] <icinga-miraheze>	 PROBLEM - *.wikitide.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wikitide.org' expires in 14 day(s) (Sat 12 Apr 2025 07:36:30 PM GMT +0000).
[19:54:13] <icinga-miraheze>	 PROBLEM - rippaverse.wikitide.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wikitide.org' expires in 14 day(s) (Sat 12 Apr 2025 07:36:30 PM GMT +0000).
[20:00:10] <icinga-miraheze>	 PROBLEM - wikitide.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wikitide.org' expires in 14 day(s) (Sat 12 Apr 2025 07:36:30 PM GMT +0000).
[20:00:44] <MirahezeLSBot>	 !log [blankeclair@mwtask151] runRefreshLinksChunked: [300/2792] Handling enderianwiki (start id: 0)
[20:00:46] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[20:29:48] <MirahezeLSBot>	 !log [blankeclair@mwtask181] runRefreshLinksChunked: [200/2761] Handling duovisionwiki (start id: 0)
[20:29:50] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[20:31:01] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks
[20:31:02] <MirahezeLSBot>	 mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=evolutionismwiki 2001 --e 4000 (running for 01:59)
[20:31:03] <MirahezeLSBot>	 mwtask161: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=undertaledeltaruneauocwiki 28001 --e 30000 (running for 03:38)
[20:31:04] <MirahezeLSBot>	 mwtask171: not running
[20:31:05] <MirahezeLSBot>	 mwtask181: bash runRefreshLinksChunked.sh pre-1.43-shared-mwtask181-try-8.txt (running for 00:00)
[20:50:43] <MirahezeRelay>	 <blankeclair> huh? was mwtask181 caught running while in a subshell lmao
[21:05:14] <BlankEclair>	 re mwtask171
[21:05:15] <BlankEclair>	 MediaWiki\Revision\RevisionAccessException from line 1214 of /srv/mediawiki/1.43/includes/Revision/RevisionStore.php: Failed to load data blob from Bad data in text row 82. Use findBadBlobs.php to remedy. for revision 1791. If this problem persist, use the findBadBlobs maintenance script to investigate the issue and mark bad blobs.
[21:05:17] <BlankEclair>	 uh oh
[21:08:01] <MirahezeRelay>	 <pixldev, replying to blankeclair> shellception
[21:16:28] <MirahezeLSBot>	 !log [blankeclair@mwtask171] runRefreshLinksChunked: [0/1403] Handling notkancollewikiwiki (start id: 0)
[21:16:30] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[21:19:47] <MirahezeLSBot>	 !log [blankeclair@mwtask171] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php MirahezeMagic:RenameDatabase --wiki=loginwiki --user='BlankEclair (Miraheze)' --old=crapolawiki --new=bigcrapolawiki --rename (END - exit=0)
[21:19:49] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[21:31:04] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks
[21:31:05] <MirahezeLSBot>	 mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=evolutionismwiki 14001 (running for 13:11)
[21:31:06] <MirahezeLSBot>	 mwtask161: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=vanataswiki 2001 --e 4000 (running for 11:10)
[21:31:07] <MirahezeLSBot>	 mwtask171: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=nssportswiki 2001 --e 4000 (running for 02:36)
[21:31:08] <MirahezeLSBot>	 mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=epicduelwikiwiki 32001 --e 34000 (running for 02:11)
[21:49:26] <MirahezeLSBot>	 !log [blankeclair@mwtask181] runRefreshLinksChunked: [300/2761] Handling esquiregameswiki (start id: 0)
[21:49:27] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[22:10:43] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 23.57, 19.26, 12.29
[22:14:24] <icinga-miraheze>	 PROBLEM - mwtask151 Current Load on mwtask151 is WARNING: LOAD WARNING - total load average: 23.21, 19.52, 13.55
[22:14:43] <icinga-miraheze>	 RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 19.49, 19.50, 14.03
[22:16:24] <icinga-miraheze>	 RECOVERY - mwtask151 Current Load on mwtask151 is OK: LOAD OK - total load average: 17.16, 18.48, 13.90
[22:18:43] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 21.80, 20.78, 15.85
[22:18:50] <MirahezeLSBot>	 !log [blankeclair@mwtask161] runRefreshLinksChunked: [600/823] Handling vivalaeuropawiki (start id: 0)
[22:18:52] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[22:20:43] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 25.64, 23.02, 17.29
[22:22:20] <icinga-miraheze>	 [Grafana] FIRING: The mediawiki job queue has more than 2000 unclaimed jobs https://grafana.wikitide.net/d/GtxbP1Xnk?orgId=1
[22:22:43] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 20.87, 21.79, 17.52
[22:23:13] <icinga-miraheze>	 PROBLEM - mwtask151 Current Load on mwtask151 is WARNING: LOAD WARNING - total load average: 23.56, 20.74, 16.29
[22:25:07] <icinga-miraheze>	 PROBLEM - mwtask151 Current Load on mwtask151 is CRITICAL: LOAD CRITICAL - total load average: 26.50, 22.55, 17.46
[22:27:02] <icinga-miraheze>	 PROBLEM - mwtask151 Current Load on mwtask151 is WARNING: LOAD WARNING - total load average: 20.54, 22.24, 17.98
[22:28:43] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 28.02, 22.86, 19.04
[22:30:43] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 23.90, 22.90, 19.52
[22:30:50] <icinga-miraheze>	 RECOVERY - mwtask151 Current Load on mwtask151 is OK: LOAD OK - total load average: 12.75, 18.23, 17.39
[22:31:06] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks
[22:31:07] <MirahezeLSBot>	 mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=fairytailwiki 12001 --e 14000 (running for 01:01)
[22:31:08] <MirahezeLSBot>	 mwtask161: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=voidstrangerwiki 2001 --e 4000 (running for 01:06)
[22:31:09] <MirahezeLSBot>	 mwtask171: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=orbitaldebriswiki 1 --e 2000 (running for 06:44)
[22:31:10] <MirahezeLSBot>	 mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=fallenstarwiki 1 --e 2000 (running for 28:24)
[22:32:20] <icinga-miraheze>	 [Grafana] RESOLVED: High Job Queue Backlog https://grafana.wikitide.net/d/GtxbP1Xnk?orgId=1
[22:32:43] <icinga-miraheze>	 RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 12.91, 19.41, 18.68
[22:36:32] <MirahezeLSBot>	 !log [blankeclair@mwtask171] runRefreshLinksChunked: [100/1403] Handling outskirtsprojectwiki (start id: 0)
[22:36:34] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:31:08] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks
[23:31:09] <MirahezeLSBot>	 mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=fairytailwiki 70001 --e 72000 (running for 01:28)
[23:31:10] <MirahezeLSBot>	 mwtask161: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=whentheycrywiki 2001 --e 4000 (running for 00:24)
[23:31:11] <MirahezeLSBot>	 mwtask171: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=paneidoversewiki 4001 --e 6000 (running for 04:13)
[23:31:12] <MirahezeLSBot>	 mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=fanonpediawiki 2001 --e 4000 (running for 21:30)
[23:35:15] <MacFanBot>	 [02python-functions] 07dependabot[bot] created 03dependabot/pip/dot-github/types-requests-2.32.0.20250328 (+1 new commit) 13https://github.com/miraheze/python-functions/commit/164fd7e8a126
[23:35:15] <MacFanBot>	 02python-functions/03dependabot/pip/dot-github/types-requests-2.32.0.20250328 07dependabot[bot] 03164fd7e build(deps): bump types-requests in /.github…
[23:35:16] <MacFanBot>	 [02python-functions] 07dependabot[bot] added the label 'python' to pull request #133 (build(deps): bump types-requests from 2.32.0.20250306 to 2.32.0.20250328 in /.github) 13https://github.com/miraheze/python-functions/pull/133
[23:35:16] <MacFanBot>	 [02python-functions] 07dependabot[bot] added the label 'dependencies' to pull request #133 (build(deps): bump types-requests from 2.32.0.20250306 to 2.32.0.20250328 in /.github) 13https://github.com/miraheze/python-functions/pull/133
[23:35:18] <MacFanBot>	 [02python-functions] 07dependabot[bot] opened pull request #133: build(deps): bump types-requests from 2.32.0.20250306 to 2.32.0.20250328 in /.github (03master...03dependabot/pip/dot-github/types-requests-2.32.0.20250328) 13https://github.com/miraheze/python-functions/pull/133
[23:35:23] <MacFanBot>	 [02python-functions] 07coderabbitai[bot] commented on pull request #133: --- […] 13https://github.com/miraheze/python-functions/pull/133#issuecomment-2762855192
[23:39:13] <MacFanBot>	 [02python-functions] 07github-merge-queue[bot] created 03gh-readonly-queue/master/pr-133-7f75a04538ac56d49580af8716a1fba5b6f47c11 (+1 new commit) 13https://github.com/miraheze/python-functions/commit/52599402fabd
[23:39:13] <MacFanBot>	 02python-functions/03gh-readonly-queue/master/pr-133-7f75a04538ac56d49580af8716a1fba5b6f47c11 07dependabot[bot] 035259940 build(deps): bump types-requests in /.github (#133)…
[23:39:20] <miraheze-github>	 miraheze/python-functions - dependabot[bot] the build passed.
[23:43:23] <MacFanBot>	 [02python-functions] 07github-merge-queue[bot] merged 03gh-readonly-queue/master/pr-133-7f75a04538ac56d49580af8716a1fba5b6f47c11 into 03master 13https://github.com/miraheze/python-functions/compare/7f75a04538ac...52599402fabd
[23:43:25] <MacFanBot>	 [02python-functions] 07github-merge-queue[bot] 04deleted 03gh-readonly-queue/master/pr-133-7f75a04538ac56d49580af8716a1fba5b6f47c11 at 035259940 13https://github.com/miraheze/python-functions/commit/5259940
[23:43:27] <MacFanBot>	 [02python-functions] 07github-actions[bot] merged 07dependabot[bot]'s pull request #133: build(deps): bump types-requests from 2.32.0.20250306 to 2.32.0.20250328 in /.github (03master...03dependabot/pip/dot-github/types-requests-2.32.0.20250328) 13https://github.com/miraheze/python-functions/pull/133
[23:43:29] <MacFanBot>	 [02python-functions] 07github-actions[bot] 04deleted 03dependabot/pip/dot-github/types-requests-2.32.0.20250328 at 03164fd7e 13https://github.com/miraheze/python-functions/commit/164fd7e
[23:47:25] <miraheze-github>	 miraheze/python-functions - github-merge-queue[bot] the build passed.