[00:05:52] <icinga-miraheze>	 RECOVERY - cp38 Disk Space on cp38 is OK: DISK OK - free space: / 59001MiB (12% inode=99%);
[00:31:10] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks
[00:31:11] <MirahezeLSBot>	 mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=fairytailwiki 134001 --e 136000 (running for 01:32)
[00:31:12] <MirahezeLSBot>	 mwtask161: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=wikibiginowiki 2001 --e 4000 (running for 03:26)
[00:31:13] <MirahezeLSBot>	 mwtask171: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=peppafanonwiki 62001 --e 64000 (running for 00:21)
[00:31:14] <MirahezeLSBot>	 mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=finderherewiki 1 --e 2000 (running for 02:59)
[00:39:01] <MirahezeLSBot>	 !log [blankeclair@mwtask181] runRefreshLinksChunked: [400/2761] Handling fireemblemwiki (start id: 0)
[00:39:03] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[01:31:12] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks
[01:31:13] <MirahezeLSBot>	 mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=fairytailwiki 200001 --e 202000 (running for 01:47)
[01:31:14] <MirahezeLSBot>	 mwtask161: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=wikibiginowiki 2001 --e 4000 (running for 01:03:28)
[01:31:15] <MirahezeLSBot>	 mwtask171: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=pippipediawiki 1 --e 2000 (running for 00:43)
[01:31:16] <MirahezeLSBot>	 mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=fungalinfectionsporewiki 2001 --e 4000 (running for 05:36)
[01:44:43] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 26.33, 20.97, 12.89
[01:46:24] <icinga-miraheze>	 PROBLEM - mwtask151 Current Load on mwtask151 is WARNING: LOAD WARNING - total load average: 21.80, 17.11, 10.24
[01:48:43] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 23.84, 22.89, 15.57
[01:52:43] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 26.15, 24.48, 17.86
[01:56:24] <icinga-miraheze>	 RECOVERY - mwtask151 Current Load on mwtask151 is OK: LOAD OK - total load average: 15.86, 20.05, 15.51
[02:02:43] <icinga-miraheze>	 RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 10.16, 19.27, 19.56
[02:29:50] <MirahezeLSBot>	 !log [blankeclair@mwtask171] runRefreshLinksChunked: [200/1403] Handling plavbawiki (start id: 0)
[02:29:52] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[02:31:15] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks
[02:31:16] <MirahezeLSBot>	 mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=fairytailwiki 260001 --e 262000 (running for 01:33)
[02:31:17] <MirahezeLSBot>	 mwtask161: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=wikibiginowiki 4001 --e 6000 (running for 13:37)
[02:31:18] <MirahezeLSBot>	 mwtask171: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=pmodwiki 1 --e 2000 (running for 00:36)
[02:31:19] <MirahezeLSBot>	 mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=fungalinfectionsporewiki 4001 --e 6000 (running for 08:19)
[02:54:15] <MirahezeLSBot>	 !log [blankeclair@mwtask181] runRefreshLinksChunked: [500/2761] Handling genethoswiki (start id: 0)
[02:54:17] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[03:06:04] <MirahezeLSBot>	 !log [blankeclair@mwtask151] runRefreshLinksChunked: [400/2792] Handling favorite2hufanartwikiwiki (start id: 0)
[03:06:06] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[03:19:44] <MacFanBot>	 [02ssl] 07MacFan4000 pushed 1 new commit to 03master 13https://github.com/miraheze/ssl/commit/3520011def770b08e8e1fc58651b671ca6c22657
[03:19:44] <MacFanBot>	 02ssl/03master 07MacFan4000 033520011 add echoverse.wiki and www.drawing.wiki
[03:31:17] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks
[03:31:18] <MirahezeLSBot>	 mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=fictionpediawiki 4001 (running for 07:51)
[03:31:19] <MirahezeLSBot>	 mwtask161: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=wikibiginowiki 6001 --e 8000 (running for 22:30)
[03:31:20] <MirahezeLSBot>	 mwtask171: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=polandballruwiki 8001 --e 10000 (running for 00:27)
[03:31:21] <MirahezeLSBot>	 mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=googologywiki 1 --e 2000 (running for 01:27)
[03:37:11] <BlankEclair>	 when are we getting wikiwiki?
[04:31:19] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks
[04:31:20] <MirahezeLSBot>	 mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=foolsgoldwiki 1 --e 2000 (running for 07:47)
[04:31:21] <MirahezeLSBot>	 mwtask161: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=wikibiginowiki 8001 --e 10000 (running for 11:58)
[04:31:22] <MirahezeLSBot>	 mwtask171: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=polandballruwiki 76001 --e 78000 (running for 00:24)
[04:31:23] <MirahezeLSBot>	 mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=gsowiki 1 --e 2000 (running for 00:03)
[05:31:21] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks
[05:31:23] <MirahezeLSBot>	 mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=funkeywiki 1 --e 2000 (running for 01:02)
[05:31:24] <MirahezeLSBot>	 mwtask161: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=wikibiginowiki 10001 --e 12000 (running for 26:48)
[05:31:25] <MirahezeLSBot>	 mwtask171: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=polcompballwiki 30001 --e 32000 (running for 01:12)
[05:31:25] <MirahezeLSBot>	 mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=harnicawiki 1 --e 2000 (running for 02:48)
[06:31:24] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks
[06:31:25] <MirahezeLSBot>	 mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=furrnationswiki 2001 --e 4000 (running for 25:48)
[06:31:26] <MirahezeLSBot>	 mwtask161: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=wikibiginowiki 12001 --e 14000 (running for 32:34)
[06:31:27] <MirahezeLSBot>	 mwtask171: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=polytopewiki 6001 --e 8000 (running for 07:10)
[06:31:28] <MirahezeLSBot>	 mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=harnicawiki 14001 --e 16000 (running for 00:12)
[07:31:26] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks
[07:31:27] <MirahezeLSBot>	 mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=fusangpediawiki 2001 --e 4000 (running for 00:11)
[07:31:28] <MirahezeLSBot>	 mwtask161: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=wikibiginowiki 16001 --e 18000 (running for 16:14)
[07:31:29] <MirahezeLSBot>	 mwtask171: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=polytopewiki 16001 --e 18000 (running for 02:11)
[07:31:30] <MirahezeLSBot>	 mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=harnicawiki 22001 --e 24000 (running for 08:27)
[07:38:21] <MirahezeLSBot>	 !log [blankeclair@mwtask151] runRefreshLinksChunked: [500/2792] Handling futanariwiki (start id: 0)
[07:38:24] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[07:38:30] <BlankEclair>	 we have a fucking WHAT
[07:38:48] <BlankEclair>	 oh, abandoned wiki it seems
[07:45:54] <MirahezeRelay>	 <aeywoo> Oh god.
[07:47:31] <BlankEclair>	 for better or worse, it's empty
[07:47:41] <BlankEclair>	 at least it's not like animatedmusclewomenwiki?
[08:31:28] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks
[08:31:29] <MirahezeLSBot>	 mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=gameshowswiki 16001 --e 18000 (running for 05:18)
[08:31:30] <MirahezeLSBot>	 mwtask161: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=wikibiginowiki 18001 --e 20000 (running for 33:48)
[08:31:31] <MirahezeLSBot>	 mwtask171: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=polytopewiki 30001 --e 32000 (running for 03:05)
[08:31:32] <MirahezeLSBot>	 mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=harnicawiki 36001 --e 38000 (running for 01:56)
[09:31:31] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks
[09:31:32] <MirahezeLSBot>	 mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=gameshowswiki 24001 (running for 03:18)
[09:31:33] <MirahezeLSBot>	 mwtask161: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=wikitrashwiki 1 --e 2000 (running for 05:43)
[09:31:34] <MirahezeLSBot>	 mwtask171: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=projectmoonwiki 4001 --e 6000 (running for 05:15)
[09:31:35] <MirahezeLSBot>	 mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=harnicawiki 44001 --e 46000 (running for 08:08)
[09:52:00] <MirahezeLSBot>	 !log [blankeclair@mwtask181] runRefreshLinksChunked: [600/2761] Handling hatumerowiki (start id: 0)
[09:52:02] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[10:16:14] <RhinosF1>	 !log revised job queue alerts
[10:16:16] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[10:17:18] <MirahezeLSBot>	 !log [blankeclair@mwtask161] runRefreshLinksChunked: [694/823] wikitrashwiki exited with 1
[10:17:20] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[10:31:33] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks
[10:31:34] <MirahezeLSBot>	 mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=gleekswiki 2001 --e 4000 (running for 00:11)
[10:31:35] <MirahezeLSBot>	 mwtask161: not running
[10:31:36] <MirahezeLSBot>	 mwtask171: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=projectsekaiwiki 12001 --e 14000 (running for 01:37)
[10:31:37] <MirahezeLSBot>	 mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=hereuswiki 2001 --e 4000 (running for 11:39)
[10:54:46] <MirahezeLSBot>	 !log [blankeclair@mwtask161] runRefreshLinksChunked: [0/128] Handling wikiversoswiki (start id: 0)
[10:54:48] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[11:31:35] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks
[11:31:36] <MirahezeLSBot>	 mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=gratispaideiawiki 1 --e 2000 (running for 10:51)
[11:31:37] <MirahezeLSBot>	 mwtask161: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=worldofwarwiki 4001 --e 6000 (running for 12:53)
[11:31:38] <MirahezeLSBot>	 mwtask171: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=projectsekaiwiki 40001 --e 42000 (running for 01:33)
[11:31:39] <MirahezeLSBot>	 mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=hereuswiki 16001 --e 18000 (running for 01:13)
[11:59:37] <MirahezeLSBot>	 !log [blankeclair@mwtask151] runRefreshLinksChunked: [600/2792] Handling gswitchwiki (start id: 0)
[11:59:39] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[12:19:00] <MirahezeLSBot>	 !log [blankeclair@mwtask171] runRefreshLinksChunked: [300/1403] Handling puertomandelawiki (start id: 0)
[12:19:02] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[12:31:38] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks
[12:31:39] <MirahezeLSBot>	 mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=hebammenwikiwiki 1 --e 2000 (running for 00:05)
[12:31:40] <MirahezeLSBot>	 mwtask161: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=yourcreatureswiki 1 --e 2000 (running for 01:40)
[12:31:41] <MirahezeLSBot>	 mwtask171: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=ranchstorywiki 1 --e 2000 (running for 01:05)
[12:31:42] <MirahezeLSBot>	 mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=hereuswiki 36001 --e 38000 (running for 03:16)
[12:34:54] <miraheze-github>	 miraheze/mw-config - RhinosF1 the build passed.
[12:34:56] <MirahezeLSBot>	 !log [blankeclair@mwtask161] runRefreshLinksChunked: [100/128] Handling zampaniosimwiki (start id: 0)
[12:34:58] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[12:35:51] <MacFanBot>	 [02mw-config] 07RhinosF1 merged 07Aeywoo's pull request #5861: Install Extension:CampaignEvents (07miraheze:03master...07Aeywoo:03patch-3) 13https://github.com/miraheze/mw-config/pull/5861
[12:35:51] <MacFanBot>	 [02mw-config] 07RhinosF1 pushed 1 new commit to 03master 13https://github.com/miraheze/mw-config/commit/f46003bd6ef714b64eff1362426f7e701507025f
[12:35:51] <MacFanBot>	 02mw-config/03master 07Aeywoo 03f46003b Install Extension:CampaignEvents (#5861)…
[12:36:29] <MirahezeLSBot>	 !log [rhinos@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all
[12:36:31] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[12:36:45] <miraheze-github>	 miraheze/mw-config - RhinosF1 the build passed.
[12:36:53] <MirahezeLSBot>	 !log [rhinos@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 24s
[12:36:55] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[12:37:57] <MirahezeLSBot>	 !log [rhinos@test151] starting deploy of {'pull': 'config', 'config': True} to test151
[12:37:58] <MirahezeLSBot>	 !log [rhinos@test151] finished deploy of {'pull': 'config', 'config': True} to test151 - SUCCESS in 1s
[12:37:59] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[12:38:01] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[12:41:40] <MirahezeLSBot>	 !log [rhinos@test151] starting deploy of {'l10n': True, 'extension_list': True, 'versions': '1.44'} to test151
[12:41:42] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[12:42:38] <MirahezeLSBot>	 !log [rhinos@test151] finished deploy of {'l10n': True, 'extension_list': True, 'versions': '1.44'} to test151 - SUCCESS in 58s
[12:42:40] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[12:43:24] <MirahezeLSBot>	 !log [rhinos@mwtask181] starting deploy of {'l10n': True, 'extension_list': True, 'versions': '1.43'} to all
[12:43:26] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[12:50:20] <MacFanBot>	 [02mw-config] 07RhinosF1 pushed 1 new commit to 03master 13https://github.com/miraheze/mw-config/commit/259b993c7470867316ff80da3f77db1ddcec45fd
[12:50:21] <MacFanBot>	 02mw-config/03master 07RhinosF1 03259b993 Update ManageWikiExtensions.php
[12:50:27] <MirahezeLSBot>	 !log [rhinos@test151] starting deploy of {'pull': 'config', 'config': True} to test151
[12:50:28] <MirahezeLSBot>	 !log [rhinos@test151] finished deploy of {'pull': 'config', 'config': True} to test151 - SUCCESS in 0s
[12:50:29] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[12:50:31] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[12:51:17] <miraheze-github>	 miraheze/mw-config - RhinosF1 the build passed.
[12:51:35] <MirahezeLSBot>	 !log [rhinos@mwtask181] finished deploy of {'l10n': True, 'extension_list': True, 'versions': '1.43'} to all - SUCCESS in 490s
[12:51:37] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[12:51:44] <MirahezeLSBot>	 !log [rhinos@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all
[12:51:46] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[12:52:08] <MirahezeLSBot>	 !log [rhinos@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 23s
[12:52:10] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[12:54:41] <MacFanBot>	 [02mw-config] 07RhinosF1 pushed 1 new commit to 03master 13https://github.com/miraheze/mw-config/commit/fdaf90ecae1fc30602e34ee82fa18bb28cb6395d
[12:54:41] <MacFanBot>	 02mw-config/03master 07RhinosF1 03fdaf90e Update ManageWikiExtensions.php
[12:54:48] <MirahezeLSBot>	 !log [rhinos@test151] starting deploy of {'pull': 'config', 'config': True} to test151
[12:54:49] <MirahezeLSBot>	 !log [rhinos@test151] finished deploy of {'pull': 'config', 'config': True} to test151 - SUCCESS in 0s
[12:54:50] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[12:54:51] <MirahezeLSBot>	 !log [rhinos@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all
[12:54:52] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[12:54:54] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[12:55:16] <MirahezeLSBot>	 !log [rhinos@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 24s
[12:55:18] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[12:55:40] <miraheze-github>	 miraheze/mw-config - RhinosF1 the build passed.
[13:10:26] <MacFanBot>	 [02puppet] 07RhinosF1 requested changes on pull request #4251: DO NOT MERGE 13https://github.com/miraheze/puppet/pull/4251#pullrequestreview-2727365143
[13:27:01] <MacFanBot>	 [02mw-config] 07RhinosF1 pushed 1 new commit to 03master 13https://github.com/miraheze/mw-config/commit/edf5cc32d875c88aa657f2d9d739fe31128f9e0e
[13:27:02] <MacFanBot>	 02mw-config/03master 07RhinosF1 03edf5cc3 restrict CampaignEvents
[13:27:10] <MirahezeLSBot>	 !log [rhinos@test151] starting deploy of {'pull': 'config', 'config': True} to test151
[13:27:11] <MirahezeLSBot>	 !log [rhinos@test151] finished deploy of {'pull': 'config', 'config': True} to test151 - SUCCESS in 0s
[13:27:12] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[13:27:14] <MirahezeLSBot>	 !log [rhinos@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all
[13:27:14] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[13:27:16] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[13:27:40] <MirahezeLSBot>	 !log [rhinos@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 26s
[13:27:42] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[13:27:59] <miraheze-github>	 miraheze/mw-config - RhinosF1 the build passed.
[13:29:11] <MacFanBot>	 [02puppet] 07Aeywoo commented on pull request #4251: I will merge this repo >:3 13https://github.com/miraheze/puppet/pull/4251#issuecomment-2763365190
[13:30:01] <MirahezeLSBot>	 !log [rhinos@mwtask181] sudo -u www-data /usr/local/bin/foreachwikiindblist /tmp/CampaginEvents.php /srv/mediawiki/1.43/maintenance/run.php ManageWiki::ToggleExtension --disable (START)
[13:30:02] <MirahezeLSBot>	 !log [rhinos@mwtask181] sudo -u www-data /usr/local/bin/foreachwikiindblist /tmp/CampaginEvents.php /srv/mediawiki/1.43/maintenance/run.php ManageWiki::ToggleExtension --disable (END - exit=256)
[13:30:03] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[13:30:05] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[13:31:40] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks
[13:31:41] <MirahezeLSBot>	 mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=horsegamedatabasewiki 12001 --e 14000 (running for 00:38)
[13:31:42] <MirahezeLSBot>	 mwtask161: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=zhdelwiki 32001 --e 34000 (running for 00:56)
[13:31:43] <MirahezeLSBot>	 mwtask171: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=removededmsongswiki 2001 --e 4000 (running for 04:35)
[13:31:44] <MirahezeLSBot>	 mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=hereuswiki 56001 --e 58000 (running for 04:20)
[13:36:58] <MirahezeLSBot>	 !log [blankeclair@mwtask151] runRefreshLinksChunked: [700/2792] Handling hsoodenwiki (start id: 0)
[13:37:00] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[13:37:39] <MacFanBot>	 [02mw-config] 07RhinosF1 created 03RhinosF1-patch-1 (+1 new commit) 13https://github.com/miraheze/mw-config/commit/b6ef8c0bb134
[13:37:39] <MacFanBot>	 02mw-config/03RhinosF1-patch-1 07RhinosF1 03b6ef8c0 Update ManageWikiExtensions.php
[13:37:44] <MacFanBot>	 [02mw-config] 07RhinosF1 opened pull request #5885: Update ManageWikiExtensions.php (03master...03RhinosF1-patch-1) 13https://github.com/miraheze/mw-config/pull/5885
[13:38:17] <MacFanBot>	 [02mw-config] 07github-actions[bot] pushed 1 new commit to 03RhinosF1-patch-1 13https://github.com/miraheze/mw-config/commit/9bfb370aff310616f6a7290b503162093b5b5cc9
[13:38:17] <MacFanBot>	 02mw-config/03RhinosF1-patch-1 07github-actions 039bfb370 CI: lint code to MediaWiki standards…
[13:38:47] <miraheze-github>	 miraheze/mw-config - RhinosF1 the build passed.
[13:40:23] <MacFanBot>	 [02mw-config] 07RhinosF1 pushed 1 new commit to 03RhinosF1-patch-1 13https://github.com/miraheze/mw-config/commit/df210722021f87844ad7d0cfe729c80257edb2f9
[13:40:23] <MacFanBot>	 02mw-config/03RhinosF1-patch-1 07RhinosF1 03df21072 Update LocalSettings.php
[13:41:21] <miraheze-github>	 miraheze/mw-config - RhinosF1 the build passed.
[13:41:57] <MacFanBot>	 [02mw-config] 07RhinosF1 merged pull request #5885: Update ManageWikiExtensions.php (03master...03RhinosF1-patch-1) 13https://github.com/miraheze/mw-config/pull/5885
[13:41:57] <MacFanBot>	 [02mw-config] 07RhinosF1 pushed 1 new commit to 03master 13https://github.com/miraheze/mw-config/commit/d753a836e723dfe9c8b2dfae2207e59a83d197b6
[13:41:57] <MacFanBot>	 02mw-config/03master 07RhinosF1 03d753a83 Update ManageWikiExtensions.php (#5885)…
[13:41:59] <MacFanBot>	 [02mw-config] 07RhinosF1 04deleted 03RhinosF1-patch-1 at 03df21072 13https://github.com/miraheze/mw-config/commit/df21072
[13:42:00] <MirahezeLSBot>	 !log [rhinos@test151] starting deploy of {'pull': 'config', 'config': True} to test151
[13:42:01] <MirahezeLSBot>	 !log [rhinos@test151] finished deploy of {'pull': 'config', 'config': True} to test151 - SUCCESS in 0s
[13:42:03] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[13:42:04] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[13:42:05] <MirahezeLSBot>	 !log [rhinos@test151] starting deploy of {'pull': 'config', 'config': True} to test151
[13:42:06] <MirahezeLSBot>	 !log [rhinos@test151] finished deploy of {'pull': 'config', 'config': True} to test151 - SUCCESS in 0s
[13:42:07] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[13:42:09] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[13:42:49] <miraheze-github>	 miraheze/mw-config - RhinosF1 the build passed.
[13:43:01] <MirahezeLSBot>	 !log [rhinos@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all
[13:43:03] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[13:43:25] <MirahezeLSBot>	 !log [rhinos@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 24s
[13:43:27] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[13:47:42] <MirahezeLSBot>	 !log [macfan@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php /srv/mediawiki/1.43/maintenance/importDump.php --wiki=magmmlcontestwiki magmmlcontestcom_wiki-20250328-wikidump/magmmlcontestcom_wiki-20250328-history.xml --no-updates (START)
[13:47:44] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[14:23:28] <MirahezeLSBot>	 !log [blankeclair@mwtask151] runRefreshLinksChunked: [800/2792] Handling iss12wiki (start id: 0)
[14:23:31] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[14:31:25] <MirahezeLSBot>	 !log [blankeclair@mwtask171] runRefreshLinksChunked: [400/1403] Handling reyversewiki (start id: 0)
[14:31:27] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[14:31:42] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks
[14:31:43] <MirahezeLSBot>	 mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=jacksrealityremakeswiki 1 --e 2000 (running for 03:28)
[14:31:44] <MirahezeLSBot>	 mwtask161: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=zhdelwiki 76001 --e 78000 (running for 02:12)
[14:31:45] <MirahezeLSBot>	 mwtask171: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=rhapsodyalphawiki 1 --e 2000 (running for 00:04)
[14:31:46] <MirahezeLSBot>	 mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=hereuswiki 78001 --e 80000 (running for 03:54)
[14:35:00] <MirahezeLSBot>	 !log [macfan@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php /srv/mediawiki/1.43/maintenance/importDump.php --wiki=magmmlcontestwiki magmmlcontestcom_wiki-20250328-wikidump/magmmlcontestcom_wiki-20250328-history.xml --no-updates (END - exit=0)
[14:35:01] <MirahezeLSBot>	 !log [macfan@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php /srv/mediawiki/1.43/maintenance/rebuildall.php --wiki=magmmlcontestwiki (START)
[14:35:01] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[14:35:03] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[14:43:26] <icinga-miraheze>	 PROBLEM - cp38 Disk Space on cp38 is WARNING: DISK WARNING - free space: / 49939MiB (10% inode=99%);
[15:03:16] <MirahezeLSBot>	 !log [macfan@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php /srv/mediawiki/1.43/maintenance/rebuildall.php --wiki=magmmlcontestwiki (END - exit=0)
[15:03:18] <MirahezeLSBot>	 !log [macfan@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php /srv/mediawiki/1.43/maintenance/initSiteStats.php --wiki=magmmlcontestwiki --update (END - exit=0)
[15:03:19] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[15:03:20] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[15:24:56] <icinga-miraheze>	 [Grafana] FIRING: The mediawiki JobQueue backlog is increasing by more than 100 jobs a minute over an extended time period https://grafana.wikitide.net/d/GtxbP1Xnk?orgId=1
[15:31:45] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks
[15:31:46] <MirahezeLSBot>	 mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=japolandballfanonwiki 14001 --e 16000 (running for 00:27)
[15:31:47] <MirahezeLSBot>	 mwtask161: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=zhdelwiki 80001 (running for 56:32)
[15:31:48] <MirahezeLSBot>	 mwtask171: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=rosettacodewiki 1 --e 2000 (running for 23:44)
[15:31:49] <MirahezeLSBot>	 mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=hommwiki 4001 --e 6000 (running for 00:25)
[15:36:14] <MirahezeLSBot>	 !log [macfan@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php /srv/mediawiki/1.43/maintenance/importImages.php --wiki=magmmlcontestwiki magmmlcontestcom_wiki-20250328-wikidump/images --search-recursively (START)
[15:36:16] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[15:40:12] <MacFanBot>	 [02dns] 07MacFan4000 pushed 1 new commit to 03master 13https://github.com/miraheze/dns/commit/502293108ff3a32a5f1b80c6f337cecd64b2f641
[15:40:12] <MacFanBot>	 02dns/03master 07MacFan4000 035022931 add ACME challenges wikitide.org
[15:41:07] <MacFanBot>	 [02ssl] 07WikiTideSSLBot pushed 1 new commit to 03master 13https://github.com/miraheze/ssl/commit/28672f3a1fc5e8030bd57ee41569b84b7ca24c08
[15:41:07] <MacFanBot>	 02ssl/03master 07WikiTideSSLBot 0328672f3 Bot: Update SSL cert for wikitide.org
[15:41:08] <miraheze-github>	 miraheze/dns - MacFan4000 the build passed.
[15:44:21] <icinga-miraheze>	 PROBLEM - mwtask171 Current Load on mwtask171 is WARNING: LOAD WARNING - total load average: 23.64, 18.59, 11.58
[15:44:56] <icinga-miraheze>	 [Grafana] RESOLVED: MediaWiki Jobs are rapidly increasing https://grafana.wikitide.net/d/GtxbP1Xnk?orgId=1
[15:48:13] <icinga-miraheze>	 PROBLEM - mwtask171 Current Load on mwtask171 is CRITICAL: LOAD CRITICAL - total load average: 24.02, 21.28, 14.23
[15:49:56] <icinga-miraheze>	 [Grafana] FIRING: The mediawiki job queue has more than 20000 unclaimed jobs https://grafana.wikitide.net/d/GtxbP1Xnk?orgId=1[Grafana] RESOLVED: MediaWiki Jobs are rapidly increasing https://grafana.wikitide.net/d/GtxbP1Xnk?orgId=1
[15:51:50] <MirahezeLSBot>	 !log [macfan@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php /srv/mediawiki/1.43/maintenance/importImages.php --wiki=magmmlcontestwiki magmmlcontestcom_wiki-20250328-wikidump/images --search-recursively (END - exit=0)
[15:51:52] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[15:52:06] <icinga-miraheze>	 PROBLEM - mwtask171 Current Load on mwtask171 is WARNING: LOAD WARNING - total load average: 22.04, 22.46, 16.32
[15:52:11] <MacFanBot>	 [02puppet] 07paladox pushed 1 new commit to 03master 13https://github.com/miraheze/puppet/commit/1151de0162c12c883257db752595a283995d1f29
[15:52:11] <MacFanBot>	 02puppet/03master 07paladox 031151de0 changeprop201: increase emantic_mediawiki_concurrency to 6
[15:52:50] <MacFanBot>	 [02puppet] 07paladox pushed 1 new commit to 03master 13https://github.com/miraheze/puppet/commit/778f2be6bb3735da5faa8f9e35c12096344da04f
[15:52:50] <MacFanBot>	 02puppet/03master 07paladox 03778f2be Delete hieradata/hosts/changeprop151.yaml
[15:54:02] <icinga-miraheze>	 RECOVERY - mwtask171 Current Load on mwtask171 is OK: LOAD OK - total load average: 6.68, 17.23, 15.17
[15:57:56] <icinga-miraheze>	 PROBLEM - mwtask171 Current Load on mwtask171 is WARNING: LOAD WARNING - total load average: 22.56, 20.19, 16.82
[16:01:49] <icinga-miraheze>	 RECOVERY - mwtask171 Current Load on mwtask171 is OK: LOAD OK - total load average: 11.07, 16.89, 16.41
[16:03:49] <MacFanBot>	 [02puppet] 07paladox pushed 1 new commit to 03master 13https://github.com/miraheze/puppet/commit/7fbad191f6e9e1e000cddd0b64996bbf7242c1ec
[16:03:49] <MacFanBot>	 02puppet/03master 07paladox 037fbad19 changeprop201: increase semanticmediawiki concurrency to 10
[16:03:53] <icinga-miraheze>	 PROBLEM - matomo151 Current Load on matomo151 is CRITICAL: LOAD CRITICAL - total load average: 10.68, 7.78, 6.38
[16:08:43] <MirahezeLSBot>	 !log [macfan@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php /srv/mediawiki/1.43/maintenance/importDump.php --wiki=tgmc14wiki Space_Station_14_Вики-20250326042231.xml --no-updates (START)
[16:08:44] <MirahezeLSBot>	 !log [macfan@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php /srv/mediawiki/1.43/maintenance/importDump.php --wiki=tgmc14wiki Space_Station_14_Вики-20250326042231.xml --no-updates (END - exit=256)
[16:08:45] <MirahezeLSBot>	 !log [macfan@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php /srv/mediawiki/1.43/maintenance/rebuildall.php --wiki=tgmc14wiki (START)
[16:08:45] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[16:08:46] <MirahezeLSBot>	 !log [macfan@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php /srv/mediawiki/1.43/maintenance/rebuildall.php --wiki=tgmc14wiki (END - exit=2)
[16:08:47] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[16:08:47] <MirahezeLSBot>	 !log [macfan@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php /srv/mediawiki/1.43/maintenance/initSiteStats.php --wiki=tgmc14wiki --update (END - exit=0)
[16:08:49] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[16:08:51] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[16:08:53] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[16:09:56] <MirahezeLSBot>	 !log [macfan@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php /srv/mediawiki/1.43/maintenance/importDump.php --wiki=tgmc14wiki Space_Station_14_Вики-20250326042231.xml --no-updates (START)
[16:09:58] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[16:20:22] <icinga-miraheze>	 RECOVERY - rippaverse.wikitide.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wikitide.org' will expire on Fri 27 Jun 2025 02:42:29 PM GMT +0000.
[16:24:56] <icinga-miraheze>	 [Grafana] RESOLVED: High Job Queue Backlog https://grafana.wikitide.net/d/GtxbP1Xnk?orgId=1
[16:30:13] <icinga-miraheze>	 RECOVERY - *.wikitide.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wikitide.org' will expire on Fri 27 Jun 2025 02:42:29 PM GMT +0000.
[16:31:47] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks
[16:31:48] <MirahezeLSBot>	 mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=japolandballfanonwiki 30001 --e 32000 (running for 12:02)
[16:31:49] <MirahezeLSBot>	 mwtask161: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=allthetropeswiki 4001 --e 6000 (running for 00:31)
[16:31:50] <MirahezeLSBot>	 mwtask171: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=rosettacodewiki 2001 --e 4000 (running for 15:13)
[16:31:51] <MirahezeLSBot>	 mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=idrisiwiki 2001 (running for 00:00)
[16:32:58] <MirahezeLSBot>	 !log [blankeclair@mwtask181] runRefreshLinksChunked: [700/2761] Handling igniswiki (start id: 0)
[16:33:00] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[16:46:25] <MirahezeLSBot>	 !log [macfan@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php /srv/mediawiki/1.43/maintenance/importDump.php --wiki=tgmc14wiki Space_Station_14_Вики-20250326042231.xml --no-updates (END - exit=256)
[16:46:26] <MirahezeLSBot>	 !log [macfan@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php /srv/mediawiki/1.43/maintenance/rebuildall.php --wiki=tgmc14wiki (START)
[16:46:27] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[16:46:29] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[16:48:24] <icinga-miraheze>	 RECOVERY - wikitide.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wikitide.org' will expire on Fri 27 Jun 2025 02:42:29 PM GMT +0000.
[17:21:44] <MirahezeLSBot>	 !log [macfan@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php /srv/mediawiki/1.43/maintenance/rebuildall.php --wiki=tgmc14wiki (END - exit=0)
[17:21:45] <MirahezeLSBot>	 !log [macfan@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php /srv/mediawiki/1.43/maintenance/initSiteStats.php --wiki=tgmc14wiki --update (END - exit=0)
[17:21:46] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[17:21:48] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[17:31:49] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks
[17:31:50] <MirahezeLSBot>	 mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=jwmeetingwiki 2001 --e 4000 (running for 05:47)
[17:31:51] <MirahezeLSBot>	 mwtask161: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=allthetropeswiki 22001 --e 24000 (running for 04:59)
[17:31:52] <MirahezeLSBot>	 mwtask171: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=rosettacodewiki 8001 --e 10000 (running for 08:42)
[17:31:53] <MirahezeLSBot>	 mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=irfwiki 1 --e 2000 (running for 01:37)
[17:50:06] <MirahezeLSBot>	 !log [macfan@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php /srv/mediawiki/1.43/maintenance/importDump.php --wiki=tgmc14wiki Space_Station_14_Вики-20250326042809.xml --no-updates (START)
[17:50:08] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[17:50:19] <MirahezeLSBot>	 !log [macfan@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php /srv/mediawiki/1.43/maintenance/importDump.php --wiki=tgmc14wiki Space_Station_14_Вики-20250326042809.xml --no-updates (END - exit=256)
[17:50:20] <MirahezeLSBot>	 !log [macfan@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php /srv/mediawiki/1.43/maintenance/rebuildall.php --wiki=tgmc14wiki (START)
[17:50:21] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[17:50:22] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[17:50:57] <MirahezeLSBot>	 !log [macfan@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php /srv/mediawiki/1.43/maintenance/rebuildall.php --wiki=tgmc14wiki (END - exit=2)
[17:50:58] <MirahezeLSBot>	 !log [macfan@mwtask181] sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php /srv/mediawiki/1.43/maintenance/initSiteStats.php --wiki=tgmc14wiki --update (END - exit=2)
[17:50:59] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[17:51:01] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[18:09:36] <MirahezeLSBot>	 !log [blankeclair@mwtask151] runRefreshLinksChunked: [900/2792] Handling killerqueenwiki (start id: 0)
[18:09:38] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[18:31:52] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks
[18:31:53] <MirahezeLSBot>	 mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=laoshiwiki 1 --e 2000 (running for 00:16)
[18:31:54] <MirahezeLSBot>	 mwtask161: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=allthetropeswiki 42001 --e 44000 (running for 03:17)
[18:31:55] <MirahezeLSBot>	 mwtask171: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=rosettacodewiki 12001 --e 14000 (running for 09:14)
[18:31:56] <MirahezeLSBot>	 mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=jiduocdumpwiki 1 --e 2000 (running for 00:42)
[18:31:57] <MirahezeLSBot>	 !log [blankeclair@mwtask181] runRefreshLinksChunked: [800/2761] Handling jilljimmywiki (start id: 0)
[18:31:59] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[18:53:01] <MirahezeLSBot>	 !log [blankeclair@mwtask151] runRefreshLinksChunked: [1000/2792] Handling lgbtqidentitywiki (start id: 0)
[18:53:03] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[19:09:09] <icinga-miraheze>	 PROBLEM - phighting.wiki - LetsEncrypt on sslhost is CRITICAL: No address associated with hostnameHTTP CRITICAL - Unable to open TCP socket
[19:19:53] <icinga-miraheze>	 PROBLEM - matomo151 Current Load on matomo151 is WARNING: LOAD WARNING - total load average: 3.86, 6.63, 7.99
[19:26:43] <MacFanBot>	 [02dns] 07RhinosF1 pushed 1 new commit to 03master 13https://github.com/miraheze/dns/commit/81ea3c42e7ef8e25ae84e966ea9e15706b67cee6
[19:26:43] <MacFanBot>	 02dns/03master 07RhinosF1 0381ea3c4 Delete zones/phighting.wiki
[19:27:37] <miraheze-github>	 miraheze/dns - RhinosF1 the build passed.
[19:27:53] <icinga-miraheze>	 RECOVERY - matomo151 Current Load on matomo151 is OK: LOAD OK - total load average: 5.89, 5.38, 6.77
[19:31:54] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks
[19:31:55] <MirahezeLSBot>	 mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=lhkpediawiki 12001 --e 14000 (running for 01:28)
[19:31:56] <MirahezeLSBot>	 mwtask161: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=allthetropeswiki 62001 --e 64000 (running for 02:46)
[19:31:57] <MirahezeLSBot>	 mwtask171: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=rtlwiki 1 --e 2000 (running for 01:29)
[19:31:58] <MirahezeLSBot>	 mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=jtohwiki 34001 --e 36000 (running for 01:50)
[19:38:49] <icinga-miraheze>	 RECOVERY - phighting.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'phighting.wiki' will expire on Fri 27 Jun 2025 06:23:27 PM GMT +0000.
[20:31:56] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks
[20:31:57] <MirahezeLSBot>	 mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=librepediawiki 1 --e 2000 (running for 04:08)
[20:31:58] <MirahezeLSBot>	 mwtask161: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=allthetropeswiki 82001 --e 84000 (running for 03:25)
[20:31:59] <MirahezeLSBot>	 mwtask171: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=sagan4alphawiki 1 --e 2000 (running for 32:42)
[20:32:00] <MirahezeLSBot>	 mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=jwikiwiki 1 --e 2000 (running for 06:13)
[20:46:01] <RhinosF1>	 ATT has too many pages
[20:46:41] <RhinosF1>	 I guess it got moved to the end though
[21:31:58] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks
[21:31:59] <MirahezeLSBot>	 mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=librepediawiki 1 --e 2000 (running for 01:04:10)
[21:32:00] <MirahezeLSBot>	 mwtask161: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=allthetropeswiki 102001 --e 104000 (running for 03:07)
[21:32:01] <MirahezeLSBot>	 mwtask171: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=sagan4alphawiki 2001 --e 4000 (running for 40:29)
[21:32:02] <MirahezeLSBot>	 mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=kanjouwiki 4001 --e 6000 (running for 24:21)
[22:07:06] <MacFanBot>	 [02dns] 07RhinosF1 pushed 1 new commit to 03master 13https://github.com/miraheze/dns/commit/f29c35ff26ab9f71111a1ea2b44e3b391c17defc
[22:07:06] <MacFanBot>	 02dns/03master 07RhinosF1 03f29c35f Delete zones/urbanshade.org
[22:08:05] <miraheze-github>	 miraheze/dns - RhinosF1 the build passed.
[22:12:27] <icinga-miraheze>	 PROBLEM - mwtask161 Current Load on mwtask161 is WARNING: LOAD WARNING - total load average: 21.36, 16.28, 9.40
[22:14:26] <icinga-miraheze>	 RECOVERY - mwtask161 Current Load on mwtask161 is OK: LOAD OK - total load average: 8.96, 13.14, 9.05
[22:21:15] <BlankEclair>	 > [30/03/2025 07:46] <RhinosF1> I guess it got moved to the end though
[22:21:16] <BlankEclair>	 yep, it did
[22:21:54] <RhinosF1>	 BlankEclair: is it last one then?
[22:22:05] <BlankEclair>	 i believe so yeah
[22:22:14] <BlankEclair>	 librepedia is taking its time...
[22:22:33] <BlankEclair>	 if it stays that way the next hour, i'm requeueing it to the end
[22:24:41] <RhinosF1>	 Wooo
[22:32:01] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks
[22:32:02] <MirahezeLSBot>	 mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=librepediawiki 2001 --e 4000 (running for 50:24)
[22:32:03] <MirahezeLSBot>	 mwtask161: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=allthetropeswiki 120001 --e 122000 (running for 04:26)
[22:32:04] <MirahezeLSBot>	 mwtask171: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=sagan4alphawiki 6001 --e 8000 (running for 01:05)
[22:32:05] <MirahezeLSBot>	 mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=kanjouwiki 8001 --e 10000 (running for 08:54)
[22:39:22] <RhinosF1>	 BlankEclair: it's progressing
[22:39:26] <BlankEclair>	 yippee
[22:40:04] <RhinosF1>	 BlankEclair: what's the total for ATT?
[22:40:28] <BlankEclair>	 324,615 pages per special:statistics
[22:42:23] <RhinosF1>	 Bloody hell
[22:56:45] <icinga-miraheze>	 PROBLEM - cp37 Disk Space on cp37 is WARNING: DISK WARNING - free space: / 49888MiB (10% inode=99%);
[23:32:03] * MirahezeLSBot is checking the other mwtask* servers on refreshLinks
[23:32:04] <MirahezeLSBot>	 mwtask151: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=librepediawiki 2001 --e 4000 (running for 01:50:27)
[23:32:05] <MirahezeLSBot>	 mwtask161: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=allthetropeswiki 140001 --e 142000 (running for 01:52)
[23:32:06] <MirahezeLSBot>	 mwtask171: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=sagan4alphawiki 8001 --e 10000 (running for 28:46)
[23:32:07] <MirahezeLSBot>	 mwtask181: sudo -u www-data php /srv/mediawiki/1.43/maintenance/run.php refreshLinks --wiki=kirarafantasiawiki 1 --e 2000 (running for 00:45)
[23:47:16] <MirahezeLSBot>	 !log [blankeclair@mwtask151] runRefreshLinksChunked: [1004/2792] librepediawiki exited with 137
[23:47:18] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:47:22] <BlankEclair>	 oh fml how
[23:48:46] <BlankEclair>	 oof, i'll just tune down the delta size to like 50 and hope it helps?
[23:49:12] <BlankEclair>	 died at 4000
[23:50:37] <MirahezeLSBot>	 !log [blankeclair@mwtask151] runRefreshLinksChunked: [0/1] Handling librepediawiki (start id: 4000)
[23:50:39] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:52:36] <MirahezeLSBot>	 !log [blankeclair@mwtask151] runRefreshLinksChunked: [0/1] librepediawiki exited with 137
[23:52:38] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:52:40] <BlankEclair>	 WTF
[23:52:58] <BlankEclair>	 this wiki op frfr
[23:53:50] <MirahezeLSBot>	 !log [blankeclair@mwtask151] runRefreshLinksChunked: [0/1] Handling librepediawiki (start id: 4050)
[23:53:52] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:55:28] <MirahezeLSBot>	 !log [blankeclair@mwtask151] runRefreshLinksChunked: [0/1] librepediawiki exited with 137
[23:55:30] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:55:46] <BlankEclair>	 died on 4070
[23:55:48] <BlankEclair>	 wow
[23:56:15] <MirahezeLSBot>	 !log [blankeclair@mwtask151] runRefreshLinksChunked: [0/1788] Handling lichesandloungeswiki (start id: 0)
[23:56:17] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:56:23] <BlankEclair>	 requeued to end