[00:01:46] <MacFanBot>	 [02statichelp] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/statichelp/commit/defd0b8c5d8c3ea567de2c73f24115beb1a78a11
[00:01:46] <MacFanBot>	 02statichelp/03main 07WikiTideBot 03defd0b8 Bot: Auto-update Tech namespace pages 2025-10-24 00:01:43
[00:13:30] <icinga-miraheze>	 RECOVERY - cp191 Disk Space on cp191 is OK: DISK OK - free space: / 74094MiB (16% inode=99%);
[00:13:53] <icinga-miraheze>	 RECOVERY - cp171 Disk Space on cp171 is OK: DISK OK - free space: / 73686MiB (16% inode=99%);
[00:14:15] <icinga-miraheze>	 RECOVERY - cp201 Disk Space on cp201 is OK: DISK OK - free space: / 73226MiB (16% inode=99%);
[00:31:06] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is CRITICAL: LOAD CRITICAL - total load average: 29.77, 14.76, 7.45
[00:33:03] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is WARNING: LOAD WARNING - total load average: 6.94, 11.00, 6.93
[00:35:00] <icinga-miraheze>	 RECOVERY - db171 Current Load on db171 is OK: LOAD OK - total load average: 3.40, 8.37, 6.44
[01:01:21] <MacFanBot>	 [02DiscordNotifications] 07pskyechology opened pull request #112: Fix File namespace edits not notifying (07miraheze:03main...07pskyechology:03T14365) 13https://github.com/miraheze/DiscordNotifications/pull/112
[01:02:43] <MacFanBot>	 [02DiscordNotifications] 07coderabbitai[bot] commented on pull request #112: <details> […] 13https://github.com/miraheze/DiscordNotifications/pull/112#issuecomment-3440171017
[01:27:52] <miraheze-github>	 miraheze/DiscordNotifications - pskyechology the build passed.
[01:43:30] <icinga-miraheze>	 PROBLEM - mwtask151 Current Load on mwtask151 is WARNING: LOAD WARNING - total load average: 23.96, 18.97, 12.38
[01:45:30] <icinga-miraheze>	 RECOVERY - mwtask151 Current Load on mwtask151 is OK: LOAD OK - total load average: 8.10, 14.71, 11.62
[02:13:11] <miraheze-github>	 miraheze/mw-config - originalcloudcrafter the build passed.
[02:17:10] <MacFanBot>	 [02mw-config] 07pskyechology requested changes on pull request #6148: Issues remain unresolved. CI still reports 10 fixes, suggest running it in your cloned repo. 13https://github.com/miraheze/mw-config/pull/6148#pullrequestreview-3374004217
[02:19:18] <miraheze-github>	 miraheze/mw-config - originalcloudcrafter the build passed.
[02:23:25] <MacFanBot>	 [02mw-config] 07pskyechology requested changes on pull request #6149: CI reports 4 errors. Run it, or `composer fix`, in your repo. 13https://github.com/miraheze/mw-config/pull/6149#pullrequestreview-3374022186
[02:24:46] <MacFanBot>	 [02DiscordNotifications] 07pskyechology merged pull request #112: Fix File namespace edits not notifying (07miraheze:03main...07pskyechology:03T14365) 13https://github.com/miraheze/DiscordNotifications/pull/112
[02:24:48] <MacFanBot>	 [02DiscordNotifications] 07pskyechology pushed 1 new commit to 03main 13https://github.com/miraheze/DiscordNotifications/commit/aefc9a6e0875db4d16d6d9165bece9bb82d823c1
[02:24:50] <MacFanBot>	 02DiscordNotifications/03main 07Skye 03aefc9a6 Fix File namespace edits not notifying (#112)…
[02:27:52] <MirahezeLSBot>	 !log [skye@mwtask181] starting deploy of {'versions': '1.44', 'upgrade_extensions': 'DiscordNotifications'} to all
[02:27:56] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[02:28:16] <MirahezeLSBot>	 !log [skye@mwtask181] finished deploy of {'versions': '1.44', 'upgrade_extensions': 'DiscordNotifications'} to all - SUCCESS in 24s
[02:28:20] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[02:47:53] <icinga-miraheze>	 [Grafana] FIRING: The estimated time for the MediaWiki JobQueue to clear is excessively high (8 hours) for an extended time period https://grafana.wikitide.net/d/GtxbP1Xnk?from=1761270440000&orgId=1&to=1761274073358
[02:48:43] <miraheze-github>	 miraheze/DiscordNotifications - pskyechology the build passed.
[02:57:53] <icinga-miraheze>	 [Grafana] RESOLVED: MediaWiki JobQueue is stalled https://grafana.wikitide.net/d/GtxbP1Xnk?from=1761270980000&orgId=1&to=1761274580000
[03:38:52] <MirahezeRelay>	 <hugoedrick6385> https://cdn.discordapp.com/attachments/808001911868489748/1431124763366916167/3dded1be-cfc5-4d0b-950e-24ebd37d8f75.jpg?ex=68fc464c&is=68faf4cc&hm=1c0ca88926f15f7d21dbbd69cd38b3b3ea1bda9a167de5b372b0ad2d33b3fcfb&
[07:50:53] <icinga-miraheze>	 [Grafana] FIRING: The estimated time for the MediaWiki JobQueue to clear is excessively high (8 hours) for an extended time period https://grafana.wikitide.net/d/GtxbP1Xnk?from=1761288620000&orgId=1&to=1761292253356
[07:55:53] <icinga-miraheze>	 [Grafana] RESOLVED: MediaWiki JobQueue is stalled https://grafana.wikitide.net/d/GtxbP1Xnk?from=1761288860000&orgId=1&to=1761292460000
[11:31:43] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is WARNING: LOAD WARNING - total load average: 7.41, 10.24, 6.91
[11:33:40] <icinga-miraheze>	 RECOVERY - db171 Current Load on db171 is OK: LOAD OK - total load average: 4.05, 8.08, 6.50
[11:57:03] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is WARNING: LOAD WARNING - total load average: 5.85, 10.37, 7.43
[11:59:00] <icinga-miraheze>	 RECOVERY - db171 Current Load on db171 is OK: LOAD OK - total load average: 4.05, 8.26, 7.02
[13:39:57] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is CRITICAL: LOAD CRITICAL - total load average: 14.38, 12.13, 7.43
[13:41:54] <icinga-miraheze>	 RECOVERY - db171 Current Load on db171 is OK: LOAD OK - total load average: 3.67, 8.72, 6.75
[15:24:15] <icinga-miraheze>	 PROBLEM - cp201 Disk Space on cp201 is WARNING: DISK WARNING - free space: / 49745MiB (10% inode=99%);
[15:47:30] <icinga-miraheze>	 PROBLEM - cp191 Disk Space on cp191 is WARNING: DISK WARNING - free space: / 49864MiB (10% inode=99%);
[15:57:53] <icinga-miraheze>	 PROBLEM - cp171 Disk Space on cp171 is WARNING: DISK WARNING - free space: / 49846MiB (10% inode=99%);
[16:10:49] <MacFanBot>	 [02mw-config] 07pskyechology commented on pull request #6148: No new changes have been made, why are you requesting a new review? 13https://github.com/miraheze/mw-config/pull/6148#issuecomment-3443923245
[18:57:53] <icinga-miraheze>	 [Grafana] FIRING: The estimated time for the MediaWiki JobQueue to clear is excessively high (8 hours) for an extended time period https://grafana.wikitide.net/d/GtxbP1Xnk?from=1761328640000&orgId=1&to=1761332273373
[19:02:53] <icinga-miraheze>	 [Grafana] RESOLVED: MediaWiki JobQueue is stalled https://grafana.wikitide.net/d/GtxbP1Xnk?from=1761328640000&orgId=1&to=1761332540000
[19:15:26] <RhinosF1>	 !log install fluidsynth on mw* and test151 per Skye PR
[19:15:31] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[20:24:02] <MirahezeLSBot>	 !log [skye@test151] starting deploy of {'config': True} to test151
[20:24:03] <MirahezeLSBot>	 !log [skye@test151] finished deploy of {'config': True} to test151 - SUCCESS in 0s
[20:24:06] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[20:24:11] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[20:32:26] <miraheze-github>	 miraheze/mw-config - pskyechology the build passed.
[20:34:11] <miraheze-github>	 miraheze/mw-config - pskyechology the build passed.
[20:35:02] <MirahezeLSBot>	 !log [skye@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all
[20:35:07] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[20:35:27] <MirahezeLSBot>	 !log [skye@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 24s
[20:35:31] <miraheze-github>	 miraheze/mw-config - pskyechology the build passed.
[20:35:32] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[21:12:47] <icinga-miraheze>	 PROBLEM - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is WARNING: WARNING - NGINX Error Rate is 42%
[21:14:47] <icinga-miraheze>	 RECOVERY - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is OK: OK - NGINX Error Rate is 15%
[22:47:53] <icinga-miraheze>	 [Grafana] FIRING: The estimated time for the MediaWiki JobQueue to clear is excessively high (8 hours) for an extended time period https://grafana.wikitide.net/d/GtxbP1Xnk?from=1761342440000&orgId=1&to=1761346073354
[22:57:53] <icinga-miraheze>	 [Grafana] RESOLVED: MediaWiki JobQueue is stalled https://grafana.wikitide.net/d/GtxbP1Xnk?from=1761342440000&orgId=1&to=1761346640000