[00:01:59] [02statichelp] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/statichelp/commit/3442ef412ebe3eac07e2c67ef1f6af0a8d1afb71 [00:02:00] 02statichelp/03main 07WikiTideBot 033442ef4 Bot: Auto-update Tech namespace pages 2026-10-06 00:01:56 [00:03:26] PROBLEM - db182 Current Load on db182 is WARNING: LOAD WARNING - total load average: 11.09, 10.61, 8.32 [00:05:26] RECOVERY - db182 Current Load on db182 is OK: LOAD OK - total load average: 7.37, 9.32, 8.12 [00:30:45] RECOVERY - speedscope211 Check unit status of speedscope_daily_aggregation on speedscope211 is OK: OK: Status of the systemd unit speedscope_daily_aggregation [00:52:27] RECOVERY - cp201 Disk Space on cp201 is OK: DISK OK - free space: / 84467MiB (18.6% inode=100%); [00:53:36] PROBLEM - speedscope211 Current Load on speedscope211 is CRITICAL: LOAD CRITICAL - total load average: 18.01, 20.16, 9.47 [00:53:45] PROBLEM - speedscope211 Check unit status of speedscope_daily_aggregation on speedscope211 is CRITICAL: CRITICAL: Status of the systemd unit speedscope_daily_aggregation [00:59:30] RECOVERY - speedscope211 Current Load on speedscope211 is OK: LOAD OK - total load average: 0.14, 6.21, 6.48 [01:56:02] PROBLEM - mw192 Current Load on mw192 is CRITICAL: LOAD CRITICAL - total load average: 18.28, 25.21, 16.03 [01:57:59] RECOVERY - mw192 Current Load on mw192 is OK: LOAD OK - total load average: 9.48, 19.68, 15.12 [03:16:53] PROBLEM - mw182 Current Load on mw182 is WARNING: LOAD WARNING - total load average: 21.51, 17.59, 13.52 [03:26:05] PROBLEM - mw183 Current Load on mw183 is WARNING: LOAD WARNING - total load average: 23.33, 20.85, 16.38 [03:29:15] PROBLEM - mw192 Current Load on mw192 is WARNING: LOAD WARNING - total load average: 21.78, 19.85, 15.44 [03:30:14] PROBLEM - mw193 Current Load on mw193 is WARNING: LOAD WARNING - total load average: 22.15, 19.29, 15.20 [03:30:53] PROBLEM - mw181 Current Load on mw181 is WARNING: LOAD WARNING - total load average: 23.21, 20.47, 16.48 [03:31:10] PROBLEM - mw151 Current Load on mw151 is WARNING: LOAD WARNING - total load average: 21.22, 19.20, 15.18 [03:31:18] PROBLEM - mw163 Current Load on mw163 is WARNING: LOAD WARNING - total load average: 23.33, 21.10, 16.36 [03:31:39] PROBLEM - cp171 Varnish Backends on cp171 is CRITICAL: 2 backends are down. mw182 mw201 [03:32:05] PROBLEM - mw183 Current Load on mw183 is CRITICAL: LOAD CRITICAL - total load average: 24.15, 22.43, 18.43 [03:32:11] PROBLEM - mw203 Current Load on mw203 is WARNING: LOAD WARNING - total load average: 23.24, 19.84, 15.62 [03:32:21] PROBLEM - mw191 Current Load on mw191 is WARNING: LOAD WARNING - total load average: 22.35, 18.59, 14.36 [03:33:33] PROBLEM - mw201 Current Load on mw201 is WARNING: LOAD WARNING - total load average: 23.14, 20.14, 15.81 [03:33:39] RECOVERY - cp171 Varnish Backends on cp171 is OK: All 34 backends are healthy [03:34:53] PROBLEM - mw182 Current Load on mw182 is CRITICAL: LOAD CRITICAL - total load average: 24.39, 22.77, 19.78 [03:36:50] PROBLEM - mw173 Current Load on mw173 is WARNING: LOAD WARNING - total load average: 21.05, 19.55, 16.03 [03:36:53] PROBLEM - mw182 Current Load on mw182 is WARNING: LOAD WARNING - total load average: 19.95, 22.04, 19.89 [03:37:08] PROBLEM - mw163 Current Load on mw163 is CRITICAL: LOAD CRITICAL - total load average: 24.11, 22.93, 18.65 [03:37:10] PROBLEM - mw172 Current Load on mw172 is WARNING: LOAD WARNING - total load average: 22.84, 21.04, 17.42 [03:37:56] PROBLEM - mw202 Current Load on mw202 is WARNING: LOAD WARNING - total load average: 22.84, 20.94, 17.58 [03:37:56] PROBLEM - mw171 Current Load on mw171 is WARNING: LOAD WARNING - total load average: 22.61, 19.72, 16.51 [03:38:21] RECOVERY - mw191 Current Load on mw191 is OK: LOAD OK - total load average: 20.00, 19.88, 16.30 [03:38:50] RECOVERY - mw173 Current Load on mw173 is OK: LOAD OK - total load average: 19.66, 19.93, 16.63 [03:39:05] PROBLEM - mw163 Current Load on mw163 is WARNING: LOAD WARNING - total load average: 19.95, 22.13, 18.89 [03:39:18] PROBLEM - mw152 Current Load on mw152 is WARNING: LOAD WARNING - total load average: 21.12, 20.81, 17.31 [03:41:10] RECOVERY - mw151 Current Load on mw151 is OK: LOAD OK - total load average: 11.97, 18.60, 17.48 [03:41:15] RECOVERY - mw152 Current Load on mw152 is OK: LOAD OK - total load average: 15.27, 19.34, 17.22 [03:41:33] RECOVERY - mw201 Current Load on mw201 is OK: LOAD OK - total load average: 12.50, 18.51, 17.28 [03:41:47] RECOVERY - mw202 Current Load on mw202 is OK: LOAD OK - total load average: 13.74, 19.42, 17.88 [03:41:56] RECOVERY - mw171 Current Load on mw171 is OK: LOAD OK - total load average: 10.73, 16.68, 16.16 [03:42:05] PROBLEM - mw183 Current Load on mw183 is WARNING: LOAD WARNING - total load average: 14.17, 21.86, 20.83 [03:42:11] RECOVERY - mw203 Current Load on mw203 is OK: LOAD OK - total load average: 11.81, 18.84, 17.80 [03:42:14] RECOVERY - mw193 Current Load on mw193 is OK: LOAD OK - total load average: 11.75, 18.72, 18.02 [03:42:53] RECOVERY - mw181 Current Load on mw181 is OK: LOAD OK - total load average: 9.88, 17.43, 17.88 [03:42:53] RECOVERY - mw182 Current Load on mw182 is OK: LOAD OK - total load average: 9.46, 17.85, 19.12 [03:42:59] RECOVERY - mw163 Current Load on mw163 is OK: LOAD OK - total load average: 9.79, 16.67, 17.54 [03:43:10] RECOVERY - mw172 Current Load on mw172 is OK: LOAD OK - total load average: 11.28, 17.34, 17.34 [03:43:15] RECOVERY - mw192 Current Load on mw192 is OK: LOAD OK - total load average: 11.02, 17.63, 18.07 [03:44:05] RECOVERY - mw183 Current Load on mw183 is OK: LOAD OK - total load average: 8.50, 17.28, 19.28 [04:59:26] PROBLEM - phorge171 Current Load on phorge171 is CRITICAL: LOAD CRITICAL - total load average: 8.63, 6.86, 5.56 [05:01:21] PROBLEM - phorge171 Current Load on phorge171 is WARNING: LOAD WARNING - total load average: 7.66, 7.05, 5.78 [05:06:38] PROBLEM - phorge171 phorge-static.wikitide.net HTTPS on phorge171 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:10:44] RECOVERY - phorge171 phorge-static.wikitide.net HTTPS on phorge171 is OK: HTTP OK: Status line output matched "HTTP/1.1 200" - 17668 bytes in 0.040 second response time [05:17:01] RECOVERY - phorge171 Current Load on phorge171 is OK: LOAD OK - total load average: 3.33, 5.86, 6.19 [05:50:20] PROBLEM - phorge171 phorge-static.wikitide.net HTTPS on phorge171 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/1.1 502 Bad Gateway [05:52:18] RECOVERY - phorge171 phorge-static.wikitide.net HTTPS on phorge171 is OK: HTTP OK: Status line output matched "HTTP/1.1 200" - 17668 bytes in 0.032 second response time [05:52:47] PROBLEM - phorge171 issue-tracker.miraheze.org HTTPS on phorge171 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:54:46] RECOVERY - phorge171 issue-tracker.miraheze.org HTTPS on phorge171 is OK: HTTP OK: HTTP/1.1 200 OK - 18180 bytes in 0.101 second response time [07:35:00] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 21.54, 20.58, 18.69 [07:38:47] PROBLEM - mw182 Current Load on mw182 is WARNING: LOAD WARNING - total load average: 20.40, 20.87, 17.88 [07:40:58] RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 20.13, 20.25, 19.20 [07:42:45] RECOVERY - mw182 Current Load on mw182 is OK: LOAD OK - total load average: 8.29, 15.93, 16.71 [08:55:08] [02python-functions] 07renovate[bot] created 03renovate/all-deps (+1 new commit) 13https://github.com/miraheze/python-functions/commit/bf068e8fd6d0 [08:55:08] 02python-functions/03renovate/all-deps 07renovate[bot] 03bf068e8 chore(deps): update dependency types-requests to v2.33.0.20261006 [09:15:13] [02DiscordNotifications] 07Zippybonzo opened pull request #126: Skip user groups notification if performer doesn't exist (07miraheze:03main...07Zippybonzo:03main) 13https://github.com/miraheze/DiscordNotifications/pull/126 [09:26:25] [02DiscordNotifications] 07Universal-Omega approved pull request #126 13https://github.com/miraheze/DiscordNotifications/pull/126#pullrequestreview-5426371143 [09:26:39] [02DiscordNotifications] 07Universal-Omega merged 07Zippybonzo's pull request #126: Skip user groups notification if performer doesn't exist (07miraheze:03main...07Zippybonzo:03main) 13https://github.com/miraheze/DiscordNotifications/pull/126 [09:26:39] [02DiscordNotifications] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/DiscordNotifications/commit/2bf03d63487ea66d824e2a6632cebce82697a3e6 [09:26:39] 02DiscordNotifications/03main 07Zippybonzo 032bf03d6 Skip user groups notification if performer doesn't exist (#126)… [09:26:51] [02DiscordNotifications] 07Universal-Omega commented on pull request #126: Thanks for the patch! 13https://github.com/miraheze/DiscordNotifications/pull/126#issuecomment-6013337812 [09:30:23] miraheze/DiscordNotifications - Universal-Omega the build has errored. [09:30:33] miraheze/DiscordNotifications - Zippybonzo the build has errored. [09:34:10] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 20.59, 19.02, 16.88 [09:38:10] RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 18.01, 18.65, 17.26 [09:42:08] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 22.29, 20.59, 18.36 [09:43:51] [02DiscordNotifications] 07Zippybonzo opened pull request #127: fix failing tests (07miraheze:03main...07Zippybonzo:03main) 13https://github.com/miraheze/DiscordNotifications/pull/127 [09:44:23] [02DiscordNotifications] 07Universal-Omega merged 07Zippybonzo's pull request #127: fix failing tests (07miraheze:03main...07Zippybonzo:03main) 13https://github.com/miraheze/DiscordNotifications/pull/127 [09:44:23] [02DiscordNotifications] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/DiscordNotifications/commit/caa790a4d6c4247f76ec83f9d486376b8c780b79 [09:44:23] 02DiscordNotifications/03main 07Zippybonzo 03caa790a fix failing tests (#127) [09:50:49] miraheze/DiscordNotifications - Zippybonzo the build passed. [09:52:31] miraheze/DiscordNotifications - Universal-Omega the build passed. [10:00:03] RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 17.12, 19.87, 19.99 [11:10:28] PROBLEM - cp171 Varnish Backends on cp171 is CRITICAL: 4 backends are down. mw182 mw153 mw201 mw202 [11:10:44] PROBLEM - cp201 Varnish Backends on cp201 is CRITICAL: 3 backends are down. mw161 mw201 mw202 [11:13:15] PROBLEM - cp171 HTTPS on cp171 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10005 milliseconds with 0 bytes received [11:14:13] PROBLEM - mw193 Current Load on mw193 is CRITICAL: LOAD CRITICAL - total load average: 25.28, 19.51, 13.87 [11:14:33] PROBLEM - mw163 Current Load on mw163 is WARNING: LOAD WARNING - total load average: 23.50, 19.70, 14.64 [11:14:50] PROBLEM - mw173 Current Load on mw173 is WARNING: LOAD WARNING - total load average: 23.26, 19.02, 14.00 [11:15:04] PROBLEM - mw173 MediaWiki Rendering on mw173 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 5857 bytes in 0.011 second response time [11:15:10] PROBLEM - mw152 Current Load on mw152 is WARNING: LOAD WARNING - total load average: 23.20, 19.17, 14.15 [11:15:10] PROBLEM - mw172 Current Load on mw172 is WARNING: LOAD WARNING - total load average: 22.92, 19.86, 14.88 [11:15:10] PROBLEM - mw151 Current Load on mw151 is WARNING: LOAD WARNING - total load average: 23.46, 19.05, 13.75 [11:15:15] PROBLEM - mw192 Current Load on mw192 is WARNING: LOAD WARNING - total load average: 23.12, 19.31, 14.17 [11:15:24] PROBLEM - mw162 Current Load on mw162 is WARNING: LOAD WARNING - total load average: 22.84, 19.26, 14.18 [11:16:11] PROBLEM - mw203 Current Load on mw203 is WARNING: LOAD WARNING - total load average: 23.51, 20.55, 15.53 [11:16:21] PROBLEM - mw191 Current Load on mw191 is WARNING: LOAD WARNING - total load average: 23.73, 19.69, 14.14 [11:16:44] RECOVERY - cp201 Varnish Backends on cp201 is OK: All 34 backends are healthy [11:16:53] PROBLEM - mw181 Current Load on mw181 is WARNING: LOAD WARNING - total load average: 23.79, 20.52, 15.40 [11:17:10] RECOVERY - mw173 MediaWiki Rendering on mw173 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 6.197 second response time [11:17:17] RECOVERY - cp171 HTTPS on cp171 is OK: HTTP OK: HTTP/2 410 - Status line output matched "HTTP/2 410" - 1485 bytes in 3.490 second response time [11:19:16] PROBLEM - mw153 Current Load on mw153 is WARNING: LOAD WARNING - total load average: 23.02, 17.81, 13.22 [11:19:33] PROBLEM - mw201 Current Load on mw201 is WARNING: LOAD WARNING - total load average: 23.12, 18.09, 13.83 [11:19:56] PROBLEM - mw171 Current Load on mw171 is CRITICAL: LOAD CRITICAL - total load average: 24.64, 19.84, 14.65 [11:20:14] PROBLEM - mw193 Current Load on mw193 is WARNING: LOAD WARNING - total load average: 23.00, 22.27, 17.00 [11:20:33] PROBLEM - mw163 Current Load on mw163 is CRITICAL: LOAD CRITICAL - total load average: 25.01, 22.76, 17.64 [11:21:16] PROBLEM - mw153 Current Load on mw153 is CRITICAL: LOAD CRITICAL - total load average: 24.80, 20.05, 14.59 [11:21:19] PROBLEM - mw161 Current Load on mw161 is WARNING: LOAD WARNING - total load average: 22.99, 18.72, 13.64 [11:21:56] PROBLEM - mw171 Current Load on mw171 is WARNING: LOAD WARNING - total load average: 22.84, 20.84, 15.66 [11:22:18] PROBLEM - mw202 Current Load on mw202 is WARNING: LOAD WARNING - total load average: 22.95, 19.89, 15.06 [11:22:21] PROBLEM - mw191 Current Load on mw191 is CRITICAL: LOAD CRITICAL - total load average: 24.51, 22.79, 17.33 [11:22:24] PROBLEM - mw182 Current Load on mw182 is WARNING: LOAD WARNING - total load average: 23.04, 20.26, 16.73 [11:22:33] PROBLEM - mw163 Current Load on mw163 is WARNING: LOAD WARNING - total load average: 23.79, 23.12, 18.41 [11:23:16] PROBLEM - mw153 Current Load on mw153 is WARNING: LOAD WARNING - total load average: 21.18, 20.06, 15.25 [11:24:05] PROBLEM - mw183 Current Load on mw183 is CRITICAL: LOAD CRITICAL - total load average: 24.76, 22.51, 17.74 [11:24:33] PROBLEM - mw163 Current Load on mw163 is CRITICAL: LOAD CRITICAL - total load average: 24.03, 23.44, 19.10 [11:25:15] PROBLEM - mw192 Current Load on mw192 is CRITICAL: LOAD CRITICAL - total load average: 24.12, 23.07, 18.68 [11:25:16] RECOVERY - mw153 Current Load on mw153 is OK: LOAD OK - total load average: 16.81, 19.13, 15.52 [11:25:19] RECOVERY - mw161 Current Load on mw161 is OK: LOAD OK - total load average: 17.39, 18.76, 14.92 [11:25:33] RECOVERY - mw201 Current Load on mw201 is OK: LOAD OK - total load average: 18.73, 19.64, 16.07 [11:26:06] RECOVERY - cp171 Varnish Backends on cp171 is OK: All 34 backends are healthy [11:26:11] PROBLEM - mw203 Current Load on mw203 is CRITICAL: LOAD CRITICAL - total load average: 24.14, 23.39, 19.46 [11:26:21] PROBLEM - mw191 Current Load on mw191 is WARNING: LOAD WARNING - total load average: 23.61, 23.29, 18.79 [11:26:33] PROBLEM - mw163 Current Load on mw163 is WARNING: LOAD WARNING - total load average: 23.79, 23.48, 19.64 [11:27:15] PROBLEM - mw192 Current Load on mw192 is WARNING: LOAD WARNING - total load average: 21.80, 22.84, 19.15 [11:27:56] RECOVERY - mw171 Current Load on mw171 is OK: LOAD OK - total load average: 18.65, 19.34, 16.78 [11:28:04] RECOVERY - mw202 Current Load on mw202 is OK: LOAD OK - total load average: 20.15, 20.27, 16.78 [11:28:05] PROBLEM - mw183 Current Load on mw183 is WARNING: LOAD WARNING - total load average: 20.29, 22.75, 19.04 [11:28:11] PROBLEM - mw203 Current Load on mw203 is WARNING: LOAD WARNING - total load average: 21.57, 22.82, 19.74 [11:30:14] RECOVERY - mw193 Current Load on mw193 is OK: LOAD OK - total load average: 17.20, 20.38, 18.94 [11:30:21] RECOVERY - mw191 Current Load on mw191 is OK: LOAD OK - total load average: 16.17, 19.50, 18.29 [11:30:46] RECOVERY - mw152 Current Load on mw152 is OK: LOAD OK - total load average: 16.82, 19.87, 18.59 [11:30:50] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.wikitide.net/d/GtxbP1Xnk?from=1791282620000&orgId=1&to=1791286250030 [11:30:50] RECOVERY - mw173 Current Load on mw173 is OK: LOAD OK - total load average: 14.55, 19.03, 18.31 [11:31:10] RECOVERY - mw151 Current Load on mw151 is OK: LOAD OK - total load average: 15.58, 19.64, 18.61 [11:31:15] RECOVERY - mw192 Current Load on mw192 is OK: LOAD OK - total load average: 12.71, 18.65, 18.37 [11:31:24] RECOVERY - mw162 Current Load on mw162 is OK: LOAD OK - total load average: 14.83, 18.78, 18.32 [11:32:11] RECOVERY - mw203 Current Load on mw203 is OK: LOAD OK - total load average: 17.60, 20.30, 19.44 [11:33:10] RECOVERY - mw172 Current Load on mw172 is OK: LOAD OK - total load average: 17.43, 19.68, 19.17 [11:34:20] PROBLEM - mw182 Current Load on mw182 is CRITICAL: LOAD CRITICAL - total load average: 24.16, 23.17, 20.19 [11:34:33] RECOVERY - mw163 Current Load on mw163 is OK: LOAD OK - total load average: 19.72, 20.16, 19.61 [11:34:37] PROBLEM - mw152 Current Load on mw152 is WARNING: LOAD WARNING - total load average: 21.47, 20.72, 19.20 [11:35:16] PROBLEM - mw153 Current Load on mw153 is WARNING: LOAD WARNING - total load average: 22.71, 20.66, 17.84 [11:35:33] PROBLEM - mw201 Current Load on mw201 is WARNING: LOAD WARNING - total load average: 22.96, 20.66, 17.91 [11:36:05] PROBLEM - mw183 Current Load on mw183 is CRITICAL: LOAD CRITICAL - total load average: 25.50, 23.13, 20.53 [11:36:19] PROBLEM - mw182 Current Load on mw182 is WARNING: LOAD WARNING - total load average: 21.32, 22.40, 20.28 [11:37:10] PROBLEM - mw172 Current Load on mw172 is CRITICAL: LOAD CRITICAL - total load average: 24.22, 21.58, 20.00 [11:37:42] PROBLEM - mw202 Current Load on mw202 is WARNING: LOAD WARNING - total load average: 22.08, 20.39, 18.18 [11:38:11] PROBLEM - mw203 Current Load on mw203 is WARNING: LOAD WARNING - total load average: 23.63, 21.86, 20.34 [11:38:14] PROBLEM - mw193 Current Load on mw193 is WARNING: LOAD WARNING - total load average: 23.04, 21.03, 19.56 [11:38:33] PROBLEM - mw163 Current Load on mw163 is WARNING: LOAD WARNING - total load average: 22.50, 21.30, 20.19 [11:39:10] PROBLEM - mw151 Current Load on mw151 is WARNING: LOAD WARNING - total load average: 22.59, 20.63, 19.26 [11:39:44] PROBLEM - mw173 Current Load on mw173 is WARNING: LOAD WARNING - total load average: 20.85, 20.84, 19.46 [11:39:56] PROBLEM - mw171 Current Load on mw171 is WARNING: LOAD WARNING - total load average: 21.79, 20.65, 18.36 [11:40:21] PROBLEM - mw191 Current Load on mw191 is WARNING: LOAD WARNING - total load average: 22.08, 19.88, 18.49 [11:41:10] PROBLEM - mw172 Current Load on mw172 is WARNING: LOAD WARNING - total load average: 23.12, 22.27, 20.64 [11:41:10] RECOVERY - mw151 Current Load on mw151 is OK: LOAD OK - total load average: 18.91, 20.06, 19.22 [11:41:16] RECOVERY - mw153 Current Load on mw153 is OK: LOAD OK - total load average: 15.33, 19.81, 18.63 [11:41:33] RECOVERY - mw202 Current Load on mw202 is OK: LOAD OK - total load average: 15.26, 19.92, 18.63 [11:41:56] RECOVERY - mw171 Current Load on mw171 is OK: LOAD OK - total load average: 15.21, 19.32, 18.20 [11:42:05] PROBLEM - mw183 Current Load on mw183 is WARNING: LOAD WARNING - total load average: 13.70, 21.82, 21.25 [11:42:11] RECOVERY - mw203 Current Load on mw203 is OK: LOAD OK - total load average: 14.13, 19.93, 20.07 [11:42:14] RECOVERY - mw193 Current Load on mw193 is OK: LOAD OK - total load average: 13.98, 19.12, 19.27 [11:42:17] RECOVERY - mw182 Current Load on mw182 is OK: LOAD OK - total load average: 14.81, 19.40, 19.85 [11:42:21] RECOVERY - mw191 Current Load on mw191 is OK: LOAD OK - total load average: 12.00, 17.69, 17.93 [11:42:27] RECOVERY - mw152 Current Load on mw152 is OK: LOAD OK - total load average: 12.74, 18.91, 19.34 [11:42:33] RECOVERY - mw163 Current Load on mw163 is OK: LOAD OK - total load average: 12.03, 18.83, 19.65 [11:42:53] RECOVERY - mw181 Current Load on mw181 is OK: LOAD OK - total load average: 11.03, 17.64, 19.11 [11:43:10] RECOVERY - mw172 Current Load on mw172 is OK: LOAD OK - total load average: 10.54, 17.64, 19.13 [11:43:33] RECOVERY - mw201 Current Load on mw201 is OK: LOAD OK - total load average: 9.98, 17.22, 17.95 [11:43:36] RECOVERY - mw173 Current Load on mw173 is OK: LOAD OK - total load average: 10.73, 17.22, 18.48 [11:44:05] RECOVERY - mw183 Current Load on mw183 is OK: LOAD OK - total load average: 8.53, 17.20, 19.62 [11:45:50] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.wikitide.net/d/GtxbP1Xnk?from=1791283340000&orgId=1&to=1791286940000 [12:15:39] PROBLEM - matomo151 Current Load on matomo151 is WARNING: LOAD WARNING - total load average: 14.91, 14.03, 13.24 [12:19:39] RECOVERY - matomo151 Current Load on matomo151 is OK: LOAD OK - total load average: 11.31, 13.07, 13.09 [12:30:30] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/aeac593811c03e721579c8bdaedd414ce3165aab [12:30:30] 02ssl/03main 07WikiTideBot 03aeac593 Bot: Auto-update domain lists [12:37:39] PROBLEM - matomo151 Current Load on matomo151 is CRITICAL: LOAD CRITICAL - total load average: 17.23, 15.23, 13.76 [12:55:39] PROBLEM - matomo151 Current Load on matomo151 is WARNING: LOAD WARNING - total load average: 12.84, 15.99, 15.89 [13:11:39] RECOVERY - matomo151 Current Load on matomo151 is OK: LOAD OK - total load average: 10.84, 11.67, 13.56 [13:30:27] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/ffde5caf0ebb8bb8ea0a1e31c4608908d672dade [13:30:27] 02ssl/03main 07WikiTideBot 03ffde5ca Bot: Auto-update domain lists [13:37:22] PROBLEM - matomo151 Current Load on matomo151 is WARNING: LOAD WARNING - total load average: 15.12, 14.26, 13.18 [13:39:19] PROBLEM - matomo151 Current Load on matomo151 is CRITICAL: LOAD CRITICAL - total load average: 16.58, 14.97, 13.57 [13:43:01] PROBLEM - mwtask151 Current Load on mwtask151 is WARNING: LOAD WARNING - total load average: 21.56, 19.61, 15.54 [13:45:01] RECOVERY - mwtask151 Current Load on mwtask151 is OK: LOAD OK - total load average: 19.80, 19.68, 16.07 [13:49:04] PROBLEM - matomo151 Current Load on matomo151 is WARNING: LOAD WARNING - total load average: 12.70, 14.63, 14.36 [14:02:44] PROBLEM - matomo151 Current Load on matomo151 is CRITICAL: LOAD CRITICAL - total load average: 16.61, 14.40, 13.97 [14:04:01] PROBLEM - mwtask151 Current Load on mwtask151 is CRITICAL: LOAD CRITICAL - total load average: 31.27, 36.84, 24.44 [14:04:41] PROBLEM - matomo151 Current Load on matomo151 is WARNING: LOAD WARNING - total load average: 14.22, 14.19, 13.94 [14:07:45] RECOVERY - mwtask151 Current Load on mwtask151 is OK: LOAD OK - total load average: 5.45, 19.90, 20.22 [14:13:46] RECOVERY - matomo151 Current Load on matomo151 is OK: LOAD OK - total load average: 11.80, 12.92, 13.45 [14:17:37] PROBLEM - matomo151 Current Load on matomo151 is WARNING: LOAD WARNING - total load average: 15.93, 14.22, 13.83 [14:19:34] RECOVERY - matomo151 Current Load on matomo151 is OK: LOAD OK - total load average: 12.08, 13.40, 13.58 [14:30:28] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/4fb35a6ba5e5c0afaf451889574791ca7c138a8f [14:30:28] 02ssl/03main 07WikiTideBot 034fb35a6 Bot: Auto-update domain lists [14:50:03] PROBLEM - matomo151 Current Load on matomo151 is WARNING: LOAD WARNING - total load average: 13.70, 13.28, 12.74 [14:56:03] RECOVERY - matomo151 Current Load on matomo151 is OK: LOAD OK - total load average: 12.11, 13.34, 13.00 [15:18:54] PROBLEM - mw182 Current Load on mw182 is WARNING: LOAD WARNING - total load average: 22.51, 18.93, 14.51 [15:19:36] PROBLEM - mw191 Current Load on mw191 is WARNING: LOAD WARNING - total load average: 23.14, 17.91, 12.79 [15:21:30] PROBLEM - mw191 Current Load on mw191 is CRITICAL: LOAD CRITICAL - total load average: 24.06, 19.99, 14.15 [15:23:25] PROBLEM - mw191 Current Load on mw191 is WARNING: LOAD WARNING - total load average: 20.87, 19.93, 14.81 [15:23:25] PROBLEM - mw203 Current Load on mw203 is WARNING: LOAD WARNING - total load average: 22.96, 19.87, 15.13 [15:23:46] PROBLEM - mw193 Current Load on mw193 is WARNING: LOAD WARNING - total load average: 23.14, 20.15, 15.10 [15:25:25] RECOVERY - mw191 Current Load on mw191 is OK: LOAD OK - total load average: 19.01, 19.68, 15.35 [15:25:30] PROBLEM - mw173 Current Load on mw173 is WARNING: LOAD WARNING - total load average: 22.30, 19.06, 14.42 [15:25:33] PROBLEM - mw181 Current Load on mw181 is WARNING: LOAD WARNING - total load average: 21.35, 18.98, 14.71 [15:25:45] RECOVERY - mw193 Current Load on mw193 is OK: LOAD OK - total load average: 18.00, 19.54, 15.50 [15:26:59] PROBLEM - mw192 Current Load on mw192 is WARNING: LOAD WARNING - total load average: 20.69, 19.98, 15.41 [15:27:15] RECOVERY - mw203 Current Load on mw203 is OK: LOAD OK - total load average: 16.08, 19.59, 16.17 [15:27:33] RECOVERY - mw181 Current Load on mw181 is OK: LOAD OK - total load average: 15.49, 17.95, 14.89 [15:27:37] PROBLEM - mw202 Current Load on mw202 is WARNING: LOAD WARNING - total load average: 21.24, 20.04, 15.33 [15:28:58] RECOVERY - mw192 Current Load on mw192 is OK: LOAD OK - total load average: 19.51, 19.36, 15.71 [15:29:28] PROBLEM - mw173 Current Load on mw173 is CRITICAL: LOAD CRITICAL - total load average: 24.17, 21.80, 16.60 [15:31:05] PROBLEM - mw203 Current Load on mw203 is WARNING: LOAD WARNING - total load average: 22.63, 21.00, 17.48 [15:31:28] PROBLEM - mw173 Current Load on mw173 is WARNING: LOAD WARNING - total load average: 23.18, 22.24, 17.40 [15:31:33] PROBLEM - mw181 Current Load on mw181 is WARNING: LOAD WARNING - total load average: 22.98, 19.99, 16.34 [15:31:39] PROBLEM - mw163 Current Load on mw163 is WARNING: LOAD WARNING - total load average: 22.54, 21.04, 17.37 [15:31:40] PROBLEM - mw193 Current Load on mw193 is WARNING: LOAD WARNING - total load average: 22.36, 20.14, 16.85 [15:33:13] PROBLEM - mw183 Current Load on mw183 is WARNING: LOAD WARNING - total load average: 19.60, 21.33, 18.40 [15:33:33] RECOVERY - mw181 Current Load on mw181 is OK: LOAD OK - total load average: 17.72, 19.66, 16.70 [15:34:11] PROBLEM - mw201 Current Load on mw201 is CRITICAL: LOAD CRITICAL - total load average: 24.13, 21.48, 17.52 [15:34:45] PROBLEM - mw182 Current Load on mw182 is CRITICAL: LOAD CRITICAL - total load average: 25.18, 23.75, 20.25 [15:35:26] RECOVERY - mw202 Current Load on mw202 is OK: LOAD OK - total load average: 16.71, 19.33, 17.06 [15:35:28] RECOVERY - mw173 Current Load on mw173 is OK: LOAD OK - total load average: 15.18, 19.52, 17.49 [15:35:35] RECOVERY - mw163 Current Load on mw163 is OK: LOAD OK - total load average: 16.23, 19.48, 17.67 [15:35:38] RECOVERY - mw193 Current Load on mw193 is OK: LOAD OK - total load average: 18.78, 20.13, 17.68 [15:36:07] RECOVERY - mw201 Current Load on mw201 is OK: LOAD OK - total load average: 17.01, 19.85, 17.40 [15:36:43] PROBLEM - mw182 Current Load on mw182 is WARNING: LOAD WARNING - total load average: 23.95, 23.85, 20.72 [15:38:56] PROBLEM - mw183 Current Load on mw183 is CRITICAL: LOAD CRITICAL - total load average: 25.48, 23.64, 20.29 [15:39:18] PROBLEM - mw202 Current Load on mw202 is CRITICAL: LOAD CRITICAL - total load average: 24.11, 21.42, 18.37 [15:39:28] PROBLEM - mw163 Current Load on mw163 is WARNING: LOAD WARNING - total load average: 22.33, 20.75, 18.57 [15:39:28] PROBLEM - mw173 Current Load on mw173 is WARNING: LOAD WARNING - total load average: 23.14, 21.31, 18.66 [15:39:34] PROBLEM - mw193 Current Load on mw193 is WARNING: LOAD WARNING - total load average: 21.47, 20.98, 18.60 [15:39:35] PROBLEM - mw172 Current Load on mw172 is WARNING: LOAD WARNING - total load average: 23.05, 21.21, 18.19 [15:40:01] PROBLEM - mw201 Current Load on mw201 is WARNING: LOAD WARNING - total load average: 22.19, 20.62, 18.22 [15:40:46] PROBLEM - mw162 Current Load on mw162 is WARNING: LOAD WARNING - total load average: 21.38, 20.00, 16.57 [15:40:49] PROBLEM - mw192 Current Load on mw192 is WARNING: LOAD WARNING - total load average: 22.67, 20.56, 18.01 [15:41:15] PROBLEM - mw202 Current Load on mw202 is WARNING: LOAD WARNING - total load average: 19.68, 21.30, 18.72 [15:41:26] RECOVERY - mw163 Current Load on mw163 is OK: LOAD OK - total load average: 17.38, 20.08, 18.62 [15:41:50] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.wikitide.net/d/GtxbP1Xnk?from=1791297680000&orgId=1&to=1791301310032 [15:41:57] RECOVERY - mw201 Current Load on mw201 is OK: LOAD OK - total load average: 16.32, 19.75, 18.24 [15:42:43] RECOVERY - mw203 Current Load on mw203 is OK: LOAD OK - total load average: 14.10, 19.27, 18.84 [15:42:44] PROBLEM - mw183 Current Load on mw183 is WARNING: LOAD WARNING - total load average: 13.92, 21.18, 20.24 [15:42:46] RECOVERY - mw162 Current Load on mw162 is OK: LOAD OK - total load average: 9.84, 16.27, 15.64 [15:42:48] RECOVERY - mw192 Current Load on mw192 is OK: LOAD OK - total load average: 11.94, 17.18, 17.08 [15:43:15] RECOVERY - mw202 Current Load on mw202 is OK: LOAD OK - total load average: 11.40, 17.71, 17.73 [15:43:28] RECOVERY - mw173 Current Load on mw173 is OK: LOAD OK - total load average: 12.56, 17.84, 17.99 [15:43:32] RECOVERY - mw193 Current Load on mw193 is OK: LOAD OK - total load average: 11.24, 16.99, 17.68 [15:43:32] RECOVERY - mw172 Current Load on mw172 is OK: LOAD OK - total load average: 11.51, 17.18, 17.38 [15:44:38] RECOVERY - mw182 Current Load on mw182 is OK: LOAD OK - total load average: 11.31, 16.97, 19.18 [15:44:39] RECOVERY - mw183 Current Load on mw183 is OK: LOAD OK - total load average: 10.47, 17.38, 18.95 [15:46:50] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.wikitide.net/d/GtxbP1Xnk?from=1791297740000&orgId=1&to=1791301340000 [19:21:44] PROBLEM - mw182 Current Load on mw182 is WARNING: LOAD WARNING - total load average: 23.56, 20.73, 15.25 [19:25:41] RECOVERY - mw182 Current Load on mw182 is OK: LOAD OK - total load average: 18.83, 20.08, 16.31 [19:31:41] PROBLEM - mw182 Current Load on mw182 is WARNING: LOAD WARNING - total load average: 22.24, 20.60, 17.68 [19:35:02] PROBLEM - mw183 Current Load on mw183 is WARNING: LOAD WARNING - total load average: 22.27, 21.06, 17.56 [19:36:56] PROBLEM - mw183 Current Load on mw183 is CRITICAL: LOAD CRITICAL - total load average: 26.07, 22.82, 18.61 [19:38:26] PROBLEM - mw201 Current Load on mw201 is WARNING: LOAD WARNING - total load average: 20.79, 19.60, 15.91 [19:38:43] PROBLEM - mw203 Current Load on mw203 is WARNING: LOAD WARNING - total load average: 23.33, 19.40, 15.84 [19:38:58] PROBLEM - mw163 Current Load on mw163 is WARNING: LOAD WARNING - total load average: 23.48, 20.12, 16.52 [19:39:15] PROBLEM - mw202 Current Load on mw202 is WARNING: LOAD WARNING - total load average: 23.61, 21.32, 17.24 [19:39:17] PROBLEM - mw192 Current Load on mw192 is WARNING: LOAD WARNING - total load average: 23.43, 20.02, 16.20 [19:39:25] PROBLEM - mw191 Current Load on mw191 is WARNING: LOAD WARNING - total load average: 23.55, 18.99, 15.38 [19:39:28] PROBLEM - mw173 Current Load on mw173 is WARNING: LOAD WARNING - total load average: 23.71, 20.19, 15.94 [19:39:29] PROBLEM - mw193 Current Load on mw193 is WARNING: LOAD WARNING - total load average: 23.36, 20.03, 16.33 [19:39:33] PROBLEM - mw181 Current Load on mw181 is WARNING: LOAD WARNING - total load average: 23.54, 20.92, 17.18 [19:40:25] PROBLEM - mw171 Current Load on mw171 is WARNING: LOAD WARNING - total load average: 20.51, 18.39, 14.71 [19:40:35] PROBLEM - mw172 Current Load on mw172 is CRITICAL: LOAD CRITICAL - total load average: 24.05, 19.83, 15.42 [19:40:46] PROBLEM - mw162 Current Load on mw162 is WARNING: LOAD WARNING - total load average: 23.93, 20.07, 15.49 [19:40:58] PROBLEM - mw161 Current Load on mw161 is CRITICAL: LOAD CRITICAL - total load average: 24.70, 20.19, 15.06 [19:41:17] RECOVERY - mw192 Current Load on mw192 is OK: LOAD OK - total load average: 17.80, 19.64, 16.56 [19:41:25] RECOVERY - mw191 Current Load on mw191 is OK: LOAD OK - total load average: 17.39, 18.95, 15.85 [19:41:28] RECOVERY - mw173 Current Load on mw173 is OK: LOAD OK - total load average: 18.63, 20.05, 16.44 [19:41:29] RECOVERY - mw193 Current Load on mw193 is OK: LOAD OK - total load average: 15.75, 18.81, 16.36 [19:42:25] RECOVERY - mw171 Current Load on mw171 is OK: LOAD OK - total load average: 9.98, 15.20, 14.00 [19:42:26] RECOVERY - mw201 Current Load on mw201 is OK: LOAD OK - total load average: 11.17, 17.51, 16.10 [19:42:35] RECOVERY - mw172 Current Load on mw172 is OK: LOAD OK - total load average: 11.69, 17.02, 14.96 [19:42:39] PROBLEM - mw183 Current Load on mw183 is WARNING: LOAD WARNING - total load average: 14.89, 21.47, 19.71 [19:42:43] RECOVERY - mw203 Current Load on mw203 is OK: LOAD OK - total load average: 11.49, 18.15, 16.38 [19:42:46] RECOVERY - mw162 Current Load on mw162 is OK: LOAD OK - total load average: 9.56, 16.09, 14.59 [19:42:58] RECOVERY - mw161 Current Load on mw161 is OK: LOAD OK - total load average: 11.21, 16.70, 14.42 [19:42:58] RECOVERY - mw163 Current Load on mw163 is OK: LOAD OK - total load average: 10.29, 17.14, 16.35 [19:43:15] RECOVERY - mw202 Current Load on mw202 is OK: LOAD OK - total load average: 10.66, 16.96, 16.55 [19:43:33] RECOVERY - mw181 Current Load on mw181 is OK: LOAD OK - total load average: 10.50, 17.01, 16.62 [19:43:41] RECOVERY - mw182 Current Load on mw182 is OK: LOAD OK - total load average: 10.98, 18.16, 18.88 [19:44:33] RECOVERY - mw183 Current Load on mw183 is OK: LOAD OK - total load average: 10.51, 17.80, 18.58 [20:17:19] PROBLEM - cp201 Disk Space on cp201 is WARNING: DISK WARNING - free space: / 45220MiB (10.0% inode=100%); [22:05:25] PROBLEM - cp171 Disk Space on cp171 is WARNING: DISK WARNING - free space: / 44449MiB (9.8% inode=100%); [22:09:25] RECOVERY - cp171 Disk Space on cp171 is OK: DISK OK - free space: / 89093MiB (19.6% inode=100%); [22:32:56] PROBLEM - cp191 Disk Space on cp191 is WARNING: DISK WARNING - free space: / 44445MiB (9.8% inode=100%); [22:38:56] RECOVERY - cp191 Disk Space on cp191 is OK: DISK OK - free space: / 89707MiB (19.7% inode=100%); [23:16:24] PROBLEM - mw183 Current Load on mw183 is CRITICAL: LOAD CRITICAL - total load average: 26.10, 18.62, 13.83 [23:17:41] PROBLEM - mw182 Current Load on mw182 is WARNING: LOAD WARNING - total load average: 23.13, 18.50, 13.53 [23:18:24] RECOVERY - mw183 Current Load on mw183 is OK: LOAD OK - total load average: 19.45, 19.33, 14.72 [23:23:41] RECOVERY - mw182 Current Load on mw182 is OK: LOAD OK - total load average: 4.83, 14.67, 14.01 [23:24:07] PROBLEM - mw203 HTTPS on mw203 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/2 502 [23:24:14] PROBLEM - cp161 Varnish Backends on cp161 is CRITICAL: 7 backends are down. mw161 mw171 mw182 mw153 mw183 mw201 mw202 [23:24:15] PROBLEM - mw173 MediaWiki Rendering on mw173 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 5857 bytes in 0.011 second response time [23:24:20] PROBLEM - cp201 Varnish Backends on cp201 is CRITICAL: 6 backends are down. mw161 mw171 mw182 mw183 mw201 mw202 [23:24:21] PROBLEM - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is WARNING: WARNING - NGINX Error Rate is 56% [23:24:25] PROBLEM - db161 Current Load on db161 is CRITICAL: LOAD CRITICAL - total load average: 184.54, 81.64, 32.31 [23:25:24] Depooling db161 [23:26:06] RECOVERY - mw203 HTTPS on mw203 is OK: HTTP OK: HTTP/2 410 - Status line output matched "HTTP/2 410" - 340 bytes in 2.843 second response time [23:26:09] !log [petramagna@mwtask181] Starting deploy of {'config': True, 'force': True} to all [23:26:14] RECOVERY - cp161 Varnish Backends on cp161 is OK: All 34 backends are healthy [23:26:15] RECOVERY - mw173 MediaWiki Rendering on mw173 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.266 second response time [23:26:17] RECOVERY - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is OK: OK - NGINX Error Rate is 4% [23:26:20] RECOVERY - cp201 Varnish Backends on cp201 is OK: All 34 backends are healthy [23:26:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log#sal-20261006232609-c291307c [23:26:37] !log [petramagna@mwtask181] finished deploy of {'config': True, 'force': True} to all - SUCCESS in 27s [23:26:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log#sal-20261006232637-649fd588 [23:27:25] Repooling db161 now that load is down [23:27:45] !log [petramagna@mwtask181] Starting deploy of {'config': True, 'force': True} to all [23:27:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log#sal-20261006232745-c291307c [23:28:06] !log [petramagna@mwtask181] finished deploy of {'config': True, 'force': True} to all - SUCCESS in 21s [23:28:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log#sal-20261006232806-0df86a34 [23:35:02] PROBLEM - mw183 Current Load on mw183 is WARNING: LOAD WARNING - total load average: 22.18, 19.80, 17.19 [23:36:56] RECOVERY - mw183 Current Load on mw183 is OK: LOAD OK - total load average: 19.02, 19.72, 17.49 [23:37:41] PROBLEM - mw182 Current Load on mw182 is WARNING: LOAD WARNING - total load average: 23.71, 20.96, 17.39 [23:40:07] PROBLEM - mw173 Current Load on mw173 is WARNING: LOAD WARNING - total load average: 22.60, 18.27, 15.14 [23:40:26] PROBLEM - mw201 Current Load on mw201 is WARNING: LOAD WARNING - total load average: 23.37, 19.31, 15.78 [23:40:45] PROBLEM - mw183 Current Load on mw183 is CRITICAL: LOAD CRITICAL - total load average: 26.07, 22.94, 19.27 [23:40:46] PROBLEM - mw162 Current Load on mw162 is WARNING: LOAD WARNING - total load average: 22.85, 19.03, 14.91 [23:40:53] PROBLEM - mw203 Current Load on mw203 is WARNING: LOAD WARNING - total load average: 23.79, 20.05, 16.90 [23:40:58] PROBLEM - mw161 Current Load on mw161 is WARNING: LOAD WARNING - total load average: 23.90, 18.61, 14.07 [23:41:15] PROBLEM - mw202 Current Load on mw202 is WARNING: LOAD WARNING - total load average: 21.61, 19.02, 15.75 [23:41:16] PROBLEM - mw193 Current Load on mw193 is WARNING: LOAD WARNING - total load average: 23.25, 19.87, 16.45 [23:41:41] RECOVERY - mw182 Current Load on mw182 is OK: LOAD OK - total load average: 15.34, 19.79, 17.86 [23:42:05] RECOVERY - mw173 Current Load on mw173 is OK: LOAD OK - total load average: 13.79, 16.97, 15.09 [23:42:26] RECOVERY - mw201 Current Load on mw201 is OK: LOAD OK - total load average: 13.03, 17.39, 15.56 [23:42:40] RECOVERY - mw183 Current Load on mw183 is OK: LOAD OK - total load average: 11.18, 18.71, 18.18 [23:42:46] RECOVERY - mw162 Current Load on mw162 is OK: LOAD OK - total load average: 9.56, 15.50, 14.14 [23:42:48] RECOVERY - mw203 Current Load on mw203 is OK: LOAD OK - total load average: 11.69, 17.38, 16.34 [23:42:58] RECOVERY - mw161 Current Load on mw161 is OK: LOAD OK - total load average: 9.38, 15.08, 13.34 [23:43:15] RECOVERY - mw193 Current Load on mw193 is OK: LOAD OK - total load average: 9.73, 15.88, 15.40 [23:43:15] RECOVERY - mw202 Current Load on mw202 is OK: LOAD OK - total load average: 10.31, 15.50, 14.85 [23:44:25] PROBLEM - db161 Current Load on db161 is WARNING: LOAD WARNING - total load average: 2.06, 4.56, 11.27 [23:46:25] RECOVERY - db161 Current Load on db161 is OK: LOAD OK - total load average: 1.71, 3.63, 10.12