[00:00:40] PROBLEM - os151 Current Load on os151 is WARNING: LOAD WARNING - total load average: 3.63, 3.58, 3.32 [00:01:03] [02statichelp] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/statichelp/commit/0305438e145cc4cfcc8cf0fe6afe8aa76798e3b2 [00:01:03] 02statichelp/03main 07WikiTideBot 030305438 Bot: Auto-update Tech namespace pages 2026-10-09 00:01:00 [00:03:13] PROBLEM - db182 Current Load on db182 is CRITICAL: LOAD CRITICAL - total load average: 12.31, 10.03, 7.88 [00:04:30] PROBLEM - os151 Current Load on os151 is CRITICAL: LOAD CRITICAL - total load average: 4.03, 3.85, 3.48 [00:05:13] RECOVERY - db182 Current Load on db182 is OK: LOAD OK - total load average: 9.51, 9.83, 8.08 [00:06:25] PROBLEM - os151 Current Load on os151 is WARNING: LOAD WARNING - total load average: 3.16, 3.55, 3.41 [00:07:09] RECOVERY - os161 Disk Space on os161 is OK: DISK OK - free space: / 48373MiB (10.8% inode=100%); [00:10:15] PROBLEM - os151 Current Load on os151 is CRITICAL: LOAD CRITICAL - total load average: 4.11, 3.82, 3.55 [00:12:10] PROBLEM - os151 Current Load on os151 is WARNING: LOAD WARNING - total load average: 2.96, 3.49, 3.46 [00:14:05] RECOVERY - os151 Current Load on os151 is OK: LOAD OK - total load average: 2.33, 3.18, 3.35 [00:43:37] PROBLEM - mwtask181 Check unit status of mediawiki_job_generate-sitemap-index on mwtask181 is CRITICAL: CRITICAL: Status of the systemd unit mediawiki_job_generate-sitemap-index [00:48:38] RECOVERY - cp201 Disk Space on cp201 is OK: DISK OK - free space: / 84615MiB (18.7% inode=100%); [00:53:28] PROBLEM - os151 Current Load on os151 is WARNING: LOAD WARNING - total load average: 3.54, 3.59, 3.41 [00:59:13] RECOVERY - os151 Current Load on os151 is OK: LOAD OK - total load average: 2.90, 3.27, 3.34 [01:05:01] PROBLEM - os151 Current Load on os151 is WARNING: LOAD WARNING - total load average: 3.57, 3.43, 3.38 [01:07:01] RECOVERY - os151 Current Load on os151 is OK: LOAD OK - total load average: 3.16, 3.39, 3.37 [01:22:40] PROBLEM - os151 Current Load on os151 is WARNING: LOAD WARNING - total load average: 3.86, 3.60, 3.43 [01:26:30] RECOVERY - os151 Current Load on os151 is OK: LOAD OK - total load average: 3.05, 3.27, 3.33 [01:36:06] PROBLEM - os151 Current Load on os151 is WARNING: LOAD WARNING - total load average: 3.76, 3.60, 3.42 [01:38:01] RECOVERY - os151 Current Load on os151 is OK: LOAD OK - total load average: 2.84, 3.26, 3.31 [01:43:47] PROBLEM - os151 Current Load on os151 is WARNING: LOAD WARNING - total load average: 3.49, 3.41, 3.34 [01:49:31] RECOVERY - os151 Current Load on os151 is OK: LOAD OK - total load average: 3.00, 3.31, 3.33 [01:56:54] PROBLEM - os151 Disk Space on os151 is WARNING: DISK WARNING - free space: / 41807MiB (9.4% inode=100%); [02:05:01] PROBLEM - os161 Current Load on os161 is WARNING: LOAD WARNING - total load average: 3.63, 2.98, 1.66 [02:07:01] RECOVERY - os161 Current Load on os161 is OK: LOAD OK - total load average: 2.16, 2.64, 1.69 [02:10:54] RECOVERY - os151 Disk Space on os151 is OK: DISK OK - free space: / 47896MiB (10.7% inode=100%); [03:37:44] PROBLEM - os201 Current Load on os201 is CRITICAL: LOAD CRITICAL - total load average: 4.34, 3.65, 2.44 [03:39:39] PROBLEM - os201 Current Load on os201 is WARNING: LOAD WARNING - total load average: 3.34, 3.64, 2.59 [03:41:35] PROBLEM - os201 Current Load on os201 is CRITICAL: LOAD CRITICAL - total load average: 4.50, 3.91, 2.81 [03:43:31] PROBLEM - os201 Current Load on os201 is WARNING: LOAD WARNING - total load average: 2.48, 3.42, 2.77 [03:47:23] RECOVERY - os201 Current Load on os201 is OK: LOAD OK - total load average: 2.85, 3.26, 2.86 [05:16:27] PROBLEM - phorge171 Current Load on phorge171 is WARNING: LOAD WARNING - total load average: 7.72, 5.37, 3.50 [05:42:27] RECOVERY - phorge171 Current Load on phorge171 is OK: LOAD OK - total load average: 4.95, 6.23, 6.34 [06:02:00] PROBLEM - phorge171 Current Load on phorge171 is WARNING: LOAD WARNING - total load average: 7.85, 6.14, 5.41 [06:13:43] PROBLEM - phorge171 Current Load on phorge171 is CRITICAL: LOAD CRITICAL - total load average: 8.57, 7.63, 6.59 [06:21:32] PROBLEM - phorge171 Current Load on phorge171 is WARNING: LOAD WARNING - total load average: 8.00, 8.00, 7.20 [06:21:43] PROBLEM - phorge171 phorge-static.wikitide.net HTTPS on phorge171 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:23:46] RECOVERY - phorge171 phorge-static.wikitide.net HTTPS on phorge171 is OK: HTTP OK: Status line output matched "HTTP/1.1 200" - 17668 bytes in 8.290 second response time [06:27:24] PROBLEM - phorge171 Current Load on phorge171 is CRITICAL: LOAD CRITICAL - total load average: 8.04, 7.96, 7.43 [06:29:21] PROBLEM - phorge171 Current Load on phorge171 is WARNING: LOAD WARNING - total load average: 7.76, 7.93, 7.48 [06:31:18] PROBLEM - phorge171 Current Load on phorge171 is CRITICAL: LOAD CRITICAL - total load average: 8.12, 7.94, 7.54 [06:33:16] PROBLEM - phorge171 Current Load on phorge171 is WARNING: LOAD WARNING - total load average: 7.93, 7.93, 7.58 [06:38:35] PROBLEM - phorge171 issue-tracker.miraheze.org HTTPS on phorge171 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:39:17] PROBLEM - phorge171 phorge-static.wikitide.net HTTPS on phorge171 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:41:05] PROBLEM - phorge171 Current Load on phorge171 is CRITICAL: LOAD CRITICAL - total load average: 8.12, 8.00, 7.75 [06:42:42] RECOVERY - phorge171 issue-tracker.miraheze.org HTTPS on phorge171 is OK: HTTP OK: HTTP/1.1 200 OK - 18165 bytes in 8.793 second response time [06:47:36] RECOVERY - phorge171 phorge-static.wikitide.net HTTPS on phorge171 is OK: HTTP OK: Status line output matched "HTTP/1.1 200" - 17668 bytes in 8.962 second response time [06:49:17] PROBLEM - phorge171 issue-tracker.miraheze.org HTTPS on phorge171 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:55:08] PROBLEM - phorge171 phorge-static.wikitide.net HTTPS on phorge171 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:56:43] PROBLEM - phorge171 Current Load on phorge171 is WARNING: LOAD WARNING - total load average: 7.81, 7.95, 7.97 [06:57:16] RECOVERY - phorge171 phorge-static.wikitide.net HTTPS on phorge171 is OK: HTTP OK: Status line output matched "HTTP/1.1 200" - 17668 bytes in 9.317 second response time [06:59:58] RECOVERY - phorge171 issue-tracker.miraheze.org HTTPS on phorge171 is OK: HTTP OK: HTTP/1.1 200 OK - 18165 bytes in 6.340 second response time [07:03:01] PROBLEM - os161 Current Load on os161 is WARNING: LOAD WARNING - total load average: 3.75, 2.67, 1.70 [07:04:25] PROBLEM - phorge171 issue-tracker.miraheze.org HTTPS on phorge171 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:07:00] PROBLEM - os191 Current Load on os191 is WARNING: LOAD WARNING - total load average: 3.88, 3.52, 2.37 [07:07:01] RECOVERY - os161 Current Load on os161 is OK: LOAD OK - total load average: 2.75, 2.94, 2.05 [07:08:58] PROBLEM - os191 Current Load on os191 is CRITICAL: LOAD CRITICAL - total load average: 4.06, 3.73, 2.58 [07:10:48] RECOVERY - phorge171 issue-tracker.miraheze.org HTTPS on phorge171 is OK: HTTP OK: HTTP/1.1 200 OK - 18180 bytes in 5.421 second response time [07:10:52] PROBLEM - phorge171 phorge-static.wikitide.net HTTPS on phorge171 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/1.1 502 Bad Gateway [07:12:27] PROBLEM - phorge171 Current Load on phorge171 is CRITICAL: LOAD CRITICAL - total load average: 8.23, 8.07, 8.02 [07:12:55] PROBLEM - os191 Current Load on os191 is WARNING: LOAD WARNING - total load average: 3.55, 3.73, 2.86 [07:15:02] RECOVERY - phorge171 phorge-static.wikitide.net HTTPS on phorge171 is OK: HTTP OK: Status line output matched "HTTP/1.1 200" - 17668 bytes in 9.467 second response time [07:18:27] PROBLEM - phorge171 Current Load on phorge171 is WARNING: LOAD WARNING - total load average: 6.03, 7.31, 7.77 [07:20:49] RECOVERY - os191 Current Load on os191 is OK: LOAD OK - total load average: 2.19, 3.21, 3.02 [07:40:27] PROBLEM - phorge171 Current Load on phorge171 is CRITICAL: LOAD CRITICAL - total load average: 8.01, 7.21, 7.14 [07:42:27] PROBLEM - phorge171 Current Load on phorge171 is WARNING: LOAD WARNING - total load average: 7.69, 7.34, 7.19 [07:44:27] PROBLEM - phorge171 Current Load on phorge171 is CRITICAL: LOAD CRITICAL - total load average: 8.18, 7.68, 7.34 [07:46:27] PROBLEM - phorge171 Current Load on phorge171 is WARNING: LOAD WARNING - total load average: 7.08, 7.41, 7.28 [08:08:27] PROBLEM - phorge171 Current Load on phorge171 is CRITICAL: LOAD CRITICAL - total load average: 8.17, 7.90, 7.48 [08:08:41] PROBLEM - phorge171 phorge-static.wikitide.net HTTPS on phorge171 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:10:27] PROBLEM - phorge171 Current Load on phorge171 is WARNING: LOAD WARNING - total load average: 7.46, 7.79, 7.50 [08:10:42] RECOVERY - phorge171 phorge-static.wikitide.net HTTPS on phorge171 is OK: HTTP OK: Status line output matched "HTTP/1.1 200" - 17668 bytes in 6.155 second response time [08:14:27] PROBLEM - phorge171 Current Load on phorge171 is CRITICAL: LOAD CRITICAL - total load average: 8.05, 8.02, 7.66 [08:16:27] PROBLEM - phorge171 Current Load on phorge171 is WARNING: LOAD WARNING - total load average: 7.58, 7.85, 7.64 [08:22:27] PROBLEM - phorge171 Current Load on phorge171 is CRITICAL: LOAD CRITICAL - total load average: 8.16, 7.80, 7.67 [08:33:16] PROBLEM - os191 Disk Space on os191 is WARNING: DISK WARNING - free space: / 44063MiB (9.9% inode=100%); [08:33:46] PROBLEM - os191 Current Load on os191 is WARNING: LOAD WARNING - total load average: 3.42, 3.21, 2.83 [08:34:09] [02puppet] 07paladox created 03paladox-patch-3 (+1 new commit) 13https://github.com/miraheze/puppet/commit/cd3212029859 [08:34:09] 02puppet/03paladox-patch-3 07paladox 03cd32120 speedscope211: fix dns [08:34:14] [02puppet] 07paladox opened pull request #5068: speedscope211: fix dns (03main...03paladox-patch-3) 13https://github.com/miraheze/puppet/pull/5068 [08:34:27] PROBLEM - phorge171 Current Load on phorge171 is WARNING: LOAD WARNING - total load average: 7.76, 7.97, 7.90 [08:35:45] RECOVERY - os191 Current Load on os191 is OK: LOAD OK - total load average: 2.97, 3.09, 2.83 [08:36:50] [02puppet] 07paladox closed pull request #5068: speedscope211: fix dns (03main...03paladox-patch-3) 13https://github.com/miraheze/puppet/pull/5068 [08:36:54] [02puppet] 07paladox 04deleted 03paladox-patch-3 at 03cd32120 13https://api.github.com/repos/miraheze/puppet/commit/cd32120 [08:38:27] PROBLEM - phorge171 Current Load on phorge171 is CRITICAL: LOAD CRITICAL - total load average: 7.99, 8.03, 7.95 [08:38:56] PROBLEM - phorge171 issue-tracker.miraheze.org HTTPS on phorge171 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:40:27] PROBLEM - phorge171 Current Load on phorge171 is WARNING: LOAD WARNING - total load average: 7.75, 7.91, 7.92 [08:41:04] RECOVERY - phorge171 issue-tracker.miraheze.org HTTPS on phorge171 is OK: HTTP OK: HTTP/1.1 200 OK - 18180 bytes in 8.989 second response time [08:42:19] [02puppet] 07paladox created 03paladox-patch-3 (+1 new commit) 13https://github.com/miraheze/puppet/commit/cd3212029859 [08:42:19] 02puppet/03paladox-patch-3 07paladox 03cd32120 speedscope211: fix dns [08:42:22] [02puppet] 07paladox reopened pull request #5068: speedscope211: fix dns (03main...03paladox-patch-3) 13https://github.com/miraheze/puppet/pull/5068 [08:42:47] [02puppet] 07paladox merged pull request #5068: speedscope211: fix dns (03main...03paladox-patch-3) 13https://github.com/miraheze/puppet/pull/5068 [08:42:47] [02puppet] 07paladox pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/00bd9622c4004069b299919d609fcdd86fe42b21 [08:42:47] 02puppet/03main 07paladox 0300bd962 speedscope211: fix dns (#5068) [08:42:49] [02puppet] 07paladox 04deleted 03paladox-patch-3 at 03cd32120 13https://api.github.com/repos/miraheze/puppet/commit/cd32120 [08:44:27] PROBLEM - phorge171 Current Load on phorge171 is CRITICAL: LOAD CRITICAL - total load average: 8.71, 8.23, 8.04 [08:45:31] PROBLEM - phorge171 issue-tracker.miraheze.org HTTPS on phorge171 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [08:45:45] PROBLEM - os161 Disk Space on os161 is WARNING: DISK WARNING - free space: / 43992MiB (9.8% inode=100%); [08:49:18] !log reboot phorge171 [08:49:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log#sal-20261009084918-dd1e89e4 [08:50:27] RECOVERY - phorge171 Current Load on phorge171 is OK: LOAD OK - total load average: 5.01, 1.47, 0.51 [08:52:47] !log rebooted cp161 [08:52:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log#sal-20261009085247-3ddf3865 [08:54:27] PROBLEM - phorge171 Current Load on phorge171 is WARNING: LOAD WARNING - total load average: 7.95, 5.23, 2.30 [08:55:56] RECOVERY - phorge171 issue-tracker.miraheze.org HTTPS on phorge171 is OK: HTTP OK: HTTP/1.1 200 OK - 18180 bytes in 9.322 second response time [08:56:27] PROBLEM - phorge171 Current Load on phorge171 is CRITICAL: LOAD CRITICAL - total load average: 9.98, 6.85, 3.25 [08:58:27] RECOVERY - phorge171 Current Load on phorge171 is OK: LOAD OK - total load average: 1.76, 4.85, 2.96 [08:59:33] PROBLEM - phorge171 phorge-static.wikitide.net HTTPS on phorge171 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:01:36] RECOVERY - phorge171 phorge-static.wikitide.net HTTPS on phorge171 is OK: HTTP OK: Status line output matched "HTTP/1.1 200" - 17668 bytes in 8.174 second response time [09:02:27] PROBLEM - phorge171 Current Load on phorge171 is WARNING: LOAD WARNING - total load average: 7.58, 6.45, 4.05 [09:04:27] PROBLEM - phorge171 Current Load on phorge171 is CRITICAL: LOAD CRITICAL - total load average: 8.16, 7.06, 4.57 [09:06:27] PROBLEM - phorge171 Current Load on phorge171 is WARNING: LOAD WARNING - total load average: 7.48, 7.25, 4.94 [09:06:34] PROBLEM - phorge171 issue-tracker.miraheze.org HTTPS on phorge171 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:07:15] RECOVERY - os161 Disk Space on os161 is OK: DISK OK - free space: / 44880MiB (10.0% inode=100%); [09:08:40] RECOVERY - phorge171 issue-tracker.miraheze.org HTTPS on phorge171 is OK: HTTP OK: HTTP/1.1 200 OK - 18180 bytes in 6.966 second response time [09:12:27] PROBLEM - phorge171 Current Load on phorge171 is CRITICAL: LOAD CRITICAL - total load average: 8.02, 7.87, 5.98 [09:15:17] PROBLEM - phorge171 phorge-static.wikitide.net HTTPS on phorge171 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:17:18] RECOVERY - phorge171 phorge-static.wikitide.net HTTPS on phorge171 is OK: HTTP OK: Status line output matched "HTTP/1.1 200" - 17668 bytes in 5.883 second response time [09:22:47] PROBLEM - phorge171 issue-tracker.miraheze.org HTTPS on phorge171 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:24:52] RECOVERY - phorge171 issue-tracker.miraheze.org HTTPS on phorge171 is OK: HTTP OK: HTTP/1.1 200 OK - 18180 bytes in 6.028 second response time [09:32:19] PROBLEM - phorge171 issue-tracker.miraheze.org HTTPS on phorge171 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:34:22] RECOVERY - phorge171 issue-tracker.miraheze.org HTTPS on phorge171 is OK: HTTP OK: HTTP/1.1 200 OK - 18180 bytes in 3.802 second response time [09:42:58] PROBLEM - phorge171 phorge-static.wikitide.net HTTPS on phorge171 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:45:02] RECOVERY - phorge171 phorge-static.wikitide.net HTTPS on phorge171 is OK: HTTP OK: Status line output matched "HTTP/1.1 200" - 17668 bytes in 9.399 second response time [09:48:27] PROBLEM - phorge171 issue-tracker.miraheze.org HTTPS on phorge171 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:49:03] PROBLEM - phorge171 phorge-static.wikitide.net HTTPS on phorge171 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:50:27] PROBLEM - phorge171 Current Load on phorge171 is WARNING: LOAD WARNING - total load average: 7.74, 7.98, 7.95 [09:51:05] RECOVERY - phorge171 phorge-static.wikitide.net HTTPS on phorge171 is OK: HTTP OK: Status line output matched "HTTP/1.1 200" - 17668 bytes in 7.303 second response time [09:52:27] PROBLEM - phorge171 Current Load on phorge171 is CRITICAL: LOAD CRITICAL - total load average: 8.08, 8.06, 8.00 [09:55:26] PROBLEM - phorge171 phorge-static.wikitide.net HTTPS on phorge171 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:00:27] PROBLEM - phorge171 Current Load on phorge171 is WARNING: LOAD WARNING - total load average: 6.77, 7.65, 7.87 [10:01:15] RECOVERY - phorge171 issue-tracker.miraheze.org HTTPS on phorge171 is OK: HTTP OK: HTTP/1.1 200 OK - 18180 bytes in 3.971 second response time [10:01:34] RECOVERY - phorge171 phorge-static.wikitide.net HTTPS on phorge171 is OK: HTTP OK: Status line output matched "HTTP/1.1 200" - 17668 bytes in 2.230 second response time [10:02:20] PROBLEM - speedscope211 Check unit status of speedscope_hourly_aggregation on speedscope211 is CRITICAL: CRITICAL: Status of the systemd unit speedscope_hourly_aggregation [10:11:16] RECOVERY - os191 Disk Space on os191 is OK: DISK OK - free space: / 61100MiB (13.7% inode=100%); [10:16:50] PROBLEM - os201 Current Load on os201 is CRITICAL: LOAD CRITICAL - total load average: 4.92, 3.78, 3.03