[00:00:12] PROBLEM - mwtask171 Current Load on mwtask171 is WARNING: LOAD WARNING - total load average: 23.71, 21.18, 20.12 [00:02:05] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 14.88, 21.35, 22.12 [00:02:08] RECOVERY - mwtask171 Current Load on mwtask171 is OK: LOAD OK - total load average: 12.61, 18.62, 19.36 [00:03:25] PROBLEM - mw181 MediaWiki Rendering on mw181 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 8191 bytes in 0.012 second response time [00:03:32] PROBLEM - mw192 HTTPS on mw192 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/2 502 [00:03:33] PROBLEM - mw201 HTTPS on mw201 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/2 502 [00:03:41] PROBLEM - cp171 HTTPS on cp171 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/2 503 [00:03:41] PROBLEM - mw152 HTTPS on mw152 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/2 502 [00:03:42] PROBLEM - mw193 MediaWiki Rendering on mw193 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 8191 bytes in 0.025 second response time [00:03:43] PROBLEM - mw173 MediaWiki Rendering on mw173 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 8191 bytes in 0.010 second response time [00:03:44] PROBLEM - mw172 MediaWiki Rendering on mw172 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 8191 bytes in 0.012 second response time [00:03:44] PROBLEM - mw203 MediaWiki Rendering on mw203 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 8191 bytes in 0.011 second response time [00:03:45] PROBLEM - mw172 HTTPS on mw172 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/2 502 [00:03:45] PROBLEM - mw171 MediaWiki Rendering on mw171 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 8191 bytes in 0.015 second response time [00:03:46] PROBLEM - mw181 HTTPS on mw181 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/2 502 [00:03:48] PROBLEM - cp201 HTTPS on cp201 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/2 503 [00:03:49] PROBLEM - mw162 HTTPS on mw162 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/2 502 [00:03:49] PROBLEM - mw163 MediaWiki Rendering on mw163 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 8191 bytes in 0.025 second response time [00:03:51] PROBLEM - cp161 HTTPS on cp161 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/2 503 [00:03:53] PROBLEM - mw183 HTTPS on mw183 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/2 502 [00:03:57] PROBLEM - mw171 HTTPS on mw171 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/2 502 [00:04:02] PROBLEM - mw182 MediaWiki Rendering on mw182 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 8191 bytes in 0.012 second response time [00:04:02] PROBLEM - mw191 MediaWiki Rendering on mw191 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 8191 bytes in 0.025 second response time [00:04:02] PROBLEM - cp161 Varnish Backends on cp161 is CRITICAL: 19 backends are down. mw151 mw152 mw161 mw162 mw171 mw172 mw181 mw182 mw153 mw163 mw173 mw183 mw191 mw192 mw193 mw201 mw202 mw203 mediawiki [00:04:03] PROBLEM - mw161 HTTPS on mw161 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/2 502 [00:04:05] RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 7.90, 16.60, 20.29 [00:04:14] PROBLEM - mw201 MediaWiki Rendering on mw201 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 8191 bytes in 0.012 second response time [00:04:14] PROBLEM - mw152 MediaWiki Rendering on mw152 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 8191 bytes in 0.018 second response time [00:04:18] PROBLEM - mw151 HTTPS on mw151 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/2 502 [00:04:21] PROBLEM - mw162 MediaWiki Rendering on mw162 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 8191 bytes in 0.014 second response time [00:04:23] PROBLEM - db161 Current Load on db161 is CRITICAL: LOAD CRITICAL - total load average: 167.44, 81.41, 32.26 [00:04:24] PROBLEM - mw153 MediaWiki Rendering on mw153 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 8191 bytes in 0.014 second response time [00:04:25] PROBLEM - mw193 HTTPS on mw193 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/2 502 [00:04:26] PROBLEM - mw173 HTTPS on mw173 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/2 502 [00:04:30] PROBLEM - mw191 HTTPS on mw191 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/2 502 [00:04:30] PROBLEM - mw183 MediaWiki Rendering on mw183 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 8191 bytes in 0.015 second response time [00:04:31] PROBLEM - mw202 MediaWiki Rendering on mw202 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 8191 bytes in 0.023 second response time [00:04:32] PROBLEM - mw163 HTTPS on mw163 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/2 502 [00:04:34] PROBLEM - mw202 HTTPS on mw202 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/2 502 [00:04:51] PROBLEM - cp201 Varnish Backends on cp201 is CRITICAL: 19 backends are down. mw151 mw152 mw161 mw162 mw171 mw172 mw181 mw182 mw153 mw163 mw173 mw183 mw191 mw192 mw193 mw201 mw202 mw203 mediawiki [00:04:59] PROBLEM - mw161 MediaWiki Rendering on mw161 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:05:01] PROBLEM - cp191 Varnish Backends on cp191 is CRITICAL: 19 backends are down. mw151 mw152 mw161 mw162 mw171 mw172 mw181 mw182 mw153 mw163 mw173 mw183 mw191 mw192 mw193 mw201 mw202 mw203 mediawiki [00:05:06] PROBLEM - mw153 HTTPS on mw153 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10005 milliseconds with 0 bytes received [00:05:09] PROBLEM - mw203 HTTPS on mw203 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10001 milliseconds with 0 bytes received [00:05:11] PROBLEM - mw151 MediaWiki Rendering on mw151 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:05:12] PROBLEM - mw192 MediaWiki Rendering on mw192 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:05:18] PROBLEM - cp191 HTTPS on cp191 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/2 503 [00:05:18] PROBLEM - mw182 HTTPS on mw182 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10003 milliseconds with 0 bytes received [00:05:19] PROBLEM - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is CRITICAL: CRITICAL - NGINX Error Rate is 77% [00:05:25] PROBLEM - cp171 Varnish Backends on cp171 is CRITICAL: 19 backends are down. mw151 mw152 mw161 mw162 mw171 mw172 mw181 mw182 mw153 mw163 mw173 mw183 mw191 mw192 mw193 mw201 mw202 mw203 mediawiki [00:05:50] PROBLEM - mwtask181 Check unit status of update-static-tech-docs on mwtask181 is CRITICAL: CRITICAL: Status of the systemd unit update-static-tech-docs [00:07:25] PROBLEM - db161 MariaDB Connections on db161 is UNKNOWN: [00:07:38] PROBLEM - db161 MariaDB on db161 is UNKNOWN: [00:07:53] PROBLEM - puppet181 Check unit status of listdomains_github_push on puppet181 is CRITICAL: CRITICAL: Status of the systemd unit listdomains_github_push [00:07:58] PROBLEM - db161 APT on db161 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [00:08:09] RECOVERY - mw183 HTTPS on mw183 is OK: HTTP OK: HTTP/2 410 - Status line output matched "HTTP/2 410" - 4112 bytes in 9.649 second response time [00:08:09] RECOVERY - mw171 HTTPS on mw171 is OK: HTTP OK: HTTP/2 410 - Status line output matched "HTTP/2 410" - 4112 bytes in 4.741 second response time [00:08:09] RECOVERY - mw161 HTTPS on mw161 is OK: HTTP OK: HTTP/2 410 - Status line output matched "HTTP/2 410" - 4112 bytes in 0.065 second response time [00:08:11] RECOVERY - mw182 MediaWiki Rendering on mw182 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.800 second response time [00:08:12] RECOVERY - mw191 MediaWiki Rendering on mw191 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 5.260 second response time [00:08:20] RECOVERY - mw201 MediaWiki Rendering on mw201 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.194 second response time [00:08:21] RECOVERY - mw152 MediaWiki Rendering on mw152 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.189 second response time [00:08:23] RECOVERY - mw151 HTTPS on mw151 is OK: HTTP OK: HTTP/2 410 - Status line output matched "HTTP/2 410" - 4112 bytes in 0.066 second response time [00:08:28] RECOVERY - mw162 MediaWiki Rendering on mw162 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.199 second response time [00:08:28] RECOVERY - mw153 MediaWiki Rendering on mw153 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.174 second response time [00:08:31] RECOVERY - mw173 HTTPS on mw173 is OK: HTTP OK: HTTP/2 410 - Status line output matched "HTTP/2 410" - 4112 bytes in 0.072 second response time [00:08:31] RECOVERY - mw193 HTTPS on mw193 is OK: HTTP OK: HTTP/2 410 - Status line output matched "HTTP/2 410" - 4112 bytes in 0.071 second response time [00:08:34] RECOVERY - mw191 HTTPS on mw191 is OK: HTTP OK: HTTP/2 410 - Status line output matched "HTTP/2 410" - 4112 bytes in 0.072 second response time [00:08:35] RECOVERY - mw183 MediaWiki Rendering on mw183 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.192 second response time [00:08:35] RECOVERY - mw202 MediaWiki Rendering on mw202 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.217 second response time [00:08:37] RECOVERY - mw163 HTTPS on mw163 is OK: HTTP OK: HTTP/2 410 - Status line output matched "HTTP/2 410" - 4112 bytes in 0.066 second response time [00:08:43] RECOVERY - mw202 HTTPS on mw202 is OK: HTTP OK: HTTP/2 410 - Status line output matched "HTTP/2 410" - 4112 bytes in 0.076 second response time [00:08:58] RECOVERY - mw161 MediaWiki Rendering on mw161 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.194 second response time [00:09:01] RECOVERY - cp191 Varnish Backends on cp191 is OK: All 31 backends are healthy [00:09:04] RECOVERY - mw153 HTTPS on mw153 is OK: HTTP OK: HTTP/2 410 - Status line output matched "HTTP/2 410" - 4112 bytes in 0.066 second response time [00:09:10] RECOVERY - mw151 MediaWiki Rendering on mw151 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.242 second response time [00:09:17] RECOVERY - mw203 HTTPS on mw203 is OK: HTTP OK: HTTP/2 410 - Status line output matched "HTTP/2 410" - 4112 bytes in 0.075 second response time [00:09:18] RECOVERY - cp191 HTTPS on cp191 is OK: HTTP OK: HTTP/2 410 - Status line output matched "HTTP/2 410" - 4161 bytes in 0.275 second response time [00:09:18] RECOVERY - cp171 Varnish Backends on cp171 is OK: All 31 backends are healthy [00:09:19] PROBLEM - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is WARNING: WARNING - NGINX Error Rate is 58% [00:09:20] RECOVERY - mw182 HTTPS on mw182 is OK: HTTP OK: HTTP/2 410 - Status line output matched "HTTP/2 410" - 4112 bytes in 0.069 second response time [00:09:21] RECOVERY - mw192 MediaWiki Rendering on mw192 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.194 second response time [00:09:30] RECOVERY - mw181 MediaWiki Rendering on mw181 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.245 second response time [00:09:34] PROBLEM - db161 MariaDB on db161 is CRITICAL: Too many connections [00:09:36] RECOVERY - cp171 HTTPS on cp171 is OK: HTTP OK: HTTP/2 410 - Status line output matched "HTTP/2 410" - 4161 bytes in 0.071 second response time [00:09:41] RECOVERY - mw201 HTTPS on mw201 is OK: HTTP OK: HTTP/2 410 - Status line output matched "HTTP/2 410" - 4112 bytes in 0.080 second response time [00:09:48] RECOVERY - cp201 HTTPS on cp201 is OK: HTTP OK: HTTP/2 410 - Status line output matched "HTTP/2 410" - 4161 bytes in 0.092 second response time [00:09:50] RECOVERY - mw203 MediaWiki Rendering on mw203 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.200 second response time [00:09:50] RECOVERY - mw193 MediaWiki Rendering on mw193 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.189 second response time [00:09:51] RECOVERY - mw192 HTTPS on mw192 is OK: HTTP OK: HTTP/2 410 - Status line output matched "HTTP/2 410" - 4112 bytes in 0.095 second response time [00:09:51] RECOVERY - cp161 HTTPS on cp161 is OK: HTTP OK: HTTP/2 410 - Status line output matched "HTTP/2 410" - 4216 bytes in 0.086 second response time [00:09:53] RECOVERY - mw173 MediaWiki Rendering on mw173 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.186 second response time [00:09:55] RECOVERY - mw172 MediaWiki Rendering on mw172 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.210 second response time [00:09:57] RECOVERY - mw152 HTTPS on mw152 is OK: HTTP OK: HTTP/2 410 - Status line output matched "HTTP/2 410" - 4112 bytes in 0.071 second response time [00:09:58] RECOVERY - mw162 HTTPS on mw162 is OK: HTTP OK: HTTP/2 410 - Status line output matched "HTTP/2 410" - 4112 bytes in 0.065 second response time [00:09:58] RECOVERY - mw163 MediaWiki Rendering on mw163 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.194 second response time [00:09:59] RECOVERY - mw172 HTTPS on mw172 is OK: HTTP OK: HTTP/2 410 - Status line output matched "HTTP/2 410" - 4112 bytes in 0.062 second response time [00:10:00] RECOVERY - mw171 MediaWiki Rendering on mw171 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.194 second response time [00:10:02] RECOVERY - cp161 Varnish Backends on cp161 is OK: All 31 backends are healthy [00:10:03] RECOVERY - mw181 HTTPS on mw181 is OK: HTTP OK: HTTP/2 410 - Status line output matched "HTTP/2 410" - 4112 bytes in 0.085 second response time [00:10:12] RECOVERY - cp171 Disk Space on cp171 is OK: DISK OK - free space: / 55143MiB (12% inode=99%); [00:10:17] PROBLEM - db161 Puppet on db161 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [00:10:41] RECOVERY - cp191 Disk Space on cp191 is OK: DISK OK - free space: / 55330MiB (12% inode=99%); [00:10:43] PROBLEM - mwtask181 videoscaler.svc.fsslc.wtnet HTTP on mwtask181 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 9005: cURL returned 28 - Operation timed out after 10001 milliseconds with 0 bytes received [00:11:16] RECOVERY - cp201 Disk Space on cp201 is OK: DISK OK - free space: / 54727MiB (12% inode=99%); [00:11:19] RECOVERY - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is OK: OK - NGINX Error Rate is 17% [00:13:12] PROBLEM - mwtask181 HTTPS on mwtask181 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10000 milliseconds with 0 bytes received [00:13:13] PROBLEM - mwtask181 MediaWiki Rendering on mwtask181 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:13:14] PROBLEM - mwtask181 jobrunner.svc.fsslc.wtnet HTTP on mwtask181 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 9005: cURL returned 28 - Operation timed out after 10004 milliseconds with 0 bytes received [00:14:51] RECOVERY - cp201 Varnish Backends on cp201 is OK: All 31 backends are healthy [00:15:09] RECOVERY - mwtask181 HTTPS on mwtask181 is OK: HTTP OK: HTTP/2 410 - Status line output matched "HTTP/2 410" - 4116 bytes in 1.515 second response time [00:15:09] RECOVERY - mwtask181 jobrunner.svc.fsslc.wtnet HTTP on mwtask181 is OK: HTTP OK: HTTP/1.1 204 No Content - 170 bytes in 0.833 second response time [00:15:14] RECOVERY - mwtask181 MediaWiki Rendering on mwtask181 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 1.976 second response time [00:15:53] RECOVERY - puppet181 Check unit status of listdomains_github_push on puppet181 is OK: OK: Status of the systemd unit listdomains_github_push [00:16:38] PROBLEM - mwtask181 jobrunner-high.svc.fsslc.wtnet HTTP on mwtask181 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 9005: cURL returned 28 - Operation timed out after 10001 milliseconds with 0 bytes received [00:16:45] RECOVERY - mwtask181 videoscaler.svc.fsslc.wtnet HTTP on mwtask181 is OK: HTTP OK: HTTP/1.1 204 No Content - 169 bytes in 0.067 second response time [00:18:38] RECOVERY - mwtask181 jobrunner-high.svc.fsslc.wtnet HTTP on mwtask181 is OK: HTTP OK: HTTP/1.1 204 No Content - 168 bytes in 0.876 second response time [00:19:27] PROBLEM - mwtask181 jobrunner.svc.fsslc.wtnet HTTP on mwtask181 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 9005: cURL returned 28 - Operation timed out after 10003 milliseconds with 0 bytes received [00:23:01] PROBLEM - mwtask181 videoscaler.svc.fsslc.wtnet HTTP on mwtask181 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 9005: cURL returned 28 - Operation timed out after 10003 milliseconds with 0 bytes received [00:23:59] PROBLEM - mwtask181 MediaWiki Rendering on mwtask181 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:26:05] RECOVERY - mwtask181 MediaWiki Rendering on mwtask181 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 6.471 second response time [00:27:08] RECOVERY - mwtask181 videoscaler.svc.fsslc.wtnet HTTP on mwtask181 is OK: HTTP OK: HTTP/1.1 204 No Content - 171 bytes in 9.359 second response time [00:27:28] PROBLEM - mwtask181 jobrunner-high.svc.fsslc.wtnet HTTP on mwtask181 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 9005: cURL returned 28 - Operation timed out after 10001 milliseconds with 0 bytes received [00:29:28] RECOVERY - mwtask181 jobrunner-high.svc.fsslc.wtnet HTTP on mwtask181 is OK: HTTP OK: HTTP/1.1 204 No Content - 171 bytes in 1.788 second response time [00:32:18] PROBLEM - mwtask181 HTTPS on mwtask181 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10004 milliseconds with 0 bytes received [00:33:46] RECOVERY - mwtask181 jobrunner.svc.fsslc.wtnet HTTP on mwtask181 is OK: HTTP OK: HTTP/1.1 204 No Content - 168 bytes in 0.004 second response time [00:34:43] PROBLEM - mwtask181 videoscaler.svc.fsslc.wtnet HTTP on mwtask181 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 9005: cURL returned 28 - Operation timed out after 10002 milliseconds with 0 bytes received [00:34:49] PROBLEM - mwtask181 MediaWiki Rendering on mwtask181 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:35:54] PROBLEM - mwtask181 jobrunner-high.svc.fsslc.wtnet HTTP on mwtask181 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 9005: cURL returned 28 - Operation timed out after 10002 milliseconds with 0 bytes received [00:36:51] RECOVERY - mwtask181 MediaWiki Rendering on mwtask181 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 2.611 second response time [00:38:27] RECOVERY - mwtask181 HTTPS on mwtask181 is OK: HTTP OK: HTTP/2 410 - Status line output matched "HTTP/2 410" - 4116 bytes in 1.588 second response time [00:40:52] RECOVERY - mwtask181 videoscaler.svc.fsslc.wtnet HTTP on mwtask181 is OK: HTTP OK: HTTP/1.1 204 No Content - 171 bytes in 7.236 second response time [00:41:13] PROBLEM - mwtask181 jobrunner.svc.fsslc.wtnet HTTP on mwtask181 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 9005: cURL returned 28 - Operation timed out after 10003 milliseconds with 0 bytes received [00:41:18] PROBLEM - mwtask181 MediaWiki Rendering on mwtask181 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:43:25] RECOVERY - mwtask181 MediaWiki Rendering on mwtask181 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 7.856 second response time [00:47:04] PROBLEM - mwtask181 HTTPS on mwtask181 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10002 milliseconds with 0 bytes received [00:48:44] RECOVERY - mwtask181 jobrunner-high.svc.fsslc.wtnet HTTP on mwtask181 is OK: HTTP OK: HTTP/1.1 204 No Content - 171 bytes in 5.764 second response time [00:49:52] PROBLEM - mwtask181 MediaWiki Rendering on mwtask181 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:51:23] RECOVERY - mwtask181 jobrunner.svc.fsslc.wtnet HTTP on mwtask181 is OK: HTTP OK: HTTP/1.1 204 No Content - 168 bytes in 0.003 second response time [00:51:58] RECOVERY - mwtask181 MediaWiki Rendering on mwtask181 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 6.636 second response time [00:55:04] PROBLEM - mwtask181 videoscaler.svc.fsslc.wtnet HTTP on mwtask181 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 9005: cURL returned 28 - Operation timed out after 10004 milliseconds with 0 bytes received [00:56:59] RECOVERY - mwtask181 videoscaler.svc.fsslc.wtnet HTTP on mwtask181 is OK: HTTP OK: HTTP/1.1 204 No Content - 170 bytes in 0.955 second response time [00:59:22] !log [blankeclair@mwtask181] starting deploy of {'config': True} to all [00:59:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:59:27] !log put c2 into maintenance [00:59:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:59:36] PROBLEM - mwtask181 jobrunner.svc.fsslc.wtnet HTTP on mwtask181 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 9005: cURL returned 28 - Operation timed out after 10004 milliseconds with 0 bytes received [00:59:36] !log [blankeclair@mwtask181] DEPLOY ABORTED: Canary check failed for publictestwiki.com@localhost [00:59:37] RECOVERY - mwtask181 HTTPS on mwtask181 is OK: HTTP OK: HTTP/2 410 - Status line output matched "HTTP/2 410" - 4116 bytes in 7.340 second response time [00:59:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:59:49] !log [blankeclair@mwtask181] starting deploy of {'config': True, 'force': True} to all [00:59:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:00:39] !log [blankeclair@mwtask181] finished deploy of {'config': True, 'force': True} to all - SUCCESS in 50s [01:00:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:01:17] PROBLEM - mwtask181 videoscaler.svc.fsslc.wtnet HTTP on mwtask181 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 9005: cURL returned 28 - Operation timed out after 10003 milliseconds with 0 bytes received [01:01:32] RECOVERY - mwtask181 jobrunner.svc.fsslc.wtnet HTTP on mwtask181 is OK: HTTP OK: HTTP/1.1 204 No Content - 171 bytes in 2.615 second response time [01:05:56] PROBLEM - mwtask181 HTTPS on mwtask181 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10004 milliseconds with 0 bytes received [01:06:02] PROBLEM - mwtask181 jobrunner-high.svc.fsslc.wtnet HTTP on mwtask181 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 9005: cURL returned 28 - Operation timed out after 10004 milliseconds with 0 bytes received [01:06:07] PROBLEM - mwtask181 MediaWiki Rendering on mwtask181 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:07:26] RECOVERY - mwtask181 videoscaler.svc.fsslc.wtnet HTTP on mwtask181 is OK: HTTP OK: HTTP/1.1 204 No Content - 171 bytes in 6.221 second response time [01:08:05] RECOVERY - mwtask181 jobrunner-high.svc.fsslc.wtnet HTTP on mwtask181 is OK: HTTP OK: HTTP/1.1 204 No Content - 171 bytes in 3.647 second response time [01:08:07] RECOVERY - mwtask181 MediaWiki Rendering on mwtask181 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 1.336 second response time [01:12:04] RECOVERY - mwtask181 HTTPS on mwtask181 is OK: HTTP OK: HTTP/2 410 - Status line output matched "HTTP/2 410" - 4116 bytes in 0.445 second response time [01:12:25] RECOVERY - db161 MariaDB Connections on db161 is OK: OK connection usage: 1.4%Current connections: 14 [01:12:38] RECOVERY - db161 MariaDB on db161 is OK: Uptime: 1392199 Threads: 9 Questions: 3577707545 Slow queries: 16742 Opens: 3823874 Open tables: 200000 Queries per second avg: 2569.824 [01:12:38] RECOVERY - db161 APT on db161 is OK: APT OK: 130 packages available for upgrade (0 critical updates). [01:14:24] RECOVERY - db161 Puppet on db161 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [01:16:01] PROBLEM - mwtask181 Check unit status of mediawiki_job_purge-parsercache on mwtask181 is CRITICAL: CRITICAL: Status of the systemd unit mediawiki_job_purge-parsercache [01:16:05] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 25.00, 15.85, 8.09 [01:18:05] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 23.72, 18.53, 10.02 [01:18:24] !log [blankeclair@mwtask181] starting deploy of {'config': True, 'force': True} to all [01:18:27] !log unmaint c2 [01:18:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:18:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:18:53] !log [blankeclair@mwtask181] finished deploy of {'config': True, 'force': True} to all - SUCCESS in 29s [01:18:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:20:05] RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 13.94, 17.70, 10.83 [01:22:20] [Grafana] RESOLVED: MediaWiki JobQueue is stalled https://grafana.wikitide.net/d/GtxbP1Xnk?from=1757808800000&orgId=1&to=1757812400000 [01:45:50] RECOVERY - mwtask181 Check unit status of update-static-tech-docs on mwtask181 is OK: OK: Status of the systemd unit update-static-tech-docs [01:46:01] RECOVERY - mwtask181 Check unit status of mediawiki_job_purge-parsercache on mwtask181 is OK: OK: Status of the systemd unit mediawiki_job_purge-parsercache [01:55:32] PROBLEM - mwtask171 Current Load on mwtask171 is CRITICAL: LOAD CRITICAL - total load average: 24.45, 20.73, 17.28 [01:56:05] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 23.97, 19.76, 15.31 [01:57:32] PROBLEM - mwtask171 Current Load on mwtask171 is WARNING: LOAD WARNING - total load average: 20.17, 20.53, 17.64 [01:59:32] RECOVERY - mwtask171 Current Load on mwtask171 is OK: LOAD OK - total load average: 19.62, 20.25, 17.90 [02:00:06] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 24.01, 22.03, 17.25 [02:06:05] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 22.72, 23.23, 19.39 [02:12:23] PROBLEM - db161 Current Load on db161 is WARNING: LOAD WARNING - total load average: 0.99, 1.06, 10.98 [02:13:32] PROBLEM - mwtask171 Current Load on mwtask171 is CRITICAL: LOAD CRITICAL - total load average: 24.04, 21.77, 19.52 [02:14:23] RECOVERY - db161 Current Load on db161 is OK: LOAD OK - total load average: 1.64, 1.26, 9.84 [02:15:32] PROBLEM - mwtask171 Current Load on mwtask171 is WARNING: LOAD WARNING - total load average: 22.67, 22.31, 20.01 [02:19:32] PROBLEM - mwtask171 Current Load on mwtask171 is CRITICAL: LOAD CRITICAL - total load average: 24.72, 22.54, 20.56 [02:21:32] PROBLEM - mwtask171 Current Load on mwtask171 is WARNING: LOAD WARNING - total load average: 21.19, 21.72, 20.49 [02:22:05] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 24.58, 23.89, 22.10 [02:24:05] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 20.74, 22.85, 21.96 [02:27:32] RECOVERY - mwtask171 Current Load on mwtask171 is OK: LOAD OK - total load average: 18.34, 19.90, 20.15 [02:33:32] PROBLEM - mwtask171 Current Load on mwtask171 is WARNING: LOAD WARNING - total load average: 21.24, 20.44, 20.21 [02:34:05] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 24.18, 23.64, 22.71 [02:36:05] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 23.75, 23.73, 22.86 [02:37:32] RECOVERY - mwtask171 Current Load on mwtask171 is OK: LOAD OK - total load average: 17.72, 19.52, 19.93 [02:41:32] PROBLEM - mwtask171 Current Load on mwtask171 is WARNING: LOAD WARNING - total load average: 21.45, 20.52, 20.19 [02:44:05] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 25.17, 23.02, 22.76 [02:46:05] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 23.83, 23.32, 22.91 [02:46:18] lots of high loads [02:59:16] PROBLEM - cp201 Disk Space on cp201 is WARNING: DISK WARNING - free space: / 49803MiB (10% inode=99%); [02:59:32] PROBLEM - mwtask171 Current Load on mwtask171 is CRITICAL: LOAD CRITICAL - total load average: 25.21, 23.77, 22.02 [03:01:32] PROBLEM - mwtask171 Current Load on mwtask171 is WARNING: LOAD WARNING - total load average: 22.96, 23.26, 22.04 [03:02:05] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 24.62, 23.47, 23.16 [03:02:43] PROBLEM - puppet181 Disk Space on puppet181 is WARNING: DISK WARNING - free space: / 2018MiB (6% inode=80%); [03:03:32] PROBLEM - mwtask171 Current Load on mwtask171 is CRITICAL: LOAD CRITICAL - total load average: 27.11, 24.96, 22.83 [03:04:06] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 22.77, 23.02, 23.03 [03:10:05] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 24.18, 23.19, 23.04 [03:10:41] PROBLEM - cp191 Disk Space on cp191 is WARNING: DISK WARNING - free space: / 49894MiB (10% inode=99%); [03:10:43] RECOVERY - puppet181 Disk Space on puppet181 is OK: DISK OK - free space: / 4148MiB (13% inode=80%); [03:12:05] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 23.10, 23.36, 23.14 [03:17:32] PROBLEM - mwtask171 Current Load on mwtask171 is WARNING: LOAD WARNING - total load average: 18.60, 22.26, 23.34 [03:20:12] PROBLEM - cp171 Disk Space on cp171 is WARNING: DISK WARNING - free space: / 49829MiB (10% inode=99%); [03:25:32] PROBLEM - mwtask171 Current Load on mwtask171 is CRITICAL: LOAD CRITICAL - total load average: 24.33, 20.64, 21.82 [03:28:05] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 24.09, 23.57, 23.25 [03:31:32] PROBLEM - mwtask171 Current Load on mwtask171 is WARNING: LOAD WARNING - total load average: 23.40, 23.17, 22.69 [03:32:05] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 24.00, 23.81, 23.44 [03:34:05] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 24.45, 24.06, 23.58 [03:36:05] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 23.91, 23.98, 23.61 [03:43:37] PROBLEM - matomo151 Check unit status of matomo-archiver-2 on matomo151 is CRITICAL: CRITICAL: Status of the systemd unit matomo-archiver-2 [03:46:05] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 24.85, 23.93, 23.68 [03:48:05] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 22.49, 23.68, 23.64 [03:55:11] !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.44/maintenance/run.php MirahezeMagic:CheckWikiDatabases --wiki=metawiki --delete (END - exit=0) [03:55:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:55:32] RECOVERY - mwtask171 Current Load on mwtask171 is OK: LOAD OK - total load average: 16.41, 18.62, 20.00 [03:56:06] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 24.99, 24.14, 23.81 [03:56:39] !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.44/maintenance/run.php MirahezeMagic:CheckWikiDatabases --wiki=metawiki --tables --delete (END - exit=0) [03:56:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:58:05] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 22.08, 23.38, 23.58 [04:08:05] RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 6.10, 12.24, 18.61 [04:40:33] !log [skye@mwtask171] sudo -u www-data php /srv/mediawiki/1.44/maintenance/run.php rebuildall --wiki=utaitewiki (END - exit=0) [04:40:34] !log [skye@mwtask171] sudo -u www-data php /srv/mediawiki/1.44/maintenance/run.php initEditCount --wiki=utaitewiki (START) [04:40:35] !log [skye@mwtask171] sudo -u www-data php /srv/mediawiki/1.44/maintenance/run.php initEditCount --wiki=utaitewiki (END - exit=0) [04:40:36] !log [skye@mwtask171] sudo -u www-data php /srv/mediawiki/1.44/maintenance/run.php initSiteStats --wiki=utaitewiki --update (START) [04:40:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:40:38] !log [skye@mwtask171] sudo -u www-data php /srv/mediawiki/1.44/maintenance/run.php initSiteStats --wiki=utaitewiki --update (END - exit=0) [04:40:39] !log [skye@mwtask171] Finished import for utaitewiki (XML: ./utaite4.xml; Images: None) (END - exit=0) [04:40:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:40:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:40:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:40:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:40:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:05:33] RECOVERY - test151 Check unit status of mediawiki_job_purge-checkuser on test151 is OK: OK: Status of the systemd unit mediawiki_job_purge-checkuser [08:01:37] RECOVERY - matomo151 Check unit status of matomo-archiver-2 on matomo151 is OK: OK: Status of the systemd unit matomo-archiver-2 [12:45:34] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/218d7255f8e91b4a8eeb181843e2bc1cf85fce1a [12:45:34] 02ssl/03main 07WikiTideBot 03218d725 Bot: Auto-update domain lists [12:55:27] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/82380f1a6e2489d13b373f9a2d6d6def3585cb99 [12:55:27] 02ssl/03main 07WikiTideBot 0382380f1 Bot: Auto-update domain lists [13:45:31] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/819d764d0a541c4ae5bd60d9ca8f6cc95aaf4896 [13:45:32] 02ssl/03main 07WikiTideBot 03819d764 Bot: Auto-update domain lists [13:55:29] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/9cc87864a02ef1e100dde945c3ae15ef2e6f6f47 [13:55:30] 02ssl/03main 07WikiTideBot 039cc8786 Bot: Auto-update domain lists [14:05:36] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/d0de8d16d1ad66df5dec5f22c496598c4d996565 [14:05:36] 02ssl/03main 07WikiTideBot 03d0de8d1 Bot: Auto-update domain lists [16:00:43] PROBLEM - matomo151 Disk Space on matomo151 is WARNING: DISK WARNING - free space: / 1962MiB (10% inode=89%); [16:29:53] PROBLEM - puppet181 Check unit status of listdomains_github_push on puppet181 is CRITICAL: CRITICAL: Status of the systemd unit listdomains_github_push [16:35:53] RECOVERY - puppet181 Check unit status of listdomains_github_push on puppet181 is OK: OK: Status of the systemd unit listdomains_github_push [16:43:48] [02MediaWikiDebugJS] 07Universal-Omega created 03update (+1 new commit) 13https://github.com/miraheze/MediaWikiDebugJS/commit/65697d714728 [16:43:48] 02MediaWikiDebugJS/03update 07CosmicAlpha 0365697d7 Add update manifest for Firefox [16:43:52] [02MediaWikiDebugJS] 07Universal-Omega opened pull request #18: Add update manifest for Firefox (03main...03update) 13https://github.com/miraheze/MediaWikiDebugJS/pull/18 [16:43:59] [02MediaWikiDebugJS] 07coderabbitai[bot] commented on pull request #18:
[…] 13https://github.com/miraheze/MediaWikiDebugJS/pull/18#issuecomment-3289679206 [16:45:16] [02MediaWikiDebugJS] 07Universal-Omega pushed 1 new commit to 03update 13https://github.com/miraheze/MediaWikiDebugJS/commit/3312fc11110fe15cbfe4fa40be8b5b82006b810f [16:45:16] 02MediaWikiDebugJS/03update 07CosmicAlpha 033312fc1 Update [16:45:39] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/9f7f33ee38cbfaea6df1949e8cdca2d49b1d474e [16:45:39] 02ssl/03main 07WikiTideBot 039f7f33e Bot: Auto-update domain lists [16:46:12] [02MediaWikiDebugJS] 07Universal-Omega 04deleted 03v1.1.0 at 03537878b 13https://api.github.com/repos/miraheze/MediaWikiDebugJS/commit/537878b [16:46:30] [02MediaWikiDebugJS] 07Universal-Omega merged pull request #18: Add update manifest for Firefox (03main...03update) 13https://github.com/miraheze/MediaWikiDebugJS/pull/18 [16:46:32] [02MediaWikiDebugJS] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/MediaWikiDebugJS/commit/d6bab0183ba0bf1823b9dea9bef58b0724685219 [16:46:34] [02MediaWikiDebugJS] 07Universal-Omega 04deleted 03update at 033312fc1 13https://api.github.com/repos/miraheze/MediaWikiDebugJS/commit/3312fc1 [16:46:35] 02MediaWikiDebugJS/03main 07CosmicAlpha 03d6bab01 Add update manifest for Firefox [16:46:59] [02MediaWikiDebugJS] 07github-actions[bot] released MediaWikiDebugJS 1.1.0 13https://github.com/miraheze/MediaWikiDebugJS/releases/tag/v1.1.0 [16:46:59] [02MediaWikiDebugJS] 07github-actions[bot] tagged 03v1.1.0 at 03main 13https://github.com/miraheze/MediaWikiDebugJS/compare/v1.1.0 [16:48:05] [02MediaWikiDebugJS] 07Universal-Omega 04deleted 03v1.1.0 at 03d6bab01 13https://api.github.com/repos/miraheze/MediaWikiDebugJS/commit/d6bab01 [16:48:31] [02MediaWikiDebugJS] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/MediaWikiDebugJS/commit/950535783a7306b753d6720377dc3d564c5cc467 [16:48:32] 02MediaWikiDebugJS/03main 07CosmicAlpha 039505357 Fix update.json [16:49:00] [02MediaWikiDebugJS] 07github-actions[bot] released MediaWikiDebugJS 1.1.0 13https://github.com/miraheze/MediaWikiDebugJS/releases/tag/v1.1.0 [16:49:01] [02MediaWikiDebugJS] 07github-actions[bot] tagged 03v1.1.0 at 03main 13https://github.com/miraheze/MediaWikiDebugJS/compare/v1.1.0 [17:02:10] RECOVERY - matomo151 Disk Space on matomo151 is OK: DISK OK - free space: / 6598MiB (36% inode=89%); [17:02:35] [02WikiTideDebug] 07Universal-Omega created 03update (+1 new commit) 13https://github.com/miraheze/WikiTideDebug/commit/48e86057f26e [17:02:35] 02WikiTideDebug/03update 07CosmicAlpha 0348e8605 Add update manifest for Firefox [17:02:40] [02WikiTideDebug] 07Universal-Omega opened pull request #15: Add update manifest for Firefox (03main...03update) 13https://github.com/miraheze/WikiTideDebug/pull/15 [17:02:46] [02WikiTideDebug] 07coderabbitai[bot] commented on pull request #15:
[…] 13https://github.com/miraheze/WikiTideDebug/pull/15#issuecomment-3289691174 [17:04:12] [02WikiTideDebug] 07Universal-Omega pushed 1 new commit to 03update 13https://github.com/miraheze/WikiTideDebug/commit/6852452cef21ff85cc4479c5dc372330d636f3a9 [17:04:12] 02WikiTideDebug/03update 07CosmicAlpha 036852452 Add [17:04:42] [02WikiTideDebug] 07Universal-Omega 04deleted 03v3.1.0 at 030607314 13https://api.github.com/repos/miraheze/WikiTideDebug/commit/0607314 [17:04:56] [02WikiTideDebug] 07Universal-Omega merged pull request #15: Add update manifest for Firefox (03main...03update) 13https://github.com/miraheze/WikiTideDebug/pull/15 [17:04:57] [02WikiTideDebug] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/WikiTideDebug/commit/886d26b4116a7e2d4d7ae012043cd1fbddb055e2 [17:04:57] 02WikiTideDebug/03main 07CosmicAlpha 03886d26b Add update manifest for Firefox [17:05:01] [02WikiTideDebug] 07Universal-Omega 04deleted 03update at 036852452 13https://api.github.com/repos/miraheze/WikiTideDebug/commit/6852452 [17:05:20] [02WikiTideDebug] 07github-actions[bot] tagged 03v3.1.0 at 03main 13https://github.com/miraheze/WikiTideDebug/compare/v3.1.0 [17:05:21] [02WikiTideDebug] 07github-actions[bot] released WikiTideDebug 3.1.0 13https://github.com/miraheze/WikiTideDebug/releases/tag/v3.1.0 [17:09:53] PROBLEM - puppet181 Check unit status of listdomains_github_push on puppet181 is CRITICAL: CRITICAL: Status of the systemd unit listdomains_github_push [17:10:32] [02WikiTideDebug] 07Universal-Omega created 03firefox-fix (+1 new commit) 13https://github.com/miraheze/WikiTideDebug/commit/3fadc657851a [17:10:33] 02WikiTideDebug/03firefox-fix 07CosmicAlpha 033fadc65 Some build fixes for Firefox [17:10:38] [02WikiTideDebug] 07Universal-Omega opened pull request #16: Some build fixes for Firefox (03main...03firefox-fix) 13https://github.com/miraheze/WikiTideDebug/pull/16 [17:10:44] [02WikiTideDebug] 07coderabbitai[bot] commented on pull request #16:
[…] 13https://github.com/miraheze/WikiTideDebug/pull/16#issuecomment-3289698455 [17:11:11] [02WikiTideDebug] 07Universal-Omega 04deleted 03v3.1.0 at 03886d26b 13https://api.github.com/repos/miraheze/WikiTideDebug/commit/886d26b [17:11:46] [02WikiTideDebug] 07Universal-Omega merged pull request #16: Some build fixes for Firefox (03main...03firefox-fix) 13https://github.com/miraheze/WikiTideDebug/pull/16 [17:11:48] [02WikiTideDebug] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/WikiTideDebug/commit/0c7af0ebdffb240ac5314ff5f23dd7fc617a3dd6 [17:11:49] 02WikiTideDebug/03main 07CosmicAlpha 030c7af0e Some build fixes for Firefox [17:11:50] [02WikiTideDebug] 07Universal-Omega 04deleted 03firefox-fix at 033fadc65 13https://api.github.com/repos/miraheze/WikiTideDebug/commit/3fadc65 [17:12:11] [02WikiTideDebug] 07github-actions[bot] released WikiTideDebug 3.1.0 13https://github.com/miraheze/WikiTideDebug/releases/tag/v3.1.0 [17:12:11] [02WikiTideDebug] 07github-actions[bot] tagged 03v3.1.0 at 03main 13https://github.com/miraheze/WikiTideDebug/compare/v3.1.0 [17:15:34] [02CreateWiki] 07lihaohong6 opened pull request #777: Improve dark mode styling (07miraheze:03main...07lihaohong6:03lihaohong6-patch-1) 13https://github.com/miraheze/CreateWiki/pull/777 [17:15:40] [02CreateWiki] 07coderabbitai[bot] commented on pull request #777:
[…] 13https://github.com/miraheze/CreateWiki/pull/777#issuecomment-3289701340 [17:15:53] RECOVERY - puppet181 Check unit status of listdomains_github_push on puppet181 is OK: OK: Status of the systemd unit listdomains_github_push [17:16:20] [02MediaWikiDebugJS] 07Universal-Omega created 03firefox-fix (+1 new commit) 13https://github.com/miraheze/MediaWikiDebugJS/commit/f920423201c6 [17:16:20] 02MediaWikiDebugJS/03firefox-fix 07CosmicAlpha 03f920423 Build fix for Firefox [17:16:35] [02MediaWikiDebugJS] 07Universal-Omega opened pull request #19: Build fix for Firefox (03main...03firefox-fix) 13https://github.com/miraheze/MediaWikiDebugJS/pull/19 [17:16:41] [02MediaWikiDebugJS] 07coderabbitai[bot] commented on pull request #19:
[…] 13https://github.com/miraheze/MediaWikiDebugJS/pull/19#issuecomment-3289701870 [17:17:46] [02MediaWikiDebugJS] 07Universal-Omega 04deleted 03v1.1.0 at 039505357 13https://api.github.com/repos/miraheze/MediaWikiDebugJS/commit/9505357 [17:18:34] [02MediaWikiDebugJS] 07Universal-Omega merged pull request #19: Build fix for Firefox (03main...03firefox-fix) 13https://github.com/miraheze/MediaWikiDebugJS/pull/19 [17:18:34] [02MediaWikiDebugJS] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/MediaWikiDebugJS/commit/c5723af795d9759b1dc871be6af40de49710f8e3 [17:18:34] 02MediaWikiDebugJS/03main 07CosmicAlpha 03c5723af Build fix for Firefox [17:18:36] [02MediaWikiDebugJS] 07Universal-Omega 04deleted 03firefox-fix at 03f920423 13https://api.github.com/repos/miraheze/MediaWikiDebugJS/commit/f920423 [17:19:01] [02MediaWikiDebugJS] 07github-actions[bot] released MediaWikiDebugJS 1.1.0 13https://github.com/miraheze/MediaWikiDebugJS/releases/tag/v1.1.0 [17:19:01] [02MediaWikiDebugJS] 07github-actions[bot] tagged 03v1.1.0 at 03main 13https://github.com/miraheze/MediaWikiDebugJS/compare/v1.1.0 [17:20:41] [02MediaWikiDebugJS] 07Universal-Omega pushed 1 new commit to 03cleanup-content_script 13https://github.com/miraheze/MediaWikiDebugJS/commit/31bca69f77184fb950ea7f11a2253b1119ae4fff [17:20:41] 02MediaWikiDebugJS/03cleanup-content_script 07CosmicAlpha 0331bca69 Merge branch 'main' into cleanup-content_script [18:23:02] PROBLEM - mw153 APT on mw153 is CRITICAL: APT CRITICAL: 133 packages available for upgrade (1 critical updates). [18:28:45] PROBLEM - db171 Current Load on db171 is CRITICAL: LOAD CRITICAL - total load average: 20.73, 14.03, 7.62 [18:28:47] PROBLEM - mw192 APT on mw192 is CRITICAL: APT CRITICAL: 133 packages available for upgrade (1 critical updates). [18:28:56] PROBLEM - mw151 APT on mw151 is CRITICAL: APT CRITICAL: 135 packages available for upgrade (1 critical updates). [18:30:12] PROBLEM - mw163 APT on mw163 is CRITICAL: APT CRITICAL: 133 packages available for upgrade (1 critical updates). [18:30:45] RECOVERY - db171 Current Load on db171 is OK: LOAD OK - total load average: 3.77, 9.76, 6.83 [18:32:53] PROBLEM - mw181 APT on mw181 is CRITICAL: APT CRITICAL: 133 packages available for upgrade (1 critical updates). [18:32:58] PROBLEM - test151 APT on test151 is CRITICAL: APT CRITICAL: 122 packages available for upgrade (1 critical updates). [18:34:11] PROBLEM - mw201 APT on mw201 is CRITICAL: APT CRITICAL: 133 packages available for upgrade (1 critical updates). [18:34:31] PROBLEM - mwtask181 APT on mwtask181 is CRITICAL: APT CRITICAL: 137 packages available for upgrade (1 critical updates). [18:35:41] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/dab412621646369ed69b35f41f6e4f7762122b1a [18:35:42] 02ssl/03main 07WikiTideBot 03dab4126 Bot: Auto-update domain lists [18:36:04] PROBLEM - mw152 APT on mw152 is CRITICAL: APT CRITICAL: 133 packages available for upgrade (1 critical updates). [18:36:53] PROBLEM - mw183 APT on mw183 is CRITICAL: APT CRITICAL: 133 packages available for upgrade (1 critical updates). [18:37:07] PROBLEM - mw182 APT on mw182 is CRITICAL: APT CRITICAL: 133 packages available for upgrade (1 critical updates). [18:38:45] PROBLEM - db171 Current Load on db171 is CRITICAL: LOAD CRITICAL - total load average: 10.17, 12.04, 8.84 [18:39:10] [02WikiTideDebug] 07Universal-Omega created 03signed-firefox (+1 new commit) 13https://github.com/miraheze/WikiTideDebug/commit/2d9b92914462 [18:39:10] 02WikiTideDebug/03signed-firefox 07CosmicAlpha 032d9b929 Add signed firefox build [18:39:16] [02WikiTideDebug] 07Universal-Omega opened pull request #17: Add signed firefox build (03main...03signed-firefox) 13https://github.com/miraheze/WikiTideDebug/pull/17 [18:39:22] [02WikiTideDebug] 07coderabbitai[bot] commented on pull request #17:
[…] 13https://github.com/miraheze/WikiTideDebug/pull/17#issuecomment-3289769363 [18:40:36] PROBLEM - mw162 APT on mw162 is CRITICAL: APT CRITICAL: 133 packages available for upgrade (1 critical updates). [18:40:54] [02WikiTideDebug] 07Universal-Omega pushed 1 new commit to 03signed-firefox 13https://github.com/miraheze/WikiTideDebug/commit/aeff07c33471f8d9a2488ed4b65b2575e2e9b11a [18:40:54] 02WikiTideDebug/03signed-firefox 07CosmicAlpha 03aeff07c Update [18:41:15] PROBLEM - mw202 APT on mw202 is CRITICAL: APT CRITICAL: 133 packages available for upgrade (1 critical updates). [18:41:31] PROBLEM - mw161 APT on mw161 is CRITICAL: APT CRITICAL: 133 packages available for upgrade (1 critical updates). [18:41:33] [02WikiTideDebug] 07Universal-Omega pushed 1 new commit to 03signed-firefox 13https://github.com/miraheze/WikiTideDebug/commit/0b412fccc4da8bf4a3288140c1627aa2c1aa13f5 [18:41:33] 02WikiTideDebug/03signed-firefox 07CosmicAlpha 030b412fc Bump version [18:41:54] PROBLEM - mw172 APT on mw172 is CRITICAL: APT CRITICAL: 133 packages available for upgrade (1 critical updates). [18:43:06] PROBLEM - mw203 APT on mw203 is CRITICAL: APT CRITICAL: 133 packages available for upgrade (1 critical updates). [18:43:17] PROBLEM - mwtask171 APT on mwtask171 is CRITICAL: APT CRITICAL: 137 packages available for upgrade (1 critical updates). [18:44:13] PROBLEM - mwtask161 APT on mwtask161 is CRITICAL: APT CRITICAL: 137 packages available for upgrade (1 critical updates). [18:44:46] [02WikiTideDebug] 07Universal-Omega merged pull request #17: Add signed firefox build (03main...03signed-firefox) 13https://github.com/miraheze/WikiTideDebug/pull/17 [18:44:46] [02WikiTideDebug] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/WikiTideDebug/commit/2b867a6fe9e1b9dc975c319df9e6f5fdcdb535d9 [18:44:48] 02WikiTideDebug/03main 07CosmicAlpha 032b867a6 Add signed firefox build [18:44:49] [02WikiTideDebug] 07Universal-Omega 04deleted 03signed-firefox at 030b412fc 13https://api.github.com/repos/miraheze/WikiTideDebug/commit/0b412fc [18:45:12] PROBLEM - mwtask151 APT on mwtask151 is CRITICAL: APT CRITICAL: 137 packages available for upgrade (1 critical updates). [18:45:17] PROBLEM - mw173 APT on mw173 is CRITICAL: APT CRITICAL: 133 packages available for upgrade (1 critical updates). [18:46:45] PROBLEM - db171 Current Load on db171 is WARNING: LOAD WARNING - total load average: 1.49, 9.87, 10.60 [18:48:45] RECOVERY - db171 Current Load on db171 is OK: LOAD OK - total load average: 1.57, 7.12, 9.51 [18:49:18] PROBLEM - mw193 APT on mw193 is CRITICAL: APT CRITICAL: 133 packages available for upgrade (1 critical updates). [18:50:44] [02WikiTideDebug] 07github-actions[bot] released WikiTideDebug 3.2.0 13https://github.com/miraheze/WikiTideDebug/releases/tag/v3.2.0 [18:50:44] [02WikiTideDebug] 07github-actions[bot] tagged 03v3.2.0 at 03main 13https://github.com/miraheze/WikiTideDebug/compare/v3.2.0 [18:51:14] PROBLEM - mw171 APT on mw171 is CRITICAL: APT CRITICAL: 133 packages available for upgrade (1 critical updates). [18:52:41] PROBLEM - mw191 APT on mw191 is CRITICAL: APT CRITICAL: 133 packages available for upgrade (1 critical updates). [18:54:11] [02MediaWikiDebugJS] 07Universal-Omega created 03signed-firefox (+1 new commit) 13https://github.com/miraheze/MediaWikiDebugJS/commit/d3d96fdae13f [18:54:12] 02MediaWikiDebugJS/03signed-firefox 07CosmicAlpha 03d3d96fd Add signed firefox build [18:54:20] [02MediaWikiDebugJS] 07Universal-Omega opened pull request #20: Add signed firefox build (03main...03signed-firefox) 13https://github.com/miraheze/MediaWikiDebugJS/pull/20 [18:54:26] [02MediaWikiDebugJS] 07coderabbitai[bot] commented on pull request #20:
[…] 13https://github.com/miraheze/MediaWikiDebugJS/pull/20#issuecomment-3289782583 [18:55:13] [02MediaWikiDebugJS] 07Universal-Omega pushed 1 new commit to 03signed-firefox 13https://github.com/miraheze/MediaWikiDebugJS/commit/6e411a189468b9325d5717b083e1f9bab2bb7691 [18:55:13] 02MediaWikiDebugJS/03signed-firefox 07CosmicAlpha 036e411a1 Add [18:56:20] [02MediaWikiDebugJS] 07Universal-Omega pushed 1 new commit to 03signed-firefox 13https://github.com/miraheze/MediaWikiDebugJS/commit/b09b860cded7faa081b1172a9cf07814f0ea7e2f [18:56:20] 02MediaWikiDebugJS/03signed-firefox 07CosmicAlpha 03b09b860 Bump version [18:58:52] [02MediaWikiDebugJS] 07Universal-Omega merged pull request #20: Add signed firefox build (03main...03signed-firefox) 13https://github.com/miraheze/MediaWikiDebugJS/pull/20 [18:58:52] [02MediaWikiDebugJS] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/MediaWikiDebugJS/commit/f8e52623c3e467083ce49df269c01b8641e50a89 [18:58:53] 02MediaWikiDebugJS/03main 07CosmicAlpha 03f8e5262 Add signed firefox build [18:58:55] [02MediaWikiDebugJS] 07Universal-Omega 04deleted 03signed-firefox at 03b09b860 13https://api.github.com/repos/miraheze/MediaWikiDebugJS/commit/b09b860 [19:00:45] [02MediaWikiDebugJS] 07github-actions[bot] tagged 03v1.2.0 at 03main 13https://github.com/miraheze/MediaWikiDebugJS/compare/v1.2.0 [19:00:45] [02MediaWikiDebugJS] 07github-actions[bot] released MediaWikiDebugJS 1.2.0 13https://github.com/miraheze/MediaWikiDebugJS/releases/tag/v1.2.0 [19:03:22] [02MediaWikiDebugJS] 07Universal-Omega pushed 1 new commit to 03cleanup-content_script 13https://github.com/miraheze/MediaWikiDebugJS/commit/3dde31ab00cda6b9f25c34b96b03c0adc472738a [19:03:22] 02MediaWikiDebugJS/03cleanup-content_script 07CosmicAlpha 033dde31a Merge branch 'main' into cleanup-content_script [19:15:32] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/e992254b53c4701405ffef847010fcbd11868ccc [19:15:32] 02ssl/03main 07WikiTideBot 03e992254 Bot: Auto-update domain lists [19:25:19] [02MediaWikiDebugJS] 07Universal-Omega pushed 1 new commit to 03cleanup-content_script 13https://github.com/miraheze/MediaWikiDebugJS/commit/e9e52511bf9e8eecad0e0d7ee9e85fec8c4bef1b [19:25:19] 02MediaWikiDebugJS/03cleanup-content_script 07CosmicAlpha 03e9e5251 Add workflow [19:27:14] [02MediaWikiDebugJS] 07Universal-Omega pushed 1 new commit to 03cleanup-content_script 13https://github.com/miraheze/MediaWikiDebugJS/commit/fa6032b2ed826a96987cde69fae795e7231494f8 [19:27:14] 02MediaWikiDebugJS/03cleanup-content_script 07CosmicAlpha 03fa6032b Tabs [19:28:24] [02MediaWikiDebugJS] 07Universal-Omega pushed 1 new commit to 03cleanup-content_script 13https://github.com/miraheze/MediaWikiDebugJS/commit/fc4bbb8a7970bfbc3b10706d43eeab3a098cd6bf [19:28:24] 02MediaWikiDebugJS/03cleanup-content_script 07CosmicAlpha 03fc4bbb8 Tabs [19:41:48] [02MediaWikiDebugJS] 07Universal-Omega pushed 1 new commit to 03cleanup-content_script 13https://github.com/miraheze/MediaWikiDebugJS/commit/ba50359481ee6481456b4998cd5a9f73809f0a52 [19:41:48] 02MediaWikiDebugJS/03cleanup-content_script 07CosmicAlpha 03ba50359 Update [19:46:03] [02MediaWikiDebugJS] 07Universal-Omega pushed 1 new commit to 03cleanup-content_script 13https://github.com/miraheze/MediaWikiDebugJS/commit/f2002bc194188d1ec879612a0f84f790a047f61e [19:46:03] 02MediaWikiDebugJS/03cleanup-content_script 07CosmicAlpha 03f2002bc Update [19:49:20] [02MediaWikiDebugJS] 07Universal-Omega created 03artificate-build (+1 new commit) 13https://github.com/miraheze/MediaWikiDebugJS/commit/1ef173e8ef3d [19:49:20] 02MediaWikiDebugJS/03artificate-build 07CosmicAlpha 031ef173e Add artificate build workflow [19:49:30] [02MediaWikiDebugJS] 07Universal-Omega opened pull request #21: Add artificate build workflow (03main...03artificate-build) 13https://github.com/miraheze/MediaWikiDebugJS/pull/21 [19:49:40] [02MediaWikiDebugJS] 07coderabbitai[bot] commented on pull request #21:
[…] 13https://github.com/miraheze/MediaWikiDebugJS/pull/21#issuecomment-3289836968 [19:51:45] [02MediaWikiDebugJS] 07Universal-Omega pushed 1 new commit to 03artificate-build 13https://github.com/miraheze/MediaWikiDebugJS/commit/78c5ada6e4209a3279a1cf7d942bbe4e6cc19954 [19:51:45] 02MediaWikiDebugJS/03artificate-build 07CosmicAlpha 0378c5ada Update [19:56:12] [02MediaWikiDebugJS] 07Universal-Omega merged pull request #21: Add artificate build workflow (03main...03artificate-build) 13https://github.com/miraheze/MediaWikiDebugJS/pull/21 [19:56:12] [02MediaWikiDebugJS] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/MediaWikiDebugJS/commit/3852db0ef7d49405f9bc0d1ff150642f49d1fbdd [19:56:13] 02MediaWikiDebugJS/03main 07CosmicAlpha 033852db0 Add artificate build workflow [19:56:15] [02MediaWikiDebugJS] 07Universal-Omega 04deleted 03artificate-build at 0378c5ada 13https://api.github.com/repos/miraheze/MediaWikiDebugJS/commit/78c5ada [19:56:26] [02MediaWikiDebugJS] 07Universal-Omega pushed 1 new commit to 03cleanup-content_script 13https://github.com/miraheze/MediaWikiDebugJS/commit/52ac6054cd84d152d02d5e40c9b9256f1944a77c [19:56:26] 02MediaWikiDebugJS/03cleanup-content_script 07CosmicAlpha 0352ac605 Merge branch 'main' into cleanup-content_script [20:09:32] [02MediaWikiDebugJS] 07Universal-Omega pushed 1 new commit to 03cleanup-content_script 13https://github.com/miraheze/MediaWikiDebugJS/commit/41d69cf8500d06bff9b135b2367b17b0e89af2eb [20:09:32] 02MediaWikiDebugJS/03cleanup-content_script 07CosmicAlpha 0341d69cf Fix [20:11:06] [02MediaWikiDebugJS] 07Universal-Omega pushed 1 new commit to 03cleanup-content_script 13https://github.com/miraheze/MediaWikiDebugJS/commit/62e599060dbebbb2ec769cbc4ec5566a27df4e7e [20:11:06] 02MediaWikiDebugJS/03cleanup-content_script 07CosmicAlpha 0362e5990 Fix [20:11:16] PROBLEM - cp201 Disk Space on cp201 is CRITICAL: DISK CRITICAL - free space: / 27196MiB (5% inode=99%); [20:12:09] [02MediaWikiDebugJS] 07Universal-Omega pushed 1 new commit to 03cleanup-content_script 13https://github.com/miraheze/MediaWikiDebugJS/commit/93603ffb403b72bb100d0883ad6dcce93a809898 [20:12:09] 02MediaWikiDebugJS/03cleanup-content_script 07CosmicAlpha 0393603ff Fix [20:22:41] PROBLEM - cp191 Disk Space on cp191 is CRITICAL: DISK CRITICAL - free space: / 27246MiB (5% inode=99%); [20:26:35] [02MediaWikiDebugJS] 07Universal-Omega pushed 1 new commit to 03cleanup-content_script 13https://github.com/miraheze/MediaWikiDebugJS/commit/28329978d76ab0591e2ec44fb788c87e82d8c2ec [20:26:35] 02MediaWikiDebugJS/03cleanup-content_script 07CosmicAlpha 032832997 Disable code no supported farms use right now. [20:29:00] [02MediaWikiDebugJS] 07Universal-Omega pushed 1 new commit to 03cleanup-content_script 13https://github.com/miraheze/MediaWikiDebugJS/commit/2eb22cbce8918c756d7318edcf94f74e46370817 [20:29:00] 02MediaWikiDebugJS/03cleanup-content_script 07CosmicAlpha 032eb22cb Fix [20:29:40] [02MediaWikiDebugJS] 07Universal-Omega pushed 1 new commit to 03cleanup-content_script 13https://github.com/miraheze/MediaWikiDebugJS/commit/98a3b856bb4534d4c208853888e067e16d9c7ca2 [20:29:40] 02MediaWikiDebugJS/03cleanup-content_script 07CosmicAlpha 0398a3b85 Add version [20:31:04] [02MediaWikiDebugJS] 07Universal-Omega pushed 1 new commit to 03cleanup-content_script 13https://github.com/miraheze/MediaWikiDebugJS/commit/37fcf8d54d63d02f54f7c9579acb3947fde66f12 [20:31:04] 02MediaWikiDebugJS/03cleanup-content_script 07CosmicAlpha 0337fcf8d - [20:34:25] [02MediaWikiDebugJS] 07Universal-Omega pushed 1 new commit to 03cleanup-content_script 13https://github.com/miraheze/MediaWikiDebugJS/commit/d76b3f3a9155697d6ecadd9210bed8591c9470a4 [20:34:26] 02MediaWikiDebugJS/03cleanup-content_script 07CosmicAlpha 03d76b3f3 Don't show jobs if 0 [20:38:12] PROBLEM - cp171 Disk Space on cp171 is CRITICAL: DISK CRITICAL - free space: / 27214MiB (5% inode=99%); [20:39:56] [02MediaWikiDebugJS] 07Universal-Omega pushed 1 new commit to 03cleanup-content_script 13https://github.com/miraheze/MediaWikiDebugJS/commit/8b014475c819f6287a0af989596bdc51108920e1 [20:39:56] 02MediaWikiDebugJS/03cleanup-content_script 07CosmicAlpha 038b01447 Use console.debug and console.info [20:41:03] [02MediaWikiDebugJS] 07Universal-Omega merged pull request #16: Cleanup content_script and add eslint (03main...03cleanup-content_script) 13https://github.com/miraheze/MediaWikiDebugJS/pull/16 [20:41:03] [02MediaWikiDebugJS] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/MediaWikiDebugJS/commit/e3c39409bc7b514af0c66dcf0516c6401e1c0574 [20:41:03] 02MediaWikiDebugJS/03main 07CosmicAlpha 03e3c3940 Cleanup content_script and add eslint [20:41:04] [02MediaWikiDebugJS] 07Universal-Omega 04deleted 03cleanup-content_script at 038b01447 13https://api.github.com/repos/miraheze/MediaWikiDebugJS/commit/8b01447 [20:42:02] [02MediaWikiDebugJS] 07dependabot[bot] created 03dependabot/npm_and_yarn/eslint-config-wikimedia-0.31.0 (+1 new commit) 13https://github.com/miraheze/MediaWikiDebugJS/commit/e5f7994a9590 [20:42:02] 02MediaWikiDebugJS/03dependabot/npm_and_yarn/eslint-config-wikimedia-0.31.0 07dependabot[bot] 03e5f7994 Bump eslint-config-wikimedia from 0.30.0 to 0.31.0… [20:42:02] [02MediaWikiDebugJS] 07dependabot[bot] opened pull request #22: Bump eslint-config-wikimedia from 0.30.0 to 0.31.0 (03main...03dependabot/npm_and_yarn/eslint-config-wikimedia-0.31.0) 13https://github.com/miraheze/MediaWikiDebugJS/pull/22 [20:42:03] [02MediaWikiDebugJS] 07dependabot[bot] added the label 'dependencies' to pull request #22 (Bump eslint-config-wikimedia from 0.30.0 to 0.31.0) 13https://github.com/miraheze/MediaWikiDebugJS/pull/22 [20:42:04] [02MediaWikiDebugJS] 07dependabot[bot] added the label 'javascript' to pull request #22 (Bump eslint-config-wikimedia from 0.30.0 to 0.31.0) 13https://github.com/miraheze/MediaWikiDebugJS/pull/22 [20:42:06] [02MediaWikiDebugJS] 07dependabot[bot] added the label 'dependencies' to pull request #22 (Bump eslint-config-wikimedia from 0.30.0 to 0.31.0) 13https://github.com/miraheze/MediaWikiDebugJS/pull/22 [20:42:08] [02MediaWikiDebugJS] 07dependabot[bot] added the label 'javascript' to pull request #22 (Bump eslint-config-wikimedia from 0.30.0 to 0.31.0) 13https://github.com/miraheze/MediaWikiDebugJS/pull/22 [20:42:10] [02MediaWikiDebugJS] 07coderabbitai[bot] commented on pull request #22: --- […] 13https://github.com/miraheze/MediaWikiDebugJS/pull/22#issuecomment-3289880546 [20:42:42] [02MediaWikiDebugJS] 07Universal-Omega merged 07dependabot[bot]'s pull request #22: Bump eslint-config-wikimedia from 0.30.0 to 0.31.0 (03main...03dependabot/npm_and_yarn/eslint-config-wikimedia-0.31.0) 13https://github.com/miraheze/MediaWikiDebugJS/pull/22 [20:42:42] [02MediaWikiDebugJS] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/MediaWikiDebugJS/commit/ac50e6c64b2d396126139e9a50e2f17e6a115567 [20:42:42] 02MediaWikiDebugJS/03main 07dependabot[bot] 03ac50e6c Bump eslint-config-wikimedia from 0.30.0 to 0.31.0… [20:42:44] [02MediaWikiDebugJS] 07Universal-Omega 04deleted 03dependabot/npm_and_yarn/eslint-config-wikimedia-0.31.0 at 03e5f7994 13https://api.github.com/repos/miraheze/MediaWikiDebugJS/commit/e5f7994 [20:43:27] [02MediaWikiDebugJS] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/MediaWikiDebugJS/commit/d1183ad3aa8941be2ac75be082af1d8cf82d20b9 [20:43:28] 02MediaWikiDebugJS/03main 07CosmicAlpha 03d1183ad Bump version [20:45:48] [02MediaWikiDebugJS] 07github-actions[bot] tagged 03v1.3.0 at 03main 13https://github.com/miraheze/MediaWikiDebugJS/compare/v1.3.0 [20:45:48] [02MediaWikiDebugJS] 07github-actions[bot] released MediaWikiDebugJS 1.3.0 13https://github.com/miraheze/MediaWikiDebugJS/releases/tag/v1.3.0 [20:49:16] [02ssl] 07pskyechology pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/f5945243e18ae8fa66156377fbacd7e3f5259a2b [20:49:16] 02ssl/03main 07Skye 03f594524 Redirect superstarracers.miraheze.org to superstarracers.wiki [21:14:22] [02MediaWikiDebugJS] 07Universal-Omega created 03firefox-fix (+1 new commit) 13https://github.com/miraheze/MediaWikiDebugJS/commit/6d535953ccdf [21:14:22] 02MediaWikiDebugJS/03firefox-fix 07CosmicAlpha 036d53595 Fix for Firefox [21:14:26] [02MediaWikiDebugJS] 07Universal-Omega opened pull request #23: Fix for Firefox (03main...03firefox-fix) 13https://github.com/miraheze/MediaWikiDebugJS/pull/23 [21:14:33] [02MediaWikiDebugJS] 07coderabbitai[bot] commented on pull request #23:
[…] 13https://github.com/miraheze/MediaWikiDebugJS/pull/23#issuecomment-3289907646 [21:14:57] [02MediaWikiDebugJS] 07Universal-Omega pushed 1 new commit to 03firefox-fix 13https://github.com/miraheze/MediaWikiDebugJS/commit/e5e47a6cb1b00e75518805b4cdf4e3e90d8c9adc [21:14:58] 02MediaWikiDebugJS/03firefox-fix 07CosmicAlpha 03e5e47a6 Add version [21:15:30] [02MediaWikiDebugJS] 07Universal-Omega pushed 1 new commit to 03firefox-fix 13https://github.com/miraheze/MediaWikiDebugJS/commit/55b0aaaa0231caf0d0a3329181ee762936174a35 [21:15:31] 02MediaWikiDebugJS/03firefox-fix 07CosmicAlpha 0355b0aaa Bump [21:21:18] [02MediaWikiDebugJS] 07Universal-Omega merged pull request #23: Fix for Firefox (03main...03firefox-fix) 13https://github.com/miraheze/MediaWikiDebugJS/pull/23 [21:21:18] [02MediaWikiDebugJS] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/MediaWikiDebugJS/commit/927bfa8ea552f2f3e2e1f541153dba3c17c0258e [21:21:19] 02MediaWikiDebugJS/03main 07CosmicAlpha 03927bfa8 Fix for Firefox [21:21:21] [02MediaWikiDebugJS] 07Universal-Omega 04deleted 03firefox-fix at 0355b0aaa 13https://api.github.com/repos/miraheze/MediaWikiDebugJS/commit/55b0aaa [21:25:41] [02MediaWikiDebugJS] 07github-actions[bot] released MediaWikiDebugJS 1.4.0 13https://github.com/miraheze/MediaWikiDebugJS/releases/tag/v1.4.0 [21:25:42] [02MediaWikiDebugJS] 07github-actions[bot] tagged 03v1.4.0 at 03main 13https://github.com/miraheze/MediaWikiDebugJS/compare/v1.4.0 [21:26:31] [02MediaWikiDebugJS] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/MediaWikiDebugJS/commit/4dcf778c1e1f0ad0aa9902f07bf020b99c9e9178 [21:26:31] 02MediaWikiDebugJS/03main 07CosmicAlpha 034dcf778 Fix workflow name [21:35:47] [02MediaWikiDebugJS] 07Universal-Omega created 03workflows (+1 new commit) 13https://github.com/miraheze/MediaWikiDebugJS/commit/b8b7c4755160 [21:35:47] 02MediaWikiDebugJS/03workflows 07CosmicAlpha 03b8b7c47 Cleanup workflows and fix firefox-signed file name [21:35:52] [02MediaWikiDebugJS] 07Universal-Omega opened pull request #24: Cleanup workflows and fix firefox-signed file name (03main...03workflows) 13https://github.com/miraheze/MediaWikiDebugJS/pull/24 [21:35:59] [02MediaWikiDebugJS] 07coderabbitai[bot] commented on pull request #24:
[…] 13https://github.com/miraheze/MediaWikiDebugJS/pull/24#issuecomment-3289924018 [21:46:53] [02MediaWikiDebugJS] 07Universal-Omega pushed 1 new commit to 03workflows 13https://github.com/miraheze/MediaWikiDebugJS/commit/29896a5cc2344e1dc63c2a0debf8ead4a7e1d66b [21:46:53] 02MediaWikiDebugJS/03workflows 07CosmicAlpha 0329896a5 Update [21:51:03] [02MediaWikiDebugJS] 07Universal-Omega pushed 1 new commit to 03workflows 13https://github.com/miraheze/MediaWikiDebugJS/commit/7fc892a826ddd4af227adc99d32a77a35fed8095 [21:51:03] 02MediaWikiDebugJS/03workflows 07CosmicAlpha 037fc892a Update [21:57:23] [02MediaWikiDebugJS] 07Universal-Omega pushed 1 new commit to 03workflows 13https://github.com/miraheze/MediaWikiDebugJS/commit/af67146d1f4c75fed66e62231ff105d34c7474c2 [21:57:23] 02MediaWikiDebugJS/03workflows 07CosmicAlpha 03af67146 Update [21:58:32] [02MediaWikiDebugJS] 07Universal-Omega pushed 1 new commit to 03workflows 13https://github.com/miraheze/MediaWikiDebugJS/commit/1516c229761e415993c8e32e5e59a2e389e84e24 [21:58:32] 02MediaWikiDebugJS/03workflows 07CosmicAlpha 031516c22 - [22:01:54] [02MediaWikiDebugJS] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/MediaWikiDebugJS/commit/5a611ba04e0a119a137aa3f9fa9080c29484e39b [22:01:55] 02MediaWikiDebugJS/03main 07CosmicAlpha 035a611ba update: use signed releases [22:02:08] [02MediaWikiDebugJS] 07Universal-Omega 04force-pushed 03workflows from 031516c22 to 0318d8f8f 13https://api.github.com/repos/miraheze/MediaWikiDebugJS/commits/workflows [22:02:08] 02MediaWikiDebugJS/03workflows 07CosmicAlpha 03b8e8a6e Cleanup workflows and fix firefox-signed file name [22:02:09] 02MediaWikiDebugJS/03workflows 07CosmicAlpha 03dd158a0 Update [22:02:10] 02MediaWikiDebugJS/03workflows 07CosmicAlpha 03c27724c Update [22:02:11] 02MediaWikiDebugJS/03workflows 07CosmicAlpha 0346e5823 Update [22:02:12] 02MediaWikiDebugJS/03workflows 07CosmicAlpha 0318d8f8f - [22:04:41] [02MediaWikiDebugJS] 07Universal-Omega pushed 1 new commit to 03workflows 13https://github.com/miraheze/MediaWikiDebugJS/commit/0296c3501a3fd360bbd536fcb5cefd80ae053541 [22:04:41] 02MediaWikiDebugJS/03workflows 07CosmicAlpha 030296c35 Add 1.5.0 [22:05:02] [02MediaWikiDebugJS] 07Universal-Omega pushed 1 new commit to 03workflows 13https://github.com/miraheze/MediaWikiDebugJS/commit/396647e83eca512d5e4b67e03f2ece2144e2f5e5 [22:05:02] 02MediaWikiDebugJS/03workflows 07CosmicAlpha 03396647e Bump [22:06:51] [02MediaWikiDebugJS] 07Universal-Omega merged pull request #24: Cleanup workflows and fix firefox-signed file name (03main...03workflows) 13https://github.com/miraheze/MediaWikiDebugJS/pull/24 [22:06:51] [02MediaWikiDebugJS] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/MediaWikiDebugJS/commit/961c7598f188fc95996dafc81146c199d16ec923 [22:06:52] 02MediaWikiDebugJS/03main 07CosmicAlpha 03961c759 Cleanup workflows and fix firefox-signed file name [22:06:53] [02MediaWikiDebugJS] 07Universal-Omega 04deleted 03workflows at 03396647e 13https://api.github.com/repos/miraheze/MediaWikiDebugJS/commit/396647e [22:10:36] [02MediaWikiDebugJS] 07github-actions[bot] released MediaWikiDebugJS 1.5.0 13https://github.com/miraheze/MediaWikiDebugJS/releases/tag/v1.5.0 [22:10:36] [02MediaWikiDebugJS] 07github-actions[bot] tagged 03v1.5.0 at 03main 13https://github.com/miraheze/MediaWikiDebugJS/compare/v1.5.0 [22:18:10] [02WikiTideDebug] 07Universal-Omega created 03artifact (+1 new commit) 13https://github.com/miraheze/WikiTideDebug/commit/d72d40a449dd [22:18:10] 02WikiTideDebug/03artifact 07CosmicAlpha 03d72d40a Add artifact build workflow [22:18:14] [02WikiTideDebug] 07Universal-Omega opened pull request #18: Add artifact build workflow (03main...03artifact) 13https://github.com/miraheze/WikiTideDebug/pull/18 [22:18:20] [02WikiTideDebug] 07coderabbitai[bot] commented on pull request #18:
[…] 13https://github.com/miraheze/WikiTideDebug/pull/18#issuecomment-3289968864 [22:19:58] [02WikiTideDebug] 07Universal-Omega merged pull request #18: Add artifact build workflow (03main...03artifact) 13https://github.com/miraheze/WikiTideDebug/pull/18 [22:19:58] [02WikiTideDebug] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/WikiTideDebug/commit/cb29645f380aeae971133ce9f74d357c6f36590b [22:20:00] 02WikiTideDebug/03main 07CosmicAlpha 03cb29645 Add artifact build workflow [22:20:01] [02WikiTideDebug] 07Universal-Omega 04deleted 03artifact at 03d72d40a 13https://api.github.com/repos/miraheze/WikiTideDebug/commit/d72d40a [22:22:29] [02MediaWikiDebugJS] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/MediaWikiDebugJS/commit/f15cb041d3c0aa5fd25de105fe6592e9a3a186e2 [22:22:29] 02MediaWikiDebugJS/03main 07CosmicAlpha 03f15cb04 Use EXT_NAME rather than GITHUB_REPOSITORY [22:29:49] [02WikiTideDebug] 07Universal-Omega created 03workflow (+1 new commit) 13https://github.com/miraheze/WikiTideDebug/commit/cb8989f3763d [22:29:49] 02WikiTideDebug/03workflow 07CosmicAlpha 03cb8989f Cleanup release workflow and fix firefox-signed file name [22:29:54] [02WikiTideDebug] 07Universal-Omega opened pull request #19: Cleanup release workflow and fix firefox-signed file name (03main...03workflow) 13https://github.com/miraheze/WikiTideDebug/pull/19 [22:30:01] [02WikiTideDebug] 07coderabbitai[bot] commented on pull request #19:
[…] 13https://github.com/miraheze/WikiTideDebug/pull/19#issuecomment-3289977207 [22:32:21] [02WikiTideDebug] 07Universal-Omega pushed 1 new commit to 03workflow 13https://github.com/miraheze/WikiTideDebug/commit/d274e5698dbf537d05f006c4ecf4c4a3e8fa772b [22:32:21] 02WikiTideDebug/03workflow 07CosmicAlpha 03d274e56 Use signed release [22:36:19] [02WikiTideDebug] 07Universal-Omega pushed 1 new commit to 03workflow 13https://github.com/miraheze/WikiTideDebug/commit/896d621b00cadc463e30f2e51a4e0ceb6f49ebf8 [22:36:19] 02WikiTideDebug/03workflow 07CosmicAlpha 03896d621 Add 3.3.0 [22:39:06] [02WikiTideDebug] 07Universal-Omega pushed 1 new commit to 03workflow 13https://github.com/miraheze/WikiTideDebug/commit/9068f1c0bd6a451dc2f9f4491c1ac52b6c9edba2 [22:39:06] 02WikiTideDebug/03workflow 07CosmicAlpha 039068f1c Use tabs and bump to 3.3.0 [22:41:12] [02WikiTideDebug] 07Universal-Omega merged pull request #19: Cleanup release workflow and fix firefox-signed file name (03main...03workflow) 13https://github.com/miraheze/WikiTideDebug/pull/19 [22:41:13] [02WikiTideDebug] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/WikiTideDebug/commit/77e46515942a6fbf7278e841062ce5d5247e7c3e [22:41:13] 02WikiTideDebug/03main 07CosmicAlpha 0377e4651 Cleanup release workflow and fix firefox-signed file name… [22:41:15] [02WikiTideDebug] 07Universal-Omega 04deleted 03workflow at 039068f1c 13https://api.github.com/repos/miraheze/WikiTideDebug/commit/9068f1c [22:41:50] [02WikiTideDebug] 07github-actions[bot] released WikiTideDebug 3.3.0 13https://github.com/miraheze/WikiTideDebug/releases/tag/v3.3.0 [22:41:50] [02WikiTideDebug] 07github-actions[bot] tagged 03v3.3.0 at 03main 13https://github.com/miraheze/WikiTideDebug/compare/v3.3.0 [23:22:55] !log [somerandomdeveloper@mwtask181] sudo -u www-data php /srv/mediawiki/1.44/maintenance/run.php SemanticMediaWiki:setupStore --wiki=modelgalacticsenatewiki (END - exit=0) [23:22:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:33:54] !log [universalomega@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all [23:33:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:34:16] miraheze/mw-config - Universal-Omega the build passed. [23:34:21] !log [universalomega@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 26s [23:34:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log