[00:02:17] PROBLEM - ping6 on cloud17 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 0.47 ms [00:03:04] PROBLEM - mwtask181 Check unit status of update-static-tech-docs on mwtask181 is CRITICAL: CRITICAL: Status of the systemd unit update-static-tech-docs [00:03:30] RECOVERY - ping6 on cloud21 is OK: PING OK - Packet loss = 0%, RTA = 0.45 ms [00:04:46] PROBLEM - ping6 on cloud19 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 0.66 ms [00:04:47] PROBLEM - ping6 on cloud20 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 0.43 ms [00:04:49] RECOVERY - ping6 on cloud15 is OK: PING OK - Packet loss = 0%, RTA = 0.46 ms [00:05:58] PROBLEM - mw152 Puppet on mw152 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_3d2png] [00:06:19] RECOVERY - ping6 on cloud17 is OK: PING OK - Packet loss = 0%, RTA = 0.44 ms [00:06:50] RECOVERY - ping6 on cloud20 is OK: PING OK - Packet loss = 0%, RTA = 0.43 ms [00:07:40] PROBLEM - ping6 on cloud21 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 0.43 ms [00:08:55] PROBLEM - ping6 on cloud15 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 0.46 ms [00:10:30] PROBLEM - mw162 Puppet on mw162 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [00:11:38] RECOVERY - ping6 on cloud21 is OK: PING OK - Packet loss = 0%, RTA = 0.41 ms [00:12:46] RECOVERY - ping6 on cloud19 is OK: PING OK - Packet loss = 0%, RTA = 0.46 ms [00:18:37] PROBLEM - ping6 on cloud16 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 0.43 ms [00:19:42] PROBLEM - ping6 on cloud17 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 0.43 ms [00:20:48] RECOVERY - ping6 on cloud15 is OK: PING OK - Packet loss = 0%, RTA = 0.45 ms [00:21:43] RECOVERY - ping6 on cloud17 is OK: PING OK - Packet loss = 0%, RTA = 0.47 ms [00:24:52] PROBLEM - ping6 on cloud15 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 0.46 ms [00:26:40] RECOVERY - swiftobject171 Puppet on swiftobject171 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:26:41] RECOVERY - ping6 on cloud16 is OK: PING OK - Packet loss = 0%, RTA = 0.43 ms [00:27:53] PROBLEM - ping6 on cloud21 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 0.44 ms [00:28:51] RECOVERY - ping6 on cloud15 is OK: PING OK - Packet loss = 0%, RTA = 0.44 ms [00:33:59] PROBLEM - ping6 on cloud16 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 0.48 ms [00:33:59] RECOVERY - ping6 on cloud21 is OK: PING OK - Packet loss = 0%, RTA = 0.41 ms [00:34:13] PROBLEM - puppet181 Check unit status of listdomains_github_push on puppet181 is CRITICAL: CRITICAL: Status of the systemd unit listdomains_github_push [00:34:34] PROBLEM - swiftobject151 Puppet on swiftobject151 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [00:35:57] RECOVERY - mw152 Puppet on mw152 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:35:59] RECOVERY - ping6 on cloud16 is OK: PING OK - Packet loss = 0%, RTA = 0.45 ms [00:37:00] PROBLEM - ping6 on cloud20 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 0.46 ms [00:38:08] PROBLEM - ping6 on cloud21 is CRITICAL: PING CRITICAL - Packet loss = 37%, RTA = 0.40 ms [00:40:30] RECOVERY - mw162 Puppet on mw162 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:40:55] PROBLEM - ping6 on cloud15 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 0.47 ms [00:41:07] RECOVERY - ping6 on cloud20 is OK: PING OK - Packet loss = 0%, RTA = 0.42 ms [00:44:07] RECOVERY - ping6 on cloud21 is OK: PING OK - Packet loss = 0%, RTA = 0.40 ms [00:46:22] PROBLEM - ping6 on cloud16 is CRITICAL: PING CRITICAL - Packet loss = 60%, RTA = 0.45 ms [00:46:51] RECOVERY - ping6 on cloud15 is OK: PING OK - Packet loss = 0%, RTA = 0.47 ms [00:47:21] PROBLEM - os201 Puppet on os201 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [00:48:22] RECOVERY - ping6 on cloud16 is OK: PING OK - Packet loss = 0%, RTA = 0.38 ms [00:52:35] PROBLEM - mw153 Puppet on mw153 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [00:59:39] PROBLEM - ping6 on cloud17 is CRITICAL: PING CRITICAL - Packet loss = 37%, RTA = 0.45 ms [01:00:13] RECOVERY - puppet181 Check unit status of listdomains_github_push on puppet181 is OK: OK: Status of the systemd unit listdomains_github_push [01:00:15] PROBLEM - ping6 on cloud21 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 0.43 ms [01:00:30] PROBLEM - ping6 on cloud18 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 0.31 ms [01:00:53] PROBLEM - ping6 on cloud15 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 0.45 ms [01:02:13] RECOVERY - ping6 on cloud21 is OK: PING OK - Packet loss = 0%, RTA = 0.45 ms [01:02:33] RECOVERY - swiftobject151 Puppet on swiftobject151 is OK: OK: Puppet is currently enabled, last run 43 seconds ago with 0 failures [01:04:34] RECOVERY - ping6 on cloud18 is OK: PING OK - Packet loss = 0%, RTA = 0.52 ms [01:05:47] PROBLEM - ping6 on cloud16 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 0.83 ms [01:05:48] RECOVERY - ping6 on cloud17 is OK: PING OK - Packet loss = 0%, RTA = 0.43 ms [01:07:47] RECOVERY - ping6 on cloud16 is OK: PING OK - Packet loss = 0%, RTA = 0.51 ms [01:08:47] RECOVERY - ping6 on cloud15 is OK: PING OK - Packet loss = 0%, RTA = 0.45 ms [01:09:58] PROBLEM - ping6 on cloud17 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 0.45 ms [01:11:57] PROBLEM - ping6 on cloud16 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 0.44 ms [01:11:58] RECOVERY - ping6 on cloud17 is OK: PING OK - Packet loss = 0%, RTA = 0.44 ms [01:14:49] PROBLEM - ping6 on cloud19 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 0.52 ms [01:16:08] PROBLEM - ping6 on cloud17 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 0.60 ms [01:16:48] RECOVERY - ping6 on cloud19 is OK: PING OK - Packet loss = 0%, RTA = 0.43 ms [01:17:33] RECOVERY - os201 Puppet on os201 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [01:18:08] RECOVERY - ping6 on cloud17 is OK: PING OK - Packet loss = 0%, RTA = 0.42 ms [01:18:34] PROBLEM - ping6 on cloud20 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 0.44 ms [01:18:52] PROBLEM - ping6 on cloud15 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 0.44 ms [01:20:01] RECOVERY - ping6 on cloud16 is OK: PING OK - Packet loss = 0%, RTA = 0.43 ms [01:20:37] RECOVERY - ping6 on cloud20 is OK: PING OK - Packet loss = 0%, RTA = 0.44 ms [01:22:35] RECOVERY - mw153 Puppet on mw153 is OK: OK: Puppet is currently enabled, last run 53 seconds ago with 0 failures [01:26:10] PROBLEM - ping6 on cloud16 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 0.46 ms [01:28:10] RECOVERY - ping6 on cloud16 is OK: PING OK - Packet loss = 0%, RTA = 0.44 ms [01:28:53] RECOVERY - ping6 on cloud15 is OK: PING OK - Packet loss = 0%, RTA = 0.47 ms [01:33:21] PROBLEM - ping6 on cloud21 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 0.42 ms [01:36:52] PROBLEM - ping6 on cloud15 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 0.45 ms [01:38:17] PROBLEM - ping6 on cloud20 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 0.41 ms [01:40:49] RECOVERY - ping6 on cloud15 is OK: PING OK - Packet loss = 0%, RTA = 0.47 ms [01:41:23] RECOVERY - ping6 on cloud21 is OK: PING OK - Packet loss = 0%, RTA = 0.43 ms [01:41:31] PROBLEM - ping6 on cloud18 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 0.32 ms [01:43:29] RECOVERY - ping6 on cloud18 is OK: PING OK - Packet loss = 0%, RTA = 0.28 ms [01:44:53] PROBLEM - ping6 on cloud15 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 0.46 ms [01:47:40] PROBLEM - ping6 on cloud16 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 0.44 ms [01:47:46] PROBLEM - os201 Puppet on os201 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [01:48:18] PROBLEM - db161 Current Load on db161 is CRITICAL: LOAD CRITICAL - total load average: 164.86, 51.01, 19.34 [01:48:50] RECOVERY - ping6 on cloud15 is OK: PING OK - Packet loss = 0%, RTA = 0.44 ms [01:49:05] PROBLEM - ping6 on cloud17 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 0.45 ms [01:49:37] Not now db161 I’m too busy wondering why phorge searching is down and why mwtask161 exploded [01:49:48] PROBLEM - mw202 MediaWiki Rendering on mw202 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 5857 bytes in 0.011 second response time [01:49:52] PROBLEM - mw203 MediaWiki Rendering on mw203 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 5857 bytes in 0.011 second response time [01:49:53] PROBLEM - mw161 MediaWiki Rendering on mw161 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 5857 bytes in 0.010 second response time [01:49:57] PROBLEM - mw192 HTTPS on mw192 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/2 502 [01:49:59] PROBLEM - mw192 MediaWiki Rendering on mw192 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 5857 bytes in 0.010 second response time [01:50:11] PROBLEM - mw181 MediaWiki Rendering on mw181 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 5857 bytes in 0.010 second response time [01:50:11] PROBLEM - mw191 MediaWiki Rendering on mw191 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:50:12] PROBLEM - cp161 Varnish Backends on cp161 is CRITICAL: 19 backends are down. mw151 mw152 mw161 mw162 mw171 mw172 mw181 mw182 mw153 mw163 mw173 mw183 mw191 mw192 mw193 mw201 mw202 mw203 mediawiki [01:50:12] PROBLEM - cp201 HTTPS on cp201 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/2 502 [01:50:15] PROBLEM - mw171 MediaWiki Rendering on mw171 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 5857 bytes in 0.010 second response time [01:50:17] PROBLEM - mw182 HTTPS on mw182 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/2 502 [01:50:19] PROBLEM - mw173 HTTPS on mw173 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10006 milliseconds with 0 bytes received [01:50:23] PROBLEM - mw171 HTTPS on mw171 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/2 502 [01:50:28] PROBLEM - mw181 HTTPS on mw181 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/2 502 [01:50:29] PROBLEM - mw202 HTTPS on mw202 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/2 502 [01:50:32] PROBLEM - mw182 MediaWiki Rendering on mw182 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 5857 bytes in 0.010 second response time [01:50:35] PROBLEM - cp201 Varnish Backends on cp201 is CRITICAL: 11 backends are down. mw151 mw152 mw162 mw172 mw153 mw163 mw173 mw191 mw193 mw201 mw202 [01:50:35] PROBLEM - cp171 HTTPS on cp171 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/2 502 [01:50:39] PROBLEM - mw183 HTTPS on mw183 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/2 502 [01:50:41] RECOVERY - ping6 on cloud20 is OK: PING OK - Packet loss = 0%, RTA = 0.38 ms [01:50:43] PROBLEM - mw203 HTTPS on mw203 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/2 502 [01:50:43] PROBLEM - mw162 MediaWiki Rendering on mw162 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 5857 bytes in 0.010 second response time [01:50:43] PROBLEM - cp191 HTTPS on cp191 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/2 502 [01:50:48] PROBLEM - mw151 HTTPS on mw151 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10004 milliseconds with 0 bytes received [01:50:56] PROBLEM - mw183 MediaWiki Rendering on mw183 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 5857 bytes in 0.011 second response time [01:50:57] PROBLEM - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is CRITICAL: CRITICAL - NGINX Error Rate is 95% [01:50:59] PROBLEM - mw153 MediaWiki Rendering on mw153 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:51:05] https://klipy.com/gifs/grandma-grandma-sad [01:51:05] RECOVERY - ping6 on cloud17 is OK: PING OK - Packet loss = 0%, RTA = 0.41 ms [01:51:07] PROBLEM - mw191 HTTPS on mw191 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10006 milliseconds with 0 bytes received [01:51:07] PROBLEM - mw193 HTTPS on mw193 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10001 milliseconds with 0 bytes received [01:51:09] PROBLEM - mw193 MediaWiki Rendering on mw193 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:51:11] PROBLEM - cp161 HTTPS on cp161 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/2 503 [01:51:27] PROBLEM - mw163 HTTPS on mw163 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10005 milliseconds with 0 bytes received [01:51:30] PROBLEM - mw162 HTTPS on mw162 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/2 502 [01:51:30] PROBLEM - mw173 MediaWiki Rendering on mw173 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 5857 bytes in 0.010 second response time [01:51:33] PROBLEM - mw161 HTTPS on mw161 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/2 502 [01:51:44] PROBLEM - mw191 Puppet on mw191 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [01:51:44] !log [void@mwtask181] starting deploy of {'config': True, 'force': True} to all [01:51:44] PROBLEM - cp171 Varnish Backends on cp171 is CRITICAL: 8 backends are down. mw151 mw152 mw172 mw153 mw163 mw191 mw193 mw201 [01:51:50] PROBLEM - cp191 Varnish Backends on cp191 is CRITICAL: 8 backends are down. mw151 mw152 mw172 mw153 mw163 mw191 mw193 mw201 [01:51:50] RECOVERY - mw202 MediaWiki Rendering on mw202 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 3.448 second response time [01:51:52] RECOVERY - mw203 MediaWiki Rendering on mw203 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 3.860 second response time [01:51:53] RECOVERY - mw161 MediaWiki Rendering on mw161 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 2.058 second response time [01:51:58] RECOVERY - mw192 MediaWiki Rendering on mw192 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.714 second response time [01:51:58] RECOVERY - mw192 HTTPS on mw192 is OK: HTTP OK: HTTP/2 410 - Status line output matched "HTTP/2 410" - 340 bytes in 0.410 second response time [01:52:07] RECOVERY - mw191 MediaWiki Rendering on mw191 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.257 second response time [01:52:09] RECOVERY - cp201 HTTPS on cp201 is OK: HTTP OK: HTTP/2 410 - Status line output matched "HTTP/2 410" - 1463 bytes in 1.699 second response time [01:52:09] !log [void@mwtask181] finished deploy of {'config': True, 'force': True} to all - SUCCESS in 26s [01:52:11] RECOVERY - mw181 MediaWiki Rendering on mw181 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.288 second response time [01:52:15] RECOVERY - mw171 MediaWiki Rendering on mw171 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.296 second response time [01:52:18] RECOVERY - mw173 HTTPS on mw173 is OK: HTTP OK: HTTP/2 410 - Status line output matched "HTTP/2 410" - 340 bytes in 0.077 second response time [01:52:20] RECOVERY - mw182 HTTPS on mw182 is OK: HTTP OK: HTTP/2 410 - Status line output matched "HTTP/2 410" - 340 bytes in 2.618 second response time [01:52:23] RECOVERY - mw171 HTTPS on mw171 is OK: HTTP OK: HTTP/2 410 - Status line output matched "HTTP/2 410" - 340 bytes in 0.076 second response time [01:52:28] RECOVERY - mw181 HTTPS on mw181 is OK: HTTP OK: HTTP/2 410 - Status line output matched "HTTP/2 410" - 340 bytes in 0.085 second response time [01:52:29] !log [void@mwtask181] depool c2 (db161) outage [01:52:29] RECOVERY - mw202 HTTPS on mw202 is OK: HTTP OK: HTTP/2 410 - Status line output matched "HTTP/2 410" - 340 bytes in 0.090 second response time [01:52:31] RECOVERY - cp171 HTTPS on cp171 is OK: HTTP OK: HTTP/2 410 - Status line output matched "HTTP/2 410" - 1463 bytes in 0.084 second response time [01:52:32] RECOVERY - mw182 MediaWiki Rendering on mw182 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.277 second response time [01:52:35] RECOVERY - cp201 Varnish Backends on cp201 is OK: All 31 backends are healthy [01:52:39] RECOVERY - mw183 HTTPS on mw183 is OK: HTTP OK: HTTP/2 410 - Status line output matched "HTTP/2 410" - 340 bytes in 0.089 second response time [01:52:42] RECOVERY - mw151 HTTPS on mw151 is OK: HTTP OK: HTTP/2 410 - Status line output matched "HTTP/2 410" - 340 bytes in 0.077 second response time [01:52:43] RECOVERY - mw203 HTTPS on mw203 is OK: HTTP OK: HTTP/2 410 - Status line output matched "HTTP/2 410" - 340 bytes in 0.090 second response time [01:52:43] RECOVERY - cp191 HTTPS on cp191 is OK: HTTP OK: HTTP/2 410 - Status line output matched "HTTP/2 410" - 1485 bytes in 0.075 second response time [01:52:43] RECOVERY - mw162 MediaWiki Rendering on mw162 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.234 second response time [01:52:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:52:56] RECOVERY - mw183 MediaWiki Rendering on mw183 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.288 second response time [01:52:57] RECOVERY - mw153 MediaWiki Rendering on mw153 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.262 second response time [01:53:01] RECOVERY - mw193 HTTPS on mw193 is OK: HTTP OK: HTTP/2 410 - Status line output matched "HTTP/2 410" - 340 bytes in 0.084 second response time [01:53:03] RECOVERY - mw191 HTTPS on mw191 is OK: HTTP OK: HTTP/2 410 - Status line output matched "HTTP/2 410" - 340 bytes in 0.084 second response time [01:53:06] RECOVERY - mw193 MediaWiki Rendering on mw193 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.237 second response time [01:53:11] RECOVERY - cp161 HTTPS on cp161 is OK: HTTP OK: HTTP/2 410 - Status line output matched "HTTP/2 410" - 1518 bytes in 0.080 second response time [01:53:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:53:25] RECOVERY - mw163 HTTPS on mw163 is OK: HTTP OK: HTTP/2 410 - Status line output matched "HTTP/2 410" - 340 bytes in 0.076 second response time [01:53:30] RECOVERY - mw162 HTTPS on mw162 is OK: HTTP OK: HTTP/2 410 - Status line output matched "HTTP/2 410" - 340 bytes in 0.085 second response time [01:53:30] RECOVERY - mw173 MediaWiki Rendering on mw173 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.238 second response time [01:53:33] RECOVERY - mw161 HTTPS on mw161 is OK: HTTP OK: HTTP/2 410 - Status line output matched "HTTP/2 410" - 340 bytes in 0.075 second response time [01:53:44] RECOVERY - cp171 Varnish Backends on cp171 is OK: All 31 backends are healthy [01:53:50] RECOVERY - cp191 Varnish Backends on cp191 is OK: All 31 backends are healthy [01:54:12] RECOVERY - cp161 Varnish Backends on cp161 is OK: All 31 backends are healthy [01:54:57] PROBLEM - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is WARNING: WARNING - NGINX Error Rate is 44% [01:55:44] RECOVERY - ping6 on cloud16 is OK: PING OK - Packet loss = 0%, RTA = 1.16 ms [01:58:21] PROBLEM - ping6 on cloud17 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 0.45 ms [01:58:57] RECOVERY - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is OK: OK - NGINX Error Rate is 37% [02:00:21] RECOVERY - ping6 on cloud17 is OK: PING OK - Packet loss = 0%, RTA = 0.48 ms [02:00:41] PROBLEM - mw151 Puppet on mw151 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [02:02:57] PROBLEM - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is WARNING: WARNING - NGINX Error Rate is 53% [02:03:29] PROBLEM - ping6 on cloud21 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 0.40 ms [02:04:13] PROBLEM - puppet181 Check unit status of listdomains_github_push on puppet181 is CRITICAL: CRITICAL: Status of the systemd unit listdomains_github_push [02:04:57] PROBLEM - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is CRITICAL: CRITICAL - NGINX Error Rate is 60% [02:05:00] PROBLEM - ping6 on cloud16 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 0.43 ms [02:05:17] PROBLEM - ping6 on cloud18 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 0.33 ms [02:05:23] !log [void@mwtask181] starting deploy of {'config': True} to all [02:05:24] !log [void@mwtask181] DEPLOY ABORTED: Canary check failed for publictestwiki.com@localhost [02:05:36] !log [void@mwtask181] starting deploy of {'config': True, 'force': True} to all [02:05:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:05:58] PROBLEM - mw152 Puppet on mw152 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [02:06:00] !log [void@mwtask181] finished deploy of {'config': True, 'force': True} to all - SUCCESS in 24s [02:06:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:06:32] PROBLEM - ping6 on cloud17 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 0.49 ms [02:06:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:06:57] RECOVERY - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is OK: OK - NGINX Error Rate is 21% [02:07:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:07:15] RECOVERY - ping6 on cloud18 is OK: PING OK - Packet loss = 0%, RTA = 0.31 ms [02:07:26] PROBLEM - ping6 on cloud20 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 0.49 ms [02:08:30] !log [void@mwtask181] repool db161 [02:08:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:09:26] PROBLEM - swiftproxy171 Check unit status of swift-container-stats_mw-media on swiftproxy171 is CRITICAL: CRITICAL: Status of the systemd unit swift-container-stats_mw-media [02:09:29] RECOVERY - ping6 on cloud20 is OK: PING OK - Packet loss = 0%, RTA = 0.44 ms [02:09:29] RECOVERY - ping6 on cloud21 is OK: PING OK - Packet loss = 0%, RTA = 0.44 ms [02:11:02] RECOVERY - ping6 on cloud16 is OK: PING OK - Packet loss = 0%, RTA = 0.44 ms [02:11:26] RECOVERY - swiftproxy171 Check unit status of swift-container-stats_mw-media on swiftproxy171 is OK: OK: Status of the systemd unit swift-container-stats_mw-media [02:12:37] RECOVERY - ping6 on cloud17 is OK: PING OK - Packet loss = 0%, RTA = 0.43 ms [02:13:35] PROBLEM - ping6 on cloud21 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 0.45 ms [02:15:58] RECOVERY - os201 Puppet on os201 is OK: OK: Puppet is currently enabled, last run 1 second ago with 0 failures [02:21:44] RECOVERY - mw191 Puppet on mw191 is OK: OK: Puppet is currently enabled, last run 9 seconds ago with 0 failures [02:22:35] PROBLEM - mw153 Puppet on mw153 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [02:23:34] RECOVERY - ping6 on cloud21 is OK: PING OK - Packet loss = 0%, RTA = 0.47 ms [02:23:47] PROBLEM - ping6 on cloud15 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 0.45 ms [02:24:11] PROBLEM - db161 Current Load on db161 is WARNING: LOAD WARNING - total load average: 2.03, 1.97, 10.86 [02:24:24] PROBLEM - ping6 on cloud16 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 0.44 ms [02:26:11] RECOVERY - db161 Current Load on db161 is OK: LOAD OK - total load average: 1.17, 1.65, 9.66 [02:27:45] RECOVERY - ping6 on cloud15 is OK: PING OK - Packet loss = 0%, RTA = 0.42 ms [02:28:07] !log [void@phorge171] bin/phd restart [02:28:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:28:41] RECOVERY - mw151 Puppet on mw151 is OK: OK: Puppet is currently enabled, last run 36 seconds ago with 0 failures [02:28:51] PROBLEM - mem191 Puppet on mem191 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [02:28:57] PROBLEM - ping6 on cloud17 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 0.42 ms [02:30:13] RECOVERY - puppet181 Check unit status of listdomains_github_push on puppet181 is OK: OK: Status of the systemd unit listdomains_github_push [02:30:21] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/f477da685747e2811eabf94613eafdf04825be56 [02:30:21] 02ssl/03main 07WikiTideBot 03f477da6 Bot: Auto-update domain lists [02:30:57] RECOVERY - ping6 on cloud17 is OK: PING OK - Packet loss = 0%, RTA = 0.44 ms [02:32:27] RECOVERY - ping6 on cloud16 is OK: PING OK - Packet loss = 0%, RTA = 0.46 ms [02:33:47] PROBLEM - ping6 on cloud15 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 0.44 ms [02:35:57] RECOVERY - mw152 Puppet on mw152 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [02:36:36] PROBLEM - ping6 on cloud19 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 0.48 ms [02:39:44] RECOVERY - ping6 on cloud15 is OK: PING OK - Packet loss = 0%, RTA = 0.50 ms [02:40:37] RECOVERY - ping6 on cloud19 is OK: PING OK - Packet loss = 0%, RTA = 0.48 ms [02:43:51] PROBLEM - mem161 Puppet on mem161 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [02:45:34] PROBLEM - phorge171 Puppet on phorge171 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[phd] [02:51:47] PROBLEM - ping6 on cloud16 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 0.40 ms [02:52:35] RECOVERY - mw153 Puppet on mw153 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [02:54:56] PROBLEM - ping6 on cloud19 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 0.40 ms [02:55:48] RECOVERY - ping6 on cloud16 is OK: PING OK - Packet loss = 0%, RTA = 0.41 ms [02:56:50] RECOVERY - mem191 Puppet on mem191 is OK: OK: Puppet is currently enabled, last run 56 seconds ago with 0 failures [02:56:55] RECOVERY - ping6 on cloud19 is OK: PING OK - Packet loss = 0%, RTA = 1.13 ms [03:05:35] RECOVERY - phorge171 Puppet on phorge171 is OK: OK: Puppet is currently enabled, last run 11 seconds ago with 0 failures [03:11:51] RECOVERY - mem161 Puppet on mem161 is OK: OK: Puppet is currently enabled, last run 24 seconds ago with 0 failures [03:32:17] !log [void@phorge171] destroy all diffusion repos (contributing to site breakage) [03:32:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:34:13] PROBLEM - puppet181 Check unit status of listdomains_github_push on puppet181 is CRITICAL: CRITICAL: Status of the systemd unit listdomains_github_push [04:00:13] RECOVERY - puppet181 Check unit status of listdomains_github_push on puppet181 is OK: OK: Status of the systemd unit listdomains_github_push [04:00:20] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/9eba6271d31a64388e305ddfc130094dcbe03cd0 [04:00:20] 02ssl/03main 07WikiTideBot 039eba627 Bot: Auto-update domain lists [06:00:20] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/e9360a93648277e5cae307113924490aeb1838cb [06:00:20] 02ssl/03main 07WikiTideBot 03e9360a9 Bot: Auto-update domain lists [07:20:45] [02mw-config] 07lihaohong6 opened pull request #6496: T15148: move entries to per-wiki settings and remove outdated ones (07miraheze:03main...07lihaohong6:03csp4) 13https://github.com/miraheze/mw-config/pull/6496 [07:21:47] miraheze/mw-config - lihaohong6 the build has errored. [07:24:23] miraheze/mw-config - lihaohong6 the build passed. [07:30:19] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/db95b8df8a03a9d9a2c4961cf0c41905d37ac0d9 [07:30:19] 02ssl/03main 07WikiTideBot 03db95b8d Bot: Auto-update domain lists [10:00:19] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/1e5e577893f1e870a325d7da637eff89cf90f252 [10:00:20] 02ssl/03main 07WikiTideBot 031e5e577 Bot: Auto-update domain lists [12:13:24] [02MatomoAnalytics] 07translatewiki pushed 1 new commit to 03main 13https://github.com/miraheze/MatomoAnalytics/commit/c5ba715cf997edf386856aaf9d8c1f59f1066075 [12:13:24] 02MatomoAnalytics/03main 07translatewiki.net 03c5ba715 Localisation updates from https://translatewiki.net. [12:13:25] [02CreateWiki] 07translatewiki pushed 1 new commit to 03main 13https://github.com/miraheze/CreateWiki/commit/021ce822e1c979c38ba9087c31fc20c60e122d16 [12:13:27] 02CreateWiki/03main 07translatewiki.net 03021ce82 Localisation updates from https://translatewiki.net. [12:13:29] [02WikiDiscover] 07translatewiki pushed 1 new commit to 03main 13https://github.com/miraheze/WikiDiscover/commit/a24238b16bfc344b8b3631b5b603691820100dbf [12:13:31] [02MirahezeMagic] 07translatewiki pushed 1 new commit to 03main 13https://github.com/miraheze/MirahezeMagic/commit/20b515ddab4f2c3547a1897aa2e8f37fc0d47674 [12:13:33] 02WikiDiscover/03main 07translatewiki.net 03a24238b Localisation updates from https://translatewiki.net. [12:13:34] 02MirahezeMagic/03main 07translatewiki.net 0320b515d Localisation updates from https://translatewiki.net. [12:17:33] miraheze/WikiDiscover - translatewiki the build passed. [12:18:03] miraheze/MatomoAnalytics - translatewiki the build passed. [12:19:45] miraheze/MirahezeMagic - translatewiki the build passed. [12:21:22] miraheze/CreateWiki - translatewiki the build passed. [12:36:13] PROBLEM - matomo151 Check unit status of matomo-archiver-1 on matomo151 is CRITICAL: CRITICAL: Status of the systemd unit matomo-archiver-1 [12:37:04] PROBLEM - matomo151 Check unit status of matomo-archiver-2 on matomo151 is CRITICAL: CRITICAL: Status of the systemd unit matomo-archiver-2 [12:37:20] PROBLEM - matomo151 Check unit status of matomo-archiver-3 on matomo151 is CRITICAL: CRITICAL: Status of the systemd unit matomo-archiver-3 [12:48:33] !log reboot mwtask161 [12:48:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:50:09] !log [rhinos@mwtask181] starting deploy of {'config': True} to all [12:50:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:50:33] !log [rhinos@mwtask181] finished deploy of {'config': True} to all - SUCCESS in 24s [12:50:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:03:17] [02puppet] 07paladox created 03paladox-patch-2 (+1 new commit) 13https://github.com/miraheze/puppet/commit/66b6ff95a2b1 [13:03:17] 02puppet/03paladox-patch-2 07paladox 0366b6ff9 phorge: Put DB into read-only [13:03:21] [02puppet] 07paladox opened pull request #4905: phorge: Put DB into read-only (03main...03paladox-patch-2) 13https://github.com/miraheze/puppet/pull/4905 [13:03:49] [02puppet] 07paladox merged pull request #4905: phorge: Put DB into read-only (03main...03paladox-patch-2) 13https://github.com/miraheze/puppet/pull/4905 [13:03:51] [02puppet] 07paladox pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/1780ac66de7e34e6140120ed1f233bc88b470568 [13:03:53] [02puppet] 07paladox 04deleted 03paladox-patch-2 at 0366b6ff9 13https://api.github.com/repos/miraheze/puppet/commit/66b6ff9 [13:03:55] 02puppet/03main 07paladox 031780ac6 phorge: Put DB into read-only (#4905) [13:06:48] !log Phorge to read only and stop phd; puppet is disabled on Phorge [13:06:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:07:26] PROBLEM - phorge171 Puppet on phorge171 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 2 minutes ago with 1 failures [14:10:03] PROBLEM - db182 Disk Space on db182 is WARNING: DISK WARNING - free space: / 58123MiB (9.8% inode=100%); [14:12:44] [02mw-config] 07dependabot[bot] added the label 'dependencies' to pull request #6497 (Update phpunit/phpunit requirement from 13.3.0 to 13.3.1) 13https://github.com/miraheze/mw-config/pull/6497 [14:13:57] miraheze/mw-config - dependabot[bot] the build passed. [14:39:48] [02mw-config] 07dependabot[bot] added the label 'dependencies' to pull request #6497 (Update phpunit/phpunit requirement from 13.3.0 to 13.3.1) 13https://github.com/miraheze/mw-config/pull/6497 [14:42:02] [02mw-config] 07dependabot[bot] added the label 'php' to pull request #6497 (Update phpunit/phpunit requirement from 13.3.0 to 13.3.1) 13https://github.com/miraheze/mw-config/pull/6497 [14:42:18] [02mw-config] 07dependabot[bot] opened pull request #6497: Update phpunit/phpunit requirement from 13.3.0 to 13.3.1 (03main...03dependabot/composer/phpunit/phpunit-13.3.1) 13https://github.com/miraheze/mw-config/pull/6497 [14:42:34] [02mw-config] 07dependabot[bot] created 03dependabot/composer/phpunit/phpunit-13.3.1 (+1 new commit) 13https://github.com/miraheze/mw-config/commit/057e5c0c31a8 [14:42:34] 02mw-config/03dependabot/composer/phpunit/phpunit-13.3.1 07dependabot[bot] 03057e5c0 Update phpunit/phpunit requirement from 13.3.0 to 13.3.1… [14:46:46] [02mw-config] 07dependabot[bot] added the label 'php' to pull request #6497 (Update phpunit/phpunit requirement from 13.3.0 to 13.3.1) 13https://github.com/miraheze/mw-config/pull/6497 [15:19:40] PROBLEM - mw202 Current Load on mw202 is CRITICAL: LOAD CRITICAL - total load average: 44.13, 25.56, 13.32 [15:21:40] RECOVERY - mw202 Current Load on mw202 is OK: LOAD OK - total load average: 12.33, 19.48, 12.57 [15:36:48] !log phorge RW and phd starting but incident still in progress [15:36:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:40:47] !log stop phd again [15:40:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:45:24] !log [rhinos@phorge171] sudo rm -rf /srv/phorge/repos/* [15:45:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:48:59] !log !log sudo -u www-data ./bin/repository update (rSSL|R11|rDNS|R6|rPUPC|R14) [15:49:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:53:46] [02puppet] 07RhinosF1 created 03revert-4905-paladox-patch-2 (+1 new commit) 13https://github.com/miraheze/puppet/commit/f7e2e9668df9 [15:53:48] 02puppet/03revert-4905-paladox-patch-2 07RhinosF1 03f7e2e96 Revert "phorge: Put DB into read-only (#4905)"… [15:53:51] [02puppet] 07RhinosF1 opened pull request #4906: Revert "phorge: Put DB into read-only" (03main...03revert-4905-paladox-patch-2) 13https://github.com/miraheze/puppet/pull/4906 [15:55:36] [02puppet] 07RhinosF1 merged 03revert-4905-paladox-patch-2 into 03main 13https://github.com/miraheze/puppet/compare/1780ac66de7e...f7e2e9668df9 [15:55:39] [02puppet] 07RhinosF1 merged pull request #4906: Revert "phorge: Put DB into read-only" (03main...03revert-4905-paladox-patch-2) 13https://github.com/miraheze/puppet/pull/4906 [15:55:39] [02puppet] 07RhinosF1 04deleted 03revert-4905-paladox-patch-2 at 03f7e2e96 13https://api.github.com/repos/miraheze/puppet/commit/f7e2e96 [15:56:03] RECOVERY - db182 Disk Space on db182 is OK: DISK OK - free space: / 149907MiB (25.3% inode=100%); [15:56:28] !log restart phd and resume puppet [15:56:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:57:26] RECOVERY - phorge171 Puppet on phorge171 is OK: OK: Puppet is currently enabled, last run 47 seconds ago with 0 failures [16:00:13] RECOVERY - matomo151 Check unit status of matomo-archiver-1 on matomo151 is OK: OK: Status of the systemd unit matomo-archiver-1 [16:00:20] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/1774ac42bfb954220d4b74eec14fdbd151b20011 [16:00:20] 02ssl/03main 07WikiTideBot 031774ac4 Bot: Auto-update domain lists [16:01:04] RECOVERY - matomo151 Check unit status of matomo-archiver-2 on matomo151 is OK: OK: Status of the systemd unit matomo-archiver-2 [16:03:20] RECOVERY - matomo151 Check unit status of matomo-archiver-3 on matomo151 is OK: OK: Status of the systemd unit matomo-archiver-3 [17:30:18] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/ab67ce3e73bb5657f1de462791f3e0115fa998aa [17:30:18] 02ssl/03main 07WikiTideBot 03ab67ce3 Bot: Auto-update domain lists [18:08:26] [02GlobalNewFiles] 07dependabot[bot] created 03dependabot/composer/mediawiki/mediawiki-codesniffer-52.0.1 (+1 new commit) 13https://github.com/miraheze/GlobalNewFiles/commit/42a893ecfe2c [18:08:26] 02GlobalNewFiles/03dependabot/composer/mediawiki/mediawiki-codesniffer-52.0.1 07dependabot[bot] 0342a893e Update mediawiki/mediawiki-codesniffer requirement from 52.0.0 to 52.0.1… [18:08:27] [02GlobalNewFiles] 07dependabot[bot] opened pull request #116: Update mediawiki/mediawiki-codesniffer requirement from 52.0.0 to 52.0.1 (03main...03dependabot/composer/mediawiki/mediawiki-codesniffer-52.0.1) 13https://github.com/miraheze/GlobalNewFiles/pull/116 [18:08:27] [02GlobalNewFiles] 07dependabot[bot] added the label 'dependencies' to pull request #116 (Update mediawiki/mediawiki-codesniffer requirement from 52.0.0 to 52.0.1) 13https://github.com/miraheze/GlobalNewFiles/pull/116 [18:08:29] [02GlobalNewFiles] 07dependabot[bot] added the label 'php' to pull request #116 (Update mediawiki/mediawiki-codesniffer requirement from 52.0.0 to 52.0.1) 13https://github.com/miraheze/GlobalNewFiles/pull/116 [18:12:58] miraheze/GlobalNewFiles - dependabot[bot] the build passed. [18:33:20] [02MatomoAnalytics] 07dependabot[bot] created 03dependabot/composer/mediawiki/mediawiki-codesniffer-52.0.1 (+1 new commit) 13https://github.com/miraheze/MatomoAnalytics/commit/a363e61ba21a [18:33:20] 02MatomoAnalytics/03dependabot/composer/mediawiki/mediawiki-codesniffer-52.0.1 07dependabot[bot] 03a363e61 Update mediawiki/mediawiki-codesniffer requirement from 52.0.0 to 52.0.1… [18:33:22] [02MatomoAnalytics] 07dependabot[bot] added the label 'php' to pull request #212 (Update mediawiki/mediawiki-codesniffer requirement from 52.0.0 to 52.0.1) 13https://github.com/miraheze/MatomoAnalytics/pull/212 [18:33:22] [02MatomoAnalytics] 07dependabot[bot] added the label 'dependencies' to pull request #212 (Update mediawiki/mediawiki-codesniffer requirement from 52.0.0 to 52.0.1) 13https://github.com/miraheze/MatomoAnalytics/pull/212 [18:33:24] [02MatomoAnalytics] 07dependabot[bot] opened pull request #212: Update mediawiki/mediawiki-codesniffer requirement from 52.0.0 to 52.0.1 (03main...03dependabot/composer/mediawiki/mediawiki-codesniffer-52.0.1) 13https://github.com/miraheze/MatomoAnalytics/pull/212 [18:33:26] [02MatomoAnalytics] 07dependabot[bot] added the label 'dependencies' to pull request #212 (Update mediawiki/mediawiki-codesniffer requirement from 52.0.0 to 52.0.1) 13https://github.com/miraheze/MatomoAnalytics/pull/212 [18:33:28] [02MatomoAnalytics] 07dependabot[bot] added the label 'php' to pull request #212 (Update mediawiki/mediawiki-codesniffer requirement from 52.0.0 to 52.0.1) 13https://github.com/miraheze/MatomoAnalytics/pull/212 [18:38:31] miraheze/MatomoAnalytics - dependabot[bot] the build passed. [18:58:12] [02ManageWiki] 07dependabot[bot] created 03dependabot/composer/mediawiki/mediawiki-codesniffer-52.0.1 (+1 new commit) 13https://github.com/miraheze/ManageWiki/commit/3ee493c5b299 [18:58:12] 02ManageWiki/03dependabot/composer/mediawiki/mediawiki-codesniffer-52.0.1 07dependabot[bot] 033ee493c Update mediawiki/mediawiki-codesniffer requirement from 52.0.0 to 52.0.1… [18:58:13] [02ManageWiki] 07dependabot[bot] added the label 'dependencies' to pull request #806 (Update mediawiki/mediawiki-codesniffer requirement from 52.0.0 to 52.0.1) 13https://github.com/miraheze/ManageWiki/pull/806 [18:58:13] [02ManageWiki] 07dependabot[bot] added the label 'php' to pull request #806 (Update mediawiki/mediawiki-codesniffer requirement from 52.0.0 to 52.0.1) 13https://github.com/miraheze/ManageWiki/pull/806 [18:58:15] [02ManageWiki] 07dependabot[bot] opened pull request #806: Update mediawiki/mediawiki-codesniffer requirement from 52.0.0 to 52.0.1 (03main...03dependabot/composer/mediawiki/mediawiki-codesniffer-52.0.1) 13https://github.com/miraheze/ManageWiki/pull/806 [18:58:17] [02ManageWiki] 07dependabot[bot] added the label 'dependencies' to pull request #806 (Update mediawiki/mediawiki-codesniffer requirement from 52.0.0 to 52.0.1) 13https://github.com/miraheze/ManageWiki/pull/806 [18:58:19] [02ManageWiki] 07dependabot[bot] added the label 'php' to pull request #806 (Update mediawiki/mediawiki-codesniffer requirement from 52.0.0 to 52.0.1) 13https://github.com/miraheze/ManageWiki/pull/806 [19:04:36] miraheze/ManageWiki - dependabot[bot] the build passed. [19:13:40] [02MirahezeRequests] 07dependabot[bot] created 03dependabot/composer/mediawiki/mediawiki-codesniffer-52.0.1 (+1 new commit) 13https://github.com/miraheze/MirahezeRequests/commit/7535b4678227 [19:13:40] 02MirahezeRequests/03dependabot/composer/mediawiki/mediawiki-codesniffer-52.0.1 07dependabot[bot] 037535b46 Update mediawiki/mediawiki-codesniffer requirement from 52.0.0 to 52.0.1… [19:13:41] [02MirahezeRequests] 07dependabot[bot] added the label 'dependencies' to pull request #12 (Update mediawiki/mediawiki-codesniffer requirement from 52.0.0 to 52.0.1) 13https://github.com/miraheze/MirahezeRequests/pull/12 [19:13:42] [02MirahezeRequests] 07dependabot[bot] added the label 'php' to pull request #12 (Update mediawiki/mediawiki-codesniffer requirement from 52.0.0 to 52.0.1) 13https://github.com/miraheze/MirahezeRequests/pull/12 [19:13:43] [02MirahezeRequests] 07dependabot[bot] opened pull request #12: Update mediawiki/mediawiki-codesniffer requirement from 52.0.0 to 52.0.1 (03main...03dependabot/composer/mediawiki/mediawiki-codesniffer-52.0.1) 13https://github.com/miraheze/MirahezeRequests/pull/12 [19:13:45] [02MirahezeRequests] 07dependabot[bot] added the label 'dependencies' to pull request #12 (Update mediawiki/mediawiki-codesniffer requirement from 52.0.0 to 52.0.1) 13https://github.com/miraheze/MirahezeRequests/pull/12 [19:13:47] [02MirahezeRequests] 07dependabot[bot] added the label 'php' to pull request #12 (Update mediawiki/mediawiki-codesniffer requirement from 52.0.0 to 52.0.1) 13https://github.com/miraheze/MirahezeRequests/pull/12 [19:16:19] miraheze/MirahezeRequests - dependabot[bot] the build has errored. [19:41:54] [02RottenLinks] 07dependabot[bot] created 03dependabot/composer/mediawiki/mediawiki-codesniffer-52.0.1 (+1 new commit) 13https://github.com/miraheze/RottenLinks/commit/c223d1b7d5f4 [19:41:54] 02RottenLinks/03dependabot/composer/mediawiki/mediawiki-codesniffer-52.0.1 07dependabot[bot] 03c223d1b Update mediawiki/mediawiki-codesniffer requirement from 52.0.0 to 52.0.1… [19:41:55] [02RottenLinks] 07dependabot[bot] added the label 'dependencies' to pull request #109 (Update mediawiki/mediawiki-codesniffer requirement from 52.0.0 to 52.0.1) 13https://github.com/miraheze/RottenLinks/pull/109 [19:41:55] [02RottenLinks] 07dependabot[bot] added the label 'php' to pull request #109 (Update mediawiki/mediawiki-codesniffer requirement from 52.0.0 to 52.0.1) 13https://github.com/miraheze/RottenLinks/pull/109 [19:41:57] [02RottenLinks] 07dependabot[bot] opened pull request #109: Update mediawiki/mediawiki-codesniffer requirement from 52.0.0 to 52.0.1 (03main...03dependabot/composer/mediawiki/mediawiki-codesniffer-52.0.1) 13https://github.com/miraheze/RottenLinks/pull/109 [19:41:59] [02RottenLinks] 07dependabot[bot] added the label 'dependencies' to pull request #109 (Update mediawiki/mediawiki-codesniffer requirement from 52.0.0 to 52.0.1) 13https://github.com/miraheze/RottenLinks/pull/109 [19:42:01] [02RottenLinks] 07dependabot[bot] added the label 'php' to pull request #109 (Update mediawiki/mediawiki-codesniffer requirement from 52.0.0 to 52.0.1) 13https://github.com/miraheze/RottenLinks/pull/109 [19:46:02] miraheze/RottenLinks - dependabot[bot] the build passed. [20:00:19] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/f10c9ba9a68b789647169c6fad71bb4248bfb91d [20:00:19] 02ssl/03main 07WikiTideBot 03f10c9ba Bot: Auto-update domain lists [21:13:04] [02MirahezeMagic] 07dependabot[bot] created 03dependabot/composer/mediawiki/mediawiki-codesniffer-52.0.1 (+1 new commit) 13https://github.com/miraheze/MirahezeMagic/commit/729aa6ba8354 [21:13:04] 02MirahezeMagic/03dependabot/composer/mediawiki/mediawiki-codesniffer-52.0.1 07dependabot[bot] 03729aa6b Update mediawiki/mediawiki-codesniffer requirement from 52.0.0 to 52.0.1… [21:13:05] [02MirahezeMagic] 07dependabot[bot] added the label 'dependencies' to pull request #664 (Update mediawiki/mediawiki-codesniffer requirement from 52.0.0 to 52.0.1) 13https://github.com/miraheze/MirahezeMagic/pull/664 [21:13:07] [02MirahezeMagic] 07dependabot[bot] opened pull request #664: Update mediawiki/mediawiki-codesniffer requirement from 52.0.0 to 52.0.1 (03main...03dependabot/composer/mediawiki/mediawiki-codesniffer-52.0.1) 13https://github.com/miraheze/MirahezeMagic/pull/664 [21:13:09] [02MirahezeMagic] 07dependabot[bot] added the label 'php' to pull request #664 (Update mediawiki/mediawiki-codesniffer requirement from 52.0.0 to 52.0.1) 13https://github.com/miraheze/MirahezeMagic/pull/664 [21:13:11] [02MirahezeMagic] 07dependabot[bot] added the label 'dependencies' to pull request #664 (Update mediawiki/mediawiki-codesniffer requirement from 52.0.0 to 52.0.1) 13https://github.com/miraheze/MirahezeMagic/pull/664 [21:13:13] [02MirahezeMagic] 07dependabot[bot] added the label 'php' to pull request #664 (Update mediawiki/mediawiki-codesniffer requirement from 52.0.0 to 52.0.1) 13https://github.com/miraheze/MirahezeMagic/pull/664 [21:18:53] miraheze/MirahezeMagic - dependabot[bot] the build passed. [21:22:28] [02DataDump] 07dependabot[bot] created 03dependabot/composer/mediawiki/mediawiki-codesniffer-52.0.1 (+1 new commit) 13https://github.com/miraheze/DataDump/commit/9f97aacf65e5 [21:22:28] 02DataDump/03dependabot/composer/mediawiki/mediawiki-codesniffer-52.0.1 07dependabot[bot] 039f97aac Update mediawiki/mediawiki-codesniffer requirement from 52.0.0 to 52.0.1… [21:22:29] [02DataDump] 07dependabot[bot] added the label 'dependencies' to pull request #126 (Update mediawiki/mediawiki-codesniffer requirement from 52.0.0 to 52.0.1) 13https://github.com/miraheze/DataDump/pull/126 [21:22:29] [02DataDump] 07dependabot[bot] added the label 'php' to pull request #126 (Update mediawiki/mediawiki-codesniffer requirement from 52.0.0 to 52.0.1) 13https://github.com/miraheze/DataDump/pull/126 [21:22:31] [02DataDump] 07dependabot[bot] opened pull request #126: Update mediawiki/mediawiki-codesniffer requirement from 52.0.0 to 52.0.1 (03main...03dependabot/composer/mediawiki/mediawiki-codesniffer-52.0.1) 13https://github.com/miraheze/DataDump/pull/126 [21:22:33] [02DataDump] 07dependabot[bot] added the label 'dependencies' to pull request #126 (Update mediawiki/mediawiki-codesniffer requirement from 52.0.0 to 52.0.1) 13https://github.com/miraheze/DataDump/pull/126 [21:22:35] [02DataDump] 07dependabot[bot] added the label 'php' to pull request #126 (Update mediawiki/mediawiki-codesniffer requirement from 52.0.0 to 52.0.1) 13https://github.com/miraheze/DataDump/pull/126 [21:32:48] [02WikiDiscover] 07dependabot[bot] created 03dependabot/composer/mediawiki/mediawiki-codesniffer-52.0.1 (+1 new commit) 13https://github.com/miraheze/WikiDiscover/commit/fa07a7a51246 [21:32:48] 02WikiDiscover/03dependabot/composer/mediawiki/mediawiki-codesniffer-52.0.1 07dependabot[bot] 03fa07a7a Update mediawiki/mediawiki-codesniffer requirement from 52.0.0 to 52.0.1… [21:32:49] [02WikiDiscover] 07dependabot[bot] added the label 'dependencies' to pull request #162 (Update mediawiki/mediawiki-codesniffer requirement from 52.0.0 to 52.0.1) 13https://github.com/miraheze/WikiDiscover/pull/162 [21:32:50] [02WikiDiscover] 07dependabot[bot] added the label 'php' to pull request #162 (Update mediawiki/mediawiki-codesniffer requirement from 52.0.0 to 52.0.1) 13https://github.com/miraheze/WikiDiscover/pull/162 [21:32:52] [02WikiDiscover] 07dependabot[bot] opened pull request #162: Update mediawiki/mediawiki-codesniffer requirement from 52.0.0 to 52.0.1 (03main...03dependabot/composer/mediawiki/mediawiki-codesniffer-52.0.1) 13https://github.com/miraheze/WikiDiscover/pull/162 [21:32:54] [02WikiDiscover] 07dependabot[bot] added the label 'dependencies' to pull request #162 (Update mediawiki/mediawiki-codesniffer requirement from 52.0.0 to 52.0.1) 13https://github.com/miraheze/WikiDiscover/pull/162 [21:32:56] [02WikiDiscover] 07dependabot[bot] added the label 'php' to pull request #162 (Update mediawiki/mediawiki-codesniffer requirement from 52.0.0 to 52.0.1) 13https://github.com/miraheze/WikiDiscover/pull/162 [21:37:13] miraheze/WikiDiscover - dependabot[bot] the build passed. [22:13:05] [02CreateWiki] 07dependabot[bot] created 03dependabot/composer/mediawiki/mediawiki-codesniffer-52.0.1 (+1 new commit) 13https://github.com/miraheze/CreateWiki/commit/0e46dea1ca3f [22:13:05] 02CreateWiki/03dependabot/composer/mediawiki/mediawiki-codesniffer-52.0.1 07dependabot[bot] 030e46dea Update mediawiki/mediawiki-codesniffer requirement from 52.0.0 to 52.0.1… [22:13:06] [02CreateWiki] 07dependabot[bot] opened pull request #847: Update mediawiki/mediawiki-codesniffer requirement from 52.0.0 to 52.0.1 (03main...03dependabot/composer/mediawiki/mediawiki-codesniffer-52.0.1) 13https://github.com/miraheze/CreateWiki/pull/847 [22:13:06] [02CreateWiki] 07dependabot[bot] added the label 'dependencies' to pull request #847 (Update mediawiki/mediawiki-codesniffer requirement from 52.0.0 to 52.0.1) 13https://github.com/miraheze/CreateWiki/pull/847 [22:13:08] [02CreateWiki] 07dependabot[bot] added the label 'php' to pull request #847 (Update mediawiki/mediawiki-codesniffer requirement from 52.0.0 to 52.0.1) 13https://github.com/miraheze/CreateWiki/pull/847 [22:13:11] [02CreateWiki] 07dependabot[bot] added the label 'dependencies' to pull request #847 (Update mediawiki/mediawiki-codesniffer requirement from 52.0.0 to 52.0.1) 13https://github.com/miraheze/CreateWiki/pull/847 [22:13:12] [02CreateWiki] 07dependabot[bot] added the label 'php' to pull request #847 (Update mediawiki/mediawiki-codesniffer requirement from 52.0.0 to 52.0.1) 13https://github.com/miraheze/CreateWiki/pull/847 [22:20:50] miraheze/CreateWiki - dependabot[bot] the build passed. [22:42:28] [02IncidentReporting] 07dependabot[bot] created 03dependabot/composer/mediawiki/mediawiki-codesniffer-52.0.1 (+1 new commit) 13https://github.com/miraheze/IncidentReporting/commit/2fa874a1ede1 [22:42:28] 02IncidentReporting/03dependabot/composer/mediawiki/mediawiki-codesniffer-52.0.1 07dependabot[bot] 032fa874a Update mediawiki/mediawiki-codesniffer requirement from 52.0.0 to 52.0.1… [22:42:29] [02IncidentReporting] 07dependabot[bot] added the label 'dependencies' to pull request #130 (Update mediawiki/mediawiki-codesniffer requirement from 52.0.0 to 52.0.1) 13https://github.com/miraheze/IncidentReporting/pull/130 [22:42:29] [02IncidentReporting] 07dependabot[bot] added the label 'php' to pull request #130 (Update mediawiki/mediawiki-codesniffer requirement from 52.0.0 to 52.0.1) 13https://github.com/miraheze/IncidentReporting/pull/130 [22:42:31] [02IncidentReporting] 07dependabot[bot] opened pull request #130: Update mediawiki/mediawiki-codesniffer requirement from 52.0.0 to 52.0.1 (03main...03dependabot/composer/mediawiki/mediawiki-codesniffer-52.0.1) 13https://github.com/miraheze/IncidentReporting/pull/130 [22:42:33] [02IncidentReporting] 07dependabot[bot] added the label 'dependencies' to pull request #130 (Update mediawiki/mediawiki-codesniffer requirement from 52.0.0 to 52.0.1) 13https://github.com/miraheze/IncidentReporting/pull/130 [22:42:35] [02IncidentReporting] 07dependabot[bot] added the label 'php' to pull request #130 (Update mediawiki/mediawiki-codesniffer requirement from 52.0.0 to 52.0.1) 13https://github.com/miraheze/IncidentReporting/pull/130 [22:46:28] miraheze/IncidentReporting - dependabot[bot] the build passed. [23:30:16] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/8921f774fa30c718d410c6563aef0cf8552a3f41 [23:30:17] 02ssl/03main 07WikiTideBot 038921f77 Bot: Auto-update domain lists [23:45:40] PROBLEM - ping6 on cloud21 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 0.35 ms [23:47:42] RECOVERY - ping6 on cloud21 is OK: PING OK - Packet loss = 0%, RTA = 0.35 ms