[00:00:58] [02statichelp] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/statichelp/commit/743bb3315e6377b4cd74223e2df74d7b6d5bd369 [00:00:58] 02statichelp/03main 07WikiTideBot 03743bb33 Bot: Auto-update Tech namespace pages 2026-08-06 00:00:55 [02:33:14] PROBLEM - ping6 on cloud20 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 0.38 ms [02:35:14] RECOVERY - ping6 on cloud20 is OK: PING OK - Packet loss = 0%, RTA = 0.34 ms [07:00:20] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/8a15d612589be2853f5bd57e44f9c3f6a1eb1ce9 [07:00:21] 02ssl/03main 07WikiTideBot 038a15d61 Bot: Auto-update domain lists [09:38:05] PROBLEM - prometheus151 APT on prometheus151 is CRITICAL: APT CRITICAL: 88 packages available for upgrade (1 critical updates). [09:38:05] PROBLEM - mem201 APT on mem201 is CRITICAL: APT CRITICAL: 83 packages available for upgrade (1 critical updates). [09:38:42] PROBLEM - cloud17 APT on cloud17 is CRITICAL: APT CRITICAL: 148 packages available for upgrade (1 critical updates). [09:38:43] PROBLEM - matomo151 APT on matomo151 is CRITICAL: APT CRITICAL: 86 packages available for upgrade (1 critical updates). [09:38:50] PROBLEM - cp201 APT on cp201 is CRITICAL: APT CRITICAL: 86 packages available for upgrade (1 critical updates). [09:40:01] PROBLEM - db172 APT on db172 is CRITICAL: APT CRITICAL: 95 packages available for upgrade (1 critical updates). [09:40:14] PROBLEM - mw202 APT on mw202 is CRITICAL: APT CRITICAL: 143 packages available for upgrade (1 critical updates). [09:40:17] PROBLEM - swiftproxy161 APT on swiftproxy161 is CRITICAL: APT CRITICAL: 97 packages available for upgrade (1 critical updates). [09:40:22] PROBLEM - mw161 APT on mw161 is CRITICAL: APT CRITICAL: 143 packages available for upgrade (1 critical updates). [09:41:12] PROBLEM - swiftproxy171 APT on swiftproxy171 is CRITICAL: APT CRITICAL: 97 packages available for upgrade (1 critical updates). [09:42:14] PROBLEM - mw172 APT on mw172 is CRITICAL: APT CRITICAL: 143 packages available for upgrade (1 critical updates). [09:42:15] PROBLEM - mwtask171 APT on mwtask171 is CRITICAL: APT CRITICAL: 149 packages available for upgrade (1 critical updates). [09:42:24] PROBLEM - cp171 APT on cp171 is CRITICAL: APT CRITICAL: 87 packages available for upgrade (1 critical updates). [09:42:56] PROBLEM - mw203 APT on mw203 is CRITICAL: APT CRITICAL: 143 packages available for upgrade (1 critical updates). [09:44:04] PROBLEM - llm191 APT on llm191 is CRITICAL: APT CRITICAL: 98 packages available for upgrade (1 critical updates). [09:44:06] PROBLEM - mem161 APT on mem161 is CRITICAL: APT CRITICAL: 84 packages available for upgrade (1 critical updates). [09:44:08] PROBLEM - mwtask161 APT on mwtask161 is CRITICAL: APT CRITICAL: 148 packages available for upgrade (1 critical updates). [09:44:27] PROBLEM - swiftobject191 APT on swiftobject191 is CRITICAL: APT CRITICAL: 102 packages available for upgrade (1 critical updates). [09:44:28] PROBLEM - puppet181 APT on puppet181 is CRITICAL: APT CRITICAL: 41 packages available for upgrade (1 critical updates). [09:44:29] PROBLEM - bast161 APT on bast161 is CRITICAL: APT CRITICAL: 92 packages available for upgrade (1 critical updates). [09:44:43] PROBLEM - swiftobject201 APT on swiftobject201 is CRITICAL: APT CRITICAL: 102 packages available for upgrade (1 critical updates). [09:44:45] PROBLEM - phorge171 APT on phorge171 is CRITICAL: APT CRITICAL: 87 packages available for upgrade (1 critical updates). [09:44:55] PROBLEM - mw173 APT on mw173 is CRITICAL: APT CRITICAL: 143 packages available for upgrade (1 critical updates). [09:45:47] PROBLEM - swiftobject181 APT on swiftobject181 is CRITICAL: APT CRITICAL: 102 packages available for upgrade (1 critical updates). [09:46:05] PROBLEM - mwtask151 APT on mwtask151 is CRITICAL: APT CRITICAL: 148 packages available for upgrade (1 critical updates). [09:46:39] PROBLEM - db161 APT on db161 is CRITICAL: APT CRITICAL: 94 packages available for upgrade (1 critical updates). [09:46:47] PROBLEM - swiftac171 APT on swiftac171 is CRITICAL: APT CRITICAL: 97 packages available for upgrade (1 critical updates). [09:47:44] PROBLEM - os201 APT on os201 is CRITICAL: APT CRITICAL: 90 packages available for upgrade (1 critical updates). [09:48:27] PROBLEM - cloud15 APT on cloud15 is CRITICAL: APT CRITICAL: 154 packages available for upgrade (1 critical updates). [09:49:15] PROBLEM - mem151 APT on mem151 is CRITICAL: APT CRITICAL: 84 packages available for upgrade (1 critical updates). [09:49:37] PROBLEM - mw193 APT on mw193 is CRITICAL: APT CRITICAL: 143 packages available for upgrade (1 critical updates). [09:50:58] PROBLEM - db171 APT on db171 is CRITICAL: APT CRITICAL: 95 packages available for upgrade (1 critical updates). [09:51:14] PROBLEM - os151 APT on os151 is CRITICAL: APT CRITICAL: 91 packages available for upgrade (1 critical updates). [09:52:17] PROBLEM - mw171 APT on mw171 is CRITICAL: APT CRITICAL: 143 packages available for upgrade (1 critical updates). [09:53:11] PROBLEM - mw153 APT on mw153 is CRITICAL: APT CRITICAL: 143 packages available for upgrade (1 critical updates). [09:53:58] PROBLEM - mw191 APT on mw191 is CRITICAL: APT CRITICAL: 143 packages available for upgrade (1 critical updates). [09:54:41] PROBLEM - db182 APT on db182 is CRITICAL: APT CRITICAL: 101 packages available for upgrade (1 critical updates). [09:55:11] PROBLEM - cloud19 APT on cloud19 is CRITICAL: APT CRITICAL: 154 packages available for upgrade (1 critical updates). [09:57:00] PROBLEM - mw192 APT on mw192 is CRITICAL: APT CRITICAL: 143 packages available for upgrade (1 critical updates). [09:57:41] PROBLEM - cp161 APT on cp161 is CRITICAL: APT CRITICAL: 86 packages available for upgrade (1 critical updates). [09:57:58] PROBLEM - bots171 APT on bots171 is CRITICAL: APT CRITICAL: 99 packages available for upgrade (1 critical updates). [09:58:04] PROBLEM - cp191 APT on cp191 is CRITICAL: APT CRITICAL: 86 packages available for upgrade (1 critical updates). [09:58:20] PROBLEM - os162 APT on os162 is CRITICAL: APT CRITICAL: 91 packages available for upgrade (1 critical updates). [09:58:24] PROBLEM - swiftobject171 APT on swiftobject171 is CRITICAL: APT CRITICAL: 101 packages available for upgrade (1 critical updates). [09:58:44] PROBLEM - mw151 APT on mw151 is CRITICAL: APT CRITICAL: 143 packages available for upgrade (1 critical updates). [09:59:11] PROBLEM - os202 APT on os202 is CRITICAL: APT CRITICAL: 96 packages available for upgrade (1 critical updates). [09:59:18] PROBLEM - mem191 APT on mem191 is CRITICAL: APT CRITICAL: 83 packages available for upgrade (1 critical updates). [10:00:07] PROBLEM - db181 APT on db181 is CRITICAL: APT CRITICAL: 95 packages available for upgrade (1 critical updates). [10:00:26] PROBLEM - mw163 APT on mw163 is CRITICAL: APT CRITICAL: 143 packages available for upgrade (1 critical updates). [10:01:53] PROBLEM - db151 APT on db151 is CRITICAL: APT CRITICAL: 95 packages available for upgrade (1 critical updates). [10:02:09] PROBLEM - cloud18 APT on cloud18 is CRITICAL: APT CRITICAL: 148 packages available for upgrade (1 critical updates). [10:02:09] PROBLEM - os191 APT on os191 is CRITICAL: APT CRITICAL: 90 packages available for upgrade (1 critical updates). [10:02:42] PROBLEM - test151 APT on test151 is CRITICAL: APT CRITICAL: 150 packages available for upgrade (1 critical updates). [10:02:52] PROBLEM - reports171 APT on reports171 is CRITICAL: APT CRITICAL: 88 packages available for upgrade (1 critical updates). [10:03:09] PROBLEM - graylog161 APT on graylog161 is CRITICAL: APT CRITICAL: 94 packages available for upgrade (1 critical updates). [10:03:10] PROBLEM - swiftobject151 APT on swiftobject151 is CRITICAL: APT CRITICAL: 101 packages available for upgrade (1 critical updates). [10:03:32] PROBLEM - os161 APT on os161 is CRITICAL: APT CRITICAL: 91 packages available for upgrade (1 critical updates). [10:03:42] PROBLEM - mw181 APT on mw181 is CRITICAL: APT CRITICAL: 143 packages available for upgrade (1 critical updates). [10:04:01] PROBLEM - mw201 APT on mw201 is CRITICAL: APT CRITICAL: 143 packages available for upgrade (1 critical updates). [10:04:33] PROBLEM - swiftobject161 APT on swiftobject161 is CRITICAL: APT CRITICAL: 101 packages available for upgrade (1 critical updates). [10:05:03] PROBLEM - mwtask181 APT on mwtask181 is CRITICAL: APT CRITICAL: 150 packages available for upgrade (1 critical updates). [10:05:22] PROBLEM - cloud16 APT on cloud16 is CRITICAL: APT CRITICAL: 148 packages available for upgrade (1 critical updates). [10:05:23] PROBLEM - ldap171 APT on ldap171 is CRITICAL: APT CRITICAL: 84 packages available for upgrade (1 critical updates). [10:05:40] PROBLEM - cloud20 APT on cloud20 is CRITICAL: APT CRITICAL: 154 packages available for upgrade (1 critical updates). [10:05:41] PROBLEM - mon181 APT on mon181 is CRITICAL: APT CRITICAL: 54 packages available for upgrade (1 critical updates). [10:05:50] PROBLEM - mw183 APT on mw183 is CRITICAL: APT CRITICAL: 143 packages available for upgrade (1 critical updates). [10:05:54] PROBLEM - bast181 APT on bast181 is CRITICAL: APT CRITICAL: 93 packages available for upgrade (1 critical updates). [10:07:20] PROBLEM - mw152 APT on mw152 is CRITICAL: APT CRITICAL: 143 packages available for upgrade (1 critical updates). [10:10:09] PROBLEM - mw162 APT on mw162 is CRITICAL: APT CRITICAL: 143 packages available for upgrade (1 critical updates). [10:10:12] PROBLEM - mw182 APT on mw182 is CRITICAL: APT CRITICAL: 143 packages available for upgrade (1 critical updates). [12:13:41] [02MatomoAnalytics] 07translatewiki pushed 1 new commit to 03main 13https://github.com/miraheze/MatomoAnalytics/commit/5ce164de447198c3bb9aa7906d7c25a95adb4052 [12:13:41] 02MatomoAnalytics/03main 07translatewiki.net 035ce164d Localisation updates from https://translatewiki.net. [12:14:04] !log [wwr@mwtask171] sudo -u www-data php /srv/mediawiki/1.45/maintenance/run.php namespaceDupes --wiki=pokefieldswiki --add-suffix='_(old)' --fix (END - exit=0) [12:14:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:15:46] miraheze/MatomoAnalytics - translatewiki the build has errored. [12:26:08] [02mw-config] 07Slyhi opened pull request #6484: Change custom footer badges for lectvswiki and blocktaleswiki (07miraheze:03main...07Slyhi:03myfooterbadge) 13https://github.com/miraheze/mw-config/pull/6484 [13:30:22] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/3f74a8838942f3c61721e51c2877e627ad7aa74b [13:30:24] 02ssl/03main 07WikiTideBot 033f74a88 Bot: Auto-update domain lists [14:30:23] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/af7742ccbc9b4708f90859dc516c0bfeacafd74c [14:30:23] 02ssl/03main 07WikiTideBot 03af7742c Bot: Auto-update domain lists [14:34:32] [02mw-config] 07YTFGolf left a file comment in pull request #6479 03b513ec8: please indent using tabs 13https://github.com/miraheze/mw-config/pull/6479#discussion_r3729709918 [14:38:24] [02mw-config] 07YTFGolf approved pull request #6482 13https://github.com/miraheze/mw-config/pull/6482#pullrequestreview-4875833991 [14:45:49] !log [wwr@test151] starting deploy of {'pull': 'config', 'config': True} to test151 [14:45:52] !log [wwr@test151] finished deploy of {'pull': 'config', 'config': True} to test151 - SUCCESS in 3s [14:45:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:45:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:46:44] !log [wwr@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all [14:47:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:47:23] !log [wwr@mwtask181] DEPLOY ABORTED: Canary check failed for publictestwiki.com@mw161 [14:47:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:50:15] see mm for details [14:51:41] !log [wwr@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all [14:51:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:52:05] !log [wwr@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 24s [14:52:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:57:34] [02mw-config] 07YTFGolf requested changes on pull request #6484 13https://github.com/miraheze/mw-config/pull/6484#pullrequestreview-4876015094 [14:57:34] [02mw-config] 07YTFGolf left a file comment in pull request #6484 037b7d5bf: these width and height are the defaults so you can just remove these lines 13https://github.com/miraheze/mw-config/pull/6484#discussion_r3729893158 [14:57:35] [02mw-config] 07YTFGolf left a file comment in pull request #6484 037b7d5bf: This is an svg with a transparent background so specifying width is meaningless. 13https://github.com/miraheze/mw-config/pull/6484#discussion_r3729889327 [15:05:52] [02mw-config] 07slyhi left a file comment in pull request #6484 037b7d5bf: Okay 👍. Please wait a bit before I update the footer badges to the new version. 13https://github.com/miraheze/mw-config/pull/6484#discussion_r3729955711 [15:43:27] PROBLEM - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is CRITICAL: CRITICAL - NGINX Error Rate is 89% [15:49:27] RECOVERY - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is OK: OK - NGINX Error Rate is 24% [16:00:25] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/6ea6887bc586d20fb4d5d1d31422769ed5e36bb5 [16:00:25] 02ssl/03main 07WikiTideBot 036ea6887 Bot: Auto-update domain lists [16:49:30] [02python-functions] 07renovate[bot] created 03renovate/all-deps (+1 new commit) 13https://github.com/miraheze/python-functions/commit/a4b6a9de9b7e [16:49:30] 02python-functions/03renovate/all-deps 07renovate[bot] 03a4b6a9d chore(deps): update dependency coverage to v7.15.4 [17:30:27] PROBLEM - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is CRITICAL: CRITICAL - NGINX Error Rate is 85% [17:38:27] RECOVERY - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is OK: OK - NGINX Error Rate is 34% [17:54:28] [02mw-config] 07slyhi commented on pull request #6484: Okay I have finished the SVG. 13https://github.com/miraheze/mw-config/pull/6484#issuecomment-5207991595 [18:02:17] PROBLEM - ns2 APT on ns2 is CRITICAL: APT CRITICAL: 92 packages available for upgrade (1 critical updates). [18:03:10] PROBLEM - eventgate182 APT on eventgate182 is CRITICAL: APT CRITICAL: 94 packages available for upgrade (1 critical updates). [18:04:47] PROBLEM - db192 APT on db192 is CRITICAL: APT CRITICAL: 106 packages available for upgrade (1 critical updates). [18:06:15] PROBLEM - swiftobject211 APT on swiftobject211 is CRITICAL: APT CRITICAL: 91 packages available for upgrade (1 critical updates). [18:08:15] PROBLEM - mattermost2 APT on mattermost2 is CRITICAL: APT CRITICAL: 86 packages available for upgrade (1 critical updates). [18:08:41] PROBLEM - changeprop202 APT on changeprop202 is CRITICAL: APT CRITICAL: 94 packages available for upgrade (1 critical updates). [18:11:32] PROBLEM - rdb191 APT on rdb191 is CRITICAL: APT CRITICAL: 86 packages available for upgrade (1 critical updates). [18:18:40] PROBLEM - ns1 APT on ns1 is CRITICAL: APT CRITICAL: 86 packages available for upgrade (1 critical updates). [18:22:20] PROBLEM - db201 APT on db201 is CRITICAL: APT CRITICAL: 106 packages available for upgrade (1 critical updates). [18:22:37] PROBLEM - cloud21 APT on cloud21 is CRITICAL: APT CRITICAL: 148 packages available for upgrade (3 critical updates). [18:22:52] PROBLEM - kafka182 APT on kafka182 is CRITICAL: APT CRITICAL: 96 packages available for upgrade (1 critical updates). [18:30:22] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/a84621c2eb7413069f20f5446af3267ff7ca0651 [18:30:22] 02ssl/03main 07WikiTideBot 03a84621c Bot: Auto-update domain lists [18:43:45] PROBLEM - bast161 Current Load on bast161 is CRITICAL: LOAD CRITICAL - total load average: 8.98, 4.59, 1.95 [18:47:44] RECOVERY - bast161 Current Load on bast161 is OK: LOAD OK - total load average: 0.43, 2.89, 1.94 [19:19:10] !log [void@puppet181] Upgraded packages on bast161: linux-libc-dev and libde265-0 [19:19:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:20:50] RECOVERY - bast161 APT on bast161 is OK: APT OK: 91 packages available for upgrade (0 critical updates). [19:24:12] !log [void@puppet181] Upgraded packages on cloud21: linux-libc-dev, libcpupower1, and linux-cpupower [19:24:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:24:27] !log [void@puppet181] Upgraded packages on cp161: linux-libc-dev and libde265-0 [19:24:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:24:48] RECOVERY - cloud21 APT on cloud21 is OK: APT OK: 145 packages available for upgrade (0 critical updates). [19:25:06] RECOVERY - cp161 APT on cp161 is OK: APT OK: 85 packages available for upgrade (0 critical updates). [19:27:26] !log [void@puppet181] Upgraded packages on bots171: linux-libc-dev and libde265-0 [19:27:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:27:42] !log [void@puppet181] Upgraded packages on db151: linux-libc-dev and libde265-0 [19:27:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:27:50] RECOVERY - db151 APT on db151 is OK: APT OK: 94 packages available for upgrade (0 critical updates). [19:27:56] !log [void@puppet181] Upgraded packages on db172: linux-libc-dev and libde265-0 [19:28:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:28:11] !log [void@puppet181] Upgraded packages on cp191: linux-libc-dev and libde265-0 [19:28:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:28:26] !log [void@puppet181] Upgraded packages on db161: linux-libc-dev and libde265-0 [19:28:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:28:38] RECOVERY - db172 APT on db172 is OK: APT OK: 94 packages available for upgrade (0 critical updates). [19:28:53] RECOVERY - bots171 APT on bots171 is OK: APT OK: 98 packages available for upgrade (0 critical updates). [19:29:39] !log [void@puppet181] Upgraded packages on cloud15: linux-libc-dev, libcpupower1, libde265-0, and linux-cpupower [19:29:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:29:55] RECOVERY - cp191 APT on cp191 is OK: APT OK: 85 packages available for upgrade (0 critical updates). [19:30:04] RECOVERY - cloud15 APT on cloud15 is OK: APT OK: 153 packages available for upgrade (0 critical updates). [19:30:18] RECOVERY - db161 APT on db161 is OK: APT OK: 93 packages available for upgrade (0 critical updates). [19:32:39] PROBLEM - puppet181 Check unit status of listdomains_github_push on puppet181 is CRITICAL: CRITICAL: Status of the systemd unit listdomains_github_push [19:32:41] PROBLEM - mw202 HTTPS on mw202 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/2 502 [19:32:42] !log [void@puppet181] Upgraded packages on cloud18: linux-libc-dev, libcpupower1, libde265-0, and linux-cpupower [19:32:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:33:01] PROBLEM - mw202 PowerDNS Recursor on mw202 is CRITICAL: CRITICAL - Plugin timed out while executing system call [19:33:01] !log [void@puppet181] Upgraded packages on changeprop202: linux-libc-dev [19:33:02] PROBLEM - mw202 MediaWiki Rendering on mw202 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 5857 bytes in 6.342 second response time [19:33:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:33:30] PROBLEM - mw202 Current Load on mw202 is CRITICAL: LOAD CRITICAL - total load average: 47.02, 27.95, 13.88 [19:33:57] !log [void@puppet181] Upgraded packages on db171: linux-libc-dev and libde265-0 [19:34:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:34:13] !log [void@puppet181] Upgraded packages on cp171: linux-libc-dev and libde265-0 [19:34:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:34:25] RECOVERY - db171 APT on db171 is OK: APT OK: 94 packages available for upgrade (0 critical updates). [19:34:27] RECOVERY - cloud18 APT on cloud18 is OK: APT OK: 147 packages available for upgrade (0 critical updates). [19:34:31] RECOVERY - changeprop202 APT on changeprop202 is OK: APT OK: 93 packages available for upgrade (0 critical updates). [19:34:32] !log [void@puppet181] Upgraded packages on cloud16: linux-libc-dev, libcpupower1, libde265-0, and linux-cpupower [19:34:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:34:39] RECOVERY - mw202 HTTPS on mw202 is OK: HTTP OK: HTTP/2 410 - Status line output matched "HTTP/2 410" - 340 bytes in 0.088 second response time [19:34:45] RECOVERY - cloud16 APT on cloud16 is OK: APT OK: 147 packages available for upgrade (0 critical updates). [19:34:47] RECOVERY - cp171 APT on cp171 is OK: APT OK: 86 packages available for upgrade (0 critical updates). [19:34:50] !log [void@puppet181] Upgraded packages on cloud20: linux-libc-dev, libcpupower1, libde265-0, and linux-cpupower [19:34:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:34:58] RECOVERY - mw202 PowerDNS Recursor on mw202 is OK: DNS OK: 0.212 seconds response time. mw202.fsslc.wtnet returns 10.0.20.163 [19:34:59] RECOVERY - mw202 MediaWiki Rendering on mw202 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.282 second response time [19:35:15] !log [void@puppet181] Upgraded packages on cloud19: linux-libc-dev, libcpupower1, libde265-0, and linux-cpupower [19:35:17] RECOVERY - cloud20 APT on cloud20 is OK: APT OK: 153 packages available for upgrade (0 critical updates). [19:35:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:35:29] RECOVERY - cloud19 APT on cloud19 is OK: APT OK: 153 packages available for upgrade (0 critical updates). [19:35:29] RECOVERY - mw202 Current Load on mw202 is OK: LOAD OK - total load average: 10.99, 20.38, 12.80 [19:36:47] !log [void@puppet181] Upgraded packages on bast181: linux-libc-dev and libde265-0 [19:36:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:37:04] !log [void@puppet181] Upgraded packages on cloud17: linux-libc-dev, libcpupower1, libde265-0, and linux-cpupower [19:37:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:37:18] RECOVERY - bast181 APT on bast181 is OK: APT OK: 92 packages available for upgrade (0 critical updates). [19:37:37] RECOVERY - cloud17 APT on cloud17 is OK: APT OK: 147 packages available for upgrade (0 critical updates). [19:37:44] !log [void@puppet181] Upgraded packages on graylog161: linux-libc-dev and libde265-0 [19:37:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:38:01] !log [void@puppet181] Upgraded packages on db182: linux-libc-dev and libde265-0 [19:38:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:38:17] !log [void@puppet181] Upgraded packages on db181: linux-libc-dev and libde265-0 [19:38:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:38:36] !log [void@puppet181] Upgraded packages on db201: linux-libc-dev [19:38:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:38:54] RECOVERY - graylog161 APT on graylog161 is OK: APT OK: 93 packages available for upgrade (0 critical updates). [19:38:55] RECOVERY - db201 APT on db201 is OK: APT OK: 105 packages available for upgrade (0 critical updates). [19:38:56] !log [void@puppet181] Upgraded packages on db192: linux-libc-dev [19:38:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:39:31] RECOVERY - db182 APT on db182 is OK: APT OK: 100 packages available for upgrade (0 critical updates). [19:39:48] RECOVERY - db192 APT on db192 is OK: APT OK: 105 packages available for upgrade (0 critical updates). [19:40:11] RECOVERY - db181 APT on db181 is OK: APT OK: 94 packages available for upgrade (0 critical updates). [19:43:16] !log [void@puppet181] Upgraded packages on cp201: linux-libc-dev and libde265-0 [19:43:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:43:32] !log [void@puppet181] Upgraded packages on eventgate182: linux-libc-dev [19:43:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:43:42] RECOVERY - cp201 APT on cp201 is OK: APT OK: 85 packages available for upgrade (0 critical updates). [19:43:43] !log [void@puppet181] Upgraded packages on mattermost2: linux-libc-dev [19:43:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:43:58] !log [void@puppet181] Upgraded packages on matomo151: linux-libc-dev and libde265-0 [19:44:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:44:13] !log [void@puppet181] Upgraded packages on ldap171: linux-libc-dev and libde265-0 [19:44:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:44:24] RECOVERY - ldap171 APT on ldap171 is OK: APT OK: 83 packages available for upgrade (0 critical updates). [19:44:28] !log [void@puppet181] Upgraded packages on mem161: linux-libc-dev and libde265-0 [19:44:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:44:48] !log [void@puppet181] Upgraded packages on kafka182: linux-libc-dev [19:44:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:45:03] !log [void@puppet181] Upgraded packages on mem151: linux-libc-dev and libde265-0 [19:45:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:45:19] RECOVERY - eventgate182 APT on eventgate182 is OK: APT OK: 93 packages available for upgrade (0 critical updates). [19:45:20] RECOVERY - matomo151 APT on matomo151 is OK: APT OK: 85 packages available for upgrade (0 critical updates). [19:45:39] RECOVERY - mem161 APT on mem161 is OK: APT OK: 83 packages available for upgrade (0 critical updates). [19:45:39] RECOVERY - mattermost2 APT on mattermost2 is OK: APT OK: 85 packages available for upgrade (0 critical updates). [19:46:13] RECOVERY - kafka182 APT on kafka182 is OK: APT OK: 95 packages available for upgrade (0 critical updates). [19:46:45] RECOVERY - mem151 APT on mem151 is OK: APT OK: 83 packages available for upgrade (0 critical updates). [19:48:08] !log [void@puppet181] Upgraded packages on mem201: linux-libc-dev and libde265-0 [19:48:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:48:25] !log [void@puppet181] Upgraded packages on llm191: linux-libc-dev and libde265-0 [19:48:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:48:43] !log [void@puppet181] Upgraded packages on mw151: linux-libc-dev and libde265-0 [19:48:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:48:58] !log [void@puppet181] Upgraded packages on mem191: linux-libc-dev and libde265-0 [19:49:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:49:03] RECOVERY - mem201 APT on mem201 is OK: APT OK: 82 packages available for upgrade (0 critical updates). [19:49:03] RECOVERY - mw151 APT on mw151 is OK: APT OK: 142 packages available for upgrade (0 critical updates). [19:49:11] RECOVERY - llm191 APT on llm191 is OK: APT OK: 97 packages available for upgrade (0 critical updates). [19:49:14] !log [void@puppet181] Upgraded packages on mon181: libde265-0 and linux-libc-dev [19:49:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:49:33] !log [void@puppet181] Upgraded packages on mw152: linux-libc-dev and libde265-0 [19:49:36] RECOVERY - mem191 APT on mem191 is OK: APT OK: 82 packages available for upgrade (0 critical updates). [19:49:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:50:28] RECOVERY - mon181 APT on mon181 is OK: APT OK: 53 packages available for upgrade (0 critical updates). [19:50:52] RECOVERY - mw152 APT on mw152 is OK: APT OK: 142 packages available for upgrade (0 critical updates). [19:52:34] !log [void@puppet181] Upgraded packages on mw161: linux-libc-dev and libde265-0 [19:52:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:53:51] !log [void@puppet181] Upgraded packages on mw162: linux-libc-dev and libde265-0 [19:53:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:54:11] RECOVERY - mw162 APT on mw162 is OK: APT OK: 142 packages available for upgrade (0 critical updates). [19:54:18] RECOVERY - mw161 APT on mw161 is OK: APT OK: 142 packages available for upgrade (0 critical updates). [19:55:14] !log [void@puppet181] Upgraded packages on mw171: linux-libc-dev and libde265-0 [19:55:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:55:33] !log [void@puppet181] Upgraded packages on mw153: linux-libc-dev and libde265-0 [19:55:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:55:41] RECOVERY - mw171 APT on mw171 is OK: APT OK: 142 packages available for upgrade (0 critical updates). [19:55:46] RECOVERY - mw153 APT on mw153 is OK: APT OK: 142 packages available for upgrade (0 critical updates). [19:55:54] !log [void@puppet181] Upgraded packages on mw163: linux-libc-dev and libde265-0 [19:55:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:56:12] !log [void@puppet181] Upgraded packages on mw191: linux-libc-dev and libde265-0 [19:56:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:57:47] RECOVERY - mw163 APT on mw163 is OK: APT OK: 142 packages available for upgrade (0 critical updates). [19:58:00] RECOVERY - mw191 APT on mw191 is OK: APT OK: 142 packages available for upgrade (0 critical updates). [20:00:28] RECOVERY - puppet181 Check unit status of listdomains_github_push on puppet181 is OK: OK: Status of the systemd unit listdomains_github_push [20:02:17] !log [void@puppet181] Upgraded packages on mw172: linux-libc-dev and libde265-0 [20:02:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:02:37] !log [void@puppet181] Upgraded packages on mw173: linux-libc-dev and libde265-0 [20:02:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:03:19] !log [void@puppet181] Upgraded packages on mw182: linux-libc-dev and libde265-0 [20:03:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:03:36] RECOVERY - mw173 APT on mw173 is OK: APT OK: 142 packages available for upgrade (0 critical updates). [20:03:39] !log [void@puppet181] Upgraded packages on mw193: linux-libc-dev and libde265-0 [20:03:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:03:54] RECOVERY - mw172 APT on mw172 is OK: APT OK: 142 packages available for upgrade (0 critical updates). [20:03:59] !log [void@puppet181] Upgraded packages on mw181: linux-libc-dev and libde265-0 [20:04:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:04:04] RECOVERY - mw193 APT on mw193 is OK: APT OK: 142 packages available for upgrade (0 critical updates). [20:04:19] !log [void@puppet181] Upgraded packages on mw192: linux-libc-dev and libde265-0 [20:04:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:04:39] RECOVERY - mw182 APT on mw182 is OK: APT OK: 142 packages available for upgrade (0 critical updates). [20:04:47] !log [void@puppet181] Upgraded packages on mw183: linux-libc-dev and libde265-0 [20:04:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:05:05] !log [void@puppet181] Upgraded packages on mw201: linux-libc-dev and libde265-0 [20:05:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:05:11] RECOVERY - mw201 APT on mw201 is OK: APT OK: 142 packages available for upgrade (0 critical updates). [20:05:18] RECOVERY - mw192 APT on mw192 is OK: APT OK: 142 packages available for upgrade (0 critical updates). [20:05:20] RECOVERY - mw181 APT on mw181 is OK: APT OK: 142 packages available for upgrade (0 critical updates). [20:05:37] RECOVERY - mw183 APT on mw183 is OK: APT OK: 142 packages available for upgrade (0 critical updates). [20:06:35] !log [void@puppet181] Upgraded packages on mwtask161: linux-libc-dev and libde265-0 [20:06:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:08:12] RECOVERY - mwtask161 APT on mwtask161 is OK: APT OK: 147 packages available for upgrade (0 critical updates). [20:09:06] !log [void@puppet181] Upgraded packages on mwtask151: linux-libc-dev and libde265-0 [20:09:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:10:33] RECOVERY - mwtask151 APT on mwtask151 is OK: APT OK: 147 packages available for upgrade (0 critical updates). [20:13:38] !log [void@puppet181] Upgraded packages on mwtask171: linux-libc-dev and libde265-0 [20:13:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:13:57] !log [void@puppet181] Upgraded packages on mw203: linux-libc-dev and libde265-0 [20:14:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:14:16] !log [void@puppet181] Upgraded packages on mw202: linux-libc-dev and libde265-0 [20:14:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:14:47] RECOVERY - mw203 APT on mw203 is OK: APT OK: 142 packages available for upgrade (0 critical updates). [20:15:01] RECOVERY - mwtask171 APT on mwtask171 is OK: APT OK: 148 packages available for upgrade (0 critical updates). [20:16:04] RECOVERY - mw202 APT on mw202 is OK: APT OK: 142 packages available for upgrade (0 critical updates). [20:17:18] !log [void@puppet181] Upgraded packages on os161: linux-libc-dev and libde265-0 [20:17:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:17:33] !log [void@puppet181] Upgraded packages on ns1: linux-libc-dev [20:17:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:18:31] !log [void@puppet181] Upgraded packages on os151: linux-libc-dev and libde265-0 [20:18:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:18:40] RECOVERY - os161 APT on os161 is OK: APT OK: 90 packages available for upgrade (0 critical updates). [20:18:47] !log [void@puppet181] Upgraded packages on phorge171: linux-libc-dev and libde265-0 [20:18:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:18:57] RECOVERY - ns1 APT on ns1 is OK: APT OK: 85 packages available for upgrade (0 critical updates). [20:19:02] !log [void@puppet181] Upgraded packages on prometheus151: linux-libc-dev and libde265-0 [20:19:03] RECOVERY - phorge171 APT on phorge171 is OK: APT OK: 86 packages available for upgrade (0 critical updates). [20:19:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:19:21] !log [void@puppet181] Upgraded packages on mwtask181: linux-libc-dev and libde265-0 [20:19:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:19:31] RECOVERY - prometheus151 APT on prometheus151 is OK: APT OK: 87 packages available for upgrade (0 critical updates). [20:19:36] RECOVERY - os151 APT on os151 is OK: APT OK: 90 packages available for upgrade (0 critical updates). [20:19:37] !log [void@puppet181] Upgraded packages on os162: linux-libc-dev and libde265-0 [20:19:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:20:13] RECOVERY - os162 APT on os162 is OK: APT OK: 90 packages available for upgrade (0 critical updates). [20:20:39] !log [void@puppet181] Upgraded packages on os201: linux-libc-dev and libde265-0 [20:20:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:21:04] RECOVERY - mwtask181 APT on mwtask181 is OK: APT OK: 149 packages available for upgrade (0 critical updates). [20:21:58] RECOVERY - os201 APT on os201 is OK: APT OK: 89 packages available for upgrade (0 critical updates). [20:22:18] !log [void@puppet181] Upgraded packages on reports171: linux-libc-dev and libde265-0 [20:22:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:22:34] !log [void@puppet181] Upgraded packages on puppet181: libde265-0 and linux-libc-dev [20:22:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:22:53] !log [void@puppet181] Upgraded packages on rdb191: linux-libc-dev [20:22:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:23:16] !log [void@puppet181] Upgraded packages on os202: linux-libc-dev and libde265-0 [20:23:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:23:32] !log [void@puppet181] Upgraded packages on os191: linux-libc-dev and libde265-0 [20:23:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:24:07] RECOVERY - puppet181 APT on puppet181 is OK: APT OK: 40 packages available for upgrade (0 critical updates). [20:24:11] RECOVERY - rdb191 APT on rdb191 is OK: APT OK: 85 packages available for upgrade (0 critical updates). [20:24:17] RECOVERY - reports171 APT on reports171 is OK: APT OK: 87 packages available for upgrade (0 critical updates). [20:24:21] RECOVERY - os202 APT on os202 is OK: APT OK: 95 packages available for upgrade (0 critical updates). [20:24:23] !log [void@puppet181] Upgraded packages on swiftobject151: linux-libc-dev and libde265-0 [20:24:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:24:41] !log [void@puppet181] Upgraded packages on swiftobject171: linux-libc-dev and libde265-0 [20:24:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:24:58] !log [void@puppet181] Upgraded packages on swiftac171: linux-libc-dev and libde265-0 [20:25:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:25:13] RECOVERY - os191 APT on os191 is OK: APT OK: 89 packages available for upgrade (0 critical updates). [20:25:15] !log [void@puppet181] Upgraded packages on swiftobject161: linux-libc-dev and libde265-0 [20:25:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:25:40] RECOVERY - swiftobject151 APT on swiftobject151 is OK: APT OK: 100 packages available for upgrade (0 critical updates). [20:25:41] RECOVERY - swiftobject171 APT on swiftobject171 is OK: APT OK: 100 packages available for upgrade (0 critical updates). [20:25:52] RECOVERY - swiftobject161 APT on swiftobject161 is OK: APT OK: 100 packages available for upgrade (0 critical updates). [20:26:34] RECOVERY - swiftac171 APT on swiftac171 is OK: APT OK: 96 packages available for upgrade (0 critical updates). [20:28:47] !log [void@puppet181] Upgraded packages on swiftobject181: linux-libc-dev and libde265-0 [20:28:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:29:15] !log [void@puppet181] Upgraded packages on ns2: linux-libc-dev [20:29:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:30:19] !log [void@puppet181] Upgraded packages on swiftobject191: linux-libc-dev and libde265-0 [20:30:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:30:33] !log [void@puppet181] Upgraded packages on swiftobject211: linux-libc-dev [20:30:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:30:38] RECOVERY - swiftobject181 APT on swiftobject181 is OK: APT OK: 101 packages available for upgrade (0 critical updates). [20:30:44] RECOVERY - ns2 APT on ns2 is OK: APT OK: 91 packages available for upgrade (0 critical updates). [20:30:52] !log [void@puppet181] Upgraded packages on test151: linux-libc-dev and libde265-0 [20:30:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:31:21] RECOVERY - swiftobject191 APT on swiftobject191 is OK: APT OK: 101 packages available for upgrade (0 critical updates). [20:31:31] RECOVERY - test151 APT on test151 is OK: APT OK: 149 packages available for upgrade (0 critical updates). [20:31:51] RECOVERY - swiftobject211 APT on swiftobject211 is OK: APT OK: 90 packages available for upgrade (0 critical updates). [20:32:04] !log [void@puppet181] Upgraded packages on swiftproxy161: linux-libc-dev and libde265-0 [20:32:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:32:11] RECOVERY - swiftproxy161 APT on swiftproxy161 is OK: APT OK: 96 packages available for upgrade (0 critical updates). [20:32:20] !log [void@puppet181] Upgraded packages on swiftproxy171: linux-libc-dev and libde265-0 [20:32:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:32:26] RECOVERY - swiftproxy171 APT on swiftproxy171 is OK: APT OK: 96 packages available for upgrade (0 critical updates). [20:33:47] !log [void@puppet181] Upgraded packages on swiftobject201: linux-libc-dev and libde265-0 [20:33:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:34:25] RECOVERY - swiftobject201 APT on swiftobject201 is OK: APT OK: 101 packages available for upgrade (0 critical updates). [20:39:30] PROBLEM - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is WARNING: WARNING - NGINX Error Rate is 58% [20:41:30] PROBLEM - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is CRITICAL: CRITICAL - NGINX Error Rate is 62% [20:45:30] RECOVERY - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is OK: OK - NGINX Error Rate is 19%