[00:14:01] FIRING: QuarryDown: Quarry application is unreachable - https://prometheus-alerts.wmcloud.org/?q=alertname%3DQuarryDown [00:14:02] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/namehistory] - 10https://gitlab.wikimedia.org/toolforge-repos/namehistory/-/merge_requests/39 [00:14:05] (03open) 10renovatebot: Lock file maintenance [toolforge-repos/namehistory] - 10https://gitlab.wikimedia.org/toolforge-repos/namehistory/-/merge_requests/39 [00:14:06] FIRING: TargetDown: Job app is unreachable in project quarry instance quarry.wmcloud.org:443 - https://prometheus-alerts.wmcloud.org/?q=alertname%3DTargetDown [00:14:15] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/allblocksever] - 10https://gitlab.wikimedia.org/toolforge-repos/allblocksever/-/merge_requests/48 [00:14:18] (03open) 10renovatebot: Lock file maintenance [toolforge-repos/allblocksever] - 10https://gitlab.wikimedia.org/toolforge-repos/allblocksever/-/merge_requests/48 [00:14:28] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/checkusertools] - 10https://gitlab.wikimedia.org/toolforge-repos/checkusertools/-/merge_requests/46 [00:14:31] (03open) 10renovatebot: Lock file maintenance [toolforge-repos/checkusertools] - 10https://gitlab.wikimedia.org/toolforge-repos/checkusertools/-/merge_requests/46 [00:16:26] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/rangetree] - 10https://gitlab.wikimedia.org/toolforge-repos/rangetree/-/merge_requests/76 [00:16:29] (03open) 10renovatebot: Lock file maintenance [toolforge-repos/rangetree] - 10https://gitlab.wikimedia.org/toolforge-repos/rangetree/-/merge_requests/76 [00:16:53] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/multiuserinfo] - 10https://gitlab.wikimedia.org/toolforge-repos/multiuserinfo/-/merge_requests/93 [00:16:53] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/multiuserinfo] - 10https://gitlab.wikimedia.org/toolforge-repos/multiuserinfo/-/merge_requests/93 [00:16:56] (03open) 10renovatebot: Lock file maintenance [toolforge-repos/multiuserinfo] - 10https://gitlab.wikimedia.org/toolforge-repos/multiuserinfo/-/merge_requests/93 [00:17:34] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/wiki-mail-verify] - 10https://gitlab.wikimedia.org/toolforge-repos/wiki-mail-verify/-/merge_requests/65 [00:17:37] (03open) 10renovatebot: Lock file maintenance [toolforge-repos/wiki-mail-verify] - 10https://gitlab.wikimedia.org/toolforge-repos/wiki-mail-verify/-/merge_requests/65 [00:18:20] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/dewiki-voterightsnotifier] - 10https://gitlab.wikimedia.org/toolforge-repos/dewiki-voterightsnotifier/-/merge_requests/52 [00:18:24] (03open) 10renovatebot: Lock file maintenance [toolforge-repos/dewiki-voterightsnotifier] - 10https://gitlab.wikimedia.org/toolforge-repos/dewiki-voterightsnotifier/-/merge_requests/52 [00:18:51] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/dewiki-rangeblock] - 10https://gitlab.wikimedia.org/toolforge-repos/dewiki-rangeblock/-/merge_requests/40 [00:18:54] (03open) 10renovatebot: Lock file maintenance [toolforge-repos/dewiki-rangeblock] - 10https://gitlab.wikimedia.org/toolforge-repos/dewiki-rangeblock/-/merge_requests/40 [00:19:01] RESOLVED: QuarryDown: Quarry application is unreachable - https://prometheus-alerts.wmcloud.org/?q=alertname%3DQuarryDown [00:19:05] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/flaggedrevspromotioncheck] - 10https://gitlab.wikimedia.org/toolforge-repos/flaggedrevspromotioncheck/-/merge_requests/40 [00:19:06] RESOLVED: TargetDown: Job app is unreachable in project quarry instance quarry.wmcloud.org:443 - https://prometheus-alerts.wmcloud.org/?q=alertname%3DTargetDown [00:19:09] (03open) 10renovatebot: Lock file maintenance [toolforge-repos/flaggedrevspromotioncheck] - 10https://gitlab.wikimedia.org/toolforge-repos/flaggedrevspromotioncheck/-/merge_requests/40 [00:19:20] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/dewikisignbot] - 10https://gitlab.wikimedia.org/toolforge-repos/dewikisignbot/-/merge_requests/45 [00:19:25] (03open) 10renovatebot: Lock file maintenance [toolforge-repos/dewikisignbot] - 10https://gitlab.wikimedia.org/toolforge-repos/dewikisignbot/-/merge_requests/45 [00:27:06] FIRING: TargetDown: Job flask is unreachable in project quarry instance quarry.wmcloud.org:443 - https://prometheus-alerts.wmcloud.org/?q=alertname%3DTargetDown [00:34:01] FIRING: QuarryDown: Quarry application is unreachable - https://prometheus-alerts.wmcloud.org/?q=alertname%3DQuarryDown [00:37:06] RESOLVED: [2x] TargetDown: Job app is unreachable in project quarry instance quarry.wmcloud.org:443 - https://prometheus-alerts.wmcloud.org/?q=alertname%3DTargetDown [00:39:01] RESOLVED: QuarryDown: Quarry application is unreachable - https://prometheus-alerts.wmcloud.org/?q=alertname%3DQuarryDown [01:05:06] FIRING: TargetDown: Job flask is unreachable in project quarry instance quarry.wmcloud.org:443 - https://prometheus-alerts.wmcloud.org/?q=alertname%3DTargetDown [01:10:06] RESOLVED: TargetDown: Job flask is unreachable in project quarry instance quarry.wmcloud.org:443 - https://prometheus-alerts.wmcloud.org/?q=alertname%3DTargetDown [01:25:01] FIRING: [2x] OpenstackAPIResponse: Openstack API average response time is too high. - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/OpenstackAPIResponse - https://grafana.wikimedia.org/d/UUmLqqX4k - https://alerts.wikimedia.org/?q=alertname%3DOpenstackAPIResponse [02:22:01] FIRING: QuarryDown: Quarry application is unreachable - https://prometheus-alerts.wmcloud.org/?q=alertname%3DQuarryDown [02:22:06] FIRING: TargetDown: Job app is unreachable in project quarry instance quarry.wmcloud.org:443 - https://prometheus-alerts.wmcloud.org/?q=alertname%3DTargetDown [02:27:01] RESOLVED: QuarryDown: Quarry application is unreachable - https://prometheus-alerts.wmcloud.org/?q=alertname%3DQuarryDown [02:27:06] RESOLVED: TargetDown: Job app is unreachable in project quarry instance quarry.wmcloud.org:443 - https://prometheus-alerts.wmcloud.org/?q=alertname%3DTargetDown [02:33:01] FIRING: QuarryDown: Quarry application is unreachable - https://prometheus-alerts.wmcloud.org/?q=alertname%3DQuarryDown [02:33:06] FIRING: TargetDown: Job app is unreachable in project quarry instance quarry.wmcloud.org:443 - https://prometheus-alerts.wmcloud.org/?q=alertname%3DTargetDown [02:34:41] (03open) 10ibrahemqasim: Pass validation errors through publish responses [toolforge-repos/mdwiki] - 10https://gitlab.wikimedia.org/toolforge-repos/mdwiki/-/merge_requests/30 [02:38:01] RESOLVED: QuarryDown: Quarry application is unreachable - https://prometheus-alerts.wmcloud.org/?q=alertname%3DQuarryDown [02:38:06] RESOLVED: TargetDown: Job app is unreachable in project quarry instance quarry.wmcloud.org:443 - https://prometheus-alerts.wmcloud.org/?q=alertname%3DTargetDown [02:39:17] (03update) 10ibrahemqasim: Pass validation errors through publish responses [toolforge-repos/mdwiki] - 10https://gitlab.wikimedia.org/toolforge-repos/mdwiki/-/merge_requests/30 [02:42:01] FIRING: QuarryDown: Quarry application is unreachable - https://prometheus-alerts.wmcloud.org/?q=alertname%3DQuarryDown [02:42:06] FIRING: TargetDown: Job app is unreachable in project quarry instance quarry.wmcloud.org:443 - https://prometheus-alerts.wmcloud.org/?q=alertname%3DTargetDown [02:47:01] RESOLVED: QuarryDown: Quarry application is unreachable - https://prometheus-alerts.wmcloud.org/?q=alertname%3DQuarryDown [02:47:06] RESOLVED: [2x] TargetDown: Job app is unreachable in project quarry instance quarry.wmcloud.org:443 - https://prometheus-alerts.wmcloud.org/?q=alertname%3DTargetDown [02:55:44] (03update) 10ibrahemqasim: Pass validation errors through publish responses [toolforge-repos/mdwiki] - 10https://gitlab.wikimedia.org/toolforge-repos/mdwiki/-/merge_requests/30 [02:56:36] (03merge) 10ibrahemqasim: Pass validation errors through publish responses [toolforge-repos/mdwiki] - 10https://gitlab.wikimedia.org/toolforge-repos/mdwiki/-/merge_requests/30 [03:45:01] FIRING: [3x] OpenstackAPIResponse: Openstack API average response time is too high. - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/OpenstackAPIResponse - https://grafana.wikimedia.org/d/UUmLqqX4k - https://alerts.wikimedia.org/?q=alertname%3DOpenstackAPIResponse [04:00:01] FIRING: QuarryDown: Quarry application is unreachable - https://prometheus-alerts.wmcloud.org/?q=alertname%3DQuarryDown [04:00:06] FIRING: TargetDown: Job app is unreachable in project quarry instance quarry.wmcloud.org:443 - https://prometheus-alerts.wmcloud.org/?q=alertname%3DTargetDown [04:05:01] RESOLVED: QuarryDown: Quarry application is unreachable - https://prometheus-alerts.wmcloud.org/?q=alertname%3DQuarryDown [04:05:06] RESOLVED: TargetDown: Job app is unreachable in project quarry instance quarry.wmcloud.org:443 - https://prometheus-alerts.wmcloud.org/?q=alertname%3DTargetDown [04:34:01] FIRING: QuarryDown: Quarry application is unreachable - https://prometheus-alerts.wmcloud.org/?q=alertname%3DQuarryDown [04:34:06] FIRING: TargetDown: Job app is unreachable in project quarry instance quarry.wmcloud.org:443 - https://prometheus-alerts.wmcloud.org/?q=alertname%3DTargetDown [04:39:01] RESOLVED: QuarryDown: Quarry application is unreachable - https://prometheus-alerts.wmcloud.org/?q=alertname%3DQuarryDown [04:39:06] RESOLVED: TargetDown: Job app is unreachable in project quarry instance quarry.wmcloud.org:443 - https://prometheus-alerts.wmcloud.org/?q=alertname%3DTargetDown [04:57:01] FIRING: QuarryDown: Quarry application is unreachable - https://prometheus-alerts.wmcloud.org/?q=alertname%3DQuarryDown [04:57:06] FIRING: TargetDown: Job app is unreachable in project quarry instance quarry.wmcloud.org:443 - https://prometheus-alerts.wmcloud.org/?q=alertname%3DTargetDown [05:02:01] RESOLVED: QuarryDown: Quarry application is unreachable - https://prometheus-alerts.wmcloud.org/?q=alertname%3DQuarryDown [05:02:06] RESOLVED: TargetDown: Job app is unreachable in project quarry instance quarry.wmcloud.org:443 - https://prometheus-alerts.wmcloud.org/?q=alertname%3DTargetDown [07:21:20] (03open) 10countcount: Override glob and minimatch to fix GHSA-3g3m-2fjr-6pw4 and GHSA-g3hv-75wg-m249 [toolforge-repos/checkusertools] - 10https://gitlab.wikimedia.org/toolforge-repos/checkusertools/-/merge_requests/47 [07:21:23] (03open) 10countcount: Override glob and minimatch to fix GHSA-3g3m-2fjr-6pw4 and GHSA-g3hv-75wg-m249 [toolforge-repos/namehistory] - 10https://gitlab.wikimedia.org/toolforge-repos/namehistory/-/merge_requests/40 [07:21:27] (03open) 10countcount: Override glob and minimatch to fix GHSA-3g3m-2fjr-6pw4 and GHSA-g3hv-75wg-m249 [toolforge-repos/rangetree] - 10https://gitlab.wikimedia.org/toolforge-repos/rangetree/-/merge_requests/77 [07:21:30] (03open) 10countcount: Override glob and minimatch to fix GHSA-3g3m-2fjr-6pw4 and GHSA-g3hv-75wg-m249 [toolforge-repos/wiki-mail-verify] - 10https://gitlab.wikimedia.org/toolforge-repos/wiki-mail-verify/-/merge_requests/66 [07:24:37] (03open) 10countcount: Run pyright on nodejs-wheel-binaries instead of nodeenv [toolforge-repos/dewikisignbot] - 10https://gitlab.wikimedia.org/toolforge-repos/dewikisignbot/-/merge_requests/46 [07:24:41] (03open) 10countcount: Run pyright on nodejs-wheel-binaries instead of nodeenv [toolforge-repos/dewiki-voterightsnotifier] - 10https://gitlab.wikimedia.org/toolforge-repos/dewiki-voterightsnotifier/-/merge_requests/53 [07:25:05] (03open) 10countcount: Run pyright on nodejs-wheel-binaries instead of nodeenv [toolforge-repos/flaggedrevspromotioncheck] - 10https://gitlab.wikimedia.org/toolforge-repos/flaggedrevspromotioncheck/-/merge_requests/41 [07:25:11] (03update) 10countcount: Run pyright on nodejs-wheel-binaries instead of nodeenv [toolforge-repos/flaggedrevspromotioncheck] - 10https://gitlab.wikimedia.org/toolforge-repos/flaggedrevspromotioncheck/-/merge_requests/41 [07:28:44] (03CR) 10Abijeet Patro: [V:03+2] Localisation updates from https://translatewiki.net. [labs/xtools] - 10https://gerrit.wikimedia.org/r/1357726 (owner: 10L10n-bot) [07:29:19] (03Abandoned) 10Abijeet Patro: Localisation updates from https://translatewiki.net. [labs/xtools] - 10https://gerrit.wikimedia.org/r/1357726 (owner: 10L10n-bot) [07:45:01] FIRING: [3x] OpenstackAPIResponse: Openstack API average response time is too high. - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/OpenstackAPIResponse - https://grafana.wikimedia.org/d/UUmLqqX4k - https://alerts.wikimedia.org/?q=alertname%3DOpenstackAPIResponse [07:57:38] (03update) 10countcount: Fix glob and minimatch advisories and replace serve with sirv-cli [toolforge-repos/checkusertools] - 10https://gitlab.wikimedia.org/toolforge-repos/checkusertools/-/merge_requests/47 [07:57:42] (03update) 10countcount: Fix glob and minimatch advisories and replace serve with sirv-cli [toolforge-repos/namehistory] - 10https://gitlab.wikimedia.org/toolforge-repos/namehistory/-/merge_requests/40 [07:57:44] (03update) 10countcount: Fix glob and minimatch advisories and replace serve with sirv-cli [toolforge-repos/checkusertools] - 10https://gitlab.wikimedia.org/toolforge-repos/checkusertools/-/merge_requests/47 [07:57:46] (03update) 10countcount: Fix glob and minimatch advisories and replace serve with sirv-cli [toolforge-repos/rangetree] - 10https://gitlab.wikimedia.org/toolforge-repos/rangetree/-/merge_requests/77 [07:57:50] (03update) 10countcount: Fix glob and minimatch advisories and replace serve with sirv-cli [toolforge-repos/namehistory] - 10https://gitlab.wikimedia.org/toolforge-repos/namehistory/-/merge_requests/40 [07:57:54] (03update) 10countcount: Fix glob and minimatch advisories and replace serve with sirv-cli [toolforge-repos/rangetree] - 10https://gitlab.wikimedia.org/toolforge-repos/rangetree/-/merge_requests/77 [08:03:16] !log filippo@cloudcumin1001 admin START - Cookbook wmcs.openstack.cloudvirt.unset_maintenance [08:03:18] !log filippo@cloudcumin1001 admin END (PASS) - Cookbook wmcs.openstack.cloudvirt.unset_maintenance (exit_code=0) [08:09:40] (03update) 10countcount: Remove unused @vue/test-utils and replace serve with sirv-cli to fix glob and minimatch advisories [toolforge-repos/checkusertools] - 10https://gitlab.wikimedia.org/toolforge-repos/checkusertools/-/merge_requests/47 [08:09:40] (03update) 10countcount: Remove unused @vue/test-utils and replace serve with sirv-cli to fix glob and minimatch advisories [toolforge-repos/checkusertools] - 10https://gitlab.wikimedia.org/toolforge-repos/checkusertools/-/merge_requests/47 [08:09:44] (03update) 10countcount: Remove unused @vue/test-utils and replace serve with sirv-cli to fix glob and minimatch advisories [toolforge-repos/rangetree] - 10https://gitlab.wikimedia.org/toolforge-repos/rangetree/-/merge_requests/77 [08:09:45] (03update) 10countcount: Remove unused @vue/test-utils and replace serve with sirv-cli to fix glob and minimatch advisories [toolforge-repos/rangetree] - 10https://gitlab.wikimedia.org/toolforge-repos/rangetree/-/merge_requests/77 [08:15:19] (03merge) 10countcount: Remove unused @vue/test-utils and replace serve with sirv-cli to fix glob and minimatch advisories [toolforge-repos/rangetree] - 10https://gitlab.wikimedia.org/toolforge-repos/rangetree/-/merge_requests/77 [08:15:26] (03merge) 10countcount: Remove unused @vue/test-utils and replace serve with sirv-cli to fix glob and minimatch advisories [toolforge-repos/checkusertools] - 10https://gitlab.wikimedia.org/toolforge-repos/checkusertools/-/merge_requests/47 [08:19:26] (03merge) 10countcount: Fix glob and minimatch advisories and replace serve with sirv-cli [toolforge-repos/namehistory] - 10https://gitlab.wikimedia.org/toolforge-repos/namehistory/-/merge_requests/40 [08:23:19] (03merge) 10countcount: Run pyright on nodejs-wheel-binaries instead of nodeenv [toolforge-repos/dewikisignbot] - 10https://gitlab.wikimedia.org/toolforge-repos/dewikisignbot/-/merge_requests/46 [08:23:22] (03merge) 10countcount: Run pyright on nodejs-wheel-binaries instead of nodeenv [toolforge-repos/dewiki-voterightsnotifier] - 10https://gitlab.wikimedia.org/toolforge-repos/dewiki-voterightsnotifier/-/merge_requests/53 [08:23:26] (03merge) 10countcount: Run pyright on nodejs-wheel-binaries instead of nodeenv [toolforge-repos/flaggedrevspromotioncheck] - 10https://gitlab.wikimedia.org/toolforge-repos/flaggedrevspromotioncheck/-/merge_requests/41 [08:23:59] (03merge) 10countcount: Override glob and minimatch to fix GHSA-3g3m-2fjr-6pw4 and GHSA-g3hv-75wg-m249 [toolforge-repos/wiki-mail-verify] - 10https://gitlab.wikimedia.org/toolforge-repos/wiki-mail-verify/-/merge_requests/66 [08:28:06] FIRING: TargetDown: Job flask is unreachable in project quarry instance quarry.wmcloud.org:443 - https://prometheus-alerts.wmcloud.org/?q=alertname%3DTargetDown [08:33:06] RESOLVED: TargetDown: Job flask is unreachable in project quarry instance quarry.wmcloud.org:443 - https://prometheus-alerts.wmcloud.org/?q=alertname%3DTargetDown [08:36:29] 06cloud-services-team, 10Toolforge, 06tools-platform-team: New upstream release for Pywikibot - https://phabricator.wikimedia.org/T439635#12500292 (10Xqt) A new upstream version of Pywikibot is now available: 11.10.0. https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Pywikibot_image https://gerrit.... [08:37:18] 06cloud-services-team, 10PAWS, 06tools-platform-team: New upstream release for Pywikibot - https://phabricator.wikimedia.org/T435704#12500296 (10Xqt) A new upstream version of Pywikibot is now available: 11.10.0. https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Pywikibot_image https://gerrit.wikim... [08:37:49] 10Cloud-VPS, 06tools-infrastructure-team, 06Infrastructure-Foundations: The Cloud intermediate CA is going to expire on Dec 12th - https://phabricator.wikimedia.org/T442012#12500300 (10fgiunchedi) I verified trove-guestagent does not use tls for rabbit communication, cc @Andrew JFYI. We are all clear to proc... [08:38:28] !log filippo@cloudcumin1001 admin START - Cookbook wmcs.openstack.cloudvirt.unset_maintenance (T431374) [08:38:30] !log filippo@cloudcumin1001 admin END (PASS) - Cookbook wmcs.openstack.cloudvirt.unset_maintenance (exit_code=0) (T431374) [08:38:36] T431374: cloudvirt1071 crash, again - https://phabricator.wikimedia.org/T431374 [08:39:40] 06cloud-services-team, 10Cloud-VPS, 06tools-infrastructure-team, 06DC-Ops, and 2 others: cloudvirt1071 crash, again - https://phabricator.wikimedia.org/T431374#12500307 (10fgiunchedi) I have put the host back in service now, we'll see if it crashes again [08:48:03] 10PAWS, 06tools-platform-team, 10Pywikibot: Credential issues when running Pywikibot on PAWS - https://phabricator.wikimedia.org/T443189 (10Xqt) 03NEW [09:00:11] 10Cloud-VPS (Debian Bullseye Deprecation), 10Beta-Cluster-Infrastructure, 13Patch-For-Review: Replace deployment-zookeeper-3 (Bullseye deprecation) - https://phabricator.wikimedia.org/T436481#12500381 (10Urbanecm_WMF) [09:00:34] 10Cloud-VPS (Debian Bullseye Deprecation), 10Beta-Cluster-Infrastructure, 13Patch-For-Review: Replace deployment-zookeeper-3 (Bullseye deprecation) - https://phabricator.wikimedia.org/T436481#12500382 (10Urbanecm_WMF) Noting I cherry picked https://gerrit.wikimedia.org/r/c/operations/puppet/+/1360972 to beta... [09:14:01] (03update) 10renovatebot: Update pnpm to v12.16.1 [toolforge-repos/namehistory] - 10https://gitlab.wikimedia.org/toolforge-repos/namehistory/-/merge_requests/38 [09:14:11] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/namehistory] - 10https://gitlab.wikimedia.org/toolforge-repos/namehistory/-/merge_requests/39 [09:14:32] (03update) 10renovatebot: Update pnpm to v12.16.1 [toolforge-repos/checkusertools] - 10https://gitlab.wikimedia.org/toolforge-repos/checkusertools/-/merge_requests/45 [09:14:38] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/checkusertools] - 10https://gitlab.wikimedia.org/toolforge-repos/checkusertools/-/merge_requests/46 [09:15:43] (03update) 10renovatebot: Update pnpm to v12.16.1 [toolforge-repos/rangetree] - 10https://gitlab.wikimedia.org/toolforge-repos/rangetree/-/merge_requests/75 [09:15:49] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/rangetree] - 10https://gitlab.wikimedia.org/toolforge-repos/rangetree/-/merge_requests/76 [09:16:53] (03update) 10renovatebot: Update pnpm to v12.16.1 [toolforge-repos/wiki-mail-verify] - 10https://gitlab.wikimedia.org/toolforge-repos/wiki-mail-verify/-/merge_requests/64 [09:17:58] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/wiki-mail-verify] - 10https://gitlab.wikimedia.org/toolforge-repos/wiki-mail-verify/-/merge_requests/65 [09:18:45] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/dewiki-voterightsnotifier] - 10https://gitlab.wikimedia.org/toolforge-repos/dewiki-voterightsnotifier/-/merge_requests/52 [09:19:20] (03update) 10renovatebot: Update python Docker tag to v3.15.2 [toolforge-repos/flaggedrevspromotioncheck] - 10https://gitlab.wikimedia.org/toolforge-repos/flaggedrevspromotioncheck/-/merge_requests/18 [09:19:27] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/flaggedrevspromotioncheck] - 10https://gitlab.wikimedia.org/toolforge-repos/flaggedrevspromotioncheck/-/merge_requests/40 [09:19:38] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/dewikisignbot] - 10https://gitlab.wikimedia.org/toolforge-repos/dewikisignbot/-/merge_requests/45 [09:31:49] 10PAWS, 06tools-platform-team, 10Pywikibot: Credential issues when running Pywikibot on PAWS - https://phabricator.wikimedia.org/T443189#12500514 (10Comander123x) Hi @Xqt, I'm interested in contributing to Pywikibot as part of my GSoC 2027 preparation. I came across T443189 and would like to help investigate... [10:15:21] (03merge) 10countcount: Update pnpm to v12.16.1 [toolforge-repos/wiki-mail-verify] - 10https://gitlab.wikimedia.org/toolforge-repos/wiki-mail-verify/-/merge_requests/64 (owner: 10renovatebot) [10:15:24] (03merge) 10countcount: Update pnpm to v12.16.1 [toolforge-repos/rangetree] - 10https://gitlab.wikimedia.org/toolforge-repos/rangetree/-/merge_requests/75 (owner: 10renovatebot) [10:15:27] (03merge) 10countcount: Update pnpm to v12.16.1 [toolforge-repos/checkusertools] - 10https://gitlab.wikimedia.org/toolforge-repos/checkusertools/-/merge_requests/45 (owner: 10renovatebot) [10:15:30] (03merge) 10countcount: Update pnpm to v12.16.1 [toolforge-repos/allblocksever] - 10https://gitlab.wikimedia.org/toolforge-repos/allblocksever/-/merge_requests/47 (owner: 10renovatebot) [10:15:35] (03merge) 10countcount: Update pnpm to v12.16.1 [toolforge-repos/namehistory] - 10https://gitlab.wikimedia.org/toolforge-repos/namehistory/-/merge_requests/38 (owner: 10renovatebot) [10:16:04] 10Tools, 06Commons, 07Community-Wishlist: A set of tools for image editing directly in Wikimedia Commons - https://phabricator.wikimedia.org/T428062#12500772 (10mikez-WMF) Great find - adding that would be great as it's in line with media actions! @JSengupta-WMF , do you have a recommended word/string for [... [10:17:29] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/wiki-mail-verify] - 10https://gitlab.wikimedia.org/toolforge-repos/wiki-mail-verify/-/merge_requests/65 [10:17:52] 06cloud-services-team, 10PAWS, 06tools-platform-team: New upstream release for Pywikibot - https://phabricator.wikimedia.org/T435704#12500779 (10LibUp-bot) A new upstream version of Pywikibot is now available: 11.10.0. * https://wikitech.wikimedia.org/wiki/PAWS/Admin#Update_the_pywikibot_version * https://ge... [10:17:55] 06cloud-services-team, 10Toolforge, 06tools-platform-team: New upstream release for Pywikibot - https://phabricator.wikimedia.org/T439635#12500780 (10LibUp-bot) A new upstream version of Pywikibot is now available: 11.10.0. * https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Pywikibot_image * https:... [10:20:56] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/namehistory] - 10https://gitlab.wikimedia.org/toolforge-repos/namehistory/-/merge_requests/39 [10:21:10] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/allblocksever] - 10https://gitlab.wikimedia.org/toolforge-repos/allblocksever/-/merge_requests/48 [10:21:22] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/checkusertools] - 10https://gitlab.wikimedia.org/toolforge-repos/checkusertools/-/merge_requests/46 [10:22:28] (03update) 10renovatebot: Lock file maintenance [toolforge-repos/rangetree] - 10https://gitlab.wikimedia.org/toolforge-repos/rangetree/-/merge_requests/76 [11:05:08] 10Cloud-VPS (Project-requests), 10Tool-recaptime-dev, 10Tool-wiki-labeler-atproto: Request creation of wiki-labeler-atproto VPS project (Trove-only) - https://phabricator.wikimedia.org/T442330#12500960 (10ajhalili2006) >>! In T442330#12495002, @taavi wrote: > Hi. I believe {T418818} needs answering first. W... [11:07:24] (03close) 10raymond-ndibe: add jobs-api backend to webservice-cli [repos/cloud/toolforge/webservice-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/webservice-cli/-/merge_requests/95 (https://phabricator.wikimedia.org/T431421) [11:07:49] (03close) 10raymond-ndibe: test for jobs-api backend in webservice-cli [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1134 (https://phabricator.wikimedia.org/T348755) [11:21:03] 10Cloud-VPS, 10Toolforge, 06tools-infrastructure-team, 06tools-platform-team: 2026-10-21 Toolforge and Cloud VPS down - https://phabricator.wikimedia.org/T441908#12501044 (10taavi) 05Open→03Resolved Toolforge and Cloud VPS infrastructure is operating more or less normally again. Any remaining tools... [11:21:08] (03close) 10raymond-ndibe: [cicd] remove py3.9-bullseye-tox-pypi-debian [repos/cloud/cicd/gitlab-ci] - 10https://gitlab.wikimedia.org/repos/cloud/cicd/gitlab-ci/-/merge_requests/68 (https://phabricator.wikimedia.org/T400616) [11:23:39] 10Cloud-VPS, 06tools-infrastructure-team, 07Security: CVE-2026-99999 'pwnescape' - https://phabricator.wikimedia.org/T441555#12501083 (10taavi) Anything left to do here? [11:30:25] 10PAWS, 06tools-platform-team, 10Pywikibot: Credential issues when running Pywikibot on PAWS - https://phabricator.wikimedia.org/T443189#12501112 (10Aklapper) @Comander123x Hi and welcome! That comment looked like AI slop to me ("focused patch"?). Please see https://www.mediawiki.org/wiki/New_Developers - th... [11:34:31] (03update) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/alerts-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/alerts-api/-/merge_requests/13 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [11:34:33] (03approved) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/alerts-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/alerts-api/-/merge_requests/13 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [11:34:44] (03merge) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/alerts-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/alerts-api/-/merge_requests/13 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [11:37:26] (03open) 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce: alerts-api: bump to 0.0.15-20261102113504-0b18069e [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1481 [11:39:10] (03update) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/toolforge-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-cli/-/merge_requests/80 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [11:39:10] (03approved) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/toolforge-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-cli/-/merge_requests/80 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [11:39:15] (03merge) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/toolforge-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-cli/-/merge_requests/80 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [11:39:26] (03update) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/maintain-harbor] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/maintain-harbor/-/merge_requests/79 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [11:39:28] (03approved) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/maintain-harbor] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/maintain-harbor/-/merge_requests/79 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [11:39:32] (03merge) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/maintain-harbor] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/maintain-harbor/-/merge_requests/79 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [11:41:56] 10Cloud-VPS, 06tools-infrastructure-team, 07Security: CVE-2026-99999 'pwnescape' - https://phabricator.wikimedia.org/T441555#12501154 (10MoritzMuehlenhoff) 05Open→03Resolved All done: ` jmm@cumin2003:~$ sudo cumin A:cloudvirt 'uname -v' 44 hosts will be targeted: cloudvirt[1040-1080].eqiad.wmnet,c... [11:42:19] (03open) 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce: maintain-harbor: bump to 0.0.78-20261102113945-1ae5481f [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1482 [11:42:20] (03update) 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce: maintain-harbor: bump to 0.0.78-20261102113945-1ae5481f [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1482 [11:43:45] (03update) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/lima-kilo] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/lima-kilo/-/merge_requests/349 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [11:43:48] (03approved) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/lima-kilo] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/lima-kilo/-/merge_requests/349 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [11:43:52] (03merge) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/lima-kilo] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/lima-kilo/-/merge_requests/349 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [11:45:01] FIRING: [3x] OpenstackAPIResponse: Openstack API average response time is too high. - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/OpenstackAPIResponse - https://grafana.wikimedia.org/d/UUmLqqX4k - https://alerts.wikimedia.org/?q=alertname%3DOpenstackAPIResponse [11:51:55] (03update) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/builds-builder] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/builds-builder/-/merge_requests/98 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [11:51:56] (03approved) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/builds-builder] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/builds-builder/-/merge_requests/98 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [11:52:00] (03merge) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/builds-builder] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/builds-builder/-/merge_requests/98 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [11:52:13] (03update) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/api-gateway] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/api-gateway/-/merge_requests/112 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [11:52:15] (03approved) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/api-gateway] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/api-gateway/-/merge_requests/112 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [11:52:22] (03merge) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/api-gateway] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/api-gateway/-/merge_requests/112 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [11:52:31] (03update) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/builds-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/builds-api/-/merge_requests/170 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [11:53:02] (03update) 10raymond-ndibe: build: Upgrade Poetry dependencies [repos/cloud/toolforge/toolforge-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-cli/-/merge_requests/79 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [11:53:06] (03approved) 10raymond-ndibe: build: Upgrade Poetry dependencies [repos/cloud/toolforge/toolforge-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-cli/-/merge_requests/79 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [11:53:11] (03update) 10raymond-ndibe: build: Upgrade Poetry dependencies [repos/cloud/toolforge/toolforge-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-cli/-/merge_requests/79 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [11:53:38] (03update) 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce: builds-builder: bump to 0.0.157-20261102115213-78a28912 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1483 [11:53:50] (03open) 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce: builds-builder: bump to 0.0.157-20261102115213-78a28912 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1483 [11:54:24] (03update) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/replica-cnf] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/replica-cnf/-/merge_requests/5 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [11:54:27] (03approved) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/replica-cnf] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/replica-cnf/-/merge_requests/5 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [11:54:40] (03update) 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce: api-gateway: bump to 0.0.111-20261102115236-4a6a79d4 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1484 [11:54:50] (03open) 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce: api-gateway: bump to 0.0.111-20261102115236-4a6a79d4 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1484 [11:55:34] 10PAWS, 06tools-platform-team, 10Pywikibot: Credential issues when running Pywikibot on PAWS - https://phabricator.wikimedia.org/T443189#12501175 (10Xqt) @Comander123x: I don’t think that these issues a a "good first" task for beginners. [11:57:57] (03merge) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/replica-cnf] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/replica-cnf/-/merge_requests/5 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [11:58:06] (03merge) 10raymond-ndibe: build: Upgrade Poetry dependencies [repos/cloud/toolforge/toolforge-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-cli/-/merge_requests/79 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [11:58:10] (03update) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/envvars-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/envvars-api/-/merge_requests/80 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [11:58:14] (03approved) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/envvars-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/envvars-api/-/merge_requests/80 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [11:58:20] (03merge) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/envvars-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/envvars-api/-/merge_requests/80 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [11:58:30] (03update) 10raymond-ndibe: build: Upgrade Poetry dependencies [repos/cloud/toolforge/maintain-harbor] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/maintain-harbor/-/merge_requests/78 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [11:58:31] (03update) 10raymond-ndibe: build: Upgrade Poetry dependencies [repos/cloud/toolforge/maintain-harbor] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/maintain-harbor/-/merge_requests/78 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [11:58:34] (03approved) 10raymond-ndibe: build: Upgrade Poetry dependencies [repos/cloud/toolforge/maintain-harbor] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/maintain-harbor/-/merge_requests/78 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [11:58:38] (03update) 10raymond-ndibe: build: Upgrade Poetry dependencies [repos/cloud/toolforge/api-gateway] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/api-gateway/-/merge_requests/111 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [11:58:39] (03approved) 10raymond-ndibe: build: Upgrade Poetry dependencies [repos/cloud/toolforge/api-gateway] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/api-gateway/-/merge_requests/111 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [11:58:43] (03update) 10raymond-ndibe: build: Upgrade Poetry dependencies [repos/cloud/toolforge/api-gateway] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/api-gateway/-/merge_requests/111 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [11:58:44] (03update) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/volume-admission] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/volume-admission/-/merge_requests/54 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [11:58:47] (03approved) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/volume-admission] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/volume-admission/-/merge_requests/54 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [11:58:52] (03merge) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/volume-admission] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/volume-admission/-/merge_requests/54 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [11:59:14] (03update) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/envvars-admission] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/envvars-admission/-/merge_requests/38 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [11:59:17] (03approved) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/envvars-admission] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/envvars-admission/-/merge_requests/38 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [11:59:25] (03merge) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/envvars-admission] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/envvars-admission/-/merge_requests/38 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [11:59:48] (03approved) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/envvars-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/envvars-cli/-/merge_requests/123 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [11:59:50] (03update) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/envvars-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/envvars-cli/-/merge_requests/123 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [11:59:53] (03merge) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/envvars-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/envvars-cli/-/merge_requests/123 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [11:59:55] (03update) 10raymond-ndibe: build: Upgrade Poetry dependencies [repos/cloud/toolforge/envvars-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/envvars-cli/-/merge_requests/122 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [11:59:57] (03approved) 10raymond-ndibe: build: Upgrade Poetry dependencies [repos/cloud/toolforge/envvars-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/envvars-cli/-/merge_requests/122 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:00:09] (03update) 10raymond-ndibe: build: Upgrade Poetry dependencies [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/385 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:00:13] (03approved) 10raymond-ndibe: build: Upgrade Poetry dependencies [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/385 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:00:17] (03update) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/384 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:00:20] (03update) 10raymond-ndibe: build: Upgrade Poetry dependencies [repos/cloud/toolforge/envvars-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/envvars-cli/-/merge_requests/122 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:00:22] (03approved) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/384 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:00:23] (03merge) 10raymond-ndibe: build: Upgrade Poetry dependencies [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/385 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:00:26] (03update) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/webservice-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/webservice-cli/-/merge_requests/131 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:00:30] (03approved) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/webservice-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/webservice-cli/-/merge_requests/131 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:00:34] (03update) 10raymond-ndibe: build: Upgrade Poetry dependencies [repos/cloud/toolforge/builds-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/builds-cli/-/merge_requests/156 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:00:40] (03approved) 10raymond-ndibe: build: Upgrade Poetry dependencies [repos/cloud/toolforge/builds-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/builds-cli/-/merge_requests/156 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:00:44] (03merge) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/webservice-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/webservice-cli/-/merge_requests/131 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:00:48] (03update) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/builds-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/builds-cli/-/merge_requests/155 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:00:58] (03merge) 10raymond-ndibe: build: Upgrade Poetry dependencies [repos/cloud/toolforge/builds-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/builds-cli/-/merge_requests/156 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:01:02] (03approved) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/builds-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/builds-cli/-/merge_requests/155 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:01:07] (03update) 10raymond-ndibe: build: Upgrade Poetry dependencies [repos/cloud/toolforge/jobs-emailer] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-emailer/-/merge_requests/64 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:01:11] (03approved) 10raymond-ndibe: build: Upgrade Poetry dependencies [repos/cloud/toolforge/jobs-emailer] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-emailer/-/merge_requests/64 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:01:15] (03update) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/jobs-emailer] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-emailer/-/merge_requests/63 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:01:19] (03update) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/ingress-admission] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/ingress-admission/-/merge_requests/45 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:01:27] (03approved) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/ingress-admission] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/ingress-admission/-/merge_requests/45 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:01:35] (03merge) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/ingress-admission] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/ingress-admission/-/merge_requests/45 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:01:39] (03update) 10raymond-ndibe: build: Upgrade Poetry dependencies [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/210 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:01:43] (03approved) 10raymond-ndibe: build: Upgrade Poetry dependencies [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/210 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:01:47] (03update) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/registry-admission] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/registry-admission/-/merge_requests/46 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:01:56] (03approved) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/registry-admission] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/registry-admission/-/merge_requests/46 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:02:00] (03merge) 10raymond-ndibe: build: Upgrade Poetry dependencies [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/210 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:02:04] (03update) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/maintain-kubeusers] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/maintain-kubeusers/-/merge_requests/95 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:02:12] (03merge) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/registry-admission] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/registry-admission/-/merge_requests/46 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:02:16] (03approved) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/maintain-kubeusers] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/maintain-kubeusers/-/merge_requests/95 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:02:20] (03merge) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/maintain-kubeusers] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/maintain-kubeusers/-/merge_requests/95 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:02:32] (03update) 10raymond-ndibe: build: Upgrade Poetry dependencies [repos/cloud/toolforge/components-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-cli/-/merge_requests/103 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:02:36] (03approved) 10raymond-ndibe: build: Upgrade Poetry dependencies [repos/cloud/toolforge/components-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-cli/-/merge_requests/103 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:02:40] (03update) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/jobs-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-cli/-/merge_requests/186 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:02:45] (03approved) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/jobs-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-cli/-/merge_requests/186 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:02:48] (03merge) 10raymond-ndibe: build: Upgrade Poetry dependencies [repos/cloud/toolforge/components-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-cli/-/merge_requests/103 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:02:52] (03update) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/209 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:02:56] (03approved) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/209 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:03:00] (03merge) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/jobs-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-cli/-/merge_requests/186 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:03:05] (03update) 10raymond-ndibe: build: Upgrade Poetry dependencies [repos/cloud/toolforge/logs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/logs-api/-/merge_requests/51 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:03:09] (03approved) 10raymond-ndibe: build: Upgrade Poetry dependencies [repos/cloud/toolforge/logs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/logs-api/-/merge_requests/51 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:03:17] (03merge) 10raymond-ndibe: build: Upgrade Poetry dependencies [repos/cloud/toolforge/logs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/logs-api/-/merge_requests/51 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:06:02] 10Tool-wordcloud: Use Wikidata Labels alone, No need to split words - https://phabricator.wikimedia.org/T443220 (10Manojk) 03NEW [12:06:21] (03update) 10raymond-ndibe: build: Upgrade Poetry dependencies [repos/cloud/toolforge/logs-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/logs-cli/-/merge_requests/20 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:06:26] (03approved) 10raymond-ndibe: build: Upgrade Poetry dependencies [repos/cloud/toolforge/logs-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/logs-cli/-/merge_requests/20 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:06:47] (03update) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/misctools-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/misctools-cli/-/merge_requests/26 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:06:51] (03open) 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce: jobs-api: bump to 0.0.576-20261102120046-7cfdc5d4 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1485 [12:06:55] (03merge) 10raymond-ndibe: build: Upgrade Poetry dependencies [repos/cloud/toolforge/logs-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/logs-cli/-/merge_requests/20 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:06:59] (03update) 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce: jobs-api: bump to 0.0.576-20261102120046-7cfdc5d4 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1485 [12:07:03] (03approved) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/misctools-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/misctools-cli/-/merge_requests/26 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:07:07] (03update) 10raymond-ndibe: build: Upgrade Poetry dependencies [repos/cloud/toolforge/alerts-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/alerts-api/-/merge_requests/14 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:07:11] (03open) 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce: components-api: bump to 0.0.228-20261102120212-bacedefe [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1486 [12:07:19] (03CR) 10CI reject: [V:04-1] Localisation updates from https://translatewiki.net. [labs/tools/commons-mass-description] - 10https://gerrit.wikimedia.org/r/1361385 (owner: 10L10n-bot) [12:07:23] (03update) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/components-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-cli/-/merge_requests/100 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:07:31] (03open) 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce: envvars-api: bump to 0.0.91-20261102115833-5d4ddff4 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1487 [12:07:35] (03merge) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/misctools-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/misctools-cli/-/merge_requests/26 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:07:39] (03approved) 10raymond-ndibe: build: Upgrade Poetry dependencies [repos/cloud/toolforge/alerts-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/alerts-api/-/merge_requests/14 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:07:47] (03update) 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce: components-api: bump to 0.0.228-20261102120212-bacedefe [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1486 [12:07:51] (03update) 10raymond-ndibe: build: Upgrade Poetry dependencies [repos/cloud/toolforge/replica-cnf] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/replica-cnf/-/merge_requests/6 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:07:59] (03approved) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/components-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-cli/-/merge_requests/100 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:08:07] (03update) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/logs-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/logs-cli/-/merge_requests/19 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:08:11] (03update) 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce: envvars-api: bump to 0.0.91-20261102115833-5d4ddff4 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1487 [12:08:15] (03approved) 10raymond-ndibe: build: Upgrade Poetry dependencies [repos/cloud/toolforge/replica-cnf] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/replica-cnf/-/merge_requests/6 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:08:25] (03approved) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/logs-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/logs-cli/-/merge_requests/19 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:08:29] (03update) 10raymond-ndibe: build: Upgrade Poetry dependencies [repos/cloud/toolforge/alerts-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/alerts-api/-/merge_requests/14 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:08:46] (03open) 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce: maintain-kubeusers: bump to 0.0.204-20261102120232-9501a8a8 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1488 [12:08:50] (03update) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/components-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-cli/-/merge_requests/100 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:08:54] (03update) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/logs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/logs-api/-/merge_requests/48 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:09:02] (03update) 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce: maintain-kubeusers: bump to 0.0.204-20261102120232-9501a8a8 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1488 [12:09:06] (03open) 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce: envvars-admission: bump to 0.0.44-20261102115937-514d5978 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1489 [12:09:16] (03approved) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/logs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/logs-api/-/merge_requests/48 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:09:22] (03open) 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce: volume-admission: bump to 0.0.90-20261102115905-9b89b648 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1490 [12:09:26] (03open) 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce: ingress-admission: bump to 0.0.92-20261102120210-2bbef1d4 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1491 [12:09:30] (03update) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/logs-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/logs-cli/-/merge_requests/19 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:09:34] (03update) 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce: envvars-admission: bump to 0.0.44-20261102115937-514d5978 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1489 [12:09:42] (03open) 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce: registry-admission: bump to 0.0.82-20261102120221-e37faecf [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1492 [12:09:54] (03approved) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/builds-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/builds-api/-/merge_requests/170 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:09:58] (03update) 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce: volume-admission: bump to 0.0.90-20261102115905-9b89b648 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1490 [12:10:03] (03merge) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/builds-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/builds-api/-/merge_requests/170 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:10:07] (03update) 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce: ingress-admission: bump to 0.0.92-20261102120210-2bbef1d4 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1491 [12:10:11] (03merge) 10raymond-ndibe: build: Upgrade Poetry dependencies [repos/cloud/toolforge/maintain-harbor] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/maintain-harbor/-/merge_requests/78 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:10:19] (03merge) 10raymond-ndibe: build: Upgrade Poetry dependencies [repos/cloud/toolforge/api-gateway] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/api-gateway/-/merge_requests/111 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:10:23] (03update) 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce: registry-admission: bump to 0.0.82-20261102120221-e37faecf [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1492 [12:10:27] (03merge) 10raymond-ndibe: build: Upgrade Poetry dependencies [repos/cloud/toolforge/envvars-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/envvars-cli/-/merge_requests/122 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:11:05] (03update) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/logs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/logs-api/-/merge_requests/48 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:11:52] (03open) 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce: logs-api: bump to 0.0.59-20261102120546-84e11ef2 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1493 [12:12:09] (03update) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/384 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:12:36] (03update) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/builds-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/builds-cli/-/merge_requests/155 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:13:08] (03update) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/209 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:13:16] (03update) 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce: logs-api: bump to 0.0.59-20261102120546-84e11ef2 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1493 [12:13:47] (03update) 10raymond-ndibe: build: Upgrade Poetry dependencies [repos/cloud/toolforge/replica-cnf] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/replica-cnf/-/merge_requests/6 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:14:15] (03update) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/384 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:14:38] (03merge) 10raymond-ndibe: build: Upgrade Poetry dependencies [repos/cloud/toolforge/alerts-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/alerts-api/-/merge_requests/14 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:14:45] (03merge) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/components-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-cli/-/merge_requests/100 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:15:12] (03merge) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/logs-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/logs-cli/-/merge_requests/19 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:15:30] (03update) 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce: api-gateway: bump to 0.0.112-20261102121143-e1e5d0dd [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1484 [12:16:08] (03update) 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce: api-gateway: bump to 0.0.112-20261102121143-e1e5d0dd [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1484 [12:16:14] (03update) 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce: maintain-harbor: bump to 0.0.79-20261102121143-888c00f7 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1482 [12:16:51] (03update) 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce: maintain-harbor: bump to 0.0.79-20261102121143-888c00f7 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1482 [12:18:16] (03merge) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/builds-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/builds-cli/-/merge_requests/155 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:18:36] (03update) 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce: alerts-api: bump to 0.0.16-20261102121525-533da816 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1481 [12:18:38] (03merge) 10raymond-ndibe: build: Upgrade Poetry dependencies [repos/cloud/toolforge/replica-cnf] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/replica-cnf/-/merge_requests/6 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:18:40] (03merge) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/logs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/logs-api/-/merge_requests/48 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:18:51] (03update) 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce: alerts-api: bump to 0.0.16-20261102121525-533da816 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1481 [12:21:35] (03merge) 10raymond-ndibe: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/384 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [12:21:36] (03update) 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce: builds-api: bump to 0.0.223-20261102121145-d6532fb9 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1462 [12:21:37] (03update) 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce: logs-api: bump to 0.0.60-20261102121901-64d4bc00 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1493 [12:21:55] (03update) 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce: builds-api: bump to 0.0.223-20261102121145-d6532fb9 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1462 [12:21:56] (03update) 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce: logs-api: bump to 0.0.60-20261102121901-64d4bc00 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1493 [12:34:13] 10Striker, 06tools-platform-team, 10ChangeProp, 10Citoid, and 22 others: Migrate node-based services in production to node26 - https://phabricator.wikimedia.org/T437512#12501580 (10KartikMistry) Note that the Recommendation-API node version is no longer used in Production. We can decommission it. CC @SBisson [12:38:41] 10Striker, 06tools-platform-team, 10ChangeProp, 10Citoid, and 22 others: Migrate node-based services in production to node26 - https://phabricator.wikimedia.org/T437512#12501603 (10KartikMistry) [12:39:13] 10Striker, 06tools-platform-team, 10ChangeProp, 10Citoid, and 22 others: Migrate node-based services in production to node26 - https://phabricator.wikimedia.org/T437512#12501607 (10KartikMistry) [13:17:16] 10Striker: Striker should support marking all notifications as read at once - https://phabricator.wikimedia.org/T443098#12501796 (10aputhin) [13:17:49] 10Toolforge: Unable to log in to ToolsDB with tool thonmai's credentials (permission denied) - https://phabricator.wikimedia.org/T443135#12501799 (10aputhin) [13:36:43] 10Toolforge, 06tools-platform-team, 10Phabricator-Bot-Requests: Bot for Toolforge GitLab automation - https://phabricator.wikimedia.org/T443233 (10Raymond_Ndibe) 03NEW [13:40:33] 10Toolforge (Push-to-Deploy), 06tools-platform-team, 13Patch-For-Review: jobs-api, jobs-cli: investigate shell / exec into jobs-api containers - https://phabricator.wikimedia.org/T431276#12501886 (10aputhin) p:05Triage→03Medium [13:41:14] 10Toolforge (Push-to-Deploy), 06tools-platform-team, 07Documentation: Write tutorial for migrating build service jobs to push-to-deploy - https://phabricator.wikimedia.org/T437477#12501891 (10aputhin) p:05Triage→03Low [13:44:52] 10Toolforge, 06tools-platform-team: [cicd] auto-create the monthly dependency upgrade task and link the MRs to it - https://phabricator.wikimedia.org/T443234 (10Raymond_Ndibe) 03NEW [13:46:59] 10Toolforge, 06tools-platform-team: [cicd] auto-create the monthly dependency upgrade task and link the MRs to it - https://phabricator.wikimedia.org/T443234#12501951 (10Raymond_Ndibe) [13:47:00] 10Toolforge, 06tools-platform-team, 10Phabricator-Bot-Requests: Bot for Toolforge GitLab automation - https://phabricator.wikimedia.org/T443233#12501952 (10Raymond_Ndibe) [13:47:42] 06tools-infrastructure-team: Create temporary secgroupadmin keystone role - https://phabricator.wikimedia.org/T442554#12501954 (10github-toolforge-bot) andrewbogott opened https://github.com/toolforge/quarry/pull/109 [13:50:01] 10Toolforge, 06tools-platform-team: [cicd] don't add the 'Needs review' label to auto-created MRs - https://phabricator.wikimedia.org/T443238 (10Raymond_Ndibe) 03NEW [13:51:18] 10Tool-recaptime-dev: What is recaptime-dev and how does it advance the goals of the Wikimedia movement? - https://phabricator.wikimedia.org/T418818#12502011 (10ajhalili2006) Hi @bd808 (and others watching this task) — apologies for the eight-month silence on this; school year plus project-admin work got in the... [13:54:17] 10Toolforge, 06tools-platform-team, 10Phabricator-Bot-Requests, 06Release-Engineering-Team (Doing 😎): Bot for Toolforge GitLab automation - https://phabricator.wikimedia.org/T443233#12502032 (10Aklapper) 05Open→03Resolved a:03Aklapper Created @gitlab-toolforge-bot. Conduit API Token in non-public... [13:56:26] (03open) 10raymond-ndibe: toolforge-cd,utils: do not add the 'Needs review' label to bot merge requests [repos/cloud/cicd/gitlab-ci] - 10https://gitlab.wikimedia.org/repos/cloud/cicd/gitlab-ci/-/merge_requests/101 (https://phabricator.wikimedia.org/T443238) [13:56:26] (03update) 10raymond-ndibe: toolforge-cd,utils: do not add the 'Needs review' label to bot merge requests [repos/cloud/cicd/gitlab-ci] - 10https://gitlab.wikimedia.org/repos/cloud/cicd/gitlab-ci/-/merge_requests/101 (https://phabricator.wikimedia.org/T443238) [13:56:47] (03update) 10raymond-ndibe: toolforge-cd,utils: do not add the 'Needs review' label to bot merge requests [repos/cloud/cicd/gitlab-ci] - 10https://gitlab.wikimedia.org/repos/cloud/cicd/gitlab-ci/-/merge_requests/101 (https://phabricator.wikimedia.org/T443238) [13:59:54] 10Tool-Pageviews: Massviews fails with "Error querying the replica database" when the source is a Commons category - https://phabricator.wikimedia.org/T443242#12502084 (10Thryduulf) [14:00:01] 10Striker, 06tools-platform-team, 10ChangeProp, 10Charts, and 12 others: Migrate node-based services in production to node22 - https://phabricator.wikimedia.org/T393434#12502082 (10Jdforrester-WMF) [14:00:29] 10Striker, 06tools-platform-team, 10ChangeProp, 10Charts, and 12 others: Migrate node-based services in production to node22 - https://phabricator.wikimedia.org/T393434#12502087 (10Jdforrester-WMF) [14:00:43] 10PAWS, 06tools-infrastructure-team: PAWS outage 2026-10-18 - https://phabricator.wikimedia.org/T441568#12502094 (10Andrew) 05Open→03Resolved a:03Andrew Many things have changed since this issue including a total redeploy of PAWs on a new k8s version. [14:04:28] (03open) 10raymond-ndibe: utils,README: clean up references to 'Needs review' label [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1494 (https://phabricator.wikimedia.org/T443238) [14:05:20] (03update) 10raymond-ndibe: utils,README: clean up references to 'Needs review' label [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1494 (https://phabricator.wikimedia.org/T443238) [14:11:14] 10Toolforge, 06tools-platform-team, 10Phabricator-Bot-Requests, 06Release-Engineering-Team (Doing 😎): Bot for Toolforge GitLab automation - https://phabricator.wikimedia.org/T443233#12502156 (10Raymond_Ndibe) >>! In T443233#12502032, @Aklapper wrote: > Created @gitlab-toolforge-bot. Conduit API Token i... [14:14:31] 10PAWS, 06tools-platform-team, 10Pywikibot: Credential issues when running Pywikibot on PAWS - https://phabricator.wikimedia.org/T443189#12502162 (10Comander123x) @Aklapper sorry i used Grammarly to improve my tone and wording 😅.! [14:16:24] 06tools-infrastructure-team: Create temporary secgroupadmin keystone role - https://phabricator.wikimedia.org/T442554#12502168 (10github-toolforge-bot) andrewbogott closed https://github.com/toolforge/quarry/pull/109 [14:17:36] 10Toolforge, 06tools-platform-team: [cicd] auto-create the monthly dependency upgrade task and link the MRs to it - https://phabricator.wikimedia.org/T443234#12502172 (10Raymond_Ndibe) 05Open→03In progress [14:17:38] 10Toolforge, 06tools-platform-team, 13Patch-For-Review: [cicd] don't add the 'Needs review' label to auto-created MRs - https://phabricator.wikimedia.org/T443238#12502170 (10Raymond_Ndibe) 05Open→03In progress [14:18:20] 10PAWS, 06tools-platform-team, 10Pywikibot: Credential issues when running Pywikibot on PAWS - https://phabricator.wikimedia.org/T443189#12502175 (10Comander123x) @Xqt Yup, i am new to open source, but i am good at python & it's LIBs. So i think i should give it a try.!! [14:19:31] 10Toolforge, 06tools-platform-team: Delete cloud PetScan infrastructure - https://phabricator.wikimedia.org/T443245 (10magnusmanske) 03NEW [14:20:43] 10Cloud-VPS, 06tools-infrastructure-team: Retire petscan.wmcloud.org and forward to petscan.toolforge.org - https://phabricator.wikimedia.org/T442887#12502191 (10taavi) [14:20:50] 10Cloud-VPS, 06tools-infrastructure-team: Delete cloud PetScan infrastructure - https://phabricator.wikimedia.org/T443245#12502192 (10taavi) [14:21:13] !log taavi@cloudcumin1001 petscan START - Cookbook wmcs.vps.delete_project for project petscan in eqiad1 (T443245) [14:21:14] 10Cloud-VPS, 06tools-infrastructure-team: Delete cloud PetScan infrastructure - https://phabricator.wikimedia.org/T443245#12502207 (10taavi) a:03taavi [14:21:15] !log taavi@cloudcumin1001 petscan END (FAIL) - Cookbook wmcs.vps.delete_project (exit_code=99) for project petscan in eqiad1 (T443245) [14:21:17] T443245: Delete cloud PetScan infrastructure - https://phabricator.wikimedia.org/T443245 [14:22:00] !log taavi@cloudcumin1001 petscan START - Cookbook wmcs.vps.remove_instance for instance petscan5 [14:22:06] FIRING: TargetDown: Job flask is unreachable in project quarry instance quarry.wmcloud.org:443 - https://prometheus-alerts.wmcloud.org/?q=alertname%3DTargetDown [14:22:13] !log taavi@cloudcumin1001 petscan END (PASS) - Cookbook wmcs.vps.remove_instance (exit_code=0) for instance petscan5 [14:22:18] !log taavi@cloudcumin1001 petscan START - Cookbook wmcs.vps.delete_project for project petscan in eqiad1 (T443245) [14:22:20] !log taavi@cloudcumin1001 petscan END (FAIL) - Cookbook wmcs.vps.delete_project (exit_code=99) for project petscan in eqiad1 (T443245) [14:23:23] !log taavi@cloudcumin1001 petscan START - Cookbook wmcs.vps.delete_project for project petscan in eqiad1 (T443245) [14:23:45] (03update) 10group_199_bot_f98be072172e323ae6d1441939d3e461: projects: delete project petscan [repos/cloud/cloud-vps/tofu-infra] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/371 (https://phabricator.wikimedia.org/T443245) [14:23:45] (03open) 10group_199_bot_f98be072172e323ae6d1441939d3e461: projects: delete project petscan [repos/cloud/cloud-vps/tofu-infra] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/371 (https://phabricator.wikimedia.org/T443245) [14:24:27] (03merge) 10taavi: projects: delete project petscan [repos/cloud/cloud-vps/tofu-infra] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/371 (https://phabricator.wikimedia.org/T443245) (owner: 10group_199_bot_f98be072172e323ae6d1441939d3e461) [14:24:55] !log taavi@cloudcumin1001 petscan END (PASS) - Cookbook wmcs.vps.delete_project (exit_code=0) for project petscan in eqiad1 (T443245) [14:25:41] 10Cloud-VPS, 06tools-infrastructure-team, 13Patch-For-Review: Delete cloud PetScan infrastructure - https://phabricator.wikimedia.org/T443245#12502256 (10taavi) 05Open→03Resolved [14:25:51] 06tools-infrastructure-team: Create temporary secgroupadmin keystone role - https://phabricator.wikimedia.org/T442554#12502258 (10Andrew) 05Open→03Resolved We've restored normal secgroup controls. I've optimistically removed this role and any app credentials that depended on it. [14:27:06] RESOLVED: TargetDown: Job flask is unreachable in project quarry instance quarry.wmcloud.org:443 - https://prometheus-alerts.wmcloud.org/?q=alertname%3DTargetDown [14:30:01] FIRING: QuarryDown: Quarry application is unreachable - https://prometheus-alerts.wmcloud.org/?q=alertname%3DQuarryDown [14:30:06] FIRING: TargetDown: Job app is unreachable in project quarry instance quarry.wmcloud.org:443 - https://prometheus-alerts.wmcloud.org/?q=alertname%3DTargetDown [14:32:19] 10Cloud-VPS (Quota-requests), 06tools-infrastructure-team, 06Content-Platform-Team (Work In Progress): wikitextexp: Temporarily bump quote to create a new g4.cores32.ram64.disk20 VM to replace ctt-qa-03 - https://phabricator.wikimedia.org/T442643#12502295 (10Andrew) I've reverted this quota bump. [14:32:31] 10Cloud-VPS (Project-requests), 10Tool-recaptime-dev, 10Tool-wiki-labeler-atproto: Request creation of wiki-labeler-atproto VPS project (Trove-only) - https://phabricator.wikimedia.org/T442330#12502299 (10ajhalili2006) Hi @taavi (and anyone else reviewing this) — adding the background on Recap Time Squad and... [14:35:01] RESOLVED: QuarryDown: Quarry application is unreachable - https://prometheus-alerts.wmcloud.org/?q=alertname%3DQuarryDown [14:35:06] RESOLVED: TargetDown: Job app is unreachable in project quarry instance quarry.wmcloud.org:443 - https://prometheus-alerts.wmcloud.org/?q=alertname%3DTargetDown [14:38:39] 10Cloud-VPS, 06tools-infrastructure-team, 07Security: spectre and MDS vulnerabilities on cloud-vps? - https://phabricator.wikimedia.org/T440615#12502329 (10Andrew) 05Open→03Resolved ok :) [14:39:09] 06cloud-services-team, 10Cloud-VPS, 06tools-infrastructure-team, 07Sustainability (Incident Followup): wmcs-backup should not delete backups before taking the new one - https://phabricator.wikimedia.org/T429002#12502335 (10Andrew) 05Open→03Resolved [14:47:49] 10Tool-recaptime-dev: What is recaptime-dev and how does it advance the goals of the Wikimedia movement? - https://phabricator.wikimedia.org/T418818#12502433 (10Aklapper) >>! In T418818#12502011, @ajhalili2006 wrote: > - **Phorge tooling on Toolforge.** Our tool **rtdev-phorge-tools** (https://toolsadmin.wikimed... [14:50:35] 10Tool-recaptime-dev: What is recaptime-dev and how does it advance the goals of the Wikimedia movement? - https://phabricator.wikimedia.org/T418818#12502459 (10taavi) [[ https://www.mediawiki.org/wiki/Bug_management/Phabricator_etiquette | Did you use a language model to write your comment? ]] The question aske... [14:59:40] 10Tool-lingua-datasets, 10Toolforge (Quota-requests), 06tools-platform-team: Setup Lingua-data.toolforge.org with 400GB - https://phabricator.wikimedia.org/T440689#12502502 (10fgiunchedi) Sorry for the delay @Yug ! We dealty with the recent PHP vulnerability as you might be aware. After seeking opinions wit... [15:09:06] FIRING: TargetDown: Job flask is unreachable in project quarry instance quarry.wmcloud.org:443 - https://prometheus-alerts.wmcloud.org/?q=alertname%3DTargetDown [15:13:56] 10PAWS, 06tools-platform-team, 10Pywikibot: Credential issues when running Pywikibot on PAWS - https://phabricator.wikimedia.org/T443189#12502645 (10Xqt) Being good at Python is certainly a good starting point. However, these tasks require more than just Python knowledge. They involve understanding Pywikibot... [15:14:06] RESOLVED: TargetDown: Job flask is unreachable in project quarry instance quarry.wmcloud.org:443 - https://prometheus-alerts.wmcloud.org/?q=alertname%3DTargetDown [15:15:01] FIRING: QuarryDown: Quarry application is unreachable - https://prometheus-alerts.wmcloud.org/?q=alertname%3DQuarryDown [15:15:06] FIRING: TargetDown: Job app is unreachable in project quarry instance quarry.wmcloud.org:443 - https://prometheus-alerts.wmcloud.org/?q=alertname%3DTargetDown [15:20:53] 10Cloud-VPS, 06tools-infrastructure-team, 06tools-platform-team: Investigate periodic bots disconnections - https://phabricator.wikimedia.org/T441765#12502766 (10taavi) [15:22:26] 10Cloud-VPS, 06tools-infrastructure-team: Bump cpu overcommit to 3 or more - https://phabricator.wikimedia.org/T442997#12502787 (10Andrew) I'm fine with this. I did discuss with Belinda the idea of having more visibility into exactly when VMs are getting cycles stolen, but in theory we already have /some/ metr... [15:23:01] 10PAWS, 06tools-platform-team, 07Documentation: Public PAWS notebooks not visible due to server error - https://phabricator.wikimedia.org/T442931#12502793 (10aputhin) p:05Triage→03High a:03fnegri [15:24:21] RESOLVED: TargetDown: Job app is unreachable in project quarry instance quarry.wmcloud.org:443 - https://prometheus-alerts.wmcloud.org/?q=alertname%3DTargetDown [15:25:01] RESOLVED: QuarryDown: Quarry application is unreachable - https://prometheus-alerts.wmcloud.org/?q=alertname%3DQuarryDown [15:26:56] 10Cloud-VPS (Project-requests): Request creation of deorph VPS project - https://phabricator.wikimedia.org/T442348#12502843 (10CristianCantoro) Hi Andrew, We did look at Toolforge. I think our biggest constraint is the storage space and maybe the processing. Currently, we process the dumps and the SQL replicas... [15:29:01] FIRING: QuarryDown: Quarry application is unreachable - https://prometheus-alerts.wmcloud.org/?q=alertname%3DQuarryDown [15:29:06] FIRING: [2x] TargetDown: Job app is unreachable in project quarry instance quarry.wmcloud.org:443 - https://prometheus-alerts.wmcloud.org/?q=alertname%3DTargetDown [15:34:01] RESOLVED: QuarryDown: Quarry application is unreachable - https://prometheus-alerts.wmcloud.org/?q=alertname%3DQuarryDown [15:34:06] RESOLVED: [2x] TargetDown: Job app is unreachable in project quarry instance quarry.wmcloud.org:443 - https://prometheus-alerts.wmcloud.org/?q=alertname%3DTargetDown [15:34:36] FIRING: TargetDown: Job flask is unreachable in project quarry instance quarry.wmcloud.org:443 - https://prometheus-alerts.wmcloud.org/?q=alertname%3DTargetDown [15:39:21] RESOLVED: TargetDown: Job flask is unreachable in project quarry instance quarry.wmcloud.org:443 - https://prometheus-alerts.wmcloud.org/?q=alertname%3DTargetDown [15:42:01] FIRING: QuarryDown: Quarry application is unreachable - https://prometheus-alerts.wmcloud.org/?q=alertname%3DQuarryDown [15:42:06] FIRING: TargetDown: Job app is unreachable in project quarry instance quarry.wmcloud.org:443 - https://prometheus-alerts.wmcloud.org/?q=alertname%3DTargetDown [15:45:01] FIRING: [3x] OpenstackAPIResponse: Openstack API average response time is too high. - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/OpenstackAPIResponse - https://grafana.wikimedia.org/d/UUmLqqX4k - https://alerts.wikimedia.org/?q=alertname%3DOpenstackAPIResponse [15:47:01] RESOLVED: QuarryDown: Quarry application is unreachable - https://prometheus-alerts.wmcloud.org/?q=alertname%3DQuarryDown [15:47:06] RESOLVED: TargetDown: Job app is unreachable in project quarry instance quarry.wmcloud.org:443 - https://prometheus-alerts.wmcloud.org/?q=alertname%3DTargetDown [16:09:35] 10PAWS, 06tools-platform-team, 07Documentation: Public PAWS notebooks not visible due to server error - https://phabricator.wikimedia.org/T442931#12503225 (10aputhin) [16:12:41] 10Tool-wikicrawler: Wiki Crawler: Quiz should jump to the source sentence in the article when an answer is wrong - https://phabricator.wikimedia.org/T443271 (10Adityakumar0545) 03NEW [16:13:37] 10Tool-wikicrawler: Wiki Crawler: Quiz should jump to the source sentence in the article when an answer is wrong - https://phabricator.wikimedia.org/T443271#12503291 (10Jaishsingh913) a:03Jaishsingh913 [16:14:40] 10PAWS, 06tools-platform-team, 07Documentation: Public PAWS notebooks not visible due to server error - https://phabricator.wikimedia.org/T442931#12503300 (10TBurmeister) 05Open→03Resolved Confirmed notebooks are now rendering again now that the larger outage has been resolved. [16:16:07] 10Tool-wikicrawler: Wiki Crawler: generate a 10-question multiple-choice quiz from the crawled article - https://phabricator.wikimedia.org/T442863#12503314 (10Adityakumar0545) 05In progress→03Resolved [16:27:06] FIRING: TargetDown: Job flask is unreachable in project quarry instance quarry.wmcloud.org:443 - https://prometheus-alerts.wmcloud.org/?q=alertname%3DTargetDown [16:32:06] RESOLVED: TargetDown: Job flask is unreachable in project quarry instance quarry.wmcloud.org:443 - https://prometheus-alerts.wmcloud.org/?q=alertname%3DTargetDown [16:40:52] 10Tool-campwiz-nxt, 10Google-Summer-of-Code (2026): GSoC 2026: CampWiz NxT Redesign - https://phabricator.wikimedia.org/T414269#12503504 (10LGoto) 05Open→03Resolved Closing because the 2026 program has ended. [16:59:13] 10Cloud-VPS (Debian Bullseye Deprecation): Migrate etytree away from Debian Bullseye to Bookworm/Trixie - https://phabricator.wikimedia.org/T435770#12503710 (10Andrew) >>! In T435770#12445533, @Epantaleo wrote: > Thanks for your patience. From a search I found that I can use a new Debian instance (Trixie ?) beca... [17:06:06] FIRING: TargetDown: Job flask is unreachable in project quarry instance quarry.wmcloud.org:443 - https://prometheus-alerts.wmcloud.org/?q=alertname%3DTargetDown [17:08:01] FIRING: QuarryDown: Quarry application is unreachable - https://prometheus-alerts.wmcloud.org/?q=alertname%3DQuarryDown [17:11:06] RESOLVED: [2x] TargetDown: Job app is unreachable in project quarry instance quarry.wmcloud.org:443 - https://prometheus-alerts.wmcloud.org/?q=alertname%3DTargetDown [17:12:06] FIRING: TargetDown: Job app is unreachable in project quarry instance quarry.wmcloud.org:443 - https://prometheus-alerts.wmcloud.org/?q=alertname%3DTargetDown [17:12:13] 10Toolforge, 06tools-platform-team, 07OKR-Work: [alerts-api] List all active alerts for a tool - https://phabricator.wikimedia.org/T441144#12503853 (10TLepage-WMF) 05Open→03In progress [17:12:21] 10Toolforge, 06tools-platform-team, 07OKR-Work: [alerts-api] List all active alerts for a tool - https://phabricator.wikimedia.org/T441144#12503857 (10TLepage-WMF) a:03TLepage-WMF [17:13:01] RESOLVED: QuarryDown: Quarry application is unreachable - https://prometheus-alerts.wmcloud.org/?q=alertname%3DQuarryDown [17:13:15] 10Toolforge, 06tools-platform-team, 07OKR-Work: [alerts-api] List a range of previously-active alerts for a tool - https://phabricator.wikimedia.org/T441145#12503873 (10TLepage-WMF) 05Open→03In progress a:03TLepage-WMF [17:14:09] 10Toolforge, 06tools-platform-team, 07OKR-Work: api-gateway: Support bearer-token auth for Striker - https://phabricator.wikimedia.org/T440736#12503890 (10TLepage-WMF) 05Open→03In progress a:03TLepage-WMF [17:16:21] RESOLVED: TargetDown: Job app is unreachable in project quarry instance quarry.wmcloud.org:443 - https://prometheus-alerts.wmcloud.org/?q=alertname%3DTargetDown [17:16:52] 10Toolforge, 06tools-platform-team: [cicd] auto-create the monthly dependency upgrade task and link the MRs to it - https://phabricator.wikimedia.org/T443234#12503904 (10aputhin) p:05Triage→03Low [17:25:33] (03open) 10project_5175_bot_1dc5cd2b4a7cadb6d1af8e29974ce1a7: Göndermeyi yetkili kullanıcılara sınırla [toolforge-repos/kategori] - 10https://gitlab.wikimedia.org/toolforge-repos/kategori/-/merge_requests/8 [17:27:33] (03update) 10project_5175_bot_1dc5cd2b4a7cadb6d1af8e29974ce1a7: Göndermeyi yetkili kullanıcılara sınırla [toolforge-repos/kategori] - 10https://gitlab.wikimedia.org/toolforge-repos/kategori/-/merge_requests/8 [17:29:58] (03merge) 10sadrettin: Göndermeyi yetkili kullanıcılara sınırla [toolforge-repos/kategori] - 10https://gitlab.wikimedia.org/toolforge-repos/kategori/-/merge_requests/8 (owner: 10project_5175_bot_1dc5cd2b4a7cadb6d1af8e29974ce1a7) [17:32:02] 10Toolforge, 06tools-platform-team, 07Epic, 07OKR-Work: ST5.4.2 Toolforge Alerting System - https://phabricator.wikimedia.org/T432860#12503982 (10fnegri) 05In progress→03Resolved //Note: we are experimenting with cross-posting to Phabricator the weekly report that previously was only posted to Asan... [17:44:29] (03open) 10project_5175_bot_1dc5cd2b4a7cadb6d1af8e29974ce1a7: Kuyruk sayfasını anıtlara göre grupla ve renklendir [toolforge-repos/kategori] - 10https://gitlab.wikimedia.org/toolforge-repos/kategori/-/merge_requests/9 [17:44:30] (03update) 10project_5175_bot_1dc5cd2b4a7cadb6d1af8e29974ce1a7: Kuyruk sayfasını anıtlara göre grupla ve renklendir [toolforge-repos/kategori] - 10https://gitlab.wikimedia.org/toolforge-repos/kategori/-/merge_requests/9 [17:48:22] 06cloud-services-team, 10Toolforge, 06tools-platform-team: New upstream release for Pywikibot - https://phabricator.wikimedia.org/T439635#12504063 (10fnegri) a:03fnegri [17:48:24] 06cloud-services-team, 10Toolforge, 06tools-platform-team: New upstream release for Pywikibot - https://phabricator.wikimedia.org/T439635#12504065 (10fnegri) 05Open→03In progress [17:48:55] 06cloud-services-team, 10PAWS, 06tools-platform-team: New upstream release for Pywikibot - https://phabricator.wikimedia.org/T435704#12504067 (10fnegri) 05Open→03In progress [17:49:02] 06cloud-services-team, 10PAWS, 06tools-platform-team: New upstream release for Pywikibot - https://phabricator.wikimedia.org/T435704#12504071 (10fnegri) a:03fnegri [17:51:10] (03update) 10project_5175_bot_1dc5cd2b4a7cadb6d1af8e29974ce1a7: Kuyruk sayfasını anıtlara göre grupla ve renklendir [toolforge-repos/kategori] - 10https://gitlab.wikimedia.org/toolforge-repos/kategori/-/merge_requests/9 [17:54:10] 10Cloud-VPS (Project-requests): Request creation of deorph VPS project - https://phabricator.wikimedia.org/T442348#12504098 (10Bancherx) Hi Andrew, we use a rust pipeline with SQLite, C++/fastText, the inputs are official Wikimedia SQL, MediaWiki History and current-content XML dumps. We download and run locally... [17:56:10] (03merge) 10sadrettin: Kuyruk sayfasını anıtlara göre grupla ve renklendir [toolforge-repos/kategori] - 10https://gitlab.wikimedia.org/toolforge-repos/kategori/-/merge_requests/9 (owner: 10project_5175_bot_1dc5cd2b4a7cadb6d1af8e29974ce1a7) [18:13:49] 10Cloud-VPS, 06tools-infrastructure-team: magnum-cluster-api: understand and back up tenant cluster state - https://phabricator.wikimedia.org/T440363#12504287 (10Andrew) I did not follow any of the suggestions from IRC; because we're using k3s and sqlite I'm just making a raw copy of the sqlite db (which is wh... [18:14:55] 10Cloud-VPS, 06tools-infrastructure-team: magnum-cluster-api: understand and back up tenant cluster state - https://phabricator.wikimedia.org/T440363#12504289 (10Andrew) I know from past experience that deleting a cluster goes badly if the capi cluster has been recycled. So, my test is: * Create a user cluste... [18:23:01] FIRING: QuarryDown: Quarry application is unreachable - https://prometheus-alerts.wmcloud.org/?q=alertname%3DQuarryDown [18:23:06] FIRING: TargetDown: Job app is unreachable in project quarry instance quarry.wmcloud.org:443 - https://prometheus-alerts.wmcloud.org/?q=alertname%3DTargetDown [18:28:01] RESOLVED: QuarryDown: Quarry application is unreachable - https://prometheus-alerts.wmcloud.org/?q=alertname%3DQuarryDown [18:28:06] RESOLVED: TargetDown: Job app is unreachable in project quarry instance quarry.wmcloud.org:443 - https://prometheus-alerts.wmcloud.org/?q=alertname%3DTargetDown [18:34:01] FIRING: QuarryDown: Quarry application is unreachable - https://prometheus-alerts.wmcloud.org/?q=alertname%3DQuarryDown [18:34:06] FIRING: TargetDown: Job app is unreachable in project quarry instance quarry.wmcloud.org:443 - https://prometheus-alerts.wmcloud.org/?q=alertname%3DTargetDown [18:39:01] RESOLVED: QuarryDown: Quarry application is unreachable - https://prometheus-alerts.wmcloud.org/?q=alertname%3DQuarryDown [18:39:06] RESOLVED: TargetDown: Job app is unreachable in project quarry instance quarry.wmcloud.org:443 - https://prometheus-alerts.wmcloud.org/?q=alertname%3DTargetDown [18:41:16] 06cloud-services-team, 10Toolforge, 06tools-platform-team: New upstream release for Pywikibot - https://phabricator.wikimedia.org/T439635#12504553 (10fnegri) 05In progress→03Resolved Updated to `Release version: 11.10.0`. [18:42:16] 10Tool-lingua-datasets, 10Toolforge (Quota-requests), 06tools-platform-team: Setup Lingua-data.toolforge.org with 400GB - https://phabricator.wikimedia.org/T440689#12504563 (10Yug) [18:42:22] 06cloud-services-team, 10Toolforge, 06tools-platform-team: New upstream release for Pywikibot - https://phabricator.wikimedia.org/T439635#12504564 (10fnegri) [18:45:22] 06cloud-services-team, 10PAWS, 06tools-platform-team: New upstream release for Pywikibot - https://phabricator.wikimedia.org/T435704#12504593 (10fnegri) https://github.com/toolforge/paws/pull/542 [18:52:17] 10Tool-lingua-datasets, 10Toolforge (Quota-requests), 06tools-platform-team: Setup Lingua-data.toolforge.org with 400GB - https://phabricator.wikimedia.org/T440689#12504616 (10Yug) Hello @fgiunchedi , I guessed you were focused on PHP2SHELL, all good. 👍🏼 A perk of being volunteer developer is we can learn... [19:23:01] FIRING: QuarryDown: Quarry application is unreachable - https://prometheus-alerts.wmcloud.org/?q=alertname%3DQuarryDown [19:23:06] FIRING: TargetDown: Job app is unreachable in project quarry instance quarry.wmcloud.org:443 - https://prometheus-alerts.wmcloud.org/?q=alertname%3DTargetDown [19:28:13] 10wikitech.wikimedia.org: Wikitech static is down with a 502 HTTP error (Bad Gateway) - https://phabricator.wikimedia.org/T427081#12505064 (10Wargo) 05Open→03Resolved a:03Wargo [19:33:01] RESOLVED: QuarryDown: Quarry application is unreachable - https://prometheus-alerts.wmcloud.org/?q=alertname%3DQuarryDown [19:33:06] RESOLVED: TargetDown: Job app is unreachable in project quarry instance quarry.wmcloud.org:443 - https://prometheus-alerts.wmcloud.org/?q=alertname%3DTargetDown [19:41:33] 10Tool-dataweaver: Batch edit & warning note. - https://phabricator.wikimedia.org/T443131#12505181 (10Manojk) Fixed in V1.1.1 [19:42:10] 10Tool-dataweaver: Batch edit & warning note. - https://phabricator.wikimedia.org/T443131#12505184 (10Manojk) 05Open→03Resolved a:03Manojk [19:44:09] 10Cloud-VPS (Project-requests): Request creation of deorph VPS project - https://phabricator.wikimedia.org/T442348#12505222 (10Volans) Thanks both for the details and insights. @Bancherx can the 10GB memory peak be split into multiple workers/jobs or the single process does require that amount of RAM? For the... [19:45:01] FIRING: [3x] OpenstackAPIResponse: Openstack API average response time is too high. - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/OpenstackAPIResponse - https://grafana.wikimedia.org/d/UUmLqqX4k - https://alerts.wikimedia.org/?q=alertname%3DOpenstackAPIResponse [19:52:36] (03PS1) 10Majavah: StewardBot: Set bot mode [labs/tools/stewardbots] - 10https://gerrit.wikimedia.org/r/1361543 [19:52:36] (03PS1) 10Majavah: SULWatcher: Set bot mode [labs/tools/stewardbots] - 10https://gerrit.wikimedia.org/r/1361544 [19:53:43] (03CR) 10CI reject: [V:04-1] SULWatcher: Set bot mode [labs/tools/stewardbots] - 10https://gerrit.wikimedia.org/r/1361544 (owner: 10Majavah) [19:53:45] (03CR) 10CI reject: [V:04-1] StewardBot: Set bot mode [labs/tools/stewardbots] - 10https://gerrit.wikimedia.org/r/1361543 (owner: 10Majavah) [19:54:48] (03PS2) 10Majavah: StewardBot: Set bot mode [labs/tools/stewardbots] - 10https://gerrit.wikimedia.org/r/1361543 [19:54:48] (03PS2) 10Majavah: SULWatcher: Set bot mode [labs/tools/stewardbots] - 10https://gerrit.wikimedia.org/r/1361544 [20:00:01] FIRING: [3x] OpenstackAPIResponse: Openstack API average response time is too high. - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/OpenstackAPIResponse - https://grafana.wikimedia.org/d/UUmLqqX4k - https://alerts.wikimedia.org/?q=alertname%3DOpenstackAPIResponse [21:11:42] 10Cloud-VPS (Debian Bullseye Deprecation), 10Beta-Cluster-Infrastructure, 13Patch-For-Review: Replace Swift hosts: deployment-ms-(be0[78]|fe04) (Bullseye deprecation) - https://phabricator.wikimedia.org/T436476#12505858 (10Southparkfan) I have removed the old backend hosts from `profile::swift::storagehosts`... [21:33:51] 10Cloud-VPS, 06tools-infrastructure-team, 10Beta-Cluster-Infrastructure, 07Puppet: Cannot rollout Trixie hosts in deployment-prep without rm -rf /var/lib/puppet/ssl - https://phabricator.wikimedia.org/T443373#12506006 (10Southparkfan) [22:02:40] 10Cloud-VPS, 06tools-infrastructure-team, 10Beta-Cluster-Infrastructure, 07Puppet: Cannot rollout Trixie hosts in deployment-prep without rm -rf /var/lib/puppet/ssl - https://phabricator.wikimedia.org/T443373#12506104 (10dancy) Thanks for the report @Southparkfan. I'll look into this. [22:40:13] 10Cloud-VPS (Debian Bullseye Deprecation), 10Beta-Cluster-Infrastructure, 13Patch-For-Review: Replace Swift hosts: deployment-ms-(be0[78]|fe04) (Bullseye deprecation) - https://phabricator.wikimedia.org/T436476#12506284 (10Southparkfan) Tentative plan for replacing `deployment-ms-fe04`: - [] Ensure Puppet ru... [22:55:01] FIRING: [2x] OpenstackAPIResponse: Openstack API average response time is too high. - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/OpenstackAPIResponse - https://grafana.wikimedia.org/d/UUmLqqX4k - https://alerts.wikimedia.org/?q=alertname%3DOpenstackAPIResponse [23:00:04] (03approved) 10mugurolevy: feat:implement search by translator [toolforge-repos/wsindex] - 10https://gitlab.wikimedia.org/toolforge-repos/wsindex/-/merge_requests/6 (owner: 10mercyjae) [23:00:10] (03merge) 10mugurolevy: feat:implement search by translator [toolforge-repos/wsindex] - 10https://gitlab.wikimedia.org/toolforge-repos/wsindex/-/merge_requests/6 (owner: 10mercyjae) [23:00:16] RESOLVED: [2x] OpenstackAPIResponse: Openstack API average response time is too high. - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/OpenstackAPIResponse - https://grafana.wikimedia.org/d/UUmLqqX4k - https://alerts.wikimedia.org/?q=alertname%3DOpenstackAPIResponse [23:15:36] (03update) 10rabuma: Add Wikipedia descriptions for books (T430400) [toolforge-repos/wsindex] - 10https://gitlab.wikimedia.org/toolforge-repos/wsindex/-/merge_requests/3 (https://phabricator.wikimedia.org/T430400) [23:20:12] (03update) 10rabuma: Add Wikipedia descriptions for books (T430400) [toolforge-repos/wsindex] - 10https://gitlab.wikimedia.org/toolforge-repos/wsindex/-/merge_requests/3 (https://phabricator.wikimedia.org/T430400)