[02:24:29] 10Cloud-VPS (Quota-requests), 06Moderator-Tools-Team, 10WikiWho: Remove increased quota for project wikiwho - https://phabricator.wikimedia.org/T434023#12190043 (10Raymond_Ndibe) raymond-ndibe@cloudcontrol1006:~$ sudo wmcs-openstack quota show --usage wikiwho ` +-----------------------+--------+--------+----... [02:25:03] 10Cloud-VPS (Quota-requests), 06Moderator-Tools-Team, 10WikiWho: Remove increased quota for project wikiwho - https://phabricator.wikimedia.org/T434023#12190045 (10Raymond_Ndibe) 05Open→03Resolved [03:15:25] FIRING: SystemdUnitFailed: opentofu-infra-diff.service on cloudcontrol2006-dev:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed [04:12:37] (03update) 10raymond-ndibe: models: support publish option [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/180 (https://phabricator.wikimedia.org/T433355) [04:13:27] (03update) 10raymond-ndibe: models: support publish option [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/180 (https://phabricator.wikimedia.org/T433355) [04:14:16] (03update) 10raymond-ndibe: components-api: test continuous job publish [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1367 (https://phabricator.wikimedia.org/T433355) [04:23:28] (03update) 10raymond-ndibe: models: move cmd field out of CommonJob into job-type models [repos/cloud/toolforge/jobs-api] (increase_test_coverage) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/364 [04:24:43] (03update) 10raymond-ndibe: models: move cmd field out of CommonJob into job-type models [repos/cloud/toolforge/jobs-api] (increase_test_coverage) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/364 [04:24:55] (03update) 10raymond-ndibe: models: move cmd field out of CommonJob into job-type models [repos/cloud/toolforge/jobs-api] (increase_test_coverage) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/364 [04:29:36] 10Toolforge (Push-to-Deploy), 06tools-platform-team: jobs-api: move cmd out of common job model - https://phabricator.wikimedia.org/T434165 (10Raymond_Ndibe) 03NEW [04:54:17] (03open) 10andrew: magnum templates: master_lb_enabled = "true" for minimal cluster [repos/cloud/cloud-vps/tofu-infra] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/342 [04:58:39] 10Toolforge (Push-to-Deploy), 06tools-platform-team: [jobs-api] refactor models in preparation for webservice job-type - https://phabricator.wikimedia.org/T434166 (10Raymond_Ndibe) 03NEW [04:59:00] 10Toolforge (Push-to-Deploy), 06tools-platform-team: jobs-api: move cmd out of common job model - https://phabricator.wikimedia.org/T434165#12190182 (10Raymond_Ndibe) 05Open→03Declined [05:00:10] 10Toolforge (Push-to-Deploy), 06tools-platform-team: [jobs-api] refactor models in preparation for webservice job-type - https://phabricator.wikimedia.org/T434166#12190185 (10Raymond_Ndibe) [05:01:11] (03update) 10raymond-ndibe: models: move cmd field out of CommonJob into job-type models [repos/cloud/toolforge/jobs-api] (increase_test_coverage) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/364 (https://phabricator.wikimedia.org/T434166) [06:32:17] (03update) 10raymond-ndibe: models: move cmd field out of CommonJob into job-type models [repos/cloud/toolforge/jobs-api] (increase_test_coverage) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/364 (https://phabricator.wikimedia.org/T434166) [06:32:26] (03update) 10raymond-ndibe: refactor: move observability fields out of CommonJob into ObservabilityJob [repos/cloud/toolforge/jobs-api] (move_cmd_out_of_common_job) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/363 (https://phabricator.wikimedia.org/T434166) [06:33:27] (03update) 10raymond-ndibe: refactor: move observability fields out of CommonJob into ObservabilityJob [repos/cloud/toolforge/jobs-api] (move_cmd_out_of_common_job) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/363 (https://phabricator.wikimedia.org/T434166) [06:33:35] (03update) 10raymond-ndibe: refactor: move observability fields out of CommonJob into ObservabilityJob [repos/cloud/toolforge/jobs-api] (move_cmd_out_of_common_job) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/363 (https://phabricator.wikimedia.org/T434166) [06:42:41] (03update) 10raymond-ndibe: refactor: move observability fields out of CommonJob into ObservabilityJob [repos/cloud/toolforge/jobs-api] (move_cmd_out_of_common_job) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/363 (https://phabricator.wikimedia.org/T434166) [06:42:51] (03update) 10raymond-ndibe: models: support webservice job-type [repos/cloud/toolforge/jobs-api] (models_refactor) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/264 (https://phabricator.wikimedia.org/T428898) [06:46:43] (03update) 10raymond-ndibe: refactor: move observability fields out of CommonJob into ObservabilityJob [repos/cloud/toolforge/jobs-api] (move_cmd_out_of_common_job) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/363 (https://phabricator.wikimedia.org/T434166) [06:46:56] (03update) 10raymond-ndibe: models: support webservice job-type [repos/cloud/toolforge/jobs-api] (models_refactor) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/264 (https://phabricator.wikimedia.org/T428898) [06:48:28] (03update) 10raymond-ndibe: models: move cmd field out of CommonJob into job-type models [repos/cloud/toolforge/jobs-api] (increase_test_coverage) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/364 (https://phabricator.wikimedia.org/T434166) [06:50:49] (03update) 10raymond-ndibe: refactor: move observability fields out of CommonJob into ObservabilityJob [repos/cloud/toolforge/jobs-api] (move_cmd_out_of_common_job) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/363 (https://phabricator.wikimedia.org/T434166) [06:51:01] (03update) 10raymond-ndibe: models: support webservice job-type [repos/cloud/toolforge/jobs-api] (models_refactor) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/264 (https://phabricator.wikimedia.org/T428898) [07:19:30] 10Cloud-VPS (Debian Bullseye Deprecation): Debian Bullseye deprecation extension for statanalyser - https://phabricator.wikimedia.org/T433570#12190315 (10komla) @bd808 Noted [07:58:12] 06cloud-services-team, 10Data-Services, 06tools-platform-team, 06Data-Engineering, and 4 others: Set up x1 replication to Wiki Replicas - https://phabricator.wikimedia.org/T395881#12190402 (10Uzume) It seems like this will affect things like this that are in the works: {T424133}. [08:08:30] 10Toolforge, 06tools-infrastructure-team, 06tools-platform-team: [infra,k8s] Use an autoscaler to shrink down replicas to 0 when not used - https://phabricator.wikimedia.org/T434171 (10dcaro) 03NEW [08:08:47] 10Toolforge, 06tools-infrastructure-team, 06tools-platform-team: [infra,k8s] Use an autoscaler to shrink down replicas to 0 when not used or scale up on high load - https://phabricator.wikimedia.org/T434171#12190433 (10dcaro) [08:13:21] (03update) 10dcaro: models: move cmd field out of CommonJob into job-type models [repos/cloud/toolforge/jobs-api] (increase_test_coverage) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/364 (https://phabricator.wikimedia.org/T434166) (owner: 10raymond-ndibe) [08:16:41] (03update) 10dcaro: start-devenv: don't use recursive on files [repos/cloud/toolforge/lima-kilo] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/lima-kilo/-/merge_requests/336 [08:17:30] (03update) 10dcaro: start-devenv: no need for fancy copy function [repos/cloud/toolforge/lima-kilo] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/lima-kilo/-/merge_requests/336 [08:59:06] (03update) 10dcaro: deployment: added certificate with client rights [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/365 [09:05:03] 06cloud-services-team, 10Cloud-VPS (Debian Bullseye Deprecation): Cloud VPS Debian Bullseye deprecation - https://phabricator.wikimedia.org/T401804#12190555 (10Leaderboard) > Are you still trying to move the project into Toolforge? If so, that is probably the best action right now I am still working on that b... [09:06:05] 10Cloud-VPS (Debian Bullseye Deprecation): Debian Bullseye deprecation extension for statanalyser - https://phabricator.wikimedia.org/T433570#12190558 (10Leaderboard) OK thanks for the context; I did not make any changes so was not sure what happened. [09:08:13] 06cloud-services-team, 10Cloud-VPS (Debian Bullseye Deprecation): Shutdown timeline extension requests for maintained projects - https://phabricator.wikimedia.org/T434103#12190566 (10Leaderboard) [09:08:21] (03update) 10dcaro: deployment: added certificate with client rights [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/365 [09:43:31] (03update) 10dcaro: refactor: move observability fields out of CommonJob into ObservabilityJob [repos/cloud/toolforge/jobs-api] (move_cmd_out_of_common_job) - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/363 (https://phabricator.wikimedia.org/T434166) (owner: 10raymond-ndibe) [09:46:41] (03update) 10dcaro: components-api: test continuous job publish [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1367 (https://phabricator.wikimedia.org/T433355) (owner: 10raymond-ndibe) [10:00:19] (03update) 10dcaro: models: support publish option [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/180 (https://phabricator.wikimedia.org/T433355) (owner: 10raymond-ndibe) [10:04:35] (03update) 10dcaro: api-gateway: allow jobs-api to send logs to logs-api [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1365 [10:09:12] (03update) 10dcaro: api-gateway: allow jobs-api to send logs to logs-api [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1365 [10:10:14] (03update) 10dcaro: api-gateway: allow jobs-api to send logs to logs-api [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1365 [10:12:21] (03update) 10dcaro: api-gateway: allow jobs-api to send logs to logs-api [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1365 [10:12:40] (03update) 10dcaro: api-gateway: allow jobs-api to send logs to logs-api [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1365 [10:16:44] (03update) 10dcaro: auth: Allow specifying allowed urls for superusers [repos/cloud/toolforge/api-gateway] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/api-gateway/-/merge_requests/103 [10:16:54] (03update) 10dcaro: api-gateway: allow jobs-api to send logs to logs-api [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1365 [10:21:34] (03close) 10dcaro: bump_version: improve the message when bumping the version [repos/cloud/toolforge/builds-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/builds-cli/-/merge_requests/142 [10:24:50] (03update) 10dcaro: global: add log write endpoint [repos/cloud/toolforge/logs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/logs-api/-/merge_requests/32 [10:35:17] (03update) 10dcaro: global: add log write endpoint [repos/cloud/toolforge/logs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/logs-api/-/merge_requests/32 [12:29:49] 10VPS-project-Codesearch, 13Patch-For-Review: Allow searching for plain text in CodeSearch - https://phabricator.wikimedia.org/T381325#12191261 (10Krinkle) Works in the UI like this. Nice! https://codesearch-backend.wmcloud.org/core/?q=%5B%5D%3D&i=nope&literal=fosho {F97367297 height=350} Keeping task open... [12:36:23] 10VPS-project-Codesearch, 13Patch-For-Review: Allow searching for plain text in CodeSearch - https://phabricator.wikimedia.org/T381325#12191279 (10Ladsgroup) This patch should do it: https://gerrit.wikimedia.org/r/1321532 amend and merge mercilessly [12:44:04] 10Toolforge, 06tools-platform-team: [lima-kilo] shows error when copying home dirs - https://phabricator.wikimedia.org/T433849#12191316 (10dcaro) MR is https://gitlab.wikimedia.org/repos/cloud/toolforge/lima-kilo/-/merge_requests/336 [12:45:35] (03update) 10dcaro: global: add log write endpoint [repos/cloud/toolforge/logs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/logs-api/-/merge_requests/32 [13:05:18] (03update) 10dcaro: global: add log write endpoint [repos/cloud/toolforge/logs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/logs-api/-/merge_requests/32 [13:15:36] !log andrew@cloudcumin1001 tools START - Cookbook wmcs.toolforge.component.deploy for component cert-manager (T408786) [13:15:42] T408786: Upgrade cert-manager past 1.15 - https://phabricator.wikimedia.org/T408786 [13:20:15] 10Toolforge, 06tools-platform-team: [toolforge-deploy,functional-tests] add a test for cert-manager - https://phabricator.wikimedia.org/T434197 (10dcaro) 03NEW [13:25:03] (03approved) 10tlepage: bump_version: move to trixie [repos/cloud/toolforge/components-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-cli/-/merge_requests/88 (owner: 10dcaro) [13:25:05] (03update) 10tlepage: bump_version: move to trixie [repos/cloud/toolforge/components-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-cli/-/merge_requests/88 (owner: 10dcaro) [13:28:05] 06cloud-services-team, 10Cloud-VPS (Debian Bullseye Deprecation), 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Event-Platform: Upgrade (replace) beta|deployment-prep event platform VPS instances - https://phabricator.wikimedia.org/T429497#12191472 (10tchin) [13:33:34] 06cloud-services-team, 10Cloud-VPS (Debian Bullseye Deprecation), 06Data-Engineering (Q1 FS26/27 July 1st - September 30th), 10Event-Platform: Upgrade (replace) beta|deployment-prep event platform VPS instances - https://phabricator.wikimedia.org/T429497#12191512 (10tchin) So from poking around for a bit,... [13:36:39] !log andrew@cloudcumin1001 tools END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component cert-manager (T408786) [13:36:44] T408786: Upgrade cert-manager past 1.15 - https://phabricator.wikimedia.org/T408786 [13:46:37] (03approved) 10tlepage: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/359 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [13:46:40] (03update) 10tlepage: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/359 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [13:48:37] (03merge) 10andrew: cert-manager: update deploy to 1.20.3 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1355 (https://phabricator.wikimedia.org/T408786) [13:57:02] 06cloud-services-team, 10Toolforge, 06tools-infrastructure-team, 13Patch-For-Review: Upgrade cert-manager past 1.15 - https://phabricator.wikimedia.org/T408786#12191592 (10Andrew) 05Open→03Resolved a:03Andrew 1.20.3 deployed in toolforge, toolforge-deployment patch merged. [14:02:26] 10Toolforge, 06tools-platform-team, 07OKR-Work: [logs-cli,toolforge-cli] Add subcommand toolforge logs to query and retrieve the relevant logs, will have to design a minimal interface to filter by event/subsystem/time/etc. - https://phabricator.wikimedia.org/T432572#12191601 (10CCiufo-WMF) Depends on T434093. [14:13:58] 10Toolforge, 06tools-platform-team: Establish design principles for parity between interfaces (CLI vs REST API) - https://phabricator.wikimedia.org/T434093#12191688 (10dcaro) p:05Triage→03High [14:21:27] 10Toolforge, 06tools-platform-team, 07OKR-Work: [logs-cli] create the new cli/repo/skeleton - https://phabricator.wikimedia.org/T434206 (10dcaro) 03NEW [14:22:18] (03merge) 10dcaro: bump_version: move to trixie [repos/cloud/toolforge/components-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-cli/-/merge_requests/88 [14:23:42] (03open) 10dcaro: d/changelog: bump to 0.0.16 [repos/cloud/toolforge/components-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-cli/-/merge_requests/89 (https://phabricator.wikimedia.org/T408783 https://phabricator.wikimedia.org/T424368 https://phabricator.wikimedia.org/T434050) [14:38:55] 10Tool-wikimedia-attribution, 06App Growth, 06MediaWiki-API-Platform-Team, 06WikipediaApp, 07OKR-Work: Make mobile app store badges more visible on Wikipedia.org portal page - https://phabricator.wikimedia.org/T432758#12191838 (10HCoplin-WMF) [14:39:57] 10Tool-wikimedia-attribution, 06App Growth, 06MediaWiki-API-Platform-Team, 06WikipediaApp, 07OKR-Work: Make mobile app store badges more visible on Wikipedia.org portal page - https://phabricator.wikimedia.org/T432758#12191846 (10HCoplin-WMF) @Volker_E is on deck for code review here :) [14:42:42] 10Tools, 06Commons, 07Community-Wishlist: A set of tools for image editing directly in Wikimedia Commons - https://phabricator.wikimedia.org/T428062#12191866 (10mikez-WMF) @Doc_James absolutely, adding to the toolbar should be the bare minimum and I wonder what else might be possible to make them more visibl... [14:48:19] 10Toolforge, 06tools-platform-team, 07OKR-Work: [logs-cli] create the new cli/repo/skeleton - https://phabricator.wikimedia.org/T434206#12191911 (10dcaro) 05Open→03In progress [14:48:26] 10Toolforge, 06tools-platform-team, 07OKR-Work: [logs-cli] create the new cli/repo/skeleton - https://phabricator.wikimedia.org/T434206#12191913 (10dcaro) p:05Triage→03High [14:51:07] !log dcaro@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component components-cli [14:51:13] !log dcaro@cloudcumin1001 toolsbeta END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component components-cli [14:51:37] (03CR) 10CI reject: [V:04-1] build: Updating mediawiki/mediawiki-codesniffer to 52.0.0 [labs/tools/coverme] - 10https://gerrit.wikimedia.org/r/1321993 (owner: 10Libraryupgrader) [14:52:26] 10Tool-wikimedia-attribution, 06App Growth, 06MediaWiki-API-Platform-Team, 06WikipediaApp, 07OKR-Work: Make mobile app store badges more visible on Wikipedia.org portal page - https://phabricator.wikimedia.org/T432758#12191931 (10pmiazga) So a small issue - the App badges are only on https://www.wikipedi... [15:02:46] (03PS2) 10Umherirrender: build: Updating composer dependencies [labs/tools/coverme] - 10https://gerrit.wikimedia.org/r/1321993 (owner: 10Libraryupgrader) [15:04:13] 10Tool-campwiz-nxt: CampWiz Nxt Redesign: Root Path - https://phabricator.wikimedia.org/T415408#12191965 (10MohammadAlawneh) Hi @Nokib_Sarkar, My name is Mohammad Alawneh, and I am a Computer Science student from Palestine. I am interested in contributing to the CampWiz NxT Redesign project for GSoC 2026.... [15:05:00] 10Tool-wikimedia-attribution, 06App Growth, 06MediaWiki-API-Platform-Team, 06WikipediaApp, 07OKR-Work: Make mobile app store badges more visible on Wikipedia.org portal page - https://phabricator.wikimedia.org/T432758#12191967 (10HCoplin-WMF) The lack of app pages is by design. The app is specifically a... [15:05:16] 10Tool-wikimedia-attribution, 06App Growth, 06MediaWiki-API-Platform-Team, 06WikipediaApp, 07OKR-Work: Make mobile app store badges more visible on Wikipedia.org portal page - https://phabricator.wikimedia.org/T432758#12191969 (10pmiazga) what can be easily achieved is to move the apps container above th... [15:07:33] 10Tool-campwiz-nxt: CampWiz Nxt Redesign: Root Path - https://phabricator.wikimedia.org/T415408#12191972 (10LGoto) Hi @MohammadAlawneh thank you for your interest, however GSoC 2026 is ending soon, so no new microtasks will be accepted for this project. You are welcome to check out the projects in progress i... [15:09:01] 10Tool-wikimedia-attribution, 06App Growth, 06MediaWiki-API-Platform-Team, 06WikipediaApp, 07OKR-Work: Make mobile app store badges more visible on Wikipedia.org portal page - https://phabricator.wikimedia.org/T432758#12191973 (10HCoplin-WMF) Perfect. That proposal of rearranging the footers seems totall... [15:13:41] 10Toolforge, 06tools-platform-team: [components-cli] there's some issue with the versions generated/existing for it - https://phabricator.wikimedia.org/T434215 (10dcaro) 03NEW [15:16:31] 10Toolforge, 06tools-platform-team: [components-cli] there's some issue with the versions generated/existing for it - https://phabricator.wikimedia.org/T434215#12192011 (10dcaro) [15:23:25] (03update) 10dcaro: d/changelog: bump to 0.0.16 [repos/cloud/toolforge/components-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-cli/-/merge_requests/89 (https://phabricator.wikimedia.org/T408783 https://phabricator.wikimedia.org/T424368 https://phabricator.wikimedia.org/T434050) [15:23:39] (03update) 10dcaro: d/changelog: bump to 0.0.17 [repos/cloud/toolforge/components-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-cli/-/merge_requests/89 (https://phabricator.wikimedia.org/T408783 https://phabricator.wikimedia.org/T424368 https://phabricator.wikimedia.org/T434050) [15:26:41] (03update) 10dcaro: d/changelog: bump to 0.0.17 [repos/cloud/toolforge/components-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-cli/-/merge_requests/89 (https://phabricator.wikimedia.org/T408783 https://phabricator.wikimedia.org/T424368 https://phabricator.wikimedia.org/T434050) [15:31:18] !log dcaro@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component components-cli [15:34:08] !log dcaro@cloudcumin1001 toolsbeta END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-cli [15:38:16] 10Toolforge, 06tools-platform-team, 05Cloud-Services-Origin-Team, 07Cloud-Services-Worktype-Maintenance: [image-config] deprecate non-trixie images and make sure we have trixie for all - https://phabricator.wikimedia.org/T434218 (10dcaro) 03NEW p:05Triage→03Medium [15:38:33] 10Toolforge, 06tools-platform-team, 05Cloud-Services-Origin-Team, 07Cloud-Services-Worktype-Maintenance: [image-config] deprecate buster/bullseye images and make sure we have trixie for all - https://phabricator.wikimedia.org/T434218#12192073 (10dcaro) [15:39:15] !log dcaro@cloudcumin1001 tools START - Cookbook wmcs.toolforge.component.deploy for component components-cli [15:39:25] 10Tool-wikinewsie, 07good first task: Wikinewsie i18n - https://phabricator.wikimedia.org/T432938#12192076 (10ZhaoFJx) >>! In T432938#12177034, @Rohitpal08 wrote: > Hello! I'd like to work on this task. > > As I'm a new contributor, my GitLab account (Rohitpal08) is still pending approval, so I'm currently un... [15:40:17] 10Tool-wikinewsie: Show the Phabricator and GitLab badges in the main Wikinewsie UI - https://phabricator.wikimedia.org/T433759#12192080 (10ZhaoFJx) a:03ZhaoFJx [15:40:24] 10Tool-wikinewsie: Show the Phabricator and GitLab badges in the main Wikinewsie UI - https://phabricator.wikimedia.org/T433759#12192082 (10ZhaoFJx) 05Open→03In progress [15:42:29] !log dcaro@cloudcumin1001 tools END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-cli [15:43:03] (03PS1) 10David Caro: aptly: only maintain trixie support [cloud/wmcs-cookbooks] - 10https://gerrit.wikimedia.org/r/1322008 (https://phabricator.wikimedia.org/T434218) [15:43:18] (03approved) 10dcaro: d/changelog: bump to 0.0.17 [repos/cloud/toolforge/components-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-cli/-/merge_requests/89 (https://phabricator.wikimedia.org/T408783 https://phabricator.wikimedia.org/T424368 https://phabricator.wikimedia.org/T434050) [15:43:26] (03merge) 10dcaro: d/changelog: bump to 0.0.17 [repos/cloud/toolforge/components-cli] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-cli/-/merge_requests/89 (https://phabricator.wikimedia.org/T408783 https://phabricator.wikimedia.org/T424368 https://phabricator.wikimedia.org/T434050) [15:45:44] (03approved) 10dcaro: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/359 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [15:45:52] (03merge) 10dcaro: build: Upgrade pre-commit dependencies [repos/cloud/toolforge/jobs-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/359 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [15:46:12] (03approved) 10dcaro: global: upgrade pre-commits [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/177 [15:46:19] (03merge) 10dcaro: global: upgrade pre-commits [repos/cloud/toolforge/components-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/components-api/-/merge_requests/177 [15:46:26] 10Tools, 06Commons, 07Community-Wishlist: A set of tools for image editing directly in Wikimedia Commons - https://phabricator.wikimedia.org/T428062#12192108 (10JSengupta-WMF) I propose we create another section in the toolbar for these editing tools and show them under that. @mikez-WMF do we need to indicat... [15:46:50] (03CR) 10CI reject: [V:04-1] aptly: only maintain trixie support [cloud/wmcs-cookbooks] - 10https://gerrit.wikimedia.org/r/1322008 (https://phabricator.wikimedia.org/T434218) (owner: 10David Caro) [15:47:54] 10Tools, 06Commons, 07Community-Wishlist: A set of tools for image editing directly in Wikimedia Commons - https://phabricator.wikimedia.org/T428062#12192109 (10Doc_James) What do you mean by suggested versus integrated? [15:49:34] (03open) 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce: components-api: bump to 0.0.205-20260806154635-422dea7a [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1368 (https://phabricator.wikimedia.org/T433492) [15:49:40] (03update) 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce: jobs-api: bump to 0.0.557-20260806154611-ac76329a [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1369 [15:49:40] (03open) 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce: jobs-api: bump to 0.0.557-20260806154611-ac76329a [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1369 [15:51:48] 10Tools, 06Commons, 07Community-Wishlist: A set of tools for image editing directly in Wikimedia Commons - https://phabricator.wikimedia.org/T428062#12192125 (10JSengupta-WMF) > long-term it makes sense to look at some metrics (such as click through rates and anything the tools are using to track engagement)... [15:54:32] (03PS2) 10David Caro: aptly: only maintain trixie support [cloud/wmcs-cookbooks] - 10https://gerrit.wikimedia.org/r/1322008 (https://phabricator.wikimedia.org/T434218) [15:55:00] !log dcaro@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component jobs-api [15:55:59] 10Toolforge, 06tools-platform-team: [components-cli] there's some issue with the versions generated/existing for it - https://phabricator.wikimedia.org/T434215#12192129 (10dcaro) [15:56:00] 10Toolforge, 06tools-platform-team: [components-cli] there's some issue with the versions generated/existing for it - https://phabricator.wikimedia.org/T434215#12192130 (10dcaro) 05Open→03Resolved [15:57:42] 10Toolforge, 06tools-platform-team, 13Patch-For-Review: [clis] use trixie to bump versions - https://phabricator.wikimedia.org/T434050#12192137 (10dcaro) [16:07:12] !log dcaro@cloudcumin1001 toolsbeta END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api [16:26:40] !log dcaro@cloudcumin1001 tools START - Cookbook wmcs.toolforge.component.deploy for component jobs-api [16:41:22] !log dcaro@cloudcumin1001 tools END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api [16:43:20] !log dcaro@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component components-api [16:43:22] (03approved) 10dcaro: jobs-api: bump to 0.0.557-20260806154611-ac76329a [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1369 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [16:43:26] (03merge) 10dcaro: jobs-api: bump to 0.0.557-20260806154611-ac76329a [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1369 (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [16:47:57] !log dcaro@cloudcumin1001 toolsbeta END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-api [16:50:28] !log dcaro@cloudcumin1001 tools START - Cookbook wmcs.toolforge.component.deploy for component components-api [16:55:31] !log dcaro@cloudcumin1001 tools END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-api [17:00:05] (03approved) 10dcaro: components-api: bump to 0.0.205-20260806154635-422dea7a [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1368 (https://phabricator.wikimedia.org/T433492) (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [17:00:13] (03update) 10dcaro: components-api: bump to 0.0.205-20260806154635-422dea7a [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1368 (https://phabricator.wikimedia.org/T433492) (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [17:00:51] 06tools-platform-team, 13Patch-For-Review: [components-api] ugrade pre-commit (and ruff) - https://phabricator.wikimedia.org/T433492#12192369 (10dcaro) [17:00:52] 06tools-platform-team, 13Patch-For-Review: [components-api] ugrade pre-commit (and ruff) - https://phabricator.wikimedia.org/T433492#12192370 (10dcaro) 05In progress→03Resolved [17:00:55] (03merge) 10dcaro: components-api: bump to 0.0.205-20260806154635-422dea7a [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1368 (https://phabricator.wikimedia.org/T433492) (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [17:03:46] 10Tool-wikimedia-attribution, 06MediaWiki-API-Platform-Team, 06MediaWiki-Core-Platform-Team, 10MediaWiki-REST-API, 07OKR-Work: Download CTA should be present only on Wikipedia projects - https://phabricator.wikimedia.org/T434214#12192380 (10HCoplin-WMF) [17:04:06] 10Toolforge, 06tools-platform-team: [builds-cli] make `start` the default action - https://phabricator.wikimedia.org/T434228 (10dcaro) 03NEW [17:18:16] 10Toolforge, 06tools-platform-team: [all] first of the month dependency upgrades - https://phabricator.wikimedia.org/T433878#12192483 (10dcaro) [17:18:18] 10Toolforge, 06tools-platform-team: [clis] use trixie to bump versions - https://phabricator.wikimedia.org/T434050#12192484 (10dcaro) [17:18:51] 10Toolforge (Push-to-Deploy), 06tools-platform-team: jobs-api: move cmd out of common job model - https://phabricator.wikimedia.org/T434165#12192505 (10dcaro) 05Declined→03Resolved [17:19:14] 10Toolforge (Push-to-Deploy), 06tools-platform-team: jobs-api: move cmd out of common job model - https://phabricator.wikimedia.org/T434165#12192510 (10dcaro) 05Resolved→03Declined [17:19:59] 10Toolforge, 06tools-platform-team: [clis] use trixie to bump versions - https://phabricator.wikimedia.org/T434050#12192513 (10dcaro) [17:20:00] 10Toolforge, 06tools-platform-team: [components-cli] there's some issue with the versions generated/existing for it - https://phabricator.wikimedia.org/T434215#12192514 (10dcaro) [17:27:02] 10Cloud-VPS (Quota-requests), 10Catalyst (Luka Ijo Pimeja Jan): Quota increase request for project catalyst - https://phabricator.wikimedia.org/T432617#12192534 (10jnuche) [17:29:12] 10Cloud-VPS (Quota-requests), 10Catalyst (Luka Ijo Pimeja Jan): Quota increase request for project catalyst - https://phabricator.wikimedia.org/T432617#12192535 (10jnuche) We have been using the autoscaler in production for a couple of days and things looks stable. I've adapted the quota increase request to ma... [17:32:36] 10Cloud-VPS (Quota-requests), 10Catalyst (Luka Ijo Pimeja Jan): Quota increase request for project catalyst - https://phabricator.wikimedia.org/T432617#12192555 (10jnuche) [17:42:31] (03update) 10danyya: Draft: Resolve T433199 "[TF] Compute aggregated stats for each wiki project version" [toolforge-repos/wiki-gender-stats] (develop) - 10https://gitlab.wikimedia.org/toolforge-repos/wiki-gender-stats/-/merge_requests/96 [17:55:52] 10Tool-wiki-gender-stats: Website unable to access database while dumps ingester is running - https://phabricator.wikimedia.org/T432052#12192712 (10Danya) 05Open→03In progress [17:57:42] 10VPS-project-Wikistats: wikistats broken due to MediaWiki API dropping format=php - https://phabricator.wikimedia.org/T428521#12192720 (10Dzahn) 05Open→03Resolved a:03Dzahn [18:28:53] 10Tool-wiki-gender-stats: Translate language names in genders-by-language page - https://phabricator.wikimedia.org/T426057#12192900 (10Danya) [18:28:54] 10Tool-wiki-gender-stats: [VERSION] 0.4.0 - https://phabricator.wikimedia.org/T432521#12192902 (10Danya) [18:28:55] 10Tool-wiki-gender-stats: [VERSION] 0.5.0 - https://phabricator.wikimedia.org/T432922#12192901 (10Danya) [18:34:53] 10Tool-wiki-gender-stats: Re-integrate Python tests into the CI - https://phabricator.wikimedia.org/T434247 (10Danya) 03NEW [18:38:05] 10Tool-wiki-gender-stats: Re-integrate Python tests into the CI - https://phabricator.wikimedia.org/T434247#12192948 (10Danya) p:05Triage→03Medium [18:42:58] (03CR) 10Jforrester: [C:03+2] build: Updating composer dependencies [labs/tools/coverme] - 10https://gerrit.wikimedia.org/r/1321993 (owner: 10Libraryupgrader) [18:50:34] 10Tool-wiki-gender-stats: Add button to download charts as PNGs - https://phabricator.wikimedia.org/T432545#12192983 (10Danya) [18:51:50] 10Tool-wiki-gender-stats: Add button to download charts as PNGs - https://phabricator.wikimedia.org/T432545#12192987 (10Danya) [19:27:09] FIRING: CephClusterInWarning: Ceph cluster in eqiad is in warning status - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/CephClusterInWarning - https://grafana.wikimedia.org/d/P1tFnn3Mk/wmcs-ceph-eqiad-health?orgId=1&search=open&tag=ceph&tag=health&tag=WMCS - https://alerts.wikimedia.org/?q=alertname%3DCephClusterInWarning [19:36:19] (03update) 10danyya: Draft: Resolve T433199 "[TF] Compute aggregated stats for each wiki project version" [toolforge-repos/wiki-gender-stats] (develop) - 10https://gitlab.wikimedia.org/toolforge-repos/wiki-gender-stats/-/merge_requests/96 [19:37:27] (03update) 10danyya: Resolve T433199 "[TF] Compute aggregated stats for each wiki project version" [toolforge-repos/wiki-gender-stats] (develop) - 10https://gitlab.wikimedia.org/toolforge-repos/wiki-gender-stats/-/merge_requests/96 [19:37:34] (03merge) 10danyya: Resolve T433199 "[TF] Compute aggregated stats for each wiki project version" [toolforge-repos/wiki-gender-stats] (develop) - 10https://gitlab.wikimedia.org/toolforge-repos/wiki-gender-stats/-/merge_requests/96 [19:44:44] 10Tool-wiki-gender-stats, 13Patch-For-Review: [TF] Compute aggregated stats for each wiki project version - https://phabricator.wikimedia.org/T433199#12193096 (10Danya) The code has been updated, now the production database needs no be re-built before closing this ticket. [20:24:30] !log andrew@cloudcumin1001 admin START - Cookbook wmcs.ceph.roll_restart_mon_daemons [20:24:53] !log andrew@cloudcumin1001 admin END (PASS) - Cookbook wmcs.ceph.roll_restart_mon_daemons (exit_code=0) [20:33:33] (03update) 10don-vip: Draft: Add NASA GAPE [toolforge-repos/spacemedia] - 10https://gitlab.wikimedia.org/toolforge-repos/spacemedia/-/merge_requests/33 [20:33:39] RESOLVED: CephClusterInWarning: Ceph cluster in eqiad is in warning status - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/CephClusterInWarning - https://grafana.wikimedia.org/d/P1tFnn3Mk/wmcs-ceph-eqiad-health?orgId=1&search=open&tag=ceph&tag=health&tag=WMCS - https://alerts.wikimedia.org/?q=alertname%3DCephClusterInWarning [20:36:08] 10Tool-wiki-gender-stats: Translate language names in genders-by-language page - https://phabricator.wikimedia.org/T426057#12193291 (10Danya) 05Open→03In progress [20:37:44] (03open) 10danyya: Draft: Resolve T426057 "Translate language names in genders-by-wiki page" [toolforge-repos/wiki-gender-stats] (develop) - 10https://gitlab.wikimedia.org/toolforge-repos/wiki-gender-stats/-/merge_requests/97 [20:38:07] 10Tool-wiki-gender-stats, 13Patch-For-Review: Translate language names in genders-by-wiki page - https://phabricator.wikimedia.org/T426057#12193296 (10Danya) [20:38:20] 10Tool-wiki-gender-stats, 13Patch-For-Review: Translate language names in genders-by-wiki page - https://phabricator.wikimedia.org/T426057#12193298 (10Danya) [20:38:53] 10Cloud-VPS (Quota-requests), 10Catalyst (Luka Ijo Pimeja Jan): Quota increase request for project catalyst - https://phabricator.wikimedia.org/T432617#12193300 (10taavi) +1 [20:47:06] 10Tool-wmf-openapi-linter, 06MediaWiki-API-Platform-Team, 10MediaWiki-REST-API, 07OKR-Work: Create an extended property for UI friendly API module descriptions - https://phabricator.wikimedia.org/T434253 (10HCoplin-WMF) 03NEW [20:47:50] 10Tool-wmf-openapi-linter, 06MediaWiki-API-Platform-Team, 10MediaWiki-REST-API: Update OpenAPI Linter to limit spec descriptions - https://phabricator.wikimedia.org/T433741#12193334 (10HCoplin-WMF) 05Open→03Declined Declining this task. it will be replaced with this approach: {T434253} [20:54:24] 10Cloud-VPS (Quota-requests), 10Catalyst (Luka Ijo Pimeja Jan): Quota increase request for project catalyst - https://phabricator.wikimedia.org/T432617#12193366 (10BLiviero-WMF) +1 [21:10:45] 06cloud-services-team, 10Toolforge, 06tools-platform-team: [disable-tools] Disabled Toolforge tool deletions not occurring - https://phabricator.wikimedia.org/T431241#12193420 (10bd808) `graphbot-frontend 205 days, 21 hours` One thing this definitely raises is that we do not have active monitoring for the d... [21:13:29] 10Toolforge, 06tools-infrastructure-team: [disable-tools] Disabled Toolforge tool deletions not occurring - https://phabricator.wikimedia.org/T431241#12193429 (10taavi) Our friend tool home directory archival strikes again: `lang=shell-session taavi@tools-nfs-3:~$ sudo journalctl -u disable-tool.service --grep... [21:17:26] (03open) 10taavi: Handle tools where home directory was archived without DB updates [repos/cloud/toolforge/disable-tool] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/disable-tool/-/merge_requests/27 (https://phabricator.wikimedia.org/T431241) [21:27:41] !log andrew@cloudcumin1001 catalyst START - Cookbook wmcs.openstack.quota_increase by 64 cores, 1600 gigabytes, 4 instances, 131072 ram, 8 volumes [21:27:48] !log andrew@cloudcumin1001 catalyst END (PASS) - Cookbook wmcs.openstack.quota_increase (exit_code=0) by 64 cores, 1600 gigabytes, 4 instances, 131072 ram, 8 volumes [21:28:10] 10Cloud-VPS (Quota-requests), 10Catalyst (Luka Ijo Pimeja Jan): Quota increase request for project catalyst - https://phabricator.wikimedia.org/T432617#12193483 (10Andrew) 05Open→03Resolved a:03Andrew granted [21:38:41] FIRING: CloudVPSDesignateLeaks: Detected 4 stray dns records - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Designate_record_leaks - https://grafana.wikimedia.org/d/ebJoA6VWz/wmcs-openstack-eqiad-nova-fullstack - https://alerts.wikimedia.org/?q=alertname%3DCloudVPSDesignateLeaks [21:48:41] RESOLVED: CloudVPSDesignateLeaks: Detected 4 stray dns records - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Designate_record_leaks - https://grafana.wikimedia.org/d/ebJoA6VWz/wmcs-openstack-eqiad-nova-fullstack - https://alerts.wikimedia.org/?q=alertname%3DCloudVPSDesignateLeaks [21:55:28] 10Toolforge, 06tools-infrastructure-team, 06tools-platform-team: [infra,k8s] Use an autoscaler to shrink down replicas to 0 when not used or scale up on high load - https://phabricator.wikimedia.org/T434171#12193544 (10bd808) > allow growing replicas when traffic is high Scale up would probably need to be a... [22:43:11] (03update) 10don-vip: Draft: Add NASA GAPE [toolforge-repos/spacemedia] - 10https://gitlab.wikimedia.org/toolforge-repos/spacemedia/-/merge_requests/33 [22:52:48] (03update) 10don-vip: Draft: Add NASA GAPE [toolforge-repos/spacemedia] - 10https://gitlab.wikimedia.org/toolforge-repos/spacemedia/-/merge_requests/33 [23:05:32] 10Tool-wikinewsie: Regional and thematic portals for Wikinewsie - https://phabricator.wikimedia.org/T432162#12193699 (10Habst) 05Open→03In progress a:03Habst [23:12:09] (03update) 10don-vip: Draft: Add NASA GAPE [toolforge-repos/spacemedia] - 10https://gitlab.wikimedia.org/toolforge-repos/spacemedia/-/merge_requests/33 [23:39:34] FIRING: ToolsNfsAlmostFull: Toolforge NFS is almost full - https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolsNfsAlmostFull - https://prometheus-alerts.wmcloud.org/?q=alertname%3DToolsNfsAlmostFull