[00:11:54] 10Tool-wsindex, 10Wikisource Reader App (Android): Catalog update sets view_count to 0 when the pageviews API request fails - https://phabricator.wikimedia.org/T442788 (10RCodes) 03NEW [00:35:56] (03open) 10rabuma: books: Keep the stored view count when the pageviews request fails (T442788) [toolforge-repos/wsindex] - 10https://gitlab.wikimedia.org/toolforge-repos/wsindex/-/merge_requests/17 (https://phabricator.wikimedia.org/T442788) [00:38:23] 10Tool-wsindex, 10Wikisource Reader App (Android), 13Patch-For-Review: Catalog update sets view_count to 0 when the pageviews API request fails - https://phabricator.wikimedia.org/T442788#12487516 (10RCodes) Hi @Bodhisattwa @Saiphani02 @Muguro I created this task after finding the bug and opened a fix for i... [00:42:41] 10Tool-wsindex, 10Wikisource Reader App (Android), 13Patch-For-Review: Catalog update sets view_count to 0 when the pageviews API request fails - https://phabricator.wikimedia.org/T442788#12487536 (10RCodes) a:03RCodes [00:54:50] 10Cloud-VPS, 06tools-infrastructure-team, 06Test Platform (San Miguel de Allende 31): Restore the mediawiki-quickstart Cloud VPS project after PHP2Shell - https://phabricator.wikimedia.org/T442661#12487563 (10Mhurd) Update on the one exception above: quickstart's WikiLambda component test now uses Abstra... [00:56:07] 10Cloud-VPS, 06tools-infrastructure-team, 06Test Platform (San Miguel de Allende 31): Restore the pixel Cloud VPS project after PHP2Shell - https://phabricator.wikimedia.org/T442770#12487568 (10Mhurd) Update on the one exception above: Pixel's WikiLambda project gets its MediaWiki from quickstart, which now... [01:01:55] 10Cloud-VPS, 06tools-infrastructure-team, 06Test Platform (San Miguel de Allende 31): Restore the pixel Cloud VPS project after PHP2Shell - https://phabricator.wikimedia.org/T442770#12487579 (10Mhurd) [01:31:18] (03open) 10pacmand: Sample all-language series monthly to stop the web service running out of memory [toolforge-repos/wsstats] - 10https://gitlab.wikimedia.org/toolforge-repos/wsstats/-/merge_requests/2 [01:53:02] FIRING: [3x] OpenstackAPIResponse: Openstack API average response time is too high. - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/OpenstackAPIResponse - https://grafana.wikimedia.org/d/UUmLqqX4k - https://alerts.wikimedia.org/?q=alertname%3DOpenstackAPIResponse [02:07:26] (03update) 10pacmand: Sample all-language series monthly to stop the web service running out of memory [toolforge-repos/wsstats] - 10https://gitlab.wikimedia.org/toolforge-repos/wsstats/-/merge_requests/2 [02:36:27] (03open) 10ibrahemqasim: Refactor CX token service dependencies [toolforge-repos/mdwiki] - 10https://gitlab.wikimedia.org/toolforge-repos/mdwiki/-/merge_requests/19 [02:55:03] 10Tool-glam-tool-hospital, 10MediaWiki-extensions-Page_Forms: `values from wikidata` should store the underlying QID (while the user still sees and selects a human-readable label) - https://phabricator.wikimedia.org/T430098#12487685 (10Samwilson) [03:14:51] 10Cloud-VPS (Debian Bullseye Deprecation): Migrate wikidocumentaries away from Debian Bullseye to Bookworm/Trixie - https://phabricator.wikimedia.org/T435789#12487705 (10Zache) @komla, current status is that I should back up the wikibase installation (both its local mediawiki wiki content, files + their local wi... [03:26:02] (03merge) 10ibrahemqasim: Refactor CX token service dependencies [toolforge-repos/mdwiki] - 10https://gitlab.wikimedia.org/toolforge-repos/mdwiki/-/merge_requests/19 [03:39:10] (03merge) 10soda: in the "all languages" table, show actually all languages, not just the ones that changed [toolforge-repos/wsstats] - 10https://gitlab.wikimedia.org/toolforge-repos/wsstats/-/merge_requests/1 (owner: 10grapedog) [03:58:27] (03open) 10ibrahemqasim: Add admin SQL console [toolforge-repos/mdwiki] - 10https://gitlab.wikimedia.org/toolforge-repos/mdwiki/-/merge_requests/20 [04:10:09] (03update) 10ibrahemqasim: Add admin SQL console [toolforge-repos/mdwiki] - 10https://gitlab.wikimedia.org/toolforge-repos/mdwiki/-/merge_requests/20 [04:12:03] (03merge) 10ibrahemqasim: Add admin SQL console [toolforge-repos/mdwiki] - 10https://gitlab.wikimedia.org/toolforge-repos/mdwiki/-/merge_requests/20 [04:21:50] 10Cloud-VPS (Debian Bullseye Deprecation): Migrate etytree away from Debian Bullseye to Bookworm/Trixie - https://phabricator.wikimedia.org/T435770#12487756 (10Epantaleo) Thank you! Il mer 28 ott 2026, 23:08 komla ha scritto: > komla added a comment. View Task > (03merge) 10soda: Sample all-language series monthly to stop the web service running out of memory [toolforge-repos/wsstats] - 10https://gitlab.wikimedia.org/toolforge-repos/wsstats/-/merge_requests/2 (owner: 10pacmand) [05:20:39] (03open) 10ibrahemqasim: Add background jobs and OWID chart worker [toolforge-repos/mdwiki] - 10https://gitlab.wikimedia.org/toolforge-repos/mdwiki/-/merge_requests/21 [05:32:29] 10Tool-wikinewsie, 06Release-Engineering-Team, 07Essential-Work, 10GitLab (Account Approval): Requesting GitLab account activation for Wikinewsie Columbia students - https://phabricator.wikimedia.org/T442748#12487805 (10brennen) 05Open→03Resolved a:03brennen Approved - happy hacking to all. [05:53:02] FIRING: [3x] OpenstackAPIResponse: Openstack API average response time is too high. - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/OpenstackAPIResponse - https://grafana.wikimedia.org/d/UUmLqqX4k - https://alerts.wikimedia.org/?q=alertname%3DOpenstackAPIResponse [05:55:24] (03open) 10countcount: Retry through Wikimedia API outages instead of exiting [toolforge-repos/dewiki-rangeblock] - 10https://gitlab.wikimedia.org/toolforge-repos/dewiki-rangeblock/-/merge_requests/39 [05:55:41] (03open) 10countcount: Use the shared .node-audit template for the front-end audit [toolforge-repos/wiki-mail-verify] - 10https://gitlab.wikimedia.org/toolforge-repos/wiki-mail-verify/-/merge_requests/63 [05:55:42] (03update) 10countcount: Use the shared .node-audit template for the front-end audit [toolforge-repos/wiki-mail-verify] - 10https://gitlab.wikimedia.org/toolforge-repos/wiki-mail-verify/-/merge_requests/63 [06:05:15] (03update) 10countcount: Wait out short Wikimedia API outages, exit cleanly on long ones [toolforge-repos/dewiki-rangeblock] - 10https://gitlab.wikimedia.org/toolforge-repos/dewiki-rangeblock/-/merge_requests/39 [06:05:15] (03update) 10countcount: Wait out short Wikimedia API outages, exit cleanly on long ones [toolforge-repos/dewiki-rangeblock] - 10https://gitlab.wikimedia.org/toolforge-repos/dewiki-rangeblock/-/merge_requests/39 [06:08:43] (03merge) 10countcount: Wait out short Wikimedia API outages, exit cleanly on long ones [toolforge-repos/dewiki-rangeblock] - 10https://gitlab.wikimedia.org/toolforge-repos/dewiki-rangeblock/-/merge_requests/39 [06:11:00] (03merge) 10countcount: Use the shared .node-audit template for the front-end audit [toolforge-repos/wiki-mail-verify] - 10https://gitlab.wikimedia.org/toolforge-repos/wiki-mail-verify/-/merge_requests/63 [08:06:24] 06tools-infrastructure-team, 10Beta-Cluster-Infrastructure: Secure deployment-prep against php2shell and restore access - https://phabricator.wikimedia.org/T442482#12488080 (10Volans) >>! In T442482#12486969, @Southparkfan wrote: >>>! In T442482#12486204, @Volans wrote: >> [...] >> The other thing that could b... [08:29:15] 10Data-Services, 06tools-platform-team: ERROR 1356 (HY000): View 'commonswiki_p.globalimagelinks' references invalid table(s) or column(s) or function(s) or definer/invoker of view lack rights to use them - https://phabricator.wikimedia.org/T442452#12488101 (10Northernhenge) >>! In T442452#12475093, @Bawolff w... [08:33:19] 10Cloud-VPS, 06tools-infrastructure-team: please enable wikiapiary - https://phabricator.wikimedia.org/T442662#12488108 (10taavi) 05Open→03Resolved a:03taavi Thank you! The project is back up now. [08:35:47] 10Cloud-VPS, 06tools-infrastructure-team, 06Test Platform (San Miguel de Allende 31): Restore the pixel Cloud VPS project after PHP2Shell - https://phabricator.wikimedia.org/T442770#12488126 (10taavi) 05Open→03Resolved a:03taavi All done, thank you! [08:36:52] 10Cloud-VPS, 06tools-infrastructure-team, 10Catalyst, 06Release-Engineering-Team, 13Patch-For-Review: Restore ingress to patchdemo / catalyst - https://phabricator.wikimedia.org/T442664#12488130 (10Volans) Giving it another pass, will report shortly [08:37:56] 10Cloud-VPS, 06tools-infrastructure-team, 06Wikibase Suite Team, 10Wikidata Vector Database: Re-enable wikidata-dev cloud vps project - https://phabricator.wikimedia.org/T442730#12488131 (10taavi) 05Open→03Resolved a:03taavi All done from our side, thank you! [09:01:33] 10Cloud-VPS, 06tools-infrastructure-team, 10Catalyst, 06Release-Engineering-Team, 13Patch-For-Review: Restore ingress to patchdemo / catalyst - https://phabricator.wikimedia.org/T442664#12488239 (10Volans) @brennen I gave it another pass and that's what's reported. Apart from `k3s-envDB` that doesn't hav... [09:04:56] 10Striker, 06tools-platform-team, 10ChangeProp, 06Data-Engineering, and 14 others: Migrate node-based services in production to node22 - https://phabricator.wikimedia.org/T393434#12488245 (10taavi) The [[ https://gitlab.wikimedia.org/repos/mediawiki/services/chart-renderer | chart-renderer ]] service seems... [09:14:43] 06tools-infrastructure-team, 10Beta-Cluster-Infrastructure: Secure deployment-prep against php2shell and restore access - https://phabricator.wikimedia.org/T442482#12488254 (10taavi) One last thing: what about the Magnum cluster? Do we know if it is not running any user-exposed vulnerable PHP/etc services? (I... [09:23:23] !log tlepage@cloudcumin1001 tools START - Cookbook wmcs.toolforge.component.deploy for component maintain-kubeusers (T441425) [09:23:28] T441425: Request increased quota for oka-bot Toolforge tool - https://phabricator.wikimedia.org/T441425 [09:28:59] !log tlepage@cloudcumin1001 tools END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component maintain-kubeusers (T441425) [09:29:06] T441425: Request increased quota for oka-bot Toolforge tool - https://phabricator.wikimedia.org/T441425 [09:30:28] 10Cloud-VPS, 06tools-infrastructure-team: Make sure keepalived comes back up cleanly on IPv6 on the web proxies after a reboot - https://phabricator.wikimedia.org/T442816 (10taavi) 03NEW [09:33:40] (03merge) 10countcount: Update dependency @types/node to v26 [toolforge-repos/checkusertools] - 10https://gitlab.wikimedia.org/toolforge-repos/checkusertools/-/merge_requests/44 (owner: 10renovatebot) [09:33:46] (03merge) 10countcount: Update dependency @types/node to v26 [toolforge-repos/allblocksever] - 10https://gitlab.wikimedia.org/toolforge-repos/allblocksever/-/merge_requests/46 (owner: 10renovatebot) [09:33:50] (03merge) 10countcount: Update dependency @types/node to v26 [toolforge-repos/namehistory] - 10https://gitlab.wikimedia.org/toolforge-repos/namehistory/-/merge_requests/37 (owner: 10renovatebot) [09:34:02] !log tlepage@cloudcumin1001 tools START - Cookbook wmcs.toolforge.component.deploy for component maintain-kubeusers (T441425) [09:34:08] T441425: Request increased quota for oka-bot Toolforge tool - https://phabricator.wikimedia.org/T441425 [09:48:21] 10Cloud-VPS, 06tools-infrastructure-team: Reclaim floating IPs assigned to deleted projects - https://phabricator.wikimedia.org/T442818 (10taavi) 03NEW [09:49:19] 10Cloud-VPS, 06tools-infrastructure-team: Reclaim floating IPs assigned to deleted projects - https://phabricator.wikimedia.org/T442818#12488400 (10taavi) [09:52:21] !log tlepage@cloudcumin1001 tools END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component maintain-kubeusers (T441425) [09:52:27] T441425: Request increased quota for oka-bot Toolforge tool - https://phabricator.wikimedia.org/T441425 [09:53:02] FIRING: [3x] OpenstackAPIResponse: Openstack API average response time is too high. - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/OpenstackAPIResponse - https://grafana.wikimedia.org/d/UUmLqqX4k - https://alerts.wikimedia.org/?q=alertname%3DOpenstackAPIResponse [09:53:32] (03update) 10tlepage: Increase memory quota for oka-bot [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1474 (https://phabricator.wikimedia.org/T441425) [09:53:43] (03merge) 10tlepage: Increase memory quota for oka-bot [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1474 (https://phabricator.wikimedia.org/T441425) [09:53:45] 10Cloud-VPS, 06tools-infrastructure-team: Reclaim floating IPs assigned to deleted projects - https://phabricator.wikimedia.org/T442818#12488413 (10taavi) `lang=shell-session,lines=10 taavi@cloudcontrol1007 ~ $ os floating ip list --sort-column "Floating IP Address" --format json | jq --argjson 'projects' "$(... [09:56:15] 10Toolforge (Quota-requests), 06tools-platform-team: Request increased quota for oka-bot Toolforge tool - https://phabricator.wikimedia.org/T441425#12488426 (10TLepage-WMF) 05Open→03Resolved a:03TLepage-WMF Hello @7804j, the oka-bot tool now runs with an extended global quota of 16GiB of RAM. Have a... [09:59:31] 10Cloud-VPS, 06tools-infrastructure-team: Reclaim floating IPs assigned to deleted projects - https://phabricator.wikimedia.org/T442818#12488431 (10taavi) 05Open→03Resolved a:03taavi And deleted: `lang=shell-session taavi@cloudcontrol1007 ~ $ os floating ip list --sort-column "Floating IP Address" -... [11:05:08] 10Cloud-VPS, 06tools-infrastructure-team: Re-enable mobileappsperformance - https://phabricator.wikimedia.org/T442825 (10ihurbain) 03NEW [11:07:00] 10Cloud-VPS, 06tools-infrastructure-team: Re-enable mobileappsperformance - https://phabricator.wikimedia.org/T442825#12488724 (10taavi) 05Open→03Resolved a:03taavi Done, thank you! [11:07:27] 10Quarry, 06tools-platform-team: [bug] "commonswiki_p.categorylinks references invalid tables" on a query that ran perfectly fine. - https://phabricator.wikimedia.org/T442826 (10Gone_Postal) 03NEW [11:08:28] 10Quarry, 06tools-platform-team: [bug] "commonswiki_p.categorylinks references invalid tables" on a query that ran perfectly fine. - https://phabricator.wikimedia.org/T442826#12488742 (10Gone_Postal) Example: https://quarry.wmcloud.org/query/61337 [11:36:18] 10Data-Services, 06tools-platform-team: ERROR 1356 (HY000): View 'commonswiki_p.globalimagelinks' references invalid table(s) or column(s) or function(s) or definer/invoker of view lack rights to use them - https://phabricator.wikimedia.org/T442452#12488841 (10Bugreporter) [11:36:20] 10Quarry, 06tools-platform-team: [bug] "commonswiki_p.categorylinks references invalid tables" on a query that ran perfectly fine. - https://phabricator.wikimedia.org/T442826#12488844 (10Bugreporter) →14Duplicate dup:03T442452 [11:52:40] 10Toolforge, 06tools-platform-team: [infra,k8s] Some pods are stuck in Error, preventing new cronjobs from starting - https://phabricator.wikimedia.org/T442169#12488899 (10Superyetkin) @dcaro Yes, I think this is fixed. Thanks. [11:54:31] 10Toolforge, 06tools-platform-team: [infra,k8s] Some pods are stuck in Error, preventing new cronjobs from starting - https://phabricator.wikimedia.org/T442169#12488903 (10aputhin) 05Open→03Resolved p:05Triage→03Medium [12:03:35] 10Cloud-VPS (Quota-requests): Temporarily add 12 TB to "maps" Cloud VPS project quota for psql 13 to 18 migration - https://phabricator.wikimedia.org/T442480#12488943 (10Aklapper) [12:05:22] (03CR) 10CI reject: [V:04-1] Localisation updates from https://translatewiki.net. [labs/xtools] - 10https://gerrit.wikimedia.org/r/1357726 (owner: 10L10n-bot) [12:06:24] 10Cloud-VPS (Debian Bullseye Deprecation): Migrate maps-osmdb from bullseye to trixie - https://phabricator.wikimedia.org/T432955#12489060 (10Aklapper) [12:07:08] 10Tool-spacemedia, 10Toolforge, 06tools-platform-team, 13Patch-For-Review: Update Toolforge Deploy to Heroku 24_0.21.20+ to get openjdk 27 support - https://phabricator.wikimedia.org/T439154#12489148 (10fnegri) 05Open→03Resolved a:05fnegri→03dcaro [12:15:08] 10Toolforge, 06tools-platform-team: [toolsdb] Upgrade to MariaDB 10.11 - https://phabricator.wikimedia.org/T434679#12489227 (10fnegri) [12:31:09] 10Cloud-VPS, 06tools-infrastructure-team: Re-audit math CloudVPS project - https://phabricator.wikimedia.org/T442858 (10Ihlec) 03NEW [12:36:26] 10Tools, 03Wikimedia Hackathon 2027: Wikimedia Hackathon 2027: WikiJelajah – making it easier for newcomers to find and fill gaps in Wikidata - https://phabricator.wikimedia.org/T442808#12489337 (10Aklapper) [12:37:50] 10Tools, 03Wikimedia Hackathon 2027: HarvestNext: A Reliable Successor to Harvest Templates for Wikidata - https://phabricator.wikimedia.org/T440818#12489359 (10Aklapper) [12:47:52] 10Quarry, 06tools-platform-team: Quarry retruns results deleted several days ago - https://phabricator.wikimedia.org/T442801#12489386 (10Aklapper) This seems to be about Quarry instead [12:48:23] 10Quarry, 06tools-platform-team: Quarry returns results deleted several days ago - https://phabricator.wikimedia.org/T442801#12489389 (10Aklapper) [12:48:25] 10Toolforge, 06tools-platform-team: [toolsdb] Upgrade to MariaDB 10.11 - https://phabricator.wikimedia.org/T434679#12489390 (10Kristbaum) Django dropped support in 6.1, which is a bit of a problem for me as well: https://docs.djangoproject.com/en/6.1/releases/6.1/#dropped-support-for-mariadb-10-11 [13:11:10] 10Tools, 03Wikimedia Hackathon 2027: Wikimedia Hackathon 2027: WikiJelajah – making it easier for newcomers to find and fill gaps in Wikidata - https://phabricator.wikimedia.org/T442808#12489472 (10affandymurad) a:03affandymurad [13:20:02] 10Tool-wikicrawler: Wiki Crawler: generate a 10-question multiple-choice quiz from the crawled article - https://phabricator.wikimedia.org/T442863 (10Jaishsingh913) 03NEW [13:20:34] 10Tool-wikicrawler: Wiki Crawler: generate a 10-question multiple-choice quiz from the crawled article - https://phabricator.wikimedia.org/T442863#12489518 (10Adityakumar0545) a:03Adityakumar0545 [13:50:35] 10Toolforge, 06tools-platform-team: [toolsdb] Upgrade to MariaDB 10.11 - https://phabricator.wikimedia.org/T434679#12489673 (10fnegri) [13:53:02] FIRING: [3x] OpenstackAPIResponse: Openstack API average response time is too high. - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/OpenstackAPIResponse - https://grafana.wikimedia.org/d/UUmLqqX4k - https://alerts.wikimedia.org/?q=alertname%3DOpenstackAPIResponse [13:54:47] 10Cloud-VPS, 06tools-infrastructure-team: Add admin-only disable function to individual Cloud VPS web proxies - https://phabricator.wikimedia.org/T442870 (10taavi) 03NEW [14:01:03] 10Toolforge, 06tools-platform-team, 07OKR-Work, 13Patch-For-Review: Read the opted-in tools from components-api - https://phabricator.wikimedia.org/T439554#12489721 (10fnegri) > This is ready to be deployed, but we should deploy it at the same time of the announcement to users, draft is at https://etherpad... [14:01:16] (03open) 10psubhashish: Style guide notes, marks and italics for language switches [toolforge-repos/subtitler] - 10https://gitlab.wikimedia.org/toolforge-repos/subtitler/-/merge_requests/23 [14:03:33] (03update) 10psubhashish: Style guide notes, marks and italics for language switches [toolforge-repos/subtitler] - 10https://gitlab.wikimedia.org/toolforge-repos/subtitler/-/merge_requests/23 [14:03:59] (03update) 10psubhashish: Style guide notes, marks and italics for language switches [toolforge-repos/subtitler] - 10https://gitlab.wikimedia.org/toolforge-repos/subtitler/-/merge_requests/23 [14:18:09] 10Cloud-VPS (Quota-requests), 06tools-infrastructure-team, 06Content-Platform-Team (Work In Progress): wikitextexp: Temporarily bump quote to create a new g4.cores32.ram64.disk20 VM to replace ctt-qa-03 - https://phabricator.wikimedia.org/T442643#12489851 (10SLopes-WMF) [14:18:40] 10Toolforge, 06tools-platform-team: [toolsdb] Upgrade to MariaDB 10.11 - https://phabricator.wikimedia.org/T434679#12489865 (10DamianZaremba) >>! In T434679#12489390, @Kristbaum wrote: > Django dropped support in 6.1, which is a bit of a problem for me as well: https://docs.djangoproject.com/en/6.1/releases/6.... [14:18:42] 06cloud-services-team, 10Cloud-VPS, 06tools-infrastructure-team: [trove] MariaDB 10.6 support - https://phabricator.wikimedia.org/T417494#12489867 (10DamianZaremba) 05Open→03Resolved a:03DamianZaremba We have 12.2.2 in trove now (since ~April) so considering this done. [14:22:22] 10Toolforge, 06tools-platform-team: maintain-harbor: delete_stale_artifacts deletes images in use - https://phabricator.wikimedia.org/T442154#12489894 (10aputhin) p:05Triage→03Medium [14:24:54] 10Toolforge, 06tools-platform-team: Usurp h2bot tool account - https://phabricator.wikimedia.org/T442880 (10MBH) 03NEW [14:28:27] 06Toolforge-standards-committee: Usurp h2bot tool account - https://phabricator.wikimedia.org/T442880#12489945 (10taavi) Please see https://wikitech.wikimedia.org/wiki/Help:Toolforge/Abandoned_tool_policy for the process. [14:43:52] 10Cloud-VPS, 06tools-infrastructure-team: Add admin-only disable function to individual Cloud VPS web proxies - https://phabricator.wikimedia.org/T442870#12490066 (10taavi) a:03taavi [14:44:47] (03merge) 10fnegri: Read from components-api which tools opted in [repos/cloud/toolforge/alerts-api] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/alerts-api/-/merge_requests/12 (https://phabricator.wikimedia.org/T439554) [14:47:32] (03update) 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce: alerts-api: bump to 0.0.14-20261029144502-a187cfd5 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1444 (https://phabricator.wikimedia.org/T439554) [14:47:34] (03update) 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce: alerts-api: bump to 0.0.14-20261029144502-a187cfd5 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1444 (https://phabricator.wikimedia.org/T439554) [14:48:21] !log tools.cluebotng-staging Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40894578776 (https://github.com/cluebotng/component-configs/commits/d180ba6310a8569d7c091af3c9dd92dcdbda1991) [14:48:21] !log tools.cluebotng-review Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/40894527337 (https://github.com/cluebotng/component-configs/commits/b6e74433624164c9f93d76d8a23016bfa61d9481) [14:48:23] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebotng-staging/SAL [14:48:24] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebotng-review/SAL [14:48:41] 10Data-Services, 06tools-platform-team: Quarry returns results deleted several days ago - https://phabricator.wikimedia.org/T442801#12490095 (10JJMC89) [14:49:25] !log tools.cluebotng Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40894576159 (https://github.com/cluebotng/component-configs/commits/d180ba6310a8569d7c091af3c9dd92dcdbda1991) [14:49:26] 10Striker, 06tools-platform-team, 10ChangeProp, 06Data-Engineering, and 14 others: Migrate node-based services in production to node22 - https://phabricator.wikimedia.org/T393434#12490114 (10dancy) [14:49:26] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebotng/SAL [14:53:22] 10Striker, 06tools-platform-team, 10ChangeProp, 10Citoid, and 22 others: Migrate node-based services in production to node26 - https://phabricator.wikimedia.org/T437512#12490130 (10Sfaci) [15:05:49] 10Toolforge, 06tools-platform-team: Retire petscan.wmcloud.org and forward to petscan.toolforge.org - https://phabricator.wikimedia.org/T442887 (10magnusmanske) 03NEW [15:10:20] !log tools.cluebot-syncer Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40898265777 (https://github.com/cluebotng/component-configs/commits/2cbcb8f53b16df233c6cf981aa5e005bf42c11ad) [15:10:22] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebot-syncer/SAL [15:10:23] !log tools.toolforge-functional-runner Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40898265808 (https://github.com/cluebotng/component-configs/commits/2cbcb8f53b16df233c6cf981aa5e005bf42c11ad) [15:10:24] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.toolforge-functional-runner/SAL [15:10:35] !log tools.cluebot3 Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40898266243 (https://github.com/cluebotng/component-configs/commits/2cbcb8f53b16df233c6cf981aa5e005bf42c11ad) [15:10:36] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebot3/SAL [15:10:38] !log tools.cluebotng-trainer Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/40898266178 (https://github.com/cluebotng/component-configs/commits/2cbcb8f53b16df233c6cf981aa5e005bf42c11ad) [15:10:40] !log tools.cluebotng-editsets Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40898266070 (https://github.com/cluebotng/component-configs/commits/2cbcb8f53b16df233c6cf981aa5e005bf42c11ad) [15:10:41] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebotng-trainer/SAL [15:10:42] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebotng-editsets/SAL [15:10:54] !log tools.cluebotng-staging Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/40898265897 (https://github.com/cluebotng/component-configs/commits/2cbcb8f53b16df233c6cf981aa5e005bf42c11ad) [15:10:55] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebotng-staging/SAL [15:10:57] !log tools.cluebotng-monitoring Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/40898265896 (https://github.com/cluebotng/component-configs/commits/2cbcb8f53b16df233c6cf981aa5e005bf42c11ad) [15:10:58] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebotng-monitoring/SAL [15:11:26] !log tools.cluebotng-review Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/40898266172 (https://github.com/cluebotng/component-configs/commits/2cbcb8f53b16df233c6cf981aa5e005bf42c11ad) [15:11:27] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebotng-review/SAL [15:11:30] !log tools.cluebotng Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/40898254138 (https://github.com/cluebotng/component-configs/commits/5392cc3d04cf9e3086473ded50ae76eb8ffb6a29) [15:11:31] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebotng/SAL [15:13:34] !log tools.cluebot3 Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40898308339 (https://github.com/cluebotng/component-configs/commits/098b7b2c89711b56ef558c0b46e37906974cac41) [15:13:35] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebot3/SAL [15:13:39] 06Toolforge-standards-committee: Usurp h2bot tool account - https://phabricator.wikimedia.org/T442880#12490333 (10JJMC89) 05Open→03Stalled [15:15:44] !log tools.cluebotng-review Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/40898273176 (https://github.com/cluebotng/component-configs/commits/9312a5e969e30ca121b0c1dc95882706eb675340) [15:15:47] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebotng-review/SAL [15:16:17] !log tools.cluebotng Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/40898273109 (https://github.com/cluebotng/component-configs/commits/9312a5e969e30ca121b0c1dc95882706eb675340) [15:16:18] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebotng/SAL [15:16:50] !log tools.cluebotng-trainer Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40898272930 (https://github.com/cluebotng/component-configs/commits/9312a5e969e30ca121b0c1dc95882706eb675340) [15:16:52] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebotng-trainer/SAL [15:25:24] !log tools.cluebot3 Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40899035740 (https://github.com/cluebotng/component-configs/commits/46b9114bc14193bf52f6200273cd59584dbe78e5) [15:25:27] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebot3/SAL [15:27:30] !log tools.cluebotng-staging Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40900757791 (https://github.com/cluebotng/component-configs/commits/b49283d3d1ee6fa44d10b759e496ae2c5b230dff) [15:27:31] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebotng-staging/SAL [15:29:08] !log tools.cluebotng-review Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/40900617605 (https://github.com/cluebotng/component-configs/commits/342ebf1dca9d2c8f41b88547ed3a017fe1a1a87b) [15:29:08] !log tools.cluebotng-trainer Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40900617668 (https://github.com/cluebotng/component-configs/commits/342ebf1dca9d2c8f41b88547ed3a017fe1a1a87b) [15:29:09] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebotng-review/SAL [15:29:10] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebotng-trainer/SAL [15:29:42] !log tools.cluebotng-editsets Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40900757750 (https://github.com/cluebotng/component-configs/commits/b49283d3d1ee6fa44d10b759e496ae2c5b230dff) [15:29:43] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebotng-editsets/SAL [15:29:58] !log tools.cluebotng-monitoring Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/40900757985 (https://github.com/cluebotng/component-configs/commits/b49283d3d1ee6fa44d10b759e496ae2c5b230dff) [15:29:59] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebotng-monitoring/SAL [15:30:47] !log tools.cluebot-syncer Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40900757494 (https://github.com/cluebotng/component-configs/commits/b49283d3d1ee6fa44d10b759e496ae2c5b230dff) [15:30:49] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebot-syncer/SAL [15:30:55] !log tools.toolforge-functional-runner Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40900757719 (https://github.com/cluebotng/component-configs/commits/b49283d3d1ee6fa44d10b759e496ae2c5b230dff) [15:30:56] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.toolforge-functional-runner/SAL [15:31:04] !log tools.cluebotng Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/40900617624 (https://github.com/cluebotng/component-configs/commits/342ebf1dca9d2c8f41b88547ed3a017fe1a1a87b) [15:31:06] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebotng/SAL [15:31:24] !log tools.cluebot3 Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40900757798 (https://github.com/cluebotng/component-configs/commits/b49283d3d1ee6fa44d10b759e496ae2c5b230dff) [15:31:25] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebot3/SAL [15:32:05] !log tools.cluebotng-staging Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40901676116 (https://github.com/cluebotng/component-configs/commits/167ea1cf0b016017fb8c0197ec604ba0461a71c1) [15:32:06] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebotng-staging/SAL [15:32:55] !log tools.cluebotng-trainer Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/40901778442 (https://github.com/cluebotng/component-configs/commits/abdf069b6a9204f3fe2796741e1beb93d89a5d07) [15:32:56] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebotng-trainer/SAL [15:33:33] !log tools.cluebotng-editsets Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40901676356 (https://github.com/cluebotng/component-configs/commits/167ea1cf0b016017fb8c0197ec604ba0461a71c1) [15:33:34] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebotng-editsets/SAL [15:33:47] !log tools.cluebotng-review Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/40902023817 (https://github.com/cluebotng/component-configs/commits/d8c689f56957540b9a4fd6c51ce60701a2b483c9) [15:33:49] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebotng-review/SAL [15:34:15] !log tools.cluebot-syncer Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40901676310 (https://github.com/cluebotng/component-configs/commits/167ea1cf0b016017fb8c0197ec604ba0461a71c1) [15:34:16] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebot-syncer/SAL [15:34:16] !log tools.cluebot3 Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/40901676263 (https://github.com/cluebotng/component-configs/commits/167ea1cf0b016017fb8c0197ec604ba0461a71c1) [15:34:17] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebot3/SAL [15:34:48] !log tools.cluebotng-monitoring Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/40902159583 (https://github.com/cluebotng/component-configs/commits/9e1231590a3fc7d063de82c45faf2ab0b4060cdb) [15:34:50] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebotng-monitoring/SAL [15:36:00] !log tools.cluebotng Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/40902240936 (https://github.com/cluebotng/component-configs/commits/77ffbc8ebcebe0ba0b96808c0324623bd61aadf9) [15:36:02] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebotng/SAL [15:36:51] !log tools.cluebotng-staging Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40902241168 (https://github.com/cluebotng/component-configs/commits/77ffbc8ebcebe0ba0b96808c0324623bd61aadf9) [15:36:52] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebotng-staging/SAL [15:36:53] !log tools.cluebotng-trainer Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40902351489 (https://github.com/cluebotng/component-configs/commits/a712571c820f2a1ea767bd46ea74112426fb56bc) [15:36:54] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebotng-trainer/SAL [15:38:34] !log tools.cluebotng-review Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/40902696710 (https://github.com/cluebotng/component-configs/commits/898b57efb4eeb1bdf98e935d9fe4332693a35aa7) [15:38:35] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebotng-review/SAL [15:38:55] !log tools.cluebotng-monitoring Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/40902689515 (https://github.com/cluebotng/component-configs/commits/2c61828f93816462b7639fce810e118f8937e7a8) [15:38:56] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebotng-monitoring/SAL [15:40:00] !log tools.cluebotng-trainer Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/40902696917 (https://github.com/cluebotng/component-configs/commits/898b57efb4eeb1bdf98e935d9fe4332693a35aa7) [15:40:01] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebotng-trainer/SAL [15:40:31] !log tools.cluebotng Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/40902696699 (https://github.com/cluebotng/component-configs/commits/898b57efb4eeb1bdf98e935d9fe4332693a35aa7) [15:40:32] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebotng/SAL [15:40:37] !log tools.cluebotng-staging Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40902680991 (https://github.com/cluebotng/component-configs/commits/da88cb5e1e9693171a65562139a9fbf29fa65dfe) [15:40:38] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebotng-staging/SAL [15:44:31] !log tools.cluebotng-review Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40903315472 (https://github.com/cluebotng/component-configs/commits/48d12f535986ffcf04bdc857a204667a10e4579d) [15:44:33] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebotng-review/SAL [15:44:48] !log tools.cluebotng Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/40903315370 (https://github.com/cluebotng/component-configs/commits/48d12f535986ffcf04bdc857a204667a10e4579d) [15:44:49] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebotng/SAL [16:07:45] 10Tool-athar: [Task 1] Build Meta-Wiki Member Parser & CentralAuth Sync Script - https://phabricator.wikimedia.org/T441457#12490790 (10Bonnjalal) 05Open→03Resolved [16:19:03] 10Cloud-VPS, 06tools-infrastructure-team, 10Catalyst, 06Release-Engineering-Team, 13Patch-For-Review: Restore ingress to patchdemo / catalyst - https://phabricator.wikimedia.org/T442664#12490862 (10taavi) Thank you! `catalyst` looks good to me, I've unblocked it. `catalyst-qte` and `catalyst-dev` have n... [16:26:32] !log fnegri@cloudcumin1001 toolsbeta START - Cookbook wmcs.toolforge.component.deploy for component alerts-api (T439554) [16:26:39] T439554: Read the opted-in tools from components-api - https://phabricator.wikimedia.org/T439554 [16:27:31] !log fnegri@cloudcumin1001 toolsbeta END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component alerts-api (T439554) [16:30:10] !log fnegri@cloudcumin1001 tools START - Cookbook wmcs.toolforge.component.deploy for component alerts-api (T439554) [16:31:15] !log fnegri@cloudcumin1001 tools END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component alerts-api (T439554) [16:37:29] (03merge) 10fnegri: alerts-api: bump to 0.0.14-20261029144502-a187cfd5 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1444 (https://phabricator.wikimedia.org/T439554) (owner: 10group_203_bot_3c0afd0d9fd9529f3b7bc7e69a4a3bce) [16:38:38] 10Toolforge, 06tools-platform-team, 07OKR-Work, 13Patch-For-Review: Read the opted-in tools from components-api - https://phabricator.wikimedia.org/T439554#12490985 (10fnegri) 05In progress→03Resolved [16:40:50] 10Cloud-VPS, 06tools-infrastructure-team, 13Patch-For-Review: Add admin-only disable function to individual Cloud VPS web proxies - https://phabricator.wikimedia.org/T442870#12490999 (10taavi) 05Open→03Resolved Documented at https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Web_proxy. Closing. [17:00:47] 10Striker, 06tools-platform-team, 10ChangeProp, 06Data-Engineering, and 14 others: Migrate node-based services in production to node22 - https://phabricator.wikimedia.org/T393434#12491079 (10Jdforrester-WMF) [17:01:35] 10Cloud-Services, 06tools-infrastructure-team, 10Pywikibot, 07Pywikibot-tests: WMCS SOCKS tunnel establishment fails for all Pywikibot GitHub Actions - https://phabricator.wikimedia.org/T442175#12491090 (10Xqt) >>! In T442175#12485808, @taavi wrote: > It is not clear what is actually broken here. Toolforge... [17:03:42] 10Striker, 06tools-platform-team, 10ChangeProp, 06Data-Engineering, and 14 others: Migrate node-based services in production to node22 - https://phabricator.wikimedia.org/T393434#12491112 (10Jdforrester-WMF) >>! In T393434#12488245, @taavi wrote: > The [[ https://gitlab.wikimedia.org/repos/mediawiki/servic... [17:13:18] 10Cloud-VPS, 06tools-infrastructure-team: Re-audit math CloudVPS project - https://phabricator.wikimedia.org/T442858#12491165 (10taavi) Hello! It is not clear to me what you refer to `mdock`, I see no [[ https://wikitech.wikimedia.org/wiki/Help:Cloud_VPS_instances | instance ]] or [[ https://wikitech.wikimedia... [17:19:36] 10Striker, 06tools-platform-team, 10ChangeProp, 10Charts, and 11 others: Migrate node-based services in production to node22 - https://phabricator.wikimedia.org/T393434#12491213 (10Jdforrester-WMF) [17:19:54] 10Cloud-VPS, 10Toolforge, 06tools-infrastructure-team, 06tools-platform-team: 2026-10-21 Toolforge and Cloud VPS down - https://phabricator.wikimedia.org/T441908#12491228 (10Bodhisattwa) [18:01:58] 10Tool-wikinewsie, 07good first task: Specify Wikinewsie time window in url - https://phabricator.wikimedia.org/T442918 (10Pharos) 03NEW Thank you for tagging this task with #good_first_task for Wikimedia newcomers! Newcomers often may not be aware of things that may seem obvious to seasoned contributors, s... [18:07:08] 06tools-infrastructure-team, 10Beta-Cluster-Infrastructure: Secure deployment-prep against php2shell and restore access - https://phabricator.wikimedia.org/T442482#12491504 (10Southparkfan) T442482 would help us to upgrade containers running EOL versions of nodejs. [18:23:54] 06tools-infrastructure-team, 10Beta-Cluster-Infrastructure: Secure deployment-prep against php2shell and restore access - https://phabricator.wikimedia.org/T442482#12491613 (10Southparkfan) >>! In T442482#12488254, @taavi wrote: > One last thing: what about the Magnum cluster? Do we know if it is not running a... [18:30:39] 06tools-infrastructure-team, 10Beta-Cluster-Infrastructure: Secure deployment-prep against php2shell and restore access - https://phabricator.wikimedia.org/T442482#12491644 (10Southparkfan) [18:54:15] 06tools-infrastructure-team, 10Beta-Cluster-Infrastructure: Secure deployment-prep against php2shell and restore access - https://phabricator.wikimedia.org/T442482#12491766 (10Southparkfan) [18:56:08] 10Striker, 06tools-platform-team, 10ChangeProp, 10Citoid, and 22 others: Migrate node-based services in production to node26 - https://phabricator.wikimedia.org/T437512#12491779 (10Jdforrester-WMF) [18:56:11] 10Striker, 06tools-platform-team, 10ChangeProp, 10Citoid, and 22 others: Migrate node-based services in production to node26 - https://phabricator.wikimedia.org/T437512#12491787 (10Jdforrester-WMF) a:05tchin→03None [18:56:46] 06tools-infrastructure-team, 10Beta-Cluster-Infrastructure: Secure deployment-prep against php2shell and restore access - https://phabricator.wikimedia.org/T442482#12491793 (10Southparkfan) Thanks Taavi! In the meantime, I discovered three images have been rebuilt yesterday. I have deployed the new images. At... [19:03:44] 10Toolforge, 06tools-platform-team: [maintainer-alerts] centralise alert configuration - https://phabricator.wikimedia.org/T442927 (10DamianZaremba) 03NEW [19:07:10] 06tools-infrastructure-team, 10Beta-Cluster-Infrastructure: Secure deployment-prep against php2shell and restore access - https://phabricator.wikimedia.org/T442482#12491876 (10Andrew) >> Per T437500 if it is really serving no traffic one strategy would be to just get rid of that cluster and then re-build a CA... [19:28:21] 10PAWS, 06tools-platform-team, 07Documentation: Public PAWS notebooks not visible due to server error - https://phabricator.wikimedia.org/T442931 (10TBurmeister) 03NEW [19:40:37] 06tools-infrastructure-team, 10Citoid, 06Collaboration-Services, 06Product Safety and Integrity, and 4 others: unattended upgrades are not upgrading libbrotli properly on some VMs - https://phabricator.wikimedia.org/T442936 (10Andrew) 03NEW [19:45:21] 06tools-infrastructure-team, 10Citoid, 06Collaboration-Services, 06Product Safety and Integrity, and 4 others: unattended upgrades are not upgrading libbrotli properly on some VMs - https://phabricator.wikimedia.org/T442936#12492089 (10Andrew) Here's an example: ` root@deployment-urldownloader04:~# apt po... [19:47:52] 10PAWS, 06tools-platform-team: Public PAWS notebooks not visible due to server error - https://phabricator.wikimedia.org/T442931#12492096 (10JJMC89) [19:47:58] 10Cloud-VPS, 10Toolforge, 06tools-infrastructure-team, 06tools-platform-team: 2026-10-21 Toolforge and Cloud VPS down - https://phabricator.wikimedia.org/T441908#12492097 (10JJMC89) [19:47:59] 10PAWS, 06tools-platform-team: Public PAWS notebooks not visible due to server error - https://phabricator.wikimedia.org/T442931#12492098 (10JJMC89) [19:49:17] 10PAWS, 06tools-platform-team: Public PAWS notebooks not visible due to server error - https://phabricator.wikimedia.org/T442931#12492110 (10JJMC89) paws-public has not been restored yet per https://lists.wikimedia.org/hyperkitty/list/cloud-announce@lists.wikimedia.org/message/PNYMGNBQSVB6GCGVB4NZWBFZGSLCU6CU/ [19:49:24] 06tools-infrastructure-team, 10Citoid, 06Collaboration-Services, 06Product Safety and Integrity, and 4 others: unattended upgrades are not upgrading libbrotli properly on some VMs - https://phabricator.wikimedia.org/T442936#12492108 (10Andrew) Running this: ` sudo cumin --force O{*} "apt install -y --onl... [19:55:19] (03open) 10sd: Update to Redis 8.10.3 on Ubuntu 24.04 [toolforge-repos/containers-redis] - 10https://gitlab.wikimedia.org/toolforge-repos/containers-redis/-/merge_requests/2 (https://phabricator.wikimedia.org/T435231) [20:03:24] (03update) 10sd: Update to Redis 8.10.3 on Ubuntu 24.04 [toolforge-repos/containers-redis] - 10https://gitlab.wikimedia.org/toolforge-repos/containers-redis/-/merge_requests/2 (https://phabricator.wikimedia.org/T435231) [20:06:21] 10Cloud-VPS, 06tools-infrastructure-team, 10Catalyst, 06Release-Engineering-Team, 13Patch-For-Review: Restore ingress to patchdemo / catalyst - https://phabricator.wikimedia.org/T442664#12492179 (10brennen) > catalyst-qte and catalyst-dev have no PHP according to the audit script. That is a bit surprisin... [20:20:42] 06tools-infrastructure-team, 10Citoid, 06Collaboration-Services, 06Product Safety and Integrity, and 4 others: unattended upgrades are not upgrading libbrotli properly on some VMs - https://phabricator.wikimedia.org/T442936#12492249 (10sbassett) a:05sbassett→03None [20:30:47] (03update) 10ibrahemqasim: Add background jobs workers [toolforge-repos/mdwiki] - 10https://gitlab.wikimedia.org/toolforge-repos/mdwiki/-/merge_requests/21 [20:30:54] (03merge) 10ibrahemqasim: Add background jobs workers [toolforge-repos/mdwiki] - 10https://gitlab.wikimedia.org/toolforge-repos/mdwiki/-/merge_requests/21 [20:34:58] (03open) 10ibrahemqasim: link recent translations to wikidata [toolforge-repos/mdwiki] - 10https://gitlab.wikimedia.org/toolforge-repos/mdwiki/-/merge_requests/22 [20:50:22] (03update) 10ibrahemqasim: link recent translations to wikidata [toolforge-repos/mdwiki] - 10https://gitlab.wikimedia.org/toolforge-repos/mdwiki/-/merge_requests/22 [20:56:27] 10Cloud-VPS, 06tools-infrastructure-team: Re-audit math CloudVPS project - https://phabricator.wikimedia.org/T442858#12492351 (10Ihlec) Seems like there are a lot of containers nobody has touched for years. I will investigate and either update or remove. [20:58:09] 10PAWS, 06tools-platform-team, 07Documentation: Public PAWS notebooks not visible due to server error - https://phabricator.wikimedia.org/T442931#12492360 (10TBurmeister) [20:58:48] 10PAWS, 06tools-platform-team, 07Documentation: Public PAWS notebooks not visible due to server error - https://phabricator.wikimedia.org/T442931#12492361 (10TBurmeister) Adding the Documentation tag back to this task because this bug impacts our technical documentation, which uses public PAWS notebooks to p... [21:11:51] 10Toolforge (Push-to-Deploy), 06tools-platform-team: Create Hello World deployment tutorial - https://phabricator.wikimedia.org/T437899#12492379 (10komla) 05In progress→03Resolved Cool, thanks [21:12:24] 10Toolforge (Push-to-Deploy), 06tools-platform-team: Create code change and redeploy tutorial - https://phabricator.wikimedia.org/T437900#12492383 (10komla) 05In progress→03Resolved Done! [21:20:14] (03update) 10ibrahemqasim: link recent translations to wikidata [toolforge-repos/mdwiki] - 10https://gitlab.wikimedia.org/toolforge-repos/mdwiki/-/merge_requests/22 [21:25:15] 10Tools, 03Wikimedia Hackathon 2027: ISA Tool - https://phabricator.wikimedia.org/T442948#12492442 (10Swayam_Agrahari) [21:38:13] (03update) 10ibrahemqasim: link recent translations to wikidata [toolforge-repos/mdwiki] - 10https://gitlab.wikimedia.org/toolforge-repos/mdwiki/-/merge_requests/22 [21:44:22] (03open) 10rluts: Add skip rules, edit safety checks, and project autosave [toolforge-repos/findsmith] - 10https://gitlab.wikimedia.org/toolforge-repos/findsmith/-/merge_requests/6 [21:46:31] (03update) 10ibrahemqasim: link recent translations to wikidata [toolforge-repos/mdwiki] - 10https://gitlab.wikimedia.org/toolforge-repos/mdwiki/-/merge_requests/22 [21:46:38] (03merge) 10rluts: Add skip rules, edit safety checks, and project autosave [toolforge-repos/findsmith] - 10https://gitlab.wikimedia.org/toolforge-repos/findsmith/-/merge_requests/6 [21:56:23] 06Toolforge-standards-committee: Usurp h2bot tool account - https://phabricator.wikimedia.org/T442880#12492620 (10Mitte27) This tool https://h2bot.toolforge.org/ps/ has only stopped working recently, following the discovery of a PHP vulnerability. It provides significantly more information and is much faster tha... [21:58:25] 10Tool-wikinewsie: Deprioritize death lists on Wikinewsie - https://phabricator.wikimedia.org/T435844#12492625 (10Mollystarkdean) [21:59:54] 10Tool-wikinewsie: Deprioritize lists - https://phabricator.wikimedia.org/T435844#12492631 (10Mollystarkdean) p:05Low→03Medium [22:00:51] 10Tool-wikinewsie: Deprioritize lists - https://phabricator.wikimedia.org/T435844#12492638 (10Mollystarkdean) [22:03:21] (03update) 10ibrahemqasim: link recent translations to wikidata [toolforge-repos/mdwiki] - 10https://gitlab.wikimedia.org/toolforge-repos/mdwiki/-/merge_requests/22 [22:10:36] 10Cloud-VPS (Debian Bullseye Deprecation), 10Beta-Cluster-Infrastructure, 13Patch-For-Review: Replace Swift hosts: deployment-ms-(be0[78]|fe04) (Bullseye deprecation) - https://phabricator.wikimedia.org/T436476#12492670 (10Southparkfan) On the backend hosts, I am experiencing timeouts during creation of the... [22:16:09] (03update) 10ibrahemqasim: link recent translations to wikidata [toolforge-repos/mdwiki] - 10https://gitlab.wikimedia.org/toolforge-repos/mdwiki/-/merge_requests/22 [22:46:51] !log tools.cluebotng-editsets Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40968022552 (https://github.com/cluebotng/component-configs/commits/cd8fd90b975dd95702ab1dd885b91e8515e197cd) [22:46:53] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebotng-editsets/SAL [22:47:46] !log tools.cluebotng-trainer Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40968022564 (https://github.com/cluebotng/component-configs/commits/cd8fd90b975dd95702ab1dd885b91e8515e197cd) [22:47:47] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cluebotng-trainer/SAL