[00:49:05] 10Phabricator (2025-12-16), 06Release-Engineering-Team (Doing 😎), 06collaboration-services: Deploy Phab/Phorge 2025-12-16 - https://phabricator.wikimedia.org/T412825#11466928 (10Pppery) What I would do actually is that if there's a PHP patch that changes the `src/translations` dir mention that, and oth... [01:40:50] 10Phabricator, 06Security-Team, 07SecTeam-Processed, 07Security: Create a security issue reporting template - https://phabricator.wikimedia.org/T406313#11466956 (10Aklapper) @Reedy: ping [01:48:44] 10GitLab, 06Release-Engineering-Team, 06Research: Disable Issues in GitLab - https://phabricator.wikimedia.org/T412882 (10Aklapper) 03NEW [01:55:09] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for steffpro - https://phabricator.wikimedia.org/T411276#11466989 (10Aklapper) 05Openβ†’03Declined Unfortunately closing this Phabricator task as no further information has been provided. @Steffpro: After you h... [01:55:26] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for hacksyn - https://phabricator.wikimedia.org/T408161#11466992 (10Aklapper) 05Openβ†’03Declined Unfortunately closing this Phabricator task as no further information has been provided. @Hacksyn: After you hav... [01:56:54] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for dlopez350 - https://phabricator.wikimedia.org/T411412#11466998 (10Aklapper) 05Openβ†’03Declined Unfortunately closing this Phabricator task as no further information has been provided. @Dlopez: After you ha... [02:08:48] 10Phabricator (Upstream), 10Phabricator Translations Extension, 10Legalpad, 06translatewiki.net, 07Upstream: Use translatewiki.net to localize Phabricator - https://phabricator.wikimedia.org/T225#11467019 (10Pppery) [02:09:18] 10Phabricator (Upstream), 10Phabricator Translations Extension, 06translatewiki.net, 07I18n, 07Upstream: Get Phabricator i18n ready for translatewiki.net - https://phabricator.wikimedia.org/T136071#11467020 (10Pppery) [02:10:15] 10Phabricator, 10Phabricator Translations Extension, 06Release-Engineering-Team, 06translatewiki.net: Improve Phabricator translation synchronization process - https://phabricator.wikimedia.org/T283327#11467035 (10Pppery) [07:35:14] Can you tell, me, please, how to connect jenkins-bot and sonareqube-bot to a new change? Last time it was automatically on creation, but it's already 9 hours and nothing happened. I tried to do it manually, but there are not such autocomplete suggestions. I'm just waiting for jenkins-bot review, so I could continue working. Thank you in advance. [07:55:48] IKhitron: which change? [07:56:26] https://gerrit.wikimedia.org/r/c/mediawiki/extensions/GlobalWatchlist/+/1218844 [07:57:03] It might cause the initial upload was with patch uploader [07:57:16] IKhitron: type "recheck" in a comment [07:57:22] See if that kicks it off [07:58:31] Done. I think the bot should listen to be aware of this comment. [07:59:02] I'll tell here in five minutes if it helped. [08:01:39] It worked. Thanks a lot. [08:55:03] maintenance-disconnect-full-disks build 763998 integration-agent-docker-1046 (/: 36%, /srv: 97%, /var/lib/docker: 32%): OFFLINE due to disk space [09:00:03] maintenance-disconnect-full-disks build 763999 integration-agent-docker-1046 (/: 36%, /srv: 55%, /var/lib/docker: 32%): RECOVERY disk space OK [09:00:03] maintenance-disconnect-full-disks build 763999 integration-agent-docker-1063 (/: 25%, /srv: 99%, /var/lib/docker: 31%): OFFLINE due to disk space [09:05:03] maintenance-disconnect-full-disks build 764000 integration-agent-docker-1063 (/: 25%, /srv: 74%, /var/lib/docker: 31%): RECOVERY disk space OK [09:23:52] Could you tell me, please, how can I fix a jenkins-bot declared error in a change, if I do not see any error message? Those I saw I already fixed. Maybe there exists some extra log in Gerrit, or something. [09:46:30] It was extra space after the line warning. [11:13:08] I get +2 from jenkins-bot, but mwext-phpunit-coverage-patch decreased. Added many tests on a new code, does not help. Tried to run check coverage on my previous change to get console output to compare, but the bot ignores the comment. What can I do, and should I do anything at all? Thank you in advance. [11:47:04] (03PS1) 10Dreamy Jazz: Zuul: [mediawiki/extensions/IPInfo] Load AbuseFilter extension [integration/config] - 10https://gerrit.wikimedia.org/r/1219140 [11:47:58] (03PS2) 10Dreamy Jazz: Zuul: [mediawiki/extensions/IPInfo] Load AbuseFilter extension [integration/config] - 10https://gerrit.wikimedia.org/r/1219140 [12:47:32] (03PS1) 10Krinkle: zuul: Enforce php85 job for mediawiki/libs/less.php [integration/config] - 10https://gerrit.wikimedia.org/r/1219144 (https://phabricator.wikimedia.org/T411213) [12:48:19] (03CR) 10Krinkle: zuul: Enforce php85 job for mediawiki/libs/less.php (032 comments) [integration/config] - 10https://gerrit.wikimedia.org/r/1219144 (https://phabricator.wikimedia.org/T411213) (owner: 10Krinkle) [13:03:35] 06Release-Engineering-Team, 06serviceops: Proposal: `scap` deploy-service - https://phabricator.wikimedia.org/T412941 (10jijiki) 03NEW [13:07:20] 06Release-Engineering-Team, 10Scap, 06serviceops: Proposal: `scap` deploy-service - https://phabricator.wikimedia.org/T412941#11468508 (10taavi) [13:08:53] 06Release-Engineering-Team, 10Scap, 06serviceops: Proposal: scap deploy-service - https://phabricator.wikimedia.org/T412941#11468517 (10jijiki) [13:18:20] 10GitLab (Project Migration), 06Release-Engineering-Team, 10Wikidata, 10Wikidata-Query-Service: Create new GitLab project group: repos/wikidata-platform - https://phabricator.wikimedia.org/T411748#11468562 (10brennen) 05Openβ†’03Resolved a:03brennen Sorry for delay! Created: https://gitlab.wikimed... [13:59:18] 06Project-Admins: Create project tag for Extension: Rich Results - https://phabricator.wikimedia.org/T412946 (10Flounder) 03NEW [14:05:07] 06Project-Admins: Create project tag for Extension: Rich Results - https://phabricator.wikimedia.org/T412946#11468684 (10Aklapper) Thanks for reporting this! Do you plan to switch off https://github.com/enkigi/RichResults/issues and use Wikimedia Phabricator instead? Note to myself: https://www.mediawiki.org/w... [14:21:32] 06Project-Admins: Create project tag for Extension: Rich Results - https://phabricator.wikimedia.org/T412946#11468744 (10Flounder) I was not planning to do that unless required. Mainly interested in general feedback and security review. [14:32:28] FIRING: PuppetAgentFailure: Puppet agent failure detected on instance deployment-mx03 in project deployment-prep - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentFailure [14:32:33] 10Beta-Cluster-Infrastructure: Puppet agent failure detected on instance deployment-mx03 in project deployment-prep - https://phabricator.wikimedia.org/T412949 (10wmcs-alerts) 03NEW [14:37:53] 06Release-Engineering-Team, 06Data-Persistence, 06serviceops: Move the docker registry's /restricted prefix to Docker Distribution backed up by Ceph - https://phabricator.wikimedia.org/T412951 (10elukey) 03NEW [14:41:31] 06Project-Admins: Create project tag for Extension: Rich Results - https://phabricator.wikimedia.org/T412946#11468855 (10Aklapper) In that case I do not recommend to create another issue tracking place in Phabricator Wikimedia, as having several issue trackers usually leads to confusion, duplication of topics, f... [14:49:59] dancy: I'm thinking of experimenting with static array l10n cache again, given the improvements bvibber made last week. Anything come to mind that would go wrong that we need to update or enable in terms of scap? [14:53:40] I see there's a `php_l10n` feature flag, but if I recall correctly, this was for generating both side-by-side as opposed to letting rebuildLocalisationCache do whatever the default is, so maybe if we switch beta wholesale, it just works? [14:53:51] Hm.. no, scap hardcodes LCStoreCDB by default it seems. [14:57:22] 06Project-Admins: SRE Service Ops - Subproject to experiment new structure - https://phabricator.wikimedia.org/T412410#11468943 (10Aklapper) @MLechvien-WMF Hi, basically see https://www.mediawiki.org/wiki/Phabricator/Creating_and_renaming_projects Which project name, which type, which description, etc? [15:02:40] * Krinkle looks at php7_admin_port as another nearby option for how it is set/propagated, finds a deadend. https://gerrit.wikimedia.org/r/c/operations/puppet/+/1219164 [15:03:09] 06Release-Engineering-Team, 10Ceph, 06serviceops, 10SRE-swift-storage: Move the docker registry's /restricted prefix to Docker Distribution backed up by Ceph - https://phabricator.wikimedia.org/T412951#11469007 (10MatthewVernon) [15:29:37] 06Release-Engineering-Team (Radar), 10Ceph, 06serviceops, 10SRE-swift-storage: Move the docker registry's /restricted prefix to Docker Distribution backed up by Ceph - https://phabricator.wikimedia.org/T412951#11469210 (10thcipriani) [15:40:45] Krinkle: Nod. There's a lot of lingering cruft in scap but ultimately, whatever you need changed, we can change. Just let me know. I can test in train-dev. [15:59:23] 10Beta-Cluster-Infrastructure: Puppet failure: "Unable to locate package spamd" on deployment-mx03.deployment-prep - https://phabricator.wikimedia.org/T412975 (10dancy) 03NEW [16:00:00] 10Beta-Cluster-Infrastructure: Puppet failure: "Unable to locate package spamd" on deployment-mx03.deployment-prep - https://phabricator.wikimedia.org/T412975#11469394 (10dancy) [16:02:14] 10Beta-Cluster-Infrastructure: Puppet failure: "Unable to locate package spamd" on deployment-mx03.deployment-prep - https://phabricator.wikimedia.org/T412975#11469398 (10dancy) Presumably caused by https://gerrit.wikimedia.org/r/c/operations/puppet/+/1219137 @Muehlenhoff @Jelto [16:03:22] 10Beta-Cluster-Infrastructure: Puppet failure: "Unable to locate package spamd" on deployment-mx03.deployment-prep - https://phabricator.wikimedia.org/T412975#11469414 (10dancy) ` dancy@deployment-mx03:~$ lsb_release -a No LSB modules are available. Distributor ID: Debian Description: Debian GNU/Linux 11 (bu... [16:04:42] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for Blaithnaid - https://phabricator.wikimedia.org/T412976 (10Blaithnaid) 03NEW [16:05:18] *whee* :D [16:06:26] bvibber: I'm very pleased with the momentum that you've garnered [16:06:47] i sure hope it works out! :D [16:06:55] dancy: OK. for now I could use a pointer on where/what I need to change to flip this flag in beta. [16:07:15] My assumption is that I do the inverse of https://gerrit.wikimedia.org/r/c/operations/puppet/+/1219164 for this flag and set it in Hiera/beta? [16:07:18] 10Beta-Cluster-Infrastructure: Puppet failure: "Unable to locate package spamd" on deployment-mx03.deployment-prep - https://phabricator.wikimedia.org/T412975#11469432 (10MoritzMuehlenhoff) Why on earth does deployment-prep need an MX host? We could revert the original patch, but having cleanups held back by ran... [16:09:53] Krinkle: Do you just need a setting which controls the --store-class passed to rebuildLocalisationCache.php ? [16:12:00] Looks like the `php_l10n` setting as-is will cause both CDB and PHP files to be generated, as you already determined. [16:14:28] Yeah, I think we'd want to generate both. In beta we only need one, but in prod we'd need both for a while when we gradually test this on a canary server first/ [16:14:45] but yeah the cdb files would become unused in beta [16:14:55] and eventually (TM) we'd flip to just php files [16:16:42] 10Beta-Cluster-Infrastructure: Puppet failure: "Unable to locate package spamd" on deployment-mx03.deployment-prep - https://phabricator.wikimedia.org/T412975#11469512 (10Dzahn) This kind of thing is just a pain for all parties involved :/ How about this: We add a lookup for the package name with a default val... [16:17:07] (03PS1) 10JavierMonton: Java 25 Docker image. [integration/config] - 10https://gerrit.wikimedia.org/r/1219178 [16:21:59] (03PS2) 10JavierMonton: Java 25 Docker image. [integration/config] - 10https://gerrit.wikimedia.org/r/1219178 [16:22:19] (03PS3) 10JavierMonton: Java 25 Docker image. [integration/config] - 10https://gerrit.wikimedia.org/r/1219178 (https://phabricator.wikimedia.org/T412978) [16:22:27] Hi! I accidentally broke the "Action API" link on the main logstash dashboard. I meant to change the "API Gateway" link and messed it up... [16:22:43] Apparently there is no history and no revert mechanism... Can someone give me the URL that the "Action API" link should point to, so I can fix it? Thanks! [16:23:42] (03CR) 10CI reject: [V:04-1] Java 25 Docker image. [integration/config] - 10https://gerrit.wikimedia.org/r/1219178 (https://phabricator.wikimedia.org/T412978) (owner: 10JavierMonton) [16:28:29] 10Beta-Cluster-Infrastructure, 13Patch-For-Review: Puppet failure: "Unable to locate package spamd" on deployment-mx03.deployment-prep - https://phabricator.wikimedia.org/T412975#11469602 (10Dzahn) like this? https://gerrit.wikimedia.org/r/c/operations/puppet/+/1219180 That would mean no more OS / distro ver... [16:30:48] https://wikitech.wikimedia.org/wiki/Logstash#Restore_Dashboards_from_backup looks like it could help with that broken link [16:31:00] * Lucas_WMDE doesn’t know logstash stuff nor has permission to fix the issue [16:31:32] 06Project-Admins: Create project tag for Extension: Rich Results - https://phabricator.wikimedia.org/T412946#11469616 (10Flounder) Ok thank you. That seems reasonable to keep it limited to MediaWiki.org and Github. Please cancel request. [16:33:27] (03PS4) 10JavierMonton: component: dockerfiles [integration/config] - 10https://gerrit.wikimedia.org/r/1219178 (https://phabricator.wikimedia.org/T412978) [16:34:47] (03CR) 10CI reject: [V:04-1] component: dockerfiles [integration/config] - 10https://gerrit.wikimedia.org/r/1219178 (https://phabricator.wikimedia.org/T412978) (owner: 10JavierMonton) [16:36:38] hi releng folks! I want to deploy a new extension (T410515) and https://www.mediawiki.org/wiki/Writing_an_extension_for_deployment says you need to wait two weeks between adding the extension to make-wmf-branch and deploying to Beta [16:36:39] T410515: Deploy WikimediaCustomizations - https://phabricator.wikimedia.org/T410515 [16:36:57] is that still the case, or is it a remnant from the time when the train took two weeks? [16:37:53] (03PS5) 10JavierMonton: component: dockerfiles [integration/config] - 10https://gerrit.wikimedia.org/r/1219178 (https://phabricator.wikimedia.org/T412978) [16:38:29] it seems like waiting one week should be enough to ensure that the extension is present in all deployed branches [16:38:59] Lucas_WMDE: I don't even know what a "collector node" is... [16:39:18] well, I guess it depends on how you define one week, but anyway, is it fine to proceed once all deployed branches have the extension, or was there some other reason for the two-week rule? [16:39:26] Well, I can guess, but I have no idea how to log into one. I'll probably break more stuff trying. [16:40:21] try asking -observability channel to restore it for you [16:40:55] Actually, I think I found it. There is a dashboard called mediawiki-action-api, I suppose I can just link to that. [16:41:27] it was linking to https://logstash.wikimedia.org/app/dashboards#/view/1375c210-2abf-11f0-a229-03fbbea0849e [16:42:19] tgr_: The requirement as written is "The extension submodule must be present in all branches currently running on the cluster". I see that WikimediaCustomizations is included in wmf.7, but not wmf.5 [16:42:19] yeah logstash not having any edit history is pretty annoying [16:43:12] tgr_: It is unclear to me why you should have to wait in order to do stuff in beta. [16:43:38] tgr_: thank you! [16:43:41] oh right, dec 8 was a no-train week [16:44:08] 06Project-Admins: Create project tag for Extension: Rich Results - https://phabricator.wikimedia.org/T412946#11469668 (10A_smart_kitten) 05Openβ†’03Declined (per above `:)`) [16:44:33] dancy: yeah not sure. It says so in https://www.mediawiki.org/wiki/Writing_an_extension_for_deployment#Deploy_to_Beta_Cluster [16:45:49] my guess would be that beta and prod use the same `wmf-config/extension-list` file, and so the l10n rebuild process would always try to bundle messages for the extension even when it’? only meant for beta? [16:46:26] (*it’s) [16:46:30] thanks, that makes sense [16:46:47] Lucas_WMDE: Very helpful. Thank you! [16:47:23] There was recent discussion on https://phabricator.wikimedia.org/T125678 about this [16:47:58] it's even explained in the next step of that doc, I just stopped reading at the two weeks thing :/ [16:48:06] I'll leave it for next year then [16:48:08] ah yes, that looks like it :) [16:48:20] good to know I didn’t imagine that explanation ;) [16:54:21] 10Phabricator (2025-12-16), 06Release-Engineering-Team (Doing 😎), 06collaboration-services: Deploy Phab/Phorge 2025-12-16 - https://phabricator.wikimedia.org/T412825#11469695 (10Pppery) (And changes to `src/locales` might also be interesting and worth noting, although aside from one in-review patch I dou... [16:57:21] (03update) 10dancy: Fix incremental image build with newer docker [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/230 [17:00:58] (03approved) 10dduvall: Fix incremental image build with newer docker [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/230 (owner: 10dancy) [17:01:55] (03merge) 10dancy: Fix incremental image build with newer docker [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/230 [17:07:04] duesen: I assume you've deleted a link in a text panel on the Home dashboard, and not overwrite/deleted the Action API dashboard itself, is that right? [17:07:18] duesen: if so, the dashboard will be in the list of dashboards I assume? [17:07:43] Krinkle: yes, i found it there after I asked here. SHould be fixed now, thanks. [17:07:50] https://logstash.wikimedia.org/ > Menu > Dashboard , provides a searchable list [17:07:55] k :) [17:09:21] (03PS1) 10JavierMonton: component: dockerfiles [integration/config] - 10https://gerrit.wikimedia.org/r/1219184 (https://phabricator.wikimedia.org/T412978) [17:40:59] 10GitLab (Account Approval), 06Release-Engineering-Team (Doing 😎): Requesting GitLab account activation for Blaithnaid - https://phabricator.wikimedia.org/T412976#11469972 (10Aklapper) 05Openβ†’03Resolved a:03Aklapper Here you go! :) Please also [link](https://phabricator.wikimedia.org/settings/panel/e... [17:43:14] 06Release-Engineering-Team (Radar), 10Scap, 10MediaWiki-Internationalization, 13Patch-For-Review, 07Wikimedia-Performance-recommendation: Use static php array files for l10n cache at WMF (instead of CDB) - https://phabricator.wikimedia.org/T99740#11469977 (10Krinkle) [18:10:03] maintenance-disconnect-full-disks build 764109 integration-agent-docker-1045 (/: 35%, /srv: 97%, /var/lib/docker: 32%): OFFLINE due to disk space [18:15:03] maintenance-disconnect-full-disks build 764110 integration-agent-docker-1045 (/: 35%, /srv: 29%, /var/lib/docker: 31%): RECOVERY disk space OK [19:26:03] 06Project-Admins: Create project tag for Extension: Rich Results - https://phabricator.wikimedia.org/T412946#11470328 (10A_smart_kitten) Side note: @Flounder, I [[https://github.com/MWStake/nonwmf-extensions/pull/396|submitted a pull request]] to add your extension's GitHub repo to https://github.com/MWStake... [19:56:00] 06Release-Engineering-Team, 06Infrastructure-Foundations, 06serviceops, 06SRE, and 2 others: Cross-datacenter Docker Registry replication broken since 2025-04-27 - https://phabricator.wikimedia.org/T413008 (10CDanis) 03NEW [19:56:19] 06Release-Engineering-Team, 06Infrastructure-Foundations, 06serviceops, 06SRE, and 2 others: Cross-datacenter Docker Registry replication broken since 2025-04-27 - https://phabricator.wikimedia.org/T413008#11470444 (10CDanis) This is at least High and possibly UBN! [21:40:08] 06Release-Engineering-Team (Radar), 06Infrastructure-Foundations, 06serviceops, 06SRE, and 2 others: Cross-datacenter Docker Registry replication broken since 2025-04-27 - https://phabricator.wikimedia.org/T413008#11470751 (10thcipriani) [21:44:46] 10GitLab (Account Approval), 06Release-Engineering-Team: Grant Access to GitLab for holdyourhorses - https://phabricator.wikimedia.org/T410667#11470757 (10brennen) 05Openβ†’03Resolved a:03brennen Added to #trusted-contributors, GitLab account should be good to go. [21:58:09] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for talhajsiam - https://phabricator.wikimedia.org/T411313#11470835 (10brennen) 05Openβ†’03Resolved a:03brennen [21:59:12] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for talhajsiam - https://phabricator.wikimedia.org/T411313#11470847 (10brennen) Not added to the #trusted-contributors group on Phab since there's not much history here, but approved in GitLab.