[00:21:19] (03reopen) 10dancy: ingress-nginx.yaml.tftpl: Disable PROXY protocol stuff [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/500 (https://phabricator.wikimedia.org/T396924) [00:21:25] (03update) 10dancy: ingress-nginx.yaml.tftpl: Disable PROXY protocol stuff [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/500 (https://phabricator.wikimedia.org/T396924) [00:23:06] (03update) 10dancy: ingress-nginx.yaml.tftpl: Disable PROXY protocol stuff [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/500 (https://phabricator.wikimedia.org/T396924) [00:24:25] (03merge) 10dancy: ingress-nginx.yaml.tftpl: Disable PROXY protocol stuff [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/500 (https://phabricator.wikimedia.org/T396924) [00:50:10] 10GitLab (CI & Job Runners), 13Patch-For-Review: kokkuri cannot publish "public" images from WMCS runners due to a lack of a local registry - https://phabricator.wikimedia.org/T396924#11150657 (10dancy) Settings have been reverted. [00:52:28] 10GitLab (CI & Job Runners), 13Patch-For-Review: kokkuri cannot publish "public" images from WMCS runners due to a lack of a local registry - https://phabricator.wikimedia.org/T396924#11150658 (10thcipriani) >>! In T396924#11150657, @dancy wrote: > Settings have been reverted. Thanks @dancy <3 [03:18:08] (03PS1) 10Subramanya Sastry: Minor tweak to retry script [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/1184960 [05:42:44] 10Phabricator: display "policy" group memberships in phabricator user profiles - https://phabricator.wikimedia.org/T403778#11150843 (10Aklapper) Yes that's a downstream hack: rPHABa1304fc3756cc6a9e768f97a6731c027fb33197c The general "View All" logic is upstream code though. [05:51:47] 06Project-Admins, 07Tracking-Neverending: Requests for addition to the #acl*Project-Admins group (in comments) - https://phabricator.wikimedia.org/T706#11150847 (10SD0001) Hi, can I be added to this group? For now, I wanted to create a phab project to track bugs for a new Cloud VPS project. [06:23:11] 10Phabricator: display "policy" group memberships in phabricator user profiles - https://phabricator.wikimedia.org/T403778#11150883 (10Novem_Linguae) Nice. The modern code appears to be located at https://gitlab.wikimedia.org/repos/phabricator/phabricator/-/blob/wmf/stable/src/applications/people/controller/Phab... [07:22:36] 10Continuous-Integration-Infrastructure, 07Jenkins, 06Release-Engineering-Team, 07Essential-Work: Upgrade Jenkins to 2.516.2 - https://phabricator.wikimedia.org/T403703#11150980 (10hashar) [07:24:22] 10Continuous-Integration-Infrastructure, 07Jenkins, 06Release-Engineering-Team, 06collaboration-services, 07Essential-Work: ProbeDown - releases1003:8080 - https://phabricator.wikimedia.org/T403747#11150981 (10hashar) [08:15:18] Yippee, build fixed! [08:15:18] Project beta-code-update-eqiad build #564247: 09FIXED in 2 min 17 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/564247/ [08:42:05] 10GitLab (CI & Job Runners), 10Release-Engineering-Team (Priority Backlog πŸ“₯), 10cloud-services-team (FY2025/26-Q1): Recent incidents of buildkitd's storage volume filling up - https://phabricator.wikimedia.org/T395097#11151266 (10fnegri) [09:06:25] 10Phabricator (Upstream), 07Upstream: After archiving a Phabricator project, all future edits to it generate an extra "[username] set this project's color to Red" entry in the project's history - https://phabricator.wikimedia.org/T398735#11151359 (10Aklapper) 05In progressβ†’03Stalled Fixed in upstream: http... [09:06:33] 10Phabricator (Upstream), 07Upstream: After archiving a Phabricator project, all future edits to it generate an extra "[username] set this project's color to Red" entry in the project's history - https://phabricator.wikimedia.org/T398735#11151362 (10Aklapper) [09:06:35] 10Phabricator, 10Release-Engineering-Team (Priority Backlog πŸ“₯): Update to Phorge upstream 202x.xx release (the one after 2025.18) - https://phabricator.wikimedia.org/T393840#11151363 (10Aklapper) [09:19:06] 06Project-Admins, 07Tracking-Neverending: Requests for addition to the #acl*Project-Admins group (in comments) - https://phabricator.wikimedia.org/T706#11151377 (10Peachey88) @SD0001 If its just the one project that needs to be created at the moment, If you file a task following the process at https://www.medi... [10:14:58] 06Project-Admins, 10Tools: Request to create project: Wikidata Reference Validator - https://phabricator.wikimedia.org/T403556#11151436 (10JosefAnthony) [10:15:37] 06Project-Admins, 10Tools: Request to create project: Wikidata Reference Validator - https://phabricator.wikimedia.org/T403556#11151437 (10JosefAnthony) >>! In T403556#11147007, @Bugreporter wrote: > You will be able to create a project yourself once you have a Phabricator tool account (you can create one if y... [10:19:13] 06Project-Admins, 10Tools: Request to create project: Wikidata Reference Validator - https://phabricator.wikimedia.org/T403556#11151440 (10fnegri) 05Stalledβ†’03Declined [10:41:04] 10Gerrit, 10CAS-SSO, 06Infrastructure-Foundations: Use IDP for authentication in Gerrit - https://phabricator.wikimedia.org/T147864#11151508 (10Arendpieter) [10:43:16] 10Beta-Cluster-Infrastructure, 06Traffic: Puppet agent failure detected on instance deployment-cache-text08 in project deployment-prep - https://phabricator.wikimedia.org/T403616#11151513 (10SLyngshede-WMF) @bd808 We've added a special clause just for the datacenter database. We can use the same variable to pr... [10:45:25] 10Beta-Cluster-Infrastructure, 06Traffic: Puppet agent failure detected on instance deployment-cache-text08 in project deployment-prep - https://phabricator.wikimedia.org/T403616#11151526 (10Vgutierrez) puppet is now happy in deployment-cache-text08 :) [10:50:44] 10Gerrit, 10CAS-SSO, 06Infrastructure-Foundations: Use IDP for authentication in Gerrit - https://phabricator.wikimedia.org/T147864#11151543 (10Arendpieter) [12:25:35] 10Continuous-Integration-Config, 10MediaWiki-extensions-ReadingLists, 06Reader Experience Team, 13Patch-For-Review: ReadingLists tests not run in jenkins wmf-quibble-core-vendor-mysql-php81 - https://phabricator.wikimedia.org/T403560#11151704 (10aude) For ReadingLists, I think we mainly care about changes... [12:26:24] (03CR) 10C. Scott Ananian: [C:03+2] Update list of wikipedia prefixes known to visualdiff [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/1184939 (owner: 10Subramanya Sastry) [12:26:39] (03CR) 10C. Scott Ananian: [C:03+2] cloudvps-configs: Update README + minor tweak to setup_vm.sh script [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/1184906 (owner: 10Subramanya Sastry) [12:26:52] (03CR) 10C. Scott Ananian: [C:03+2] Minor tweak to retry script [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/1184960 (owner: 10Subramanya Sastry) [12:27:41] (03Merged) 10jenkins-bot: cloudvps-configs: Update README + minor tweak to setup_vm.sh script [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/1184906 (owner: 10Subramanya Sastry) [12:28:29] (03Merged) 10jenkins-bot: Update list of wikipedia prefixes known to visualdiff [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/1184939 (owner: 10Subramanya Sastry) [12:28:29] (03Merged) 10jenkins-bot: Minor tweak to retry script [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/1184960 (owner: 10Subramanya Sastry) [13:11:31] FIRING: [3x] PuppetAgentFailure: Puppet agent failure detected on instance deployment-cache-text08 in project deployment-prep - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentFailure [13:23:30] RESOLVED: [3x] PuppetAgentFailure: Puppet agent failure detected on instance deployment-cache-text08 in project deployment-prep - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentFailure [13:28:05] 10Beta-Cluster-Infrastructure, 06Traffic, 13Patch-For-Review: Puppet agent failure detected on instance deployment-cache-text08 in project deployment-prep - https://phabricator.wikimedia.org/T403616#11151947 (10ssingh) Thanks everyone, for working so quickly to get this fixed! [13:28:48] 10Beta-Cluster-Infrastructure, 06Traffic, 13Patch-For-Review: Puppet agent failure detected on instance deployment-cache-text08 in project deployment-prep - https://phabricator.wikimedia.org/T403616#11151948 (10Vgutierrez) 05Openβ†’03Resolved puppet is now happy on deployment-cache-text08. [13:42:46] 10WikimediaDebug, 06Wikipedia-Android-App-Backlog: Add WikimediaDebug functionality to the Wikimedia Android app - https://phabricator.wikimedia.org/T403824 (10Tgr) 03NEW [13:43:08] 10WikimediaDebug, 06Wikipedia-Android-App-Backlog: Add WikimediaDebug functionality to the Wikimedia Android app - https://phabricator.wikimedia.org/T403824#11152024 (10Tgr) [14:01:37] hashar: could you possibly do a revert and deploy of https://gerrit.wikimedia.org/r/c/integration/config/+/1184873 ? I need to deploy an emergency fix for wmf.17, and CI is broken because of the Graph/Pageview dependency [14:01:52] cc James_F Reedy, https://gerrit.wikimedia.org/r/c/mediawiki/extensions/PageViewInfo/+/1184869 is also related [14:03:08] 10Continuous-Integration-Infrastructure (Zuul upgrade): Investigate how Zuul finger gateway works - https://phabricator.wikimedia.org/T403734#11152071 (10hashar) The finger protocol: https://en.wikipedia.org/wiki/Finger_(protocol) ---- During our meeting I was looking at the [[Β https://zuul-ci.org/docs/zuul/la... [14:03:17] oh joy [14:03:25] it might be that reverting https://gerrit.wikimedia.org/r/c/mediawiki/extensions/PageViewInfo/+/1184869 is better, I am not sure [14:03:33] or that reverting both https://gerrit.wikimedia.org/r/c/mediawiki/extensions/PageViewInfo/+/1184869 and the integration/config patch is necessary [14:03:40] We were getting that error before either of those patches were merged [14:03:41] https://phabricator.wikimedia.org/T403762 [14:04:12] Reverting an extension patch in master won't unbreak WMF deployment [14:04:15] oh. Should that task be resolved, then? [14:04:33] Well, that task was resolved because the WikimediaMessages patches were passing [14:04:55] https://gerrit.wikimedia.org/r/c/mediawiki/extensions/ConfirmEdit/+/1185096 is what is not passing [14:05:29] Reverting the CI patch is probably enough, as it'll be injecting a dependancy that master just won't use [14:06:03] ok. is someone able to do that now? [14:06:21] (03PS1) 10Reedy: Revert "Zuul: [mediawiki/extensions/PageViewInfo] Drop Graph dependency" [integration/config] - 10https://gerrit.wikimedia.org/r/1185102 [14:06:28] (03CR) 10Reedy: [C:03+2] Revert "Zuul: [mediawiki/extensions/PageViewInfo] Drop Graph dependency" [integration/config] - 10https://gerrit.wikimedia.org/r/1185102 (owner: 10Reedy) [14:08:16] (03Merged) 10jenkins-bot: Revert "Zuul: [mediawiki/extensions/PageViewInfo] Drop Graph dependency" [integration/config] - 10https://gerrit.wikimedia.org/r/1185102 (owner: 10Reedy) [14:09:40] !log Reloading Zuul to deploy https://gerrit.wikimedia.org/r/1185102 [14:09:41] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [14:09:58] hmm [14:10:11] thank you Reedy ! [14:10:26] thanks! [14:11:10] feel free to add the requirement in the extension.json [14:11:46] hashar: It's not a hard dependancy [14:11:50] And it's been removed, in master [14:12:14] because the Graph extension has been broken... for a long time [14:18:53] ahhh [14:19:40] And as the Graph extension ain't coming back, James_F worked on some patches last night to undeploy it [14:20:06] and for https://phabricator.wikimedia.org/T403762 [14:20:16] should WikimediaMessages code remove dependency on graph? [14:20:21] or that is what James has already done maybe? [14:20:42] I guess once the series of patch removing Graph have progressed in the wmf branches [14:20:46] we can get rid of the CI dependency [14:20:57] (and maybe REL branches will be broken but well hmm) [14:21:10] I doubt WikimediaMessages depends on much [14:21:25] cldr apparently [14:23:41] * 284eb7dc5 - (origin/wmf/next, origin/wmf/branch_cut_pretest) undeployedplaceholders: Add used Graph disabled cat i18n too, so we can undeploy it (24 hours ago) [14:23:44] that is for WikimediaMessages [14:23:51] but it is not in wmf branches [14:24:01] hmm [14:24:23] Yeah, just some i18n strings [14:24:59] which has a mediawiki config patch related to it [14:25:16] ahhh https://gerrit.wikimedia.org/r/c/mediawiki/extensions/PageViewInfo/+/1184869 [14:25:25] that is the one that blocked kostajh backport [14:25:32] and I guess that removal can be backported to the wmf branch [14:25:38] or well [14:25:55] just wait next week to restore the integration/config patch [14:25:59] all set [14:36:46] I don’t understand the last few comments [14:37:10] does something else need to be backported/deployed before https://gerrit.wikimedia.org/r/c/mediawiki/extensions/ConfirmEdit/+/1185096 can merge? [14:39:45] no [14:42:43] except is has failed again [14:43:06] 15:41:15 'ext.pageviewinfo' => Array ( [14:43:06] 15:41:15 + 0 => 'ext.graph.render' [14:43:06] 15:41:15 ) [14:43:15] That is behaving like graph is there when it isn't expected to be [14:43:31] (still) [14:44:16] quibble-vendor passes, wmf-quibble-vendor doesn't [14:44:46] cause Graph is in the gate [14:45:09] we should just turn that off [14:45:15] because the extension isn't enabled [14:45:44] Ibd1e88d86073063c11b6c0aade5f2b8bf128ef8b [14:45:45] revert that one [14:45:51] I can't do it, I have an appointment [14:46:10] reverting it will add back Graph to the wmf-quibble-vendor job [14:46:11] I am off [14:49:29] Reedy: can you revert and deploy https://gerrit.wikimedia.org/r/c/integration/config/+/1184837 please? [14:50:00] or, can I force merge the ConfirmEdit patch? [15:01:28] kostajh: I'll do that for you [15:01:41] thanks! [15:02:12] (03PS1) 10Ahmon Dancy: Revert "Zuul: [mediawiki/extensions/Graph] Drop from gate" [integration/config] - 10https://gerrit.wikimedia.org/r/1185111 [15:02:58] dancy: Don't bother [15:03:16] OK. Abandon the revert? [15:03:27] [16:00:11] <+wikibugs> (Merged) jenkins-bot: Drop PageViewInfo's integration with the Graph extension on action=info, the extension is dead [extensions/PageViewInfo] (wmf/1.45.0-wmf.17) - https://gerrit.wikimedia.org/r/1185108 (https://phabricator.wikimedia.org/T403753) (owner: Reedy) [15:03:37] aha [15:03:45] As that's merged, the ConfirmEdit patch should be fine as the offending code is gone [15:03:46] (03Abandoned) 10Ahmon Dancy: Revert "Zuul: [mediawiki/extensions/Graph] Drop from gate" [integration/config] - 10https://gerrit.wikimedia.org/r/1185111 (owner: 10Ahmon Dancy) [15:03:59] Prevents having to keep reverting stuff that isn't ever going to come back [15:04:04] thanks [15:05:50] (03CR) 10Jforrester: "This was the wrong thing to revert anyway." [integration/config] - 10https://gerrit.wikimedia.org/r/1185111 (owner: 10Ahmon Dancy) [15:08:15] (03open) 10dancy: ingress-nginx.yaml.tftpl: Enable proxy protocol again [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/501 (https://phabricator.wikimedia.org/T396924) [15:08:17] (03update) 10dancy: ingress-nginx.yaml.tftpl: Enable proxy protocol again [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/501 (https://phabricator.wikimedia.org/T396924) [15:09:23] (03merge) 10dancy: ingress-nginx.yaml.tftpl: Enable proxy protocol again [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/501 (https://phabricator.wikimedia.org/T396924) [15:16:15] I'm starting the backport now. Reedy are you able to verify the PageViewInfo changes when this is up on mwdebug? The deploy will take a long while due to the i18n changes in that patch [15:18:33] dancy: I started deploying https://gerrit.wikimedia.org/r/c/operations/mediawiki-config/+/1184968 earlier today, then pressed "Cancel" after mwdebug. I now want this patch to go out alongside https://gerrit.wikimedia.org/r/c/mediawiki/extensions/ConfirmEdit/+/1185096 [15:18:45] I believe scap will pick it up and bring it along, does that sound right? [15:18:51] (03open) 10dancy: Revert "ingress-nginx.yaml.tftpl: Enable proxy protocol again" [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/502 [15:18:54] (03update) 10dancy: Revert "ingress-nginx.yaml.tftpl: Enable proxy protocol again" [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/502 [15:18:55] * dancy reads [15:19:15] https://spiderpig.wikimedia.org/jobs/520 is the current backport job [15:19:21] Yes, scap will deploy whatever has already been merged. [15:20:06] ok, thanks [15:21:18] (03update) 10dancy: Revert "ingress-nginx.yaml.tftpl: Enable proxy protocol again" [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/502 (https://phabricator.wikimedia.org/T396924) [15:21:21] (03update) 10dancy: Revert "ingress-nginx.yaml.tftpl: Enable proxy protocol again" [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/502 (https://phabricator.wikimedia.org/T396924) [15:23:00] (03merge) 10dancy: Revert "ingress-nginx.yaml.tftpl: Enable proxy protocol again" [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/502 (https://phabricator.wikimedia.org/T396924) [15:23:15] 06Release-Engineering-Team, 10wikimedia.biterg.io: Create account for Lauren de Lench on wikimedia.biterg.io - https://phabricator.wikimedia.org/T403836 (10ldelench_wmf) 03NEW [15:25:50] * thcipriani shakes fist at CI [15:40:20] 10Continuous-Integration-Infrastructure (Zuul upgrade): Investigate how Zuul finger gateway works - https://phabricator.wikimedia.org/T403734#11152726 (10Dzahn) Thank you, Hashar, sounds good to me :) [15:48:31] (03PS1) 10Jforrester: Revert^2 "Zuul: [mediawiki/extensions/PageViewInfo] Drop Graph dependency" [integration/config] - 10https://gerrit.wikimedia.org/r/1185128 [15:57:00] (03open) 10jforrester: releases: Bump mediawiki/mediawiki-codesniffer to v48.0.0 [repos/ci-tools/libup-config] - 10https://gitlab.wikimedia.org/repos/ci-tools/libup-config/-/merge_requests/91 [16:03:48] (03close) 10jforrester: releases: Bump mediawiki/mediawiki-codesniffer to v48.0.0 [repos/ci-tools/libup-config] - 10https://gitlab.wikimedia.org/repos/ci-tools/libup-config/-/merge_requests/91 [16:03:56] (03merge) 10jforrester: releases.json: Upgrade mediawiki/mediawiki-codesniffer to 48.0.0 in master [repos/ci-tools/libup-config] - 10https://gitlab.wikimedia.org/repos/ci-tools/libup-config/-/merge_requests/90 (https://phabricator.wikimedia.org/T403736) (owner: 10reedy) [16:04:29] (03open) 10dancy: reggie-values.yaml.tftpl: Allow write access from anywhere [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/503 (https://phabricator.wikimedia.org/T396924) [16:04:31] (03update) 10dancy: reggie-values.yaml.tftpl: Allow write access from anywhere [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/503 (https://phabricator.wikimedia.org/T396924) [16:05:51] (03update) 10dancy: reggie-values.yaml.tftpl: Allow write access from anywhere [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/503 (https://phabricator.wikimedia.org/T396924) [16:17:45] (03PS2) 10Jforrester: jjb: [wikilambda-catalyst*] Always clean up catalyst environments [integration/config] - 10https://gerrit.wikimedia.org/r/1184944 (https://phabricator.wikimedia.org/T402591) (owner: 10Jeena Huneidi) [16:18:32] (03CR) 10Jforrester: [C:03+2] "Deployed." [integration/config] - 10https://gerrit.wikimedia.org/r/1184944 (https://phabricator.wikimedia.org/T402591) (owner: 10Jeena Huneidi) [16:20:13] (03Merged) 10jenkins-bot: jjb: [wikilambda-catalyst*] Always clean up catalyst environments [integration/config] - 10https://gerrit.wikimedia.org/r/1184944 (https://phabricator.wikimedia.org/T402591) (owner: 10Jeena Huneidi) [17:01:06] (03approved) 10bd808: reggie-values.yaml.tftpl: Allow write access from anywhere [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/503 (https://phabricator.wikimedia.org/T396924) (owner: 10dancy) [17:01:42] (03merge) 10dancy: reggie-values.yaml.tftpl: Allow write access from anywhere [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/503 (https://phabricator.wikimedia.org/T396924) [17:05:12] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for [YOUR DEVELOPER ACCOUNT USERNAME HERE] - https://phabricator.wikimedia.org/T403844 (10Sakshi2) 03NEW [17:05:59] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for: sakshi2 - https://phabricator.wikimedia.org/T403844#11153036 (10Agamyasamuel) [17:07:11] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for: sakshi2 - https://phabricator.wikimedia.org/T403844#11153038 (10Agamyasamuel) We are onboard new developers. I vouch for the user @Sakshi2 [17:18:23] 10Continuous-Integration-Infrastructure (Zuul upgrade), 10Release-Engineering-Team (Priority Backlog πŸ“₯), 06collaboration-services: Deploy zuul executor on executor VM - https://phabricator.wikimedia.org/T403847 (10thcipriani) 03NEW [17:30:31] 10Continuous-Integration-Infrastructure (Zuul upgrade), 10Release-Engineering-Team (Priority Backlog πŸ“₯), 06collaboration-services: Deploy zuul executor on executor VM - https://phabricator.wikimedia.org/T403847#11153103 (10Dzahn) https://gerrit.wikimedia.org/r/c/operations/puppet/+/1151279 https://gerrit.wi... [17:32:11] 10Continuous-Integration-Infrastructure (Zuul upgrade), 10Release-Engineering-Team (Priority Backlog πŸ“₯), 06collaboration-services: Deploy zuul executor on executor VM - https://phabricator.wikimedia.org/T403847#11153108 (10Dzahn) ` [zuul1002:/] $ sudo file /etc/zuul/ssh/id_rsa /etc/zuul/ssh/id_rsa: OpenSSH... [17:35:47] 10Continuous-Integration-Infrastructure (Zuul upgrade), 10Release-Engineering-Team (Priority Backlog πŸ“₯), 06collaboration-services: Deploy zuul executor on executor VM - https://phabricator.wikimedia.org/T403847#11153118 (10Dzahn) a:03Dzahn [18:18:26] 10Continuous-Integration-Infrastructure (Zuul upgrade), 10Release-Engineering-Team (Priority Backlog πŸ“₯), 06collaboration-services, 13Patch-For-Review: Deploy zuul executor on executor VM - https://phabricator.wikimedia.org/T403847#11153318 (10Dzahn) > Needs to allow connections from the zuul-web/fingergate... [19:14:17] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for: sakshi2 - https://phabricator.wikimedia.org/T403844#11153493 (10AntiCompositeNumber) @Agamyasamuel You can add them to the #trusted-contributors group on Phabricator and their GitLab account will be approved auto... [19:28:34] 10Release-Engineering-Team (Priority Backlog πŸ“₯), 05Release, 05Train Deployments: 1.45.0-wmf.18 deployment blockers - https://phabricator.wikimedia.org/T396379#11153556 (10cscott) ##### Risky Patch! πŸš‚πŸ”₯ * **Change**: [Warn if PHP serialization of ParserOutput occurs (1165572)](https://gerrit.wikimedia.org/r... [19:30:11] 10Phabricator, 10fundraising-tech-ops: Phabricator conduit API queries are failing with 403 response - https://phabricator.wikimedia.org/T403860 (10Dwisehaupt) 03NEW [19:30:49] 10Phabricator, 10fundraising-tech-ops: Phabricator conduit API queries are failing with 403 response - https://phabricator.wikimedia.org/T403860#11153574 (10Dzahn) Where are these scripts running? [19:39:11] 10Phabricator, 10fundraising-tech-ops: Phabricator conduit API queries are failing with 403 response - https://phabricator.wikimedia.org/T403860#11153610 (10JJMC89) The scrips are likely being blocked because they do not comply with the [[ https://foundation.wikimedia.org/wiki/Policy:Wikimedia_Foundation_User-... [19:44:37] !log extloc: built latest image and restarted service [19:44:38] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [19:45:13] 10Phabricator, 10fundraising-tech-ops: Phabricator conduit API queries are failing with 403 response - https://phabricator.wikimedia.org/T403860#11153630 (10Dwisehaupt) 05Openβ†’03Resolved a:03Dwisehaupt @Dzahn This are running locally from my host. Not production related, just convenience scripts for... [19:47:45] 10Phabricator, 10fundraising-tech-ops: Phabricator conduit API queries are failing with 403 response - https://phabricator.wikimedia.org/T403860#11153640 (10Dzahn) @Dwisehaupt I was asking to determine if it was from a cloud provider. We had to throttle those more. If you still have issues later please let... [19:56:09] 10Beta-Cluster-Infrastructure, 10Automoderator, 10Moderator-Tools-Team (Kanban), 07Wikimedia-production-error: AutoModerator WikiPageConfig::getConfigData failed to load config from wiki: {error} - https://phabricator.wikimedia.org/T403756#11153654 (10Scardenasmolinar) 05Openβ†’03In progress a:03Scarden... [20:08:38] 06Project-Admins: Create project tag for VPS-project-voterlists - https://phabricator.wikimedia.org/T403862 (10SD0001) 03NEW [20:10:30] 10Continuous-Integration-Infrastructure (Zuul upgrade), 10Release-Engineering-Team (Priority Backlog πŸ“₯), 06collaboration-services, 13Patch-For-Review: Deploy zuul executor on executor VM - https://phabricator.wikimedia.org/T403847#11153698 (10Dzahn) We need an `/etc/zuul/zuul.conf` specific to executors.... [20:12:14] 10Continuous-Integration-Infrastructure (Zuul upgrade), 10Release-Engineering-Team (Priority Backlog πŸ“₯), 06collaboration-services, 13Patch-For-Review: Deploy zuul executor on executor VM - https://phabricator.wikimedia.org/T403847#11153712 (10Dzahn) executor.manage_ansible ` It is recommended to set this... [20:28:27] 10GitLab (CI & Job Runners), 13Patch-For-Review: kokkuri cannot publish "public" images from WMCS runners due to a lack of a local registry - https://phabricator.wikimedia.org/T396924#11153735 (10bd808) It works! https://gitlab.wikimedia.org/repos/releng/zuul/tofu-provisioning/-/jobs/607302 ` #27 exporting to... [21:05:13] (03PS1) 10Umherirrender: Zuul: [mediawiki/extensions/Citoid] Add MobileFrontend for phan [integration/config] - 10https://gerrit.wikimedia.org/r/1185213 [21:40:29] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for: sakshi2 - https://phabricator.wikimedia.org/T403844#11153894 (10Agamyasamuel) >>! In T403844#11153493, @AntiCompositeNumber wrote: > @Agamyasamuel You can add them to the #trusted-contributors group on Phabricato... [21:44:50] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for: sakshi2 - https://phabricator.wikimedia.org/T403844#11153910 (10Agamyasamuel) 05Openβ†’03Resolved [23:49:42] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Doing 😎), 07Zuul, 07Essential-Work: 2 stuck mwskin-phpunit-coverage-patch jobs - https://phabricator.wikimedia.org/T403306#11154047 (10thcipriani) [23:55:27] 10Release-Engineering-Team (Doing 😎), 13Patch-For-Review: Catalyst configuration as code - https://phabricator.wikimedia.org/T396897#11154059 (10thcipriani) [23:56:58] 10Release-Engineering-Team (Doing 😎), 07OKR-Work, 13Patch-For-Review: Catalyst configuration as code - https://phabricator.wikimedia.org/T396897#11154061 (10thcipriani) [23:57:28] 10Release-Engineering-Team (Priority Backlog πŸ“₯), 07Essential-Work, 05Release, 05Train Deployments: 1.45.0-wmf.17 deployment blockers - https://phabricator.wikimedia.org/T396378#11154062 (10thcipriani)