[05:30:51] 10Project-Admins: Create new project tag "Thai-Sites" - https://phabricator.wikimedia.org/T308403 (10PatsagornY) I think I would be more useful to have a tag to track all these requests and bugs. Manually subscribe for each user who might be interested is truly a pain. The task to put in eg. T306812 T308142, T30... [07:42:22] 10Scap, 10SRE, 10SRE-Access-Requests: Add new user identity to Keyholder for scap - https://phabricator.wikimedia.org/T307351 (10jnuche) 05Resolvedβ†’03Open Reopening to try to get some feedback. [07:46:08] 10Beta-Cluster-Infrastructure: Puppet broken on deploy03 - https://phabricator.wikimedia.org/T307762 (10elukey) Tried to recheck, afaics `wmflib::resource_hosts` is called by `profile::scap::dsh`, but I cannot reach `puppetdb03` from `deploy03` (the firewall rules on `puppetdb03` confirm what I am seeing, no rul... [07:50:04] 10Beta-Cluster-Infrastructure: Puppet broken on deploy03 - https://phabricator.wikimedia.org/T307762 (10elukey) This may be due to T303559 and https://gerrit.wikimedia.org/r/c/operations/puppet/+/771441, @jbond do you have any idea? [07:51:05] o/ [08:05:56] (03CR) 10Jaime Nuche: [C: 03+1] backport: add get_user_ssh_env() to gerrit_ssh() [tools/scap] - 10https://gerrit.wikimedia.org/r/791454 (owner: 10Brennen Bearnes) [08:07:57] (03CR) 10Jaime Nuche: [C: 03+2] backport: add get_user_ssh_env() to gerrit_ssh() [tools/scap] - 10https://gerrit.wikimedia.org/r/791454 (owner: 10Brennen Bearnes) [08:12:19] (03Merged) 10jenkins-bot: backport: add get_user_ssh_env() to gerrit_ssh() [tools/scap] - 10https://gerrit.wikimedia.org/r/791454 (owner: 10Brennen Bearnes) [08:21:39] (03CR) 10Hashar: "Thank you Ahmon for your assistance :)" [tools/scap] - 10https://gerrit.wikimedia.org/r/775400 (https://phabricator.wikimedia.org/T308020) (owner: 10Hashar) [08:23:10] 10Release-Engineering-Team (Doing), 10Scap, 10Patch-For-Review: Run scap CI against Stretch, Buster, Bullseye - https://phabricator.wikimedia.org/T308020 (10hashar) 05Openβ†’03Resolved We now ensure #scap test suite works against Debian Stretch, Buster and Bullseye. I even caught a python 3.9 incompatibili... [08:23:53] (03CR) 10Hashar: [C: 03+2] Make Renameuser a phan dependency for GlobalBlocking [integration/config] - 10https://gerrit.wikimedia.org/r/791809 (owner: 10Skizzerz) [08:26:12] (03Merged) 10jenkins-bot: Make Renameuser a phan dependency for GlobalBlocking [integration/config] - 10https://gerrit.wikimedia.org/r/791809 (owner: 10Skizzerz) [08:27:35] hashar: I sent you a review to add someone to the CI list [08:29:02] (03CR) 10David Caro: Zuul: add Jiyu to CI Allow list (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/791731 (owner: 10RhinosF1) [08:30:51] (03PS3) 10RhinosF1: Zuul: add Jiyu to CI Allow list [integration/config] - 10https://gerrit.wikimedia.org/r/791731 [08:31:02] (03CR) 10RhinosF1: Zuul: add Jiyu to CI Allow list (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/791731 (owner: 10RhinosF1) [08:31:16] That one [08:33:22] !log Reloading Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/791809 [08:33:23] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [08:33:46] RhinosF1: yeah I am processing my reviews this morning :) [08:34:05] (03CR) 10Hashar: [C: 03+2] Zuul: add Jiyu to CI Allow list [integration/config] - 10https://gerrit.wikimedia.org/r/791731 (owner: 10RhinosF1) [08:36:10] (03Merged) 10jenkins-bot: Zuul: add Jiyu to CI Allow list [integration/config] - 10https://gerrit.wikimedia.org/r/791731 (owner: 10RhinosF1) [08:52:46] (03PS1) 10Daniel Kinzler: pre-commit hook: abort after fixing code smells. [tools/code-utils] - 10https://gerrit.wikimedia.org/r/792110 [08:54:54] (03PS1) 10Hashar: zuul: fix typo in GlobalBlocking phan dependency [integration/config] - 10https://gerrit.wikimedia.org/r/792111 [08:55:22] (03CR) 10Hashar: [C: 03+2] zuul: fix typo in GlobalBlocking phan dependency [integration/config] - 10https://gerrit.wikimedia.org/r/792111 (owner: 10Hashar) [08:55:59] (03CR) 10Hashar: [C: 03+2] Make Renameuser a phan dependency for GlobalBlocking (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/791809 (owner: 10Skizzerz) [08:57:33] (03Merged) 10jenkins-bot: zuul: fix typo in GlobalBlocking phan dependency [integration/config] - 10https://gerrit.wikimedia.org/r/792111 (owner: 10Hashar) [09:22:09] where can I find the repo responsible for the image: releng/java8-wikidata-query-rdf? [09:24:19] dcausse: integration/config [09:24:25] je peux te faire visiter :] [09:25:36] dcausse: actually we got rid of that image in December 2020 https://gerrit.wikimedia.org/r/c/integration/config/+/651529 [09:26:34] the WDQS repository has been made to use the standard maven / java 8 base image [09:26:46] hashar: oh ok [09:27:19] rationale at https://gerrit.wikimedia.org/r/c/integration/config/+/651528 : Previously, WDQS builds were also doing some nodejs tests and required a custom docker image that contains chromium and phantomjs. This is no longer needed and we should be able to standardize the builds. [09:27:40] I guess maven magically retrieve nodejs/chromium/puppeteer etc [09:28:39] I think it's because we separated the ui out of this repo [09:31:29] hashar: thanks! did not know that docker files were in integration/config [10:33:31] Ty hashar [10:53:10] 10Beta-Cluster-Infrastructure: Puppet broken on deploy03 - https://phabricator.wikimedia.org/T307762 (10jbond) 05Openβ†’03Resolved a:03jbond This is working now. I had to fix up api redirect in "[LOCAL HACK] Attempt to secure Puppet DB better" on the deployment prep puppetmaster. please reopen if there are... [11:07:14] 10Release-Engineering-Team, 10Scap, 10MediaWiki Train Development Environment: train-dev's Gerrit zuul plugin returns a different object than production Gerrit - https://phabricator.wikimedia.org/T308290 (10hashar) [11:09:22] 10GitLab (CI & Job Runners), 10Release-Engineering-Team (GitLab-a-thon 🦊), 10Infrastructure-Foundations, 10SRE, and 3 others: Access to trusted gitlab runners for gitlab-roots (or appropriate similar group) - https://phabricator.wikimedia.org/T308350 (10jbond) >>! In T308350#7928087, @thcipriani wrote: > S... [11:10:26] 10Release-Engineering-Team, 10Scap, 10MediaWiki Train Development Environment: train-dev's Gerrit zuul plugin returns a different object than production Gerrit - https://phabricator.wikimedia.org/T308290 (10hashar) That is due to T307621 . The upstream repo was lagging behind and its master branch did not wo... [11:11:13] 10Release-Engineering-Team (Doing), 10Scap, 10MediaWiki Train Development Environment: train-dev's Gerrit zuul plugin returns a different object than production Gerrit - https://phabricator.wikimedia.org/T308290 (10hashar) [11:12:21] 10Beta-Cluster-Infrastructure: Puppet broken on deploy03 - https://phabricator.wikimedia.org/T307762 (10elukey) Nice catch, TIL about `wmflib::resource_hosts`, thanks John! [11:15:40] 10Phabricator, 10Growth-Team: Creation of a Growth Team Task Form Template - https://phabricator.wikimedia.org/T308234 (10DMburugu) @Aklapper I was directed to the creation of URL forms and that worked for my use case. Thanks for following up. [11:18:38] Hello, is it possible that the deploys to beta are stuck? [11:21:29] I just killed a stuck job at https://integration.wikimedia.org/ci/view/Beta/job/beta-scap-sync-world/, sometimes that helps [11:21:47] hopefully a new job will be created within 10 minutes or so [11:22:35] Lucas_WMDE: Good to know. Thank you. [11:44:16] 10Beta-Cluster-Infrastructure: Puppet broken on deploy03 - https://phabricator.wikimedia.org/T307762 (10jbond) >>! In T307762#7930473, @elukey wrote: > Nice catch, TIL about `wmflib::resource_hosts`, thanks John! FYi there is also a `wmflib::role_hosts` and `wmflib::class_hosts` and grep for `puppetdb_query` to... [12:46:41] 10Beta-Cluster-Infrastructure, 10Wikidata, 10Wikidata-Termbox, 10wdwb-tech, and 3 others: Move Termbox SSR for Beta Wikidata into deployment-prep project - https://phabricator.wikimedia.org/T304328 (10ItamarWMDE) a:03ItamarWMDE [13:26:13] (03PS1) 10Wangombe: Allow some more tags and attributes [integration/config] - 10https://gerrit.wikimedia.org/r/792203 (https://phabricator.wikimedia.org/T305134) [13:28:33] (03PS2) 10Wangombe: Allow some more tags and attributes [integration/config] - 10https://gerrit.wikimedia.org/r/792203 (https://phabricator.wikimedia.org/T305134) [13:50:24] (03CR) 10Abijeet Patro: [C: 03+1] "I think these tags are ok, but would like @Niklas to chip in." [integration/config] - 10https://gerrit.wikimedia.org/r/792203 (https://phabricator.wikimedia.org/T305134) (owner: 10Wangombe) [14:02:29] (03CR) 10Abijeet Patro: [C: 03+1] Allow some more tags and attributes (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/792203 (https://phabricator.wikimedia.org/T305134) (owner: 10Wangombe) [14:37:02] (03CR) 10Nikerabbit: [C: 03+1] Allow some more tags and attributes [integration/config] - 10https://gerrit.wikimedia.org/r/792203 (https://phabricator.wikimedia.org/T305134) (owner: 10Wangombe) [14:45:56] (03CR) 10SBassett: [C: 03+1] "I don't think any of these, with the current attribute list, should pose much of a security risk. dd and dl should be harmless. ref shou" [integration/config] - 10https://gerrit.wikimedia.org/r/792203 (https://phabricator.wikimedia.org/T305134) (owner: 10Wangombe) [14:57:39] 10Beta-Cluster-Infrastructure, 10CirrusSearch, 10MediaWiki-Core-JobQueue, 10Beta-Cluster-reproducible, 10Discovery-Search (Current work): Search on betacommons is not indexing anything - https://phabricator.wikimedia.org/T307862 (10Gehel) 05Openβ†’03Resolved [15:52:01] 10Scap, 10SRE, 10SRE-Access-Requests: Add new user identity to Keyholder for scap - https://phabricator.wikimedia.org/T307351 (10jnuche) 05Openβ†’03Resolved It's working now. The Keyholder proxy needed to be restarted on the deployment servers :) Thank you @Volans and @RLazarus [15:53:55] (03PS3) 10Jforrester: jjb: [mediawiki-i18n-check-docker] Allow bdi, dl, dd, and ref tags [integration/config] - 10https://gerrit.wikimedia.org/r/792203 (https://phabricator.wikimedia.org/T305134) (owner: 10Wangombe) [15:54:42] (03CR) 10Jforrester: [C: 03+2] "Deployed." [integration/config] - 10https://gerrit.wikimedia.org/r/792203 (https://phabricator.wikimedia.org/T305134) (owner: 10Wangombe) [15:56:36] (03Merged) 10jenkins-bot: jjb: [mediawiki-i18n-check-docker] Allow bdi, dl, dd, and ref tags [integration/config] - 10https://gerrit.wikimedia.org/r/792203 (https://phabricator.wikimedia.org/T305134) (owner: 10Wangombe) [16:29:40] 10Release-Engineering-Team (Doing), 10Scap, 10MediaWiki Train Development Environment: train-dev's Gerrit zuul plugin returns a different object than production Gerrit - https://phabricator.wikimedia.org/T308290 (10dancy) Thanks for the notes @hashar ! That is very helpful. [16:30:49] (03PS1) 10Ahmon Dancy: Remove unused exp/Dockerfile.mw-mv [tools/train-dev] - 10https://gerrit.wikimedia.org/r/792239 [16:30:51] (03PS1) 10Ahmon Dancy: Use Gerrit 3.4.4 instead of Gerrit 3.3.5 [tools/train-dev] - 10https://gerrit.wikimedia.org/r/792240 (https://phabricator.wikimedia.org/T308290) [16:50:21] (03CR) 10Ahmon Dancy: [C: 03+2] Remove unused exp/Dockerfile.mw-mv [tools/train-dev] - 10https://gerrit.wikimedia.org/r/792239 (owner: 10Ahmon Dancy) [16:51:30] 10GitLab (CI & Job Runners), 10Release-Engineering-Team (GitLab-a-thon 🦊), 10Infrastructure-Foundations, 10SRE, and 3 others: Access to trusted gitlab runners for gitlab-roots (or appropriate similar group) - https://phabricator.wikimedia.org/T308350 (10thcipriani) >>! In T308350#7930458, @jbond wrote: >>>... [16:51:40] (03Merged) 10jenkins-bot: Remove unused exp/Dockerfile.mw-mv [tools/train-dev] - 10https://gerrit.wikimedia.org/r/792239 (owner: 10Ahmon Dancy) [16:56:56] (03PS2) 10Ahmon Dancy: Use Gerrit 3.4.4 instead of Gerrit 3.3.5 [tools/train-dev] - 10https://gerrit.wikimedia.org/r/792240 (https://phabricator.wikimedia.org/T308290) [17:10:25] 10GitLab (CI & Job Runners), 10Release-Engineering-Team (GitLab-a-thon 🦊), 10Infrastructure-Foundations, 10SRE, and 3 others: Access to trusted gitlab runners for gitlab-roots (or appropriate similar group) - https://phabricator.wikimedia.org/T308350 (10jbond) >>! In T308350#7931549, @thcipriani wrote: >>>... [17:31:02] (03CR) 10Ahmon Dancy: [C: 03+2] Use Gerrit 3.4.4 instead of Gerrit 3.3.5 [tools/train-dev] - 10https://gerrit.wikimedia.org/r/792240 (https://phabricator.wikimedia.org/T308290) (owner: 10Ahmon Dancy) [17:32:14] (03Merged) 10jenkins-bot: Use Gerrit 3.4.4 instead of Gerrit 3.3.5 [tools/train-dev] - 10https://gerrit.wikimedia.org/r/792240 (https://phabricator.wikimedia.org/T308290) (owner: 10Ahmon Dancy) [17:53:24] 10Phabricator, 10Growth-Team: Creation of a Growth Team Task Form Template - https://phabricator.wikimedia.org/T308234 (10Aklapper) 05Resolvedβ†’03Declined [17:53:50] 10Release-Engineering-Team (Doing), 10MW-on-K8s, 10Release Pipeline, 10User-brennen: Scap backport change_url command - https://phabricator.wikimedia.org/T287042 (10jeena) [17:54:06] 10Release-Engineering-Team (🌱 Spring Cleaning β€” April 2022), 10Scap: Scap backport change_url: Implement β€œwhat are the commit hashes from the two repos that correspond to my merged commit(s)”. - https://phabricator.wikimedia.org/T295495 (10jeena) 05Openβ†’03Resolved a:03jeena [17:58:27] 10Release-Engineering-Team (Doing), 10MW-on-K8s, 10Release Pipeline, 10User-brennen: scap backport change_url: Update to use new zuul plugin - https://phabricator.wikimedia.org/T308474 (10jeena) [18:01:29] 10Release-Engineering-Team (Doing), 10MW-on-K8s, 10Release Pipeline, 10User-brennen: scap backport change_url: Deploy mwdebug - https://phabricator.wikimedia.org/T308476 (10jeena) [18:01:41] 10Release-Engineering-Team (Doing), 10MW-on-K8s, 10Release Pipeline, 10User-brennen: scap backport change_url: Deploy to mwdebug - https://phabricator.wikimedia.org/T308476 (10jeena) [18:21:25] 10Release-Engineering-Team (Doing), 10Scap, 10MediaWiki Train Development Environment, 10Patch-For-Review: train-dev's Gerrit zuul plugin returns a different object than production Gerrit - https://phabricator.wikimedia.org/T308290 (10dancy) 05Openβ†’03Resolved a:03dancy [18:34:35] 10Gerrit, 10DataΒ³, 10Patch-For-Review: Investigate sending Gerrit events to our data lake - https://phabricator.wikimedia.org/T304947 (10hashar) I have made a bit more progress today and managed to get a Json Schema which validates a comment added event from the Gerrit Java class! An issue I had was that th... [18:49:34] 10Phabricator, 10Release-Engineering-Team, 10SRE, 10SRE-Access-Requests: Add Antoine Musso to Phabricator hosts - https://phabricator.wikimedia.org/T308478 (10hashar) [18:54:59] 10Phabricator, 10Release-Engineering-Team, 10SRE, 10SRE-Access-Requests, 10Patch-For-Review: Add Antoine Musso to Phabricator hosts - https://phabricator.wikimedia.org/T308478 (10hashar) [18:56:30] 10Phabricator, 10Release-Engineering-Team, 10SRE, 10SRE-Access-Requests, 10Patch-For-Review: Add Antoine Musso to Phabricator hosts - https://phabricator.wikimedia.org/T308478 (10thcipriani) > Team manager is @thcipriani Approved from my side! [20:24:54] 10Release-Engineering-Team, 10Web Team Visual Regression Framework, 10Readers-Web-Backlog (Needs Prioritization (Tech)): Make visual regression tests run in CI (non-blocking) for the Vector repo - https://phabricator.wikimedia.org/T308194 (10nray) [20:33:16] 10Continuous-Integration-Config, 10Release-Engineering-Team (Seen), 10Wikimedia-Site-requests: Something like puppet-compile for wmf-config - https://phabricator.wikimedia.org/T189152 (10Zabe) [20:34:08] 10Release-Engineering-Team (Seen), 10Wikimedia-Site-requests, 10serviceops-radar: Consider creating a puppet-compiler equivalent for mediawiki-config.git - https://phabricator.wikimedia.org/T220775 (10Zabe) [20:44:03] 10GitLab (CI & Job Runners), 10Security Team AppSec, 10Security-Team, 10SecTeam-Processed, and 2 others: Re-implement semgrep ci includes - https://phabricator.wikimedia.org/T307962 (10sbassett) New semgrep-rules-merge tool created here: https://toolsadmin.wikimedia.org/tools/id/semgrep-rule-merge [20:44:39] (03Abandoned) 10Hashar: Switch from extension to plugin API [software/gerrit/jsonschemagenerator] - 10https://gerrit.wikimedia.org/r/791647 (owner: 10Hashar) [20:45:09] (03PS2) 10Hashar: Json schema from Gerrit Java event classes [software/gerrit/jsonschemagenerator] - 10https://gerrit.wikimedia.org/r/791642 (https://phabricator.wikimedia.org/T304947) [20:45:14] (03PS2) 10Hashar: Add SonarQube scanner [software/gerrit/jsonschemagenerator] - 10https://gerrit.wikimedia.org/r/791692 [20:45:31] (03CR) 10jerkins-bot: [V: 04-1] Json schema from Gerrit Java event classes [software/gerrit/jsonschemagenerator] - 10https://gerrit.wikimedia.org/r/791642 (https://phabricator.wikimedia.org/T304947) (owner: 10Hashar) [20:45:37] (03CR) 10jerkins-bot: [V: 04-1] Add SonarQube scanner [software/gerrit/jsonschemagenerator] - 10https://gerrit.wikimedia.org/r/791692 (owner: 10Hashar) [21:02:57] 10Release-Engineering-Team, 10Web Team Visual Regression Framework, 10Readers-Web-Backlog (Needs Prioritization (Tech)): Make visual regression tests run in CI (non-blocking) for the Vector repo - https://phabricator.wikimedia.org/T308194 (10nray) Thank you for your response @hashar. I have a follow up quest... [21:12:04] 10GitLab (CI & Job Runners), 10Release-Engineering-Team (GitLab-a-thon 🦊), 10User-brennen: Figure out authentication scheme for WMF production registry from trusted GitLab runners - https://phabricator.wikimedia.org/T308501 (10dduvall) [21:20:06] 10GitLab (CI & Job Runners), 10Release-Engineering-Team (GitLab-a-thon 🦊), 10User-brennen: Figure out authentication scheme for WMF production registry from trusted GitLab runners - https://phabricator.wikimedia.org/T308501 (10dduvall) [21:59:30] 10Gerrit, 10SRE, 10serviceops, 10Patch-For-Review: replacement for gerrit2001 - https://phabricator.wikimedia.org/T243027 (10Dzahn) >>! In T243027#7732585, @hashar wrote: > To replace the server, we can add the new one as a 2nd replica and have the repositories replicated there (should take a few hours at... [22:14:43] 10Continuous-Integration-Infrastructure, 10Wikimedia-Fundraising-CiviCRM, 10Patch-For-Review: CiviCRM CI jobs fails when migrating from Stretch to Bullseye - https://phabricator.wikimedia.org/T307178 (10Eileenmcnaughton) I would note that at that time `utf8bm4` was a conversion from `utf8` which was the old... [22:26:37] 10Gerrit, 10SRE, 10serviceops, 10Patch-For-Review: replacement for gerrit2001 - https://phabricator.wikimedia.org/T243027 (10Dzahn) reopened T299575 to move the host around