[00:35:36] 10Release-Engineering-Team (Now this 🫠), 05Release, 05Train Deployments: 1.42.0-wmf.21 deployment blockers - https://phabricator.wikimedia.org/T354439#9603817 (10Jdlrobson) [00:36:59] 10Release-Engineering-Team (Now this 🫠), 05Release, 05Train Deployments: 1.42.0-wmf.21 deployment blockers - https://phabricator.wikimedia.org/T354439#9603820 (10Jdlrobson) Train should wait on fix for T359229 (and roll out with it) since this caused quite a bit of disruption to communities last time it happ... [01:58:31] 10Continuous-Integration-Config, 10MediaWiki-Installer, 06MediaWiki-Platform-Team, 10MediaWiki-extensions-CentralAuth, 07ci-test-error: Admin account created by the installer isn't made global by CentralAuth (at least in CI) - https://phabricator.wikimedia.org/T358985#9603935 (10matmarex) >>! In T358985#... [02:22:23] 10Release-Engineering-Team (Now this 🫠), 05Release, 05Train Deployments: 1.42.0-wmf.21 deployment blockers - https://phabricator.wikimedia.org/T354439#9603956 (10SToyofuku-WMF) ^ @jnuche we've got a fix for the train blocker (https://gerrit.wikimedia.org/r/c/mediawiki/skins/MinervaNeue/+/1008986). If this c... [07:37:25] 10Release-Engineering-Team (Seen), 06Content-Transform-Team, 10MW-on-K8s, 06SRE, and 3 others: Create parsoid mediawiki deployment and migrate parsoid-php.discovery.wmnet traffic to it - https://phabricator.wikimedia.org/T357392#9604693 (10akosiaris) [07:41:41] 10Release-Engineering-Team (Seen), 06Content-Transform-Team, 10MW-on-K8s, 06SRE, and 3 others: Reimage parse* hosts as kubernetes nodes - https://phabricator.wikimedia.org/T358752#9604721 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by akosiaris@cumin1002 for host parse1014.eqiad... [09:49:13] 10Release-Engineering-Team (Seen), 06Content-Transform-Team, 10MW-on-K8s, 06SRE, and 2 others: Reimage parse* hosts as kubernetes nodes - https://phabricator.wikimedia.org/T358752#9604826 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by akosiaris@cumin1002 for host parse1014.eqiad.wmn... [09:49:49] 10Release-Engineering-Team (Now this 🫠), 05Release, 05Train Deployments: 1.42.0-wmf.21 deployment blockers - https://phabricator.wikimedia.org/T354439#9604841 (10jnuche) [09:50:05] 10Release-Engineering-Team (Seen), 06Content-Transform-Team, 10MW-on-K8s, 06SRE, and 2 others: Reimage parse* hosts as kubernetes nodes - https://phabricator.wikimedia.org/T358752#9604842 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by akosiaris@cumin1002 for host parse2008.codfw... [09:50:21] 10Release-Engineering-Team (Seen), 06Content-Transform-Team, 10MW-on-K8s, 06SRE, and 2 others: Reimage parse* hosts as kubernetes nodes - https://phabricator.wikimedia.org/T358752#9604847 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by akosiaris@cumin1002 for host parse2009.codfw... [09:50:53] 10Release-Engineering-Team (Seen), 06Content-Transform-Team, 10MW-on-K8s, 06SRE, and 2 others: Reimage parse* hosts as kubernetes nodes - https://phabricator.wikimedia.org/T358752#9604848 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by akosiaris@cumin1002 for host parse2010.codfw... [09:51:21] 10Release-Engineering-Team (Seen), 06Content-Transform-Team, 10MW-on-K8s, 06SRE, and 2 others: Reimage parse* hosts as kubernetes nodes - https://phabricator.wikimedia.org/T358752#9604849 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by akosiaris@cumin1002 for host parse2011.codfw... [09:51:49] 10Release-Engineering-Team (Seen), 06Content-Transform-Team, 10MW-on-K8s, 06SRE, and 2 others: Reimage parse* hosts as kubernetes nodes - https://phabricator.wikimedia.org/T358752#9604850 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by akosiaris@cumin1002 for host parse2012.codfw... [09:52:25] 10Release-Engineering-Team (Seen), 06Content-Transform-Team, 10MW-on-K8s, 06SRE, and 2 others: Reimage parse* hosts as kubernetes nodes - https://phabricator.wikimedia.org/T358752#9604852 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by akosiaris@cumin1002 for host parse2013.codfw... [09:54:09] 10Release-Engineering-Team (Seen), 06Content-Transform-Team, 10MW-on-K8s, 06SRE, and 2 others: Reimage parse* hosts as kubernetes nodes - https://phabricator.wikimedia.org/T358752#9604859 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by akosiaris@cumin1002 for host parse2014.codfw... [09:54:38] 10Release-Engineering-Team (Seen), 06Content-Transform-Team, 10MW-on-K8s, 06SRE, and 2 others: Reimage parse* hosts as kubernetes nodes - https://phabricator.wikimedia.org/T358752#9604860 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by akosiaris@cumin1002 for host parse2015.codfw... [10:02:16] 10Release-Engineering-Team (Seen), 06Content-Transform-Team, 10MW-on-K8s, 06SRE, and 2 others: Reimage parse* hosts as kubernetes nodes - https://phabricator.wikimedia.org/T358752#9604968 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by akosiaris@cumin1002 for host parse2009.codfw.wmn... [10:03:21] 10Release-Engineering-Team (Seen), 06Content-Transform-Team, 10MW-on-K8s, 06SRE, and 2 others: Reimage parse* hosts as kubernetes nodes - https://phabricator.wikimedia.org/T358752#9604974 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by akosiaris@cumin1002 for host parse2008.codfw.wmn... [10:04:21] 10Release-Engineering-Team (Seen), 06Content-Transform-Team, 10MW-on-K8s, 06SRE, and 2 others: Reimage parse* hosts as kubernetes nodes - https://phabricator.wikimedia.org/T358752#9605005 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by akosiaris@cumin1002 for host parse2013.codfw.wmn... [10:06:29] 10Release-Engineering-Team (Seen), 06Content-Transform-Team, 10MW-on-K8s, 06SRE, and 2 others: Reimage parse* hosts as kubernetes nodes - https://phabricator.wikimedia.org/T358752#9605029 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by akosiaris@cumin1002 for host parse2015.codfw.wmn... [10:07:38] 10Release-Engineering-Team (Seen), 06Content-Transform-Team, 10MW-on-K8s, 06SRE, and 2 others: Reimage parse* hosts as kubernetes nodes - https://phabricator.wikimedia.org/T358752#9605037 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by akosiaris@cumin1002 for host parse2012.codfw.wmn... [10:09:10] 10Release-Engineering-Team (Seen), 06Content-Transform-Team, 10MW-on-K8s, 06SRE, and 2 others: Reimage parse* hosts as kubernetes nodes - https://phabricator.wikimedia.org/T358752#9605060 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by akosiaris@cumin1002 for host parse2014.codfw.wmn... [10:10:02] 10Release-Engineering-Team (Seen), 06Content-Transform-Team, 10MW-on-K8s, 06SRE, and 2 others: Reimage parse* hosts as kubernetes nodes - https://phabricator.wikimedia.org/T358752#9605070 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by akosiaris@cumin1002 for host parse2010.codfw.wmn... [10:11:23] 10Release-Engineering-Team (Seen), 06Content-Transform-Team, 10MW-on-K8s, 06SRE, and 2 others: Reimage parse* hosts as kubernetes nodes - https://phabricator.wikimedia.org/T358752#9605090 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by akosiaris@cumin1002 for host parse2011.codfw.wmn... [10:24:02] 10Release-Engineering-Team (Now this 🫠), 05Release, 05Train Deployments: 1.42.0-wmf.21 deployment blockers - https://phabricator.wikimedia.org/T354439#9605211 (10jnuche) @Jdlrobson @SToyofuku-WMF Thank you for the fix! It's deployed now. [10:24:41] 10Release-Engineering-Team (Now this 🫠), 05Release, 05Train Deployments: 1.42.0-wmf.21 deployment blockers - https://phabricator.wikimedia.org/T354439#9605220 (10jnuche) [10:25:37] 10Release-Engineering-Team (Now this 🫠), 05Release, 05Train Deployments: 1.42.0-wmf.21 deployment blockers - https://phabricator.wikimedia.org/T354439#9605243 (10jnuche) [10:31:58] (03PS1) 10Ilias Sarantopoulos: ml-services: renamed directory for readability [integration/config] - 10https://gerrit.wikimedia.org/r/1009218 [10:34:49] 06Release-Engineering-Team, 06Tech-Docs-Team, 07Documentation: Review supporting deployment pipeline documentation - https://phabricator.wikimedia.org/T352262#9605328 (10KBach) Review of GitLab documentation on mediawiki.org is done. @brennen, the [[ https://www.mediawiki.org/wiki/GitLab/Gerrit_to_GitLab#R... [10:35:23] 06Release-Engineering-Team, 06Tech-Docs-Team, 07Documentation: Review supporting deployment pipeline documentation - https://phabricator.wikimedia.org/T352262#9605332 (10KBach) [10:36:52] 06Release-Engineering-Team, 10Temporary accounts, 06Trust and Safety Product Team: Temp accounts deployment and the release train - https://phabricator.wikimedia.org/T355882#9605381 (10kostajh) [10:53:27] 10Phabricator, 10Tool-phab-ban, 06collaboration-services: Phabricator admins should have access to phab-ban tool - https://phabricator.wikimedia.org/T359212#9605475 (10Bugreporter) [11:36:34] 10Phabricator: mmodell's staff account is still a Phabricator administrator - https://phabricator.wikimedia.org/T359313 (10Bugreporter) [12:40:44] 10Release-Engineering-Team (Seen), 06Content-Transform-Team, 10MW-on-K8s, 06SRE, and 3 others: Reimage parse* hosts as kubernetes nodes - https://phabricator.wikimedia.org/T358752#9606067 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by akosiaris@cumin1002 for host parse2002.codfw... [12:41:32] 10Release-Engineering-Team (Seen), 06Content-Transform-Team, 10MW-on-K8s, 06SRE, and 3 others: Reimage parse* hosts as kubernetes nodes - https://phabricator.wikimedia.org/T358752#9606068 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by akosiaris@cumin1002 for host parse2003.codfw... [12:42:04] 10Release-Engineering-Team (Seen), 06Content-Transform-Team, 10MW-on-K8s, 06SRE, and 3 others: Reimage parse* hosts as kubernetes nodes - https://phabricator.wikimedia.org/T358752#9606070 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by akosiaris@cumin1002 for host parse2004.codfw... [12:42:41] 10Release-Engineering-Team (Seen), 06Content-Transform-Team, 10MW-on-K8s, 06SRE, and 3 others: Reimage parse* hosts as kubernetes nodes - https://phabricator.wikimedia.org/T358752#9606072 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by akosiaris@cumin1002 for host parse2005.codfw... [12:43:14] 10Release-Engineering-Team (Seen), 06Content-Transform-Team, 10MW-on-K8s, 06SRE, and 3 others: Reimage parse* hosts as kubernetes nodes - https://phabricator.wikimedia.org/T358752#9606073 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by akosiaris@cumin1002 for host parse2006.codfw... [12:43:48] 10Release-Engineering-Team (Seen), 06Content-Transform-Team, 10MW-on-K8s, 06SRE, and 3 others: Reimage parse* hosts as kubernetes nodes - https://phabricator.wikimedia.org/T358752#9606080 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by akosiaris@cumin1002 for host parse2007.codfw... [12:57:51] (03CR) 10Elukey: [C: 03+1] ml-services: renamed directory for readability [integration/config] - 10https://gerrit.wikimedia.org/r/1009218 (owner: 10Ilias Sarantopoulos) [13:17:56] 10Release-Engineering-Team (Seen), 06Content-Transform-Team, 10MW-on-K8s, 06SRE, and 3 others: Reimage parse* hosts as kubernetes nodes - https://phabricator.wikimedia.org/T358752#9606271 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by akosiaris@cumin1002 for host parse2002.codfw.wmn... [13:18:24] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for USER[S] - https://phabricator.wikimedia.org/T359340 (10Isaac) [13:20:36] 10Release-Engineering-Team (Seen), 06Content-Transform-Team, 10MW-on-K8s, 06SRE, and 3 others: Reimage parse* hosts as kubernetes nodes - https://phabricator.wikimedia.org/T358752#9606285 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by akosiaris@cumin1002 for host parse2005.codfw.wmn... [13:21:07] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for desianabae1 - https://phabricator.wikimedia.org/T359340#9606297 (10taavi) [13:22:27] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for desianabae1 - https://phabricator.wikimedia.org/T359340#9606312 (10taavi) 05Open→03Resolved a:03taavi I have added them to #trusted-contributors here in Phabricator, this will make the #tool-gitlab-account-a... [13:24:43] 10Release-Engineering-Team (Seen), 06Content-Transform-Team, 10MW-on-K8s, 06SRE, and 3 others: Reimage parse* hosts as kubernetes nodes - https://phabricator.wikimedia.org/T358752#9606341 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by akosiaris@cumin1002 for host parse2003.codfw.wmn... [13:24:55] 10Release-Engineering-Team (Seen), 06Content-Transform-Team, 10MW-on-K8s, 06SRE, and 3 others: Reimage parse* hosts as kubernetes nodes - https://phabricator.wikimedia.org/T358752#9606342 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by akosiaris@cumin1002 for host parse2006.codfw.wmn... [13:27:22] 10Release-Engineering-Team (Seen), 06Content-Transform-Team, 10MW-on-K8s, 06SRE, and 3 others: Reimage parse* hosts as kubernetes nodes - https://phabricator.wikimedia.org/T358752#9606371 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by akosiaris@cumin1002 for host parse2007.codfw.wmn... [13:28:27] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for desianabae1 - https://phabricator.wikimedia.org/T359340#9606386 (10Isaac) Thanks @taavi! Indeed, unblocked now [13:30:22] 10Release-Engineering-Team (Seen), 06Content-Transform-Team, 10MW-on-K8s, 06SRE, and 3 others: Reimage parse* hosts as kubernetes nodes - https://phabricator.wikimedia.org/T358752#9606405 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by akosiaris@cumin1002 for host parse2004.codfw.wmn... [13:39:29] 10Release-Engineering-Team (Now this 🫠), 05Release, 05Train Deployments: 1.42.0-wmf.21 deployment blockers - https://phabricator.wikimedia.org/T354439#9606461 (10Urbanecm_WMF) [14:20:08] 10Release-Engineering-Team (Seen), 06Content-Transform-Team, 10MW-on-K8s, 06SRE, and 3 others: Create parsoid mediawiki deployment and migrate parsoid-php.discovery.wmnet traffic to it - https://phabricator.wikimedia.org/T357392#9606851 (10akosiaris) [14:23:30] 10Release-Engineering-Team (Seen), 06Content-Transform-Team, 10MW-on-K8s, 06SRE, and 2 others: Reimage parse* hosts as kubernetes nodes - https://phabricator.wikimedia.org/T358752#9606911 (10akosiaris) Almost all parsoid hosts have been reimaged as kubernetes nodes. Scandium, testreduce1002, parse1001 and... [14:24:31] 10Release-Engineering-Team (Seen), 06Content-Transform-Team, 10MW-on-K8s, 06SRE, and 3 others: Create parsoid mediawiki deployment and migrate parsoid-php.discovery.wmnet traffic to it - https://phabricator.wikimedia.org/T357392#9606936 (10akosiaris) [14:26:14] 10Release-Engineering-Team (Seen), 06Content-Transform-Team, 10MW-on-K8s, 06SRE, and 2 others: Reimage parse* hosts as kubernetes nodes - https://phabricator.wikimedia.org/T358752#9606934 (10akosiaris) 05Open→03Resolved [14:34:33] 10Release-Engineering-Team (Seen), 06Content-Transform-Team, 10MW-on-K8s, 06SRE, and 3 others: Create parsoid mediawiki deployment and migrate parsoid-php.discovery.wmnet traffic to it - https://phabricator.wikimedia.org/T357392#9607078 (10akosiaris) 05In progress→03Resolved [14:35:05] 10Release-Engineering-Team (Seen), 10MW-on-K8s, 06SRE, 06Traffic, 06serviceops: Serve production traffic via Kubernetes - https://phabricator.wikimedia.org/T290536#9607081 (10akosiaris) [14:45:44] 06Release-Engineering-Team, 06Data-Platform-SRE, 06Java-Scala-Standardization, 06collaboration-services, 07Security: Investigate replacing Archiva with Gitlab repositories - https://phabricator.wikimedia.org/T358612#9607250 (10Gehel) [15:15:23] FYI, there was some castor failure in the post-build processing of https://integration.wikimedia.org/ci/job/quibble-vendor-mysql-php74-noselenium-docker/159825/console [15:15:27] org.jenkinsci.plugins.postbuildscript.PostBuildScriptException: hudson.AbortException: castor-save-workspace-cache aborted. [15:15:38] I think I’ve seen this error once or twice before but I don’t remember if it tends to go away on its own or not [15:16:22] ok, apparently it’s tracked at https://phabricator.wikimedia.org/T352319 [15:17:43] 10Phabricator, 06Release-Engineering-Team: mmodell's staff account is still a Phabricator administrator - https://phabricator.wikimedia.org/T359313#9607452 (10taavi) [15:33:32] (03PS1) 10Pwangai: Zuul: [mediawiki/extensions/CommunityConfiguration] Enable Sonar Codehealth [integration/config] - 10https://gerrit.wikimedia.org/r/1009283 (https://phabricator.wikimedia.org/T321837) [15:34:57] (03PS1) 10Pwangai: Zuul: [mediawiki/extensions/GlobalCssJs] Enable Sonar Codehealth [integration/config] - 10https://gerrit.wikimedia.org/r/1009284 (https://phabricator.wikimedia.org/T321837) [15:36:17] (03PS1) 10Pwangai: Zuul: [mediawiki/extensions/BounceHandler] Enable Sonar Codehealth [integration/config] - 10https://gerrit.wikimedia.org/r/1009285 (https://phabricator.wikimedia.org/T321837) [15:37:19] (03PS1) 10Pwangai: Zuul: [mediawiki/extensions/WikibaseCirrusSearch] Enable Sonar Codehealth [integration/config] - 10https://gerrit.wikimedia.org/r/1009286 (https://phabricator.wikimedia.org/T321837) [15:59:43] 10GitLab, 10GitLab-Application-Security-Pipeline, 10Codex, 10Design-System-Team (Design-System-Product-Roadmap): Consider migrating Codex repo to Gitlab - https://phabricator.wikimedia.org/T352488#9607665 (10CCiufo-WMF) [16:00:01] 10GitLab, 10GitLab-Application-Security-Pipeline, 10Codex, 10Design-System-Team (Design-System-Product-Roadmap), 07Epic: Consider migrating Codex repo to Gitlab - https://phabricator.wikimedia.org/T352488#9607668 (10CCiufo-WMF) [16:24:01] 10Release-Engineering-Team (Now this 🫠), 05Release, 05Train Deployments: 1.42.0-wmf.21 deployment blockers - https://phabricator.wikimedia.org/T354439#9607751 (10matmarex) [16:42:49] 10Continuous-Integration-Infrastructure, 07Jenkins, 06Release-Engineering-Team, 07Security: Jenkins plugins security advisory 2024-03-06 - https://phabricator.wikimedia.org/T359415#9607877 (10jnuche) Releases instance has affected plugins: - https://plugins.jenkins.io/trilead-api - https://plugins.jenk... [16:49:13] 06Release-Engineering-Team, 10Release Pipeline, 06Security-Team: Solve OSV Double-Pipeline Problem without Requiring Many Default Rules - https://phabricator.wikimedia.org/T358728#9607901 (10mmartorana) Hey @cmassaro - we recommend implementing Dan's suggestions and providing us with feedback on the outcomes... [16:49:29] 06Release-Engineering-Team, 10Release Pipeline, 06Security-Team: Solve OSV Double-Pipeline Problem without Requiring Many Default Rules - https://phabricator.wikimedia.org/T358728#9607902 (10mmartorana) 05Open→03In progress p:05Triage→03Low [17:06:14] 10Continuous-Integration-Infrastructure, 07Jenkins, 06Release-Engineering-Team, 13Patch-For-Review, 07Security: Jenkins plugins security advisory 2024-03-06 - https://phabricator.wikimedia.org/T359415#9607971 (10CodeReviewBot) jnuche opened https://gitlab.wikimedia.org/repos/releng/jenkins-deploy/-/merge... [17:19:42] 06Release-Engineering-Team, 10Release Pipeline, 06Security-Team: Solve OSV Double-Pipeline Problem without Requiring Many Default Rules - https://phabricator.wikimedia.org/T358728#9608078 (10cmassaro) Thank you, all! I will adopt the measures suggested here and see what things look like. I can report back l... [17:36:37] 06Release-Engineering-Team, 10Release Pipeline, 06Security-Team, 07SecTeam-Processed: Solve OSV Double-Pipeline Problem without Requiring Many Default Rules - https://phabricator.wikimedia.org/T358728#9608169 (10sbassett) [18:00:56] 10Continuous-Integration-Infrastructure, 07Jenkins, 06Release-Engineering-Team, 13Patch-For-Review, 07Security: Jenkins plugins security advisory 2024-03-06 - https://phabricator.wikimedia.org/T359415#9608279 (10CodeReviewBot) jnuche merged https://gitlab.wikimedia.org/repos/releng/jenkins-deploy/-/merge... [18:26:15] 10Release-Engineering-Team (Now this 🫠), 05Release, 05Train Deployments: 1.42.0-wmf.21 deployment blockers - https://phabricator.wikimedia.org/T354439#9608312 (10Urbanecm_WMF) [18:26:22] 10Release-Engineering-Team (Now this 🫠), 05Release, 05Train Deployments: 1.42.0-wmf.21 deployment blockers - https://phabricator.wikimedia.org/T354439#9608317 (10Etonkovidova) [18:48:23] 10Continuous-Integration-Infrastructure, 07Jenkins, 06Release-Engineering-Team, 07Security: Jenkins plugins security advisory 2024-03-06 - https://phabricator.wikimedia.org/T359415#9608394 (10jnuche) I've updated the releases instance. I'll do the CI instance as soon as I can find the time. [19:32:01] 10Release-Engineering-Team (Now this 🫠), 05Release, 05Train Deployments: 1.42.0-wmf.21 deployment blockers - https://phabricator.wikimedia.org/T354439#9608615 (10SToyofuku-WMF) @jnuche Thank you so much for your help and for deploying today ☺️ [19:54:34] 10Phabricator, 10GerritBot: GerritBot comments for 7-digit Gerrit changes conflict with Diffusion commit hashes - https://phabricator.wikimedia.org/T358940#9608625 (10Jdforrester-WMF) We could also just stop mirroring and empty the Diffusion repos whose only benefit is the auto-linking. [20:22:48] (03PS1) 10Dduvall: systemtests: Update base images used in example repos [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/1009347 [20:22:51] (03PS1) 10Dduvall: systemtests: Upgrade Jenkins to a newer version [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/1009348 [20:23:10] (03PS2) 10Dduvall: Refresh list of Jenkins plugins used for testing [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/971215 (owner: 10Hashar) [20:26:17] (03CR) 10Dduvall: "See the new relation chain for the fixes to the Jenkins installation and the test repos." [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/971215 (owner: 10Hashar) [20:48:40] 10Release-Engineering-Team (Now this 🫠), 13Patch-For-Review: gitlab-cloud-runner: Roll back pending helm releases before running terraform apply - https://phabricator.wikimedia.org/T354787#9608904 (10CodeReviewBot) sandeeps opened https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/3... [21:01:50] 10Release-Engineering-Team (Now this 🫠), 13Patch-For-Review: gitlab-cloud-runner: Roll back pending helm releases before running terraform apply - https://phabricator.wikimedia.org/T354787#9609133 (10CodeReviewBot) sandeeps merged https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/3... [21:28:18] (03CR) 10Ahmon Dancy: "I tested this and ended up with a hang: https://phabricator.wikimedia.org/P58602" [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/1009347 (owner: 10Dduvall) [21:28:45] (03CR) 10Ahmon Dancy: "unresolved" [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/1009347 (owner: 10Dduvall) [21:34:13] (03CR) 10Ahmon Dancy: "Bad luck for me here too: https://phabricator.wikimedia.org/P58603" [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/1009348 (owner: 10Dduvall) [21:38:44] (03CR) 10Ahmon Dancy: [C: 03+1] "make systemtest passes for me when all 3 commits in the stack are present." [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/971215 (owner: 10Hashar) [21:38:59] 10GitLab-Application-Security-Pipeline, 06Security-Team, 13Patch-For-Review, 07SecTeam-Processed, 07Security: Add basic unit tests and CI support for semgrep-merge-tool - https://phabricator.wikimedia.org/T353747#9609370 (10CodeReviewBot) sguebo merged https://gitlab.wikimedia.org/repos/security/semgrep-... [21:43:44] 10GitLab-Application-Security-Pipeline, 06Security-Team, 07SecTeam-Processed, 07Security, 15user-sbassett: [EPIC] Application Security Pipeline Components for Gitlab - Phase 2 Work - https://phabricator.wikimedia.org/T342177#9609384 (10sbassett) [21:45:20] 10GitLab-Application-Security-Pipeline, 06Security-Team, 07SecTeam-Processed, 07Security: Add basic unit tests and CI support for semgrep-merge-tool - https://phabricator.wikimedia.org/T353747#9609382 (10sbassett) 05In progress→03Resolved [21:45:31] 10GitLab-Application-Security-Pipeline, 06Security-Team, 07SecTeam-Processed, 07Security: Add basic unit tests and CI support for semgrep-merge-tool - https://phabricator.wikimedia.org/T353747#9609386 (10sbassett) [21:47:10] (03CR) 10Dduvall: "Hmm, I'm thinking the systemtests are probably already busted in master due to the missing docker-credential-environment script. Maybe we " [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/1009347 (owner: 10Dduvall) [21:50:11] (03CR) 10Dduvall: [C: 03+2] "Yeah, let's just merge these and get the system tests working again." [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/1009347 (owner: 10Dduvall) [21:50:22] (03CR) 10Dduvall: [C: 03+2] "Done" [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/1009347 (owner: 10Dduvall) [21:50:46] (03Merged) 10jenkins-bot: systemtests: Update base images used in example repos [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/1009347 (owner: 10Dduvall) [21:50:50] (03CR) 10Dduvall: [C: 03+2] "Merging the entire chain to get these tests working again." [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/1009348 (owner: 10Dduvall) [21:51:29] (03Merged) 10jenkins-bot: systemtests: Upgrade Jenkins to a newer version [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/1009348 (owner: 10Dduvall) [21:52:04] (03CR) 10Dduvall: [C: 03+2] "Thanks, Antoine!" [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/971215 (owner: 10Hashar) [21:52:34] (03Merged) 10jenkins-bot: Refresh list of Jenkins plugins used for testing [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/971215 (owner: 10Hashar) [22:00:21] 10GitLab-Application-Security-Pipeline, 06Security-Team, 07SecTeam-Processed, 07Security: Add basic unit tests and CI support for semgrep-merge-tool - https://phabricator.wikimedia.org/T353747#9609430 (10sbassett) [22:21:54] 10GitLab (Integrations), 10Release-Engineering-Team (Priority Backlog 📥), 10Wikibugs: Connect WikiBugs IRC bot to Wikimedia GitLab - https://phabricator.wikimedia.org/T288381#9609449 (10bd808) a:05Legoktm→03None Unlicking this cookie for @Legoktm. I have some hope that this will be the fun treat I get to... [22:46:45] 10Release-Engineering-Team (Now this 🫠), 10Scap, 06collaboration-services, 13Patch-For-Review, 15User-brennen: scap install fails on new Phabricator/Phorge host due to missing user - https://phabricator.wikimedia.org/T357572#9609504 (10Dzahn) @Brennen Going through your "what we did" summary, I would say... [22:47:27] 10Release-Engineering-Team (Now this 🫠), 10Scap, 06collaboration-services, 13Patch-For-Review, 15User-brennen: scap install fails on new Phabricator/Phorge host due to missing user - https://phabricator.wikimedia.org/T357572#9609505 (10Dzahn) 05Open→03Resolved [22:50:01] 10Release-Engineering-Team (Radar), 06collaboration-services: Ensure that gitlab.wikimedia.org adheres to Google's sender guidelines - https://phabricator.wikimedia.org/T355776#9609520 (10Dzahn) There is still nothing at https://postmaster.google.com/u/0/dashboards#do=gitlab.wikimedia.org&st=userReportedSpamRa... [22:52:47] 10Release-Engineering-Team (Radar), 06collaboration-services: Ensure that gitlab.wikimedia.org adheres to Google's sender guidelines - https://phabricator.wikimedia.org/T355776#9609528 (10Dzahn) [23:00:33] 10Release-Engineering-Team (Radar), 06collaboration-services: Ensure that gitlab.wikimedia.org adheres to Google's sender guidelines - https://phabricator.wikimedia.org/T355776#9609551 (10Dzahn) ` Why are some or all of my dashboards empty? Why do I not see any data? Most of the Postmaster Tools dashboards wi... [23:10:21] 10Release-Engineering-Team (Now this 🫠), 10Scap, 10MW-on-K8s, 06SRE, and 2 others: Adapt scap's testing strategy to mw-on-k8s - https://phabricator.wikimedia.org/T358117#9609616 (10CodeReviewBot) thcipriani merged https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/230 scap sync-world: Add sup...