[00:18:23] (03CR) 10CI reject: [V: 04-1] build: Updating mediawiki/mediawiki-phan-config to 0.12.0 [integration/docroot] - 10https://gerrit.wikimedia.org/r/841596 (owner: 10Libraryupgrader) [07:48:14] (03Abandoned) 10Hashar: build: Updating mediawiki/mediawiki-phan-config to 0.12.0 [integration/docroot] - 10https://gerrit.wikimedia.org/r/841596 (owner: 10Libraryupgrader) [07:59:08] 10GitLab, 10Infrastructure-Foundations, 10SRE, 10serviceops-collab, 10CAS-SSO: migrate gitlab away from the CAS protocol - https://phabricator.wikimedia.org/T320390 (10Jelto) [08:01:23] 10Continuous-Integration-Infrastructure, 10LibUp: Opt out integration/docroot from mediawiki-phan-config 0.12.0 - https://phabricator.wikimedia.org/T320593 (10hashar) [08:10:16] hashar: I tagged you on a follow-up backport for wmf.5, it may not be needed but probably safer to do it [08:10:50] I have a few appointments today so I don’t think I can make any backport window but will try to find an owner for it. In the meantime pinging you in case it’s something you have time for [08:42:38] (03PS4) 10Jeena Huneidi: scap backport: thoroughly check cross-repo deps [tools/scap] - 10https://gerrit.wikimedia.org/r/838873 [08:47:32] (03CR) 10CI reject: [V: 04-1] scap backport: thoroughly check cross-repo deps [tools/scap] - 10https://gerrit.wikimedia.org/r/838873 (owner: 10Jeena Huneidi) [08:53:41] kostajh: sorry I missed your ping [08:53:48] 10Release-Engineering-Team (Blocking 🧱), 10MediaWiki-extensions-ExternalData, 10Quibble, 10ci-test-error: Quibble fails with UnicodeDecodeError when test output has invalid unicode - https://phabricator.wikimedia.org/T318029 (10hashar) 05Open→03Stalled A quick status update: the change got merged. The... [08:55:05] kostajh: I am guessing it can be done at anypoint [08:55:12] (patch being https://gerrit.wikimedia.org/r/c/mediawiki/extensions/ContentTranslation/+/841509 ) [09:06:33] 10Continuous-Integration-Infrastructure: https://doc.wikimedia.org/mediawiki-core/ should be sorted in a better way - https://phabricator.wikimedia.org/T319497 (10hashar) The code uses [[ https://www.php.net/glob | PHP glob() ]]: ` lang=php,name=shared/Page.php 195 protected function getDirIndexContents( $di... [09:16:01] 10Beta-Cluster-Infrastructure, 10Editing-team, 10MediaWiki-Configuration, 10VisualEditor, 10Platform Team Workboards (MW Expedition): Configure VE backend to use Parsoid directly on the beta cluster and testwiki - https://phabricator.wikimedia.org/T320531 (10daniel) [09:18:23] 10Beta-Cluster-Infrastructure, 10Editing-team, 10MediaWiki-Configuration, 10VisualEditor, 10Platform Team Workboards (MW Expedition): Configure VE backend to use Parsoid directly on the beta cluster and testwiki - https://phabricator.wikimedia.org/T320531 (10daniel) [09:19:46] 10Beta-Cluster-Infrastructure, 10Editing-team, 10MediaWiki-Configuration, 10VisualEditor, 10Platform Team Workboards (MW Expedition): Configure VE backend to use Parsoid directly on the beta cluster and testwiki - https://phabricator.wikimedia.org/T320531 (10daniel) [09:26:03] 10Beta-Cluster-Infrastructure, 10Data-Persistence (Consultation), 10MediaWiki-Configuration, 10MediaWiki-Core-HTTP-Cache, and 2 others: Put Parsoid output into the ParserCache on the beta cluster and testwiki - https://phabricator.wikimedia.org/T320535 (10daniel) [09:32:12] hashar: yes that's the patch. [09:32:45] (03PS2) 10Jaime Nuche: buildkit: Support Docker's `.dockerignore` [blubber] - 10https://gerrit.wikimedia.org/r/841175 (https://phabricator.wikimedia.org/T319337) [09:32:59] kostajh: does it need to land now (aka before we promote gourp 1 to wmf.5? [09:34:06] I can't deploy it now, but can later this afternoon [09:34:13] (03CR) 10Jaime Nuche: buildkit: Support Docker's `.dockerignore` (036 comments) [blubber] - 10https://gerrit.wikimedia.org/r/841175 (https://phabricator.wikimedia.org/T319337) (owner: 10Jaime Nuche) [09:57:08] (03CR) 10Hashar: [C: 04-1] "We did request a Debian package for NodeJS 14 via T267891 which got declined. Later on the nodesource Debian package got included in our a" [integration/config] - 10https://gerrit.wikimedia.org/r/840336 (owner: 10Legoktm) [10:00:47] hashar: I think it's a good idea, but I am not entirely sure as I haven't looked closely at the patch and whether that particular code is being called. I asked Mohd and Santhosh to comment. [11:48:52] (03CR) 10Jaime Nuche: add new configuration key for ordered builders (035 comments) [blubber] - 10https://gerrit.wikimedia.org/r/825708 (https://phabricator.wikimedia.org/T314482) (owner: 10Jaime Nuche) [12:33:18] (03CR) 10Jaime Nuche: buildkit: Support builds for specific target platforms (031 comment) [blubber] - 10https://gerrit.wikimedia.org/r/836307 (https://phabricator.wikimedia.org/T318866) (owner: 10Dduvall) [13:21:35] 10GitLab (CI & Job Runners), 10Release-Engineering-Team (Radar), 10Security-Team, 10serviceops, and 3 others: Setup GitLab Runner in trusted environment - https://phabricator.wikimedia.org/T295481 (10Jelto) While doing more debugging around the firewall rules for Trusted Runners I found out the firewall mo... [13:21:39] (03PS10) 10Jaime Nuche: add new configuration key for ordered builders [blubber] - 10https://gerrit.wikimedia.org/r/825708 (https://phabricator.wikimedia.org/T314482) [13:21:41] (03PS1) 10Jaime Nuche: move example blubber files to their own directory [blubber] - 10https://gerrit.wikimedia.org/r/841916 (https://phabricator.wikimedia.org/T314482) [14:50:51] 10Phabricator, 10Data Pipelines: Custom task form for Data Platform - https://phabricator.wikimedia.org/T320648 (10EChetty) [14:53:17] 10Phabricator, 10Data Pipelines: Custom task form for Data Platform - https://phabricator.wikimedia.org/T320648 (10EChetty) [14:56:06] 10Phabricator, 10Data Pipelines: Custom task form permissions for Data Platform Team PMs - https://phabricator.wikimedia.org/T320648 (10EChetty) p:05Triage→03High [15:14:17] (03CR) 10Dduvall: buildkit: Support builds for specific target platforms (031 comment) [blubber] - 10https://gerrit.wikimedia.org/r/836307 (https://phabricator.wikimedia.org/T318866) (owner: 10Dduvall) [15:14:42] (03PS4) 10Dduvall: buildkit: Support target platform in Makefile [blubber] - 10https://gerrit.wikimedia.org/r/836264 (https://phabricator.wikimedia.org/T318866) [15:14:53] (03CR) 10Dduvall: [C: 03+2] buildkit: Support target platform in Makefile [blubber] - 10https://gerrit.wikimedia.org/r/836264 (https://phabricator.wikimedia.org/T318866) (owner: 10Dduvall) [15:18:36] (03PS3) 10Dduvall: buildkit: Support builds for specific target platforms [blubber] - 10https://gerrit.wikimedia.org/r/836307 (https://phabricator.wikimedia.org/T318866) [15:26:00] (03CR) 10Ahmon Dancy: [C: 03+1] buildkit: Support Docker's `.dockerignore` [blubber] - 10https://gerrit.wikimedia.org/r/841175 (https://phabricator.wikimedia.org/T319337) (owner: 10Jaime Nuche) [15:39:56] (03PS4) 10Dduvall: buildkit: Support builds for specific target platforms [blubber] - 10https://gerrit.wikimedia.org/r/836307 (https://phabricator.wikimedia.org/T318866) [15:44:07] (03CR) 10Dduvall: [C: 03+2] buildkit: Support Docker's `.dockerignore` [blubber] - 10https://gerrit.wikimedia.org/r/841175 (https://phabricator.wikimedia.org/T319337) (owner: 10Jaime Nuche) [15:49:32] (03Merged) 10jenkins-bot: buildkit: Support Docker's `.dockerignore` [blubber] - 10https://gerrit.wikimedia.org/r/841175 (https://phabricator.wikimedia.org/T319337) (owner: 10Jaime Nuche) [15:51:38] (03CR) 10Dduvall: [C: 03+2] add new configuration key for ordered builders (031 comment) [blubber] - 10https://gerrit.wikimedia.org/r/825708 (https://phabricator.wikimedia.org/T314482) (owner: 10Jaime Nuche) [15:53:47] (03CR) 10Dduvall: [C: 03+2] buildkit: Support target platform in Makefile [blubber] - 10https://gerrit.wikimedia.org/r/836264 (https://phabricator.wikimedia.org/T318866) (owner: 10Dduvall) [15:55:44] (03Merged) 10jenkins-bot: add new configuration key for ordered builders [blubber] - 10https://gerrit.wikimedia.org/r/825708 (https://phabricator.wikimedia.org/T314482) (owner: 10Jaime Nuche) [15:58:12] 10Release-Engineering-Team (GitLab II: Wrath of Kahn 👾), 10Patch-For-Review, 10Release Pipeline (Blubber): blubber's buildkit frontend should process .dockerignore - https://phabricator.wikimedia.org/T319337 (10jnuche) 05Open→03Resolved [15:58:14] 10Release-Engineering-Team (GitLab II: Wrath of Kahn 👾), 10Scap: Get scap CI working on GitLab - https://phabricator.wikimedia.org/T319335 (10jnuche) [15:59:16] (03CR) 10Dduvall: [C: 03+2] move example blubber files to their own directory (031 comment) [blubber] - 10https://gerrit.wikimedia.org/r/841916 (https://phabricator.wikimedia.org/T314482) (owner: 10Jaime Nuche) [16:01:24] (03PS5) 10Dduvall: buildkit: Support target platform in Makefile [blubber] - 10https://gerrit.wikimedia.org/r/836264 (https://phabricator.wikimedia.org/T318866) [16:04:35] (03Merged) 10jenkins-bot: move example blubber files to their own directory [blubber] - 10https://gerrit.wikimedia.org/r/841916 (https://phabricator.wikimedia.org/T314482) (owner: 10Jaime Nuche) [16:20:46] (03CR) 10Dduvall: [C: 03+2] "One more time now that I've removed the depends-on." [blubber] - 10https://gerrit.wikimedia.org/r/836264 (https://phabricator.wikimedia.org/T318866) (owner: 10Dduvall) [16:28:12] (03Merged) 10jenkins-bot: buildkit: Support target platform in Makefile [blubber] - 10https://gerrit.wikimedia.org/r/836264 (https://phabricator.wikimedia.org/T318866) (owner: 10Dduvall) [16:30:40] 10Continuous-Integration-Infrastructure, 10LibUp: Opt out integration/docroot from mediawiki-phan-config 0.12.0 - https://phabricator.wikimedia.org/T320593 (10Jdforrester-WMF) Just leave a `bump-dev-deps` patch open and LibUp will ignore the repo. [16:36:53] (03CR) 10Jaime Nuche: add new configuration key for ordered builders (031 comment) [blubber] - 10https://gerrit.wikimedia.org/r/825708 (https://phabricator.wikimedia.org/T314482) (owner: 10Jaime Nuche) [16:39:04] (03PS5) 10Dduvall: buildkit: Support builds for specific target platforms [blubber] - 10https://gerrit.wikimedia.org/r/836307 (https://phabricator.wikimedia.org/T318866) [16:59:24] (03CR) 10Dduvall: [C: 03+2] Set up /srv/deployment/testrepo in the deploy container [tools/train-dev] - 10https://gerrit.wikimedia.org/r/839697 (owner: 10Ahmon Dancy) [17:00:36] (03Merged) 10jenkins-bot: Set up /srv/deployment/testrepo in the deploy container [tools/train-dev] - 10https://gerrit.wikimedia.org/r/839697 (owner: 10Ahmon Dancy) [17:07:53] !log deployed blubberoid using docker-registry.discovery.wmnet/wikimedia/blubber:2022-10-12-162839-production [17:07:54] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [17:12:55] (03CR) 10Ahmon Dancy: scap backport: thoroughly check cross-repo deps (036 comments) [tools/scap] - 10https://gerrit.wikimedia.org/r/838873 (owner: 10Jeena Huneidi) [17:40:18] (03PS1) 10Dduvall: pipeline: Only publish blubber-buildkit when new git tags are pushed [blubber] - 10https://gerrit.wikimedia.org/r/841954 [17:40:20] (03PS1) 10Dduvall: version: 0.10.0 [blubber] - 10https://gerrit.wikimedia.org/r/841955 [18:55:49] (03CR) 10Ahmon Dancy: [C: 03+2] pipeline: Only publish blubber-buildkit when new git tags are pushed [blubber] - 10https://gerrit.wikimedia.org/r/841954 (owner: 10Dduvall) [18:56:17] (03CR) 10Ahmon Dancy: [C: 03+2] version: 0.10.0 [blubber] - 10https://gerrit.wikimedia.org/r/841955 (owner: 10Dduvall) [19:00:07] (03CR) 10Hashar: Send events to Wikimedia EventGate (036 comments) [software/gerrit/plugins/events-wikimedia] - 10https://gerrit.wikimedia.org/r/814807 (owner: 10Hashar) [19:11:04] (03Merged) 10jenkins-bot: pipeline: Only publish blubber-buildkit when new git tags are pushed [blubber] - 10https://gerrit.wikimedia.org/r/841954 (owner: 10Dduvall) [19:11:06] (03Merged) 10jenkins-bot: version: 0.10.0 [blubber] - 10https://gerrit.wikimedia.org/r/841955 (owner: 10Dduvall) [19:31:07] (03CR) 10Hashar: Send events to Wikimedia EventGate (033 comments) [software/gerrit/plugins/events-wikimedia] - 10https://gerrit.wikimedia.org/r/814807 (owner: 10Hashar) [19:50:00] (03PS1) 10Dduvall: jjb: Define blubber-pipeline-publish-buildkit job [integration/config] - 10https://gerrit.wikimedia.org/r/841995 [19:50:26] (03PS1) 10Dduvall: zuul: Run trigger-blubber-pipeline-publish-buildkit upon tag pushes [integration/config] - 10https://gerrit.wikimedia.org/r/841996 [19:50:50] 10Beta-Cluster-Infrastructure, 10MediaWiki-extensions-Phonos, 10SRE-swift-storage, 10Community-Tech (CommTech-Sprint-35), and 2 others: Phonos links to an unauthorized URL - https://phabricator.wikimedia.org/T317417 (10Eevans) >>! In T317417#8280934, @MusikAnimal wrote: >>>! In T317417#8280822, @Eevans wro... [19:52:01] (03PS1) 10Dduvall: pipeline: Make the blubber-buildkit name slightly less verbose [blubber] - 10https://gerrit.wikimedia.org/r/841997 [19:53:41] (03CR) 10Dduvall: [C: 03+2] pipeline: Make the blubber-buildkit name slightly less verbose [blubber] - 10https://gerrit.wikimedia.org/r/841997 (owner: 10Dduvall) [20:02:57] (03Merged) 10jenkins-bot: pipeline: Make the blubber-buildkit name slightly less verbose [blubber] - 10https://gerrit.wikimedia.org/r/841997 (owner: 10Dduvall) [20:03:10] (03CR) 10Dduvall: [C: 03+2] jjb: Define blubber-pipeline-publish-buildkit job [integration/config] - 10https://gerrit.wikimedia.org/r/841995 (owner: 10Dduvall) [20:05:25] (03Merged) 10jenkins-bot: jjb: Define blubber-pipeline-publish-buildkit job [integration/config] - 10https://gerrit.wikimedia.org/r/841995 (owner: 10Dduvall) [20:06:18] (03CR) 10Dduvall: [C: 03+2] "INFO:jenkins_jobs.builder:Number of jobs generated: 2" [integration/config] - 10https://gerrit.wikimedia.org/r/841995 (owner: 10Dduvall) [20:06:31] (03CR) 10Dduvall: [C: 03+2] zuul: Run trigger-blubber-pipeline-publish-buildkit upon tag pushes [integration/config] - 10https://gerrit.wikimedia.org/r/841996 (owner: 10Dduvall) [20:08:14] (03Merged) 10jenkins-bot: zuul: Run trigger-blubber-pipeline-publish-buildkit upon tag pushes [integration/config] - 10https://gerrit.wikimedia.org/r/841996 (owner: 10Dduvall) [20:08:20] 10GitLab (CI & Job Runners), 10Release-Engineering-Team, 10Security-Team, 10serviceops-collab, and 3 others: Allow registry.gitlab.com/security-products/**/* for gitlab shared runner docker images - https://phabricator.wikimedia.org/T312961 (10brennen) > My concerns are also relevant for registry.gitlab.co... [20:09:04] !log Reloading Zuul to deploy https://gerrit.wikimedia.org/r/841996 [20:09:05] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [20:21:23] If anyone familiar with acme-chief has any ideas of how to fix failing CI tests on https://integration.wikimedia.org/ci/job/acme-chief-tox-docker/584/console I'd love to get a PM :) [20:32:38] 10Beta-Cluster-Infrastructure, 10Editing-team, 10MediaWiki-Configuration, 10VisualEditor, 10Platform Team Workboards (MW Expedition): Configure VE backend to use Parsoid directly on the beta cluster and testwiki - https://phabricator.wikimedia.org/T320531 (10daniel) [20:32:44] 10Beta-Cluster-Infrastructure, 10Data-Persistence (Consultation), 10MediaWiki-Configuration, 10MediaWiki-Core-HTTP-Cache, and 2 others: Put Parsoid output into the ParserCache on the beta cluster and testwiki - https://phabricator.wikimedia.org/T320535 (10daniel) [21:00:51] (03PS1) 10Dduvall: pipeline: Optimize variants using blubber 0.10.0 [blubber] - 10https://gerrit.wikimedia.org/r/842005 [21:03:53] (03CR) 10CI reject: [V: 04-1] pipeline: Optimize variants using blubber 0.10.0 [blubber] - 10https://gerrit.wikimedia.org/r/842005 (owner: 10Dduvall) [21:05:52] (03PS2) 10Dduvall: pipeline: Optimize variants using blubber 0.10.0 [blubber] - 10https://gerrit.wikimedia.org/r/842005 [21:52:51] PROBLEM - Work requests waiting in Zuul Gearman server on contint2001 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [400.0] https://www.mediawiki.org/wiki/Continuous_integration/Zuul https://grafana.wikimedia.org/d/000000322/zuul-gearman?orgId=1&viewPanel=10 [21:54:21] whew.. [21:54:43] https://gerrit.wikimedia.org/r/c/mediawiki/skins/Vector/+/841977 doesn't look right [21:57:23] RECOVERY - Work requests waiting in Zuul Gearman server on contint2001 is OK: OK: Less than 100.00% above the threshold [200.0] https://www.mediawiki.org/wiki/Continuous_integration/Zuul https://grafana.wikimedia.org/d/000000322/zuul-gearman?orgId=1&viewPanel=10 [22:18:13] TheresNoTime: looks like local rebase gone wrong. git+gerrit can really mess with folks sometimes [22:24:04] (03CR) 10Ahmon Dancy: [C: 03+1] pipeline: Optimize variants using blubber 0.10.0 [blubber] - 10https://gerrit.wikimedia.org/r/842005 (owner: 10Dduvall)