[04:03:34] !log on deployment-deploy03 running scap sync-world -v with PHP 7.2 for T295578 sanity check [04:03:36] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [04:03:37] T295578: Test running php7.2 and php7.4 in parallel on the beta cluster - https://phabricator.wikimedia.org/T295578 [04:27:51] !log on deployment-deploy03 running scap sync-world -v with PHP 7.4 for T295578 [04:27:53] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [04:27:54] T295578: Test running php7.2 and php7.4 in parallel on the beta cluster - https://phabricator.wikimedia.org/T295578 [08:21:44] (03CR) 10Hashar: [C: 03+2] "Lets do it :]" [integration/config] - 10https://gerrit.wikimedia.org/r/803990 (owner: 10C. Scott Ananian) [08:24:10] (03Merged) 10jenkins-bot: Adding parsoid as a dependency is no longer required for CI [integration/config] - 10https://gerrit.wikimedia.org/r/803990 (owner: 10C. Scott Ananian) [08:28:55] !log Reloaded Zuul to remove mediawiki/services/parsoid from CI dependencies # https://gerrit.wikimedia.org/r/c/integration/config/+/803990 [08:28:56] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [08:47:34] hashar: I'm keeping an eye on https://integration.wikimedia.org/ci/job/quibble-vendor-mysql-php72-selenium-docker/123380/console to see if the selenium tests still work [09:03:27] (03PS1) 10Kosta Harlan: Revert "Adding parsoid as a dependency is no longer required for CI" [integration/config] - 10https://gerrit.wikimedia.org/r/804527 [09:05:21] (03CR) 10CI reject: [V: 04-1] Revert "Adding parsoid as a dependency is no longer required for CI" [integration/config] - 10https://gerrit.wikimedia.org/r/804527 (owner: 10Kosta Harlan) [09:06:43] (03PS2) 10Kosta Harlan: Revert "Adding parsoid as a dependency is no longer required for CI" [integration/config] - 10https://gerrit.wikimedia.org/r/804527 [09:21:06] (03CR) 10Jaime Nuche: Add medebug container (034 comments) [tools/train-dev] - 10https://gerrit.wikimedia.org/r/804481 (https://phabricator.wikimedia.org/T308476) (owner: 10Jeena Huneidi) [09:29:47] kostajh: oops :D [09:29:56] (03CR) 10Hashar: [C: 03+2] Revert "Adding parsoid as a dependency is no longer required for CI" [integration/config] - 10https://gerrit.wikimedia.org/r/804527 (owner: 10Kosta Harlan) [09:30:00] hashar: wait, it looks like it worked [09:30:08] (03CR) 10Kosta Harlan: [C: 04-1] Revert "Adding parsoid as a dependency is no longer required for CI" [integration/config] - 10https://gerrit.wikimedia.org/r/804527 (owner: 10Kosta Harlan) [09:30:15] (03Abandoned) 10Kosta Harlan: Revert "Adding parsoid as a dependency is no longer required for CI" [integration/config] - 10https://gerrit.wikimedia.org/r/804527 (owner: 10Kosta Harlan) [09:30:39] kostajh: from what I understand is that the logic to enable parsoid has been ported to mediawiki/core [09:30:41] hashar: sorry, was about to write... it seems like the change I checked had some flakiness issues, but another patch passed. If it passes on one, then the change here doesn't seem suspect [09:30:54] excellent! [09:31:16] then the release branches probably end up being broken as a result [09:31:33] we will see :] [09:34:55] duesen: the API testing job triggered from mediawiki/core will run its API test as well as the ones for vendor and Vector if they have api tests. Vector is always injected as a dependency by Quibble [09:36:03] hashar: how about the api integration tests for parsoid? They are in vendor, because the parsoid extension is pulled in as part of the parsoid library [09:36:07] duesen: and it looks like a job triggered for an extension would always run the mediawiki/core api tests as well as any api tests defined in the extension or its dependencies [09:36:33] if vendor has a composer run script named "api-testing", I think it will be detected and launched by quibble [09:37:15] for Parsoid cscott has send a change which no more inject mediawiki/services/parsoid and I have deployed that this morning [09:37:21] so the parsoid api tests are not run [09:37:31] yea, but for parsoid, we *don*t want to run core tests against the repo. We *do* want to run the parsoid integration tests on the core repo. The reason is that it's versioned: the patch that bumps the version needs to run the tests that assert that the new version of parsoid works with the current version of core. [09:39:07] so if one send a patch to mediawiki/core which bump the parsoid composer dependency, that should run the mediawiki/core api tests [09:54:13] 10Beta-Cluster-Infrastructure: Create deployment-deploy04 as future secondary/upgrade - https://phabricator.wikimedia.org/T309437 (10TheresNoTime) [09:55:05] 10Beta-Cluster-Infrastructure: Create deployment-deploy04 as future secondary/upgrade - https://phabricator.wikimedia.org/T309437 (10TheresNoTime) I had a bit more of a think on this, and you're quite right — updated the task & will recreate this as a `debian-10.0-buster` instance [10:25:56] 10GitLab (Infrastructure), 10serviceops: Reduce usage of public IPv4 addresses on GitLab hosts - https://phabricator.wikimedia.org/T310265 (10ayounsi) Thanks for opening this task! Going that way would have multiple benefits: * reducing our public IP usage, which will become more and more needed as we grow an... [12:08:27] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team (Priority Backlog đŸ“Ĩ), 10Scap: Add a ssh key pair for scap on beta cluster - https://phabricator.wikimedia.org/T310354 (10hashar) [12:34:40] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team (Priority Backlog đŸ“Ĩ), 10Scap, 10Patch-For-Review: Add a ssh key pair for scap on beta cluster - https://phabricator.wikimedia.org/T310354 (10jnuche) Thanks for this task @hashar The Puppet config ` lang=puppet ssh::userkey { 'scap': content... [12:41:05] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team (Priority Backlog đŸ“Ĩ), 10Scap, 10Patch-For-Review: Add a ssh key pair for scap on beta cluster - https://phabricator.wikimedia.org/T310354 (10hashar) From the quick tour I gave to Jaime, the beta cluster deployment server is the WMCS instance `deploy... [12:42:46] jnuche: i have created the key and loaded it on deployment-deploy03 https://phabricator.wikimedia.org/T310354#7994473 :) [12:43:05] that would need a puppet patch for the configuration of the keyholder agent: https://gerrit.wikimedia.org/r/c/operations/puppet/+/804568/ [12:43:38] 10GitLab (Infrastructure), 10serviceops: Reduce usage of public IPv4 addresses on GitLab hosts - https://phabricator.wikimedia.org/T310265 (10Jelto) >>! In T310265#7993198, @Dzahn wrote: > First and foremost though, the reason why gitlab has all public IPs is because we were trying to emulate the gerrit setup.... [12:45:45] hashar: saw it, thanks! [12:51:18] hashar: that's a very detailed explanation, thanks again [13:00:58] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team (Priority Backlog đŸ“Ĩ), 10Scap, 10Patch-For-Review: Add a ssh key pair for scap on beta cluster - https://phabricator.wikimedia.org/T310354 (10hashar) >>! In T310354#7994473, @hashar wrote: > ` > $ keyholder status > keyholder-agent: active > - 256 SH... [13:01:39] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team (Priority Backlog đŸ“Ĩ), 10Scap, 10Patch-For-Review: Add a ssh key pair for scap on beta cluster - https://phabricator.wikimedia.org/T310354 (10hashar) a:03hashar The key has been added, task is pending for the Puppet change to configure the keyholde... [13:02:10] jnuche: yeah and turns out we have some doc at https://wikitech.wikimedia.org/wiki/Keyholder [13:02:32] and for applying Puppet to the beta cluster WMCS project https://wikitech.wikimedia.org/wiki/Help:Standalone_puppetmaster is the reference ;) [13:02:44] the key is loaded on deployment-deploy03 [13:02:52] and is reacheable by anyone in the deployment-prep project [13:03:35] it might be sufficient [13:15:19] (03CR) 10Kosta Harlan: [C: 04-1] "This probably needs to wait on Ib88894955b79c870122f7f40874a304d6cc121fd. Or maybe it needs to be reworked so it's compatible with release" [integration/config] - 10https://gerrit.wikimedia.org/r/803487 (https://phabricator.wikimedia.org/T90875) (owner: 10Kosta Harlan) [13:50:18] (03CR) 10Hashar: dockerfiles: Remove hardcoded references to suite.xml and phpunit.php (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/803487 (https://phabricator.wikimedia.org/T90875) (owner: 10Kosta Harlan) [13:58:51] (03PS4) 10Hashar: dockerfiles: Remove hardcoded references to suite.xml and phpunit.php [integration/config] - 10https://gerrit.wikimedia.org/r/803487 (https://phabricator.wikimedia.org/T90875) (owner: 10Kosta Harlan) [13:58:53] (03PS1) 10Hashar: dockerfiles: remove obsolete coverage utilities [integration/config] - 10https://gerrit.wikimedia.org/r/804587 (https://phabricator.wikimedia.org/T279833) [14:14:09] (03CR) 10Hashar: [C: 04-1] "I have amended the change to remove the coverage bits which were in the php 7.2 image. I am removing them with the parent change https://g" [integration/config] - 10https://gerrit.wikimedia.org/r/803487 (https://phabricator.wikimedia.org/T90875) (owner: 10Kosta Harlan) [14:37:59] 10Beta-Cluster-Infrastructure: Create deployment-deploy04 as future secondary/upgrade - https://phabricator.wikimedia.org/T309437 (10TheresNoTime) 05Stalled→03In progress [15:09:38] (03CR) 10Jforrester: [C: 03+1] "❤ī¸" [integration/config] - 10https://gerrit.wikimedia.org/r/804587 (https://phabricator.wikimedia.org/T279833) (owner: 10Hashar) [15:11:51] (03PS3) 10Seddon: Add SearchVue repo zuul config [integration/config] - 10https://gerrit.wikimedia.org/r/804015 (https://phabricator.wikimedia.org/T309932) [15:16:21] (03PS4) 10Jforrester: Zuul: [mediawiki/extensions/SearchVue] Add initial CI jobs [integration/config] - 10https://gerrit.wikimedia.org/r/804015 (https://phabricator.wikimedia.org/T309932) (owner: 10Seddon) [15:16:26] (03CR) 10Jforrester: [C: 03+2] "Thanks!" [integration/config] - 10https://gerrit.wikimedia.org/r/804015 (https://phabricator.wikimedia.org/T309932) (owner: 10Seddon) [15:19:10] (03Merged) 10jenkins-bot: Zuul: [mediawiki/extensions/SearchVue] Add initial CI jobs [integration/config] - 10https://gerrit.wikimedia.org/r/804015 (https://phabricator.wikimedia.org/T309932) (owner: 10Seddon) [15:20:57] !log Zuul: [mediawiki/extensions/SearchVue] Add initial CI jobs for T309932 [15:20:59] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [15:20:59] T309932: [M] Create new SearchVue extension to contain Search Improvements augmentations - https://phabricator.wikimedia.org/T309932 [15:23:38] (03CR) 10Ahmon Dancy: Add medebug container (038 comments) [tools/train-dev] - 10https://gerrit.wikimedia.org/r/804481 (https://phabricator.wikimedia.org/T308476) (owner: 10Jeena Huneidi) [15:38:41] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team (Seen), 10Scap, 10SRE, 10serviceops: Scap can't clear opcache on mw servers in Beta Cluster - https://phabricator.wikimedia.org/T237033 (10dancy) 05Open→03Resolved a:03dancy [15:54:15] 10Release-Engineering-Team (Priority Backlog đŸ“Ĩ), 10Patch-For-Review, 10Release, 10Train Deployments: 1.39.0-wmf.15 deployment blockers - https://phabricator.wikimedia.org/T308068 (10JMeybohm) 05Resolved→03Open I see mcrouter get+gets increased significantly since the rollout to group2: https://grafana-... [15:58:38] (03CR) 10Jaime Nuche: Add medebug container (032 comments) [tools/train-dev] - 10https://gerrit.wikimedia.org/r/804481 (https://phabricator.wikimedia.org/T308476) (owner: 10Jeena Huneidi) [16:10:06] (03CR) 10Ahmon Dancy: Add medebug container (031 comment) [tools/train-dev] - 10https://gerrit.wikimedia.org/r/804481 (https://phabricator.wikimedia.org/T308476) (owner: 10Jeena Huneidi) [16:16:27] (03CR) 10Lucas Werkmeister (WMDE): Update Wikibase section (031 comment) [integration/docroot] - 10https://gerrit.wikimedia.org/r/802138 (owner: 10Lucas Werkmeister (WMDE)) [16:45:05] (03Abandoned) 10Arlolra: Stop running api testing on the parsoid repo [integration/config] - 10https://gerrit.wikimedia.org/r/802668 (owner: 10Arlolra) [17:23:16] (03CR) 10Jaime Nuche: Add medebug container (031 comment) [tools/train-dev] - 10https://gerrit.wikimedia.org/r/804481 (https://phabricator.wikimedia.org/T308476) (owner: 10Jeena Huneidi) [19:15:31] (03PS2) 10Jeena Huneidi: Add medebug container [tools/train-dev] - 10https://gerrit.wikimedia.org/r/804481 (https://phabricator.wikimedia.org/T308476) [19:17:08] (03PS3) 10Jeena Huneidi: Add medebug container [tools/train-dev] - 10https://gerrit.wikimedia.org/r/804481 (https://phabricator.wikimedia.org/T308476) [19:18:02] (03PS4) 10Jeena Huneidi: Add mwdebug container [tools/train-dev] - 10https://gerrit.wikimedia.org/r/804481 (https://phabricator.wikimedia.org/T308476) [19:19:19] (03PS5) 10Jeena Huneidi: Add mwdebug container [tools/train-dev] - 10https://gerrit.wikimedia.org/r/804481 (https://phabricator.wikimedia.org/T308476) [19:21:52] (03PS6) 10Jeena Huneidi: Add mwdebug container [tools/train-dev] - 10https://gerrit.wikimedia.org/r/804481 (https://phabricator.wikimedia.org/T308476) [19:44:47] 10Release-Engineering-Team (Doing), 10NFDI: Do mediawiki docker images from wmf branch exist - https://phabricator.wikimedia.org/T309458 (10Physikerwelt) Hi @dancy. Thank you. That worked without problems. > Commit docker-registry.discovery.wmnet/restricted/mediawiki-multiversion:2022-06-10-213251-publish > s... [19:52:40] 10Release-Engineering-Team (Deployment Autopilot 🛩ī¸), 10MW-on-K8s, 10Release Pipeline, 10Patch-For-Review, 10User-brennen: scap backport change_url: Deploy to mwdebug - https://phabricator.wikimedia.org/T308476 (10thcipriani) [19:53:17] 10Release-Engineering-Team (Deployment Autopilot 🛩ī¸), 10MW-on-K8s, 10Release Pipeline, 10User-brennen: Scap backport change_url: make gerrit plugin authorize with ssh - https://phabricator.wikimedia.org/T303755 (10thcipriani) [19:53:24] 10Release-Engineering-Team (Deployment Autopilot 🛩ī¸), 10MW-on-K8s, 10Release Pipeline, 10User-brennen: Scap backport change_url command - https://phabricator.wikimedia.org/T287042 (10thcipriani) [19:53:28] 10Release-Engineering-Team (Deployment Autopilot 🛩ī¸), 10MW-on-K8s, 10Release Pipeline, 10User-brennen: scap backport --revert command - https://phabricator.wikimedia.org/T287046 (10thcipriani) [19:53:30] 10Release-Engineering-Team (Deployment Autopilot 🛩ī¸), 10MW-on-K8s, 10Release Pipeline, 10User-brennen: Scap rollback command - https://phabricator.wikimedia.org/T287045 (10thcipriani) [19:54:56] 10Release-Engineering-Team (Deployment Autopilot 🛩ī¸), 10Scap: Allow Scap to push to Gerrit without operator creds - https://phabricator.wikimedia.org/T306425 (10thcipriani) [19:59:50] 10Release-Engineering-Team (Deployment Autopilot 🛩ī¸): Automated Tuesday Train via a timer - https://phabricator.wikimedia.org/T310395 (10thcipriani) [20:00:03] 10Release-Engineering-Team (Deployment Autopilot 🛩ī¸), 10Scap: Automated Tuesday Train via a timer - https://phabricator.wikimedia.org/T310395 (10thcipriani) [20:04:34] 10Release-Engineering-Team (Deployment Autopilot 🛩ī¸): Create alerts for automated Tuesday Train timer - https://phabricator.wikimedia.org/T310396 (10thcipriani) [20:04:42] 10Release-Engineering-Team (Deployment Autopilot 🛩ī¸), 10Scap: Create alerts for automated Tuesday Train timer - https://phabricator.wikimedia.org/T310396 (10thcipriani) [20:06:02] 10Release-Engineering-Team (Deployment Autopilot 🛩ī¸), 10Scap: Automated Tuesday Train via a timer - https://phabricator.wikimedia.org/T310395 (10thcipriani) [20:12:12] 10Release-Engineering-Team (Doing), 10NFDI: Do mediawiki docker images from wmf branch exist - https://phabricator.wikimedia.org/T309458 (10dancy) Apologies for the lack of documentation. It's all a bit of a work in progress at the moment. These environment variables determine the name of the output images... [20:24:18] 10Release-Engineering-Team (Deployment Autopilot 🛩ī¸), 10Scap: Automated Tuesday Train via a timer - https://phabricator.wikimedia.org/T310395 (10dancy) [20:24:20] 10Release-Engineering-Team (Seen), 10Scap, 10Epic, 10Goal: Automate the Train - https://phabricator.wikimedia.org/T196515 (10dancy) [20:25:27] 10Release-Engineering-Team (Deployment Autopilot 🛩ī¸), 10Scap: Allow Scap to push to Gerrit without operator creds - https://phabricator.wikimedia.org/T306425 (10dancy) [20:31:42] 10Release-Engineering-Team (Deployment Autopilot 🛩ī¸), 10Scap: Allow Scap to push to Gerrit without operator creds - https://phabricator.wikimedia.org/T306425 (10dancy) [20:31:45] 10Release-Engineering-Team (Deployment Autopilot 🛩ī¸), 10Scap: Automated Tuesday Train via a timer - https://phabricator.wikimedia.org/T310395 (10dancy) [20:33:02] 10Release-Engineering-Team (Deployment Autopilot 🛩ī¸), 10Scap: Allow Scap to push to Gerrit without operator creds - https://phabricator.wikimedia.org/T306425 (10dancy) This will be required to implement T310395, assuming it deploys to testwikis. [20:35:09] 10Release-Engineering-Team (Radar), 10Infrastructure-Foundations, 10SRE, 10SRE-Access-Requests, 10serviceops: Need a service account on deploy servers for automated train pre-sync operations - https://phabricator.wikimedia.org/T303857 (10dancy) [20:35:15] 10Release-Engineering-Team (Deployment Autopilot 🛩ī¸), 10Scap: Automated Tuesday Train via a timer - https://phabricator.wikimedia.org/T310395 (10dancy) [20:35:50] 10Release-Engineering-Team (Deployment Autopilot 🛩ī¸), 10Scap: Automated Tuesday Train via a timer - https://phabricator.wikimedia.org/T310395 (10dancy) [20:42:48] 10Release-Engineering-Team (Deployment Autopilot 🛩ī¸), 10Scap: Automated Tuesday Train via a timer - https://phabricator.wikimedia.org/T310395 (10dancy) [20:46:25] (03PS7) 10Jeena Huneidi: Add mwdebug container [tools/train-dev] - 10https://gerrit.wikimedia.org/r/804481 (https://phabricator.wikimedia.org/T308476) [20:48:00] (03CR) 10Jeena Huneidi: "Having some trouble with my train-dev env...let me know if this is working for you" [tools/train-dev] - 10https://gerrit.wikimedia.org/r/804481 (https://phabricator.wikimedia.org/T308476) (owner: 10Jeena Huneidi) [20:48:44] 10Release-Engineering-Team (Deployment Autopilot 🛩ī¸), 10MW-on-K8s, 10Release Pipeline, 10User-brennen: Scap backport change_url: make gerrit plugin authorize with ssh - https://phabricator.wikimedia.org/T303755 (10dancy) @jeena Is this all done? [20:49:56] (03PS8) 10Jeena Huneidi: Add mwdebug container [tools/train-dev] - 10https://gerrit.wikimedia.org/r/804481 (https://phabricator.wikimedia.org/T308476) [20:50:48] (03CR) 10Jeena Huneidi: Add mwdebug container (031 comment) [tools/train-dev] - 10https://gerrit.wikimedia.org/r/804481 (https://phabricator.wikimedia.org/T308476) (owner: 10Jeena Huneidi) [20:51:58] 10Release-Engineering-Team (Doing), 10MW-on-K8s, 10Release Pipeline, 10User-brennen: Scap backport change_url command - https://phabricator.wikimedia.org/T287042 (10thcipriani) [20:57:13] (03CR) 10Ahmon Dancy: Add mwdebug container (031 comment) [tools/train-dev] - 10https://gerrit.wikimedia.org/r/804481 (https://phabricator.wikimedia.org/T308476) (owner: 10Jeena Huneidi) [21:27:16] 10Continuous-Integration-Config, 10Quality-and-Test-Engineering-Team (QTE), 10Sonarqubebot, 10Developer Productivity: SonarQube is unhelpfully suggesting ES6 feautures in ES5 code - https://phabricator.wikimedia.org/T289957 (10Krinkle) [21:41:12] (03PS6) 10Jeena Huneidi: scap backport: deploy to mwdebug [tools/scap] - 10https://gerrit.wikimedia.org/r/803370 (https://phabricator.wikimedia.org/T308476) [21:42:23] 10Release-Engineering-Team (Priority Backlog đŸ“Ĩ), 10Release, 10Train Deployments: 1.39.0-wmf.17 deployment blockers - https://phabricator.wikimedia.org/T308070 (10Jdlrobson) [21:50:12] 10Release-Engineering-Team (Priority Backlog đŸ“Ĩ), 10Release, 10Train Deployments: 1.39.0-wmf.16 deployment blockers - https://phabricator.wikimedia.org/T308069 (10Jdlrobson) [21:51:26] (03PS7) 10Jeena Huneidi: scap backport: deploy to mwdebug [tools/scap] - 10https://gerrit.wikimedia.org/r/803370 (https://phabricator.wikimedia.org/T308476) [22:03:44] 10Release-Engineering-Team (Doing), 10NFDI: Do mediawiki docker images from wmf branch exist - https://phabricator.wikimedia.org/T309458 (10Physikerwelt) 05Open→03Resolved @dancy Thank you very much I figured that I can just use `$(cat last-build)` to retrieve the version to work with. Eventually, I figure... [22:08:31] (03PS9) 10Jeena Huneidi: Add mwdebug container [tools/train-dev] - 10https://gerrit.wikimedia.org/r/804481 (https://phabricator.wikimedia.org/T308476) [22:10:55] (03CR) 10Jeena Huneidi: Add mwdebug container (031 comment) [tools/train-dev] - 10https://gerrit.wikimedia.org/r/804481 (https://phabricator.wikimedia.org/T308476) (owner: 10Jeena Huneidi)