[00:06:39] thcipriani: looks like i'm not an op for topic change, but phab migration's done. (we sincerely hope.) [00:10:40] 10Phabricator, 10Release-Engineering-Team (Priority Backlog 📥), 10serviceops-collab, 10Patch-For-Review: move phabricator to new hardware generation - https://phabricator.wikimedia.org/T280597 (10Dzahn) This has happened. It will just stay open until the old server is actually decom'ed. This will continue... [00:16:53] brennen: nice work :) [00:17:44] thcipriani: big thanks to mutante - 99% his effort. [00:18:21] <3 both [08:31:16] 10Phabricator, 10Release-Engineering-Team (Priority Backlog 📥), 10serviceops-collab, 10Patch-For-Review: move phabricator to new hardware generation - https://phabricator.wikimedia.org/T280597 (10Aklapper) May I ask for https://wikitech.wikimedia.org/wiki/Help:SSH_Fingerprints/phab1004.eqiad.wmnet and (les... [08:34:06] 10Phabricator, 10Release-Engineering-Team (Priority Backlog 📥), 10serviceops-collab, 10Patch-For-Review: move phabricator to new hardware generation - https://phabricator.wikimedia.org/T280597 (10taavi) >>! In T280597#8427143, @Aklapper wrote: > May I ask for https://wikitech.wikimedia.org/wiki/Help:SSH_Fi... [10:15:05] 10GitLab (Infrastructure), 10serviceops-collab, 10Cloud-VPS (Quota-requests): Request quota increase for devtools Cloud VPS project - https://phabricator.wikimedia.org/T323986 (10Jelto) [10:43:41] 10Phabricator, 10Release-Engineering-Team (Priority Backlog 📥), 10serviceops-collab, 10Patch-For-Review: move phabricator to new hardware generation - https://phabricator.wikimedia.org/T280597 (10Peachey88) >>! In T280597#8427143, @Aklapper wrote: > and (less important) https://wikitech.wikimedia.org/wiki/... [11:21:27] hmm [11:21:56] how can I add multiple reviewers to a Gitlab merge request? ;) [11:31:06] that's a feature only in the paid versions iirc [11:33:18] *sigh* [11:49:44] hi all im getting an error while trying to fork https://gitlab.wikimedia.org/repos/releng/dev-images/ is anyone able to check/fix my permissions [11:50:01] the error message is the super helpful "An error occurred while forking the project. Please try again. " [11:50:09] trying again does not help [12:11:39] jbond: T295468 ? [12:11:40] T295468: Couldn't fork a gitlab repository - https://phabricator.wikimedia.org/T295468 [12:13:39] 10Release-Engineering-Team (Priority Backlog 📥), 10MW-on-K8s, 10serviceops: mwdebug: people in the "deployment" group should be able to launch 'experimental' instances for testing purposes - https://phabricator.wikimedia.org/T324003 (10Joe) [12:14:54] 10Release-Engineering-Team (Priority Backlog 📥), 10MW-on-K8s, 10serviceops: mwdebug: people in the "deployment" group should be able to launch 'experimental' instances for testing purposes - https://phabricator.wikimedia.org/T324003 (10Joe) p:05Triage→03Medium [12:19:42] 10Continuous-Integration-Infrastructure, 10CheckUser, 10Browser-Tests: Allow the jenkins selenium tests to grant the test user the checkuser group/right for testing - https://phabricator.wikimedia.org/T321965 (10Dreamy_Jazz) p:05Triage→03Medium [12:35:58] 10Phabricator, 10Release-Engineering-Team (Priority Backlog 📥), 10serviceops-collab, 10Patch-For-Review: move phabricator to new hardware generation - https://phabricator.wikimedia.org/T280597 (10Dzahn) >>! In T280597#8427143, @Aklapper wrote: > May I ask for https://wikitech.wikimedia.org/wiki/Help:SSH_Fi... [12:44:49] 10Continuous-Integration-Infrastructure, 10CheckUser, 10Browser-Tests: Allow the jenkins selenium tests to grant the test user the checkuser group/right for testing - https://phabricator.wikimedia.org/T321965 (10Dreamy_Jazz) Seems to be resolved based on the success of the tests in https://gerrit.wikimedia.o... [12:46:37] 10GitLab (Administration, Settings & Policy), 10Release-Engineering-Team, 10serviceops-collab: Define GitLab API access for system users - https://phabricator.wikimedia.org/T324008 (10Jelto) [13:02:52] 10Phabricator, 10Release-Engineering-Team (Priority Backlog 📥), 10serviceops-collab, 10Patch-For-Review: move phabricator to new hardware generation - https://phabricator.wikimedia.org/T280597 (10Aklapper) >>! In T280597#8427150, @taavi wrote: > Do the automatically published files on https://config-master... [13:18:47] 10Continuous-Integration-Infrastructure, 10Jenkins, 10SRE, 10SRE-Access-Requests: New Keyholder identity for RelEng deployments - https://phabricator.wikimedia.org/T324014 (10jnuche) [13:28:22] 10Continuous-Integration-Infrastructure, 10Jenkins, 10SRE, 10SRE-Access-Requests: New Keyholder identity for RelEng deployments - https://phabricator.wikimedia.org/T324014 (10taavi) -1. Scoping resources by WMF team excludes volunteers from participating and often doesn't reflect reality anyway. > It's a... [13:30:51] 10GitLab, 10Release-Engineering-Team: Gitlab make public the default fork option - https://phabricator.wikimedia.org/T324016 (10jbond) [13:31:04] thanks arturo although in this case it was of PEBCAK, i have not selected the option to make it public. would be usefull if this was pre-selected T324016 [13:31:04] T324016: Gitlab make public the default fork option - https://phabricator.wikimedia.org/T324016 [13:43:24] 10Continuous-Integration-Infrastructure, 10Jenkins, 10SRE, 10SRE-Access-Requests: New Keyholder identity for RelEng deployments - https://phabricator.wikimedia.org/T324014 (10jnuche) @taavi, that is a valid concern. There is already a `jenkins-deploy` Unix user though, so to reduce confusion maybe we can... [13:45:33] 10Continuous-Integration-Infrastructure, 10Jenkins, 10SRE, 10SRE-Access-Requests: New Keyholder identity for RelEng Jenkins service - https://phabricator.wikimedia.org/T324014 (10jnuche) [14:30:17] 10Release-Engineering-Team, 10Scap: scap fails to sync some new hosts - https://phabricator.wikimedia.org/T324023 (10taavi) [14:31:13] 10Release-Engineering-Team, 10Scap, 10serviceops: scap fails to sync some new hosts - https://phabricator.wikimedia.org/T324023 (10Jdforrester-WMF) Probably not a scap bug but a new server config issue, then. [14:32:42] 10Release-Engineering-Team, 10Scap, 10serviceops: scap fails to sync some new hosts - https://phabricator.wikimedia.org/T324023 (10Joe) Please note these are not new hosts, just one of the servers listed is. So I would say either a scap bug or a network issue. [14:32:56] 10Release-Engineering-Team, 10Scap, 10serviceops: scap sync failure - https://phabricator.wikimedia.org/T324023 (10Joe) [14:53:52] hi all is someone able to review https://gitlab.wikimedia.org/repos/releng/dev-images/-/merge_requests/24 ( hashar ??) [15:17:07] 10GitLab (Administration, Settings & Policy), 10Release-Engineering-Team, 10serviceops-collab: Define GitLab API access for system users - https://phabricator.wikimedia.org/T324008 (10LSobanski) p:05Triage→03Medium [15:17:45] 10GitLab (Infrastructure), 10serviceops-collab, 10Cloud-VPS (Quota-requests): Request quota increase for devtools Cloud VPS project - https://phabricator.wikimedia.org/T323986 (10LSobanski) p:05Triage→03Medium [15:17:57] 10GitLab, 10serviceops-collab: automatically check for new gitlab releases and send notifications - https://phabricator.wikimedia.org/T323932 (10LSobanski) p:05Triage→03Medium [15:19:26] 10GitLab, 10serviceops-collab: automatically check for new gitlab releases and send notifications - https://phabricator.wikimedia.org/T323932 (10LSobanski) A possible source of information: https://about.gitlab.com/security-releases.xml [15:40:31] meanwhile [15:40:52] I got scap3-dev working with podman rootless containers, finally! [15:53:27] 10Release-Engineering-Team (Priority Backlog 📥), 10Patch-For-Review, 10Release, 10Train Deployments: 1.40.0-wmf.12 deployment blockers - https://phabricator.wikimedia.org/T320517 (10matmarex) [15:58:10] Hi, regarding scap: Is there a way to generate locally the output of a template to double check what gets rendered before deployment? [16:06:53] jnuche: for Gerrit automatically updating submodules, the documentation is at https://gerrit.wikimedia.org/r/Documentation/user-submodules.html [16:12:59] 10Release-Engineering-Team (Priority Backlog 📥), 10Patch-For-Review, 10Release, 10Train Deployments: 1.40.0-wmf.12 deployment blockers - https://phabricator.wikimedia.org/T320517 (10ssastry) [16:16:50] nemo-yiannis: I'm not certain but please try the `--dry-run` flag. [16:16:58] 👍 [16:18:11] 10GitLab (Infrastructure), 10serviceops-collab, 10Cloud-VPS (Quota-requests): Request quota increase for devtools Cloud VPS project - https://phabricator.wikimedia.org/T323986 (10aborrero) LGTM, +1 My only ask would be to return the unused floating IP when the transition is done. [16:26:17] 10GitLab, 10serviceops-collab: automatically check for new gitlab releases and send notifications - https://phabricator.wikimedia.org/T323932 (10brennen) Apart from the feed, there's a mailing list for security releases: https://about.gitlab.com/company/contact/ [16:31:14] dancy: we are fixing the mediawiki/core branch bump commit with jnuche (we are in spontaneous office right now) [16:31:24] the change got a +2 and hopefully will pass CI [16:31:29] which should unbreak scap prep [16:31:43] went manually cause i don't think the jenkins branch cut job is reentrant [16:32:35] 👍🏾 [16:37:40] when moving scap to gitlab, was it an intentional choice to not grant merge rights to all mediawiki +2ers (like on gerrit) or something that happened sort of by accident? [16:38:42] 10Release-Engineering-Team (Priority Backlog 📥), 10serviceops: Upgrade jwt-authorizer on all registry hosts - https://phabricator.wikimedia.org/T324037 (10dduvall) [16:38:59] taavi: Definitely not intentional. I will discuss this with the team today. [16:39:24] Wait, scap was all-MW-mergeable before? That seems surprising. [16:40:33] yep, it was under mediawiki/tools/ so inherited them I guess [16:46:15] dancy: success the commit is in :-] [16:47:14] Yay! [16:54:56] I have a checkout of Podman dated Nov 10, 2020 [16:55:10] looks like I have been looking forward to switch to it for two years [16:55:14] goal completed! [16:59:53] taavi: Yeah, I just assumed it was RelEng+SREs but apparently not. [17:15:14] James_F: I was neither in RelEng or SRE when I did the initial project. :) [17:19:23] * bd808 can't remember if RelEng has split from mwcore yet at that point or not [17:20:05] oi. *nor and *had to fix grammar [17:21:28] bd808: I guess you were left in platformengineering [17:21:50] based on https://www.mediawiki.org/w/index.php?title=Wikimedia_Release_Engineering_Team&oldid=759733 the split was Chris, Chad, Sam and me [17:22:07] and Greg tasked to initiate the team [17:22:21] where I learn I have been the oldest continuous member of that team by now [17:37:37] FY2013-2014 was a blur of virtual teams and "actual" teams. A quick wiki dive makes me think it would take a couple of hours of wiki and mailing list research to untangle the exact timeline of when who reported to whom and what each group was called at that point. :) But I agree that hashar has been in all of the formulations of "Release and QA" -> Release Engineering that I know of. [18:16:40] bd808: You were definitely part of the 'in' group in my mind, yes. :-) [19:08:59] 10Phabricator, 10Release-Engineering-Team (Priority Backlog 📥), 10serviceops-collab, 10Patch-For-Review: move phabricator to new hardware generation - https://phabricator.wikimedia.org/T280597 (10Dzahn) >>! In T280597#8427683, @Peachey88 wrote: > Do we still need server pages on wikitech? It's a bit of a c... [19:27:54] (03PS1) 10Dzahn: zuul/layout: set scholarships app repo to archived [integration/config] - 10https://gerrit.wikimedia.org/r/861928 (https://phabricator.wikimedia.org/T243037) [19:44:45] 10Project-Admins, 10Abstract Wikipedia team, 10WikiLambda: Rename "WikiLambda" and "WikiLambda Front-End" Phabricator tags to reflect the new project name: WikiFunction - https://phabricator.wikimedia.org/T323759 (10Jdforrester-WMF) a:03Jdforrester-WMF [19:55:12] 10Project-Admins, 10Abstract Wikipedia team, 10WikiLambda: Rename "WikiLambda" and "WikiLambda Front-End" Phabricator tags to reflect the new project name: WikiFunction - https://phabricator.wikimedia.org/T323759 (10Jdforrester-WMF) >>! In T323759#8425069, @Teleosteen wrote: > @Jdforrester-WMF OK, so from y... [19:56:11] 10Project-Admins, 10Abstract Wikipedia team, 10WikiLambda: Rename "WikiLambda" and "WikiLambda Front-End" Phabricator tags to reflect the new project name: WikiFunction - https://phabricator.wikimedia.org/T323759 (10Teleosteen) Thank you for your answer :) [19:56:16] 10Project-Admins, 10Abstract Wikipedia team, 10WikiLambda: Create "Wikifunctions" umbrella project to cover tasks that aren't necessarily specific to software, e.g. organising hackathons, co-ordinating projects, etc. - https://phabricator.wikimedia.org/T323759 (10Jdforrester-WMF) [19:59:14] 10Project-Admins, 10Abstract Wikipedia team, 10WikiLambda: Create "Wikifunctions" umbrella project to cover tasks that aren't necessarily specific to software, e.g. organising hackathons, co-ordinating projects, etc. - https://phabricator.wikimedia.org/T323759 (10Jdforrester-WMF) 05Open→03Resolved I've c... [20:00:21] 10Project-Admins, 10Abstract Wikipedia team, 10WikiLambda: Create "Wikifunctions" umbrella project to cover tasks that aren't necessarily specific to software, e.g. organising hackathons, co-ordinating projects, etc. - https://phabricator.wikimedia.org/T323759 (10Jdforrester-WMF) PR at https://github.com/Lad... [20:21:57] (03PS2) 10Jforrester: Zuul: [wikimedia/wikimania-scholarships] Set as archived [integration/config] - 10https://gerrit.wikimedia.org/r/861928 (https://phabricator.wikimedia.org/T243037) (owner: 10Dzahn) [20:22:12] (03CR) 10Jforrester: [C: 03+2] Zuul: [wikimedia/wikimania-scholarships] Set as archived [integration/config] - 10https://gerrit.wikimedia.org/r/861928 (https://phabricator.wikimedia.org/T243037) (owner: 10Dzahn) [20:24:02] (03Merged) 10jenkins-bot: Zuul: [wikimedia/wikimania-scholarships] Set as archived [integration/config] - 10https://gerrit.wikimedia.org/r/861928 (https://phabricator.wikimedia.org/T243037) (owner: 10Dzahn) [20:33:27] !log Zuul: [wikimedia/wikimania-scholarships] Set as archived for T243037 [20:33:29] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [20:33:29] T243037: Shutdown scholarships.wikimedia.org and archive project - https://phabricator.wikimedia.org/T243037 [20:40:38] (03PS2) 10Jforrester: Zuul: [avro-php] Use lib template (add doxygen and coverage) [integration/config] - 10https://gerrit.wikimedia.org/r/860061 [20:40:40] (03PS2) 10Jforrester: Zuul: [mediawiki/services/jobrunner] Use lib template (add doxygen and coverage) [integration/config] - 10https://gerrit.wikimedia.org/r/860062 [20:40:42] (03PS2) 10Jforrester: Zuul: [mediawiki/tools/codesniffer] Use lib template (add doxygen) [integration/config] - 10https://gerrit.wikimedia.org/r/860063 [20:40:44] (03PS2) 10Jforrester: Zuul: [mediawiki/tools/phpunit-patch-coverage] Use lib template (add doxygen) [integration/config] - 10https://gerrit.wikimedia.org/r/860064 [20:40:46] (03PS2) 10Jforrester: Zuul: [mediawiki/tools/minus-x] Use lib template (add doxygen and coverage) [integration/config] - 10https://gerrit.wikimedia.org/r/860065 [20:40:48] (03PS1) 10Jforrester: Zuul: Add a PHP 8.2 version of mediawiki-php-library [integration/config] - 10https://gerrit.wikimedia.org/r/861934 [21:11:23] 10Release-Engineering-Team, 10Scap, 10serviceops: scap sync failure - https://phabricator.wikimedia.org/T324023 (10Urbanecm) This happened again during the UTC late B&C deploy window: ` 21:10:16 ['/usr/bin/scap', 'pull', '--no-php-restart', '--no-update-l10n', '--exclude-wikiversions.php', 'deploy2002.codfw... [21:35:44] !log gitlab repos/releng/scap: added direct membership for some non-releng maintainers who show up frequently/recently in commit log [21:35:45] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [21:38:15] 10Release-Engineering-Team, 10Scap: scap backport: KeyError: '/srv/mediawiki-staging/php-1.40.0-wmf.12' - https://phabricator.wikimedia.org/T324060 (10Urbanecm) [22:01:52] 10Release-Engineering-Team (Priority Backlog 📥), 10Patch-For-Review, 10Release, 10Train Deployments: 1.40.0-wmf.12 deployment blockers - https://phabricator.wikimedia.org/T320517 (10matmarex) [22:52:49] 10Release-Engineering-Team, 10Scap, 10serviceops: scap sync failure - https://phabricator.wikimedia.org/T324023 (10dancy) >>! In T324023#8428647, @Jdforrester-WMF wrote: > Probably not a scap bug but a new server config issue, then. A little of both in the end.