[03:30:40] 10GitLab (Project Migration), 10Release-Engineering-Team: Youtac RS - https://phabricator.wikimedia.org/T304806 (10YoutacrsVARs) [03:31:00] 10GitLab (Project Migration), 10Release-Engineering-Team: Youtac RS - https://phabricator.wikimedia.org/T304806 (10YoutacrsVARs) a:03YoutacrsVARs [07:49:34] (03CR) 10Jaime Nuche: [C: 03+2] AnsiColorFormatter: Don't use colors if stderr is not a TTY (update) [tools/scap] - 10https://gerrit.wikimedia.org/r/773884 (owner: 10Ahmon Dancy) [07:52:35] (03Merged) 10jenkins-bot: AnsiColorFormatter: Don't use colors if stderr is not a TTY (update) [tools/scap] - 10https://gerrit.wikimedia.org/r/773884 (owner: 10Ahmon Dancy) [07:55:01] good morning [07:56:11] (03CR) 10Jaime Nuche: [C: 03+2] Add --no-logo flag to scap sync-world [tools/scap] - 10https://gerrit.wikimedia.org/r/773885 (owner: 10Ahmon Dancy) [07:56:53] (03Merged) 10jenkins-bot: Add --no-logo flag to scap sync-world [tools/scap] - 10https://gerrit.wikimedia.org/r/773885 (owner: 10Ahmon Dancy) [07:57:06] hashar: morning [07:58:30] I am too slow this morning, I so hate the timezone change :-\ [07:58:36] summer time is a sin [08:02:41] yeah, I'm not a fan either [08:11:10] kostajh: will finish up that phpbench patch , sorry for the mess up on friday :D [08:11:37] hashar: thanks! it's ok, thanks for dealing with it on a Friday [08:17:16] kostajh: so I have updated the job, triggered a rebuild and it failed https://integration.wikimedia.org/ci/job/mediawiki-phpbench-patch-docker/20/console [08:17:32] `00:00:58.194 git: 'switch' is not a git command. See 'git --help'.` [08:18:25] hrm [08:18:37] https://git-scm.com/docs/git-switch [08:18:42] trying https://gerrit.wikimedia.org/r/c/mediawiki/extensions/GrowthExperiments/+/722594 [08:18:56] since 2.27.0 [08:19:00] what version of git do we have? [08:19:02] it is probably an alias for git checkout [08:19:36] iirc the images are based on Buster and thus would have git 2.20 [08:21:55] bah [08:22:25] so close, guess I'll have to rework the code in quibble or upgrade git in the image, either way we'll need a new image [08:23:26] hashar: would using add-apt-repository ppa:git-core/ppa in the quibble image be OK or should I rework the command to not use 'git switch' ? [08:23:58] I think we can do both [08:24:13] `git checkout -` would work as I understand the `git switch` command [08:24:21] and we can install git from buster-backports [08:26:18] then upgrading git is not necessarly streaightforward [08:26:23] it might well break stuff here and there [08:26:35] so I am tempted to have the quibble phpbench to use `checkout` [08:29:27] ok [08:33:07] patch coming [08:34:09] moare release and image building bah :D [08:34:58] yeah [08:35:36] hashar: I filed T301468 a few weeks ago, that could make things a little more automated [08:35:36] T301468: Use deployment pipeline with Quibble? - https://phabricator.wikimedia.org/T301468 [08:47:23] (03CR) 10Hashar: [C: 03+2] jjb: Adjust phpbench args [integration/config] - 10https://gerrit.wikimedia.org/r/773869 (https://phabricator.wikimedia.org/T291549) (owner: 10Kosta Harlan) [08:48:38] kostajh: thank you for the wikilove message about trainsperiment :] [08:49:36] <3 [08:50:04] (03Merged) 10jenkins-bot: jjb: Adjust phpbench args [integration/config] - 10https://gerrit.wikimedia.org/r/773869 (https://phabricator.wikimedia.org/T291549) (owner: 10Kosta Harlan) [09:26:35] (03PS1) 10Hashar: dockerfiles update to Quibble 1.4.5 [integration/config] - 10https://gerrit.wikimedia.org/r/774415 (https://phabricator.wikimedia.org/T291549) [09:42:03] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team, 10Cloud-VPS (Quota-requests), 10castor: Request new flavor for integration Cloud VPS project - https://phabricator.wikimedia.org/T304080 (10hashar) For this specific use case we are probable better off creating a volume via Horizon and at... [09:49:00] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team, 10Cloud-VPS (Quota-requests), 10castor: Request volume quota increase for integration Cloud VPS project - https://phabricator.wikimedia.org/T304080 (10hashar) [09:49:52] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team, 10Cloud-VPS (Quota-requests), 10castor: Request volume quota increase for integration Cloud VPS project - https://phabricator.wikimedia.org/T304080 (10dcaro) +1 from me [09:53:26] !log Tag Quibble 1.4.5 @ abe16d574 | T291549 [09:53:28] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [09:53:29] T291549: Evaluate phpbench for benchmarking and guarding against performance regressions - https://phabricator.wikimedia.org/T291549 [09:54:26] (03CR) 10Hashar: [C: 03+2] dockerfiles update to Quibble 1.4.5 [integration/config] - 10https://gerrit.wikimedia.org/r/774415 (https://phabricator.wikimedia.org/T291549) (owner: 10Hashar) [09:58:21] (03Merged) 10jenkins-bot: dockerfiles update to Quibble 1.4.5 [integration/config] - 10https://gerrit.wikimedia.org/r/774415 (https://phabricator.wikimedia.org/T291549) (owner: 10Hashar) [10:09:44] (03PS1) 10Hashar: jjb: mediawiki-phpbench-patch-docker to Quibble 1.4.5 [integration/config] - 10https://gerrit.wikimedia.org/r/774427 (https://phabricator.wikimedia.org/T291549) [10:11:14] (03CR) 10Kosta Harlan: [C: 03+1] jjb: mediawiki-phpbench-patch-docker to Quibble 1.4.5 [integration/config] - 10https://gerrit.wikimedia.org/r/774427 (https://phabricator.wikimedia.org/T291549) (owner: 10Hashar) [10:18:13] !log contint2001 and contint1001: pruning all git reflog entries from the zuul-merger: `sudo -u zuul find /srv/zuul/git -name .git -type d -execdir git reflog expire --expire=all --all`. They are useless and no more generated since https://gerrit.wikimedia.org/r/c/operations/puppet/+/757943 [10:18:14] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [10:21:01] thcipriani: https://docs.google.com/forms/u/0/d/e/1FAIpQLSd0Nc2jGkAGW-5rTiKN2EHWzfw2HeHm13N-ZCw1xUdE3z6woQ/formrestricted is only open to same org [10:23:43] RhinosF1: I think I can fix it up [10:24:15] Morning hashar [10:25:08] RhinosF1: may you try again? [10:25:26] hashar: works [10:25:45] !log Changed `Trainsperiment Survey Questions` surveys permissions to be open outside of WMF and limited to 1 answer (forcing signin) https://docs.google.com/forms/u/0/d/e/1FAIpQLSd0Nc2jGkAGW-5rTiKN2EHWzfw2HeHm13N-ZCw1xUdE3z6woQ/formrestricted [10:25:47] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [10:25:50] thcipriani: solved ^ :] [10:25:54] RhinosF1: thank you! [10:28:10] :) [10:34:13] !log contint2001 and contint1001: pruning obsolete branches from the zuul-merger: `sudo -H -u zuul find /srv/zuul/git -type d -name .git -print -execdir git -c url."https://gerrit.wikimedia.org/r/".insteadOf="ssh://jenkins-bot@gerrit.wikimedia.org:29418/" remote prune origin \;` T220606 [10:34:15] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [10:34:16] T220606: zuul-merger takes a while to recreate repository branches - https://phabricator.wikimedia.org/T220606 [10:45:52] (03CR) 10Hashar: [C: 03+2] jjb: mediawiki-phpbench-patch-docker to Quibble 1.4.5 [integration/config] - 10https://gerrit.wikimedia.org/r/774427 (https://phabricator.wikimedia.org/T291549) (owner: 10Hashar) [10:47:45] (03Merged) 10jenkins-bot: jjb: mediawiki-phpbench-patch-docker to Quibble 1.4.5 [integration/config] - 10https://gerrit.wikimedia.org/r/774427 (https://phabricator.wikimedia.org/T291549) (owner: 10Hashar) [10:53:41] (03PS1) 10Hashar: jjb: mediawiki-phpbench-patch-docker with supervisord [integration/config] - 10https://gerrit.wikimedia.org/r/774438 [11:04:45] (03CR) 10Hashar: [C: 03+2] jjb: mediawiki-phpbench-patch-docker with supervisord [integration/config] - 10https://gerrit.wikimedia.org/r/774438 (owner: 10Hashar) [11:06:34] (03Merged) 10jenkins-bot: jjb: mediawiki-phpbench-patch-docker with supervisord [integration/config] - 10https://gerrit.wikimedia.org/r/774438 (owner: 10Hashar) [11:25:20] 10Phabricator, 10Release-Engineering-Team (Next), 10serviceops: Deprecate git-ssh service on phabricator.wikimedia.org - https://phabricator.wikimedia.org/T296022 (10awight) >>! In T296022#7742371, @Dzahn wrote: >>>! In T296022#7742329, @Stashbot wrote: >> {nav icon=file, name=Mentioned in SAL (#wikimedia-op... [12:31:08] (03PS1) 10Jaime Nuche: stop_before_sync flag: add defaults [tools/scap] - 10https://gerrit.wikimedia.org/r/774465 [12:36:28] (03CR) 10Jaime Nuche: [C: 03+2] stop_before_sync flag: add defaults [tools/scap] - 10https://gerrit.wikimedia.org/r/774465 (owner: 10Jaime Nuche) [12:37:28] (03Merged) 10jenkins-bot: stop_before_sync flag: add defaults [tools/scap] - 10https://gerrit.wikimedia.org/r/774465 (owner: 10Jaime Nuche) [13:21:06] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team, 10Cloud-VPS (Quota-requests), 10castor: Request volume quota increase for integration Cloud VPS project - https://phabricator.wikimedia.org/T304080 (10Andrew) 05Openโ†’03Resolved a:03Andrew done! [13:21:16] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Seen), 10Cloud-VPS (Debian Stretch Deprecation): Move all Wikimedia CI (WMCS integration project) instances from stretch to buster/bullseye - https://phabricator.wikimedia.org/T252071 (10Andrew) [13:26:04] (03PS2) 10Sbisson: Start branching Wikistories for Wikimedia production [tools/release] - 10https://gerrit.wikimedia.org/r/773211 (https://phabricator.wikimedia.org/T303004) [13:36:57] Project mediawiki-core-doxygen-docker build #32963: 04FAILURE in 19 min: https://integration.wikimedia.org/ci/job/mediawiki-core-doxygen-docker/32963/ [13:45:43] (03PS1) 10Jaime Nuche: deploy-promote: small refactor [tools/scap] - 10https://gerrit.wikimedia.org/r/774475 [13:45:45] (03PS1) 10Jaime Nuche: stage-train: integrate into `scap` [tools/scap] - 10https://gerrit.wikimedia.org/r/774476 (https://phabricator.wikimedia.org/T302488) [13:48:14] Yippee, build fixed! [13:48:14] Project mediawiki-core-doxygen-docker build #32964: 09FIXED in 11 min: https://integration.wikimedia.org/ci/job/mediawiki-core-doxygen-docker/32964/ [13:50:54] (03CR) 10Jaime Nuche: "Tested manually on train-dev" [tools/scap] - 10https://gerrit.wikimedia.org/r/774476 (https://phabricator.wikimedia.org/T302488) (owner: 10Jaime Nuche) [14:00:06] Project beta-code-update-eqiad build #385522: 15ABORTED in 8 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/385522/ [14:02:12] (03PS3) 10Jaime Nuche: deploy-promote: migrate script to `tools/scap` repository [tools/release] - 10https://gerrit.wikimedia.org/r/769026 (https://phabricator.wikimedia.org/T30248) [14:06:33] (03PS1) 10Hashar: log: add ecs logging events to Timer [tools/scap] - 10https://gerrit.wikimedia.org/r/774483 [14:07:13] (03CR) 10jerkins-bot: [V: 04-1] log: add ecs logging events to Timer [tools/scap] - 10https://gerrit.wikimedia.org/r/774483 (owner: 10Hashar) [14:08:33] (03CR) 10Hashar: "Fails cause of an outdated pytest:" [tools/scap] - 10https://gerrit.wikimedia.org/r/774483 (owner: 10Hashar) [14:09:16] jnuche: I have a test failure due to Debian Stretch sipping an outdated test dependency ] [14:09:39] I am also guessing we should run tests against all of Stretch, Buster, Bullseye but that is a side track :D [14:30:34] hashar: well, that's convenient, this is the patch to start using pip deps if you wanna help move it along :) https://gerrit.wikimedia.org/r/c/mediawiki/tools/scap/+/773809 [14:55:47] 10Release-Engineering-Team (Radar), 10CommRel-Specialists-Support, 10DBA, 10User-notice: Stop announcing and scheduling primary database switchovers - https://phabricator.wikimedia.org/T303605 (10Elitre) [14:58:04] 10GitLab (Infrastructure), 10serviceops: GitLab minor version upgrade: 14.9.x - https://phabricator.wikimedia.org/T304622 (10Jelto) This will happen tomorrow/Tuesday due to scheduling conflicts. [14:59:30] 10GitLab: gitlab: consider enabling docker container registry - https://phabricator.wikimedia.org/T304845 (10aborrero) [14:59:58] 10GitLab, 10cloud-services-team (Kanban): gitlab: consider enabling docker container registry - https://phabricator.wikimedia.org/T304845 (10aborrero) p:05Triageโ†’03Medium [15:00:53] 10GitLab, 10cloud-services-team (Kanban): gitlab: consider enabling docker container registry - https://phabricator.wikimedia.org/T304845 (10aborrero) [15:30:49] 10Release-Engineering-Team, 10Scap, 10serviceops: Deploy Scap version 4.5.0 - https://phabricator.wikimedia.org/T304134 (10jnuche) @Dzahn this task is not getting any love and I see you rolled out the two previous versions. Could we assign this to you? Failing that, can you please help get it unblocked? [15:32:30] 10GitLab (CI & Job Runners), 10Release-Engineering-Team, 10Security Team AppSec, 10Security-Team, 10Security: Evaluate and confirm potential licensing issues for gitlab appsec pipeline tools - https://phabricator.wikimedia.org/T304737 (10sbassett) Tagging @Legoktm and @greg as subject matter experts here... [15:37:59] 10Release-Engineering-Team (๐Ÿš‚๐Ÿงช Trainsperiment Week), 10Infrastructure-Foundations, 10SRE, 10serviceops: Need a service account on deploy servers - https://phabricator.wikimedia.org/T303857 (10herron) Removing from the sre access request queue while the details of the request are being clarified. Please r... [15:44:13] (03PS1) 10Jaime Nuche: stage-train: migrate script to `tools/scap` repository [tools/release] - 10https://gerrit.wikimedia.org/r/774504 (https://phabricator.wikimedia.org/T30248) [15:45:13] 10GitLab (CI & Job Runners), 10Release-Engineering-Team, 10Security Team AppSec, 10Security-Team, and 2 others: Evaluate and confirm potential licensing issues for gitlab appsec pipeline tools - https://phabricator.wikimedia.org/T304737 (10sbassett) [15:50:49] (03CR) 10Jaime Nuche: "Cannot be merged yet" [tools/release] - 10https://gerrit.wikimedia.org/r/774504 (https://phabricator.wikimedia.org/T30248) (owner: 10Jaime Nuche) [15:50:57] (03CR) 10Jaime Nuche: [C: 04-2] stage-train: migrate script to `tools/scap` repository [tools/release] - 10https://gerrit.wikimedia.org/r/774504 (https://phabricator.wikimedia.org/T30248) (owner: 10Jaime Nuche) [15:52:52] (03CR) 10Dduvall: [C: 03+2] deploy-promote: small refactor [tools/scap] - 10https://gerrit.wikimedia.org/r/774475 (owner: 10Jaime Nuche) [15:53:38] (03Merged) 10jenkins-bot: deploy-promote: small refactor [tools/scap] - 10https://gerrit.wikimedia.org/r/774475 (owner: 10Jaime Nuche) [16:15:12] 10Release-Engineering-Team, 10Release Pipeline (Blubber): Blubber must not use easy_install to install pip, but python3-pip - https://phabricator.wikimedia.org/T304860 (10hashar) [16:20:50] 10Phabricator, 10Privacy: Investigate ways to enforce username usage within Phabricator - https://phabricator.wikimedia.org/T304864 (10sbassett) [16:23:42] (03CR) 10Hashar: blubber: use `pip` to install Python test dependencies (034 comments) [tools/scap] - 10https://gerrit.wikimedia.org/r/773809 (https://phabricator.wikimedia.org/T302905) (owner: 10Jaime Nuche) [16:24:37] (03PS2) 10Hashar: log: add ecs logging events to Timer [tools/scap] - 10https://gerrit.wikimedia.org/r/774483 [16:28:09] (03CR) 10jerkins-bot: [V: 04-1] log: add ecs logging events to Timer [tools/scap] - 10https://gerrit.wikimedia.org/r/774483 (owner: 10Hashar) [16:39:44] (03CR) 10Gifti: [V: 03+2 C: 03+2] Edit Repo Config [labs/tools/giftbot] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/773860 (owner: 10Zabe) [16:41:30] (03CR) 10Dduvall: [C: 04-1] "This looks great. I have just a few nits and some optional suggestions. I haven't run my own tests yet, but I will do that now." [tools/scap] - 10https://gerrit.wikimedia.org/r/773793 (https://phabricator.wikimedia.org/T302905) (owner: 10Jaime Nuche) [16:49:01] !log integration: created 320G volume https://horizon.wikimedia.org/project/volumes/3f90c3f2-158d-4e45-a919-0f048f47c3b6/ . Intended to migrate integration-castor03 T252071 [16:49:03] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [16:49:03] T252071: Move all Wikimedia CI (WMCS integration project) instances from stretch to buster/bullseye - https://phabricator.wikimedia.org/T252071 [16:51:54] (03CR) 10Dduvall: [C: 04-1] scap prep: support for serialization of concurrent processes (031 comment) [tools/scap] - 10https://gerrit.wikimedia.org/r/773793 (https://phabricator.wikimedia.org/T302905) (owner: 10Jaime Nuche) [16:55:15] !log integration: created instance integration-castor04 with flavor `g3.cores8.ram32.disk20` (twice more ram than integration-castor03) # T252071 [16:55:17] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [16:55:18] T252071: Move all Wikimedia CI (WMCS integration project) instances from stretch to buster/bullseye - https://phabricator.wikimedia.org/T252071 [17:00:52] 10Release-Engineering-Team, 10serviceops: docker-report-releng failing on multiple image tags because of certificate validation error - https://phabricator.wikimedia.org/T304875 (10JMeybohm) [17:00:56] 10Gerrit: Switch labs/tools/giftbot to merging without review - https://phabricator.wikimedia.org/T304775 (10Giftpflanze) 05Openโ†’03Resolved a:03Giftpflanze [17:31:04] Would anyone have time to build some docker images later today? I'm trying to release three versions of an image in https://gitlab.wikimedia.org/repos/releng/dev-images but i suspect that needs someone in releng for the merge, and contint-docker for the build/deploy. Re T304290 [17:31:05] T304290: Create docker elasticsearch images with wmf search plugins - https://phabricator.wikimedia.org/T304290 [17:35:48] 10Phabricator, 10Privacy: Investigate ways to enforce username usage within Phabricator - https://phabricator.wikimedia.org/T304864 (10Aklapper) 05Openโ†’03Invalid Indeed. Same may happen on wikis, mailing lists, video calls, etc. I am not aware of any feasible technical solution to this social problem ("ple... [17:57:20] (03CR) 10Dduvall: [C: 03+2] stage-train: Always pass --yes to deploy-promote [tools/release] - 10https://gerrit.wikimedia.org/r/773355 (owner: 10Ahmon Dancy) [17:58:00] (03Merged) 10jenkins-bot: stage-train: Always pass --yes to deploy-promote [tools/release] - 10https://gerrit.wikimedia.org/r/773355 (owner: 10Ahmon Dancy) [17:58:26] (03CR) 10Dduvall: [C: 04-1] "Tested this as well and it seems good to go after follow-ups to my nitpicking." [tools/scap] - 10https://gerrit.wikimedia.org/r/773793 (https://phabricator.wikimedia.org/T302905) (owner: 10Jaime Nuche) [18:07:39] (03CR) 10Dduvall: [C: 03+2] stage-train: Handle KeyboardInterrupt in main() [tools/release] - 10https://gerrit.wikimedia.org/r/773350 (owner: 10Ahmon Dancy) [18:26:50] 10Phabricator, 10Release-Engineering-Team (Next), 10serviceops: Deprecate git-ssh service on phabricator.wikimedia.org - https://phabricator.wikimedia.org/T296022 (10Dzahn) Thank you @awight :) Gotcha! So for now, even without migrating, it will still be possible to push to the repo, just not via ssh. It's s... [18:34:53] 10Release-Engineering-Team (Next), 10Release, 10Train Deployments: 1.39.0-wmf.5 deployment blockers - https://phabricator.wikimedia.org/T300204 (10hashar) Welcome aboard train 1.39.0-wmf.5 heading to all wikis. I will be the train conductor this week. The train will run during UTC morning given I am based in... [18:36:27] hashar: DST is just lovely [18:43:20] phab codfw just went down [18:44:27] twentyafterfour: ^ [18:52:07] RhinosF1: I can ssh into phab2001.codfw [18:52:34] twentyafterfour: it came back like a second ago [18:52:38] see -operations [18:54:12] twentyafterfour: seems like we tripped over a cable, maybe, thanks for jumping in <3 [18:54:26] np [18:54:50] at least I confirmed that my access still works in case it's needed in a real emergency [18:55:08] heh [18:55:13] we should get phab2002 in production [18:55:25] it wasnt the server though [18:55:38] it was "just" network [18:55:58] RhinosF1: thanks for the ping. And as an FYI twentyafterfour is a volunteer nowadays and might be a bit slower to respond now that phab is not his day job :) [18:56:28] thcipriani: oh ye [18:56:57] mutante: +1 for phab2002 -- this event made my heart jump a bit :D [18:58:02] thcipriani: the unusual part is.. server AND mgmt were offline [18:58:05] that is ..weird [18:58:17] will talk to dcops etc [18:58:34] or.. it's just that mgmt was broken unrelatedly [18:58:43] trying that again now [18:59:09] yea, mgmt is also responding again now [18:59:46] the mgmt -- is that drac? [18:59:59] yes, the DRAC [19:18:44] (03PS2) 10Ahmon Dancy: stage-train: Handle KeyboardInterrupt in main() [tools/release] - 10https://gerrit.wikimedia.org/r/773350 [19:26:57] (03CR) 10Ahmon Dancy: [C: 03+2] stage-train: Handle KeyboardInterrupt in main() [tools/release] - 10https://gerrit.wikimedia.org/r/773350 (owner: 10Ahmon Dancy) [19:27:45] (03Merged) 10jenkins-bot: stage-train: Handle KeyboardInterrupt in main() [tools/release] - 10https://gerrit.wikimedia.org/r/773350 (owner: 10Ahmon Dancy) [19:53:06] (03CR) 10Ahmon Dancy: scap prep: support for serialization of concurrent processes (031 comment) [tools/scap] - 10https://gerrit.wikimedia.org/r/773793 (https://phabricator.wikimedia.org/T302905) (owner: 10Jaime Nuche) [19:55:20] (03CR) 10Ahmon Dancy: "Thanks for the fix Jaime" [tools/scap] - 10https://gerrit.wikimedia.org/r/774465 (owner: 10Jaime Nuche) [20:03:48] (03CR) 10Ahmon Dancy: "Please consider moving the style fixes into a separate prerequisite commit. Does the new style work equally well for the old and new flak" [tools/scap] - 10https://gerrit.wikimedia.org/r/773809 (https://phabricator.wikimedia.org/T302905) (owner: 10Jaime Nuche) [20:14:14] (03CR) 10Ahmon Dancy: [V: 03+1 C: 04-1] "Tested in train-dev." [tools/scap] - 10https://gerrit.wikimedia.org/r/774476 (https://phabricator.wikimedia.org/T302488) (owner: 10Jaime Nuche) [20:36:44] 10Release-Engineering-Team, 10Release Pipeline (Blubber), 10User-dduvall: Blubber must not use easy_install to install pip, but python3-pip - https://phabricator.wikimedia.org/T304860 (10dduvall) p:05Triageโ†’03High [20:36:55] 10Release-Engineering-Team, 10Release Pipeline (Blubber), 10User-dduvall: Blubber must not use easy_install to install pip, but python3-pip - https://phabricator.wikimedia.org/T304860 (10dduvall) a:03dduvall [21:08:53] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team, 10Cloud-VPS (Quota-requests), 10castor: Request volume quota increase for integration Cloud VPS project - https://phabricator.wikimedia.org/T304080 (10hashar) That worked like a charm, I have followed https://wikitech.wikimedia.org/wiki/H... [21:34:41] (Queue (Jenkins jobs + Zuul functions) alert) firing: Queue (Jenkins jobs + Zuul functions) alert - https://alerts.wikimedia.org/?q=alertname%3DQueue+%28Jenkins+jobs+%2B+Zuul+functions%29+alert [21:39:56] PROBLEM - Work requests waiting in Zuul Gearman server on contint2001 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [400.0] https://www.mediawiki.org/wiki/Continuous_integration/Zuul https://grafana.wikimedia.org/d/000000322/zuul-gearman?orgId=1&viewPanel=10 [21:44:40] (Queue (Jenkins jobs + Zuul functions) alert) firing: (2) Queue (Jenkins jobs + Zuul functions) alert - https://alerts.wikimedia.org/?q=alertname%3DQueue+%28Jenkins+jobs+%2B+Zuul+functions%29+alert [21:55:30] RECOVERY - Work requests waiting in Zuul Gearman server on contint2001 is OK: OK: Less than 100.00% above the threshold [200.0] https://www.mediawiki.org/wiki/Continuous_integration/Zuul https://grafana.wikimedia.org/d/000000322/zuul-gearman?orgId=1&viewPanel=10 [22:04:40] (Queue (Jenkins jobs + Zuul functions) alert) resolved: Queue (Jenkins jobs + Zuul functions) alert - https://alerts.wikimedia.org/?q=alertname%3DQueue+%28Jenkins+jobs+%2B+Zuul+functions%29+alert [22:30:58] (03PS1) 10Dduvall: python: Stop using easy_install to bootstrap pip [blubber] - 10https://gerrit.wikimedia.org/r/774576 (https://phabricator.wikimedia.org/T304860) [22:32:50] (03PS2) 10Dduvall: python: Stop using easy_install to bootstrap pip [blubber] - 10https://gerrit.wikimedia.org/r/774576 (https://phabricator.wikimedia.org/T304860) [22:38:28] (03CR) 10Dduvall: "I've looked through code search to see who this might affect, and I only see one use of python2.7 where this might break the build:" [blubber] - 10https://gerrit.wikimedia.org/r/774576 (https://phabricator.wikimedia.org/T304860) (owner: 10Dduvall) [23:02:24] (03CR) 10BryanDavis: [C: 03+1] python: Stop using easy_install to bootstrap pip [blubber] - 10https://gerrit.wikimedia.org/r/774576 (https://phabricator.wikimedia.org/T304860) (owner: 10Dduvall)