[00:00:55] (03open) 10pppery: Define path as "phabricator/" rather than "phorge/" [repos/phabricator/arcanist] (wmf/stable) - 10https://gitlab.wikimedia.org/repos/phabricator/arcanist/-/merge_requests/2 [00:02:51] (03update) 10pppery: Define path as "phabricator/" rather than "phorge/" [repos/phabricator/arcanist] (wmf/stable) - 10https://gitlab.wikimedia.org/repos/phabricator/arcanist/-/merge_requests/2 (https://phabricator.wikimedia.org/T364426) [00:03:00] 10Phabricator (2024-05-14), 10Release-Engineering-Team (Yakisfaction), 10Wikimedia-Phabricator-Extensions: Make WMF's Phabricator Translations extension work with an upstream Phorge installation - https://phabricator.wikimedia.org/T364426#9802571 (10CodeReviewBot) pppery updated https://gitlab.wikimedia.... [00:04:33] (03open) 10addbot: Bump postgres from 13.14 to 13.15 [repos/releng/cli] - 10https://gitlab.wikimedia.org/repos/releng/cli/-/merge_requests/558 [01:29:48] (03open) 10volker-e: releases: Bump Codex to 1.6.0 [repos/ci-tools/libup-config] - 10https://gitlab.wikimedia.org/repos/ci-tools/libup-config/-/merge_requests/11 [01:36:45] (03approved) 10catrope: releases: Bump Codex to 1.6.0 [repos/ci-tools/libup-config] - 10https://gitlab.wikimedia.org/repos/ci-tools/libup-config/-/merge_requests/11 (owner: 10volker-e) [01:36:51] (03merge) 10catrope: releases: Bump Codex to 1.6.0 [repos/ci-tools/libup-config] - 10https://gitlab.wikimedia.org/repos/ci-tools/libup-config/-/merge_requests/11 (owner: 10volker-e) [06:58:03] 10GitLab (Upstream pit of despair 🕳️), 06Release-Engineering-Team: Invalid key added when adding GPG key with subkey to GitLab - https://phabricator.wikimedia.org/T364212#9803107 (10Aklapper) [07:00:55] 10GitLab (Upstream pit of despair 🕳️), 10Release-Engineering-Team (Radar): Invalid key added when adding GPG key with subkey to GitLab - https://phabricator.wikimedia.org/T364212#9803111 (10Aklapper) This is upstream issue https://gitlab.com/gitlab-org/gitlab-foss/-/issues/36829 and https://gitlab.com/gitlab-o... [07:45:16] (03update) 10brouberol: Update projects.json [repos/releng/gitlab-trusted-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-trusted-runner/-/merge_requests/73 (https://phabricator.wikimedia.org/T364795) [07:48:03] if anyone's around, would it be possible to get a review of ^ ? Thank you! [08:32:41] une db dans un container? :-] [08:33:30] and https://gitlab.wikimedia.org/repos/releng/gitlab-trusted-runner/-/merge_requests/73/diffs states it is in conflict apparently [08:39:17] brouberol: I think you have to rebase it [08:39:28] and maybe I can approve it after that [08:42:10] oh come on, that's the 3rd rebase :D [08:42:11] on it [08:43:40] 10Release-Engineering-Team (Seen), 06Quality-and-Test-Engineering-Team, 07Code-Health, 07Epic: [EPIC] Encourage developers to increase code coverage - https://phabricator.wikimedia.org/T100294#9803413 (10kostajh) Should we close this epic? Or assign some specific target that we want to reach? [08:44:55] brouberol: I don't really know what is the merge policy for that repo, but it seems it requires fast forward merge requests [08:45:00] with no automatic rebases [08:48:23] 10Continuous-Integration-Config, 10Gerrit: Show lines covered by tests in Gerrit patches - https://phabricator.wikimedia.org/T365104 (10kostajh) 03NEW [08:50:46] FIRING: DatasourceError: Queue (Jenkins jobs + Zuul functions) alert - https://grafana.wikimedia.org/alerting/grafana/iS0FSjJ4z/view - https://wikitech.wikimedia.org/wiki/Monitoring/DatasourceError - https://alerts.wikimedia.org/?q=alertname%3DDatasourceError [08:55:46] RESOLVED: DatasourceError: Queue (Jenkins jobs + Zuul functions) alert - https://grafana.wikimedia.org/alerting/grafana/iS0FSjJ4z/view - https://wikitech.wikimedia.org/wiki/Monitoring/DatasourceError - https://alerts.wikimedia.org/?q=alertname%3DDatasourceError [08:56:44] FIRING: DatasourceError: Queue (Jenkins jobs + Zuul functions) alert - https://grafana.wikimedia.org/alerting/grafana/iS0FSjJ4z/view - https://wikitech.wikimedia.org/wiki/Monitoring/DatasourceError - https://alerts.wikimedia.org/?q=alertname%3DDatasourceError [08:59:46] (03update) 10brouberol: Update projects.json [repos/releng/gitlab-trusted-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-trusted-runner/-/merge_requests/73 (https://phabricator.wikimedia.org/T364795) [09:00:09] hashar: rebased! Sorry I was in a 1.1 [09:00:42] > une db dans un container? :-] [09:00:42] yep, for small workloads (the DB shouldn't exceed 1GB) backed by Ceph [09:02:57] 10Continuous-Integration-Config, 10Gerrit: Show lines covered by tests in Gerrit patches - https://phabricator.wikimedia.org/T365104#9803499 (10hashar) →14Duplicate dup:03T183760 [09:04:27] 10Gerrit: Create a code coverage plugin for polygerrit - https://phabricator.wikimedia.org/T183760#9803496 (10hashar) [09:06:44] RESOLVED: DatasourceError: Queue (Jenkins jobs + Zuul functions) alert - https://grafana.wikimedia.org/alerting/grafana/iS0FSjJ4z/view - https://wikitech.wikimedia.org/wiki/Monitoring/DatasourceError - https://alerts.wikimedia.org/?q=alertname%3DDatasourceError [09:11:39] oh stupid gitlab [09:15:02] brouberol: you might not have rebased it properly (or GitLab is broken somehow) [09:15:14] also the commit message had `runners` changed to `runnerS` (nitpick) [09:15:18] bisous [09:15:20] :D [09:17:47] 06Release-Engineering-Team: Per-page graphite metrics created for MediaWiki.rest_api_latency - https://phabricator.wikimedia.org/T365111 (10fgiunchedi) 03NEW [09:19:02] (03update) 10brouberol: Update projects.json [repos/releng/gitlab-trusted-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-trusted-runner/-/merge_requests/73 (https://phabricator.wikimedia.org/T364795) [09:22:50] (03merge) 10hashar: Update projects.json [repos/releng/gitlab-trusted-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-trusted-runner/-/merge_requests/73 (https://phabricator.wikimedia.org/T364795) (owner: 10brouberol) [09:23:06] brouberol: DONE! then I don't know whether some extra step is required in order for the change to be taken in account :/ [09:23:27] ah [09:23:28] After a project was added and merged, the apply-job has to be started manually by an administrator. A diff is available in the job log of diff-job. [09:24:30] and I don't know from where to run it [09:24:43] 06Release-Engineering-Team, 13Patch-For-Review: Per-page graphite metrics created for MediaWiki.rest_api_latency / rest_api_errors - https://phabricator.wikimedia.org/T365111#9803610 (10fgiunchedi) [09:24:51] I guess I should not have merged it [09:33:54] 06Release-Engineering-Team: Per-page graphite metrics created for MediaWiki.rest_api_latency / rest_api_errors - https://phabricator.wikimedia.org/T365111#9803644 (10fgiunchedi) I've temporarily blackholed the metrics from graphite, though of course mw should stop sending them. cc @hashar @daniel @BPirkle [09:33:56] brouberol: https://gitlab.wikimedia.org/repos/releng/gitlab-trusted-runner/-/jobs/262361 [09:33:58] it is running [09:34:41] 10Beta-Cluster-Infrastructure, 06Commons: Image uploads appear to be broken - https://phabricator.wikimedia.org/T365116 (10zoe) 03NEW [09:34:55] 10Beta-Cluster-Infrastructure, 06Commons: Image uploads appear to be broken on the beta cluster specifically - https://phabricator.wikimedia.org/T365116#9803663 (10zoe) [09:36:10] woohoo thanks hashar! [09:36:42] jelto gave me the link to that `apply-job` [09:37:46] 10Beta-Cluster-Infrastructure, 06Commons: Image uploads appear to be broken on the beta cluster specifically - https://phabricator.wikimedia.org/T365116#9803670 (10zoe) Whoops, I didn't mean to give it such an alarming title. I should proofread better, sorry about that. [09:41:15] 06Release-Engineering-Team, 06Infrastructure-Foundations, 06serviceops: Deprecate buster-backports - https://phabricator.wikimedia.org/T362518#9803683 (10Clement_Goubert) [09:43:26] 06Release-Engineering-Team: Per-page graphite metrics created for MediaWiki.rest_api_latency / rest_api_errors - https://phabricator.wikimedia.org/T365111#9803687 (10fgiunchedi) [09:43:41] hmm, seems like the trusted runners don't (yet?) appear under https://gitlab.wikimedia.org/repos/data-engineering/postgresql-kubernetes/-/settings/ci_cd (section "Runners"). I'm going to give it a few hours, assuming there's a systemd timer that needs to run somehwere [09:44:19] brouberol: or ask jelto I guess he would know :) [09:44:27] I don't know much about the gitlab infra unfortunately [09:45:30] no worries at all and thanks for the help already! [09:46:07] I can take a look in a sec [09:48:23] 06Release-Engineering-Team, 06Infrastructure-Foundations, 06serviceops: Deprecate buster-backports - https://phabricator.wikimedia.org/T362518#9803705 (10Clement_Goubert) Still left to either remove or rebuild: * base images ` docker-registry.wikimedia.org/docker-gc:1.0.0-20230402 [FAIL] docke... [09:50:14] appreciated thank you [09:57:42] The project ID is wrong, which is also visible in the diff. The diff mentions "Htriedman / rfc-parsing". Let me upload a fix with the correct project id [09:58:00] argh sorry .. I really should not have merged that one :-( [09:59:37] np, this diff looks better now :) https://gitlab.wikimedia.org/repos/releng/gitlab-trusted-runner/-/jobs/262372. Runner is also available now in https://gitlab.wikimedia.org/repos/data-engineering/postgresql-kubernetes/-/settings/ci_cd [10:02:36] \o/ [10:02:51] point taken: I should not mess up with that repository! [10:03:00] thank you jelto [10:03:47] no problem :) [10:11:22] I can confirm that the repo is now associated w/ trusted runners. Thank you all! [10:18:05] 10Gerrit: Create a code coverage plugin for polygerrit - https://phabricator.wikimedia.org/T183760#9803807 (10hashar) [10:18:31] Keep in mind that this runners accept jobs from protected branches or tags only. Also this have to be new commits. You cant run old jobs again on the Trusted Runners [10:25:29] 10Gerrit: Create a code coverage plugin for polygerrit - https://phabricator.wikimedia.org/T183760#9803826 (10hashar) [10:29:41] (03PS8) 10Arthur taylor: [WIP] Add parallel execution for PHPUnit extensions suite [integration/quibble] - 10https://gerrit.wikimedia.org/r/1031903 (https://phabricator.wikimedia.org/T361190) [10:53:39] 10Phabricator: Some project links inserted by searching don't work - https://phabricator.wikimedia.org/T365126 (10Sebastian_Berlin-WMSE) 03NEW [11:11:36] 10Phabricator: Active user accounts don't show up in advanced search when "Document Status" is "open" - https://phabricator.wikimedia.org/T365128 (10Sebastian_Berlin-WMSE) 03NEW [11:16:40] 10Beta-Cluster-Infrastructure, 06Commons: Image uploads appear to be broken on the beta cluster specifically - https://phabricator.wikimedia.org/T365116#9804066 (10TheresNoTime) Images on the beta cluster haven't been happy for a while :/ not sure if the above reported issue is a symptom of some/all: - {T3446... [11:37:59] (03PS1) 10Zoranzoki21: Zuul: [mediawiki/extensions/BlueSpiceInsertMagic] Archive extension [integration/config] - 10https://gerrit.wikimedia.org/r/1032447 (https://phabricator.wikimedia.org/T365127) [11:39:20] (03CR) 10CI reject: [V:04-1] Zuul: [mediawiki/extensions/BlueSpiceInsertMagic] Archive extension [integration/config] - 10https://gerrit.wikimedia.org/r/1032447 (https://phabricator.wikimedia.org/T365127) (owner: 10Zoranzoki21) [11:45:54] (03PS2) 10Zoranzoki21: Zuul: [mediawiki/extensions/BlueSpiceInsertMagic] Archive extension [integration/config] - 10https://gerrit.wikimedia.org/r/1032447 (https://phabricator.wikimedia.org/T365127) [11:46:05] (03PS3) 10Zoranzoki21: Zuul: [mediawiki/extensions/BlueSpiceInsertMagic] Archive extension [integration/config] - 10https://gerrit.wikimedia.org/r/1032447 (https://phabricator.wikimedia.org/T365127) [12:08:56] (03CR) 10Hashar: [C:03+2] Zuul: [mediawiki/extensions/BlueSpiceInsertMagic] Archive extension [integration/config] - 10https://gerrit.wikimedia.org/r/1032447 (https://phabricator.wikimedia.org/T365127) (owner: 10Zoranzoki21) [12:10:10] 10Phabricator (Search): Active user accounts don't show up in advanced search when "Document Status" is "open" - https://phabricator.wikimedia.org/T365128#9804200 (10Aklapper) p:05Triage→03Low It works for me when **not** setting the document type. (And I cannot reproduce in upstream.) [12:10:23] 10Phabricator (Search): Active user accounts don't show up in advanced search when setting "Document Type" to "User" (and "Document Status" to "open") - https://phabricator.wikimedia.org/T365128#9804206 (10Aklapper) [12:10:27] (03Merged) 10jenkins-bot: Zuul: [mediawiki/extensions/BlueSpiceInsertMagic] Archive extension [integration/config] - 10https://gerrit.wikimedia.org/r/1032447 (https://phabricator.wikimedia.org/T365127) (owner: 10Zoranzoki21) [12:12:35] (03CR) 10Hashar: [C:03+2] "Deployed" [integration/config] - 10https://gerrit.wikimedia.org/r/1032447 (https://phabricator.wikimedia.org/T365127) (owner: 10Zoranzoki21) [12:54:16] (03PS1) 10Novem Linguae: JSDoc: add 5 extensions/skins [integration/config] - 10https://gerrit.wikimedia.org/r/1032475 (https://phabricator.wikimedia.org/T138401) [12:57:26] (03PS1) 10Jforrester: Zuul: [mediawiki/extensions/WikiLambda] Add ULS as a dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1032476 [12:59:16] (03CR) 10Jforrester: [C:03+2] Zuul: [mediawiki/extensions/WikiLambda] Add ULS as a dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1032476 (owner: 10Jforrester) [13:00:53] (03Merged) 10jenkins-bot: Zuul: [mediawiki/extensions/WikiLambda] Add ULS as a dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1032476 (owner: 10Jforrester) [13:01:08] !log Zuul: [mediawiki/extensions/WikiLambda] Add ULS as a dependency [13:01:09] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [13:27:12] 10Scap: Backport: implement new criteria for relevant dependencies - https://phabricator.wikimedia.org/T365146 (10jnuche) 03NEW [13:28:23] 10Release-Engineering-Team (Yakisfaction), 10Scap: Backport: implement new criteria for relevant dependencies - https://phabricator.wikimedia.org/T365146#9804557 (10jnuche) [13:57:33] 06Release-Engineering-Team, 10dev-images, 10MediaWiki-Docker: APT errors when installing custom packages in MediaWiki-Docker - https://phabricator.wikimedia.org/T362702#9804769 (10Daimona) Seems like two of the errors have fixed themselves in the meantime, and only the last one remains: ` 3.632 E: The repos... [14:13:11] (03CR) 10Hashar: [C:03+2] JSDoc: add 5 extensions/skins [integration/config] - 10https://gerrit.wikimedia.org/r/1032475 (https://phabricator.wikimedia.org/T138401) (owner: 10Novem Linguae) [14:14:42] (03Merged) 10jenkins-bot: JSDoc: add 5 extensions/skins [integration/config] - 10https://gerrit.wikimedia.org/r/1032475 (https://phabricator.wikimedia.org/T138401) (owner: 10Novem Linguae) [14:15:28] (03CR) 10Hashar: [C:03+2] "Deployed" [integration/config] - 10https://gerrit.wikimedia.org/r/1032475 (https://phabricator.wikimedia.org/T138401) (owner: 10Novem Linguae) [14:37:36] 10Beta-Cluster-Infrastructure, 10MediaWiki-Platform-Team (SUL3): Set up sso.wikimedia.beta.wmflabs.org with config-layer routing to other wikis - https://phabricator.wikimedia.org/T365162 (10Tgr) 03NEW [14:37:44] 10Beta-Cluster-Infrastructure, 10MediaWiki-Platform-Team (SUL3): Set up sso.wikimedia.beta.wmflabs.org with config-layer routing to other wikis - https://phabricator.wikimedia.org/T365162#9805034 (10Tgr) [14:38:14] 10Beta-Cluster-Infrastructure, 06MediaWiki-Platform-Team, 05SUL3: Set up sso.wikimedia.beta.wmflabs.org with config-layer routing to other wikis - https://phabricator.wikimedia.org/T365162#9805042 (10Tgr) [14:41:22] (03CR) 10Hashar: "Adjustments look good but I have to test it :]" [software/gerrit] (deploy/wmf/stable-3.8) - 10https://gerrit.wikimedia.org/r/1026135 (https://phabricator.wikimedia.org/T363918) (owner: 10Paladox) [14:47:44] reimaging contint2002 now [14:48:09] jelto: Seems like the code should verify that the project path and project id match. [14:49:00] jelto: the add-project.py code, that is. [14:54:31] (03CR) 10Hashar: Allow users to recheck tests in checkers (031 comment) [software/gerrit] (deploy/wmf/stable-3.8) - 10https://gerrit.wikimedia.org/r/1026135 (https://phabricator.wikimedia.org/T363918) (owner: 10Paladox) [14:55:45] 06Release-Engineering-Team, 06Infrastructure-Foundations, 06serviceops: Deprecate buster-backports - https://phabricator.wikimedia.org/T362518#9805179 (10dancy) >>! In T362518#9803705, @Clement_Goubert wrote: > Still left to either remove or rebuild: > * base images > ` > docker-registry.wikimedia.org/docke... [14:55:52] (03PS22) 10Paladox: Allow users to recheck tests in checkers [software/gerrit] (deploy/wmf/stable-3.8) - 10https://gerrit.wikimedia.org/r/1026135 (https://phabricator.wikimedia.org/T363918) [14:56:09] (03CR) 10Paladox: Allow users to recheck tests in checkers (031 comment) [software/gerrit] (deploy/wmf/stable-3.8) - 10https://gerrit.wikimedia.org/r/1026135 (https://phabricator.wikimedia.org/T363918) (owner: 10Paladox) [14:56:27] (03CR) 10CI reject: [V:04-1] Allow users to recheck tests in checkers [software/gerrit] (deploy/wmf/stable-3.8) - 10https://gerrit.wikimedia.org/r/1026135 (https://phabricator.wikimedia.org/T363918) (owner: 10Paladox) [14:56:39] paladox: you are too fast :] [14:56:54] (03PS23) 10Paladox: Allow users to recheck tests in checkers [software/gerrit] (deploy/wmf/stable-3.8) - 10https://gerrit.wikimedia.org/r/1026135 (https://phabricator.wikimedia.org/T363918) [14:58:07] hashar: :D [14:59:24] also I guess the change can be passed to each of the functions instead of setting the changeNumber / patchsetNumber as object properties. But I don't think it matter so I did not mention it [14:59:27] we shall see [14:59:45] tomorrow I will look at writing tests to cover it [15:03:25] (03approved) 10jnuche: Add read timeout retries to resilient_df() [repos/releng/docker-gc] - 10https://gitlab.wikimedia.org/repos/releng/docker-gc/-/merge_requests/21 (https://phabricator.wikimedia.org/T350478 https://phabricator.wikimedia.org/T364521) (owner: 10dancy) [15:03:25] 10Release-Engineering-Team (Radar), 06collaboration-services, 13Patch-For-Review: upgrade contint servers to bullseye - https://phabricator.wikimedia.org/T334517#9805239 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by dzahn@cumin2002 for host contint2002.wikimedia.org with OS bullseye [15:03:55] (03merge) 10dancy: Add read timeout retries to resilient_df() [repos/releng/docker-gc] - 10https://gitlab.wikimedia.org/repos/releng/docker-gc/-/merge_requests/21 (https://phabricator.wikimedia.org/T350478 https://phabricator.wikimedia.org/T364521) [15:04:54] (03open) 10dancy: Release 1.3.0 [repos/releng/docker-gc] - 10https://gitlab.wikimedia.org/repos/releng/docker-gc/-/merge_requests/22 [15:05:39] (03merge) 10dancy: Release 1.3.0 [repos/releng/docker-gc] - 10https://gitlab.wikimedia.org/repos/releng/docker-gc/-/merge_requests/22 [15:13:54] (03CR) 10Ahmon Dancy: [C:03+2] "James F said this looks ok in IRC. Moving forward." [integration/config] - 10https://gerrit.wikimedia.org/r/1028900 (https://phabricator.wikimedia.org/T282893) (owner: 10Ahmon Dancy) [15:15:18] (03Merged) 10jenkins-bot: Add protection against running docker with a nonexistent host path [integration/config] - 10https://gerrit.wikimedia.org/r/1028900 (https://phabricator.wikimedia.org/T282893) (owner: 10Ahmon Dancy) [15:15:30] !log Updating many Jenkins jobs for https://gerrit.wikimedia.org/r/c/integration/config/+/1028900 (T282893) [15:15:34] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [15:15:35] T282893: Various CI jobs failing after "mkdir: cannot create directory ‘log’: Permission denied" - https://phabricator.wikimedia.org/T282893 [15:19:48] Project mediawiki-core-doxygen build #1091: 04FAILURE in 1 min 43 sec: https://integration.wikimedia.org/ci/job/mediawiki-core-doxygen/1091/ [15:21:20] ooh, the first victim of the new check [15:21:25] * dancy investigates [15:25:00] 10Release-Engineering-Team (Radar), 06collaboration-services, 13Patch-For-Review: upgrade contint servers to bullseye - https://phabricator.wikimedia.org/T334517#9805353 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by dzahn@cumin2002 for host contint2002.wikimedia.org with OS bullseye... [15:25:46] 10Release-Engineering-Team (Radar), 06collaboration-services, 13Patch-For-Review: upgrade contint servers to bullseye - https://phabricator.wikimedia.org/T334517#9805356 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by dzahn@cumin2002 for host contint2002.wikimedia.org with OS bullseye [15:29:16] (03PS1) 10Ahmon Dancy: doxygen-publish job: Add docker-cache-dir to builders [integration/config] - 10https://gerrit.wikimedia.org/r/1032515 (https://phabricator.wikimedia.org/T282893) [15:31:06] (03CR) 10Ahmon Dancy: [C:03+2] "I'm going to merge and deploy this right away but still would like y'all to look at this and consider the question of having docker-run-wi" [integration/config] - 10https://gerrit.wikimedia.org/r/1032515 (https://phabricator.wikimedia.org/T282893) (owner: 10Ahmon Dancy) [15:32:50] (03Merged) 10jenkins-bot: doxygen-publish job: Add docker-cache-dir to builders [integration/config] - 10https://gerrit.wikimedia.org/r/1032515 (https://phabricator.wikimedia.org/T282893) (owner: 10Ahmon Dancy) [15:33:30] !log Updated Jenkins doxygen-publish job for https://gerrit.wikimedia.org/r/c/integration/config/+/1032515 (T282893) [15:33:33] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [15:33:33] T282893: Various CI jobs failing after "mkdir: cannot create directory ‘log’: Permission denied" - https://phabricator.wikimedia.org/T282893 [15:42:57] (03PS1) 10Ahmon Dancy: diff2changelog: Fix use of ANSI codes [integration/config] - 10https://gerrit.wikimedia.org/r/1032521 [15:43:19] (03PS2) 10Ahmon Dancy: diff2changelog: Fix use of ANSI codes [integration/config] - 10https://gerrit.wikimedia.org/r/1032521 [15:57:02] is there a way to kick blubber? I've been building with it locally `docker build` on my Mac and it doesn't seem to be picking up changes anymore [15:57:46] tried restarting the docker daemon and removing the images from `docker image ls` [16:10:17] (03PS1) 10Ahmon Dancy: docker-run-with-log-cache-src builder: mkdir cache [integration/config] - 10https://gerrit.wikimedia.org/r/1032528 [16:10:46] (03CR) 10Ahmon Dancy: [C:03+2] docker-run-with-log-cache-src builder: mkdir cache [integration/config] - 10https://gerrit.wikimedia.org/r/1032528 (owner: 10Ahmon Dancy) [16:12:01] inflatador: You already tried passing `--no-cache` on the build command line? [16:12:12] (03Merged) 10jenkins-bot: docker-run-with-log-cache-src builder: mkdir cache [integration/config] - 10https://gerrit.wikimedia.org/r/1032528 (owner: 10Ahmon Dancy) [16:22:50] (03CR) 10Jforrester: "Hmm. Maybe combining into the run-with would be good in general, yes. It probably makes sense to collapse many of the builders into one co" [integration/config] - 10https://gerrit.wikimedia.org/r/1032515 (https://phabricator.wikimedia.org/T282893) (owner: 10Ahmon Dancy) [16:23:36] (03CR) 10Jforrester: [C:03+2] diff2changelog: Fix use of ANSI codes [integration/config] - 10https://gerrit.wikimedia.org/r/1032521 (owner: 10Ahmon Dancy) [16:25:14] (03Merged) 10jenkins-bot: diff2changelog: Fix use of ANSI codes [integration/config] - 10https://gerrit.wikimedia.org/r/1032521 (owner: 10Ahmon Dancy) [16:26:11] dancy yeah, that doesn't seem to be working. Let me try killing docker completely [16:26:23] Try `docker buildx prune` [16:28:15] Yippee, build fixed! [16:28:15] Project mediawiki-core-doxygen build #1092: 09FIXED in 10 min: https://integration.wikimedia.org/ci/job/mediawiki-core-doxygen/1092/ [16:29:56] that deleted a bunch of files...still seems to be building suspiciously quickly though. Let me peep inside the container [16:32:02] (03PS2) 10Jforrester: Zuul: Make unused in-mediawiki-tarball target php81 [integration/config] - 10https://gerrit.wikimedia.org/r/1020364 [16:32:03] (03PS2) 10Jforrester: Zuul: Migrate default quibble-…-selenium jobs from php74 to php81 [integration/config] - 10https://gerrit.wikimedia.org/r/1020362 [16:32:03] (03PS2) 10Jforrester: Zuul: Make default noselenium job run php81, not php74 [integration/config] - 10https://gerrit.wikimedia.org/r/1020363 [16:32:29] (03PS1) 10Ahmon Dancy: Create cache and log dirs where needed [integration/config] - 10https://gerrit.wikimedia.org/r/1032534 (https://phabricator.wikimedia.org/T282893) [16:32:40] hmm, still there. I'm gonna assume PEBKAC or something specific to Mac docker for now [16:33:24] (03CR) 10CI reject: [V:04-1] Zuul: Migrate default quibble-…-selenium jobs from php74 to php81 [integration/config] - 10https://gerrit.wikimedia.org/r/1020362 (owner: 10Jforrester) [16:33:27] (03CR) 10CI reject: [V:04-1] Zuul: Make default noselenium job run php81, not php74 [integration/config] - 10https://gerrit.wikimedia.org/r/1020363 (owner: 10Jforrester) [16:33:52] 10Beta-Cluster-Infrastructure, 06serviceops, 13Patch-Needs-Improvement: Implement API Gateway solution for deployment-prep - https://phabricator.wikimedia.org/T254917#9805756 (10Aklapper) a:05hnowlan→03None @hnowlan: Removing task assignee as this open task has been assigned for more than two years - se... [16:34:02] (03CR) 10Ahmon Dancy: [C:03+2] "Based on some CI failures I ended up with https://gerrit.wikimedia.org/r/c/integration/config/+/1032534" [integration/config] - 10https://gerrit.wikimedia.org/r/1032515 (https://phabricator.wikimedia.org/T282893) (owner: 10Ahmon Dancy) [16:34:17] (03CR) 10Ahmon Dancy: "This change is live" [integration/config] - 10https://gerrit.wikimedia.org/r/1032534 (https://phabricator.wikimedia.org/T282893) (owner: 10Ahmon Dancy) [16:35:45] (03update) 10dancy: Simplify logic in PythonConfig.InstructionsForPhase() [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/80 [16:42:04] 10Release-Engineering-Team (Radar), 06collaboration-services: upgrade contint servers to bullseye - https://phabricator.wikimedia.org/T334517#9805937 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by dzahn@cumin2002 for host contint2002.wikimedia.org with OS bullseye [16:43:28] (03CR) 10Jforrester: Create cache and log dirs where needed (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/1032534 (https://phabricator.wikimedia.org/T282893) (owner: 10Ahmon Dancy) [16:43:54] looks like running prune twice did the trick? IDK [16:49:12] (03CR) 10Jforrester: [C:03+2] Zuul: Make unused in-mediawiki-tarball target php81 [integration/config] - 10https://gerrit.wikimedia.org/r/1020364 (owner: 10Jforrester) [16:50:04] 10Release-Engineering-Team (Priority Backlog 📥), 10Release Pipeline (Blubber): deploy.sh in operations/deployment-charts does not work - https://phabricator.wikimedia.org/T305033#9806031 (10Aklapper) a:05thcipriani→03None @thcipriani: Removing task assignee as this open task has been assigned for more than... [16:50:39] 10Deployments, 10Release-Engineering-Team (Priority Backlog 📥): Deployment calendar: MediaWiki branch cut reported as between 3-4 AM UTC but actually it seems to be between 2-3 AM - https://phabricator.wikimedia.org/T297724#9806034 (10Aklapper) a:05thcipriani→03None @thcipriani: Removing task assignee as t... [16:50:40] (03Merged) 10jenkins-bot: Zuul: Make unused in-mediawiki-tarball target php81 [integration/config] - 10https://gerrit.wikimedia.org/r/1020364 (owner: 10Jforrester) [16:50:41] 10Release-Engineering-Team (Yakisfaction), 10Scap: scap should have a better error message when it can't find keyholder key - https://phabricator.wikimedia.org/T313624#9806046 (10Sandeeps) To verify scap behavior and error messaging when it cannot find the specified keyholder key, and to confirm if scap retrie... [16:53:51] 10Release-Engineering-Team (Onboarding 🚀), 10Scap: Fatal scap error messages should include the version of scap that is running - https://phabricator.wikimedia.org/T311080#9806087 (10Sandeeps) 05Open→03In progress [16:54:53] 10Release-Engineering-Team (Onboarding 🚀), 10Scap: Fatal scap error messages should include the version of scap that is running - https://phabricator.wikimedia.org/T311080#9806105 (10Sandeeps) a:03Sandeeps [16:56:28] 10Phabricator, 10Release-Engineering-Team (Priority Backlog 📥): Decrease number of open Phab tickets with assignee field set for more than two years (aka cookie licking) (Q4/2024 edition) - https://phabricator.wikimedia.org/T365183 (10Aklapper) 03NEW p:05Triage→03Low [16:57:22] 10Phabricator, 10Release-Engineering-Team (Yakisfaction): Decrease number of open Phab tickets with assignee field set for more than two years (aka cookie licking) (Q2/2024 edition) - https://phabricator.wikimedia.org/T351691#9806144 (10Aklapper) 05Open→03In progress [16:57:44] 10Release-Engineering-Team (Radar), 06collaboration-services: upgrade contint servers to bullseye - https://phabricator.wikimedia.org/T334517#9806146 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by dzahn@cumin2002 for host contint2002.wikimedia.org with OS bullseye executed with errors:... [16:59:06] 10Release-Engineering-Team (Radar), 06collaboration-services: upgrade contint servers to bullseye - https://phabricator.wikimedia.org/T334517#9806169 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by dzahn@cumin2002 for host contint2002.wikimedia.org with OS buster [17:01:54] (03approved) 10jforrester: Add support for .bananaconfig.json files [repos/ci-tools/banana-checker] (warn) - 10https://gitlab.wikimedia.org/repos/ci-tools/banana-checker/-/merge_requests/15 (https://phabricator.wikimedia.org/T364843) (owner: 10esanders) [17:01:58] (03update) 10jforrester: Downgrade errors with translated data (in default config) to warnings [repos/ci-tools/banana-checker] - 10https://gitlab.wikimedia.org/repos/ci-tools/banana-checker/-/merge_requests/13 (https://phabricator.wikimedia.org/T364727) (owner: 10esanders) [17:01:59] (03update) 10esanders: Major config refactor [repos/ci-tools/banana-checker] (warn) - 10https://gitlab.wikimedia.org/repos/ci-tools/banana-checker/-/merge_requests/16 (https://phabricator.wikimedia.org/T364843) [17:02:03] (03update) 10esanders: Major config refactor [repos/ci-tools/banana-checker] (warn) - 10https://gitlab.wikimedia.org/repos/ci-tools/banana-checker/-/merge_requests/16 (https://phabricator.wikimedia.org/T364843) [17:02:25] 10Continuous-Integration-Infrastructure: Create WMF CI images and jobs for Node.js 20 - https://phabricator.wikimedia.org/T343826#9806199 (10KartikMistry) Thanks @hashar T362681 was the task for Nodejs 20 image creation for production. [17:08:04] 10Continuous-Integration-Config, 10Toolhub, 07Documentation: Publish docs on doc.wikimedia.org - https://phabricator.wikimedia.org/T305914#9806260 (10Aklapper) a:05Slst2020→03None @Slst2020: Removing task assignee as this open task has been assigned for more than two years - see the email sent to all tas... [17:11:44] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Priority Backlog 📥): Change notification email from jenkins-bot@wikimedia.org to releng internal list - https://phabricator.wikimedia.org/T151642#9806308 (10Aklapper) a:05hashar→03None @hashar: Removing task assignee as this open task has... [17:13:09] 10Phabricator, 10Release-Engineering-Team (Yakisfaction): Decrease number of open Phab tickets with assignee field set for more than two years (aka cookie licking) (Q2/2024 edition) - https://phabricator.wikimedia.org/T351691#9806357 (10Aklapper) 05In progress→03Resolved Unassigned 190 tasks from 96 ta... [17:13:48] (03merge) 10jforrester: Downgrade errors with translated data (in default config) to warnings [repos/ci-tools/banana-checker] - 10https://gitlab.wikimedia.org/repos/ci-tools/banana-checker/-/merge_requests/13 (https://phabricator.wikimedia.org/T364727) (owner: 10esanders) [17:13:49] (03update) 10esanders: Major config refactor [repos/ci-tools/banana-checker] - 10https://gitlab.wikimedia.org/repos/ci-tools/banana-checker/-/merge_requests/16 (https://phabricator.wikimedia.org/T364843) [17:13:53] (03update) 10esanders: Major config refactor [repos/ci-tools/banana-checker] - 10https://gitlab.wikimedia.org/repos/ci-tools/banana-checker/-/merge_requests/16 (https://phabricator.wikimedia.org/T364843) [17:16:50] (03approved) 10jforrester: Major config refactor [repos/ci-tools/banana-checker] - 10https://gitlab.wikimedia.org/repos/ci-tools/banana-checker/-/merge_requests/16 (https://phabricator.wikimedia.org/T364843) (owner: 10esanders) [17:16:53] (03merge) 10jforrester: Major config refactor [repos/ci-tools/banana-checker] - 10https://gitlab.wikimedia.org/repos/ci-tools/banana-checker/-/merge_requests/16 (https://phabricator.wikimedia.org/T364843) (owner: 10esanders) [17:16:54] (03update) 10esanders: Improve formatting of error messages [repos/ci-tools/banana-checker] - 10https://gitlab.wikimedia.org/repos/ci-tools/banana-checker/-/merge_requests/17 [17:16:58] (03update) 10esanders: Improve formatting of error messages [repos/ci-tools/banana-checker] - 10https://gitlab.wikimedia.org/repos/ci-tools/banana-checker/-/merge_requests/17 [17:18:00] (03merge) 10jforrester: Improve formatting of error messages [repos/ci-tools/banana-checker] - 10https://gitlab.wikimedia.org/repos/ci-tools/banana-checker/-/merge_requests/17 (owner: 10esanders) [17:22:26] (03open) 10jforrester: Release v0.13.0 [repos/ci-tools/banana-checker] - 10https://gitlab.wikimedia.org/repos/ci-tools/banana-checker/-/merge_requests/18 [17:38:05] (03PS3) 10Jforrester: Zuul: Migrate default quibble-…-selenium jobs from php74 to php81 [integration/config] - 10https://gerrit.wikimedia.org/r/1020362 [17:52:12] !log running a no-op test deployment to phab2002 to reproduce errors for T313624 [17:52:15] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [17:52:17] T313624: scap should have a better error message when it can't find keyholder key - https://phabricator.wikimedia.org/T313624 [17:54:18] (03approved) 10esanders: Release v0.13.0 [repos/ci-tools/banana-checker] - 10https://gitlab.wikimedia.org/repos/ci-tools/banana-checker/-/merge_requests/18 (owner: 10jforrester) [17:54:45] (03merge) 10esanders: Release v0.13.0 [repos/ci-tools/banana-checker] - 10https://gitlab.wikimedia.org/repos/ci-tools/banana-checker/-/merge_requests/18 (owner: 10jforrester) [18:00:29] (03open) 10jforrester: releases: Upgrade grunt-banana-config to 0.13.0 [repos/ci-tools/libup-config] - 10https://gitlab.wikimedia.org/repos/ci-tools/libup-config/-/merge_requests/12 [18:01:23] 10Release-Engineering-Team (Yakisfaction), 10Scap: scap should have a better error message when it can't find keyholder key - https://phabricator.wikimedia.org/T313624#9806484 (10brennen) A full log of the discussion that led to this task is here: https://wm-bot.wmcloud.org/browser/index.php?start=07%2F22%2F2... [18:04:34] 10Release-Engineering-Team (Yakisfaction), 10Scap: scap should have a better error message when it can't find keyholder key - https://phabricator.wikimedia.org/T313624#9806488 (10brennen) One additional question: Are there any deployment repos currently where scap does not find a key, but the deployment succe... [18:05:02] 10Release-Engineering-Team (Radar), 06collaboration-services: upgrade contint servers to bullseye - https://phabricator.wikimedia.org/T334517#9806489 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by dzahn@cumin2002 for host contint2002.wikimedia.org with OS buster executed with errors: -... [18:11:41] (03approved) 10esanders: releases: Upgrade grunt-banana-config to 0.13.0 [repos/ci-tools/libup-config] - 10https://gitlab.wikimedia.org/repos/ci-tools/libup-config/-/merge_requests/12 (owner: 10jforrester) [18:11:47] (03merge) 10esanders: releases: Upgrade grunt-banana-config to 0.13.0 [repos/ci-tools/libup-config] - 10https://gitlab.wikimedia.org/repos/ci-tools/libup-config/-/merge_requests/12 (owner: 10jforrester) [18:12:22] (03CR) 10Ahmon Dancy: Create cache and log dirs where needed (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/1032534 (https://phabricator.wikimedia.org/T282893) (owner: 10Ahmon Dancy) [18:12:32] (03CR) 10Ahmon Dancy: [C:03+2] Create cache and log dirs where needed [integration/config] - 10https://gerrit.wikimedia.org/r/1032534 (https://phabricator.wikimedia.org/T282893) (owner: 10Ahmon Dancy) [18:13:31] (03update) 10matmarex: Draft: OAuth: Authorize in a popup without reloading the page [repos/ci-tools/patchdemo] - 10https://gitlab.wikimedia.org/repos/ci-tools/patchdemo/-/merge_requests/615 [18:13:59] (03Merged) 10jenkins-bot: Create cache and log dirs where needed [integration/config] - 10https://gerrit.wikimedia.org/r/1032534 (https://phabricator.wikimedia.org/T282893) (owner: 10Ahmon Dancy) [18:17:22] 10Release-Engineering-Team (Radar), 06collaboration-services: upgrade contint servers to bullseye - https://phabricator.wikimedia.org/T334517#9806543 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by dzahn@cumin2002 for host contint2002.wikimedia.org with OS bullseye [18:19:10] 10Scap: Proposal for refactoring of backport dependency handling - https://phabricator.wikimedia.org/T362987#9806559 (10jeena) I'm wondering if we want to change the terminology of 'Production branch' to 'Active branch' to match the terminology that is all over scap (active wikiversions, etc.)? [18:21:27] 10Continuous-Integration-Infrastructure, 07Jenkins, 10Release-Engineering-Team (Priority Backlog 📥), 07ci-test-error, and 2 others: Various CI jobs failing after "mkdir: cannot create directory ‘log’: Permission denied" - https://phabricator.wikimedia.org/T282893#9806566 (10dancy) Deployment of https://ger... [18:44:57] (03update) 10jhuneidi: backport.py: Restore included_in branches check [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/270 (https://phabricator.wikimedia.org/T360291) [18:47:00] (03update) 10jhuneidi: backport.py: Restore included_in branches check [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/270 (https://phabricator.wikimedia.org/T360291) [18:51:50] (03update) 10jhuneidi: backport.py: Restore included_in branches check [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/270 (https://phabricator.wikimedia.org/T360291) [18:53:50] (03update) 10matmarex: Draft: OAuth: Authorize in a popup without reloading the page [repos/ci-tools/patchdemo] - 10https://gitlab.wikimedia.org/repos/ci-tools/patchdemo/-/merge_requests/615 [18:54:12] (03merge) 10brennen: Define path as "phabricator/" rather than "phorge/" [repos/phabricator/arcanist] (wmf/stable) - 10https://gitlab.wikimedia.org/repos/phabricator/arcanist/-/merge_requests/2 (https://phabricator.wikimedia.org/T364426) (owner: 10pppery) [18:54:22] 10Phabricator (2024-05-14), 10Release-Engineering-Team (Yakisfaction), 10Wikimedia-Phabricator-Extensions: Make WMF's Phabricator Translations extension work with an upstream Phorge installation - https://phabricator.wikimedia.org/T364426#9806656 (10CodeReviewBot) brennen merged https://gitlab.wikimedia.... [18:58:17] 10Release-Engineering-Team (Radar), 06collaboration-services: upgrade contint servers to bullseye - https://phabricator.wikimedia.org/T334517#9806659 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by dzahn@cumin2002 for host contint2002.wikimedia.org with OS buster [18:59:08] 10Release-Engineering-Team (Yakisfaction), 10Scap: scap should have a better error message when it can't find keyholder key - https://phabricator.wikimedia.org/T313624#9806660 (10Sandeeps) @brennen In my case on Scap3-dev env if Scap doesn't find a key it tries to do ssh without a key, and yes it succeeding th... [19:30:02] 10Release-Engineering-Team (Yakisfaction), 05Release, 05Train Deployments: 1.43.0-wmf.5 deployment blockers - https://phabricator.wikimedia.org/T361399#9806772 (10hashar) 05Open→03Resolved [19:30:16] thcipriani: jeena: andre: I have marked the train blocker task resolved cause nothing is happening as far as I can tell :) [19:30:45] 👍 [19:31:05] hashar: <3 [19:50:55] (03open) 10dancy: Makefile fixes [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/81 [19:50:58] (03update) 10dancy: Makefile fixes [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/81 [19:55:26] 10Release-Engineering-Team (Radar), 06collaboration-services: upgrade contint servers to bullseye - https://phabricator.wikimedia.org/T334517#9806829 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by dzahn@cumin1002 for host contint2002.wikimedia.org with OS bullseye [19:56:10] (03merge) 10dancy: Makefile fixes [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/81 [19:59:33] (03update) 10dancy: Simplify logic in PythonConfig.InstructionsForPhase() [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/80 [19:59:34] (03update) 10dancy: Simplify logic in PythonConfig.InstructionsForPhase() v2.0 [repos/releng/blubber] (main-If96a81c08a71c74659e41849f7cad058a6b0b362) - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/82 [19:59:34] (03open) 10dancy: Simplify logic in PythonConfig.InstructionsForPhase() v2.0 [repos/releng/blubber] (main-If96a81c08a71c74659e41849f7cad058a6b0b362) - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/82 [19:59:34] (03update) 10dancy: Python builder: Add virtualenv support [repos/releng/blubber] (main-I001b43a7699499d5057762eb52df9d936c0dd066) - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/83 (https://phabricator.wikimedia.org/T357548) [19:59:35] (03open) 10dancy: Python builder: Add virtualenv support [repos/releng/blubber] (main-I001b43a7699499d5057762eb52df9d936c0dd066) - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/83 (https://phabricator.wikimedia.org/T357548) [19:59:37] (03update) 10dancy: Simplify logic in PythonConfig.InstructionsForPhase() v2.0 [repos/releng/blubber] (main-If96a81c08a71c74659e41849f7cad058a6b0b362) - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/82 [19:59:41] (03update) 10dancy: Python builder: Add virtualenv support [repos/releng/blubber] (main-I001b43a7699499d5057762eb52df9d936c0dd066) - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/83 (https://phabricator.wikimedia.org/T357548) [19:59:45] (03update) 10dancy: Simplify logic in PythonConfig.InstructionsForPhase() [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/80 [20:01:21] 10Release-Engineering-Team (Yakisfaction), 13Patch-For-Review: Blubber Python builder: Support virtualenv setup - https://phabricator.wikimedia.org/T357548#9806837 (10CodeReviewBot) dancy opened https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/83 Python builder: Add virtualenv support [20:05:03] (03update) 10jhuneidi: backport.py: Restore included_in branches check [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/270 (https://phabricator.wikimedia.org/T360291) [20:06:43] (03update) 10jhuneidi: backport.py: Restore included_in branches check [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/270 (https://phabricator.wikimedia.org/T360291 https://phabricator.wikimedia.org/T362987) [20:06:51] 10Scap: Proposal for refactoring of backport dependency handling - https://phabricator.wikimedia.org/T362987#9806876 (10CodeReviewBot) jhuneidi updated https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/270 backport.py: Restore included_in branches check [20:09:56] (03update) 10jhuneidi: backport.py: Restore included_in branches check [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/270 (https://phabricator.wikimedia.org/T360291 https://phabricator.wikimedia.org/T362987) [20:13:25] (03update) 10dancy: Python builder: Add virtualenv support [repos/releng/blubber] (main-I001b43a7699499d5057762eb52df9d936c0dd066) - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/83 (https://phabricator.wikimedia.org/T357548) [20:15:37] 10Gerrit: Proxy error on /changes/conflicts - https://phabricator.wikimedia.org/T365198 (10Reedy) 03NEW [20:16:16] 10Gerrit: Proxy error on /changes/conflicts - https://phabricator.wikimedia.org/T365198#9806925 (10Reedy) The fact that it is being shown verbatim as the above is "fun" too... [20:21:59] (03update) 10dancy: Simplify logic in PythonConfig.InstructionsForPhase() v2.0 [repos/releng/blubber] (main-If96a81c08a71c74659e41849f7cad058a6b0b362) - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/82 [20:22:21] (03update) 10dancy: Python builder: Add virtualenv support [repos/releng/blubber] (main-I001b43a7699499d5057762eb52df9d936c0dd066) - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/83 (https://phabricator.wikimedia.org/T357548) [20:23:36] 10Release-Engineering-Team (Yakisfaction), 13Patch-For-Review: Blubber Python builder: Support virtualenv setup - https://phabricator.wikimedia.org/T357548#9806930 (10dancy) 05Open→03In progress [20:30:46] (03update) 10jhuneidi: backport.py: Restore included_in branches check [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/270 (https://phabricator.wikimedia.org/T360291 https://phabricator.wikimedia.org/T362987) [20:31:50] (03update) 10jhuneidi: backport.py: Restore included_in branches check [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/270 (https://phabricator.wikimedia.org/T360291 https://phabricator.wikimedia.org/T362987) [20:33:15] 10Release-Engineering-Team (Radar), 06collaboration-services: upgrade contint servers to bullseye - https://phabricator.wikimedia.org/T334517#9806957 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by dzahn@cumin1002 for host contint2002.wikimedia.org with OS bullseye completed: - contint20... [20:35:54] 10Release-Engineering-Team (Radar), 06collaboration-services: upgrade contint servers to bullseye - https://phabricator.wikimedia.org/T334517#9806961 (10Dzahn) [20:38:07] 10Release-Engineering-Team (Radar), 06collaboration-services: upgrade contint servers to bullseye - https://phabricator.wikimedia.org/T334517#9806962 (10Dzahn) After a couple problems with reimaging (networking config via DHCP in Debian installer failing due to networking changes, RAID setup failure due to cha... [20:39:08] 10Release-Engineering-Team (Radar), 06collaboration-services: upgrade contint servers to bullseye - https://phabricator.wikimedia.org/T334517#9806964 (10Dzahn) 05In progress→03Resolved [20:57:48] (03approved) 10dduvall: Simplify logic in PythonConfig.InstructionsForPhase() [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/80 (owner: 10dancy) [21:00:11] (03approved) 10dduvall: Simplify logic in PythonConfig.InstructionsForPhase() v2.0 [repos/releng/blubber] (main-If96a81c08a71c74659e41849f7cad058a6b0b362) - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/82 (owner: 10dancy) [21:40:59] (03open) 10bking: data-engineering: Add airflow image repository [repos/releng/gitlab-trusted-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-trusted-runner/-/merge_requests/76 (https://phabricator.wikimedia.org/T363000) [21:44:03] (03merge) 10dancy: Simplify logic in PythonConfig.InstructionsForPhase() [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/80 [21:44:07] (03update) 10dancy: Simplify logic in PythonConfig.InstructionsForPhase() v2.0 [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/82 [21:44:11] (03update) 10dancy: Simplify logic in PythonConfig.InstructionsForPhase() v2.0 [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/82 [21:44:36] (03update) 10dancy: Python builder: Add virtualenv support [repos/releng/blubber] (main-I001b43a7699499d5057762eb52df9d936c0dd066) - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/83 (https://phabricator.wikimedia.org/T357548) [21:48:36] (03merge) 10dancy: Simplify logic in PythonConfig.InstructionsForPhase() v2.0 [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/82 [21:48:39] (03update) 10dancy: Python builder: Add virtualenv support [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/83 (https://phabricator.wikimedia.org/T357548) [21:48:42] (03update) 10dancy: Python builder: Add virtualenv support [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/83 (https://phabricator.wikimedia.org/T357548) [22:05:18] (03open) 10matmarex: Update OOUI to 0.49.1 [repos/ci-tools/patchdemo] - 10https://gitlab.wikimedia.org/repos/ci-tools/patchdemo/-/merge_requests/616 [22:50:41] (03open) 10dancy: add-project.py: Pagination, phase 1 [repos/releng/gitlab-trusted-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-trusted-runner/-/merge_requests/77 [22:50:43] (03update) 10dancy: add-project.py: Pagination, phase 1 [repos/releng/gitlab-trusted-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-trusted-runner/-/merge_requests/77 [22:51:18] (03update) 10dancy: add-project.py: Pagination, phase 1 [repos/releng/gitlab-trusted-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-trusted-runner/-/merge_requests/77 [23:20:24] 10Release-Engineering-Team (Yakisfaction), 10Scap: Backport: implement new criteria for relevant dependencies - https://phabricator.wikimedia.org/T365146#9807391 (10jeena) a:03jeena [23:38:58] Managed to finished the new mobile nav for gerrit: https://gerrit-review.googlesource.com/c/gerrit/+/425857 [23:39:08] Logged out view: https://imgur.com/a/logout-gerrit-view-PL3L2ON [23:39:09] Logged in view: https://imgur.com/a/logged-gerrit-view-My5adWl [23:43:24] Project beta-code-update-eqiad build #496038: 04FAILURE in 23 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/496038/ [23:55:17] Yippee, build fixed! [23:55:17] Project beta-code-update-eqiad build #496039: 09FIXED in 2 min 16 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/496039/