[00:00:36] FIRING: DatasourceError: Queue (Jenkins jobs + Zuul functions) alert - https://grafana.wikimedia.org/alerting/grafana/iS0FSjJ4z/view - https://wikitech.wikimedia.org/wiki/Monitoring/DatasourceError - https://alerts.wikimedia.org/?q=alertname%3DDatasourceError [00:05:36] RESOLVED: DatasourceError: Queue (Jenkins jobs + Zuul functions) alert - https://grafana.wikimedia.org/alerting/grafana/iS0FSjJ4z/view - https://wikitech.wikimedia.org/wiki/Monitoring/DatasourceError - https://alerts.wikimedia.org/?q=alertname%3DDatasourceError [07:43:48] 10Phabricator (Upstream), 07Upstream: Display warning about commenting on a task already closed as duplicate - https://phabricator.wikimedia.org/T354769#9891602 (10Aklapper) 05Open→03Stalled [07:54:32] 10Continuous-Integration-Config, 10MediaWiki-extensions-CommunityConfiguration, 10Growth-Team (Sprint 16 (Growth Team)): Make CommunityConfiguration a gated extension - https://phabricator.wikimedia.org/T366696#9891630 (10Urbanecm_WMF) 05Open→03Resolved a:03Urbanecm_WMF [07:54:37] 10Continuous-Integration-Config, 10MediaWiki-extensions-CommunityConfiguration, 10Growth-Team (Sprint 16 (Growth Team)): Make CommunityConfiguration a gated extension - https://phabricator.wikimedia.org/T366696#9891633 (10Urbanecm_WMF) [08:26:38] (03PS2) 10Hashar: jjb: remove eventgate-wikimedia and eventstreams [integration/config] - 10https://gerrit.wikimedia.org/r/1043187 (https://phabricator.wikimedia.org/T344730) (owner: 10Snwachukwu) [08:30:11] (03CR) 10Hashar: [C:03+2] "I have normalized the commit message to make it closer to what we are used to :) Thanks for the patch!" [integration/config] - 10https://gerrit.wikimedia.org/r/1043187 (https://phabricator.wikimedia.org/T344730) (owner: 10Snwachukwu) [08:31:39] (03Merged) 10jenkins-bot: jjb: remove eventgate-wikimedia and eventstreams [integration/config] - 10https://gerrit.wikimedia.org/r/1043187 (https://phabricator.wikimedia.org/T344730) (owner: 10Snwachukwu) [08:44:16] 10GitLab (CI & Job Runners), 06collaboration-services: GitLabCIJobErrors - https://phabricator.wikimedia.org/T367341#9891711 (10Jelto) 05Open→03Resolved This should be fixed with the change above. We ignore user-generated `script_failures` in the alert now. [08:49:16] (03PS1) 10Kevin Bazira: inference-services: add CI jobs for articlequality model-server [integration/config] - 10https://gerrit.wikimedia.org/r/1043661 (https://phabricator.wikimedia.org/T360455) [08:51:32] kevinbazira: :) [08:51:36] I will deploy that right now [08:52:13] hashar: o/ [08:52:23] great. thank you! :) [08:53:10] INFO:jenkins_jobs.builder:Reconfiguring jenkins job inference-services-pipeline-articlequality [08:53:11] hmm [08:53:17] a job by that name existed already [08:54:38] kevinbazira: the articlequality one was previously removed by https://gerrit.wikimedia.org/r/c/integration/config/+/868437 [08:55:08] I guess it is coming back afterall [08:56:34] (03CR) 10Hashar: [C:03+2] inference-services: add CI jobs for articlequality model-server [integration/config] - 10https://gerrit.wikimedia.org/r/1043661 (https://phabricator.wikimedia.org/T360455) (owner: 10Kevin Bazira) [08:58:04] (03Merged) 10jenkins-bot: inference-services: add CI jobs for articlequality model-server [integration/config] - 10https://gerrit.wikimedia.org/r/1043661 (https://phabricator.wikimedia.org/T360455) (owner: 10Kevin Bazira) [08:58:31] hashar: yep. revscoring language-specific articlequality models are being phased out and a new language-agnostic articlequality model has been developed by the Research team. the ML team is working on hosting it and that's why we've created this job. Please see more details in: https://phabricator.wikimedia.org/T362598 [08:58:53] ah so the name is reused [08:59:06] ** correct link: https://phabricator.wikimedia.org/T360455 [08:59:17] yes yes, the name is reused [08:59:29] I have deployed it [08:59:49] thanks a lot for your help! [08:59:52] so you can comment `recheck` on whatever change has the new articlequality image and that should run the jobs [08:59:55] \o: [08:59:58] \o/ [09:00:09] super! [09:02:59] (03PS3) 10Jack Phoenix: zuul: [mediawiki/extensions/LinkFilter] Add ConfirmEdit & SpamRegex as phan dependencies [integration/config] - 10https://gerrit.wikimedia.org/r/1043664 [09:04:23] (03CR) 10CI reject: [V:04-1] zuul: [mediawiki/extensions/LinkFilter] Add ConfirmEdit & SpamRegex as phan dependencies [integration/config] - 10https://gerrit.wikimedia.org/r/1043664 (owner: 10Jack Phoenix) [09:06:11] (03PS4) 10Jack Phoenix: zuul: [mediawiki/extensions/LinkFilter] +ConfirmEdit & SpamRegex 4 phan [integration/config] - 10https://gerrit.wikimedia.org/r/1043664 [09:09:11] (03CR) 10Jack Phoenix: "I just want to note that the commit message guidelines being enforced as policy is silly, especially if and when for this repo the convent" [integration/config] - 10https://gerrit.wikimedia.org/r/1043664 (owner: 10Jack Phoenix) [09:30:35] (03CR) 10Hashar: [C:03+2] "The commit message rule comes from https://www.mediawiki.org/wiki/Gerrit/Commit_message_guidelines and although it can be annoying, keepin" [integration/config] - 10https://gerrit.wikimedia.org/r/1043664 (owner: 10Jack Phoenix) [09:31:07] (03CR) 10Kosta Harlan: [C:03+2] "Per discussion with Hashar. Let's try this and see how it goes. This is easy enough to undo if needed. There's also follow-up work in I447" [integration/quibble] - 10https://gerrit.wikimedia.org/r/1031903 (https://phabricator.wikimedia.org/T361190) (owner: 10Arthur taylor) [09:32:00] (03Merged) 10jenkins-bot: zuul: [mediawiki/extensions/LinkFilter] +ConfirmEdit & SpamRegex 4 phan [integration/config] - 10https://gerrit.wikimedia.org/r/1043664 (owner: 10Jack Phoenix) [09:59:09] (03CR) 10CI reject: [V:04-1] Add parallel execution for PHPUnit extensions suite [integration/quibble] - 10https://gerrit.wikimedia.org/r/1031903 (https://phabricator.wikimedia.org/T361190) (owner: 10Arthur taylor) [10:30:20] Project beta-update-databases-eqiad build #76723: 04FAILURE in 10 min: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/76723/ [10:31:34] 10Gerrit, 06Diffusion-Repository-Administrators, 10EntitySchema, 10Wikidata, and 2 others: GitHub EntitySchema repository is getting mirrored from both EntitySchema and WikibaseSchema on Gerrit - https://phabricator.wikimedia.org/T367396#9891935 (10Lucas_Werkmeister_WMDE) Amazing, thank you! [10:46:01] (03CR) 10Kosta Harlan: Add parallel execution for PHPUnit extensions suite [integration/quibble] - 10https://gerrit.wikimedia.org/r/1031903 (https://phabricator.wikimedia.org/T361190) (owner: 10Arthur taylor) [10:46:04] (03CR) 10Kosta Harlan: [C:03+2] Add parallel execution for PHPUnit extensions suite [integration/quibble] - 10https://gerrit.wikimedia.org/r/1031903 (https://phabricator.wikimedia.org/T361190) (owner: 10Arthur taylor) [11:01:35] (03PS1) 10Kosta Harlan: release: Quibble 1.9.0 [integration/quibble] - 10https://gerrit.wikimedia.org/r/1043719 [11:02:07] (03PS1) 10Kosta Harlan: release: Start 1.9.1 cycle [integration/quibble] - 10https://gerrit.wikimedia.org/r/1043722 [11:02:42] GitLab needs a short maintenance in one hour [11:05:22] (03PS2) 10Kosta Harlan: release: Quibble 1.9.0 [integration/quibble] - 10https://gerrit.wikimedia.org/r/1043719 [11:05:22] (03PS2) 10Kosta Harlan: release: Start 1.9.1 cycle [integration/quibble] - 10https://gerrit.wikimedia.org/r/1043722 [11:11:32] (03PS1) 10Kosta Harlan: DNM: CI test [integration/quibble] - 10https://gerrit.wikimedia.org/r/1043723 [11:13:00] (03CR) 10CI reject: [V:04-1] Add parallel execution for PHPUnit extensions suite [integration/quibble] - 10https://gerrit.wikimedia.org/r/1031903 (https://phabricator.wikimedia.org/T361190) (owner: 10Arthur taylor) [11:22:11] (03CR) 10CI reject: [V:04-1] release: Quibble 1.9.0 [integration/quibble] - 10https://gerrit.wikimedia.org/r/1043719 (owner: 10Kosta Harlan) [11:22:36] (03CR) 10CI reject: [V:04-1] release: Start 1.9.1 cycle [integration/quibble] - 10https://gerrit.wikimedia.org/r/1043722 (owner: 10Kosta Harlan) [11:30:04] (03CR) 10CI reject: [V:04-1] release: Start 1.9.1 cycle [integration/quibble] - 10https://gerrit.wikimedia.org/r/1043722 (owner: 10Kosta Harlan) [11:30:48] Yippee, build fixed! [11:30:48] Project beta-update-databases-eqiad build #76724: 09FIXED in 10 min: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/76724/ [11:32:48] (03CR) 10CI reject: [V:04-1] release: Quibble 1.9.0 [integration/quibble] - 10https://gerrit.wikimedia.org/r/1043719 (owner: 10Kosta Harlan) [11:42:28] (03CR) 10CI reject: [V:04-1] DNM: CI test [integration/quibble] - 10https://gerrit.wikimedia.org/r/1043723 (owner: 10Kosta Harlan) [12:13:03] 10Phabricator: Explore displaying additional info in comment field for open Outreach related tasks - https://phabricator.wikimedia.org/T367500 (10Aklapper) 03NEW [12:13:16] 10Phabricator: Explore displaying additional info in comment field for open Outreach related tasks - https://phabricator.wikimedia.org/T367500#9892098 (10Aklapper) 05Open→03Stalled p:05Triage→03Low a:03Aklapper [12:13:21] 10Phabricator: Explore displaying additional info in comment field for open Outreach related tasks - https://phabricator.wikimedia.org/T367500#9892103 (10Aklapper) [12:13:22] 10Phabricator (Upstream), 07Upstream: Display warning about commenting on a task already closed as duplicate - https://phabricator.wikimedia.org/T354769#9892104 (10Aklapper) [12:14:17] 10Phabricator: Explore displaying additional info in comment field for open Outreach related tasks - https://phabricator.wikimedia.org/T367500#9892106 (10Aklapper) This piggybackrides on the code needed to implement {T354769} in upstream, thus setting status to stalled for the time being. [12:15:42] 10GitLab (Infrastructure), 06collaboration-services: GitLab sre.gitlab.upgrade cookbook should lock all other backups during runtime - https://phabricator.wikimedia.org/T367501 (10Jelto) 03NEW [12:17:16] GitLab maintenance is delayed by 45 minutes [12:17:41] I'll start a roughly 12:45 UTC [12:23:47] 10Phabricator: Explore displaying additional info in comment field for open Outreach related tasks - https://phabricator.wikimedia.org/T367500#9892157 (10Aklapper) Code to add in `ManiphestEditEngine.php`: ` // WMF BEGIN custom Outreach task comment placeholder if (ManiphestTaskStatus::isOpenStatus($task->ge... [12:30:15] 10Phabricator: Explore displaying additional info in comment field for open Outreach related tasks - https://phabricator.wikimedia.org/T367500#9892186 (10Aklapper) Heads-up to @Maryann-Onyinye when it comes to drafting the text to display in the task comment field in Phabricator (and whether this idea makes sens... [12:30:53] 10Gerrit (Gerrit 3.10): Configure h2 cache pruning - https://phabricator.wikimedia.org/T367504 (10hashar) 03NEW [12:36:30] 10Gerrit (Gerrit 3.10): Use Gerrit 3.10 built-in log rotation - https://phabricator.wikimedia.org/T367505 (10hashar) 03NEW [12:49:49] 10Gerrit (Gerrit 3.10), 06Release-Engineering-Team, 06collaboration-services: Upgrade to Gerrit 3.10 - https://phabricator.wikimedia.org/T367419#9892285 (10hashar) [12:55:14] GitLab maintenance finished, sorry for the delays :) [13:24:30] 10GitLab (Pipeline Services Migration🐤), 10Data-Engineering (Q4 2024 April 1st - June 30th), 10Event-Platform, 13Patch-For-Review: Migrate Data Engineering Pipelinelib repos to GitLab - https://phabricator.wikimedia.org/T344730#9892436 (10Snwachukwu) The repos have been archived: Here are the steps i took... [13:52:39] 10GitLab (Infrastructure), 06Release-Engineering-Team, 06collaboration-services, 13Patch-For-Review: Upgrade GitLab to major version 17 - https://phabricator.wikimedia.org/T365675#9892557 (10Jelto) [13:54:52] 10Gerrit, 06Release-Engineering-Team, 10Projects-Cleanup: Prevent Gerrit archived repositories from being replicated to GitHub - https://phabricator.wikimedia.org/T351543#9892559 (10hashar) I have changed the form linked from #cleanup to mention the repository has to be reparented (and while at it remove exi... [13:55:22] 10GitLab (Infrastructure), 06Release-Engineering-Team, 06collaboration-services, 13Patch-For-Review: Upgrade GitLab to major version 17 - https://phabricator.wikimedia.org/T365675#9892562 (10Jelto) I'm going to upgrade the test instance to 17.0 next Monday June 17th. [13:57:39] (03PS2) 10Jdlrobson: DNM: CI test [integration/quibble] - 10https://gerrit.wikimedia.org/r/1043723 (owner: 10Kosta Harlan) [14:00:41] (03CR) 10Hashar: [C:03+2] Also install fresh-node20 (032 comments) [fresh] - 10https://gerrit.wikimedia.org/r/1041527 (https://phabricator.wikimedia.org/T367063) (owner: 10Lucas Werkmeister (WMDE)) [14:01:48] !log gerrit: change fresh submit type from `ff only` to `Rebase if necessary` and enable `Allow content merges` [14:01:49] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [14:02:29] that should be the default really :D [14:11:12] (03Merged) 10jenkins-bot: Also install fresh-node20 [fresh] - 10https://gerrit.wikimedia.org/r/1041527 (https://phabricator.wikimedia.org/T367063) (owner: 10Lucas Werkmeister (WMDE)) [14:39:18] (03CR) 10Jdlrobson: "recheck" [integration/quibble] - 10https://gerrit.wikimedia.org/r/1031903 (https://phabricator.wikimedia.org/T361190) (owner: 10Arthur taylor) [14:39:25] (03CR) 10Jdlrobson: "recheck" [integration/quibble] - 10https://gerrit.wikimedia.org/r/1043722 (owner: 10Kosta Harlan) [14:39:28] (03CR) 10Jdlrobson: "recheck" [integration/quibble] - 10https://gerrit.wikimedia.org/r/1043719 (owner: 10Kosta Harlan) [14:51:13] 10GitLab (Pipeline Services Migration🐤), 10Data-Engineering (Q4 2024 April 1st - June 30th), 10Event-Platform, 13Patch-For-Review: Migrate Data Engineering Pipelinelib repos to GitLab - https://phabricator.wikimedia.org/T344730#9893198 (10Snwachukwu) The following documents have been edited: # [[ https... [14:56:16] (03CR) 10Kosta Harlan: Add parallel execution for PHPUnit extensions suite [integration/quibble] - 10https://gerrit.wikimedia.org/r/1031903 (https://phabricator.wikimedia.org/T361190) (owner: 10Arthur taylor) [14:56:20] (03CR) 10Kosta Harlan: [C:03+2] Add parallel execution for PHPUnit extensions suite [integration/quibble] - 10https://gerrit.wikimedia.org/r/1031903 (https://phabricator.wikimedia.org/T361190) (owner: 10Arthur taylor) [14:56:32] (03Abandoned) 10Kosta Harlan: DNM: CI test [integration/quibble] - 10https://gerrit.wikimedia.org/r/1043723 (owner: 10Kosta Harlan) [14:57:56] 10Fresh: Fresh 24.05.1 installer does not remove fresh-node20 - https://phabricator.wikimedia.org/T367063#9893298 (10Lucas_Werkmeister_WMDE) Alright, I think we can close this task then? [15:07:33] 06Release-Engineering-Team, 10Cloud-VPS (Debian Buster Deprecation): Cloud VPS "integration" project Buster deprecation - https://phabricator.wikimedia.org/T367534#9893362 (10taavi) [15:13:35] (03PS3) 10Kosta Harlan: release: Quibble 1.9.0 [integration/quibble] - 10https://gerrit.wikimedia.org/r/1043719 (https://phabricator.wikimedia.org/T361190) [15:18:54] I'm trying to use docker-pkg to bump Quibble docker images to 1.9.0 but docker-pkg just updates to 1.8.0-s1, not sure why [15:19:07] I'm running `docker-pkg -c dockerfiles/config.yaml --info update --reason "Quibble 1.9.0" --version 1.9.0 quibble-buster dockerfiles/` [15:28:40] (03CR) 10CI reject: [V:04-1] release: Quibble 1.9.0 [integration/quibble] - 10https://gerrit.wikimedia.org/r/1043719 (https://phabricator.wikimedia.org/T361190) (owner: 10Kosta Harlan) [15:28:45] kostajh: hmm. does it create entries with the 1.9.0 reason you passed in? [15:28:58] brennen: no. it uses 1.8.0-s1 [15:29:13] oh wait [15:29:19] brennen: sorry, it uses 1.9.0 in the reason [15:29:29] I'll push a patch [15:29:38] (03PS1) 10Hashar: Merge branch 'stable-3.10' into wmf/stable-3.10 [software/gerrit] (wmf/stable-3.10) - 10https://gerrit.wikimedia.org/r/1043813 (https://phabricator.wikimedia.org/T367419) [15:30:18] (03Merged) 10jenkins-bot: Add parallel execution for PHPUnit extensions suite [integration/quibble] - 10https://gerrit.wikimedia.org/r/1031903 (https://phabricator.wikimedia.org/T361190) (owner: 10Arthur taylor) [15:30:37] (03PS1) 10Kosta Harlan: WIP: dockerfiles: Update to Quibble 1.9.0 [integration/config] - 10https://gerrit.wikimedia.org/r/1043814 [15:30:49] brennen: https://gerrit.wikimedia.org/r/c/integration/config/+/1043814 [15:31:28] hmm, i think i know what's happening [15:31:57] brennen: on a semi-related note, is this something you can help with? `fatal: cannot create directory at 'wikimedia/parsoid/bin': No space left on device` seen on a job for https://gerrit.wikimedia.org/r/c/integration/quibble/+/1043719 [15:32:22] it's pushing quibble-buster to your specified version, but the things that depend on it are just getting a version bump [15:32:34] (03CR) 10CI reject: [V:04-1] WIP: dockerfiles: Update to Quibble 1.9.0 [integration/config] - 10https://gerrit.wikimedia.org/r/1043814 (owner: 10Kosta Harlan) [15:33:09] (03open) 10lucaswerkmeister-wmde: Update exec example to use run.php [repos/releng/cli] - 10https://gitlab.wikimedia.org/repos/releng/cli/-/merge_requests/567 [15:33:27] brennen: ah... I see [15:33:33] I'm missing `ARG_QUIBBLE_VERSION` [15:34:00] (03CR) 10Hashar: [C:04-1] "That is merging ur `stable-3.10` which is ahead by 32 commits:" [software/gerrit] (wmf/stable-3.10) - 10https://gerrit.wikimedia.org/r/1043813 (https://phabricator.wikimedia.org/T367419) (owner: 10Hashar) [15:34:42] kostajh: i'm about to lose signal here but i'll poke at the integration host disk space (i assume that's what's going on) when back, if nobody beats me to it [15:36:18] brennen: ack, thx [15:37:11] hashar: maybe you know what to do. I've set `ARG_QUIBBLE_VERSION` in bullseye and buster but `docker-pkg -c dockerfiles/config.yaml --info update --reason "Quibble 1.9.0" --version 1.9.0` doesn't set the version to 1.9.0 in all the Dockerfile.template files as I'd expect [15:41:35] (03CR) 10CI reject: [V:04-1] Merge branch 'stable-3.10' into wmf/stable-3.10 [software/gerrit] (wmf/stable-3.10) - 10https://gerrit.wikimedia.org/r/1043813 (https://phabricator.wikimedia.org/T367419) (owner: 10Hashar) [15:50:40] Hey brennen permission to do a Friday backport today to fix https://phabricator.wikimedia.org/T367462? Jan Drewniak can do it. [15:52:41] (03CR) 10Kosta Harlan: [C:03+2] "self +2'ing as:" [integration/quibble] - 10https://gerrit.wikimedia.org/r/1043824 (https://phabricator.wikimedia.org/T361190) (owner: 10Kosta Harlan) [15:52:51] 10GitLab-Application-Security-Pipeline, 10Security Team AppSec, 06Security-Team, 07Security: Attempt to condense trivy scanning output and avoid false positive exit code - https://phabricator.wikimedia.org/T367440#9893529 (10mmartorana) 05Open→03In progress p:05Triage→03Medium [15:53:35] 10GitLab (CI & Job Runners), 10GitLab-Application-Security-Pipeline, 10Security Team AppSec, 06Security-Team, and 2 others: Investigate container scanning options within the context of the Gitlab appsec pipeline - https://phabricator.wikimedia.org/T307523#9893531 (10mmartorana) 05In progress→03Resol... [15:54:42] (03CR) 10Hashar: [C:04-1] "The lfs plugin fails due to PluginCommand. https://gerrit-review.googlesource.com/c/plugins/lfs/+/430179" [software/gerrit] (wmf/stable-3.10) - 10https://gerrit.wikimedia.org/r/1043813 (https://phabricator.wikimedia.org/T367419) (owner: 10Hashar) [16:05:00] (03CR) 10CI reject: [V:04-1] build: Enable parallel runs by setting QUIBBLE_PHPUNIT_PARALLEL [integration/quibble] - 10https://gerrit.wikimedia.org/r/1043824 (https://phabricator.wikimedia.org/T361190) (owner: 10Kosta Harlan) [16:08:47] Paging @dduvall as backup train conductor. ^ [16:08:50] (03Merged) 10jenkins-bot: build: Enable parallel runs by setting QUIBBLE_PHPUNIT_PARALLEL [integration/quibble] - 10https://gerrit.wikimedia.org/r/1043824 (https://phabricator.wikimedia.org/T361190) (owner: 10Kosta Harlan) [16:30:04] 10GitLab-Application-Security-Pipeline, 10Security Team AppSec, 06Security-Team, 07Security: Attempt to condense trivy scanning output and avoid false positive exit code - https://phabricator.wikimedia.org/T367440#9893708 (10sbassett) [16:30:06] 10GitLab-Application-Security-Pipeline, 06Security-Team, 07SecTeam-Processed, 07Security: [EPIC] Application Security Pipeline Components for Gitlab - Phase 2 Work - https://phabricator.wikimedia.org/T342177#9893709 (10sbassett) [16:43:10] Jdlrobson: I'm around. [16:43:17] Taking a look [16:43:42] Let's get it fixed. [16:45:54] ah looks like you got the go-ahead in #-operations. Good [16:53:05] thanks dancy yeh jan is on it! [17:17:27] Jdlrobson, dancy: sorry for missing earlier ping. [17:32:22] 10Beta-Cluster-Infrastructure, 10Cloud-VPS (Debian Buster Deprecation): Launching new bullseye deployment-prep instances fails, no sudo access - https://phabricator.wikimedia.org/T361536#9893971 (10Andrew) 05Open→03Resolved I have built several bullseye VMs without trouble so I not believe this to be f... [17:36:21] hashar: for https://gerrit-review.googlesource.com/c/plugins/lfs/+/430179 probably want a stable-3.9 branch [17:36:50] looks like there errors in the log are due to needing to do https://gerrit-review.googlesource.com/c/gerrit/+/406479 with lfs tests [20:56:09] (03open) 10cjming: make-release: Start branching MetricsPlatform [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/82 (https://phabricator.wikimedia.org/T366316) [21:49:57] (03update) 10cjming: make-release: Start branching MetricsPlatform [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/82 (https://phabricator.wikimedia.org/T366316) [21:57:50] 06Release-Engineering-Team, 10Scap: Did retrying canary checks do anything? - https://phabricator.wikimedia.org/T367131#9894740 (10dancy) 05Open→03In progress p:05Triage→03Low a:03dancy [21:58:06] 10Release-Engineering-Team (Seen), 10Scap: Scap canary has a shifting baseline - https://phabricator.wikimedia.org/T183999#9894744 (10dancy) 05Open→03In progress p:05Medium→03Low a:03dancy [21:58:18] 06Release-Engineering-Team, 10Scap: If aborting a scap due to test canary error rate, output some errors for reference - https://phabricator.wikimedia.org/T159991#9894747 (10dancy) 05Open→03In progress p:05Medium→03Low a:03dancy [23:20:01] Project beta-update-databases-eqiad build #76736: 04FAILURE in 0.44 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/76736/