[01:28:39] 10Release-Engineering-Team, 10API Platform, 10AQS2.0, 10Platform Engineering, and 5 others: Define a procedure/pattern to populate test environments - https://phabricator.wikimedia.org/T334851 (10Eevans) >>! In T334851#8825307, @Htriedman wrote: > > [ ... ] > > I don't think I'm following what you mean h... [01:40:36] maintenance-disconnect-full-disks build 488044 integration-agent-docker-1035 (/: 30%, /srv: 100%, /var/lib/docker: 72%): OFFLINE due to disk space [01:45:30] maintenance-disconnect-full-disks build 488045 integration-agent-docker-1035 (/: 30%, /srv: 100%, /var/lib/docker: 77%): still OFFLINE due to disk space [02:10:31] maintenance-disconnect-full-disks build 488050 integration-agent-docker-1035 (/: 30%, /srv: 100%, /var/lib/docker: 68%): still OFFLINE due to disk space [02:20:34] maintenance-disconnect-full-disks build 488052 integration-agent-docker-1035 (/: 30%, /srv: 11%, /var/lib/docker: 8%): RECOVERY disk space OK [04:47:29] PROBLEM - Check systemd state on doc1002 is CRITICAL: CRITICAL - degraded: The following units failed: rsync-doc-doc2002.codfw.wmnet.service https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state [05:44:33] RECOVERY - Check systemd state on doc1002 is OK: OK - running: The system is fully operational https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state [06:08:19] (03CR) 10Giuseppe Lavagetto: [C: 03+1] operations-puppet: Install envoyproxy [integration/config] - 10https://gerrit.wikimedia.org/r/914782 (https://phabricator.wikimedia.org/T304660) (owner: 10JMeybohm) [08:54:50] 10Gerrit: [wm-checks-api] Create a new gerrit bot for Patch Demo - https://phabricator.wikimedia.org/T332474 (10hashar) [08:56:20] 10Gerrit: [wm-checks-api] Create a new gerrit bot for Patch Demo - https://phabricator.wikimedia.org/T332474 (10hashar) I kind of forgot about that task since I ran the train and went on vacation in April. I think I will sprint it together with the similar request {T331651}. [09:27:10] 10Phabricator, 10Trust-and-Safety, 10cloud-services-team, 10wikitech.wikimedia.org, 10User-bd808: Account recovery help needed for Developer account AOkoth - https://phabricator.wikimedia.org/T335811 (10Aklapper) 05Open→03Resolved Hi, for future reference, one ticket per one auth system is welcome. T... [09:29:38] 10GitLab, 10serviceops-collab: Repository by URL import from Gerrit to GitLab fails - https://phabricator.wikimedia.org/T333447 (10Jelto) 05Open→03Resolved ## Import on test instance I've tried another import on the [GitLab test instance](https://gitlab.devtools.wmcloud.org/jelto/cirrus-streaming-updater)... [09:32:05] 10GitLab, 10serviceops-collab: GitLab: Unable to import a repository from gitlab.com - https://phabricator.wikimedia.org/T333048 (10Jelto) p:05Triage→03Medium a:03Legoktm Hi @Legoktm can you try again? I did a test in T333447#8825848 with the new GitLab version and import should work again. [10:48:47] 10Phabricator, 10serviceops-collab: create aphlict2001 (Phabricator realtime notifications codfw) - https://phabricator.wikimedia.org/T322369 (10ops-monitoring-bot) Cookbook cookbooks.sre.ganeti.reimage was started by eoghan@cumin1001 for host aphlict2001.codfw.wmnet with OS bullseye [11:14:30] 10Phabricator, 10serviceops-collab: create aphlict2001 (Phabricator realtime notifications codfw) - https://phabricator.wikimedia.org/T322369 (10ops-monitoring-bot) Cookbook cookbooks.sre.ganeti.reimage started by eoghan@cumin1001 for host aphlict2001.codfw.wmnet with OS bullseye completed: - aphlict2001 (**WA... [11:49:20] (03CR) 10Giuseppe Lavagetto: [C: 03+2] operations-puppet: Install envoyproxy [integration/config] - 10https://gerrit.wikimedia.org/r/914782 (https://phabricator.wikimedia.org/T304660) (owner: 10JMeybohm) [11:50:49] (03Merged) 10jenkins-bot: operations-puppet: Install envoyproxy [integration/config] - 10https://gerrit.wikimedia.org/r/914782 (https://phabricator.wikimedia.org/T304660) (owner: 10JMeybohm) [12:00:02] <_joe_> !log Updating docker-pkg files on contint primary for https://gerrit.wikimedia.org/r/914782 [12:00:03] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [12:48:01] (03PS1) 10JMeybohm: Add wmf-certificates to helm-linter [integration/config] - 10https://gerrit.wikimedia.org/r/915652 (https://phabricator.wikimedia.org/T300324) [13:18:07] 10Project-Admins: Create project tag to track Toolforge Build Service beta release - https://phabricator.wikimedia.org/T335518 (10Aklapper) So if we create a subproject, then the parent project cannot specify members anymore. Instead, the members of all subprojects are treated as being the parent project's membe... [13:47:10] (03CR) 10Giuseppe Lavagetto: [C: 03+2] Add wmf-certificates to helm-linter [integration/config] - 10https://gerrit.wikimedia.org/r/915652 (https://phabricator.wikimedia.org/T300324) (owner: 10JMeybohm) [13:48:26] (03Merged) 10jenkins-bot: Add wmf-certificates to helm-linter [integration/config] - 10https://gerrit.wikimedia.org/r/915652 (https://phabricator.wikimedia.org/T300324) (owner: 10JMeybohm) [13:51:38] <_joe_> !log Updating docker-pkg files on contint primary for https://gerrit.wikimedia.org/r/915652 [13:51:39] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [14:02:51] (03PS2) 10JMeybohm: jjb/operations-puppet: Bump image version [integration/config] - 10https://gerrit.wikimedia.org/r/914785 (https://phabricator.wikimedia.org/T304660) [14:02:53] (03PS1) 10JMeybohm: jjb/operations-misc: Bump helm-linter image [integration/config] - 10https://gerrit.wikimedia.org/r/915681 [14:03:07] (03PS2) 10JMeybohm: jjb/operations-misc: Bump helm-linter image [integration/config] - 10https://gerrit.wikimedia.org/r/915681 [14:03:53] hashar: do you have a minute to merge https://gerrit.wikimedia.org/r/c/integration/config/+/915681 ? [14:07:35] 10Release-Engineering-Team (Seen), 10Scap, 10serviceops-radar, 10Python3-Porting: git-fat replacement/removal - https://phabricator.wikimedia.org/T279509 (10jijiki) [14:16:59] 10Phabricator, 10Regression: Phabricator is auto claiming tasks when closing as resolved (again) - https://phabricator.wikimedia.org/T134106 (10Michael) > but please understand that probably the majority of maintainers in GitHub, GitLab and ClickUp (not just Phabricator) very probably strongly disagree with th... [14:22:06] 10Phabricator, 10Regression: Phabricator is auto claiming tasks when closing as resolved (again) - https://phabricator.wikimedia.org/T134106 (10valerio.bozzolan) [14:34:43] 10Phabricator, 10Trust-and-Safety, 10cloud-services-team, 10wikitech.wikimedia.org, 10User-bd808: Account recovery help needed for Developer account AOkoth - https://phabricator.wikimedia.org/T335811 (10Arnoldokoth) Thanks @Aklapper All good now. [14:40:59] 10Phabricator, 10Regression: Phabricator is auto claiming tasks when closing as resolved (again) - https://phabricator.wikimedia.org/T134106 (10valerio.bozzolan) (Uh! how many things I learned in one day) First of all, the good news: we need exactly zero lines of source code to change Wikimedia Phabricator 🎉... [14:58:01] 10Phabricator: "Unhandled Exception: Call to a member function getAppliedTransactionPHIDs() on bool" when viewing old Herald Transcript - https://phabricator.wikimedia.org/T294860 (10valerio.bozzolan) This can be reproduced upstream too on old Tasks: https://we.phorge.it/herald/transcript/268/ [15:01:27] jayme: still need that? [15:09:32] 10Phabricator: "Unhandled Exception: Call to a member function getAppliedTransactionPHIDs() on bool" when viewing old Herald Transcript - https://phabricator.wikimedia.org/T294860 (10valerio.bozzolan) [15:10:04] 10Phabricator (Upstream): "Unhandled Exception: Call to a member function getAppliedTransactionPHIDs() on bool" when viewing old Herald Transcript - https://phabricator.wikimedia.org/T294860 (10valerio.bozzolan) [15:10:19] 10Phabricator (Upstream), 10Upstream: "Unhandled Exception: Call to a member function getAppliedTransactionPHIDs() on bool" when viewing old Herald Transcript - https://phabricator.wikimedia.org/T294860 (10valerio.bozzolan) [15:15:00] 10Phabricator (Upstream), 10Release-Engineering-Team, 10Upstream, 10User-brennen: Uploaded files via the drag-and-drop are defaulting to private-access - https://phabricator.wikimedia.org/T310833 (10valerio.bozzolan) [15:20:04] taavi: yeah [15:22:29] hmmm jenkins.JenkinsException: Could not parse JSON info for server[https://integration.wikimedia.org/ci/] [15:22:51] ValueError: Timeout value connect was , but it must be an int, float or None. [15:23:28] and that happens after nuking the tox venv :( [15:24:37] jayme: sorry, looks like either jjb or our docs (that I've previously used) are broken :/ [15:27:08] is that something my change caused? [15:31:01] I don't know. it does not happen on the master branch but that might be just because there are no changes to apply [15:32:28] 10Beta-Cluster-Infrastructure: Beta Cluster Wikisource contains invalid interwikis - https://phabricator.wikimedia.org/T245917 (10Xqt) [15:36:54] jayme: taavi: i will try ) [15:37:40] ah same error [15:42:16] I guess something broke on the CI Jenkins, possibly due to some update [15:45:33] 10Continuous-Integration-Infrastructure, 10Jenkins, 10Release-Engineering-Team: JJB can no more update CI Jenkins due to failure when retrieving server infos - https://phabricator.wikimedia.org/T335977 (10hashar) [15:46:56] 10Continuous-Integration-Infrastructure, 10Jenkins, 10Release-Engineering-Team: JJB can no more update CI Jenkins due to failure when retrieving server infos - https://phabricator.wikimedia.org/T335977 (10hashar) [15:48:36] jayme: the issue is unrelated to your patch. Something is broken on Jenkins server I guess [15:50:19] ack, thanks [15:54:48] 10Continuous-Integration-Infrastructure, 10Jenkins, 10Release-Engineering-Team: JJB can no more update CI Jenkins due to failure when retrieving server infos - https://phabricator.wikimedia.org/T335977 (10hashar) The trace has {nav jenkins > requests > urllib3} so maybe one of those got a new release which i... [15:56:45] 10Continuous-Integration-Infrastructure, 10Jenkins, 10Release-Engineering-Team, 10Upstream: JJB can no more update CI Jenkins due to failure when retrieving server infos - https://phabricator.wikimedia.org/T335977 (10hashar) [15:56:47] yeah https://github.com/psf/requests/issues/6432 :) [15:56:48] easy [15:58:10] (03PS1) 10Hashar: tox: pin urllib3<2 [integration/config] - 10https://gerrit.wikimedia.org/r/915736 (https://phabricator.wikimedia.org/T335977) [15:58:18] taavi: if you wanna try with ^ [15:59:21] it is really an issue in Python itself [15:59:38] cause the whole set of dependencies have to work nicely together unlike nodejs [16:00:14] (03PS3) 10Hashar: jjb/operations-misc: Bump helm-linter image [integration/config] - 10https://gerrit.wikimedia.org/r/915681 (owner: 10JMeybohm) [16:02:08] (03CR) 10Hashar: [C: 03+2] "I have updated the job:" [integration/config] - 10https://gerrit.wikimedia.org/r/915681 (owner: 10JMeybohm) [16:02:16] (03CR) 10Hashar: [C: 03+2] tox: pin urllib3<2 [integration/config] - 10https://gerrit.wikimedia.org/r/915736 (https://phabricator.wikimedia.org/T335977) (owner: 10Hashar) [16:02:36] jayme: I have deployed the job :) [16:02:45] hashar: cool, thanks [16:02:49] the tldr is that urllib3 python dependency got a new major update released today [16:02:53] and that breaks requests [16:03:03] and that is most probably going to affect anyone [16:03:12] 10Continuous-Integration-Infrastructure, 10Jenkins, 10Release-Engineering-Team, 10Patch-For-Review, 10Upstream: JJB can no more update CI Jenkins due to failure when retrieving server infos - https://phabricator.wikimedia.org/T335977 (10hashar) 05Open→03Resolved a:03hashar [16:03:44] (03Merged) 10jenkins-bot: tox: pin urllib3<2 [integration/config] - 10https://gerrit.wikimedia.org/r/915736 (https://phabricator.wikimedia.org/T335977) (owner: 10Hashar) [16:03:47] (03Merged) 10jenkins-bot: jjb/operations-misc: Bump helm-linter image [integration/config] - 10https://gerrit.wikimedia.org/r/915681 (owner: 10JMeybohm) [16:09:21] 10Continuous-Integration-Infrastructure, 10Jenkins, 10Release-Engineering-Team, 10Patch-For-Review, 10Upstream: JJB can no longer update CI Jenkins due to failure when retrieving server info - https://phabricator.wikimedia.org/T335977 (10Novem_Linguae) [16:33:30] 10Phabricator, 10Regression: Phabricator is auto claiming tasks when closing as resolved (again) - https://phabricator.wikimedia.org/T134106 (10Krinkle) I don't feel strongly about this either way, but I do enjoy the current behaviour. Without this feature, we should perhaps codify awareness and responsibility... [16:38:48] 10Phabricator: Phabricator is auto claiming tasks when closing as resolved (again) - https://phabricator.wikimedia.org/T134106 (10Krinkle) //Removing "Regression" tag.// T84833 was resolved in 2016 after the comment form was improved to allow setting assignees (previously it required a post-closure task edit),... [16:45:58] 10Phabricator, 10SRE-Access-Requests, 10serviceops-collab: let Eoghan see security tickets in Phabricator - https://phabricator.wikimedia.org/T335981 (10Dzahn) [16:46:16] 10Phabricator, 10SRE-Access-Requests, 10serviceops-collab: let Eoghan see security tickets in Phabricator - https://phabricator.wikimedia.org/T335981 (10Dzahn) [16:49:57] 10Phabricator, 10Security-Team, 10serviceops-collab, 10Security: let Eoghan see security tickets in Phabricator - https://phabricator.wikimedia.org/T335981 (10Dzahn) [16:50:36] 10Phabricator, 10Security-Team, 10serviceops-collab, 10Security: let Eoghan see security tickets in Phabricator - https://phabricator.wikimedia.org/T335981 (10Dzahn) as pointed out by @RhinosF1 I should tag security-team and not sre-access-requests, which is of course correct. using tags from example tic... [16:55:46] 10Phabricator, 10Security-Team, 10serviceops-collab, 10Security: let Eoghan see security tickets in Phabricator - https://phabricator.wikimedia.org/T335981 (10Dzahn) [16:56:36] 10Phabricator, 10Security-Team, 10serviceops-collab, 10Security: let Eoghan see security tickets in Phabricator - https://phabricator.wikimedia.org/T335981 (10Dzahn) [17:06:12] 10Phabricator, 10Security-Team, 10serviceops-collab, 10Security: let Eoghan see security tickets in Phabricator - https://phabricator.wikimedia.org/T335981 (10MoritzMuehlenhoff) You need to email security-help@wikimedia.org, they make the change. [17:12:37] 10GitLab (Integrations), 10Phabricator, 10Release-Engineering-Team, 10User-brennen: Phabricator does not degrade properly when GitLab is unavailable - https://phabricator.wikimedia.org/T333347 (10brennen) 05In progress→03Resolved Fix deployed. This //should// now be robust against an unavailable GitLab... [17:12:47] 10Phabricator, 10Security-Team, 10serviceops-collab, 10Security: let Eoghan see security tickets in Phabricator - https://phabricator.wikimedia.org/T335981 (10Dzahn) Oh, really? That is strange that we can't use the system itself when it's about groups within the system. [17:19:40] 10Phabricator, 10serviceops-collab, 10PM: Merge the Phabricator Priority values "Low" and "Lowest" - https://phabricator.wikimedia.org/T228759 (10brennen) 05Open→03Resolved Deployed. [17:29:23] 10Phabricator, 10serviceops-collab, 10PM: Merge the Phabricator Priority values "Low" and "Lowest" - https://phabricator.wikimedia.org/T228759 (10Aklapper) p:05Lowest→03Low >>! In T228759#8827490, @brennen wrote: > Deployed. @brennen: Hmm, https://phabricator.wikimedia.org/config/edit/maniphest.prioriti... [17:29:58] ::sigh:: [17:32:12] I'm rebooting the aphlict host for a kernel upgrade, it should be back in a minute or two but tickets may not move on workboards automatically until then. [17:33:47] 10Phabricator, 10serviceops-collab, 10PM: Merge the Phabricator Priority values "Low" and "Lowest" - https://phabricator.wikimedia.org/T228759 (10brennen) > @brennen: Hmm, https://phabricator.wikimedia.org/config/edit/maniphest.priorities/ shows "disabled": true under Local Config but not under Database. Thu... [17:42:03] 10Gerrit: mediawiki/core on gerrit-replica is out of date - https://phabricator.wikimedia.org/T335995 (10Mainframe98) [17:44:17] 10Gerrit, 10ExtensionDistributor: gerrit-replica seems out of date breaking extension distributor - https://phabricator.wikimedia.org/T335730 (10Mainframe98) Is T335995 similar? I can't tell if here the repository suddenly travelled back in time like what happened to mediawiki/core in T335995. [17:50:02] 10Release-Engineering-Team (Priority Backlog 📥), 10Patch-For-Review, 10Release, 10Train Deployments: 1.41.0-wmf.6 deployment blockers - https://phabricator.wikimedia.org/T330212 (10matmarex) [17:55:32] 10Phabricator: Phabricator is auto claiming tasks when closing as resolved (again) - https://phabricator.wikimedia.org/T134106 (10Aklapper) The Wikimedia Phabricator configuration only makes a user "claim" a task when the user sets the task status to "resolved". It's one line of config. Phabricator auto-claimin... [18:12:14] 10Release-Engineering-Team (Priority Backlog 📥), 10Release, 10Train Deployments: 1.41.0-wmf.8 deployment blockers - https://phabricator.wikimedia.org/T330214 (10Jdlrobson) [18:12:37] 10Release-Engineering-Team, 10API Platform, 10AQS2.0, 10Platform Engineering, and 5 others: Define a procedure/pattern to populate test environments - https://phabricator.wikimedia.org/T334851 (10Htriedman) @Eevans Thanks so much for the clarification! This rationale makes a great deal of sense to me, and... [18:17:45] 10Gerrit, 10ExtensionDistributor: gerrit-replica seems out of date breaking extension distributor - https://phabricator.wikimedia.org/T335730 (10hashar) [18:17:48] 10Gerrit: mediawiki/core on gerrit-replica is out of date - https://phabricator.wikimedia.org/T335995 (10hashar) [18:21:54] 10Gerrit, 10ExtensionDistributor: gerrit-replica seems out of date breaking extension distributor - https://phabricator.wikimedia.org/T335730 (10hashar) 05Resolved→03Open T335995 is the same issue, as to why, that is a good question. Gerrit has been up and running since March 29th ` ● gerrit.service - Ger... [18:22:33] 10Gerrit, 10ExtensionDistributor: gerrit-replica seems out of date breaking extension distributor - https://phabricator.wikimedia.org/T335730 (10hashar) [18:36:14] 10Gerrit, 10ExtensionDistributor: gerrit-replica seems out of date breaking extension distributor - https://phabricator.wikimedia.org/T335730 (10hashar) Looking at the work queue: ` $ ssh -p 29418 hashar@gerrit.wikimedia.org gerrit show-queue --wide --by-queue ... Queue: ReplicateTo-replica_codfw 9ba5ca13... [18:42:54] 10Gerrit, 10ExtensionDistributor: gerrit-replica seems out of date breaking extension distributor - https://phabricator.wikimedia.org/T335730 (10hashar) The HEAD is correct: ` $ sudo -u gerrit2 git -C /srv/gerrit/git/mediawiki/core.git/ rev-parse HEAD c2a620c74f40ce37d0a7386cf76cbbdbcbd5110f ` Doing a full cl... [18:45:41] 10Gerrit, 10ExtensionDistributor: gerrit-replica seems out of date breaking extension distributor - https://phabricator.wikimedia.org/T335730 (10Dzahn) So, the new host gerrit1003 (gerrit-new.wikimedia.org) was trying to replicate to the gerrit-replica. That is because gerrit config has it hardcoded and a remo... [18:50:40] 10Gerrit, 10ExtensionDistributor: gerrit-replica seems out of date breaking extension distributor - https://phabricator.wikimedia.org/T335730 (10Dzahn) temp fix: stopped puppet on gerrit1003, edited /etc/gerrit/replication.config, set `replicateOnStartup = false` in [gerrit] section and entirely remove the 2... [19:14:27] 10Gerrit, 10ExtensionDistributor: gerrit-replica seems out of date breaking extension distributor - https://phabricator.wikimedia.org/T335730 (10thcipriani) >>! In T335730#8827843, @Dzahn wrote: > If we start replication manually from 1001 one more time it should be fixed. Just ran `ssh -p 29418 gerrit.wikime... [19:15:07] 10Phabricator, 10serviceops-collab: create aphlict2001 (Phabricator realtime notifications codfw) - https://phabricator.wikimedia.org/T322369 (10eoghan) 05Open→03Resolved We now have `aphlict2001` running in codfw, We haven't tested it since we don't allow cross-region traffic, but it uses the same puppet... [20:10:42] 10GitLab (Auth & Access), 10Release-Engineering-Team: Requesting GitLab non-external access/account unlock for Pwangai @pwangai - https://phabricator.wikimedia.org/T336006 (10pwangai) [20:18:14] 10Release-Engineering-Team (Priority Backlog 📥), 10Patch-For-Review, 10Release, 10Train Deployments: 1.41.0-wmf.7 deployment blockers - https://phabricator.wikimedia.org/T330213 (10brennen) @Ladsgroup any chance {T336008} is fallout of above-mentioned risky patch? [20:26:01] 10GitLab (Auth & Access), 10Release-Engineering-Team: Requesting GitLab non-external access/account unlock for Pwangai @pwangai - https://phabricator.wikimedia.org/T336006 (10brennen) 05Open→03Resolved [20:26:45] 10GitLab (Auth & Access), 10Release-Engineering-Team: Requesting GitLab non-external access/account unlock for Pwangai @pwangai - https://phabricator.wikimedia.org/T336006 (10brennen) You should be good to go - `@wikimedia.org` addresses are automatically set to internal. [20:31:51] 10Release-Engineering-Team (Priority Backlog 📥), 10Patch-For-Review, 10Release, 10Train Deployments: 1.41.0-wmf.7 deployment blockers - https://phabricator.wikimedia.org/T330213 (10brennen) [20:33:30] 10Release-Engineering-Team (Priority Backlog 📥), 10Patch-For-Review, 10Release, 10Train Deployments: 1.41.0-wmf.7 deployment blockers - https://phabricator.wikimedia.org/T330213 (10brennen) T336008 has spiked quite a bit. Rolling train back to group1. [20:34:49] 10Release-Engineering-Team (Priority Backlog 📥), 10Patch-For-Review, 10Release, 10Train Deployments: 1.41.0-wmf.7 deployment blockers - https://phabricator.wikimedia.org/T330213 (10Ladsgroup) >>! In T330213#8828156, @brennen wrote: > @Ladsgroup any chance {T336008} is fallout of above-mentioned risky patch... [20:36:21] this is a new one - something causing logspam-watch to quit silently with no output [20:36:38] there's a recent spike of errors, but i'm not sure why that would do it. [20:37:26] hmm, pipefail [20:37:36] brennen@mwlog1002:/srv/mw-log$ logspam-watch [20:37:38] brennen@mwlog1002:/srv/mw-log$ echo $? [20:37:40] (Queue (Jenkins jobs + Zuul functions) alert) firing: - https://alerts.wikimedia.org/?q=alertname%3DQueue+%28Jenkins+jobs+%2B+Zuul+functions%29+alert [20:37:40] 141 [20:38:31] 10Release-Engineering-Team (Priority Backlog 📥), 10Patch-For-Review, 10Release, 10Train Deployments: 1.41.0-wmf.7 deployment blockers - https://phabricator.wikimedia.org/T330213 (10Ladsgroup) From a brief look, it's highly unlikely. It's something else. [20:41:33] 10Release-Engineering-Team (Priority Backlog 📥), 10Patch-For-Review, 10Release, 10Train Deployments: 1.41.0-wmf.7 deployment blockers - https://phabricator.wikimedia.org/T330213 (10brennen) > From a brief look, it's highly unlikely. It's something else. Ack, thanks! Seemed worth checking. [20:42:39] (Queue (Jenkins jobs + Zuul functions) alert) resolved: - https://alerts.wikimedia.org/?q=alertname%3DQueue+%28Jenkins+jobs+%2B+Zuul+functions%29+alert [20:46:16] 10Phabricator, 10User-DannyS712: Phabricator "reconcile timezone" dialog options are confusing - https://phabricator.wikimedia.org/T158177 (10Aklapper) 05Open→03Resolved a:03DannyS712 This is deployed now locally on WIkimedia Phabricator (I just tested it by changing my timezone). Thanks for the patch!... [21:07:23] 10Release-Engineering-Team (Priority Backlog 📥), 10Release, 10Train Deployments: 1.41.0-wmf.8 deployment blockers - https://phabricator.wikimedia.org/T330214 (10matmarex) [21:15:06] 10Phabricator: Phabricator is auto claiming tasks when closing as resolved (again) - https://phabricator.wikimedia.org/T134106 (10Peachey88) 05Open→03Declined As the original task author i'm boldly declining, others are always open to reopen the task, althought he only other dup was 2020 say may not been see... [21:17:08] 10Release-Engineering-Team: GitLab Access Token - https://phabricator.wikimedia.org/T336014 (10pwangai) [21:47:47] 10Phabricator, 10serviceops-collab, 10PM: Merge the Phabricator Priority values "Low" and "Lowest" - https://phabricator.wikimedia.org/T228759 (10Aklapper) Thanks! Related docs updated: [x] https://www.mediawiki.org/wiki/Bug_management/Phabricator_etiquette [x] https://www.mediawiki.org/wiki/Bug_management/... [22:00:47] 10Release-Engineering-Team (Priority Backlog 📥), 10Patch-For-Review, 10Release, 10Train Deployments: 1.41.0-wmf.7 deployment blockers - https://phabricator.wikimedia.org/T330213 (10brennen) End of US workday update: Doing a diagnostic backport for T336008 and pausing the train for the day. [22:06:52] 10Release-Engineering-Team: Provide Access Token to allow SonarQube to access GitLab - https://phabricator.wikimedia.org/T336014 (10Aklapper) [22:08:59] 10Release-Engineering-Team: Provide Access Token to allow SonarQube to access GitLab - https://phabricator.wikimedia.org/T336014 (10Aklapper) I assume this is a request for a Group Access token. Which GitLab group(s) would you want to access? [22:18:19] 10Release-Engineering-Team: Provide Access Token to allow SonarQube to access GitLab - https://phabricator.wikimedia.org/T336014 (10pwangai) Currently working on search-platform group