[01:54:10] 10GitLab, 10mwbot-rs: GitLab "An error occurred while merging. Try again." but unable to try again - https://phabricator.wikimedia.org/T332528 (10Legoktm) [08:34:27] 10Beta-Cluster-Infrastructure: deployment-prep hourly databases update times out - https://phabricator.wikimedia.org/T332507 (10hashar) a:03TheresNoTime Awesome @TheresNoTime . Does it mean that loosing the replica caused `Wikimedia\Rdbms\LoadMonitor::computeServerStates` to stale and thus prevented update.ph... [09:05:33] 10Gerrit, 10Release-Engineering-Team (Seen): Can't `git pull` mediawiki/core from Gerrit: "fatal: the remote end hung up unexpectedly" SSH_MSG_CHANNEL_WINDOW_ADJUST - https://phabricator.wikimedia.org/T263293 (10hashar) Upstream has another potentially related fix will will be in 3.5.6: https://gerrit-review.g... [09:25:13] 10Beta-Cluster-Infrastructure: deployment-prep hourly databases update times out - https://phabricator.wikimedia.org/T332507 (10TheresNoTime) >>! In T332507#8708750, @hashar wrote: > Does it mean that loosing the replica caused `Wikimedia\Rdbms\LoadMonitor::computeServerStates` to stale and thus prevented update... [09:25:46] "I honestly have no idea — resolving this was a mixture of luck, guessing and turning it off and on again..." may be the best phab comment I've made to date :D [09:27:01] Also a contender for most honest ever ;) [09:29:51] heh :p I got a load of respect for the folx who just *know* these things tbf [09:38:45] 10Gerrit, 10Abstract Wikipedia team, 10Tool-ducttape, 10WikiLambda: [wm-checks-api] support kindrobot - https://phabricator.wikimedia.org/T331651 (10hashar) This task prompted me to document how to add a bot account for Gerrit and some hint about the Checks UI https://wikitech.wikimedia.org/wiki/Gerrit/Bot... [09:50:38] 10Gerrit: Create a new gerrit bot for Patch Demo - https://phabricator.wikimedia.org/T332474 (10hashar) There is no robot per see in Gerrit, the only exception is the `its-phabricator` which adds comments to Phabricator whenever a change refers to a task (via `Bug: T####` in the commit headers). For [[ https://... [09:52:28] 10Beta-Cluster-Infrastructure: deployment-prep hourly databases update times out - https://phabricator.wikimedia.org/T332507 (10TheresNoTime) 05Open→03Resolved [09:54:34] taavi: I'd like to get some sort of notification for https://prometheus-alerts.wmcloud.org/?q=%40state%3Dactive&q=project%3Ddeployment-prep alerts — is that possible? :) [09:54:57] (iirc you set this up hence the ping, apologies if not!) [10:00:42] 10Gerrit: Create a new gerrit bot for Patch Demo - https://phabricator.wikimedia.org/T332474 (10hashar) I note patchdemo already has an API, for example https://patchdemo.wmflabs.org/api.php?patch=889642,73 yields: ` lang=json,lines=9 [ { "commit": "efebda9dae323e5c79ac296597a864dff28b2788", "parents":... [10:02:06] 10Phabricator: Cannot access workboard: Unhandled Exception: Undefined variable: other_assignees - https://phabricator.wikimedia.org/T332234 (10jcrespo) p:05Medium→03Unbreak! I found another major regression: I cannot read the task: https://phabricator.wikimedia.org/T331695 It says "Undefined index: state"... [10:06:07] 10Phabricator: Cannot access workboard: Unhandled Exception: Undefined variable: other_assignees - https://phabricator.wikimedia.org/T332234 (10TheresNoTime) >>! In T332234#8708974, @jcrespo wrote: > I found another major regression: I cannot read the task: https://phabricator.wikimedia.org/T331695 > > It says... [10:09:54] 10Phabricator: Cannot access workboard: Unhandled Exception: Undefined variable: other_assignees - https://phabricator.wikimedia.org/T332234 (10jcrespo) p:05Unbreak!→03Medium Weird, I double checked with 2 other SREs that stated the same issue (claime and volans). No problem, then. Maybe it got cached just f... [10:13:00] 10Phabricator: Cannot access workboard: Unhandled Exception: Undefined variable: other_assignees - https://phabricator.wikimedia.org/T332234 (10Clement_Goubert) Yeah, can confirm it now works, without having to log in or out. [10:42:43] TheresNoTime: yes, the possible notification types for now are email and irc. unfortunately they both need to be configured manually in a database, there's no public UI to manage that :( [10:49:31] ah ^^ [11:07:16] 10Continuous-Integration-Config, 10SRE-Sprint-Week-Sustainability-March2023, 10serviceops, 10Regression, 10Sustainability (Incident Followup): operations-apache-config-lint replacement doesn't check syntax - https://phabricator.wikimedia.org/T114801 (10Joe) 05Open→03Invalid a:03Joe We've dismissed... [11:07:30] 10Continuous-Integration-Infrastructure, 10SRE, 10Patch-For-Review: Jenkins: Re-enable lint checks for Apache config in operations-puppet - https://phabricator.wikimedia.org/T72068 (10Joe) [11:17:37] 10Beta-Cluster-Infrastructure, 10DBA, 10MediaWiki-libs-Rdbms, 10SRE-Sprint-Week-Sustainability-March2023, and 2 others: Enable MariaDB/MySQL's Strict Mode - https://phabricator.wikimedia.org/T108255 (10Joe) 05Open→03Stalled p:05Medium→03Low I fail to see how this task is related to incident followu... [11:19:00] TheresNoTime: so we can surely set up something (for example IRC alerts somewhere, or re-use the existing alerts mailing list), but you just need to nag me every time you want changes to the rules [11:20:10] 10Beta-Cluster-Infrastructure, 10DBA, 10MediaWiki-libs-Rdbms, 10SRE-Sprint-Week-Sustainability-March2023, and 2 others: Enable MariaDB/MySQL's Strict Mode - https://phabricator.wikimedia.org/T108255 (10Joe) Additionally: strict mode is on by default since mariadb 10.2, this has nothing to do with productio... [11:22:24] taavi: that works :) reusing `betacluster-alerts` makes sense [11:23:05] hashar: dancy: Is the scap-global-lock file still used/honoured? I noticed today that my reflex to check this file, resulted in me finding the file exists, but 1) the owner (samtar/TheresNoTime) didn't create it intentionally and 2) apparenlty scap sync-file doesn't care and proceeds anyway. [11:25:28] which suggests something recently created the file automatically on their behalf.. yet.. the obvious cause (scap deploy) isn't it because they never used scap on deploy2002 before. the second thing that comes to mind (rsync from deploy1002) doesnt' seem like the cause either since the file is different there and I see no replcation of this afaik. it's DC specific. [11:25:46] and given Scap apparently no longer cares about this file, I'd guess it doesnt' create it either even if it was somehow the reason [11:26:02] 10Beta-Cluster-Infrastructure, 10DBA, 10MediaWiki-libs-Rdbms, 10SRE-Sprint-Week-Sustainability-March2023, and 2 others: Enable MariaDB/MySQL's Strict Mode - https://phabricator.wikimedia.org/T108255 (10jcrespo) >>! In T108255#8709276, @Joe wrote: > I fail to see how this task is related to incident followu... [11:27:32] Krinkle: oh, I have used scap deply on deploy2002 before [11:27:44] just not today, think the last was Thursday? [11:27:58] ok, good to know. I hope that'll help releng debug this later. [11:28:02] don't worry for now :) [11:30:00] TheresNoTime: ok - you need to get a list admin to configure the list to allow posts from root@wmflabs.org and root@wmcloud.org, after that I can configure the prometheus side for that [11:53:36] Krinkle: TheresNoTime: I noticed the issue with the lock and created this to track it: https://phabricator.wikimedia.org/T330756 [11:53:44] my intention was to take care of it at the time, but got sidetracked and then forgot [11:53:51] sorry about that, I should have at least communicated the issue right away [11:54:02] basically, creating the global lock file now won't be honored, you will need to call `scap block --all` [12:15:24] 10Release-Engineering-Team, 10Observability-Logging, 10SRE, 10Wikimedia-Logstash, 10SRE Observability (FY2022/2023-Q3): mediawiki-errors logstash dashboard's "errors over time" panel broken - https://phabricator.wikimedia.org/T332273 (10TheresNoTime) >>! In T332273#8702656, @colewhite wrote: > The `Media... [12:38:00] Do we have stats on how many requests we see by logged in users, compared to the number of unauthenticated users? [12:38:19] 10Gerrit: Create a new gerrit bot for Patch Demo - https://phabricator.wikimedia.org/T332474 (10Esanders) >>! In T332474#8708971, @hashar wrote: > I note patchdemo already has an API, for example https://patchdemo.wmflabs.org/api.php?patch=889642,73 yields: > ` > lang=json,lines=9 > [ > { > "commit": "efeb... [12:49:22] duesen: traffic team might now? [12:49:58] ok, i'll cross-post my question ;) [12:50:00] or data engineering, I would assume they can find page views split by anonymous vs logged out [13:08:56] 10Gerrit: Create a new gerrit bot for Patch Demo - https://phabricator.wikimedia.org/T332474 (10Esanders) Either approach sounds good, although I wouldn't know how to implement the Check UI integration. If you know what to do there's a patch for the API up on GitHub. [13:11:47] duesen: varnish stats in Grafana. Session requests are "pass", unauth are hits or miss. [13:12:10] To discount non-pageview URLs try the same in Turnilo with is_pageview [13:12:47] (Noting that about 50% is load.php and other static stuff) [13:13:15] "wmf requests 128 sampled" [13:28:24] 10Gerrit: Create a new gerrit bot for Patch Demo - https://phabricator.wikimedia.org/T332474 (10hashar) I don't mind doing it, is merely about doing a `fetch()` processing the received data and return the CheckResults data structure described at https://gerrit.googlesource.com/gerrit/+/stable-3.5/polygerrit-ui/a... [14:33:33] (03PS1) 10Jameel Kaisar: Zuul: Add Jameel Kaisar Khan personal e-mail to CI allow list [integration/config] - 10https://gerrit.wikimedia.org/r/901221 [14:40:02] Krinkle: `scap lock` is what you want. [14:43:30] 10Scap: Improve behavior around global Scal lock + communicate changes - https://phabricator.wikimedia.org/T330756 (10dancy) I searched wikitech for references to `/var/lock/scap-global-lock`. These two pages need to be updated: https://wikitech.wikimedia.org/wiki/Switch_Datacenter/DeploymentServer https://wiki... [14:45:46] 10Scap: Improve behavior around global Scal lock + communicate changes - https://phabricator.wikimedia.org/T330756 (10taavi) The Puppet class `profile::mediawiki::deployment::server` needs to be updated too. [14:47:26] 10Scap: Improve behavior around global Scal lock + communicate changes - https://phabricator.wikimedia.org/T330756 (10dancy) >>! In T330756#8710386, @taavi wrote: > The Puppet class `profile::mediawiki::deployment::server` needs to be updated too. Thanks @taavi! [15:02:24] 10Release-Engineering-Team, 10Observability-Logging, 10SRE, 10Wikimedia-Logstash, 10SRE Observability (FY2022/2023-Q3): mediawiki-errors logstash dashboard's "errors over time" panel broken - https://phabricator.wikimedia.org/T332273 (10colewhite) 05Open→03Resolved a:03colewhite I went ahead and re... [15:21:50] (03CR) 10Hashar: [C: 03+2] Zuul: Add Jameel Kaisar Khan personal e-mail to CI allow list [integration/config] - 10https://gerrit.wikimedia.org/r/901221 (owner: 10Jameel Kaisar) [15:23:11] (03Merged) 10jenkins-bot: Zuul: Add Jameel Kaisar Khan personal e-mail to CI allow list [integration/config] - 10https://gerrit.wikimedia.org/r/901221 (owner: 10Jameel Kaisar) [15:23:15] 10Beta-Cluster-Infrastructure: deployment-prep hourly databases update times out - https://phabricator.wikimedia.org/T332507 (10hashar) >>! In T332507#8708918, @TheresNoTime wrote: > I honestly have no idea — resolving this was a mixture of luck, guessing and //turning it off and on again//... I fully agree! T... [15:24:08] (03CR) 10Hashar: [C: 03+2] "Deployed! So you should now have CI running for your patch and be able to comment `recheck` on patches to trigger a CI run." [integration/config] - 10https://gerrit.wikimedia.org/r/901221 (owner: 10Jameel Kaisar) [15:27:48] 10Gerrit, 10Release-Engineering-Team (Priority Backlog 📥), 10SRE-OnFire, 10SRE-Sprint-Week-Sustainability-March2023, and 3 others: gerrit1001 running out of space on / - https://phabricator.wikimedia.org/T323262 (10Volans) Is there anything left to do here related to #sre-onfire or #wikimedia-incident-acti... [15:32:04] (03PS1) 10Jameel Kaisar: Revert "Zuul: Add Jameel Kaisar Khan personal e-mail to CI allow list" [integration/config] - 10https://gerrit.wikimedia.org/r/901150 [15:32:57] (03CR) 10Ayounsi: [C: 03+1] "Thanks!" [integration/config] - 10https://gerrit.wikimedia.org/r/901150 (owner: 10Jameel Kaisar) [15:33:47] (03CR) 10CI reject: [V: 04-1] Revert "Zuul: Add Jameel Kaisar Khan personal e-mail to CI allow list" [integration/config] - 10https://gerrit.wikimedia.org/r/901150 (owner: 10Jameel Kaisar) [15:35:16] (03PS2) 10Jameel Kaisar: Revert "Zuul: Add Jameel Kaisar Khan personal e-mail to CI allow list" [integration/config] - 10https://gerrit.wikimedia.org/r/901150 [15:39:22] 10Gerrit, 10Release-Engineering-Team (Priority Backlog 📥), 10SRE-OnFire, 10SRE-Sprint-Week-Sustainability-March2023, and 3 others: gerrit1001 running out of space on / - https://phabricator.wikimedia.org/T323262 (10jcrespo) I believe this was only open waiting for the incident writing, which happened long... [16:03:15] 10GitLab, 10Phabricator, 10Release-Engineering-Team, 10User-brennen: GitLab MR widget sometimes errors out on a missing index - https://phabricator.wikimedia.org/T332607 (10brennen) [16:04:06] 10Phabricator: Cannot access workboard: Unhandled Exception: Undefined variable: other_assignees - https://phabricator.wikimedia.org/T332234 (10brennen) > It says "Undefined index: state" in an unhandled exception, maybe triggered by the recent upgrade (and revert?). This is almost certainly from recently deplo... [16:11:14] 10Phabricator (Upstream), 10Legalpad, 10Upstream: Granularize Legalpad view/edit/sign permissions - https://phabricator.wikimedia.org/T194148 (10valerio.bozzolan) [16:13:03] 10Phabricator, 10Release-Engineering-Team, 10Security-Team, 10SecTeam-Processed, 10user-sbassett: Phabricator Admin Access Request for Scott Bassett - https://phabricator.wikimedia.org/T331928 (10sbassett) @Aklapper - seems like there are no objections here, with at least one blessing from the #release-e... [16:18:47] (03CR) 10Hashar: [C: 03+2] "Of course @wikimedia.org emails are automatically allowed (there is a wildcard regex somewhere in the stack). Once merged, any changes pe" [integration/config] - 10https://gerrit.wikimedia.org/r/901150 (owner: 10Jameel Kaisar) [16:19:56] (03Merged) 10jenkins-bot: Revert "Zuul: Add Jameel Kaisar Khan personal e-mail to CI allow list" [integration/config] - 10https://gerrit.wikimedia.org/r/901150 (owner: 10Jameel Kaisar) [16:24:46] (03CR) 10Hashar: [C: 03+2] "Deployed" [integration/config] - 10https://gerrit.wikimedia.org/r/901150 (owner: 10Jameel Kaisar) [16:35:50] 10GitLab, 10Phabricator, 10Release-Engineering-Team, 10User-brennen: GitLab MR widget sometimes errors out on a missing index - https://phabricator.wikimedia.org/T332607 (10brennen) Yep: `lines=10 (RuntimeException) Undefined index: state at [/src/error/PhutilErrorHandler.php:251]PHP message: ar... [16:46:58] 10Phabricator, 10Release-Engineering-Team (Radar), 10Patch-For-Review, 10User-brennen: Show "other assignee" avatar on tasks in workboard - https://phabricator.wikimedia.org/T329974 (10Jdlrobson) Are we trying this patch again? Anything I can do to help move this one along? [16:55:11] 10Phabricator, 10Release-Engineering-Team (Radar), 10Patch-For-Review, 10User-brennen: Show "other assignee" avatar on tasks in workboard - https://phabricator.wikimedia.org/T329974 (10brennen) Yes, once I'm confident in a fix for {T332234}. I'll probably schedule a brief update window yet this week. [17:02:11] 10GitLab (CI & Job Runners), 10Release-Engineering-Team (GitLab V: Event Horizon 🌄), 10serviceops-collab, 10serviceops-radar, 10Patch-For-Review: Set up mirror of the docker hub registry for gitlab-runners - https://phabricator.wikimedia.org/T329679 (10dancy) [17:03:44] 10Scap, 10MW-on-K8s, 10serviceops, 10Patch-For-Review: Add a flag to scap to force updating the /etc/helmfile-defaults/mediawiki/release/* files - https://phabricator.wikimedia.org/T332187 (10jnuche) a:03jnuche [17:21:09] 10Release-Engineering-Team, 10Scap, 10SRE-Sprint-Week-Sustainability-March2023, 10Sustainability (Incident Followup): Add failure rate triggered rollback to scap - https://phabricator.wikimedia.org/T317405 (10Joe) Re-tagging to the team responsible for scap. [17:22:52] 10Scap, 10SRE-OnFire, 10SRE-Sprint-Week-Sustainability-March2023, 10serviceops, 10Sustainability (Incident Followup): Add etcdmirror status check to scap - https://phabricator.wikimedia.org/T317403 (10Joe) [17:51:20] 10Release-Engineering-Team, 10Scap, 10Wikimedia-IEG-grant-review: scap deploy fails for iegreview - https://phabricator.wikimedia.org/T332623 (10Dzahn) [17:51:46] 10Release-Engineering-Team, 10Scap, 10Wikimedia-IEG-grant-review, 10serviceops-collab: scap deploy fails for iegreview - https://phabricator.wikimedia.org/T332623 (10Dzahn) [17:52:15] 10Release-Engineering-Team, 10Scap, 10Wikimedia-IEG-grant-review, 10serviceops-collab: scap deploy fails for iegreview - https://phabricator.wikimedia.org/T332623 (10Dzahn) [17:53:36] 10Release-Engineering-Team, 10Scap, 10Wikimedia-IEG-grant-review, 10serviceops-collab: scap deploy fails for iegreview - https://phabricator.wikimedia.org/T332623 (10Dzahn) p:05Triage→03High [18:29:34] 10Project-Admins: Requests for addition to the #acl*Project-Admins group (in comments) - https://phabricator.wikimedia.org/T706 (10MShilova_WMF) Hi There, I am a Sr. TPgM supporting the #Growth-Team. I need to modify two Phab task templates: # [[ https://phabricator.wikimedia.org/maniphest/task/edit/form/1/?p... [19:38:14] dancy: the main reason I avoided the command so far is that it logs to SAL which feels overkill for merely following the (imho useful) practice of locking for the 10min around staging and testing a change, to avoid incomplete or untested deploys. I feel that logging them is putting an undue burden on the channel and logs, feels like too big a deal compared to eg locking because of external reasons. The same way that eg a regular [19:38:14] deploy also doesn't log a lock during the first 10min of a sync despite presumably having a lock by then [19:39:18] 10Release-Engineering-Team, 10Scap, 10Wikimedia-IEG-grant-review, 10serviceops-collab: scap deploy fails for iegreview - https://phabricator.wikimedia.org/T332623 (10Dzahn) Still the old issue from years ago, as evidenced by server name "tin". ` root@miscweb1003:/srv/deployment/iegreview# grep git_server... [19:41:14] Krinkle: I will add that feedback to T330756 [19:41:15] T330756: Improve behavior around global Scal lock + communicate changes - https://phabricator.wikimedia.org/T330756 [19:41:28] 10Scap, 10Patch-For-Review: scap deploy-local should make fewer assumptions about server/directories - https://phabricator.wikimedia.org/T146602 (10Dzahn) in 2023 we still have 'tin.eqiad.wmnet' configured as git_server on brandnew machines. This blocks first deploys and keeps coming back all the time. ` roo... [19:41:52] 10Release-Engineering-Team, 10Scap, 10Wikimedia-IEG-grant-review, 10serviceops-collab: scap deploy fails for iegreview - https://phabricator.wikimedia.org/T332623 (10Dzahn) maybe it's T146602 [19:42:39] 10Release-Engineering-Team, 10Scap, 10Wikimedia-IEG-grant-review, 10serviceops-collab: scap deploy fails for iegreview - https://phabricator.wikimedia.org/T332623 (10Dzahn) or T257317 [19:43:39] 10Scap: scap deploy --init on deployment server fails on first puppet run - https://phabricator.wikimedia.org/T257317 (10Dzahn) T332623 We are still getting `tin.eqiad.wmnet` defined as initial git server. This is a brandnew machine created merely days ago: ` root@miscweb1003:/srv/deployment/iegreview# grep g... [19:44:13] root@miscweb1003:/# grep git_server /srv/deployment/iegreview/iegreview-cache/.config [19:44:16] git_server: tin.eqiad.wmnet [19:44:22] Krinkle: Before I do that, will the existing `--no-no-message` flag satisfy you? [19:44:29] ^ tin is just never going away but it must come from SOMEWHERE [19:44:30] er.. `--no-log-message` [19:49:34] 10Scap: Improve behavior around global Scal lock + communicate changes - https://phabricator.wikimedia.org/T330756 (10dancy) Feedback on `scap lock` from @Krinkle ` dancy: the main reason I avoided the command so far is that it logs to SAL which feels overkill for merely following the (imho useful) practice of... [19:50:20] 10Release-Engineering-Team, 10Scap, 10Wikimedia-IEG-grant-review, 10serviceops-collab: scap deploy fails for iegreview - https://phabricator.wikimedia.org/T332623 (10Dzahn) [19:50:30] 10Scap: scap deploy --init on deployment server fails on first puppet run - https://phabricator.wikimedia.org/T257317 (10Dzahn) [19:55:14] mutante: deploy2002:/srv/deployment/iegreview/iegreview/.git/DEPLOY_HEAD has that line in it [19:57:13] 7 hits for `find /srv/deployment -name DEPLOY_HEAD | xargs fgrep tin.eqiad |wc -l` [20:04:19] dancy: yes, thank you, though tin was decom'ed in 2018 and deploy2002 did not exist until 2020 [20:05:29] Presumably /srv/deployment was rsync'd over from an older deploy server at some point. [20:05:51] * dancy makes guesses [20:16:13] 10GitLab (CI & Job Runners), 10Release-Engineering-Team (GitLab V: Event Horizon 🌄), 10Patch-For-Review: Mitigate thundering herd on GitLab runners - https://phabricator.wikimedia.org/T327416 (10dduvall) 05Open→03Resolved The last few rounds of load testing, whereby 100 concurrent image-build jobs are tr... [20:41:08] 10Phabricator, 10Release-Engineering-Team, 10Security-Team: Make it more difficult to unintentionally paste secrets, passwords, and keys in Phabricator task descriptions, comments and pastes - https://phabricator.wikimedia.org/T332639 (10kostajh) [21:40:07] 10Phabricator, 10Release-Engineering-Team, 10Security-Team, 10SecTeam-Processed, 10user-sbassett: Phabricator Admin Access Request for Scott Bassett - https://phabricator.wikimedia.org/T331928 (10Aklapper) Anyone please feel free to go ahead - thanks! [21:41:22] 10Phabricator, 10Release-Engineering-Team, 10Security-Team, 10SecTeam-Processed, 10user-sbassett: Phabricator Admin Access Request for Scott Bassett - https://phabricator.wikimedia.org/T331928 (10brennen) a:03brennen [21:43:25] !log phabricator: setting sbassett to administrator per T331928 [21:43:28] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [21:43:29] T331928: Phabricator Admin Access Request for Scott Bassett - https://phabricator.wikimedia.org/T331928 [21:43:56] 10Phabricator, 10Release-Engineering-Team, 10Security-Team, 10SecTeam-Processed, 10user-sbassett: Phabricator Admin Access Request for Scott Bassett - https://phabricator.wikimedia.org/T331928 (10brennen) 05Open→03Resolved [21:57:36] 10Phabricator, 10Release-Engineering-Team, 10Security-Team: Make it more difficult to unintentionally paste secrets, passwords, and keys in Phabricator task descriptions, comments and pastes - https://phabricator.wikimedia.org/T332639 (10Aklapper) p:05Triage→03Low [22:01:44] 10GitLab (Integrations), 10Release-Engineering-Team, 10Patch-For-Review, 10Software-Licensing, 10User-brennen: https://gitlab.wikimedia.org/repos/releng/gitlab-phabricator needs a LICENSE file - https://phabricator.wikimedia.org/T331943 (10brennen) 05Open→03In progress [22:02:19] 10Phabricator, 10Release-Engineering-Team, 10Security-Team: Make it more difficult to unintentionally paste secrets, passwords, and keys in Phabricator task descriptions, comments and pastes - https://phabricator.wikimedia.org/T332639 (10sbassett) So there are at least a few CLI tools - [[ https://github.com... [22:19:29] 10Phabricator, 10Release-Engineering-Team (Radar), 10Patch-For-Review, 10User-brennen: Show "other assignee" avatar on tasks in workboard - https://phabricator.wikimedia.org/T329974 (10brennen) [22:20:22] 10Phabricator, 10Release-Engineering-Team, 10Patch-For-Review, 10User-brennen: Cannot access workboard: Unhandled Exception: Undefined variable: other_assignees - https://phabricator.wikimedia.org/T332234 (10brennen) 05Open→03In progress [22:26:03] 10Phabricator, 10Release-Engineering-Team, 10User-brennen: Work out how to bring in new Phabricator translations again - https://phabricator.wikimedia.org/T318763 (10brennen) [22:28:28] 10Phabricator, 10Release-Engineering-Team, 10User-brennen: Move phabricator/deployments repository from Differential to Gerrit - https://phabricator.wikimedia.org/T321380 (10brennen) 05Open→03Declined All but a couple of these have moved to GitLab at this point: https://gitlab.wikimedia.org/repos/phabri... [22:30:36] 10Diffusion, 10Phabricator (Upstream): Error trying to view previous git blame ("Skip past this commit" button): "reset() expects parameter 1 to be array, null given" - https://phabricator.wikimedia.org/T274559 (10brennen) [22:32:21] 10Phabricator (Upstream), 10Developer Productivity: Disable hiding of older Phabricator task comments by default (yellow "Show Older Changes" bar in Maniphest) - https://phabricator.wikimedia.org/T912 (10brennen) [22:38:02] 10GitLab (Integrations), 10Release-Engineering-Team, 10Patch-For-Review, 10Software-Licensing, 10User-brennen: https://gitlab.wikimedia.org/repos/releng/gitlab-phabricator needs a LICENSE file - https://phabricator.wikimedia.org/T331943 (10brennen) 05In progress→03Resolved [23:07:26] 10Release-Engineering-Team (Priority Backlog 📥), 10Patch-For-Review, 10Release, 10Train Deployments: 1.40.0-wmf.20 deployment blockers - https://phabricator.wikimedia.org/T325583 (10brennen) 05Open→03Resolved