[00:05:15] 06Project-Admins, 06Movement-Insights: Create data-problem Phabricator tag - https://phabricator.wikimedia.org/T362839#9724850 (10nshahquinn-wmf) [00:05:37] 06Release-Engineering-Team, 10Scap, 06serviceops: scap should optionally display helmfile diffs for review - https://phabricator.wikimedia.org/T362717#9724858 (10Scott_French) Thanks, Reuven. Once that's available, it would be good to figure out whether it's straightforward to make the regex precise enough t... [00:09:42] 10Release-Engineering-Team (Radar), 06collaboration-services, 13Patch-For-Review: upgrade contint servers to bullseye - https://phabricator.wikimedia.org/T334517#9724869 (10Dzahn) - confirmed rsync commands are working and executed them as noted in the runbook above - /srv/jenkins , /var/lib/zuul and /var/li... [00:12:01] 06Project-Admins, 06Movement-Insights: Create data-problem Phabricator tag - https://phabricator.wikimedia.org/T362839#9724874 (10nshahquinn-wmf) One question is how we should handle issues where the data shows spikes or anomalies which are likely related to external factors (e.g. bot users) rather than a clea... [00:39:14] 06Project-Admins, 06Movement-Insights: Create data-problem Phabricator tag - https://phabricator.wikimedia.org/T362839#9724921 (10Mayakp.wiki) Ty @nshahquinn-wmf for opening this task. Sharing my initial thoughts below: - Agree that we should tag all the tasks that reports data anomalies with this tag, for no... [02:15:47] 06Project-Admins, 06Movement-Insights: Create data-problem Phabricator tag - https://phabricator.wikimedia.org/T362839#9725017 (10nshahquinn-wmf) >>! In T362839#9724921, @Mayakp.wiki wrote: > - I would like us to use this tag for data issues reported Community as well. Not sure if you already intended that but... [05:30:13] (03CR) 10Subramanya Sastry: [C:03+2] "Turns out this introduces a lot of noise in diffing because of https://phabricator.wikimedia.org/T358452 ... see the new run and the regre" [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/1019280 (owner: 10Jgiannelos) [08:10:08] (03PS1) 10Majavah: Zuul: [mediawiki/libs/UpdateHistory] Configure CI [integration/config] - 10https://gerrit.wikimedia.org/r/1021369 [08:24:04] 10Continuous-Integration-Infrastructure, 07Jenkins, 06Release-Engineering-Team, 07Security: Jenkins core security advisory 2024-04-17 - https://phabricator.wikimedia.org/T362852 (10jnuche) 03NEW [08:25:27] 10Continuous-Integration-Infrastructure, 07Jenkins, 06Release-Engineering-Team, 07Security: Jenkins core security advisory 2024-04-17 - https://phabricator.wikimedia.org/T362852#9725340 (10jnuche) The vulnerability affects the CLI client over SSH transport only. None of our CI and Release instances have th... [09:02:17] 10Continuous-Integration-Infrastructure, 07Jenkins, 06Release-Engineering-Team, 07Security: Jenkins core security advisory 2024-04-17 - https://phabricator.wikimedia.org/T362852#9725480 (10MoritzMuehlenhoff) Do you still want me to import the latest LTS release (like for non-security fixes) or shall we ski... [10:23:56] 10Continuous-Integration-Infrastructure, 07Jenkins, 06Release-Engineering-Team, 07Security: Jenkins core security advisory 2024-04-17 - https://phabricator.wikimedia.org/T362852#9725716 (10hashar) There are a few more changes, I guess they are trivial ones since they did not make it in the release notes. `... [10:36:38] 06Gerrit-Privilege-Requests: Grant +2 rights to Simone Cuomo for the QuickSurveys repo - https://phabricator.wikimedia.org/T362866#9725776 (10SCherukuwada) [10:41:36] 06Gerrit-Privilege-Requests: Grant +2 rights to Simone Cuomo for the QuickSurveys repo - https://phabricator.wikimedia.org/T362866#9725790 (10SCherukuwada) I think ThisDot should be in the table here: https://www.mediawiki.org/wiki/Gerrit/Privilege_policy#Expedited_process_for_trusted_organisations I'll see abo... [10:55:50] 10Continuous-Integration-Infrastructure, 07Developer Productivity: CI depending on GitHub results in numerous failures outside our control - https://phabricator.wikimedia.org/T362426#9725831 (10Aklapper) [10:57:34] 10Continuous-Integration-Infrastructure, 07Jenkins, 06Release-Engineering-Team, 07Security: Jenkins core security advisory 2024-04-17 - https://phabricator.wikimedia.org/T362852#9725835 (10MoritzMuehlenhoff) >>! In T362852#9725716, @hashar wrote: > I am fine skipping this update. Ack! [10:58:25] 10Gerrit, 07Documentation: Update screenshots and text in Gerrit tutorial on branch name "main" - https://phabricator.wikimedia.org/T299683#9725849 (10Aklapper) [11:06:00] 10Phabricator, 06Security-Team, 07SecTeam-Processed, 07Security: Audit members of acl*security for more than 12 months of no activity (May 2024) - https://phabricator.wikimedia.org/T337305#9725890 (10Aklapper) 05Stalledβ†’03Open [11:09:41] 10Phabricator, 06Security-Team, 07SecTeam-Processed, 07Security: Audit members of acl*security for more than 12 months of no activity (May 2024) - https://phabricator.wikimedia.org/T337305#9725892 (10Aklapper) [11:16:03] 06Release-Engineering-Team, 10Scap, 10MW-on-K8s, 06serviceops: Find a way to stage updated PHP packages on wikikube - https://phabricator.wikimedia.org/T362628#9725897 (10MoritzMuehlenhoff) >>! In T362628#9722794, @akosiaris wrote: >> * If a new image found to be okay, have some script/option/tool to promo... [11:23:24] 10Gerrit, 07Documentation: Update screenshots and text in Gerrit tutorial on branch name "main" - https://phabricator.wikimedia.org/T299683#9725910 (10hashar) 05Stalledβ†’03Declined It is now unlikely we will fully migrate out of Gerrit and our obsolete CI (Zuul) currently hardcode `master` as the defaul... [11:31:23] 06Gerrit-Privilege-Requests: Grant +2 rights to Simone Cuomo for the QuickSurveys repo - https://phabricator.wikimedia.org/T362866#9725977 (10taavi) >>! In T362866#9725790, @SCherukuwada wrote: > I think ThisDot should be in the table here: https://www.mediawiki.org/wiki/Gerrit/Privilege_policy#Expedited_process... [11:55:19] 10Gerrit, 07Upstream: Allow searching for 'state:active', 'state:read_only', 'state:hidden' via web interface - https://phabricator.wikimedia.org/T180297#9726025 (10Paladox) You can search `state:active` or state:read-only in the UI. Doesn't seem to support hidden. [11:59:49] 10Gerrit, 07Upstream: Horizontal scrollbars are missing when needed in Gerrit - https://phabricator.wikimedia.org/T257705#9726032 (10Paladox) This seems fixed at least scroll bars show for me now. [12:00:47] 10Gerrit, 07Upstream: Horizontal scrollbars are missing when needed in Gerrit - https://phabricator.wikimedia.org/T257705#9726033 (10Paladox) Oh... It misses the end " bit. [12:08:32] 10Gerrit, 07Upstream: Horizontal scrollbars are missing when needed in Gerrit - https://phabricator.wikimedia.org/T257705#9726041 (10Paladox) I think this may be fixed in gerrit 3.9 based on testing locally. I can't reproduce on master but I remember work on the diff screen being done for that release. [12:11:04] 10GitLab (Infrastructure), 06collaboration-services, 03Wikimedia-Hackathon-2024: Create a custom GitLab Prometheus exporter - https://phabricator.wikimedia.org/T354656#9726055 (10Jelto) a:03Jelto [12:27:49] 06Project-Admins, 06Movement-Insights: Create data-problem Phabricator tag - https://phabricator.wikimedia.org/T362839#9726106 (10WDoranWMF) +1 to this proposal. Having the ability to separately categorise and manage these issue will help tremendously both with triaging and tracking issues for Data Platform En... [12:38:32] 10Release-Engineering-Team (Now this 🫠), 10Scap, 13Patch-For-Review: scap backport check prevents using it to fix an about-to-be-live branch - https://phabricator.wikimedia.org/T317795#9726142 (10CodeReviewBot) sandeeps merged https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/208 scap backport... [12:51:35] 10Release-Engineering-Team (Now this 🫠), 10Scap, 13Patch-For-Review: scap backport check prevents using it to fix an about-to-be-live branch - https://phabricator.wikimedia.org/T317795#9726221 (10Sandeeps) 05In progressβ†’03Resolved [13:17:11] 06Gerrit-Privilege-Requests: Grant +2 rights to Simone Cuomo for the QuickSurveys repo - https://phabricator.wikimedia.org/T362866#9726324 (10SCherukuwada) Hello Taavi, Thanks for responding. I'll leave the trusted organization list alone for now - it clearly needs more thought/discussion. [13:46:29] Project beta-scap-sync-world build #151131: 04FAILURE in 1 min 4 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/151131/ [13:56:38] Yippee, build fixed! [13:56:39] Project beta-scap-sync-world build #151132: 09FIXED in 1 min 19 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/151132/ [14:00:08] flappy flap due to an error rate [14:01:00] (03CR) 10Hashar: [C:03+2] Zuul: [mediawiki/libs/UpdateHistory] Configure CI [integration/config] - 10https://gerrit.wikimedia.org/r/1021369 (owner: 10Majavah) [14:02:34] (03Merged) 10jenkins-bot: Zuul: [mediawiki/libs/UpdateHistory] Configure CI [integration/config] - 10https://gerrit.wikimedia.org/r/1021369 (owner: 10Majavah) [14:12:17] (03CR) 10Hashar: [C:03+2] "Deployed" [integration/config] - 10https://gerrit.wikimedia.org/r/1021369 (owner: 10Majavah) [14:15:13] 10Phabricator, 10Release-Engineering-Team (Priority Backlog πŸ“₯), 07Performance Issue: Submitting actions taking ~10 seconds to load after making changes - https://phabricator.wikimedia.org/T360484#9726626 (10Aklapper) Summary: * Folks have experienced this both with Chrome and Firefox (and other browsers), th... [14:22:27] 10Phabricator, 10Release-Engineering-Team (Priority Backlog πŸ“₯), 07Performance Issue: Submitting actions taking ~10 seconds to load after making changes - https://phabricator.wikimedia.org/T360484#9726685 (10hashar) > Less realistic: Per https://we.phorge.it/book/phorge/article/performance/ I realized that "T... [14:25:53] 10Scap, 10MW-on-K8s: Provide some feedback in scap whilst waiting for helmfile deploys to complete - https://phabricator.wikimedia.org/T361747#9726697 (10Lucas_Werkmeister_WMDE) > It looks like it’s possible to get similar information out of Kubernetes: Slightly refined version until something better comes al... [14:26:29] 10Phabricator: Production error phabricator form is missing an obvious place to place the RequestID - https://phabricator.wikimedia.org/T352629#9726699 (10Aklapper) 05Openβ†’03Resolved a:03Aklapper Thanks! I removed it from the form preamble: https://phabricator.wikimedia.org/transactions/editengine/mani... [14:35:10] 10Phabricator: Phab Forms 70 and 81 look like duplicates of form 47 - https://phabricator.wikimedia.org/T279785#9726731 (10Aklapper) 05Openβ†’03Resolved a:03Aklapper I disabled Form 70 today (looks like I disabled Form 81 more than a year ago). As this was not marked as a Create or Edit form, this should... [14:45:57] 10Phabricator: Production error phabricator form is missing an obvious place to place the RequestID - https://phabricator.wikimedia.org/T352629#9726776 (10Novem_Linguae) Thanks for your work on this. Consider changing `* [[ URL | Logstash single document ]]` to `* [[ Logstash single document URL | Request I... [14:50:27] 10Phabricator: Production error phabricator form is missing an obvious place to place the RequestID - https://phabricator.wikimedia.org/T352629#9726791 (10Aklapper) Good points, thanks, again! Changed. [14:52:12] 10Phabricator: Production error phabricator form is missing an obvious place to place the RequestID - https://phabricator.wikimedia.org/T352629#9726806 (10Novem_Linguae) Looks perfect now. Thanks! [14:59:32] 10Release-Engineering-Team (Now this 🫠), 10Scap, 13Patch-For-Review: scap backport check prevents using it to fix an about-to-be-live branch - https://phabricator.wikimedia.org/T317795#9726819 (10CodeReviewBot) dancy closed https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/214 Add test cas... [15:10:54] 10Phabricator: Mark ReleaseTaggerBot Phabricator account as bot in database - https://phabricator.wikimedia.org/T329748#9726836 (10Aklapper) ...and https://gerrit.wikimedia.org/r/plugins/gitiles/labs/tools/forrestbot/+/refs/heads/master/forrestbot.py#38 looks correct enough to my eyes to survive a switch from `s... [15:25:57] 10Phabricator: Remove @wikimedia.org addresses as primary address from active Phabricator accounts who are not staff anymore - https://phabricator.wikimedia.org/T331703#9726929 (10Aklapper) [16:22:07] (03PS1) 10Hashar: jjb: force ansi coloring in composer [integration/config] - 10https://gerrit.wikimedia.org/r/1021514 [16:30:30] (03CR) 10Krinkle: [C:03+1] "Nice!" [software/gerrit] (deploy/wmf/stable-3.8) - 10https://gerrit.wikimedia.org/r/1020840 (https://phabricator.wikimedia.org/T358253) (owner: 10Hashar) [16:31:20] 10Fresh: Update to Node 18.20.2 - https://phabricator.wikimedia.org/T362908 (10MusikAnimal) 03NEW [16:33:25] 10Fresh, 06Release-Engineering-Team: Update to Node 18.20.2 - https://phabricator.wikimedia.org/T362908#9727194 (10Krinkle) [16:34:01] 10Fresh, 06Release-Engineering-Team: Update to Node 18.20.2 - https://phabricator.wikimedia.org/T362908#9727202 (10Krinkle) [16:34:06] 10Fresh, 06Release-Engineering-Team: Update to Node 18.20.2 - https://phabricator.wikimedia.org/T362908#9727207 (10Krinkle) [16:34:07] 10Continuous-Integration-Infrastructure: Create WMF CI images and jobs for Node.js 18 - https://phabricator.wikimedia.org/T331181#9727208 (10Krinkle) [16:34:41] 10Fresh, 06Release-Engineering-Team: Update to Node 18.20.2 - https://phabricator.wikimedia.org/T362908#9727211 (10Krinkle) [17:03:43] 10Phabricator, 10Striker: Diffusion mirrors of GitLab repos failing to be created by Striker - https://phabricator.wikimedia.org/T362909 (10bd808) 03NEW [17:12:31] 10Phabricator, 10Striker: Diffusion mirrors of GitLab repos failing to be created by Striker - https://phabricator.wikimedia.org/T362909#9727422 (10bd808) I was able to create {R3385} via the Phabricator UI. Is it only the Conduit API that is failing? Are the failures intermittent? [17:17:40] 10Fresh, 06Release-Engineering-Team: Update to Node 18.20.2 - https://phabricator.wikimedia.org/T362908#9727437 (10Krinkle) To RelEng: The way we usually structure these tasks is to link to the previous one for the same purpose (Fresh) and track "Create image" as the subtask. Usually we try to time it so that... [17:33:02] 10Phabricator, 10Striker: Diffusion mirrors of GitLab repos failing to be created by Striker - https://phabricator.wikimedia.org/T362909#9727521 (10bd808) [18:00:33] 10Phabricator, 10Striker: Diffusion mirrors of GitLab repos failing to be created by Striker - https://phabricator.wikimedia.org/T362909#9727661 (10Aklapper) @bd808: Does this error still appear after 2024-04-16 15:30UTC? If not, then this is likely a duplicate of T355644 (which reverted T352530 which I ideall... [18:11:39] 10Release-Engineering-Team (Radar), 03Wikimedia-Hackathon-2024: [Session] Using kokkuri to build container images on GitLab CI - https://phabricator.wikimedia.org/T361937#9727718 (10brennen) [18:24:10] 10GitLab (CI & Job Runners), 06Release-Engineering-Team: `npm ci` not working on trusted runners for https://gitlab.wikimedia.org/repos/data-engineering/superset - https://phabricator.wikimedia.org/T353197#9727775 (10brennen) [18:24:40] 10GitLab (Integrations), 06collaboration-services: Review the capabilities of the Gitlab slack app - https://phabricator.wikimedia.org/T353034#9727777 (10brennen) [18:25:15] 10GitLab (Integrations), 10Tool-extjsonuploader: Support gitlab.wikimedia.org in extjsonuploader - https://phabricator.wikimedia.org/T352831#9727782 (10brennen) [18:25:22] 10GitLab (Upstream pit of despair πŸ•³οΈ), 07Privacy: Gitlab attempts to reach gitlab CDN when using the Web IDE - https://phabricator.wikimedia.org/T350931#9727785 (10brennen) [18:27:42] 10GitLab (Project Migration), 10GitLab-Application-Security-Pipeline, 10Codex, 10Design-System-Team (Design-System-Product-Roadmap), 07Epic: Consider migrating Codex repo to Gitlab - https://phabricator.wikimedia.org/T352488#9727791 (10brennen) [18:27:46] 10GitLab (Infrastructure), 10Release-Engineering-Team (Radar), 10ChangeProp, 06collaboration-services, and 10 others: Figure out a plan to move forward with regarding Redis License changes - https://phabricator.wikimedia.org/T360596#9727771 (10brennen) [18:55:02] 06Gerrit-Privilege-Requests: Grant +2 rights to Simone Cuomo for the QuickSurveys repo - https://phabricator.wikimedia.org/T362866#9727902 (10thcipriani) 05Openβ†’03Resolved a:03thcipriani >>! In T362866#9725977, @taavi wrote: >>>! In T362866#9725790, @SCherukuwada wrote: >> I think ThisDot should be in... [18:59:00] 10Fresh, 06Release-Engineering-Team: Update Fresh's version of Node 18 from 18.17.0 to 18.20.2 - https://phabricator.wikimedia.org/T362908#9727923 (10Jdforrester-WMF) [18:59:31] 06Release-Engineering-Team, 10Scap: scap backport bad behavior if invalid change number is supplied - https://phabricator.wikimedia.org/T362927 (10dancy) 03NEW [18:59:53] 06Release-Engineering-Team, 10Scap: scap backport bad behavior if nonexistent change number is supplied - https://phabricator.wikimedia.org/T362927#9727935 (10dancy) [19:29:31] 06Release-Engineering-Team, 06Infrastructure-Foundations, 06serviceops, 13Patch-For-Review: Deprecate buster-backports - https://phabricator.wikimedia.org/T362518#9728020 (10dancy) [19:34:39] 10Phabricator, 10Striker: Diffusion mirrors of GitLab repos failing to be created by Striker - https://phabricator.wikimedia.org/T362909#9728028 (10bd808) >>! In T362909#9727661, @Aklapper wrote: > @bd808: Does this error still appear after 2024-04-16 15:30UTC? If not, then this is likely a duplicate of T35564... [19:35:43] 06Release-Engineering-Team, 06Infrastructure-Foundations, 06serviceops, 13Patch-For-Review: Deprecate buster-backports - https://phabricator.wikimedia.org/T362518#9728031 (10dancy) Nothing that I'm blocked on scap development/testing in train-dev due to `docker-registry.wikimedia.org/mediawiki-httpd:latest... [20:13:16] 06Release-Engineering-Team, 10Scap, 13Patch-For-Review: scap backport bad behavior if nonexistent change number is supplied - https://phabricator.wikimedia.org/T362927#9728086 (10CodeReviewBot) dancy opened https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/290 backport: Fix bad behavior if non... [20:16:25] 10Gerrit (Gerrit 3.7): Gerrit 3.7.8: CI has completed checks. Reload the change view? RELOAD button doesn't work - https://phabricator.wikimedia.org/T360550#9728091 (10hashar) I have tried with Gerrit 3.8.5 and it still does not work. The debug console has: ` show-alert: {"text":"CI has completed checks. Reload... [20:39:20] 10Gerrit (Gerrit 3.7): Gerrit 3.7.8: CI has completed checks. Reload the change view? RELOAD button doesn't work - https://phabricator.wikimedia.org/T360550#9728167 (10hashar) As a side note, when a new patchset has been uploaded, after some minutes a popup shows "A newer patchset has been uploaded {nav RELOAD}... [20:51:19] 10GitLab (Integrations), 13Patch-For-Review: [gitlab-webhooks] Provide a server-sent events API for rebroadcast of GitLab webhook data - https://phabricator.wikimedia.org/T362288#9728188 (10CodeReviewBot) bd808 merged https://gitlab.wikimedia.org/repos/releng/gitlab-webhooks/-/merge_requests/28 Provide a serv... [21:56:00] 10Gerrit, 07Mobile: Missing sign in links on mobile - https://phabricator.wikimedia.org/T344891#9728308 (10Paladox) This appears to be because items are being pushed out of screen. I did a hack https://gerrit-review.googlesource.com/c/gerrit/+/420278. The better fix and something I'm pushing and looking at is... [22:08:59] 10Gerrit, 07Mobile: Missing sign in links on mobile - https://phabricator.wikimedia.org/T344891#9728312 (10Dzahn) When you click the "Sign Up" and on that next screen scroll down a bit, there is a: `Already have an account? Go to Log In` link. That can be used as an alternative. [22:28:37] 10GitLab (Integrations): [gitlab-webhooks] Provide a server-sent events API for rebroadcast of GitLab webhook data - https://phabricator.wikimedia.org/T362288#9728333 (10bd808) 05In progressβ†’03Resolved Play around with it via `curl --no-buffer -H 'Accept: text/event-stream' 'https://gitlab-webhooks.toolf... [22:36:55] 10GitLab (Integrations), 10Wikibugs: Automate setup of comment, pipeline, and job webhooks for all GitLab projects - https://phabricator.wikimedia.org/T362940 (10bd808) 03NEW [22:37:43] 10GitLab (Integrations), 10Wikibugs: Automate setup of comment, pipeline, and job webhooks for all GitLab projects - https://phabricator.wikimedia.org/T362940#9728377 (10bd808) p:05Triageβ†’03Medium [23:02:57] 10GitLab (Integrations), 10Wikibugs: Automate setup of comment, pipeline, and job webhooks for all GitLab projects - https://phabricator.wikimedia.org/T362940#9728392 (10brennen) I guess my other thought about a home for this is that it could live in [[ https://gitlab.wikimedia.org/repos/releng/gitlab-settings... [23:38:24] 10GitLab (Integrations), 10Phabricator, 10Release-Engineering-Team (Now this 🫠), 06collaboration-services: Get GitLab to render `T{\d}+` in MR overviews, comments, etc. as links to Phabricator - https://phabricator.wikimedia.org/T337570#9728419 (10brennen) > Also noting after some slack discussion with @bd...