[00:09:06] (03CR) 10Krinkle: "FYI - Rebuilds of node16-test-browser sometimes implicitly upgrade Firefox and Chromium for much of CI (and Fresh). It seems this commit d" [integration/config] - 10https://gerrit.wikimedia.org/r/908351 (owner: 10Ahmon Dancy) [00:25:20] 10Continuous-Integration-Config, 10Fresh, 10Performance-Team: Move Fresh to Gerrit (mirror to GitHub) - https://phabricator.wikimedia.org/T250766 (10Krinkle) [07:53:37] 10Phabricator (Upstream), 10Upstream: Writing {{#something:}} into a Phab comment makes text disappear - https://phabricator.wikimedia.org/T326398 (10Aklapper) p:05Triage→03Low [07:58:16] (03CR) 10Hashar: [C: 03+2] Zuul: [mediawiki/extensions/TitleBlacklist] Enable Sonar Codehealth [integration/config] - 10https://gerrit.wikimedia.org/r/917332 (https://phabricator.wikimedia.org/T321837) (owner: 10Pwangai) [07:58:17] (03CR) 10Hashar: [C: 03+2] Zuul: [mediawiki/extensions/TextExtracts] Enable Sonar Codehealth [integration/config] - 10https://gerrit.wikimedia.org/r/917333 (https://phabricator.wikimedia.org/T321837) (owner: 10Pwangai) [07:58:20] (03CR) 10Hashar: [C: 03+2] Zuul: [mediawiki/extensions/TemplateData] Enable Sonar Codehealth [integration/config] - 10https://gerrit.wikimedia.org/r/917334 (https://phabricator.wikimedia.org/T321837) (owner: 10Pwangai) [07:58:22] (03CR) 10Hashar: [C: 03+2] Zuul: [mediawiki/extensions/SyntaxHighlight_GeSHi] Enable Sonar Codehealth [integration/config] - 10https://gerrit.wikimedia.org/r/917335 (https://phabricator.wikimedia.org/T321837) (owner: 10Pwangai) [07:59:42] (03Merged) 10jenkins-bot: Zuul: [mediawiki/extensions/TitleBlacklist] Enable Sonar Codehealth [integration/config] - 10https://gerrit.wikimedia.org/r/917332 (https://phabricator.wikimedia.org/T321837) (owner: 10Pwangai) [07:59:47] (03Merged) 10jenkins-bot: Zuul: [mediawiki/extensions/TextExtracts] Enable Sonar Codehealth [integration/config] - 10https://gerrit.wikimedia.org/r/917333 (https://phabricator.wikimedia.org/T321837) (owner: 10Pwangai) [07:59:49] (03Merged) 10jenkins-bot: Zuul: [mediawiki/extensions/TemplateData] Enable Sonar Codehealth [integration/config] - 10https://gerrit.wikimedia.org/r/917334 (https://phabricator.wikimedia.org/T321837) (owner: 10Pwangai) [07:59:51] (03Merged) 10jenkins-bot: Zuul: [mediawiki/extensions/SyntaxHighlight_GeSHi] Enable Sonar Codehealth [integration/config] - 10https://gerrit.wikimedia.org/r/917335 (https://phabricator.wikimedia.org/T321837) (owner: 10Pwangai) [08:04:47] !log Reloading Zuul to enable Sonar Codehhealth on TitleBlacklist, TextExtracts, TemplateData and SyntaxHighlight_GeSHI Mediawiki extensions # T321837 [08:04:49] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [08:04:49] T321837: Repositories integrated into Codehealth Pipeline (Production) - https://phabricator.wikimedia.org/T321837 [08:06:08] (03CR) 10Hashar: [C: 03+2] zuul: Add MdsShakil to allowlist [integration/config] - 10https://gerrit.wikimedia.org/r/916793 (owner: 10Superpes15) [08:06:32] (03CR) 10Hashar: [C: 03+2] Add 2023 VideoCutTool GSoC students [integration/config] - 10https://gerrit.wikimedia.org/r/916513 (owner: 10Sohom Datta) [08:07:16] (03Merged) 10jenkins-bot: zuul: Add MdsShakil to allowlist [integration/config] - 10https://gerrit.wikimedia.org/r/916793 (owner: 10Superpes15) [08:07:43] (03Merged) 10jenkins-bot: Add 2023 VideoCutTool GSoC students [integration/config] - 10https://gerrit.wikimedia.org/r/916513 (owner: 10Sohom Datta) [09:00:47] 10Release-Engineering-Team (Seen), 10MW-on-K8s, 10SRE, 10Traffic, and 2 others: Serve production traffic via Kubernetes - https://phabricator.wikimedia.org/T290536 (10Joe) [09:04:44] 10GitLab (Project Migration), 10Release-Engineering-Team (Priority Backlog 📥): Provide mechanism to publish to doc.wikimedia.org from GitLab CI - https://phabricator.wikimedia.org/T336168 (10jnuche) > Feel free to use the new doc hosts that are waiting to become prodution but are currently just sitting there.... [09:06:34] (03CR) 10Hashar: [C: 03+2] "Deployed! CI should now run for patches proposed to Gerrit." [integration/config] - 10https://gerrit.wikimedia.org/r/916513 (owner: 10Sohom Datta) [09:06:38] (03CR) 10Hashar: [C: 03+2] "Deployed! CI should now run for patches proposed to Gerrit." [integration/config] - 10https://gerrit.wikimedia.org/r/916793 (owner: 10Superpes15) [09:06:55] !log Reloaded Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/916513/ and https://gerrit.wikimedia.org/r/c/integration/config/+/916793/ [09:06:56] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [09:09:01] 10GitLab (Project Migration), 10Release-Engineering-Team (Priority Backlog 📥): Provide mechanism to publish to doc.wikimedia.org from GitLab CI - https://phabricator.wikimedia.org/T336168 (10jnuche) [09:45:41] 10Scap: scap sync-world check failures should stand off - https://phabricator.wikimedia.org/T336238 (10hashar) [10:03:47] 10Release-Engineering-Team (Seen), 10MW-on-K8s, 10SRE, 10Traffic, and 2 others: Serve production traffic via Kubernetes - https://phabricator.wikimedia.org/T290536 (10Joe) [11:01:35] hi! I want to run CI locally for the following repository https://gerrit.wikimedia.org/g/mediawiki/extensions/ORES [11:01:35] Is there any documentation or guide you can point me to? Thanks :pray: [12:10:22] (03PS1) 10Btullis: Add pipelines for a datahub-upgrade container [integration/config] - 10https://gerrit.wikimedia.org/r/917868 (https://phabricator.wikimedia.org/T329514) [12:11:40] Hello. I'm seeking a review of https://gerrit.wikimedia.org/r/c/integration/config/+/917868 - Do I need to restart zuul after it is merged & submitted, or does someone else do this? Thanks. [12:13:30] 10GitLab (Infrastructure), 10ops-codfw, 10serviceops-collab: Install additional SSDs on gitlab2002.wikimedia.org (A1) - https://phabricator.wikimedia.org/T336258 (10Jelto) [12:14:56] 10Phabricator, 10Release-Engineering-Team, 10serviceops-collab, 10User-brennen: Replace existing aphlict1001 with puppet-managed bullseye host - https://phabricator.wikimedia.org/T333452 (10ops-monitoring-bot) cookbooks.sre.hosts.decommission executed by eoghan@cumin1001 for hosts: `aphlict1001.eqiad.wmnet... [12:17:59] 10Release-Engineering-Team (Priority Backlog 📥), 10Patch-For-Review, 10Release, 10Train Deployments: 1.41.0-wmf.8 deployment blockers - https://phabricator.wikimedia.org/T330214 (10TheDJ) This might be a regression: Globalusage shows mediawiki message keys for the site names: https://test.wikipedia.org/wik... [12:21:06] 10Phabricator (Upstream), 10Upstream: Unhandled Exception ("RuntimeException"): Undefined offset: 5 when trying to access T16235 - https://phabricator.wikimedia.org/T284397 (10Aklapper) I could reproduce this locally on a (upstream) Phorge instance. This seems to be a faulty regex. This is not triggered for `a... [13:18:29] 10GitLab (Infrastructure), 10SRE, 10ops-codfw, 10serviceops-collab: Install additional SSDs on gitlab2002.wikimedia.org (A1) - https://phabricator.wikimedia.org/T336258 (10Papaul) a:03Jhancock.wm @Jhancock.wm can you please take care of this? thanks [13:29:56] 10GitLab (Infrastructure), 10SRE, 10ops-codfw, 10serviceops-collab: Install additional SSDs on gitlab2002.wikimedia.org (A1) - https://phabricator.wikimedia.org/T336258 (10Jhancock.wm) 05Open→03Resolved @Papaul 2 x 1.92 TB drives inserted into gitlab2002 [13:38:10] 10Phabricator (Upstream), 10Upstream: Writing {{#something:}} into a Phab comment makes text disappear - https://phabricator.wikimedia.org/T326398 (10Aklapper) This might turn out to be a duplicate of T284397. [13:41:14] 10GitLab (Infrastructure), 10SRE, 10ops-codfw, 10serviceops-collab: Install additional SSDs on gitlab2002.wikimedia.org (A1) - https://phabricator.wikimedia.org/T336258 (10Jelto) Thanks for the quick response! I can confirm, disks are available. Thank you! [13:48:40] 10Project-Admins: Add 'developer-experience' Phabricator tag - https://phabricator.wikimedia.org/T334126 (10Aklapper) @Volker_E ping [13:53:04] (03CR) 10Hashar: [C: 03+2] "I have deployed the jobs:" [integration/config] - 10https://gerrit.wikimedia.org/r/917868 (https://phabricator.wikimedia.org/T329514) (owner: 10Btullis) [13:54:23] (03Merged) 10jenkins-bot: Add pipelines for a datahub-upgrade container [integration/config] - 10https://gerrit.wikimedia.org/r/917868 (https://phabricator.wikimedia.org/T329514) (owner: 10Btullis) [13:56:37] !log Reloaded Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/917868 | T329514 [13:56:39] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [13:56:40] T329514: Upgrade Datahub to v0.10.0 - https://phabricator.wikimedia.org/T329514 [13:58:16] hashar: Many thanks. [13:59:33] btullis: you are welcome :) [14:01:38] hashar: Is there an easy way to re-trigger the pipelinelib against an existing CR, or should I just make a dummy CR and merge to master? https://gerrit.wikimedia.org/r/c/analytics/datahub/+/916483/ [14:02:14] btullis: in Gerrit you can reply on the change to add a comment saying `recheck` [14:02:30] and that will cause Zuul to readd the patchset to the test pipeline and thus run all the jobs again [14:02:51] and you can optionally append som ereason such as `recheck cause some flappy test` [14:03:25] the reason is not processed, Zuul merely check whether a comment matches `/^recheck/` and when that is the case it adds the patchset again as it had just been uploaded [14:03:46] that should work on already merged change as well [14:03:59] although if one of the job fails, nothing get reported back to Gerrit [14:04:11] so yeah if there are no open change pending, you can send a dummy one for testing :] [14:16:57] 10Scap: deploy-promote breaks if HTML meta tags are not self closing - https://phabricator.wikimedia.org/T336269 (10jnuche) [14:17:45] 10Scap: scap sync-world check failures should stand off - https://phabricator.wikimedia.org/T336238 (10jnuche) Actual issue with version parsing addressed in: https://phabricator.wikimedia.org/T336269 [14:19:15] 10Scap: scap sync-world check failures should stand off - https://phabricator.wikimedia.org/T336238 (10hashar) Ah nice finding! Thank you @jnuche [14:30:25] hashar: Great! Thanks for the explanation. [14:31:55] 10GitLab (Auth & Access), 10Release-Engineering-Team: Provide Access Token to allow SonarQube to access GitLab - https://phabricator.wikimedia.org/T336014 (10pwangai) I am closing this task. I got the access I needed to the respective groups. [14:32:17] 10GitLab (Auth & Access), 10Release-Engineering-Team: Provide Access Token to allow SonarQube to access GitLab - https://phabricator.wikimedia.org/T336014 (10pwangai) 05Open→03Resolved a:03pwangai [14:35:36] 10Scap, 10Patch-For-Review: deploy-promote breaks if HTML meta tags are not self closing - https://phabricator.wikimedia.org/T336269 (10hashar) The self closing of elements got removed by https://gerrit.wikimedia.org/r/c/mediawiki/core/+/798999 for T309150. [14:42:55] 10Continuous-Integration-Infrastructure, 10SRE, 10serviceops-collab, 10Patch-For-Review: contint2002 service implementation tracking - https://phabricator.wikimedia.org/T324659 (10hashar) The process to migrate involves a rsync running a chroot which is thus unable to do user/group id mapping between the h... [14:55:29] Well that's interesting. https://integration.wikimedia.org/ci/view/DataHub/ - Why did my datahub-pipeline-upgrade-build pipeline run successfully, but it didn't appear to trigger datahub-pipeline-upgrade-publish ? [15:13:07] 10Continuous-Integration-Infrastructure, 10SRE, 10serviceops-collab, 10Patch-For-Review: contint2002 service implementation tracking - https://phabricator.wikimedia.org/T324659 (10hashar) Some are human users that have uid reserved via `modules/admin/data/data.yaml`. The `deploy-*` users are created by Pup... [15:13:57] oh why does gitlab keep me logged out :/ [15:22:47] btullis: I think this may be the answer to that: https://gerrit.wikimedia.org/r/plugins/gitiles/integration/config/+/refs/heads/master/zuul/layout.yaml#1316 [15:23:35] looks like the only change in the build pipeline is for the `master` branch and trigger-datahub-pipeline-.*-publish only runs on the `wmf` branch [15:30:30] 10Continuous-Integration-Infrastructure, 10SRE, 10serviceops-collab, 10Patch-For-Review: contint2002 service implementation tracking - https://phabricator.wikimedia.org/T324659 (10hashar) + @jnuche who co manages our Jenkins nowadays. This task is to migrate the Jenkins/Zuul/integration website services f... [15:59:24] thcipriani: OK, thanks. I thought that https://gerrit.wikimedia.org/r/c/analytics/datahub/+/916483/ *was* a merge to the `wmf` branch. Anyway, I'm going to try another noddy CR to see if I can get it to build, rather than a recheck. [16:02:32] oh, it does look like it is! I'm sorry, I was misreading the git revisions on https://integration.wikimedia.org/ci/view/DataHub/job/datahub-pipeline-upgrade-build/1/ [16:02:44] lemme see if I can see anything in the zuul logs [16:03:18] OK, many thanks. I'll hold off sending anything new. [16:18:19] 10GitLab (CI & Job Runners), 10Security Team AppSec, 10Security-Team, 10Security: Design and Build Application Security Pipeline Components for Gitlab - https://phabricator.wikimedia.org/T289290 (10sbassett) [16:18:47] 10GitLab (CI & Job Runners), 10Release-Engineering-Team (Radar), 10Security Team AppSec, 10Security-Team, and 3 others: Evaluate and confirm potential licensing issues for gitlab appsec pipeline tools - https://phabricator.wikimedia.org/T304737 (10sbassett) 05In progress→03Declined Declining this for n... [16:19:03] 10GitLab (CI & Job Runners), 10Release-Engineering-Team (Radar), 10Security Team AppSec, 10Security-Team, and 3 others: Evaluate and confirm potential licensing issues for gitlab appsec pipeline tools - https://phabricator.wikimedia.org/T304737 (10sbassett) [16:19:13] well, grepping tells me it wasn't triggered at all. So nothing failed, zuul just doesn't think it ought to run that job...now...why...? [16:19:54] I can also see that the job is registered in zuul [16:20:24] here's everything that was triggered for that commit, FWIW: https://phabricator.wikimedia.org/P48040 [16:27:33] 10GitLab (Project Migration), 10Release-Engineering-Team (Priority Backlog 📥): Provide mechanism to publish to doc.wikimedia.org from GitLab CI - https://phabricator.wikimedia.org/T336168 (10Dzahn) @jnuche Yes, that's right. I mean doc1003 and doc2002 from T319477. @andrea.denisse created those for us during... [16:27:41] which is strange: I don't see the publish jobs that *did* happen [16:31:23] https://integration.wikimedia.org/ci/job/trigger-datahub-pipeline-upgrade-build/ did ran at least once for https://gerrit.wikimedia.org/r/c/analytics/datahub/+/916483 [16:31:28] which is against branch `wmf` [16:31:34] btullis: ^ [16:32:25] but the -publish variants only trigger after a change got merged [16:32:42] they are a different set of jobs/pipeline than the one triggered when sending a patch or doing a `recheck` [16:33:00] the next change that merges will trigger the publish jobs [16:33:04] OK, thanks. Makes sense. I'll send a new CR then. [16:33:11] else we can trigger the postmerge manually [16:33:13] I will do it now [16:33:44] (usually we setup CI then people CR+2 an open change which does have everything running) [16:34:22] OK, yes please. That would be great. [16:35:03] oh, wait, did the job get set up after the merge? [16:35:29] (just a lost manager here, grepping things) [16:35:36] of course zuul rpc fails grrr [16:35:52] thcipriani: yeah I have deployed it earlier today [16:36:15] and ben asked how to test CI to which I replied with the usual "just `recheck` ™" [16:36:26] but I missed he might want totest against a merged change :/ [16:36:59] !log zuul enqueue --trigger gerrit --pipeline postmerge --project analytics/datahub --change 916483,4 [16:37:00] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [16:37:40] btullis: it is in the pipe! https://integration.wikimedia.org/ci/blue/organizations/jenkins/datahub-pipeline-upgrade-publish/detail/datahub-pipeline-upgrade-publish/1/ [16:37:54] and progress at https://integration.wikimedia.org/zuul/#q=datahub [16:38:42] thcipriani: nice digging in https://phabricator.wikimedia.org/P48040 :] [16:40:24] brennen: the mediawiki train looks fine so far on group 0 ;) [16:40:51] brennen: there was some minor issues with scap but jnuche ninja fixed them both! [16:44:09] thx hashar. :) [16:45:44] 10Release-Engineering-Team (Priority Backlog 📥), 10Patch-For-Review, 10Release, 10Train Deployments: 1.41.0-wmf.8 deployment blockers - https://phabricator.wikimedia.org/T330214 (10hashar) [16:46:10] brennen: bah thedj found a regression and mentioned it on the blocker task, so I converted that to an ubn at https://phabricator.wikimedia.org/T336284 :/ [16:46:36] 10Release-Engineering-Team (Priority Backlog 📥), 10Patch-For-Review, 10Release, 10Train Deployments: 1.41.0-wmf.8 deployment blockers - https://phabricator.wikimedia.org/T330214 (10hashar) >>! In T330214#8836714, @TheDJ wrote: > This might be a regression: Globalusage shows mediawiki message keys for the s... [16:47:10] btullis: if all went well docker-registry.wikimedia.org/wikimedia/datahub-upgrade:c3edc0313fd8ce4f6eb0f855a07cb3ced16087dd-production [16:48:27] hashar: you should try `scap train` to run the train. It's new magic da.ncy (who is on vacation) built while you were on vacation [16:49:02] no more remembering version numbers! [16:57:04] Thank you both ever so much. <3 [17:02:21] 10Phabricator (Upstream), 10Release-Engineering-Team, 10Upstream, 10User-brennen: Uploaded files via the drag-and-drop are defaulting to private-access - https://phabricator.wikimedia.org/T310833 (10hashar) Thank you very much for the step-by-step fix up at https://www.mediawiki.org/wiki/Phabricator/Help#F... [17:07:15] 10Release-Engineering-Team (Priority Backlog 📥), 10Patch-For-Review, 10Release, 10Train Deployments: 1.41.0-wmf.8 deployment blockers - https://phabricator.wikimedia.org/T330214 (10hashar) [17:07:36] blocker solved [17:08:48] by matmarex who should be celebrated all week long [17:10:42] 10Scap: scap sync-world check failures should stand off - https://phabricator.wikimedia.org/T336238 (10hashar) 05Open→03Resolved a:03jnuche After @jnuche patch https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/136 I am happy to mark this solved immediately given it is a cosmetic requests rath... [17:11:18] I am off [18:58:22] 10Release-Engineering-Team (Seen), 10MediaWiki-extensions-CodeReview, 10Wikimedia-Site-requests, 10Patch-For-Review, 10Technical-Debt: Undeploy CodeReview - https://phabricator.wikimedia.org/T116948 (10Dzahn) [19:02:40] 10Continuous-Integration-Config, 10Machine-Learning-Team, 10MediaWiki-Core-Tests, 10ORES, and 2 others: Audit tests/selenium/LocalSettings.php file aiming at possibly deprecating the feature - https://phabricator.wikimedia.org/T199939 (10Jdlrobson) Selenium tests were removed from Mediaviewer. [19:25:55] 10Release-Engineering-Team, 10API Platform, 10AQS2.0, 10Platform Engineering, and 5 others: Define a procedure/pattern to populate test environments - https://phabricator.wikimedia.org/T334851 (10Htriedman) Did some basic experimentation on this front here: https://gitlab.wikimedia.org/htriedman/synth-data... [21:20:48] 10Phabricator (Upstream), 10Upstream, 10User-IN: Throw exception when accessing future events - https://phabricator.wikimedia.org/T289936 (10Aklapper) [21:20:50] 10Phabricator (Upstream), 10Upstream, 10User-IN: When visiting events thousands of years in the future throw exception "Unhandled Exception ("AphrontQueryException"): #1264: Out of range value for column 'utcInitialEpoch' at row 1" - https://phabricator.wikimedia.org/T269996 (10Aklapper) 05Open→03Declined [21:24:35] 10Phabricator: Disable Slowvote application - https://phabricator.wikimedia.org/T285304 (10Aklapper) 05Open→03Declined Declining for the time being. [21:31:20] 10Phabricator (Upstream), 10Upstream: Custom Policy window overflows when task name is too long - https://phabricator.wikimedia.org/T316308 (10Aklapper) 05Open→03Stalled @Reedy: How to get a View Policy dialog that offers a "users subscribed to" option? Please provide steps to reproduce in tickets. Cannot... [22:29:50] 10Phabricator (Upstream), 10Upstream: Upload popup overflows box with a long filename - https://phabricator.wikimedia.org/T316305 (10Aklapper) Hmm hmm, guess it's possible to set a `max-width` for that `` but which value would work for different viewports?