[00:20:04] Project beta-update-databases-eqiad build #67896: 04STILL FAILING in 3.7 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/67896/ [01:20:04] Project beta-update-databases-eqiad build #67897: 04STILL FAILING in 3.9 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/67897/ [02:03:31] 10Beta-Cluster-Infrastructure, 10Continuous-Integration-Infrastructure: beta-scap-sync-world failure β€” SSL peer certificate or SSH remote key was not OK - https://phabricator.wikimedia.org/T338495 (10thcipriani) Tagging in some [[ https://openstack-browser.toolforge.org/project/pki | PKI Cloud ]] admins for so... [02:06:51] 10GitLab (Integrations), 10Phabricator, 10Release-Engineering-Team: GitLab repos are not correctly mirrored to Diffusion - https://phabricator.wikimedia.org/T324151 (10thcipriani) Would love to preserve nice embedded links. If we can link those to the canonical host, that'd be cool. Otherwise, having diffus... [02:20:05] Project beta-update-databases-eqiad build #67898: 04STILL FAILING in 4.2 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/67898/ [03:20:04] Project beta-update-databases-eqiad build #67899: 04STILL FAILING in 3.8 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/67899/ [04:20:04] Project beta-update-databases-eqiad build #67900: 04STILL FAILING in 3.9 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/67900/ [05:20:04] Project beta-update-databases-eqiad build #67901: 04STILL FAILING in 3.7 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/67901/ [06:20:05] Project beta-update-databases-eqiad build #67902: 04STILL FAILING in 4.1 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/67902/ [06:29:17] (03PS1) 10Hashar: jjb: disable all beta cluster jobs [integration/config] - 10https://gerrit.wikimedia.org/r/928703 (https://phabricator.wikimedia.org/T338495) [06:30:15] (03PS2) 10Hashar: jjb: disable all beta cluster jobs [integration/config] - 10https://gerrit.wikimedia.org/r/928703 (https://phabricator.wikimedia.org/T338495) [06:31:12] !log deployment-prep: disabled all three beta cluster jobs since some TLS certificates are broken causing jobs to fail https://gerrit.wikimedia.org/r/928703 [06:31:13] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [06:32:03] (03CR) 10Hashar: [C: 03+2] "Deployed using `./jjb-update 'beta*'`." [integration/config] - 10https://gerrit.wikimedia.org/r/928703 (https://phabricator.wikimedia.org/T338495) (owner: 10Hashar) [06:32:46] 10Release-Engineering-Team (They Live πŸ•ΆοΈπŸ§Ÿ), 10Release, 10Train Deployments: 1.41.0-wmf.13 deployment blockers - https://phabricator.wikimedia.org/T337527 (10hashar) [06:32:52] 10Beta-Cluster-Infrastructure, 10Continuous-Integration-Infrastructure, 10Patch-For-Review: beta-scap-sync-world failure β€” SSL peer certificate or SSH remote key was not OK - https://phabricator.wikimedia.org/T338495 (10hashar) [06:33:28] (03Merged) 10jenkins-bot: jjb: disable all beta cluster jobs [integration/config] - 10https://gerrit.wikimedia.org/r/928703 (https://phabricator.wikimedia.org/T338495) (owner: 10Hashar) [06:35:01] 10Beta-Cluster-Infrastructure, 10Continuous-Integration-Infrastructure, 10Patch-For-Review: beta-scap-sync-world failure β€” SSL peer certificate or SSH remote key was not OK - https://phabricator.wikimedia.org/T338495 (10hashar) p:05Triageβ†’03Unbreak! >>! In T338495#8915514, @dancy wrote: > I have re-disab... [06:41:31] 10Beta-Cluster-Infrastructure, 10Continuous-Integration-Infrastructure, 10Patch-For-Review: beta-scap-sync-world failure β€” SSL peer certificate or SSH remote key was not OK - https://phabricator.wikimedia.org/T338495 (10hashar) >>! In T338495#8916913, @thcipriani wrote: > Tagging in some [[ https://openstack... [09:04:43] 10Gerrit: List of files in a Gerrit change appears empty in the UI - https://phabricator.wikimedia.org/T338569 (10jhsoby) [09:05:41] 10Gerrit: List of files in a Gerrit change appears empty in the UI - https://phabricator.wikimedia.org/T338569 (10jhsoby) [10:07:26] 10Gerrit: List of files in a Gerrit change appears empty in the UI - https://phabricator.wikimedia.org/T338569 (10hashar) The Gerrit web ui fetch all the data from the REST API which yields the data used to craft the interface. On the screenshot missing the list of files, it is also missing the state of the cha... [10:11:27] 10Gerrit: List of files in a Gerrit change appears empty in the UI - https://phabricator.wikimedia.org/T338569 (10hashar) I have NOT looked at all the requests to find whether your browser tried to fetch the files list. Maybe sometime it does not. It might be Gerrit not supporting your web browser entirely, it... [10:14:20] 10Gerrit: List of files in a Gerrit change appears empty in the UI - https://phabricator.wikimedia.org/T338569 (10hashar) On the faulty screenshot at {F37098951} Beside the list of files and the {nav ACTIVE} button missing, the {nav Rebase} button at top right is greyed out, but I think that comes from the chan... [10:16:27] 10Release-Engineering-Team (They Live πŸ•ΆοΈπŸ§Ÿ), 10Anti-Harassment, 10Projects-Cleanup, 10Security-Team, 10iPoid-Service: Migrate mediawiki/services/ipoid to GitLab - https://phabricator.wikimedia.org/T337714 (10kostajh) [10:18:37] 10Release-Engineering-Team (They Live πŸ•ΆοΈπŸ§Ÿ), 10Anti-Harassment, 10Projects-Cleanup, 10Security-Team, 10iPoid-Service: Migrate mediawiki/services/ipoid to GitLab - https://phabricator.wikimedia.org/T337714 (10kostajh) 05Openβ†’03Resolved > ~~- [ ] Make sure deployment-charts uses the image built by GitLa... [10:18:55] 10GitLab (Project Migration), 10Release-Engineering-Team (Priority Backlog πŸ“₯), 10API Platform, 10Anti-Harassment, and 19 others: Migrate PipelineLib repos to GitLab - https://phabricator.wikimedia.org/T332953 (10kostajh) [10:39:53] 10Gerrit: List of files in a Gerrit change appears empty in the UI - https://phabricator.wikimedia.org/T338569 (10jhsoby) >>! In T338569#8917607, @hashar wrote: > I have NOT looked at all the requests to find whether your browser tried to fetch the files list. Maybe sometime it does not. > > It might be Gerrit... [11:11:26] 10GitLab (Infrastructure), 10Release-Engineering-Team, 10serviceops-collab: Upgrade GitLab to major version 16 - https://phabricator.wikimedia.org/T338460 (10Jelto) [12:20:33] maintenance-disconnect-full-disks build 498533 integration-agent-docker-1032 (/: 29%, /srv: 96%, /var/lib/docker: 73%): OFFLINE due to disk space [12:25:32] maintenance-disconnect-full-disks build 498534 integration-agent-docker-1032 (/: 29%, /srv: 32%, /var/lib/docker: 72%): RECOVERY disk space OK [13:22:32] 10Gerrit: List of files in a Gerrit change appears empty in the UI - https://phabricator.wikimedia.org/T338569 (10hashar) > Whenever I've tried network traffic in the past, I've had to open the browser console, enable it and then refresh the page. Since refreshing the page usually solves the issue, I'm not sure... [13:34:55] 10Beta-Cluster-Infrastructure, 10Continuous-Integration-Infrastructure: beta-scap-sync-world failure β€” SSL peer certificate or SSH remote key was not OK - https://phabricator.wikimedia.org/T338495 (10TheresNoTime) And finally (//sidenote: why did this take so long to fail..?//) https://en.wikipedia.beta.wmflab... [13:52:46] so with T338495, I'm taking wild guesses now β€” https://wikitech.wikimedia.org/wiki/PKI/Cloud#Authorising_puppet_agents_for_a_specific_project to me suggests that the output of `cat $(sudo facter -p puppet_config.localcacert)` on say `deployment-mediawiki12` should be present in https://github.com/wikimedia/operations-puppet/blob/production/modules/profile/files/pki/cloud/client_auth_CA.pem, but it is not [13:52:47] T338495: beta-scap-sync-world failure β€” SSL peer certificate or SSH remote key was not OK - https://phabricator.wikimedia.org/T338495 [13:54:58] 10Gerrit, 10TestMe, 10Upstream: Gerrit's ui does not correctly capitalise usernames in the git clone command - https://phabricator.wikimedia.org/T183205 (10hashar) 05Openβ†’03Resolved a:03hashar `ldap.accountSshUserName` default to the field `uid`. From `mediawiki/extensions/LdapAuthentication`: ` lang=... [13:58:44] 10Gerrit: gerrit sometimes giving "internal server error: Error inserting change/patchset" - https://phabricator.wikimedia.org/T205503 (10hashar) 05Openβ†’03Resolved a:03hashar This got filed back in September 2018 and there was a similar one filed in January 2019 T214656. We have since upgraded Gerrit mult... [14:01:26] thcipriani: dancy: hashar: anecdotal number regarding test execution time in phpunit, here's our coverage history: https://coverage.toolforge.org/charts/mediawiki.png [14:02:05] plus core is growing, and extensions are added to the gate (neither of which is tracked in that graph). [14:02:13] exact numbers at T225730 as usual :) [14:02:14] T225730: Reduce runtime of MW shared gate Jenkins jobs to 5 min - https://phabricator.wikimedia.org/T225730 [14:02:21] 10Beta-Cluster-Infrastructure, 10Continuous-Integration-Infrastructure: beta-scap-sync-world failure β€” SSL peer certificate or SSH remote key was not OK - https://phabricator.wikimedia.org/T338495 (10TheresNoTime) //Reiterating my comment on IRC;// I'm taking wild guesses now β€” https://wikitech.wikimedia.org/w... [14:03:07] definitely looks like we could overlay that with test execution time and see some relationship [14:09:56] 10Beta-Cluster-Infrastructure, 10Continuous-Integration-Infrastructure, 10Patch-For-Review: beta-scap-sync-world failure β€” SSL peer certificate or SSH remote key was not OK - https://phabricator.wikimedia.org/T338495 (10TheresNoTime) >>! In T338495#8918309, @gerritbot wrote: > Change 928851 had a related pat... [14:19:28] 10Phabricator: Upgrade license of Phabricator To CC BY-SA 4.0 - https://phabricator.wikimedia.org/T338440 (10Bugreporter) What I mean is the content of Phabricator (such as this task). [14:26:00] Krinkle: nice graph :] [14:26:18] I should tackle T225730 one day when I get the free brain for that :/ [14:26:18] T225730: Reduce runtime of MW shared gate Jenkins jobs to 5 min - https://phabricator.wikimedia.org/T225730 [14:33:05] Biggest step forward I see there is parallel phpunit. But there's a few obstacles to doing it perfectly [14:33:25] But a small iterative step should be possible [14:33:29] yeah potentially but that would cause so many issues: [14:33:58] I guess there will be potential race conditions between tests and that will consumes more CPU power than available on the instances currently [14:34:15] I don't know. We already don't run on the same db, it's a temp one that only one process knows about. And we also abstract temp files. That's pretty much everything? [14:35:06] I don't think it needs more cpu per se. It'll run as fast as it can with the same resources [14:35:09] I used to do some profiling and inspecting the debug log to optimize some code paths (one I remember was tests triggering a SearchUpdate which albeit dummy had some noticeable overhead [14:35:18] But often now we're waiting for non-cpu so that's where it'd go faster [14:35:51] Just one or two high level groups via the xml file should suffice to cut it down a lot [14:36:05] Aaron locally has it passing in under 3 minutes last I remember [14:36:12] Down from like 15 or 20 [14:36:22] the instances have 8 vCPU and allow up to 4 concurrent builds. So multiple builds on the same node tend to consume most of the available cpu [14:36:28] and mysql takes its good share [14:36:34] ahh [14:37:44] If our concern becomes that we're making the most of our CPUs, that'd be a good problem to have. And I think that's be an improvement assuming it won't cause deadlocks or stalling [14:38:07] and surely lot of those tests could benefit from being made pure unit tests. I also once experimenting first running solely the unit tests of files affected by the patch (eg: if the patch touches `includes/User.php` first run `tests/phpunit/includes/user/UserTest.php` to abort early) [14:38:09] 10GitLab (Infrastructure), 10Release-Engineering-Team, 10serviceops-collab: Upgrade GitLab to major version 16 - https://phabricator.wikimedia.org/T338460 (10Jelto) p:05Triageβ†’03High [14:39:31] The pure unit tests run in like 3 seconds total today I think? [14:40:10] 14:28:59 <<< Finish: PHPUnit unit tests, in 6.777 s [14:40:18] :) [14:40:20] pretty much yes, for 13k tests and 188k assertions [14:40:53] the wrapped phpunit default suite without database tests takes 190 seconds (or 3 minutes) [14:41:28] the one with database (really anything that we did not care to mock properly) 363 seconds (or 6 minutes) [14:41:28] 10Phabricator: Due Date stamp doesn't show on a Phab task even though the field is filled - https://phabricator.wikimedia.org/T310188 (10Aklapper) Found the code in https://phabricator.wikimedia.org/source/phab-extensions/browse/wmf%252Fstable/src/customfields/DeadlineEditEngineSubtype.php . Looking at this cus... [14:41:47] 10Phabricator: Due Date stamp rendering requires "deadline" task subtype; does not show for other task subtypes though Due Date field is filled - https://phabricator.wikimedia.org/T310188 (10Aklapper) [14:42:18] anyway total that is 10 minutes for a standalone mediawiki/core patch (ex: https://integration.wikimedia.org/ci/job/mediawiki-quibble-vendor-mysql-php74-docker/25671/console ) [14:42:49] I think I can shred 5/6 minutes from the wmf-quibble-selenium job , I should revisit [14:43:33] 10Beta-Cluster-Infrastructure, 10Continuous-Integration-Infrastructure, 10Patch-For-Review: beta-scap-sync-world failure β€” SSL peer certificate or SSH remote key was not OK - https://phabricator.wikimedia.org/T338495 (10jbond) hi All, the puppet CA certificate for deployment prep expired a few weeks back (T3... [14:43:35] and have been lurking at the Bazel build system which has a lot of interesting features applying to our case. But there is no php/composer support at all which would need to be implemented [14:43:38] anyway :] [14:43:50] I am heading out for the week-end, it has been a long week [14:47:22] 10Beta-Cluster-Infrastructure, 10Continuous-Integration-Infrastructure, 10Patch-For-Review: beta-scap-sync-world failure β€” SSL peer certificate or SSH remote key was not OK - https://phabricator.wikimedia.org/T338495 (10TheresNoTime) puppet now runs successfully on `deployment-mediawiki12`, but https://en.wi... [14:55:38] 10Beta-Cluster-Infrastructure, 10Continuous-Integration-Infrastructure, 10Patch-For-Review: beta-scap-sync-world failure β€” SSL peer certificate or SSH remote key was not OK - https://phabricator.wikimedia.org/T338495 (10jbond) The puppet certs are often reused for client auth in other areas e.g. `puppet::exp... [15:04:17] 10Beta-Cluster-Infrastructure, 10Continuous-Integration-Infrastructure, 10Patch-For-Review: beta-scap-sync-world failure β€” SSL peer certificate or SSH remote key was not OK - https://phabricator.wikimedia.org/T338495 (10TheresNoTime) Everything seems to be recovering now (I didn't change anything post-[[ htt... [15:04:28] Could we look at re-enabling the beta Jenkins jobs please? [15:11:17] !log deployment-prep: `[samtar@deployment-deploy03 ~]$ scap sync-world --no-log-message` [15:11:18] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [15:21:09] !log deployment-prep: `[samtar@deployment-deploy03 ~]$ sudo -u jenkins-deploy scap prep auto --no-log-message` [15:21:10] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [15:21:30] TheresNoTime: Reenabled [15:22:52] two jobs on https://integration.wikimedia.org/ci/view/Beta/ still showing as disabled for me? :) [15:25:11] Sorry, missed those. Now enabled too [15:25:33] thanks <3 [15:26:40] 10Phabricator: Upgrade license of Phabricator To CC BY-SA 4.0 - https://phabricator.wikimedia.org/T338440 (10Aklapper) @Bugreporter: Thanks, I wonder what the results of this request would be though. :) As all content so far was licensed under CC-BY-SA 3.0, I don't think we can assume that everybody would be fin... [15:27:18] 10Phabricator: Upgrade content license of Phabricator from 3.0 to CC BY-SA 4.0 - https://phabricator.wikimedia.org/T338440 (10Aklapper) p:05Triageβ†’03Medium [15:27:26] 10Beta-Cluster-Infrastructure, 10Continuous-Integration-Infrastructure: beta-scap-sync-world failure β€” SSL peer certificate or SSH remote key was not OK - https://phabricator.wikimedia.org/T338495 (10TheresNoTime) [15:27:30] 10Release-Engineering-Team (They Live πŸ•ΆοΈπŸ§Ÿ), 10Release, 10Train Deployments: 1.41.0-wmf.13 deployment blockers - https://phabricator.wikimedia.org/T337527 (10TheresNoTime) [15:28:12] 10Beta-Cluster-Infrastructure, 10Continuous-Integration-Infrastructure: beta-scap-sync-world failure β€” SSL peer certificate or SSH remote key was not OK - https://phabricator.wikimedia.org/T338495 (10TheresNoTime) p:05Unbreak!β†’03Triage No longer blocking the train, dropping priority β€” leaving open for foll... [15:35:20] (03PS1) 10Ahmon Dancy: Revert "jjb: disable all beta cluster jobs" [integration/config] - 10https://gerrit.wikimedia.org/r/928617 (https://phabricator.wikimedia.org/T338495) [15:36:37] (03CR) 10CI reject: [V: 04-1] Revert "jjb: disable all beta cluster jobs" [integration/config] - 10https://gerrit.wikimedia.org/r/928617 (https://phabricator.wikimedia.org/T338495) (owner: 10Ahmon Dancy) [15:37:17] (03PS2) 10Ahmon Dancy: Revert "jjb: disable all beta cluster jobs" [integration/config] - 10https://gerrit.wikimedia.org/r/928617 (https://phabricator.wikimedia.org/T338495) [15:39:02] (03CR) 10Ahmon Dancy: [C: 03+2] Revert "jjb: disable all beta cluster jobs" [integration/config] - 10https://gerrit.wikimedia.org/r/928617 (https://phabricator.wikimedia.org/T338495) (owner: 10Ahmon Dancy) [15:39:33] Yippee, build fixed! [15:39:33] Project beta-scap-sync-world build #106746: 09FIXED in 10 min: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/106746/ [15:40:33] (03Merged) 10jenkins-bot: Revert "jjb: disable all beta cluster jobs" [integration/config] - 10https://gerrit.wikimedia.org/r/928617 (https://phabricator.wikimedia.org/T338495) (owner: 10Ahmon Dancy) [15:40:37] 10MediaWiki-Releasing, 10MW-1.40-release, 10Release: Release MW 1.40.0 - https://phabricator.wikimedia.org/T329075 (10Reedy) [15:40:41] 10MediaWiki-Releasing, 10MediaWiki-Vendor, 10MW-1.40-release: Prune /vendor for REL1_40 - https://phabricator.wikimedia.org/T329081 (10Reedy) 05Openβ†’03Resolved a:03Jdforrester-WMF [15:41:50] 10Beta-Cluster-Infrastructure, 10Continuous-Integration-Infrastructure, 10Patch-For-Review: beta-scap-sync-world failure β€” SSL peer certificate or SSH remote key was not OK - https://phabricator.wikimedia.org/T338495 (10dancy) I reenabled the beta jobs. [15:46:14] 10MediaWiki-Releasing, 10MW-1.40-release, 10Release: Write release announcement for 1.40.0-rc.0 - https://phabricator.wikimedia.org/T329084 (10Reedy) [15:47:38] Yippee, build fixed! [15:47:38] Project beta-update-databases-eqiad build #67903: 09FIXED in 10 min: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/67903/ [15:49:47] 10Continuous-Integration-Infrastructure: Frequent Selenium failures - https://phabricator.wikimedia.org/T338627 (10Tgr) [15:50:09] 10Gitlab-Application-Security-Pipeline, 10Security Team AppSec, 10Security-Team, 10SecTeam-Processed, 10Security: Address issues within certain Gitlab CI security templates - https://phabricator.wikimedia.org/T338034 (10mmartorana) [15:50:13] 10MediaWiki-Releasing, 10MW-1.40-release, 10Release: Write release announcement for 1.40.0-rc.0 - https://phabricator.wikimedia.org/T329084 (10Reedy) [15:50:54] 10MediaWiki-Releasing, 10MW-1.40-release, 10Release: Write release announcement for 1.40.0-rc.0 - https://phabricator.wikimedia.org/T329084 (10Reedy) a:03Reedy [16:14:39] 10Gitlab-Application-Security-Pipeline, 10Security Team AppSec, 10Security-Team, 10SecTeam-Processed, 10Security: Address issues within certain Gitlab CI security templates - https://phabricator.wikimedia.org/T338034 (10mmartorana) [16:21:52] 10Beta-Cluster-Infrastructure, 10Continuous-Integration-Infrastructure: beta-scap-sync-world failure β€” SSL peer certificate or SSH remote key was not OK - https://phabricator.wikimedia.org/T338495 (10bd808) [16:21:54] 10Beta-Cluster-Infrastructure: deployment-prep Puppet CA about to expire on 2023-05-25 - https://phabricator.wikimedia.org/T335689 (10bd808) [16:52:52] 10Beta-Cluster-Infrastructure, 10VisualEditor, 10VisualEditor-VisualDiffs: Visual diff on beta Incubator fails with β€œInvalid response from server” - https://phabricator.wikimedia.org/T338388 (10matmarex) [16:56:27] 10Beta-Cluster-Infrastructure, 10VisualEditor, 10VisualEditor-VisualDiffs, 10Patch-For-Review: Visual diff on beta Incubator fails with β€œInvalid response from server” - https://phabricator.wikimedia.org/T338388 (10matmarex) a:03matmarex [17:20:32] 10Phabricator: Remove "Deadline" task subtype - https://phabricator.wikimedia.org/T335395 (10Aklapper) I realized the downside in T310188#8918485 - no "Due Date stamp" when removing this task subtype, due to `DeadlineEditEngineSubtype` not being called. [18:23:18] 10Phabricator: Cannot create new Mock: RuntimeException: Illegal offset type in isset or empty - https://phabricator.wikimedia.org/T333089 (10Aklapper) So far I have failed to reproduce this problem locally. @Bennylin: Can you reproduce this? After entering text and dragging an image like in your screenshot abo... [18:43:21] 10Phabricator, 10serviceops-collab, 10Developer-Advocacy (Apr-Jun 2023), 10Patch-For-Review: Automate SQL queries for annual end-of-year Phabricator statistics/metrics on wikitech-l@ - https://phabricator.wikimedia.org/T337388 (10Dzahn) - added $month parameter to phabricator::logmail class - deployed chan... [19:20:09] 10Phabricator (Upstream), 10Upstream: Remove phabricator admin role from oneself via GUI not working - https://phabricator.wikimedia.org/T271188 (10Aklapper) Same in upstream: https://we.phorge.it/source/phorge/browse/master/src/applications/people/xaction/PhabricatorUserEmpowerTransaction.php I don't think w... [19:31:39] 10Phabricator (Upstream), 10Upstream: Cannot get list of repos via Conduit: "Query (of class \"PhabricatorRepositoryQuery\") overheated: examined more than 1,010 raw rows without finding 101 visible objects." - https://phabricator.wikimedia.org/T271004 (10Aklapper) Given the information in https://secure.phabr... [19:32:42] 10Phabricator, 10ci-test-error: fatal: unable to access 'https://phabricator.wikimedia.org/source/.../': The requested URL returned error: 500 - https://phabricator.wikimedia.org/T262814 (10Aklapper) 05Openβ†’03Declined >>! In T262814#6458891, @Nikerabbit wrote: > Might have been temporary issue, since it wo... [19:41:59] 10Phabricator, 10Dumps-Generation: Compress phabricator dump - https://phabricator.wikimedia.org/T262744 (10Aklapper) If anyone who knows Python wants to look into this: https://gitlab.wikimedia.org/repos/phabricator/tools/-/blob/wmf/stable/public_task_dump.py 's ` with open('/srv/dumps/phabricator_public.... [19:45:28] (03PS1) 10Cwhite: bump dashboards version to 2.7.0 [releng/phatality] - 10https://gerrit.wikimedia.org/r/928906 (https://phabricator.wikimedia.org/T333732) [19:47:18] 10Phabricator, 10good first task: Make "merged" icon in Maniphest's Gerrit info block to be a green tick mark instead of a grey git branching icon - https://phabricator.wikimedia.org/T252866 (10Aklapper) This requires a patch in the file `src/customfields/GerritPatchesCustomField.php` of the repo https://gitla... [19:50:55] 10Phabricator (Upstream), 10Upstream: Subscriber changes not reported by email if Herald also changes subscribers in the same action - https://phabricator.wikimedia.org/T133073 (10Aklapper) [19:57:09] (03CR) 10Cwhite: "This version is live on beta-logs for testing." [releng/phatality] - 10https://gerrit.wikimedia.org/r/928906 (https://phabricator.wikimedia.org/T333732) (owner: 10Cwhite) [20:10:36] (03CR) 10Ahmon Dancy: [C: 03+1] bump dashboards version to 2.7.0 [releng/phatality] - 10https://gerrit.wikimedia.org/r/928906 (https://phabricator.wikimedia.org/T333732) (owner: 10Cwhite) [20:11:03] 10Phabricator, 10good first task: Make "merged" icon in Maniphest's Gerrit info block to be a green tick mark instead of a grey git branching icon - https://phabricator.wikimedia.org/T252866 (10Aklapper) Thinking more about this, I'm not convinced - a green tick mark might also mean "ready to go" but not "merg... [20:31:59] 10GitLab (CI & Job Runners), 10Release-Engineering-Team (They Live πŸ•ΆοΈπŸ§Ÿ): buildkitd: Require use of the blubber frontend when running on trusted runners. - https://phabricator.wikimedia.org/T329220 (10thcipriani) a:05demonβ†’03None [20:40:13] 10Phabricator, 10serviceops-collab, 10Developer-Advocacy (Apr-Jun 2023): Automate SQL queries for annual end-of-year Phabricator statistics/metrics on wikitech-l@ - https://phabricator.wikimedia.org/T337388 (10Dzahn) We had a small issue with the query syntax which is fixed now. Unrelatedly some numbers sti... [20:57:15] 10GitLab (Administration, Settings & Policy), 10Release-Engineering-Team (Priority Backlog πŸ“₯), 10User-brennen: Define "Terms of Service and Privacy Policy" text for GitLab - https://phabricator.wikimedia.org/T285354 (10thcipriani) [20:59:12] 10Release-Engineering-Team (Onboarding πŸš€), 10Scap, 10User-brennen: scap deploy-promote uses latest train blocker, which is wrong if a train has been blocked over the weekend - https://phabricator.wikimedia.org/T336179 (10thcipriani) [21:01:44] 10Release-Engineering-Team (Onboarding πŸš€), 10Scap: scap backport sanity check prevents using it to fix an about-to-be-live branch - https://phabricator.wikimedia.org/T317795 (10thcipriani) [21:02:54] 10GitLab (Infrastructure), 10Release-Engineering-Team (Priority Backlog πŸ“₯), 10User-brennen: Enable incoming mail handling for GitLab - https://phabricator.wikimedia.org/T284961 (10thcipriani) [21:03:44] 10Release-Engineering-Team (Onboarding πŸš€), 10MediaWiki-Release-Tools, 10User-brennen: Clear out the old branches on mediawiki/core.git that aren't active any more - https://phabricator.wikimedia.org/T281939 (10thcipriani) [21:03:48] 10Release-Engineering-Team (Onboarding πŸš€): Delete the wmf/1.37.0-wmf.* branches once we've fully deployed to 1.38.0-wmf.1 and finished with them - https://phabricator.wikimedia.org/T291501 (10thcipriani) [21:05:03] 10Release-Engineering-Team (Onboarding πŸš€), 10Scap: find a way to systematically update the deployment server name across all repos - https://phabricator.wikimedia.org/T197470 (10thcipriani) [21:11:22] 10Release-Engineering-Team (Onboarding πŸš€), 10Scap: scap backport check prevents using it to fix an about-to-be-live branch - https://phabricator.wikimedia.org/T317795 (10thcipriani) [21:19:33] 10Release-Engineering-Team (Seen), 10MW-on-K8s, 10Release Pipeline, 10serviceops-radar, 10Epic: Deploy MediaWiki to Wikimedia production in containers - https://phabricator.wikimedia.org/T238770 (10thcipriani) [21:20:04] 10Release-Engineering-Team (Priority Backlog πŸ“₯), 10MW-on-K8s, 10Release Pipeline, 10Patch-For-Review, 10User-brennen: Design m8s deployment workflows and tooling - https://phabricator.wikimedia.org/T279322 (10thcipriani) 05Openβ†’03Resolved Looks to me like the scope of this task is complete: * `scap... [21:20:06] 10Release-Engineering-Team (Onboarding πŸš€): Delete wmf branches from Gerrit repositories - https://phabricator.wikimedia.org/T303828 (10thcipriani) [21:21:03] 10Release-Engineering-Team (Onboarding πŸš€), 10Scap: Enhance scap-pull with swagger and error level checks - https://phabricator.wikimedia.org/T315582 (10thcipriani) [21:30:00] 10Release-Engineering-Team (They Live πŸ•ΆοΈπŸ§Ÿ), 10Anti-Harassment, 10Projects-Cleanup, 10Security-Team, 10iPoid-Service: Migrate mediawiki/services/ipoid to GitLab - https://phabricator.wikimedia.org/T337714 (10sbassett) >>! In T337714#8917614, @kostajh wrote: > in the meantime, one can use tags from https:/... [21:35:21] 10Phabricator, 10serviceops-collab, 10Developer-Advocacy (Apr-Jun 2023): Automate SQL queries for annual end-of-year Phabricator statistics/metrics on wikitech-l@ - https://phabricator.wikimedia.org/T337388 (10Aklapper) Grmpf, still one line left to fix in the bash land of phun: > `* people were active in P... [21:36:16] 10Phabricator, 10serviceops-collab, 10Developer-Advocacy (Apr-Jun 2023): Automate SQL queries for annual end-of-year Phabricator statistics/metrics on wikitech-l@ - https://phabricator.wikimedia.org/T337388 (10Dzahn) works now after follow-up fixes.:) check your mail one more time [21:36:46] 10Phabricator, 10serviceops-collab, 10Developer-Advocacy (Apr-Jun 2023): Automate SQL queries for annual end-of-year Phabricator statistics/metrics on wikitech-l@ - https://phabricator.wikimedia.org/T337388 (10Dzahn) >>! In T337388#8919648, @Aklapper wrote: > Grmpf, still one line left to fix in the bash lan... [21:51:41] 10Phabricator, 10Dumps-Generation: Compress phabricator dump - https://phabricator.wikimedia.org/T262744 (10Ladsgroup) bikeshed time: gzip or bzip? [21:54:10] 10Phabricator, 10Dumps-Generation: Compress phabricator dump - https://phabricator.wikimedia.org/T262744 (10Ladsgroup) a:03Ladsgroup i'll do it if you tell me which compression method: the options are: gzip, bzip, or if we want to be super fancy: zstd, [22:10:16] 10Phabricator, 10Dumps-Generation: Compress phabricator dump - https://phabricator.wikimedia.org/T262744 (10Dzahn) voting against super fancy and for simple .gz :) [22:10:34] 10Phabricator, 10Dumps-Generation: Compress phabricator dump - https://phabricator.wikimedia.org/T262744 (10Dzahn) alternative to doing it in python is that we run the actual gzip command on it right after upload [22:10:50] 10Release-Engineering-Team (Onboarding πŸš€), 10Scap: scap backport check prevents using it to fix an about-to-be-live branch - https://phabricator.wikimedia.org/T317795 (10jeena) Just tested this and as it works currently, It will continue to merge and deploy as directed by the user, but will fail with an error... [22:15:01] 10Phabricator, 10Dumps-Generation: Compress phabricator dump - https://phabricator.wikimedia.org/T262744 (10Dzahn) In puppet it's " $dump_script = "${directory}/public_task_dump.py". We could just make this " $dump_script = "${directory}/public_task_dump.py | gzip > ..." and not even need a Phabricator depl... [22:25:07] 10Gerrit: List of files in a Gerrit change appears empty in the UI - https://phabricator.wikimedia.org/T338569 (10jhsoby) >>! In T338569#8917607, @hashar wrote: > When it happens can you look at the browser console (should be {key ctrl shift c}: control, shift, C}. Maybe there is some javascript error or a http... [22:31:50] 10Release-Engineering-Team (Onboarding πŸš€), 10Scap: scap backport check prevents using it to fix an about-to-be-live branch - https://phabricator.wikimedia.org/T317795 (10thcipriani) >>! In T317795#8919953, @jeena wrote: > Just tested this and as it works currently, It will continue to merge and deploy as direc... [22:32:38] (03CR) 10Hashar: [C: 03+2] "Tested by passing to ssh:" [integration/config] - 10https://gerrit.wikimedia.org/r/928183 (https://phabricator.wikimedia.org/T336427) (owner: 10Dzahn) [22:34:39] (03Merged) 10jenkins-bot: remove IPs from gerrit_ssh_host_key file [integration/config] - 10https://gerrit.wikimedia.org/r/928183 (https://phabricator.wikimedia.org/T336427) (owner: 10Dzahn) [22:40:49] 10Release-Engineering-Team (They Live πŸ•ΆοΈπŸ§Ÿ), 10Patch-For-Review, 10Release, 10Train Deployments: 1.41.0-wmf.12 deployment blockers - https://phabricator.wikimedia.org/T337526 (10thcipriani) 05Openβ†’03Resolved [23:09:11] 10Release-Engineering-Team (Onboarding πŸš€), 10Scap: scap backport check prevents using it to fix an about-to-be-live branch - https://phabricator.wikimedia.org/T317795 (10jeena) No, I think it should skip the sync step instead of fail if the branch is not staged. [23:13:53] 10MediaWiki-Releasing, 10MW-1.40-release, 10Release: Write release announcement for 1.40.0-rc.0 - https://phabricator.wikimedia.org/T329084 (10Reedy) 05Openβ†’03Resolved [23:13:56] 10MediaWiki-Releasing, 10MW-1.40-notes, 10MW-1.40-release, 10Release: Release MW 1.40.0-rc.0 - https://phabricator.wikimedia.org/T329083 (10Reedy) [23:33:52] 10MediaWiki-Releasing, 10MW-1.40-notes, 10MW-1.40-release, 10Release: Release MW 1.40.0-rc.0 - https://phabricator.wikimedia.org/T329083 (10Reedy) 05Openβ†’03Resolved [23:33:55] 10MediaWiki-Releasing, 10MW-1.40-release, 10Release: Release MW 1.40.0 - https://phabricator.wikimedia.org/T329075 (10Reedy)