[00:29:29] 10GitLab (Account Approval), 06Release-Engineering-Team: 14Requesting GitLab account activation for Baba Berete - 14https://phabricator.wikimedia.org/T361658#9682612 (10bd808) 05Open→03Resolved a:03glaab 14https://gitlab.wikimedia.org/baba It looks like #tool-gitlab-account-approval found our Toolf... [00:42:08] dancy: the CI Jenkins jobs run as `jenkins-jobs` with uid 2947. They then run containers in Docker (which runs as root) with image having `USER nobody` thus uid 65534 [00:42:46] the docker-registry.wikimedia.org/releng/castor has `USER nobody` [00:44:01] what I suspect is the `cache` or `log` directories are recreated automagically by the docker daemon. That build is from April 2 but the `cache` file is from Mar 28 13:22 [00:45:53] that leads to that build https://integration.wikimedia.org/ci/job/operations-mw-config-tox-docker/6776/console [00:49:14] one of the postbuild script got interrupted the workdir is empty, but I suspect some Docker container is still running in the background [00:49:29] cause surely, a trailing dir is created :/ [00:54:27] Lucas_WMDE: re Wikibase coverage, looks like the issue got investigated by Tim and me at https://phabricator.wikimedia.org/T288396#8979619 [00:55:02] and looks like that is again something I dropped / forgot :/ [01:03:21] I think the issue lies in phpunit-suite-edit /workspace/src/tests/phpunit/suite.xml --cover-extension Wikibase [01:04:29] which is https://gerrit.wikimedia.org/g/integration/config/+/refs/heads/master/dockerfiles/quibble-buster-php74-coverage/phpunit-suite-edit.py#55 [01:06:42] it edits mediawiki/core suite.xml file to inject in the `` section filters to include `src`, `includes`, and `maintenance` [01:07:25] there is no such files in Wikibase since the code is under either `client` or `repo`, hence the message stating nothing is found [01:09:44] Tim suggested to hack that python script with some `if args.cover_extension == 'Wikibase':` [01:09:49] which would inject client/repo paths [01:10:01] and then move along and forget the whole stack is entirely broken [06:41:57] 10Continuous-Integration-Infrastructure, 07castor: Running `cypress` in Wikimedia CI requires unusual env variables - https://phabricator.wikimedia.org/T361624#9682983 (10hashar) Here is some context about CI: - the Docker images have the environment variables: -- `XDG_CACHE_HOME=/cache` , that is a bind moun... [07:12:15] 10Continuous-Integration-Infrastructure, 07castor, 13Patch-For-Review: Running `cypress` in Wikimedia CI requires unusual env variables - https://phabricator.wikimedia.org/T361624#9683048 (10hashar) Tried it with `find / -type f -name Cypress || :` and that yields nothing. Thus essentially `npm ci` does not... [09:25:34] 10GitLab (CI & Job Runners), 06collaboration-services, 13Patch-For-Review: Create a special-purpose Trusted Runner with Dockerfile frontend - https://phabricator.wikimedia.org/T357612#9683454 (10Jelto) >>! In T357612#9680650, @dancy wrote: >>>! In T357612#9679092, @Jelto wrote: >> The Trusted Dockerfile Runn... [11:02:19] (03PS1) 10Lucas Werkmeister (WMDE): Zuul: [mediawiki/extensions/EntitySchema] Disable PHP 8.2 testing for now [integration/config] - 10https://gerrit.wikimedia.org/r/1016745 [11:02:23] (03PS1) 10Lucas Werkmeister (WMDE): Zuul: [mediawiki/extensions/PropertySuggester] Disable PHP 8.2 testing for now [integration/config] - 10https://gerrit.wikimedia.org/r/1016746 [11:14:41] 10Release-Engineering-Team (Priority Backlog 📥), 13Patch-For-Review, 05Release, 05Train Deployments: 1.42.0-wmf.25 deployment blockers - https://phabricator.wikimedia.org/T360157#9683838 (10jnuche) Making a note here for T361695. If the error rate climbs up once we deploy to group2 it can possibly require... [11:25:40] Lucas_WMDE: james enabled php 8.2 widely yes :) [11:29:25] wikibugs: reboot [11:29:28] wikibugs: restart [11:29:35] wikibugs: connect redis [11:29:39] wikibugs: /help [11:29:40] :D [11:29:47] useless bots :D [11:34:09] (03PS2) 10Hashar: Zuul: [mediawiki/extensions/EntitySchema] Disable PHP 8.2 testing for now [integration/config] - 10https://gerrit.wikimedia.org/r/1016745 (https://phabricator.wikimedia.org/T360560) (owner: 10Lucas Werkmeister (WMDE)) [11:34:13] (03PS2) 10Hashar: Zuul: [mediawiki/extensions/PropertySuggester] Disable PHP 8.2 testing for now [integration/config] - 10https://gerrit.wikimedia.org/r/1016746 (https://phabricator.wikimedia.org/T360560) (owner: 10Lucas Werkmeister (WMDE)) [11:34:17] (03CR) 10Hashar: [C:03+2] "I have attached this change to T360560" [integration/config] - 10https://gerrit.wikimedia.org/r/1016745 (https://phabricator.wikimedia.org/T360560) (owner: 10Lucas Werkmeister (WMDE)) [11:34:21] (03CR) 10Hashar: "I have attached this change to T360560" [integration/config] - 10https://gerrit.wikimedia.org/r/1016746 (https://phabricator.wikimedia.org/T360560) (owner: 10Lucas Werkmeister (WMDE)) [11:34:33] (03Merged) 10jenkins-bot: Zuul: [mediawiki/extensions/EntitySchema] Disable PHP 8.2 testing for now [integration/config] - 10https://gerrit.wikimedia.org/r/1016745 (https://phabricator.wikimedia.org/T360560) (owner: 10Lucas Werkmeister (WMDE)) [11:34:43] (03CR) 10Hashar: [C:03+2] Zuul: [mediawiki/extensions/PropertySuggester] Disable PHP 8.2 testing for now [integration/config] - 10https://gerrit.wikimedia.org/r/1016746 (https://phabricator.wikimedia.org/T360560) (owner: 10Lucas Werkmeister (WMDE)) [11:34:59] (03Merged) 10jenkins-bot: Zuul: [mediawiki/extensions/PropertySuggester] Disable PHP 8.2 testing for now [integration/config] - 10https://gerrit.wikimedia.org/r/1016746 (https://phabricator.wikimedia.org/T360560) (owner: 10Lucas Werkmeister (WMDE)) [11:53:18] 10GitLab (Project Migration), 06collaboration-services, 10Observability-Alerting, 13Patch-For-Review: Migrate SRE repositories to GitLab - operations/alerts - https://phabricator.wikimedia.org/T349626#9683962 (10fgiunchedi) I'm moving this off this Q board since I believe it'll happen further down the line [12:06:24] 10Release-Engineering-Team (Priority Backlog 📥), 13Patch-For-Review, 05Release, 05Train Deployments: 1.42.0-wmf.25 deployment blockers - https://phabricator.wikimedia.org/T360157#9684024 (10jnuche) [12:27:17] 10GitLab (Infrastructure), 06collaboration-services: Evaluate a high available GitLab architecture - https://phabricator.wikimedia.org/T323201#9684097 (10Jelto) One important note (thanks @eoghan for pointing this out): GitLab HA is marked as a premium feature [here](https://docs.gitlab.com/ee/administration/r... [12:29:55] 10Release-Engineering-Team (Priority Backlog 📥), 13Patch-For-Review, 05Release, 05Train Deployments: 1.42.0-wmf.25 deployment blockers - https://phabricator.wikimedia.org/T360157#9684101 (10jnuche) [12:36:21] 10GitLab (Infrastructure), 06collaboration-services: Evaluate a high available GitLab architecture - https://phabricator.wikimedia.org/T323201#9684149 (10taavi) https://docs.gitlab.com/ee/administration/reference_architectures/3k_users.html also lists Consul as one of the components, which is non-free software. [12:41:39] (03PS1) 10Zoranzoki21: Zuul: Enable CI for the VECancelButton extension [integration/config] - 10https://gerrit.wikimedia.org/r/1016761 [12:43:26] (03PS1) 10Umherirrender: Zuul: [mediawiki/extensions/Score] Disable PHP 8.2 testing for now [integration/config] - 10https://gerrit.wikimedia.org/r/1016762 (https://phabricator.wikimedia.org/T360560) [12:43:33] 10Continuous-Integration-Infrastructure, 07Jenkins, 06Release-Engineering-Team, 06collaboration-services, and 3 others: 14Jenkins core security advisory - 2024-03-20 - 14https://phabricator.wikimedia.org/T360759#9684187 (10hashar) 05Open→03Resolved a:03hashar [12:57:42] That's quite a few disablings [12:59:39] I present you the best commit message of the day https://github.com/jenkinsci/parameterized-trigger-plugin/commit/06d8f19218e2af1e5fef27ec25afdd5b80ecd6f9 [13:00:20] to be fair, that is part of 3 commits pull request https://github.com/jenkinsci/parameterized-trigger-plugin/pull/161 [13:00:34] Reedy: yeah php 8.2 is broken [13:00:37] err [13:00:47] bunch of our code doesn ot work with 8.2 [13:00:55] (03CR) 10Hashar: [C:03+2] Zuul: [mediawiki/extensions/Score] Disable PHP 8.2 testing for now [integration/config] - 10https://gerrit.wikimedia.org/r/1016762 (https://phabricator.wikimedia.org/T360560) (owner: 10Umherirrender) [13:01:03] (03CR) 10Hashar: [C:03+2] Zuul: Enable CI for the VECancelButton extension [integration/config] - 10https://gerrit.wikimedia.org/r/1016761 (owner: 10Zoranzoki21) [13:01:46] Lucas_WMDE: the repo I found to be depending on Wikibase https://phabricator.wikimedia.org/P58906 [13:01:54] that comes from the zuul parameter_function.py array of doom [13:02:59] (03Merged) 10jenkins-bot: Zuul: [mediawiki/extensions/Score] Disable PHP 8.2 testing for now [integration/config] - 10https://gerrit.wikimedia.org/r/1016762 (https://phabricator.wikimedia.org/T360560) (owner: 10Umherirrender) [13:03:00] hashar: I had also put a similar list in https://gerrit.wikimedia.org/r/c/integration/config/+/1013338/2#message-8f4394dffea5bc51f9795cff97b41352b4b53d08 (but without transitive dependencies) but apparently nothing came of it [13:03:24] (03Merged) 10jenkins-bot: Zuul: Enable CI for the VECancelButton extension [integration/config] - 10https://gerrit.wikimedia.org/r/1016761 (owner: 10Zoranzoki21) [13:03:30] 10Continuous-Integration-Infrastructure, 07Jenkins, 06Release-Engineering-Team: Jenkins CI parameterized trigger plugin logs warnings - https://phabricator.wikimedia.org/T336782#9684254 (10hashar) [13:04:43] (03PS1) 10Lucas Werkmeister (WMDE): Zuul: [mediawiki/extensions/WikimediaBadges] Disable PHP 8.2 testing for now [integration/config] - 10https://gerrit.wikimedia.org/r/1016765 (https://phabricator.wikimedia.org/T360560) [13:04:48] ^ anothe rone [13:05:39] (03CR) 10Hashar: [C:03+2] Zuul: [mediawiki/extensions/WikimediaBadges] Disable PHP 8.2 testing for now [integration/config] - 10https://gerrit.wikimedia.org/r/1016765 (https://phabricator.wikimedia.org/T360560) (owner: 10Lucas Werkmeister (WMDE)) [13:05:45] thanks [13:05:47] good wikibugs [13:05:56] it is such a pleasant bu^Hot [13:07:35] (03Merged) 10jenkins-bot: Zuul: [mediawiki/extensions/WikimediaBadges] Disable PHP 8.2 testing for now [integration/config] - 10https://gerrit.wikimedia.org/r/1016765 (https://phabricator.wikimedia.org/T360560) (owner: 10Lucas Werkmeister (WMDE)) [13:08:56] !log Reloaded Zuul for https://gerrit.wikimedia.org/r/1016761 https://gerrit.wikimedia.org/r/1016762 https://gerrit.wikimedia.org/r/1016765 [13:08:57] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [13:10:04] Hi! [13:10:04] I'm trying to deploy refinery-source but Step 3 (when updating the symlinks to the latest refinery-source jars in the refinery repository) is failing (https://integration.wikimedia.org/ci/job/analytics-refinery-update-jars-docker/102/console). There is an error: [13:10:04] Error downloading object: artifacts/article-recommender/venv-0.0.1.zip (e2e8ee8): Smudge error: Error downloading artifacts/article-recommender/venv-0.0.1.zip (e2e8ee8719c7dc4bec09612e9a58af21e932c14b4bfe44e6a15a876644ad2b28): batch request: missing protocol: "" [13:10:04] that could be related to the last patch that was deployed last week to Switch from git-fat to git-lfs: https://gerrit.wikimedia.org/r/c/analytics/refinery/+/1007690 [13:10:04] The file that is mentioned in the above error is involved in that patch [13:10:05] Any suggestion? [13:10:05] Thanks! [13:17:19] 10Beta-Cluster-Infrastructure, 06Release-Engineering-Team, 06Infrastructure-Foundations, 10observability, and 2 others: beta-scap-sync-world fails: logstash_checker.py: KeyError: 'aggregations' - https://phabricator.wikimedia.org/T360595#9684355 (10elukey) I think that all the work is done, varnishkafka se... [13:17:28] ohhh, it's wikibase related [13:18:25] (03PS1) 10Lucas Werkmeister (WMDE): Zuul: Disable PHP 8.2 testing for more extensions [integration/config] - 10https://gerrit.wikimedia.org/r/1016788 (https://phabricator.wikimedia.org/T360560) [13:18:38] hashar: I turned that paste into another change ^ [13:18:40] 10Continuous-Integration-Infrastructure, 07Jenkins, 06Release-Engineering-Team: Jenkins CI parameterized trigger plugin logs warnings - https://phabricator.wikimedia.org/T336782#9684357 (10hashar) Found it! [[ https://github.com/jenkinsci/parameterized-trigger-plugin/pull/148 | Pull request 148 - Don't autom... [13:19:01] (though I could also live with staying in whack-a-mole mode if you don’t want to change the config for too many extensions at once without checking whether they’re actually broken or not) [13:21:06] +1 yeah [13:21:32] I think James went to fix most of the extension but has left Wikibase for the future [13:21:46] and went to enable php 8.2 for all of the extenisons, missing the dependencies system [13:21:53] that paste above comes from a discussion we had here [13:22:01] but yeah I agree, breaking stuff is bad [13:22:31] (03CR) 10Hashar: [C:03+2] Zuul: Disable PHP 8.2 testing for more extensions [integration/config] - 10https://gerrit.wikimedia.org/r/1016788 (https://phabricator.wikimedia.org/T360560) (owner: 10Lucas Werkmeister (WMDE)) [13:23:36] (I also left out the [repo/name] thing from the commit message but feel free to add it if there’s a good format for it when there are several extensions affected) [13:24:17] (03Merged) 10jenkins-bot: Zuul: Disable PHP 8.2 testing for more extensions [integration/config] - 10https://gerrit.wikimedia.org/r/1016788 (https://phabricator.wikimedia.org/T360560) (owner: 10Lucas Werkmeister (WMDE)) [13:26:37] Lucas_WMDE: well you could make a php8.2-broken branch with individual commits for each extensions [13:26:43] then send a merge commit reque [13:26:44] wait [13:26:51] wrong workflow :) [13:27:05] !log Reloaded Zuul for https://gerrit.wikimedia.org/r/1016788 [13:27:09] hashar: Failed to log message to wiki. Somebody should check the error logs. [13:27:26] what? [13:28:14] incident, see -operations / -sre [13:28:23] (people are working on it) [13:37:29] ah thanks [13:39:12] (03CR) 10Jforrester: Zuul: Disable PHP 8.2 testing for more extensions (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/1016788 (https://phabricator.wikimedia.org/T360560) (owner: 10Lucas Werkmeister (WMDE)) [13:42:20] (03PS1) 10Jforrester: Zuul: [mediawiki/skins/2018] Add basic CI [integration/config] - 10https://gerrit.wikimedia.org/r/1016791 [13:44:33] (03CR) 10Jforrester: [C:03+2] Zuul: [mediawiki/skins/2018] Add basic CI [integration/config] - 10https://gerrit.wikimedia.org/r/1016791 (owner: 10Jforrester) [13:45:46] (03Merged) 10jenkins-bot: Zuul: [mediawiki/skins/2018] Add basic CI [integration/config] - 10https://gerrit.wikimedia.org/r/1016791 (owner: 10Jforrester) [13:46:12] !log Zuul: [mediawiki/skins/2018] Add basic CI [13:46:15] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [13:59:39] 10Release-Engineering-Team (Deployment Training Requests): Next steps for MediaWiki deployment training program - https://phabricator.wikimedia.org/T354318#9684481 (10jsn.sherman) Thank you, @thcipriani, I'll start finding deployment windows to lurk in every week! [14:11:34] 10WikimediaDebug, 10MediaWiki-Platform-Team (Radar), 13Patch-For-Review, 10SRE Observability (FY2023/2024-Q4): Write PHPUnit tests for excimer-ui-client (WikimediaDebug) - https://phabricator.wikimedia.org/T361412#9684532 (10lmata) Hola @Krinkle, is any assistance needed from our end? [14:11:59] 10WikimediaDebug, 10MediaWiki-Platform-Team (Radar), 13Patch-For-Review, 10SRE Observability (FY2023/2024-Q4): Write PHPUnit tests for excimer-ui-client (WikimediaDebug) - https://phabricator.wikimedia.org/T361412#9684534 (10lmata) [14:20:06] WARNING: An illegal reflective access operation has occurred [14:20:07] * hashar whistles [14:53:07] 06Release-Engineering-Team, 10Scap: scap: Please provide a subcommand to deploy a new security patch in scap itself - https://phabricator.wikimedia.org/T361709 (10taavi) 03NEW [15:26:17] 10Continuous-Integration-Infrastructure, 10EntitySchema, 10Wikidata, 10wmde-wikidata-tech, and 2 others: [ES] Investigate OutOfMemory error in browser test, remove workaround - https://phabricator.wikimedia.org/T356402#9684845 (10Lucas_Werkmeister_WMDE) I think we can check in a few days (or more) whether... [16:52:57] 06Project-Admins: Create project tag for wikimedia/update-history library - https://phabricator.wikimedia.org/T361723 (10cscott) 03NEW [16:53:12] 06Release-Engineering-Team, 06serviceops, 07Wikimedia-Incident: scap should check if it is running within a tmux/screen - https://phabricator.wikimedia.org/T361724 (10jijiki) 03NEW [16:54:32] 06Release-Engineering-Team, 06serviceops, 07Wikimedia-Incident: scap should check if it is running within a tmux/screen - https://phabricator.wikimedia.org/T361724#9685294 (10jijiki) p:05Triage→03High [16:56:27] 06Project-Admins: Create project tag for wikimedia/update-history library - https://phabricator.wikimedia.org/T361723#9685303 (10cscott) [17:22:31] 10Beta-Cluster-Infrastructure, 06Release-Engineering-Team, 06Infrastructure-Foundations, 10observability, and 2 others: beta-scap-sync-world fails: logstash_checker.py: KeyError: 'aggregations' - https://phabricator.wikimedia.org/T360595#9685390 (10hashar) >>! In T360595#9684355, @elukey wrote: > I think t... [17:23:19] (03PS1) 10Hashar: beta-scap-sync-world: restore scap canary checks [integration/config] - 10https://gerrit.wikimedia.org/r/1016817 (https://phabricator.wikimedia.org/T360595) [17:24:24] (03CR) 10Hashar: [C:03+2] beta-scap-sync-world: restore scap canary checks [integration/config] - 10https://gerrit.wikimedia.org/r/1016817 (https://phabricator.wikimedia.org/T360595) (owner: 10Hashar) [17:25:12] (03CR) 10Hashar: "Since the logging stack has been restored, I have removed the `--force` with I03ecb0d7e6954117c499af0807fb491d1eb1073d" [integration/config] - 10https://gerrit.wikimedia.org/r/1014089 (https://phabricator.wikimedia.org/T360595) (owner: 10Thcipriani) [17:25:36] (03Merged) 10jenkins-bot: beta-scap-sync-world: restore scap canary checks [integration/config] - 10https://gerrit.wikimedia.org/r/1016817 (https://phabricator.wikimedia.org/T360595) (owner: 10Hashar) [17:26:35] 06Release-Engineering-Team, 10Scap, 06serviceops, 10Sustainability (Incident Followup): scap should check if it is running within a tmux/screen - https://phabricator.wikimedia.org/T361724#9685429 (10taavi) [17:34:02] 10Release-Engineering-Team (Radar), 10Temporary accounts, 13Patch-For-Review: Enable temp account creation in DevelopmentSettings.php - https://phabricator.wikimedia.org/T359043#9685436 (10thcipriani) [17:34:39] 06Release-Engineering-Team, 10Scap: scap: Please provide a subcommand to deploy a new security patch in scap itself - https://phabricator.wikimedia.org/T361709#9685437 (10taavi) [17:35:31] 10Beta-Cluster-Infrastructure, 06Release-Engineering-Team, 06Infrastructure-Foundations, 10observability, and 2 others: beta-scap-sync-world fails: logstash_checker.py: KeyError: 'aggregations' - https://phabricator.wikimedia.org/T360595#9685432 (10hashar) a:03elukey The [[ https://integration.wikimedia.... [17:39:48] 10Continuous-Integration-Config, 10MediaWiki-extensions-WikibaseRepository, 10Wikidata, 10wmde-wikidata-tech, 07PHP 8.2 support: Make PHP 8.2 voting on development branch of Wikibase - https://phabricator.wikimedia.org/T360560#9685442 (10Umherirrender) [17:40:28] 10GitLab (Account Approval), 06Release-Engineering-Team: 14Requesting GitLab account activation for Alejabo - 14https://phabricator.wikimedia.org/T361485#9685456 (10brennen) 05Open→03Resolved a:03brennen [17:40:30] 10Continuous-Integration-Config, 10Release-Engineering-Team (Seen): Remove "docker" suffix from Jenkins jobs - https://phabricator.wikimedia.org/T360327#9685452 (10thcipriani) p:05Triage→03Low [17:41:36] 10Release-Engineering-Team (Priority Backlog 📥), 10Scap, 13Patch-For-Review: backport is showing confusing prompt under certain conditions - https://phabricator.wikimedia.org/T360291#9685449 (10thcipriani) 05Open→03Stalled Stalling this one to reflect that the patch attached needs some rework and @jnuche... [17:45:06] 10Release-Engineering-Team (Radar), 10MW-on-K8s, 06serviceops: Helm deployment of MediaWiki now takes 6 minutes - https://phabricator.wikimedia.org/T360403#9685465 (10thcipriani) Moving this to our radar as I don't think #together can do anything about this directly right now—this is just how long it takes t... [17:49:03] 10Phabricator, 10Release-Engineering-Team (Priority Backlog 📥), 07Performance Issue: Submitting actions taking ~10 seconds to load after making changes - https://phabricator.wikimedia.org/T360484#9685471 (10thcipriani) @HNordeenWMF and @JWheeler-WMF I added you both to the [[https://phabricator.wikimedia.org... [18:20:18] (03PS1) 10Jforrester: jjb, Zuul: Rename all jobs to drop '-docker' label [integration/config] - 10https://gerrit.wikimedia.org/r/1016827 (https://phabricator.wikimedia.org/T360327) [18:20:36] (03CR) 10Jforrester: "I'll leave this to Antoine to decide upon. :-)" [integration/config] - 10https://gerrit.wikimedia.org/r/1016827 (https://phabricator.wikimedia.org/T360327) (owner: 10Jforrester) [18:55:53] 10WikimediaDebug, 10MediaWiki-Platform-Team (Radar), 13Patch-For-Review, 10SRE Observability (FY2023/2024-Q4): Write PHPUnit tests for excimer-ui-client (WikimediaDebug) - https://phabricator.wikimedia.org/T361412#9685633 (10Krinkle) @lmata Code review for the main patch. [18:56:49] 10WikimediaDebug, 10MediaWiki-Platform-Team (Radar), 13Patch-For-Review, 10SRE Observability (FY2023/2024-Q4): Write PHPUnit tests for excimer-ui-client (WikimediaDebug) - https://phabricator.wikimedia.org/T361412#9685639 (10lmata) @Krinkle I'll ask someone to take a look then, thanks! [19:08:18] (03CR) 10Krinkle: [C:03+1] "neeeat!" [integration/config] - 10https://gerrit.wikimedia.org/r/1016827 (https://phabricator.wikimedia.org/T360327) (owner: 10Jforrester) [19:13:13] 10GitLab-Application-Security-Pipeline, 06Security-Team: Craft more mediawiki-specific and php semgrep rule sets - https://phabricator.wikimedia.org/T342468#9685671 (10sbassett) a:03sbassett [19:13:20] 10GitLab-Application-Security-Pipeline, 06Security-Team: Craft more mediawiki-specific and php semgrep rule sets - https://phabricator.wikimedia.org/T342468#9685672 (10sbassett) [19:39:27] 10Beta-Cluster-Infrastructure, 06Release-Engineering-Team, 06Infrastructure-Foundations, 10observability, and 2 others: beta-scap-sync-world fails: logstash_checker.py: KeyError: 'aggregations' - https://phabricator.wikimedia.org/T360595#9685862 (10elukey) The old certificates (cergen based) for Kafka Logg... [20:22:27] 06Release-Engineering-Team, 10Scap, 06serviceops, 10Sustainability (Incident Followup): scap should check if it is running within a tmux/screen - https://phabricator.wikimedia.org/T361724#9685992 (10bd808) > Deployers should always run scap within a server side tmux/screen I think if this is actually the... [20:24:28] 10Scap, 10MW-on-K8s: Provide some feedback in scap whilst waiting for helmfile deploys to complete - https://phabricator.wikimedia.org/T361747 (10Jdforrester-WMF) 03NEW [23:35:40] 10Beta-Cluster-Infrastructure, 06Release-Engineering-Team, 06Infrastructure-Foundations, 10observability, and 2 others: 14beta-scap-sync-world fails: logstash_checker.py: KeyError: 'aggregations' - 14https://phabricator.wikimedia.org/T360595#9686558 (10thcipriani) 05Open→03Resolved 14>>! In T36059...