[07:21:18] 10Gerrit, 10Patch-For-Review: [wm-checks-api] Shows 'Starting gate-and-submit jobs.' as a run attempt - https://phabricator.wikimedia.org/T348920 (10hashar) When testing the change locally, the message is indeed filtered out: {F38467612 size=full} [07:21:54] (03CR) 10Hashar: [C: 03+2] "I have tested it locally using the production Gerrit as a backend and https://gerrit.wikimedia.org/r/c/integration/config/+/965869 as chan" [software/gerrit] (deploy/wmf/stable-3.5) - 10https://gerrit.wikimedia.org/r/966178 (https://phabricator.wikimedia.org/T348920) (owner: 10Hashar) [07:22:29] (03Merged) 10jenkins-bot: wm-checks-api: filter out Zuul start messages [software/gerrit] (deploy/wmf/stable-3.5) - 10https://gerrit.wikimedia.org/r/966178 (https://phabricator.wikimedia.org/T348920) (owner: 10Hashar) [07:28:45] 10Gerrit, 10Patch-For-Review: [wm-checks-api] Shows 'Starting gate-and-submit jobs.' as a run attempt - https://phabricator.wikimedia.org/T348920 (10hashar) 05Openβ†’03Resolved [07:32:55] 10Phabricator, 10Release-Engineering-Team (Escape Goats🐐), 10Patch-Needs-Improvement: Require WMF email address when registering Phab user account with a WMF SUL account - https://phabricator.wikimedia.org/T343647 (10Aklapper) If I understood ITS correctly, having a WMF SUL account //seems// to imply that pe... [07:39:22] 10GitLab (Infrastructure), 10collaboration-services: Create GitLab mirror - https://phabricator.wikimedia.org/T291322 (10Jelto) When opening the task disaster recovery was the main use-case. If production GitLab is down, we may have lost up to 24 hours of repository changes (during the time of ticket creation,... [07:53:52] Project beta-code-update-eqiad build #466078: 04FAILURE in 24 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/466078/ [08:05:46] Yippee, build fixed! [08:05:46] Project beta-code-update-eqiad build #466079: 09FIXED in 2 min 45 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/466079/ [09:10:37] 10Release-Engineering-Team (Priority Backlog πŸ“₯), 10Patch-For-Review, 10Release, 10Train Deployments, 10User-brennen: 1.42.0-wmf.1 deployment blockers - https://phabricator.wikimedia.org/T348354 (10Lucas_Werkmeister_WMDE) >>! In T348354#9253290, @Lucas_Werkmeister_WMDE wrote: > ** We can test on Test Wiki... [09:16:10] 10Continuous-Integration-Config, 10Quibble, 10Platform Team Initiatives (API Integration Tests): "should mark the revert as a bot edit" test flaky with Apache + php-fpm - https://phabricator.wikimedia.org/T298514 (10Aklapper) [09:23:39] 10Continuous-Integration-Config, 10MediaWiki-Core-Tests, 10Quibble, 10Platform Team Initiatives (API Integration Tests): Core apitests job should run extension/skin api tests as well - https://phabricator.wikimedia.org/T303255 (10Aklapper) Adding missing #MediaWiki-Core-Tests code project tag as #cpt-api-t... [09:24:29] 10Continuous-Integration-Config, 10MediaWiki-Core-Tests, 10Quibble, 10Platform Team Initiatives (API Integration Tests): "should mark the revert as a bot edit" test flaky with Apache + php-fpm - https://phabricator.wikimedia.org/T298514 (10Aklapper) Adding missing #MediaWiki-Core-Tests code project tag as... [09:56:15] (03CR) 10Jbond: [C: 03+1] "lgtm" [integration/config] - 10https://gerrit.wikimedia.org/r/937791 (https://phabricator.wikimedia.org/T236373) (owner: 10Hashar) [09:57:33] jbond: so to sum up, I delete https://integration.wikimedia.org/ci/job/operations-puppet-catalog-compiler/ and all of its history [09:57:39] deploy the new job that is based on labels [09:57:41] success [09:57:42] :) [09:57:44] 5~sgtm [09:58:22] * hashar looks up ANSI sequence for `5~` [10:00:20] (03CR) 10Hashar: [C: 03+2] "I have deleted the old Freestyle job and replaced it with this new Matrix job https://integration.wikimedia.org/ci/job/operations-puppet-c" [integration/config] - 10https://gerrit.wikimedia.org/r/937791 (https://phabricator.wikimedia.org/T236373) (owner: 10Hashar) [10:00:32] done! https://integration.wikimedia.org/ci/job/operations-puppet-catalog-compiler/build?delay=0sec [10:00:38] cheers [10:01:11] and `./utils/pcc.py` needs to be adjusted [10:01:38] though maybe if it does not pass any combination Jenkins will use the default label (puppet5-compiler-node) [10:01:41] (03Merged) 10jenkins-bot: jjb: convert PCC job to a matrix job [integration/config] - 10https://gerrit.wikimedia.org/r/937791 (https://phabricator.wikimedia.org/T236373) (owner: 10Hashar) [10:06:44] hashar: yes i plan to look at pcc shortly [10:07:58] (03PS1) 10Hashar: jjb: rename puppet-compiler-node to puppet5-compiler-node [integration/config] - 10https://gerrit.wikimedia.org/r/966500 (https://phabricator.wikimedia.org/T236373) [10:08:38] jbond: and that change ^ removes the label `puppet-compiler-node` in favor of `puppet5-compiler-node` [10:08:47] it is used by a single job (the one triggered by CI) https://integration.wikimedia.org/ci/label/puppet-compiler-node/ [10:09:59] ack thanks [10:10:13] !log Removing `puppet-compiler-node` label from the PCC workers, superseded by `puppet5-compiler-node` label | T236373 [10:10:16] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [10:10:17] T236373: update pcc with puppet 7 support - https://phabricator.wikimedia.org/T236373 [10:11:04] (03CR) 10Hashar: [C: 03+2] "I have removed `puppet-compiler-node` from the nodes" [integration/config] - 10https://gerrit.wikimedia.org/r/966500 (https://phabricator.wikimedia.org/T236373) (owner: 10Hashar) [10:12:49] (03Merged) 10jenkins-bot: jjb: rename puppet-compiler-node to puppet5-compiler-node [integration/config] - 10https://gerrit.wikimedia.org/r/966500 (https://phabricator.wikimedia.org/T236373) (owner: 10Hashar) [11:52:18] 10Continuous-Integration-Infrastructure, 10collaboration-services, 10Patch-For-Review: allow mwmaint/cumin hosts to connect to http on contint - https://phabricator.wikimedia.org/T340788 (10eoghan) a:05eoghanβ†’03None [12:17:06] 10Release-Engineering-Team, 10Wikimedia-Logstash, 10Wikimedia-production-error: MediaWiki normalized_message field has placeholders replaced since October 12th - https://phabricator.wikimedia.org/T349086 (10hashar) p:05Triageβ†’03Unbreak! Changing priority to {nav Unbreak Now!} cause that disrupt our triag... [12:21:30] 10Release-Engineering-Team, 10Wikimedia-Logstash, 10Wikimedia-production-error: MediaWiki normalized_message field has placeholders replaced since October 12th - https://phabricator.wikimedia.org/T349086 (10hashar) From operations/mediawiki-config, I guess that is related to 1.41.0-wmf.30 / T347081 which go... [12:37:38] 10Release-Engineering-Team, 10Wikimedia-Logstash, 10Wikimedia-production-error: MediaWiki normalized_message field has placeholders replaced since October 12th - https://phabricator.wikimedia.org/T349086 (10hashar) Maybe due to https://gerrit.wikimedia.org/r/c/mediawiki/core/+/963661 by @Krinkle . The commit... [12:54:21] 10Phabricator: Add Frostly to Triagers acl group - https://phabricator.wikimedia.org/T347817 (10Urbanecm) That too of course, but regardless of the idea, Triagers doesn't seem to be the right tool for that. [13:02:35] 10Release-Engineering-Team (Priority Backlog πŸ“₯), 10Patch-For-Review, 10Release, 10Train Deployments, 10User-brennen: 1.42.0-wmf.1 deployment blockers - https://phabricator.wikimedia.org/T348354 (10hashar) Note: the MediaWiki config has a bug which cases `normalized_message` to have placeholders replaced... [13:11:33] 10Release-Engineering-Team (Priority Backlog πŸ“₯), 10Patch-For-Review, 10Release, 10Train Deployments, 10User-brennen: 1.42.0-wmf.1 deployment blockers - https://phabricator.wikimedia.org/T348354 (10cscott) [13:14:06] 10Release-Engineering-Team (Priority Backlog πŸ“₯), 10Patch-For-Review, 10Release, 10Train Deployments, 10User-brennen: 1.42.0-wmf.1 deployment blockers - https://phabricator.wikimedia.org/T348354 (10cscott) >>! In T349033#9257804, @cscott wrote: > Adding as a train blocker. @matmarex and I /think/ that th... [13:51:51] 10Release-Engineering-Team, 10Wikimedia-Logstash, 10Patch-For-Review, 10User-brennen, 10Wikimedia-production-error: MediaWiki normalized_message field has placeholders replaced since October 12th - https://phabricator.wikimedia.org/T349086 (10brennen) [14:33:05] 10Release-Engineering-Team (Priority Backlog πŸ“₯), 10Patch-For-Review, 10Release, 10Train Deployments, 10User-brennen: 1.42.0-wmf.1 deployment blockers - https://phabricator.wikimedia.org/T348354 (10matmarex) [14:59:42] 10GitLab (Auth & Access), 10collaboration-services: Clarify the process of logging into gitlab-replica using 2FA - https://phabricator.wikimedia.org/T330639 (10Jelto) 05Openβ†’03Resolved Replicas show a additional message in the banner with some information about 2FA now. I'm closing this task. [15:03:47] 10Phabricator (2023-10-17), 10Release-Engineering-Team (Priority Backlog πŸ“₯), 10collaboration-services, 10Patch-For-Review, 10User-brennen: Deploy Phabricator/Phorge 2023-10-17 - https://phabricator.wikimedia.org/T349038 (10ops-monitoring-bot) Icinga downtime and Alertmanager silence (ID=bfe664a6-89fd-4b3... [15:04:21] 10Phabricator (2023-10-17), 10Release-Engineering-Team (Priority Backlog πŸ“₯), 10collaboration-services, 10Patch-For-Review, 10User-brennen: Deploy Phabricator/Phorge 2023-10-17 - https://phabricator.wikimedia.org/T349038 (10ops-monitoring-bot) Icinga downtime and Alertmanager silence (ID=d0c322a3-de51-4ca... [15:04:33] 10Phabricator (2023-10-17), 10Release-Engineering-Team (Priority Backlog πŸ“₯), 10collaboration-services, 10Patch-For-Review, 10User-brennen: Deploy Phabricator/Phorge 2023-10-17 - https://phabricator.wikimedia.org/T349038 (10CodeReviewBot) brennen merged https://gitlab.wikimedia.org/repos/phabricator/deplo... [15:16:13] 10Phabricator, 10Release-Engineering-Team (Priority Backlog πŸ“₯), 10collaboration-services: Stop logging Bugzilla to Phabricator redirector misses - https://phabricator.wikimedia.org/T344884 (10brennen) Looks like this actually lives in the Phabricator deployment repo. Patch incoming. [15:18:58] 10Phabricator (2023-10-17), 10Release-Engineering-Team (Priority Backlog πŸ“₯), 10User-brennen: Uninstall Drydock (Phabricator application) - https://phabricator.wikimedia.org/T337308 (10Aklapper) 05Openβ†’03Resolved [15:20:23] 10Phabricator (2023-10-17), 10Release-Engineering-Team (Priority Backlog πŸ“₯), 10collaboration-services, 10User-brennen: Deploy Phabricator/Phorge 2023-10-17 - https://phabricator.wikimedia.org/T349038 (10Aklapper) 05Openβ†’03Resolved a:05Aklapperβ†’03brennen @brennen handled this one, I might try next... [15:26:04] 10Phabricator, 10Release-Engineering-Team (Priority Backlog πŸ“₯), 10collaboration-services, 10Patch-For-Review: Stop logging Bugzilla to Phabricator redirector misses - https://phabricator.wikimedia.org/T344884 (10CodeReviewBot) brennen opened https://gitlab.wikimedia.org/repos/phabricator/deployment/-/merge... [15:28:24] 10Phabricator, 10Release-Engineering-Team (Priority Backlog πŸ“₯), 10collaboration-services, 10Patch-For-Review: Stop logging Bugzilla to Phabricator redirector misses - https://phabricator.wikimedia.org/T344884 (10Aklapper) a:05Aklapperβ†’03brennen [15:44:19] 10GitLab (Pipeline Services Migration🐀), 10Metrics Platform Backlog, 10Data Products (Sprint 01), 10Patch-For-Review: Migrate metrics-platform repo to GitLab - https://phabricator.wikimedia.org/T344733 (10thcipriani) 05Openβ†’03Resolved >>! In T344733#9251040, @thcipriani wrote: > * [x] Archive the gerri... [15:45:49] 10Phabricator: Add Frostly to Triagers acl group - https://phabricator.wikimedia.org/T347817 (10Frostly) 05Openβ†’03Invalid Thanks for the clarification and pointer to the API! Closing. [15:52:44] 10Phabricator: Uninstall Owners (Phabricator application) - https://phabricator.wikimedia.org/T336907 (10Aklapper) a:03Aklapper [15:59:50] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team (Seen), 10Patch-For-Review: Beta puppetmaster cherry-pick process - https://phabricator.wikimedia.org/T135427 (10Krinkle) Update from various sidebar chats: 1. challenge: teams are not required to fix Beta, given lack of org-wide agreement/funding fo... [16:20:53] 10Project-Admins, 10Wikipedia-Android-App-Backlog, 10Wikipedia-iOS-App-Backlog: More intuitive names for Phabricator tags "Wikipedia-Android-App-Backlog" and "Wikipedia-iOS-App-Backlog" - https://phabricator.wikimedia.org/T347364 (10Seddon) >>! In T347364#9255194, @Aklapper wrote: >> avoid changing the name... [16:37:51] 10Release-Engineering-Team (Priority Backlog πŸ“₯), 10Patch-For-Review, 10Release, 10Train Deployments, 10User-brennen: 1.42.0-wmf.1 deployment blockers - https://phabricator.wikimedia.org/T348354 (10ssastry) [16:58:37] 10Gitlab-Application-Security-Pipeline, 10Security-Team: Craft more mediawiki-specific and php semgrep rule sets - https://phabricator.wikimedia.org/T342468 (10sbassett) a:05sbassettβ†’03None [16:58:52] 10Gitlab-Application-Security-Pipeline, 10SecTeam-Processed, 10Security, 10user-sbassett: Improve related gitlab test repository - https://phabricator.wikimedia.org/T348788 (10sbassett) 05Openβ†’03In progress p:05Triageβ†’03Medium [16:58:56] 10Gitlab-Application-Security-Pipeline, 10Security-Team, 10SecTeam-Processed, 10Security, 10user-sbassett: [EPIC] Application Security Pipeline Components for Gitlab - Phase 2 Work - https://phabricator.wikimedia.org/T342177 (10sbassett) [17:38:45] 10Phabricator, 10Patch-For-Review: Uninstall Owners (Phabricator application) - https://phabricator.wikimedia.org/T336907 (10CodeReviewBot) aklapper opened https://gitlab.wikimedia.org/repos/phabricator/deployment/-/merge_requests/24 Remove unused "Owners" application from default settings [17:42:07] 10Phabricator: A task is concurrently in two different columns at the same workboard - https://phabricator.wikimedia.org/T349124 (10Urbanecm_WMF) [17:48:16] 10Phabricator: A task is concurrently in two different columns at the same workboard - https://phabricator.wikimedia.org/T349124 (10Aklapper) [17:48:26] 10Phabricator: One Phabricator task displayed in two workboard columns simultaneously - https://phabricator.wikimedia.org/T335443 (10Aklapper) [17:58:16] 10Release-Engineering-Team (Priority Backlog πŸ“₯), 10Patch-For-Review, 10Release, 10Train Deployments, 10User-brennen: 1.42.0-wmf.1 deployment blockers - https://phabricator.wikimedia.org/T348354 (10ssastry) [RISKY PATCH STATUS]: Here is an update of where we stand since y'day: * After Daniel and Scott di... [18:17:43] 10Release-Engineering-Team (Priority Backlog πŸ“₯), 10Patch-For-Review, 10Release, 10Train Deployments, 10User-brennen: 1.42.0-wmf.1 deployment blockers - https://phabricator.wikimedia.org/T348354 (10ssastry) [18:29:06] (03PS1) 10Jforrester: Dockerfiles: [sonar-scanner] Build off standard node16 CI image [integration/config] - 10https://gerrit.wikimedia.org/r/966597 [18:54:05] 10Release-Engineering-Team, 10Wikimedia-Logstash, 10Patch-For-Review, 10User-brennen, 10Wikimedia-production-error: MediaWiki normalized_message field has placeholders replaced since October 12th - https://phabricator.wikimedia.org/T349086 (10hashar) 05Openβ†’03Resolved a:03hashar I have deployed the... [19:27:39] (03CR) 10Hashar: [C: 03+1] "Oh of course I should have thought about copying instead of copy pasting the definition. This way the sonar-scanner image will be rebuild " [integration/config] - 10https://gerrit.wikimedia.org/r/966597 (owner: 10Jforrester) [19:48:19] (03CR) 10Pwangai: [C: 03+1] "Thank you James for the patch." [integration/config] - 10https://gerrit.wikimedia.org/r/966597 (owner: 10Jforrester) [20:20:26] 10Gerrit, 10Phabricator: The list of linked Gerrit patches in Phabricator tasks should not have clickable repo/branch links - https://phabricator.wikimedia.org/T349138 (10Tgr) [20:39:25] 10Release-Engineering-Team (Radar), 10DBA, 10MediaWiki-libs-Rdbms, 10Wikimedia-Logstash, 10observability: Transaction profiler logs full query which is truncated by logstash - https://phabricator.wikimedia.org/T349140 (10hashar) [21:23:06] 10Phabricator, 10Wikimedia-Phabricator-Extensions: The list of linked Gerrit patches in Phabricator tasks should not have clickable repo/branch links - https://phabricator.wikimedia.org/T349138 (10Aklapper) [21:43:51] 10Release-Engineering-Team (Radar), 10DBA, 10MediaWiki-libs-Rdbms, 10Observability-Logging, 10Wikimedia-Logstash: Transaction profiler logs full query which is truncated by logstash - https://phabricator.wikimedia.org/T349140 (10colewhite) [22:48:17] I forgot to go to bed :( [22:48:22] doing now! [22:52:21] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team (Seen), 10Patch-For-Review: Beta puppetmaster cherry-pick process - https://phabricator.wikimedia.org/T135427 (10thcipriani) >>! In T135427#9258656, @Krinkle wrote: > Update from various sidebar chats: > > 1. challenge: teams are not required to fi... [23:24:18] 10Release-Engineering-Team, 10Fresnel, 10patch-welcome: Add scenario options to Fresnel comparison output - https://phabricator.wikimedia.org/T217856 (10thcipriani)