[03:17:15] (03CR) 10Ladsgroup: dockerfiles: Add php-excimer to quibble (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/748312 (https://phabricator.wikimedia.org/T225730) (owner: 10Ladsgroup) [04:48:18] (03CR) 1020after4: "I'd almost prefer if this was the default behavior." [tools/scap] - 10https://gerrit.wikimedia.org/r/751792 (owner: 10Ahmon Dancy) [04:48:37] (03CR) 1020after4: [C: 03+1] Add --abort-git-am-on-fail option to scap apply-patches [tools/scap] - 10https://gerrit.wikimedia.org/r/751792 (owner: 10Ahmon Dancy) [08:30:03] 10Continuous-Integration-Infrastructure, 10DC-Ops, 10netops, 10ops-codfw: DRAC firmware upgrades codfw (was: Flapping codfw management alarm ( contint2001.mgmt/SSH is CRITICAL )) - https://phabricator.wikimedia.org/T283582 (10hashar) 05Resolved→03Open I no more receive alarms from `contint2001.mgmt` wh... [09:18:31] 10Release-Engineering-Team (Seen), 10Scap, 10Epic, 10Goal: Automate the Train - https://phabricator.wikimedia.org/T196515 (10hashar) [09:18:37] 10Release-Engineering-Team (Yak Shaving 🐃🪒), 10Scap: Automate scap prep - https://phabricator.wikimedia.org/T245184 (10hashar) 05Open→03Resolved a:03dancy `stage-train` covers the indeed, well done @dancy [10:02:39] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Seen), 10Zuul, 10Patch-For-Review, 10ci-test-error (WMF-deployed Build Failure): fatal: remote error: access denied or repository not exported: /mediawiki/extensions/ReadingLists - https://phabricator.wikimedia.org/T187897 (10hashar) `g... [10:33:42] 10Release-Engineering-Team (Next), 10Release, 10Train Deployments: 1.38.0-wmf.17 deployment blockers - https://phabricator.wikimedia.org/T293958 (10Ciencia_Al_Poder) [11:20:20] 10Quibble, 10MediaWiki-Core-Tests, 10Browser-Tests, 10MW-1.38-notes (1.38.0-wmf.17; 2022-01-10), and 2 others: Run browser tests in parallel - https://phabricator.wikimedia.org/T226869 (10hashar) [12:01:43] (03PS7) 10Awight: Wrapper to pretty-print parallel job progress [integration/quibble] - 10https://gerrit.wikimedia.org/r/693458 [12:01:46] (03PS44) 10Awight: Parallelism as a command object [integration/quibble] - 10https://gerrit.wikimedia.org/r/587885 (https://phabricator.wikimedia.org/T235449) [12:03:19] (03PS13) 10Awight: Split extension and skin npm and composer tests [integration/quibble] - 10https://gerrit.wikimedia.org/r/587888 [12:12:24] (03PS6) 10Awight: Split core npm and composer tests [integration/quibble] - 10https://gerrit.wikimedia.org/r/588087 [12:15:47] (03CR) 10jerkins-bot: [V: 04-1] Split core npm and composer tests [integration/quibble] - 10https://gerrit.wikimedia.org/r/588087 (owner: 10Awight) [12:22:04] (03PS4) 10Awight: Sequence of commands as a command [integration/quibble] - 10https://gerrit.wikimedia.org/r/588083 [12:25:03] (03PS5) 10Awight: Sequence of commands as a command [integration/quibble] - 10https://gerrit.wikimedia.org/r/588083 [12:28:20] (03CR) 10jerkins-bot: [V: 04-1] Sequence of commands as a command [integration/quibble] - 10https://gerrit.wikimedia.org/r/588083 (owner: 10Awight) [13:06:39] (03CR) 10Hashar: [C: 03+1] "`atexit` always triggers a warning, then I don't have any good idea right now to replace it by something else :D" [integration/quibble] - 10https://gerrit.wikimedia.org/r/693458 (owner: 10Awight) [13:11:22] (03CR) 10Awight: Wrapper to pretty-print parallel job progress (031 comment) [integration/quibble] - 10https://gerrit.wikimedia.org/r/693458 (owner: 10Awight) [13:26:31] (03CR) 10Awight: [C: 04-1] "Going to try rewriting this without `atexit`." [integration/quibble] - 10https://gerrit.wikimedia.org/r/693458 (owner: 10Awight) [13:47:58] 10Quibble, 10MediaWiki-Core-Tests, 10Browser-Tests, 10MW-1.38-notes (1.38.0-wmf.17; 2022-01-10), and 2 others: Run browser tests in parallel - https://phabricator.wikimedia.org/T226869 (10Krinkle) FYI: > Change by Awight **merged**: > > [mediawiki/core] selenium: run 4 tests in parallel > > 10Quibble, 10MW-1.36-notes (1.36.0-wmf.26; 2021-01-12), 10Patch-For-Review, 10User-awight: Consider httpd for quibble instead of php built-in server - https://phabricator.wikimedia.org/T225218 (10kostajh) The conclusion to this was {https://phabricator.wikimedia.org/T285649} \o/ [15:00:28] maintenance-disconnect-full-disks build 349107 integration-agent-docker-1010 (/: 26%, /srv: 96%, /var/lib/docker: 36%): OFFLINE due to disk space [15:05:33] maintenance-disconnect-full-disks build 349108 integration-agent-docker-1010 (/: 26%, /srv: 7%, /var/lib/docker: 32%): RECOVERY disk space OK [15:12:02] (03CR) 10Awight: [C: 04-1] Wrapper to pretty-print parallel job progress (031 comment) [integration/quibble] - 10https://gerrit.wikimedia.org/r/693458 (owner: 10Awight) [15:15:36] (Queue (Jenkins jobs + Zuul functions) alert) firing: Queue (Jenkins jobs + Zuul functions) alert - https://alerts.wikimedia.org [15:20:36] (Queue (Jenkins jobs + Zuul functions) alert) firing: (3) Queue (Jenkins jobs + Zuul functions) alert - https://alerts.wikimedia.org [15:24:05] (03PS8) 10Awight: Wrapper to pretty-print parallel job progress [integration/quibble] - 10https://gerrit.wikimedia.org/r/693458 [15:24:11] (03PS45) 10Awight: Parallelism as a command object [integration/quibble] - 10https://gerrit.wikimedia.org/r/587885 (https://phabricator.wikimedia.org/T235449) [15:24:17] (03PS14) 10Awight: Split extension and skin npm and composer tests [integration/quibble] - 10https://gerrit.wikimedia.org/r/587888 [15:24:42] (03CR) 10Awight: "Smoke-tested the happy path locally." [integration/quibble] - 10https://gerrit.wikimedia.org/r/693458 (owner: 10Awight) [15:27:22] (03CR) 10jerkins-bot: [V: 04-1] Parallelism as a command object [integration/quibble] - 10https://gerrit.wikimedia.org/r/587885 (https://phabricator.wikimedia.org/T235449) (owner: 10Awight) [15:27:39] (03CR) 10jerkins-bot: [V: 04-1] Split extension and skin npm and composer tests [integration/quibble] - 10https://gerrit.wikimedia.org/r/587888 (owner: 10Awight) [15:28:10] (03CR) 10jerkins-bot: [V: 04-1] Wrapper to pretty-print parallel job progress [integration/quibble] - 10https://gerrit.wikimedia.org/r/693458 (owner: 10Awight) [15:28:47] (03CR) 10Awight: "Was also able to locally verify that a failed subprocess will immediately stop the application and print errors." [integration/quibble] - 10https://gerrit.wikimedia.org/r/693458 (owner: 10Awight) [15:32:03] (03PS9) 10Awight: Wrapper to pretty-print parallel job progress [integration/quibble] - 10https://gerrit.wikimedia.org/r/693458 [15:32:08] (03PS46) 10Awight: Parallelism as a command object [integration/quibble] - 10https://gerrit.wikimedia.org/r/587885 (https://phabricator.wikimedia.org/T235449) [15:32:15] (03PS15) 10Awight: Split extension and skin npm and composer tests [integration/quibble] - 10https://gerrit.wikimedia.org/r/587888 [15:38:33] 10Release-Engineering-Team (Yak Shaving 🐃🪒), 10Scap: Automate scap prep - https://phabricator.wikimedia.org/T245184 (10dancy) >>! In T245184#7601115, @hashar wrote: > `stage-train` covers the indeed, well done @dancy This was @thcipriani's work. [15:40:36] (Queue (Jenkins jobs + Zuul functions) alert) resolved: (2) Queue (Jenkins jobs + Zuul functions) alert - https://alerts.wikimedia.org [15:43:06] (03CR) 10Ahmon Dancy: [C: 03+2] Add --abort-git-am-on-fail option to scap apply-patches (031 comment) [tools/scap] - 10https://gerrit.wikimedia.org/r/751792 (owner: 10Ahmon Dancy) [15:47:33] (03Merged) 10jenkins-bot: Add --abort-git-am-on-fail option to scap apply-patches [tools/scap] - 10https://gerrit.wikimedia.org/r/751792 (owner: 10Ahmon Dancy) [16:09:15] 10Continuous-Integration-Config, 10MediaWiki-Releasing: Have at least one job running REL1_XX with it's appropriate vendor repo - https://phabricator.wikimedia.org/T295175 (10hashar) 05Open→03Declined We are no more testing release branches with mediawiki/vendor since T189560. At some point vendor release... [16:17:38] 10Beta-Cluster-Infrastructure: Request for interface admin permission on en beta cluster - https://phabricator.wikimedia.org/T298704 (10SD0001) [16:19:10] 10Beta-Cluster-Infrastructure: Request for interface admin permission on en beta cluster - https://phabricator.wikimedia.org/T298704 (10Zabe) Is your username there also SD0001? [16:19:39] 10Beta-Cluster-Infrastructure: Request for interface admin permission on en beta cluster - https://phabricator.wikimedia.org/T298704 (10SD0001) Yes [16:19:50] 10Beta-Cluster-Infrastructure: Request for interface admin permission on en beta cluster - https://phabricator.wikimedia.org/T298704 (10Majavah) 05Open→03Resolved a:03Majavah Done! https://meta.wikimedia.beta.wmflabs.org/w/index.php?title=Special:Log&logid=154715 [16:48:42] 10Continuous-Integration-Config, 10MediaWiki-Releasing: Have at least one job running REL1_XX with it's appropriate vendor repo - https://phabricator.wikimedia.org/T295175 (10Reedy) The point is we have no job currently verifying that even MW core itself in the release branch work with the relevant vendor repo... [16:52:00] 10Continuous-Integration-Config, 10MediaWiki-Releasing: Have at least one job running REL1_XX with it's appropriate vendor repo - https://phabricator.wikimedia.org/T295175 (10Reedy) [18:05:15] 10MediaWiki-Releasing, 10AntiSpoof, 10MW-1.38-release: Bundle AntiSpoof extension with MediaWiki - https://phabricator.wikimedia.org/T191736 (10Umherirrender) The CI for postgres fails and needs a schema change, T298717. Without a fix for that task, it could violates the rule for bundling the extension. [18:32:19] 10MediaWiki-Releasing, 10AntiSpoof, 10MW-1.38-release: Bundle AntiSpoof extension with MediaWiki - https://phabricator.wikimedia.org/T191736 (10Reedy) [18:39:14] (03CR) 10Hashar: Wrapper to pretty-print parallel job progress (031 comment) [integration/quibble] - 10https://gerrit.wikimedia.org/r/693458 (owner: 10Awight) [19:13:53] (03PS1) 10Ahmon Dancy: scap clean: Add 'auto' mode [tools/scap] - 10https://gerrit.wikimedia.org/r/751981 [20:14:06] (03PS2) 10Ahmon Dancy: scap clean: Add 'auto' mode [tools/scap] - 10https://gerrit.wikimedia.org/r/751981 [20:16:36] 10Release-Engineering-Team (Next), 10Patch-For-Review, 10Release, 10Train Deployments: 1.38.0-wmf.16 deployment blockers - https://phabricator.wikimedia.org/T293957 (10mmodell) [20:24:08] (03PS3) 10Ahmon Dancy: scap clean: Add 'auto' mode [tools/scap] - 10https://gerrit.wikimedia.org/r/751981 [20:36:14] (03CR) 10Ahmon Dancy: [C: 03+1] "Ready for review." [tools/scap] - 10https://gerrit.wikimedia.org/r/751981 (owner: 10Ahmon Dancy) [20:55:15] kostajh: Im guessing you know more about this failing apitest? [20:58:11] 10Release-Engineering-Team (Next), 10Security-Team: Determine a better way to track Wikimedia production security patches - https://phabricator.wikimedia.org/T295925 (10mmodell) My input, informed by ~8 years of deploying and the most recent problems I experienced with patch application: 1. `git am` isn't alw... [21:19:09] 10Continuous-Integration-Config, 10MediaWiki-Core-Tests, 10Code-Health, 10Developer Productivity, 10Platform Team Initiatives (API Integration Tests): Run api-testing tests in parallel - https://phabricator.wikimedia.org/T298735 (10kostajh) [21:23:33] twentyafterfour: hi! I think I kind of quietly ignored the train today :\ [21:24:08] hashar: currently blocked by https://phabricator.wikimedia.org/T298659 and trying to decide the best course of action [21:24:39] twentyafterfour: yeah I am reading it [21:24:48] I am afraid it is out of my league unfortunately :/ [21:25:26] Yeah I think the revert is the only sane choice to get things moving [21:25:39] still holding out for a second opinion from someone qualified [21:30:24] twentyafterfour: Revert seems fine to me. [21:30:28] anyway that does not sound too bad [21:32:34] twentyafterfour: Land the revert in wmf.16 and make it a blocker for wmf.17 until it's fixed or the revert lands in master? [21:32:57] Yeah that sounds good to me [21:45:57] +1 [21:46:08] I am asleep, hopefully the train will continue moving forward ;) [22:03:20] (03CR) 10Thcipriani: [C: 03+2] "Thanks for the cleanup." [tools/scap] - 10https://gerrit.wikimedia.org/r/751780 (owner: 10Zabe) [22:05:49] (03Merged) 10jenkins-bot: General small code cleanups [tools/scap] - 10https://gerrit.wikimedia.org/r/751780 (owner: 10Zabe) [22:24:15] (03CR) 10Thcipriani: [C: 03+1] "Nitpick and fretting inline." [tools/scap] - 10https://gerrit.wikimedia.org/r/751981 (owner: 10Ahmon Dancy) [22:25:09] 10Release-Engineering-Team (Next), 10Security-Team: Determine a better way to track Wikimedia production security patches - https://phabricator.wikimedia.org/T295925 (10sbassett) >>! In T295925#7602855, @mmodell wrote: > 2. More automation has the downside of less oversight. This is a problem due to point #1.... [22:41:39] (03CR) 10Ahmon Dancy: [C: 03+2] scap clean: Add 'auto' mode (032 comments) [tools/scap] - 10https://gerrit.wikimedia.org/r/751981 (owner: 10Ahmon Dancy) [22:42:20] (03Merged) 10jenkins-bot: scap clean: Add 'auto' mode [tools/scap] - 10https://gerrit.wikimedia.org/r/751981 (owner: 10Ahmon Dancy) [22:52:48] (03PS1) 10Ahmon Dancy: /srv/patches -> config["patch_path"] [tools/scap] - 10https://gerrit.wikimedia.org/r/752029 [23:00:37] 10Release-Engineering-Team (Next), 10Patch-For-Review, 10Release, 10Train Deployments: 1.38.0-wmf.16 deployment blockers - https://phabricator.wikimedia.org/T293957 (10mmodell) [23:51:20] 10Release-Engineering-Team (Next), 10Patch-For-Review, 10Release, 10Train Deployments: 1.38.0-wmf.16 deployment blockers - https://phabricator.wikimedia.org/T293957 (10mmodell) 05In progress→03Resolved