[03:07:27] PROBLEM - SSH on contint2001.mgmt is CRITICAL: CRITICAL - Socket timeout after 10 seconds https://wikitech.wikimedia.org/wiki/Dc-operations/Hardware_Troubleshooting_Runbook [04:08:13] RECOVERY - SSH on contint2001.mgmt is OK: SSH OK - OpenSSH_6.6 (protocol 2.0) https://wikitech.wikimedia.org/wiki/Dc-operations/Hardware_Troubleshooting_Runbook [04:17:55] (03CR) 10Thcipriani: [C: 03+2] "Nice!" [tools/scap] - 10https://gerrit.wikimedia.org/r/706037 (owner: 10Ahmon Dancy) [04:20:50] (03Merged) 10jenkins-bot: Update beta cluster deployment notes [tools/scap] - 10https://gerrit.wikimedia.org/r/706037 (owner: 10Ahmon Dancy) [05:54:57] (03CR) 10DannyS712: [C: 03+1] build: Updating mediawiki/mediawiki-codesniffer to 37.0.0 [integration/docroot] - 10https://gerrit.wikimedia.org/r/706082 (owner: 10Libraryupgrader) [07:21:21] (03CR) 10Hashar: [C: 03+2] "Where are my spaces? :D" [integration/docroot] - 10https://gerrit.wikimedia.org/r/706082 (owner: 10Libraryupgrader) [08:03:17] 10Release-Engineering-Team (Next), 10MW-on-K8s, 10serviceops: Perform l10n cache rebuild using initContainers instead of including it in the image - https://phabricator.wikimedia.org/T286952 (10JMeybohm) >>! In T286952#7228919, @dduvall wrote: > It is computationally expensive only during the first deploymen... [11:35:22] (03PS3) 10Hashar: Run per-language pipelines for mediawiki/libs/metrics-platform [integration/config] - 10https://gerrit.wikimedia.org/r/697980 (owner: 10Mholloway) [11:36:19] (03CR) 10Hashar: [C: 03+2] "I have amended the patch to remove the leading '/' at the front of each file filter. I have generated the jobs and will trigger CI on eac" [integration/config] - 10https://gerrit.wikimedia.org/r/697980 (owner: 10Mholloway) [11:37:30] (03Merged) 10jenkins-bot: Run per-language pipelines for mediawiki/libs/metrics-platform [integration/config] - 10https://gerrit.wikimedia.org/r/697980 (owner: 10Mholloway) [11:42:36] (03CR) 10Hashar: "The file filter works. https://gerrit.wikimedia.org/r/c/mediawiki/libs/metrics-platform/+/705435 touches solely php files and as a result " [integration/config] - 10https://gerrit.wikimedia.org/r/697980 (owner: 10Mholloway) [11:42:40] Anyone know why Jenkins bot didn't V+2 and submit https://gerrit.wikimedia.org/r/c/operations/software/mailman-templates/+/706390 [11:42:56] It started the job but never gave a result and it doesn't look to be running [11:43:06] RhinosF1: I guess it lacks permissions [11:43:13] hashar: it shouldn't [11:43:33] https://gerrit.wikimedia.org/r/admin/repos/operations/software,access [11:43:45] It inherits from there and that shows Jenkins bot [11:44:10] let me dig in the logs [11:45:09] oh yeah [11:45:39] so the change got created by l10n-bot which does not trigger the "test" or "gate-and-submit" pipelines [11:46:12] No it has a -l10n one [11:46:21] https://phabricator.wikimedia.org/T282022 is the task fwiw [11:46:33] yes which triggers debian-glue [11:46:46] but that job only runs when a change touches files under ./debian directory [11:46:51] so it is never triggerd [11:47:35] there is https://phabricator.wikimedia.org/T282018#7069803 [11:47:41] I will reply there [11:47:58] https://phabricator.wikimedia.org/T282022 is for l10n [11:48:01] Task [11:52:03] oh [11:53:07] You're a star! [11:53:34] so I thinkn it is all about replacing debian-glue by mediawiki-i18n-check-docker ;) [11:57:33] (03CR) 10Hashar: [C: 03+2] Run parsoid integration tests with the Translate extension installed [integration/config] - 10https://gerrit.wikimedia.org/r/705933 (owner: 10C. Scott Ananian) [11:58:41] (03Merged) 10jenkins-bot: Run parsoid integration tests with the Translate extension installed [integration/config] - 10https://gerrit.wikimedia.org/r/705933 (owner: 10C. Scott Ananian) [12:06:05] 10Phabricator, 10Release-Engineering-Team, 10Security-Team: Grant access to OIT-LDAP Diffusion repo to contractor Danielattevelt - https://phabricator.wikimedia.org/T287124 (10Aklapper) [12:38:42] (03PS2) 10Hashar: Zuul: [operations/docker-images/imagecatalog] add tox-docker [integration/config] - 10https://gerrit.wikimedia.org/r/706048 (https://phabricator.wikimedia.org/T287130) (owner: 10RLazarus) [12:38:50] (03CR) 10Hashar: [C: 03+2] Zuul: [operations/docker-images/imagecatalog] add tox-docker [integration/config] - 10https://gerrit.wikimedia.org/r/706048 (https://phabricator.wikimedia.org/T287130) (owner: 10RLazarus) [12:40:01] (03Merged) 10jenkins-bot: Zuul: [operations/docker-images/imagecatalog] add tox-docker [integration/config] - 10https://gerrit.wikimedia.org/r/706048 (https://phabricator.wikimedia.org/T287130) (owner: 10RLazarus) [12:44:33] (03CR) 10Hashar: Run extension-gate jobs experimentally for Parsoid (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/705966 (https://phabricator.wikimedia.org/T287001) (owner: 10C. Scott Ananian) [12:46:38] (03PS4) 10Hashar: Run extension-gate jobs experimentally for Parsoid [integration/config] - 10https://gerrit.wikimedia.org/r/705966 (https://phabricator.wikimedia.org/T287001) (owner: 10C. Scott Ananian) [12:47:00] (03CR) 10Hashar: [C: 03+2] Run extension-gate jobs experimentally for Parsoid [integration/config] - 10https://gerrit.wikimedia.org/r/705966 (https://phabricator.wikimedia.org/T287001) (owner: 10C. Scott Ananian) [12:47:56] (03Merged) 10jenkins-bot: Run extension-gate jobs experimentally for Parsoid [integration/config] - 10https://gerrit.wikimedia.org/r/705966 (https://phabricator.wikimedia.org/T287001) (owner: 10C. Scott Ananian) [12:51:34] (03CR) 10Hashar: "Triggered on the dummy change https://gerrit.wikimedia.org/r/c/mediawiki/services/parsoid/+/655718" [integration/config] - 10https://gerrit.wikimedia.org/r/705966 (https://phabricator.wikimedia.org/T287001) (owner: 10C. Scott Ananian) [12:56:27] (03PS1) 10Hashar: zuul: [mailman-templates] use i18n checker [integration/config] - 10https://gerrit.wikimedia.org/r/706443 (https://phabricator.wikimedia.org/T282022) [12:56:36] RhinosF1: ^^ :) [12:56:47] (03CR) 10Hashar: [C: 03+2] zuul: [mailman-templates] use i18n checker [integration/config] - 10https://gerrit.wikimedia.org/r/706443 (https://phabricator.wikimedia.org/T282022) (owner: 10Hashar) [12:57:52] (03Merged) 10jenkins-bot: zuul: [mailman-templates] use i18n checker [integration/config] - 10https://gerrit.wikimedia.org/r/706443 (https://phabricator.wikimedia.org/T282022) (owner: 10Hashar) [13:02:21] hashar: :) [13:02:40] RhinosF1: and it fails due to one translation [13:02:59] Translate wiki team will know that [13:03:08] They deal with that often [13:09:40] 10Release-Engineering-Team (Doing), 10Patch-For-Review, 10Release, 10Train Deployments: 1.37.0-wmf.15 deployment blockers - https://phabricator.wikimedia.org/T281156 (10hashar) Pushed to all wikis. [13:12:10] (03CR) 10Mholloway: "Awesome! Thanks again!" [integration/config] - 10https://gerrit.wikimedia.org/r/697980 (owner: 10Mholloway) [14:38:36] (03CR) 10RLazarus: "Thanks Hashar!" [integration/config] - 10https://gerrit.wikimedia.org/r/706048 (https://phabricator.wikimedia.org/T287130) (owner: 10RLazarus) [16:00:33] 10Release-Engineering-Team (Next), 10MW-on-K8s, 10serviceops: Perform l10n cache rebuild using initContainers instead of including it in the image - https://phabricator.wikimedia.org/T286952 (10dduvall) >>! In T286952#7229317, @JMeybohm wrote: > As we're already actively working on the network I/O side of th... [16:10:04] Reedy: I guess that extension is probably a never [16:10:23] I'd guess so, yeah [16:11:58] People should probably ask before discussing extensions [16:12:01] Rather than after [16:12:11] To get a that sounds possible first [16:17:53] I mean it's a simple extension.. But potentially a perf nightmare [16:18:23] As every page using it becomes uncacheable, even for anons [16:35:56] Which would be super dangerous [16:39:58] is there already a ticket for Gitiles being all bolded now? https://gerrit.wikimedia.org/r/plugins/gitiles/operations/mediawiki-config/+/refs/heads/master/w/static.php [16:40:06] I feel like this regressed in the past too [16:40:32] https://phabricator.wikimedia.org/T256571 [16:41:49] somehow we're no longer running https://gerrit-review.googlesource.com/c/gitiles/+/273661 ? [16:43:08] 10Gerrit, 10Regression: Gitiles monospaced text is bolded again - https://phabricator.wikimedia.org/T287189 (10Legoktm) [16:54:21] legoktm: didn't plugins get messed up the other day [16:54:38] I don't know [16:55:20] Pretty sure hashar did some version changes and other stuff got reverted [16:57:44] https://phabricator.wikimedia.org/T287099#7228114 [16:58:06] (03PS1) 10Hashar: doc: add footer link to wikitech documentation [integration/docroot] - 10https://gerrit.wikimedia.org/r/706582 [17:01:06] (03CR) 10Hashar: "Can be checked locally by running the web service with: composer start:doc" [integration/docroot] - 10https://gerrit.wikimedia.org/r/706582 (owner: 10Hashar) [17:08:33] RhinosF1: yes I upgraded the its-phabricator and dropped the rest of gerrit bundled plugins in the process :\ [17:08:55] we talked about it yesterday and amended the upgrade doc [17:10:31] anyway the idea is to have scap to run those commands instead of us [17:18:20] 10Gerrit, 10Regression: Gitiles monospaced text is bolded again - https://phabricator.wikimedia.org/T287189 (10hashar) [17:22:58] hashar: could it be what caused Lego's issue [17:23:29] Automation is good :) [17:28:07] 10Gerrit, 10Regression: Gitiles monospaced text is bolded again - https://phabricator.wikimedia.org/T287189 (10hashar) The gitiles dependency is listed in Gerrit: ` name=WORKSPACE WORKSPACE:GITILES_VERS = "0.4" WORKSPACE: artifact = "com.google.gitiles:blame-cache:" + GITILES_VERS, WORKSPACE: artifact =... [17:31:51] (03PS25) 10Ahmon Dancy: Incremental mediawiki container image build process [tools/release] - 10https://gerrit.wikimedia.org/r/705003 (https://phabricator.wikimedia.org/T286505) [17:32:52] 10Release-Engineering-Team (Seen), 10Page-Previews, 10Readers-Web-Backlog (Tracking), 10patch-welcome: Popups should not use github.com for documentation generation - https://phabricator.wikimedia.org/T243263 (10Jdlrobson) p:05Triage→03Lowest [17:37:51] (03PS26) 10Ahmon Dancy: Incremental mediawiki container image build process [tools/release] - 10https://gerrit.wikimedia.org/r/705003 (https://phabricator.wikimedia.org/T286505) [17:43:22] 10Release-Engineering-Team (Doing), 10Patch-For-Review, 10Release, 10Train Deployments: 1.37.0-wmf.15 deployment blockers - https://phabricator.wikimedia.org/T281156 (10hashar) 05Open→03Resolved As far as I can tell, it is a success. [17:47:18] 10Phabricator, 10Project-Admins: Unarchive WMUA-tech project and create a custom security policy for its members - https://phabricator.wikimedia.org/T286866 (10Base) @Aklapper , it looks spaces are not the best option. At the moment I am a member of only S1 and I cannot select other spaces when creating a task... [17:48:00] 10Phabricator, 10Project-Admins: Unarchive WMUA-tech project and create a custom security policy for its members - https://phabricator.wikimedia.org/T286866 (10Base) Also thank you for unarchiving the project! [18:28:42] (03PS27) 10Ahmon Dancy: Incremental mediawiki container image build process [tools/release] - 10https://gerrit.wikimedia.org/r/705003 (https://phabricator.wikimedia.org/T286505) [18:53:53] 10Project-Admins: There should be wikibooks, wikiquote and wikivoyage community projects - https://phabricator.wikimedia.org/T93486 (10Aklapper) 05Open→03Declined Declining for the time being per my previous comments. [19:10:25] (03CR) 10Dduvall: "This is amazing work and removes a number of blockers related to large image size. I have just a couple of comments, mainly about the stra" (032 comments) [tools/release] - 10https://gerrit.wikimedia.org/r/705003 (https://phabricator.wikimedia.org/T286505) (owner: 10Ahmon Dancy) [19:11:47] 10Release-Engineering-Team (Next), 10MW-on-K8s, 10serviceops: Perform l10n cache rebuild using initContainers instead of including it in the image - https://phabricator.wikimedia.org/T286952 (10dduvall) 05Open→03Declined Closing this out with relevant updates from the discussion during our RelEng/SRE IC... [20:43:41] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team, 10GitLab, 10Release Pipeline, 10User-brennen: Figure out the future of (or replacements for) PipelineLib in a GitLab world - https://phabricator.wikimedia.org/T287211 (10brennen) [20:46:12] 10Release-Engineering-Team, 10GitLab (Initialization): Establish a routine GitLab deployment / update window - https://phabricator.wikimedia.org/T287117 (10brennen) [20:51:00] (03PS1) 10Ahmon Dancy: www container: Bump nginx-full from 1.13.9-1+wmf2 to 1.13.9-1+wmf3 [tools/train-dev] - 10https://gerrit.wikimedia.org/r/706754 [20:54:16] (03CR) 10Jeena Huneidi: [C: 03+2] www container: Bump nginx-full from 1.13.9-1+wmf2 to 1.13.9-1+wmf3 [tools/train-dev] - 10https://gerrit.wikimedia.org/r/706754 (owner: 10Ahmon Dancy) [20:54:53] (03CR) 10Ahmon Dancy: [V: 03+2] www container: Bump nginx-full from 1.13.9-1+wmf2 to 1.13.9-1+wmf3 [tools/train-dev] - 10https://gerrit.wikimedia.org/r/706754 (owner: 10Ahmon Dancy) [21:02:15] (03PS28) 10Ahmon Dancy: Incremental mediawiki container image build process [tools/release] - 10https://gerrit.wikimedia.org/r/705003 (https://phabricator.wikimedia.org/T286505) [21:03:08] (03CR) 10jerkins-bot: [V: 04-1] Incremental mediawiki container image build process [tools/release] - 10https://gerrit.wikimedia.org/r/705003 (https://phabricator.wikimedia.org/T286505) (owner: 10Ahmon Dancy) [21:03:42] (03PS29) 10Ahmon Dancy: Incremental mediawiki container image build process [tools/release] - 10https://gerrit.wikimedia.org/r/705003 (https://phabricator.wikimedia.org/T286505) [21:07:13] (03CR) 10Ahmon Dancy: Incremental mediawiki container image build process (031 comment) [tools/release] - 10https://gerrit.wikimedia.org/r/705003 (https://phabricator.wikimedia.org/T286505) (owner: 10Ahmon Dancy) [21:33:28] 10Project-Admins, 10Contributors-UX-Research: Is #Contributors-UX-Research still in use? - https://phabricator.wikimedia.org/T279953 (10dchen) @Aklapper hi there. this hasn't been in use indeed since about 2018. i don't know about all the open tasks but all the ones that originated with me or individuals from... [21:35:14] (03CR) 10Dduvall: Incremental mediawiki container image build process (031 comment) [tools/release] - 10https://gerrit.wikimedia.org/r/705003 (https://phabricator.wikimedia.org/T286505) (owner: 10Ahmon Dancy) [22:46:41] (03PS30) 10Ahmon Dancy: Incremental mediawiki container image build process [tools/release] - 10https://gerrit.wikimedia.org/r/705003 (https://phabricator.wikimedia.org/T286505) [22:48:01] (03CR) 10jerkins-bot: [V: 04-1] Incremental mediawiki container image build process [tools/release] - 10https://gerrit.wikimedia.org/r/705003 (https://phabricator.wikimedia.org/T286505) (owner: 10Ahmon Dancy) [22:53:56] (03PS31) 10Ahmon Dancy: Incremental mediawiki container image build process [tools/release] - 10https://gerrit.wikimedia.org/r/705003 (https://phabricator.wikimedia.org/T286505) [22:59:47] (03PS32) 10Ahmon Dancy: Incremental mediawiki container image build process [tools/release] - 10https://gerrit.wikimedia.org/r/705003 (https://phabricator.wikimedia.org/T286505) [23:33:01] (03PS1) 10TrainBranchBot: Update state/train-versions.json [tools/release] - 10https://gerrit.wikimedia.org/r/706828 [23:33:03] (03CR) 10TrainBranchBot: [C: 03+2] Update state/train-versions.json [tools/release] - 10https://gerrit.wikimedia.org/r/706828 (owner: 10TrainBranchBot) [23:33:58] (03Merged) 10jenkins-bot: Update state/train-versions.json [tools/release] - 10https://gerrit.wikimedia.org/r/706828 (owner: 10TrainBranchBot)