[00:23:07] 10Release-Engineering-Team (Next), 10Release, 10Train Deployments: 1.38.0-wmf.19 deployment blockers - https://phabricator.wikimedia.org/T293960 (10thcipriani) p:05Triageβ†’03Medium [00:24:07] 10Release-Engineering-Team (Next), 10Release, 10Train Deployments: 1.38.0-wmf.18 deployment blockers - https://phabricator.wikimedia.org/T293959 (10thcipriani) p:05Triageβ†’03Medium a:03jeena [00:24:27] 10Release-Engineering-Team (Next), 10Release, 10Train Deployments: 1.38.0-wmf.19 deployment blockers - https://phabricator.wikimedia.org/T293960 (10thcipriani) a:05jeenaβ†’03brennen [00:25:20] 10Release-Engineering-Team (Next), 10Release, 10Train Deployments: 1.38.0-wmf.20 deployment blockers - https://phabricator.wikimedia.org/T293961 (10thcipriani) p:05Triageβ†’03Medium a:03dancy [04:44:53] PROBLEM - SSH on contint1001.mgmt is CRITICAL: CRITICAL - Socket timeout after 10 seconds https://wikitech.wikimedia.org/wiki/Dc-operations/Hardware_Troubleshooting_Runbook [04:47:50] 10GitLab (Project Migration), 10Release-Engineering-Team (Doing), 10User-brennen: Early adoption signup for WMF GitLab - https://phabricator.wikimedia.org/T282842 (10Ed6767) I'd love to move my #teyora project to WMF GitLab from GitLab https://gitlab.com/t5201/teyora [05:46:01] RECOVERY - SSH on contint1001.mgmt is OK: SSH OK - OpenSSH_6.6 (protocol 2.0) https://wikitech.wikimedia.org/wiki/Dc-operations/Hardware_Troubleshooting_Runbook [07:40:04] (03CR) 10Kevin Bazira: [C: 03+1] "LGTM!" [integration/config] - 10https://gerrit.wikimedia.org/r/752714 (https://phabricator.wikimedia.org/T297823) (owner: 10Accraze) [09:01:39] (03CR) 10Hashar: "The existing jobs had some filter to only have them running when specific files are modified:" [integration/config] - 10https://gerrit.wikimedia.org/r/752714 (https://phabricator.wikimedia.org/T297823) (owner: 10Accraze) [09:06:39] (03PS2) 10Hashar: inference: add publishing pipelines for postmerge [integration/config] - 10https://gerrit.wikimedia.org/r/752714 (https://phabricator.wikimedia.org/T297823) (owner: 10Accraze) [09:14:41] (03CR) 10Hashar: [C: 03+1] "The zuul layout diff job https://integration.wikimedia.org/ci/job/integration-config-zuul-layout-diff-docker/7639/console gives the detai" [integration/config] - 10https://gerrit.wikimedia.org/r/752714 (https://phabricator.wikimedia.org/T297823) (owner: 10Accraze) [09:15:36] (03CR) 10Hashar: [C: 03+2] jjb: drop extra double quotes in docker run -e [integration/config] - 10https://gerrit.wikimedia.org/r/752745 (owner: 10Hashar) [09:16:19] (03CR) 10Hashar: [C: 03+2] jjb: add 'environment' to Jinja2 docker macro [integration/config] - 10https://gerrit.wikimedia.org/r/752746 (owner: 10Hashar) [09:17:29] (03Merged) 10jenkins-bot: jjb: drop extra double quotes in docker run -e [integration/config] - 10https://gerrit.wikimedia.org/r/752745 (owner: 10Hashar) [09:18:09] (03Merged) 10jenkins-bot: jjb: add 'environment' to Jinja2 docker macro [integration/config] - 10https://gerrit.wikimedia.org/r/752746 (owner: 10Hashar) [09:18:13] !log Updating all Jenkins jobs following recent "noop" refactorings [09:18:14] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [09:34:29] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team: Upgrade CI Jenkins to 2.319.1 - https://phabricator.wikimedia.org/T298949 (10hashar) [09:40:05] (03CR) 10Giuseppe Lavagetto: [C: 03+2] make-container-image: add missing symlinks to the webserver image [tools/release] - 10https://gerrit.wikimedia.org/r/746870 (https://phabricator.wikimedia.org/T285232) (owner: 10Giuseppe Lavagetto) [09:41:02] (03Merged) 10jenkins-bot: make-container-image: add missing symlinks to the webserver image [tools/release] - 10https://gerrit.wikimedia.org/r/746870 (https://phabricator.wikimedia.org/T285232) (owner: 10Giuseppe Lavagetto) [09:50:33] (03PS1) 10Zoranzoki21: Add Thomas-topway-it to the CI allowlist [integration/config] - 10https://gerrit.wikimedia.org/r/752997 [09:52:23] (03CR) 10jerkins-bot: [V: 04-1] Add Thomas-topway-it to the CI allowlist [integration/config] - 10https://gerrit.wikimedia.org/r/752997 (owner: 10Zoranzoki21) [09:53:05] (03PS2) 10Zoranzoki21: Add Thomas-topway-it to the CI allowlist [integration/config] - 10https://gerrit.wikimedia.org/r/752997 [11:01:26] 10Release-Engineering-Team (Next), 10Patch-For-Review, 10Release, 10Train Deployments: 1.38.0-wmf.17 deployment blockers - https://phabricator.wikimedia.org/T293958 (10daniel) ##### Risky Patch! πŸš‚πŸ”₯ * **Change**: https://gerrit.wikimedia.org/r/c/mediawiki/core/+/740663 * **Summary**: ** Automatic refacto... [11:09:35] 10Release-Engineering-Team (Next), 10Patch-For-Review, 10Release, 10Train Deployments: 1.38.0-wmf.17 deployment blockers - https://phabricator.wikimedia.org/T293958 (10daniel) ##### Risky Patch! πŸš‚πŸ”₯ * **Change**: https://gerrit.wikimedia.org/r/c/mediawiki/core/+/743278/17 and https://gerrit.wikimedia.org... [11:13:07] 10Continuous-Integration-Config, 10MediaWiki-Core-Tests, 10Code-Health, 10Developer Productivity, and 3 others: Run api-testing tests in parallel - https://phabricator.wikimedia.org/T298735 (10kostajh) Running the core api-testing tests in parallel works (see https://gerrit.wikimedia.org/r/c/mediawiki/core... [12:06:39] 10Beta-Cluster-Infrastructure, 10MediaWiki-User-login-and-signup: Unable to log in on aa.wikipedia.beta.wmflabs.org - https://phabricator.wikimedia.org/T298965 (10AlexisJazz) [12:07:47] 10Beta-Cluster-Infrastructure, 10MediaWiki-User-login-and-signup: Unable to log in on aa.wikipedia.beta.wmflabs.org - https://phabricator.wikimedia.org/T298965 (10AlexisJazz) 05Openβ†’03Invalid https://meta.wikimedia.beta.wmflabs.org/wiki/Special:SiteMatrix should have been more clear this is a closed test w... [12:36:12] 10Gerrit: fatal: fetch-pack: invalid index-pack output on git fetch for mediawki/core - https://phabricator.wikimedia.org/T298967 (10Kizule) [12:37:53] 10Gerrit: fatal: fetch-pack: invalid index-pack output on git fetch for mediawki/core - https://phabricator.wikimedia.org/T298967 (10Kizule) My internet connection is good, support of ISP told me "as you are trying to use Wikimedia Foundation's service, report your problem to their staff, there is nothing wrong... [12:38:52] 10Gerrit: fatal: fetch-pack: invalid index-pack output on git fetch for mediawki/core - https://phabricator.wikimedia.org/T298967 (10Kizule) [12:53:17] PROBLEM - SSH on contint1001.mgmt is CRITICAL: CRITICAL - Socket timeout after 10 seconds https://wikitech.wikimedia.org/wiki/Dc-operations/Hardware_Troubleshooting_Runbook [12:54:51] 10Gerrit: fatal: fetch-pack: invalid index-pack output on git fetch for mediawki/core - https://phabricator.wikimedia.org/T298967 (10Kizule) This is similar to {T152801}. [12:58:15] 10Beta-Cluster-Infrastructure, 10Wiki-Setup: Add a wiki that doesn't use the Gregorian calendar to beta cluster - https://phabricator.wikimedia.org/T298970 (10AlexisJazz) [13:08:05] 10Gerrit: fatal: fetch-pack: invalid index-pack output on git fetch for mediawiki/core - https://phabricator.wikimedia.org/T298967 (10Aklapper) [13:15:15] 10Beta-Cluster-Infrastructure, 10Wiki-Setup: Add a wiki that doesn't use the Gregorian calendar to beta cluster - https://phabricator.wikimedia.org/T298970 (10Urbanecm) Do you plan to use that wiki for some specific tests? Is there anyone else planning to? Setting up a wiki is non-trivial work, and we shouldn'... [13:35:24] 10Gerrit: fatal: fetch-pack: invalid index-pack output on git fetch for mediawiki/core - https://phabricator.wikimedia.org/T298967 (10Kizule) `git fsck` shows nothing: ` C:\Users\zoran\Desktop\development\mediawiki-core>git fsck Checking object directories: 100% (256/256), done. Checking objects: 100% (969617/9... [13:39:32] 10Gerrit: fatal: fetch-pack: invalid index-pack output on git fetch for mediawiki/core - https://phabricator.wikimedia.org/T298967 (10Kizule) Okay, I've cloned fresh copy of mediawiki/core and there weren't errors on `git clone`. [14:34:19] scap sync-masters seems to be reaaaaaally slow today (taking a minute or two, instead of seconds) [14:54:25] RECOVERY - SSH on contint1001.mgmt is OK: SSH OK - OpenSSH_6.6 (protocol 2.0) https://wikitech.wikimedia.org/wiki/Dc-operations/Hardware_Troubleshooting_Runbook [15:06:27] 10MediaWiki-Releasing, 10Security: Release MediaWiki 1.35.5/1.36.3/1.37.1 - https://phabricator.wikimedia.org/T292226 (10sbassett) [15:06:33] 10MediaWiki-Releasing, 10Security Team AppSec, 10Security-Team, 10Security, 10user-sbassett: Write and send supplementary release announcement for extensions and skins with security patches (1.35.5/1.36.3/1.37.1) - https://phabricator.wikimedia.org/T292236 (10sbassett) 05Openβ†’03Resolved a:03sbassett [15:07:04] 10MediaWiki-Releasing, 10Security Team AppSec, 10Security-Team, 10Security, 10user-sbassett: Write and send supplementary release announcement for extensions and skins with security patches (1.35.5/1.36.3/1.37.1) - https://phabricator.wikimedia.org/T292236 (10sbassett) a:05sbassettβ†’03Mstyles [15:14:28] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team: Upgrade CI Jenkins to 2.319.1 - https://phabricator.wikimedia.org/T298949 (10hashar) I have send a commit test the plugin at https://github.com/jenkinsci/gearman-plugin/ with Jenkins 2.139 and the tests fail https://ci.jenkins.io/blue/organiz... [15:18:48] 10Project-Admins: Requests for addition to the #acl*Project-Admins group (in comments) - https://phabricator.wikimedia.org/T706 (10Lena.Milenko) Hi, I'm @Lena.Milenko new coordinator for Workboard and need permissions for creating and managing projects in #wikimedia_enterprise -> #workboard in Phabricator. I wou... [15:53:31] 10Continuous-Integration-Config, 10MediaWiki-Core-Tests, 10Code-Health, 10Developer Productivity, and 3 others: Run api-testing tests in parallel - https://phabricator.wikimedia.org/T298735 (10Jdforrester-WMF) The proper fix for this would be to fix the back-end to not instantly throw an error on deadlock... [16:26:28] (03PS5) 10Ahmon Dancy: Make scap prep re-runnable [tools/scap] - 10https://gerrit.wikimedia.org/r/752189 [16:27:06] (03CR) 10Ahmon Dancy: Make scap prep re-runnable (031 comment) [tools/scap] - 10https://gerrit.wikimedia.org/r/752189 (owner: 10Ahmon Dancy) [16:35:16] Does any one know why this weird bug is happening with nodejs CI pipeline? https://integration.wikimedia.org/ci/job/service-pipeline-test/10855/console [16:36:07] mbsantos: you're probably hit by https://www.bleepingcomputer.com/news/security/dev-corrupts-npm-libs-colors-and-faker-breaking-thousands-of-apps/ [16:37:20] oh boy [16:37:35] which is strange, because https://gerrit.wikimedia.org/r/c/mediawiki/services/mobileapps/+/752693/ doesn’t look like it touches package(-lock).json [16:42:45] (03PS6) 10Ahmon Dancy: Make scap prep re-runnable [tools/scap] - 10https://gerrit.wikimedia.org/r/752189 [16:45:57] (03PS7) 10Ahmon Dancy: Make scap prep re-runnable [tools/scap] - 10https://gerrit.wikimedia.org/r/752189 [16:46:26] it's strange because it's not happening locally as well [16:49:44] nor we are using the corrupted versions of the packages. taavi could it be some sort of CI cache? [16:49:53] (03PS1) 10Isabelle Hurbain-Palatin: Add 'parsoid' to the dependencies of 'Translate' [integration/config] - 10https://gerrit.wikimedia.org/r/753097 (https://phabricator.wikimedia.org/T295170) [16:50:13] I don't know enough about the CI stack to answer that, sorry [16:54:17] I think they might (like npm does more normally) [16:59:54] (03CR) 10Subramanya Sastry: Add 'parsoid' to the dependencies of 'Translate' (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/753097 (https://phabricator.wikimedia.org/T295170) (owner: 10Isabelle Hurbain-Palatin) [17:03:44] (03CR) 10Isabelle Hurbain-Palatin: Add 'parsoid' to the dependencies of 'Translate' (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/753097 (https://phabricator.wikimedia.org/T295170) (owner: 10Isabelle Hurbain-Palatin) [17:06:00] (03CR) 10Isabelle Hurbain-Palatin: Add 'parsoid' to the dependencies of 'Translate' (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/753097 (https://phabricator.wikimedia.org/T295170) (owner: 10Isabelle Hurbain-Palatin) [17:06:15] (03PS2) 10Isabelle Hurbain-Palatin: Add 'parsoid' to the dependencies of 'Translate' [integration/config] - 10https://gerrit.wikimedia.org/r/753097 (https://phabricator.wikimedia.org/T295170) [17:06:51] (03CR) 10Subramanya Sastry: [C: 03+1] Add 'parsoid' to the dependencies of 'Translate' [integration/config] - 10https://gerrit.wikimedia.org/r/753097 (https://phabricator.wikimedia.org/T295170) (owner: 10Isabelle Hurbain-Palatin) [17:08:11] (03CR) 10jerkins-bot: [V: 04-1] Add 'parsoid' to the dependencies of 'Translate' [integration/config] - 10https://gerrit.wikimedia.org/r/753097 (https://phabricator.wikimedia.org/T295170) (owner: 10Isabelle Hurbain-Palatin) [17:10:23] (03PS8) 10Ahmon Dancy: Make scap prep re-runnable [tools/scap] - 10https://gerrit.wikimedia.org/r/752189 [17:28:34] (03PS9) 10Ahmon Dancy: Make scap prep re-runnable [tools/scap] - 10https://gerrit.wikimedia.org/r/752189 [17:28:36] (03PS1) 10Ahmon Dancy: scap prep auto [tools/scap] - 10https://gerrit.wikimedia.org/r/753103 [17:28:53] (03CR) 10Ahmon Dancy: [C: 03+1] Make scap prep re-runnable [tools/scap] - 10https://gerrit.wikimedia.org/r/752189 (owner: 10Ahmon Dancy) [17:30:08] (03PS3) 10Isabelle Hurbain-Palatin: Add 'parsoid' to the dependencies of 'Translate' [integration/config] - 10https://gerrit.wikimedia.org/r/753097 (https://phabricator.wikimedia.org/T295170) [17:30:10] (03PS2) 10Ahmon Dancy: scap prep auto [tools/scap] - 10https://gerrit.wikimedia.org/r/753103 [17:30:41] (03CR) 10Ahmon Dancy: [C: 03+1] scap prep auto [tools/scap] - 10https://gerrit.wikimedia.org/r/753103 (owner: 10Ahmon Dancy) [17:30:55] (03CR) 10jerkins-bot: [V: 04-1] scap prep auto [tools/scap] - 10https://gerrit.wikimedia.org/r/753103 (owner: 10Ahmon Dancy) [17:44:28] 10Beta-Cluster-Infrastructure, 10Wiki-Setup: Add a wiki that doesn't use the Gregorian calendar to beta cluster - https://phabricator.wikimedia.org/T298970 (10AlexisJazz) >>! In T298970#7612666, @Urbanecm wrote: > Do you plan to use that wiki for some specific tests? Is there anyone else planning to? Setting u... [17:57:15] (03PS1) 10Ahmon Dancy: Release 4.1.1-1 [tools/scap] - 10https://gerrit.wikimedia.org/r/753109 [17:57:47] (03CR) 10Ahmon Dancy: [C: 03+2] Release 4.1.1-1 [tools/scap] - 10https://gerrit.wikimedia.org/r/753109 (owner: 10Ahmon Dancy) [17:58:27] (03Merged) 10jenkins-bot: Release 4.1.1-1 [tools/scap] - 10https://gerrit.wikimedia.org/r/753109 (owner: 10Ahmon Dancy) [17:59:21] dduvall: I'm not sure how the state of your gerrit notifications is, so I'm gently poking you with https://gerrit.wikimedia.org/r/c/blubber/+/749569 which is my first take at an implementation for T296046 [17:59:22] T296046: Allow build time control of effective UID/GID for runtime in Blubber generated Dockerfile - https://phabricator.wikimedia.org/T296046 [18:01:25] bd808: hey hey. just getting back from holiday and am on train this week, so i might be a bit on review, but thanks for contributing that [18:01:27] 10Release-Engineering-Team, 10Scap, 10serviceops: Deploy Scap version 4.1.1 - https://phabricator.wikimedia.org/T298986 (10dancy) [18:06:34] dduvall: I figured you were not without things to do. :) [18:15:20] 10Phabricator: Project-Admins can't set Source Repos on Projects - https://phabricator.wikimedia.org/T279284 (10mmodell) Form 9 is more restricted, it's for policy-admins not project-admins [18:16:02] 10Phabricator: Project-Admins can't set Source Repos on Projects - https://phabricator.wikimedia.org/T279284 (10mmodell) I enabled the repository field on form 9. [18:20:03] 10Phabricator: Project-Admins can't set Source Repos on Projects - https://phabricator.wikimedia.org/T279284 (10mmodell) 05Openβ†’03Resolved a:03mmodell [18:20:24] (03CR) 10Accraze: [C: 03+1] "Awesome thanks for the fixup Antoine, this looks great!" [integration/config] - 10https://gerrit.wikimedia.org/r/752714 (https://phabricator.wikimedia.org/T297823) (owner: 10Accraze) [18:25:13] 10Release-Engineering-Team, 10Scap, 10serviceops: Deploy Scap version 4.1.1 - https://phabricator.wikimedia.org/T298986 (10Joe) a:03Joe [18:28:48] sbassett: can you make T298019 oublic [18:28:51] Public* [19:43:51] Thanks sbassett ! [19:55:11] (03CR) 10Jeena Huneidi: [C: 03+1] Make scap prep re-runnable [tools/scap] - 10https://gerrit.wikimedia.org/r/752189 (owner: 10Ahmon Dancy) [20:10:26] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team: Upgrade CI Jenkins to 2.319.1 - https://phabricator.wikimedia.org/T298949 (10hashar) And running mvn release: `counterexample [INFO] --- spotbugs-maven-plugin:4.2.3:check (spotbugs) @ gearman-plugin --- [INFO] BugInstance size is 5... [21:04:16] 10Release-Engineering-Team (Next), 10Patch-For-Review, 10Release, 10Train Deployments: 1.38.0-wmf.17 deployment blockers - https://phabricator.wikimedia.org/T293958 (10dduvall) >>! In T293958#7612230, @daniel wrote: > ##### Risky Patch! πŸš‚πŸ”₯ > > * **Change**: https://gerrit.wikimedia.org/r/c/mediawiki/cor... [22:14:58] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team: Upgrade CI Jenkins to 2.319.1 - https://phabricator.wikimedia.org/T298949 (10hashar) I have ignored the above spotbugs issues when doing the release. The tag has been uploaded and I crafted the release notes: https://github.com/jenkinsci/gear... [22:19:39] 10Release-Engineering-Team (Next), 10Patch-For-Review, 10Release, 10Train Deployments: 1.38.0-wmf.17 deployment blockers - https://phabricator.wikimedia.org/T293958 (10matmarex) [22:19:41] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team: Upgrade CI Jenkins to 2.319.1 - https://phabricator.wikimedia.org/T298949 (10hashar) 05Openβ†’03Resolved a:03hashar [22:20:36] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team: Fix Gearman plugin for Jenkins to 2.319.1 - https://phabricator.wikimedia.org/T298949 (10hashar) [22:34:34] 10Release-Engineering-Team (Next), 10Release, 10Train Deployments: 1.38.0-wmf.18 deployment blockers - https://phabricator.wikimedia.org/T293959 (10thcipriani) [22:35:44] (03PS1) 10Ahmon Dancy: make-container-image/auto-stage: Use git am instead of patch [tools/release] - 10https://gerrit.wikimedia.org/r/753168 [22:43:39] (03PS2) 10Ahmon Dancy: make-container-image/auto-stage: Use git am instead of patch [tools/release] - 10https://gerrit.wikimedia.org/r/753168 [23:05:21] (03CR) 10Ahmon Dancy: [C: 03+2] make-container-image/auto-stage: Use git am instead of patch [tools/release] - 10https://gerrit.wikimedia.org/r/753168 (owner: 10Ahmon Dancy) [23:07:55] (03Merged) 10jenkins-bot: make-container-image/auto-stage: Use git am instead of patch [tools/release] - 10https://gerrit.wikimedia.org/r/753168 (owner: 10Ahmon Dancy) [23:16:29] (03PS1) 10Ahmon Dancy: scap/git.py: Replace get_disclosable_head with git merge-base HEAD origin [tools/scap] - 10https://gerrit.wikimedia.org/r/753177 [23:18:26] (03CR) 10jerkins-bot: [V: 04-1] scap/git.py: Replace get_disclosable_head with git merge-base HEAD origin [tools/scap] - 10https://gerrit.wikimedia.org/r/753177 (owner: 10Ahmon Dancy) [23:23:35] (03PS2) 10Ahmon Dancy: scap/git.py: Replace get_disclosable_head with git merge-base HEAD origin [tools/scap] - 10https://gerrit.wikimedia.org/r/753177 [23:24:37] (03PS3) 10Ahmon Dancy: scap/git.py: Replace get_disclosable_head with git merge-base HEAD origin [tools/scap] - 10https://gerrit.wikimedia.org/r/753177 [23:52:51] 10Release-Engineering-Team (Next), 10Patch-For-Review, 10Release, 10Train Deployments: 1.38.0-wmf.13 deployment blockers - https://phabricator.wikimedia.org/T293954 (10Krinkle)