[00:25:53] 10Continuous-Integration-Infrastructure, 10CirrusSearch, 10Discovery-Search: CirrusSearch cucumber runner system is not compatible with node 12 -> master is unmeregable - https://phabricator.wikimedia.org/T284519 (10Jdforrester-WMF) [00:30:00] 10Continuous-Integration-Infrastructure, 10CirrusSearch, 10Discovery-Search: CirrusSearch cucumber runner system is not compatible with node 12 -> master is unmerge-able - https://phabricator.wikimedia.org/T284519 (10Jdforrester-WMF) [02:45:23] RECOVERY - SSH on contint2001.mgmt is OK: SSH OK - OpenSSH_6.6 (protocol 2.0) https://wikitech.wikimedia.org/wiki/Dc-operations/Hardware_Troubleshooting_Runbook [04:40:37] (03CR) 10Hashar: "> Patch Set 1: Code-Review+2" [integration/config] - 10https://gerrit.wikimedia.org/r/698627 (https://phabricator.wikimedia.org/T284492) (owner: 10Jforrester) [04:41:46] 10Continuous-Integration-Infrastructure: CI failures in "git-status" task related to submodules - https://phabricator.wikimedia.org/T284492 (10hashar) 05Resolved→03Open That is also breaking the `wikimedia-portals-build` job which needs to have the submodule updated from the remote. [04:43:09] (03CR) 10Hashar: [C: 03+2] "\o/" [integration/config] - 10https://gerrit.wikimedia.org/r/698610 (owner: 10Jforrester) [04:43:31] (03CR) 10Hashar: [C: 03+2] dockerfiles: Drop node10-kartotherian, no longer used [integration/config] - 10https://gerrit.wikimedia.org/r/698612 (owner: 10Jforrester) [04:43:42] (03CR) 10Hashar: [C: 03+2] jjb: Drop kartotherian-node10-browser-docker, now unused [integration/config] - 10https://gerrit.wikimedia.org/r/698611 (owner: 10Jforrester) [04:44:28] (03Merged) 10jenkins-bot: Zuul: [mediawiki/services/kartotherian] Drop non-pipeline job [integration/config] - 10https://gerrit.wikimedia.org/r/698610 (owner: 10Jforrester) [04:44:58] (03Merged) 10jenkins-bot: jjb: Drop kartotherian-node10-browser-docker, now unused [integration/config] - 10https://gerrit.wikimedia.org/r/698611 (owner: 10Jforrester) [04:45:08] (03Merged) 10jenkins-bot: dockerfiles: Drop node10-kartotherian, no longer used [integration/config] - 10https://gerrit.wikimedia.org/r/698612 (owner: 10Jforrester) [05:15:30] 10Phabricator, 10Release-Engineering-Team (Seen), 10User-Matthewrbowker: Phacility (Maintainer of Phabricator) is winding down. Upstream support ending. - https://phabricator.wikimedia.org/T283980 (10hashar) 05Open→03Resolved a:03hashar Thank you for all the tokens and friendly messages. The suggestio... [05:15:50] 10Phabricator, 10Release-Engineering-Team (Seen), 10User-Matthewrbowker: Phacility (Maintainer of Phabricator) is winding down. Upstream support ending. - https://phabricator.wikimedia.org/T283980 (10hashar) a:05hashar→03mmodell [05:52:10] 10Continuous-Integration-Infrastructure, 10Browser-Tests, 10Developer Productivity: Remove voting Selenium jobs from the wmf branches - https://phabricator.wikimedia.org/T284526 (10Tgr) [05:53:21] 10Continuous-Integration-Infrastructure, 10MediaWiki-Core-Tests, 10Browser-Tests, 10Developer Productivity, 10Patch-For-Review: Consider moving browser based tests (Selenium and QUnit) to a non-voting pipeline - https://phabricator.wikimedia.org/T225248 (10Tgr) Related: {T284526} [07:06:16] (03Abandoned) 10Jdrewniak: Edit Repo Config [wikimedia/portals] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/673120 (owner: 10Avula Shanmukhi) [07:18:05] (03PS2) 10Martaannaj: Zuul: Add EventLogging to phan dependencies of PropertySuggester [integration/config] - 10https://gerrit.wikimedia.org/r/698584 [08:23:14] PROBLEM - Work requests waiting in Zuul Gearman server on contint2001 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [150.0] https://www.mediawiki.org/wiki/Continuous_integration/Zuul https://grafana.wikimedia.org/dashboard/db/zuul-gearman?panelId=10&fullscreen&orgId=1 [08:39:28] RECOVERY - Work requests waiting in Zuul Gearman server on contint2001 is OK: OK: Less than 100.00% above the threshold [90.0] https://www.mediawiki.org/wiki/Continuous_integration/Zuul https://grafana.wikimedia.org/dashboard/db/zuul-gearman?panelId=10&fullscreen&orgId=1 [08:44:56] dancy: hi! looks like you've created deployment-deleteme.deployment-prep.eqiad1.wikimedia.cloud, it's failing puppet as its puppet as its puppet certificates were not signed, is it needed or can it be deleted (as the name suggests)? [09:03:07] hashar: kostajh: Oops, I spaced the beginning of our meeting. Still happening? [09:03:22] yeah I can join [09:17:49] 10Continuous-Integration-Config, 10Release-Engineering-Team (Doing), 10MW-1.37-notes (1.37.0-wmf.9; 2021-06-07), 10Patch-For-Review, 10User-zeljkofilipin: Upgrade all CI jobs for WMF-deployed projects from Node 10 to Node 12 - https://phabricator.wikimedia.org/T284345 (10zeljkofilipin) [09:19:53] 10Continuous-Integration-Config, 10Release-Engineering-Team (Doing), 10MW-1.37-notes (1.37.0-wmf.9; 2021-06-07), 10Patch-For-Review, 10User-zeljkofilipin: Upgrade all CI jobs for WMF-deployed projects from Node 10 to Node 12 - https://phabricator.wikimedia.org/T284345 (10zeljkofilipin) >>! In T284345#713... [09:31:03] 10Continuous-Integration-Config, 10Release-Engineering-Team (Doing), 10MW-1.37-notes (1.37.0-wmf.9; 2021-06-07), 10Patch-For-Review, 10User-zeljkofilipin: Upgrade all CI jobs for WMF-deployed projects from Node 10 to Node 12 - https://phabricator.wikimedia.org/T284345 (10Mvolz) >>! In T284345#7137909, @W... [09:31:12] thcipriani: I've added a few more notes to the etherpad from yesterday, lemme know eventually how I can help for next steps. [09:53:21] 10Beta-Cluster-Infrastructure, 10Beta-Cluster-reproducible, 10User-Majavah, 10User-Ryasmeen, 10User-zeljkofilipin: Cannot login to beta cluster: "There seems to be a problem with your login session..." - https://phabricator.wikimedia.org/T263617 (10zeljkofilipin) [09:56:09] 10Beta-Cluster-Infrastructure, 10Beta-Cluster-reproducible, 10User-Majavah, 10User-Ryasmeen, 10User-zeljkofilipin: Cannot login to beta cluster: "There seems to be a problem with your login session..." - https://phabricator.wikimedia.org/T263617 (10zeljkofilipin) [10:08:17] 10Beta-Cluster-Infrastructure, 10Beta-Cluster-reproducible, 10User-Majavah, 10User-Ryasmeen, 10User-zeljkofilipin: Cannot login to beta cluster: "There seems to be a problem with your login session..." - https://phabricator.wikimedia.org/T263617 (10Majavah) @Urbanecm based on https://gerrit.wikimedia.org... [10:09:55] 10Continuous-Integration-Config, 10Browser-Tests: Don't run quibble-vendor-mysql-php72-selenium-docker in gate-and-submit - https://phabricator.wikimedia.org/T284434 (10kostajh) Thanks. It feels like the first job ("with this patch, do this extension's selenium test (and its dependencies) still pass?") is redu... [10:20:20] Project beta-scap-sync-world build #7964: 04FAILURE in 2.2 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/7964/ [10:20:41] Project beta-scap-sync-world build #7965: 04STILL FAILING in 1.5 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/7965/ [10:24:29] Project beta-scap-sync-world build #7966: 04STILL FAILING in 1.6 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/7966/ [10:26:49] (03CR) 10Thiemo Kreuz (WMDE): [C: 04-1] "I used $$foo as a random example to illustrate what I don't want us to do, but what patchset 3 now does: we start re-implementing parts of" [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/693531 (https://phabricator.wikimedia.org/T283446) (owner: 10DannyS712) [10:34:30] Project beta-scap-sync-world build #7967: 04STILL FAILING in 1.5 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/7967/ [10:44:32] Project beta-scap-sync-world build #7968: 04STILL FAILING in 1.6 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/7968/ [10:54:28] Project beta-scap-sync-world build #7969: 04STILL FAILING in 1.5 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/7969/ [11:00:16] Project beta-scap-sync-world build #7970: 04STILL FAILING in 1 min 20 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/7970/ [11:03:01] Project beta-scap-sync-world build #7971: 04STILL FAILING in 1 min 19 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/7971/ [11:05:47] Project beta-scap-sync-world build #7972: 04STILL FAILING in 1 min 13 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/7972/ [11:09:31] Project beta-scap-sync-world build #7973: 04STILL FAILING in 1 min 13 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/7973/ [11:15:32] Yippee, build fixed! [11:15:33] Project beta-scap-sync-world build #7974: 09FIXED in 3 min 18 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/7974/ [11:51:48] PROBLEM - SSH on contint2001.mgmt is CRITICAL: CRITICAL - Socket timeout after 10 seconds https://wikitech.wikimedia.org/wiki/Dc-operations/Hardware_Troubleshooting_Runbook [12:08:53] 10Beta-Cluster-Infrastructure, 10Beta-Cluster-reproducible, 10User-Majavah, 10User-Ryasmeen, 10User-zeljkofilipin: Cannot login to beta cluster: "There seems to be a problem with your login session..." - https://phabricator.wikimedia.org/T263617 (10dom_walden) >>! In T263617#7140598, @Urbanecm wrote: > @... [12:11:56] (03PS1) 10Lars Wirzenius: fix: write bytes to lock file [tools/scap] - 10https://gerrit.wikimedia.org/r/698773 [12:12:14] 10Beta-Cluster-Infrastructure, 10Continuous-Integration-Config, 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Seen), 10Test-Coverage: Have a CI test that fails if a Beta Cluster / production extension has an unsatisfiable dependency that bl... - https://phabricator.wikimedia.org/T231601 [12:13:00] 10Beta-Cluster-Infrastructure, 10Continuous-Integration-Config, 10Release-Engineering-Team (Seen), 10Test-Coverage: Have a CI test that fails if a Beta Cluster / production extension has an unsatisfiable dependency that blocks merge - https://phabricator.wikimedia.org/T231601 (10hashar) [12:14:59] (03CR) 10Lars Wirzenius: "Found problem when trying to test Scap for release on beta cluster." [tools/scap] - 10https://gerrit.wikimedia.org/r/698773 (owner: 10Lars Wirzenius) [12:16:13] (03PS1) 10Nikki Nikkhoui: rehearse stage for image-suggestion-api [integration/config] - 10https://gerrit.wikimedia.org/r/698774 (https://phabricator.wikimedia.org/T281132) [12:17:35] 10Release-Engineering-Team (Seen), 10phan, 10Security-Team, 10Documentation, 10Wikimedia-extension-review-queue: Document that Phan is required for WMF deployed and MW bundled extensions - https://phabricator.wikimedia.org/T250038 (10hashar) To the best of my knowledge the canonical documentation would b... [12:19:45] 10Release-Engineering-Team, 10Documentation: Document automatic MW branching time in Deployment Calendar - https://phabricator.wikimedia.org/T284487 (10hashar) [12:22:37] 10Release-Engineering-Team, 10Documentation: Document automatic MW branching time in Deployment Calendar - https://phabricator.wikimedia.org/T284487 (10hashar) [12:27:36] 10Release-Engineering-Team (Doing): Document automatic MW branching time in Deployment Calendar - https://phabricator.wikimedia.org/T284487 (10hashar) a:03thcipriani Boldly assigning to @thcipriani as the process leader, or at least as the relevant bot conductor of calendarbot and updater of the Deployment pag... [12:27:46] 10Release-Engineering-Team (Doing): Document automatic MW branching time in Deployment Calendar - https://phabricator.wikimedia.org/T284487 (10hashar) p:05Triage→03Medium [12:31:38] 10VPS-project-Codesearch, 10Traffic, 10netops, 10serviceops: Consider using BindsTo instead of Requires to declare dependencies between systemd unit - https://phabricator.wikimedia.org/T284555 (10ema) [12:31:58] 10VPS-project-Codesearch, 10Traffic, 10netops, 10serviceops: Consider using BindsTo instead of Requires to declare dependencies between systemd unit - https://phabricator.wikimedia.org/T284555 (10ema) p:05Triage→03Low [12:37:17] 10Release-Engineering-Team (Seen), 10Code-Health-DevEd-Curriculum: The Train - the workshop - https://phabricator.wikimedia.org/T249152 (10hashar) a:03thcipriani Triaging the task from our workboard, feel free to adjust as needed. See also {T249151} --- On topic: a while back I ran some backport sessions o... [12:37:32] 10Release-Engineering-Team (Seen), 10Code-Health-DevEd-Curriculum: The Train - an overview - https://phabricator.wikimedia.org/T249151 (10hashar) a:03thcipriani Triaging the task from our workboard, feel free to adjust as needed. See also {T249152} [12:38:48] 10Continuous-Integration-Config, 10Continuous-Integration-Infrastructure, 10Jenkins, 10Release-Engineering-Team (Seen): integration-config-zuul-layout-validate-docker takes too long in Jenkins due to huge output - https://phabricator.wikimedia.org/T232287 (10hashar) [12:40:51] (03PS1) 10Hashar: (DO NOT SUBMIT) test perf of zuul diff job [integration/config] - 10https://gerrit.wikimedia.org/r/698782 (https://phabricator.wikimedia.org/T232287) [12:42:36] (03CR) 10jerkins-bot: [V: 04-1] (DO NOT SUBMIT) test perf of zuul diff job [integration/config] - 10https://gerrit.wikimedia.org/r/698782 (https://phabricator.wikimedia.org/T232287) (owner: 10Hashar) [13:18:01] (03PS1) 10Hashar: tests: mute zuul output when testing layout [integration/config] - 10https://gerrit.wikimedia.org/r/698787 (https://phabricator.wikimedia.org/T232287) [13:18:55] 10Continuous-Integration-Config, 10Continuous-Integration-Infrastructure, 10Jenkins, 10Release-Engineering-Team (Seen), 10Patch-For-Review: integration-config-zuul-layout-validate-docker takes too long in Jenkins due to huge output - https://phabricator.wikimedia.org/T232287 (10hashar) a:03hashar So th... [13:19:10] (03CR) 10jerkins-bot: [V: 04-1] tests: mute zuul output when testing layout [integration/config] - 10https://gerrit.wikimedia.org/r/698787 (https://phabricator.wikimedia.org/T232287) (owner: 10Hashar) [13:20:53] (03CR) 10Hashar: "It is based on https://gerrit.wikimedia.org/r/c/integration/config/+/698787 which introduces a fault. The console output at https://integ" [integration/config] - 10https://gerrit.wikimedia.org/r/698787 (https://phabricator.wikimedia.org/T232287) (owner: 10Hashar) [13:21:01] (03PS2) 10Hashar: tests: mute zuul output when testing layout [integration/config] - 10https://gerrit.wikimedia.org/r/698787 (https://phabricator.wikimedia.org/T232287) [13:21:14] (03Abandoned) 10Hashar: (DO NOT SUBMIT) test perf of zuul diff job [integration/config] - 10https://gerrit.wikimedia.org/r/698782 (https://phabricator.wikimedia.org/T232287) (owner: 10Hashar) [13:21:49] 10Continuous-Integration-Config, 10Continuous-Integration-Infrastructure, 10Jenkins, 10Release-Engineering-Team (Doing), 10Patch-For-Review: integration-config-zuul-layout-validate-docker takes too long in Jenkins due to huge output - https://phabricator.wikimedia.org/T232287 (10hashar) [13:22:21] 10Continuous-Integration-Config, 10Continuous-Integration-Infrastructure, 10Jenkins, 10Release-Engineering-Team (Doing), and 2 others: integration-config-zuul-layout-validate-docker takes too long in Jenkins due to huge output - https://phabricator.wikimedia.org/T232287 (10hashar) [13:36:42] 10VPS-project-Codesearch, 10SRE, 10Traffic, 10netops, 10serviceops: Consider using BindsTo instead of Requires to declare dependencies between systemd unit - https://phabricator.wikimedia.org/T284555 (10BBlack) When we looked into this for the Bird-based anycast stuff, we found that the combination you w... [13:40:07] 10VPS-project-Codesearch, 10SRE, 10Traffic, 10serviceops: Consider using BindsTo instead of Requires to declare dependencies between systemd unit - https://phabricator.wikimedia.org/T284555 (10ayounsi) [13:45:34] 10LibUp: Automatically clean up the parallel-lint command in composer.json files - https://phabricator.wikimedia.org/T266305 (10cscott) core doesn't have the `.` in the command... see https://gerrit.wikimedia.org/r/c/mediawiki/core/+/441412 and {T199403}, etc... [13:52:02] <_joe_> hi, I need some guidance in modifying the pipeline config for mediawiki [13:52:18] <_joe_> basically I want to run 2 commands as root when we build the final image [13:53:06] RECOVERY - SSH on contint2001.mgmt is OK: SSH OK - OpenSSH_6.6 (protocol 2.0) https://wikitech.wikimedia.org/wiki/Dc-operations/Hardware_Troubleshooting_Runbook [13:56:25] (03PS1) 10Lars Wirzenius: add a new definition of SCAP [tools/scap] - 10https://gerrit.wikimedia.org/r/698791 [13:56:51] _joe_: no idea, guess you will want dancy and/or jeena . They should appear in an hour or so from now [13:57:16] <_joe_> yeah I wasn't expecting a very fast response :) [14:30:08] 10Release-Engineering-Team (Doing), 10Release, 10Train Deployments: 1.37.0-wmf.9 deployment blockers - https://phabricator.wikimedia.org/T281150 (10matmarex) [14:46:18] (03PS4) 10Thiemo Kreuz (WMDE): FunctionCommentSniff: also skip {@inheritDoc} [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/698526 (https://phabricator.wikimedia.org/T270830) (owner: 10DannyS712) [14:49:43] (03PS5) 10Thiemo Kreuz (WMDE): FunctionCommentSniff: also skip {@inheritDoc} [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/698526 (https://phabricator.wikimedia.org/T270830) (owner: 10DannyS712) [14:51:06] (03CR) 10Thiemo Kreuz (WMDE): [C: 03+1] FunctionCommentSniff: also skip {@inheritDoc} (031 comment) [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/698526 (https://phabricator.wikimedia.org/T270830) (owner: 10DannyS712) [15:02:51] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Seen): Reorganize CI phabricator projects - https://phabricator.wikimedia.org/T223134 (10hashar) 05Open→03Declined I guess if one day we got a good idea to reorganize the projects, it will just happen. [15:09:21] 10Release-Engineering-Team (Deployment Training Requests): Deployment training request for egardner - https://phabricator.wikimedia.org/T283630 (10thcipriani) 05Open→03Resolved And! @egardner was able to deploy in this session. Kudos! Please feel free to drop by any future session. Ping me in the usual chann... [15:11:08] Hi _joe_. Shall we chat on #wikimedia-mw-on-k8s where it's not overrun by bots? [15:12:38] <_joe_> sure [15:16:26] 10Beta-Cluster-Infrastructure, 10Editing-team, 10Release Pipeline, 10serviceops, and 2 others: Migrate Beta cluster services to use Kubernetes - https://phabricator.wikimedia.org/T220235 (10hashar) [15:16:41] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team (Seen), 10Release Pipeline: Experiment with hosted kubernetes solutions for Beta - https://phabricator.wikimedia.org/T222820 (10hashar) 05Stalled→03Declined That was as part of supporting containerized MediaWiki services on beta ({T220235}). Inste... [15:19:50] 10Deployments, 10Release-Engineering-Team (Seen): Remove "php-" from wiki version numbers - https://phabricator.wikimedia.org/T63733 (10hashar) 05Stalled→03Declined After all those years, I guess we will just stick to carry the `php-` prefix. It is not a problem but attempt to drop it might prove to be pro... [15:20:43] 10Release-Engineering-Team, 10serviceops: Offer Loadtesting as a Service - https://phabricator.wikimedia.org/T230530 (10hashar) [15:21:00] 10Release-Engineering-Team (Seen), 10SRE, 10Epic, 10Performance Issue: [EPIC] Performance testing environment - https://phabricator.wikimedia.org/T67394 (10hashar) [15:21:18] 10Release-Engineering-Team (Seen), 10SRE, 10Epic, 10Performance Issue: [EPIC] Performance testing environment - https://phabricator.wikimedia.org/T67394 (10hashar) [15:21:42] 10Release-Engineering-Team, 10serviceops: Offer Loadtesting as a Service - https://phabricator.wikimedia.org/T230530 (10hashar) I have marked it as a dupe of T67394 and copy pasted the description there. [15:25:33] 10Release-Engineering-Team (Seen): "Welcome to Wikimedia development" information for new devs about releasing, CI, and QA - https://phabricator.wikimedia.org/T101031 (10hashar) Sounds like that is now flagged via #code-health-deved-curriculum and the two tasks: * {T249152} * {T249151} [15:25:38] 10Release-Engineering-Team (Seen): "Welcome to Wikimedia development" information for new devs about releasing, CI, and QA - https://phabricator.wikimedia.org/T101031 (10hashar) 05Open→03Declined [15:27:45] (03CR) 10Ahmon Dancy: [C: 03+2] "LGTM. I wonder why the problem didn't show up in train-dev." [tools/scap] - 10https://gerrit.wikimedia.org/r/698773 (owner: 10Lars Wirzenius) [15:28:36] (03Merged) 10jenkins-bot: fix: write bytes to lock file [tools/scap] - 10https://gerrit.wikimedia.org/r/698773 (owner: 10Lars Wirzenius) [15:47:37] (03PS1) 10Lars Wirzenius: Revert "fix: write bytes to lock file" [tools/scap] - 10https://gerrit.wikimedia.org/r/698812 [15:49:09] (03CR) 10Ahmon Dancy: [C: 03+2] Revert "fix: write bytes to lock file" [tools/scap] - 10https://gerrit.wikimedia.org/r/698812 (owner: 10Lars Wirzenius) [15:49:50] (03Merged) 10jenkins-bot: Revert "fix: write bytes to lock file" [tools/scap] - 10https://gerrit.wikimedia.org/r/698812 (owner: 10Lars Wirzenius) [16:12:05] 10Release-Engineering-Team, 10MW-on-K8s, 10SRE, 10serviceops: Ownership of the /tmp/mw-cache directories should be www-data in the mediawiki-multiversion image - https://phabricator.wikimedia.org/T284581 (10Joe) [16:13:48] 10Release-Engineering-Team, 10MW-on-K8s, 10SRE, 10serviceops: Ownership of the /tmp/mw-cache directories should be www-data in the mediawiki-multiversion image - https://phabricator.wikimedia.org/T284581 (10Joe) I suspect we just need to remove the directories, as they only contain a cached configuration f... [16:26:38] James_F: Around? I need your virtual blessing regarding ruby upgrade in the CI [16:26:42] context https://gerrit.wikimedia.org/r/c/mediawiki/extensions/Wikibase/+/680996 [16:27:19] Already released new version of the gem for wikidata-api that works with ruby 2.5 [16:38:50] James_F: is it okay if you remove DNM from https://gerrit.wikimedia.org/r/c/integration/config/+/685631 and https://gerrit.wikimedia.org/r/c/integration/config/+/681853 so I can deploy them? [16:39:09] it'll be my first CI deployment ^^ [16:50:39] 10Release-Engineering-Team, 10MW-on-K8s, 10SRE, 10serviceops: The restricted/mediawiki-multiversion image should include the production version of private/PrivateSettings.php - https://phabricator.wikimedia.org/T284582 (10Joe) [17:01:51] oh I'm not in the integration/config ladp group :( Can't merge them. [17:02:14] boo [17:03:16] I can add myself to the group but rather let someone else do it. It would be rude [17:05:04] 10Release-Engineering-Team (Doing), 10Patch-For-Review, 10Release, 10Train Deployments: 1.37.0-wmf.9 deployment blockers - https://phabricator.wikimedia.org/T281150 (10Jdlrobson) [17:05:26] Context: T283925 [17:05:26] T283925: Requesting access to contint-admins for Ladsgroup - https://phabricator.wikimedia.org/T283925 [17:05:48] Amir1: will do [17:05:52] that is in gerrit [17:06:27] Yeah, I was meaning I got the right (as a concept) [17:06:29] hmm [17:06:39] so rights come frmo "integration" group [17:06:45] which includes the LDAP ciadmin group [17:06:46] https://gerrit.wikimedia.org/r/admin/groups/af5fd59673a33a78f3fb79577d15c19be89d9e64,members [17:07:29] which grants access to eg deploy jobs ;D [17:08:45] 10Continuous-Integration-Infrastructure, 10LDAP-Access-Requests, 10SRE, 10SRE-Access-Requests: Requesting access to contint-admins for Ladsgroup - https://phabricator.wikimedia.org/T283925 (10hashar) 05Resolved→03Open @Ladsgroup now has access to the server, but I completely missed he already needs adm... [17:08:54] Amir1: I have reopened the task mentioning ciadmin , sorry I completely missed that part :-\ [17:09:20] hopefully my comment is enough, else thcipriani can reapprove by replying on https://phabricator.wikimedia.org/T283925#7142992 [17:09:25] All good. Thanks! [17:09:30] then well.. gotta find someone with LDAP rights [17:09:40] hashar: I can add myself :D [17:09:51] at least I think I can [17:09:52] ahah [17:09:54] let me see [17:09:58] 10Release-Engineering-Team (Doing), 10Patch-For-Review, 10Release, 10Train Deployments: 1.37.0-wmf.9 deployment blockers - https://phabricator.wikimedia.org/T281150 (10Jdlrobson) @jeena would it be possible to merge https://gerrit.wikimedia.org/r/c/mediawiki/extensions/Echo/+/698680 before pushing forward... [17:10:02] those processes restrictions are sooo broken [17:10:23] one sure thing: be careful cause the whole stack is suprisingly extremely easy to collapse entirely [17:10:25] :| [17:10:40] Noted [17:10:48] I'll be as careful as possible [17:11:07] the overall idea is to first deploy the jobs using tox -e jenkins-jobs -- xyz [17:11:14] that is documented in the README afaik [17:11:22] then reload zuul [17:11:33] else zuul might start trying to trigger jobs that do not exist yet [17:12:05] also those two patches got a [DNM] prefix in the commit message not the end of the world [17:12:23] there are also stuff that directly affect developers, so well your mileage varies :D [17:12:36] anyway, I was about to go to dinner. I will be back later tonight [17:13:14] Bon appetit [17:13:37] 10Release-Engineering-Team (Doing), 10Patch-For-Review, 10Release, 10Train Deployments: 1.37.0-wmf.9 deployment blockers - https://phabricator.wikimedia.org/T281150 (10jeena) @Jdlrobson I think that would be alright. Do you need me to deploy it to testwikis? [17:22:44] (03PS4) 10Jforrester: [DNM] Zuul: [mediawiki/extensions/Wikibase] Switch legacy Ruby jobs to 2.5 [integration/config] - 10https://gerrit.wikimedia.org/r/685631 (https://phabricator.wikimedia.org/T280491) [17:23:23] Amir1: Hey, sorry, around now. [17:23:41] All good. Thanks for removing those [17:23:44] Amir1: I can merge and deploy https://gerrit.wikimedia.org/r/c/integration/config/+/685631 if you're OK with the merges etc.? [17:23:51] sure [17:24:08] (03PS5) 10Jforrester: Zuul: [mediawiki/extensions/Wikibase] Switch legacy Ruby jobs to 2.5 [integration/config] - 10https://gerrit.wikimedia.org/r/685631 (https://phabricator.wikimedia.org/T280491) [17:24:13] (03CR) 10Jforrester: [C: 03+2] Zuul: [mediawiki/extensions/Wikibase] Switch legacy Ruby jobs to 2.5 [integration/config] - 10https://gerrit.wikimedia.org/r/685631 (https://phabricator.wikimedia.org/T280491) (owner: 10Jforrester) [17:24:46] 10Continuous-Integration-Infrastructure, 10LDAP-Access-Requests, 10SRE, 10SRE-Access-Requests: Requesting access to contint-admins for Ladsgroup - https://phabricator.wikimedia.org/T283925 (10Marostegui) 05Open→03Resolved Done! ` root@mwmaint1002:~# ldapsearch -x cn=ciadmin | grep lads member: uid=lads... [17:25:28] (03Merged) 10jenkins-bot: Zuul: [mediawiki/extensions/Wikibase] Switch legacy Ruby jobs to 2.5 [integration/config] - 10https://gerrit.wikimedia.org/r/685631 (https://phabricator.wikimedia.org/T280491) (owner: 10Jforrester) [17:25:42] !log Zuul: [mediawiki/extensions/Wikibase] Switch legacy Ruby jobs to 2.5 T280491 [17:25:44] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [17:25:45] T280491: Wikibase legacy ruby browser tests need to be updated to work on buster/ruby2.5 - https://phabricator.wikimedia.org/T280491 [17:26:12] Amir1: OK, that's live. [17:26:30] James_F: there should be another one too [17:26:37] There should? [17:26:48] two patches [17:27:09] https://gerrit.wikimedia.org/r/c/integration/config/+/681853 [17:27:12] Is this needed? [17:27:13] Oh, hmm. [17:27:16] Checking. [17:28:07] No, over-taken by other patches. [17:29:19] (03Abandoned) 10Jforrester: [DNM] Zuul: Switch mwgate-rake and mediawiki-selenium to Ruby 2.5/buster [integration/config] - 10https://gerrit.wikimedia.org/r/681853 (https://phabricator.wikimedia.org/T280874) (owner: 10Jforrester) [17:29:44] Amir1: There's a bunch of clean-up patches of mine I can now land, but will wait for confirmation that all is well. [17:30:19] sure, let me try the patch and merging it [17:31:20] then cherry-picking it to a million branches :D [17:31:37] REL1_31, REL1_35, REL1_36, wmf.9 and wmf.7 I guess? [17:31:51] oh good [17:31:56] If you'd all slacked off for a month you could have avoided REL1_31. ;-) [17:32:26] lol [17:35:02] (03CR) 10Jforrester: [C: 03+1] "Nice!" [integration/config] - 10https://gerrit.wikimedia.org/r/698787 (https://phabricator.wikimedia.org/T232287) (owner: 10Hashar) [17:35:28] oh wmf.10 I think is cut too [17:40:50] !log gitlab1001: running k6 data generator [17:40:52] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [17:45:01] 10Release-Engineering-Team (Doing), 10Patch-For-Review, 10Release, 10Train Deployments: 1.37.0-wmf.9 deployment blockers - https://phabricator.wikimedia.org/T281150 (10Jdlrobson) @jeena should be fine to just merge into the branch before we deploy to mediawiki.org / test.wikipedia.org. I'd rather not see t... [17:48:47] 10Release-Engineering-Team (Doing), 10Patch-For-Review, 10Release, 10Train Deployments: 1.37.0-wmf.9 deployment blockers - https://phabricator.wikimedia.org/T281150 (10jeena) Sounds good, thanks @Jdlrobson [18:11:38] 10Phabricator: Create form for Fundraising Tech - https://phabricator.wikimedia.org/T282292 (10DStrine) @Aklapper I think John is looking for the formatting below to be created in a template like this one: ((fundraising-story)) But we don't understand your questions about preamble or your last question. >! In... [18:15:53] @jeena apologies there is one more patch too that I need to go out before the train rolls - https://gerrit.wikimedia.org/r/c/mediawiki/extensions/Echo/+/698848 [18:17:07] @Jdlrobson okay, I'll give it a +2 now if it's ready [18:17:52] actually, I see it's not merged into master, so I'll want to wait for that [18:24:56] 10Release-Engineering-Team, 10MW-on-K8s, 10SRE, 10serviceops, 10Patch-For-Review: Ownership of the /tmp/mw-cache directories should be www-data in the mediawiki-multiversion image - https://phabricator.wikimedia.org/T284581 (10dancy) 05Open→03Resolved a:03dancy @Joe This should be fixed now. You... [18:31:04] @jeena it's merged on master now :) [18:31:07] thank you! [18:31:13] that should be everything [18:31:21] thanks! [18:36:19] James_F: the patch is failing on REL1_31 for unrelated reasons. How sad it would make you if I force merge it? [18:40:09] thanks jeena ! [18:49:29] Amir1: Go for it. [18:50:08] Thanks! [18:50:26] (03CR) 10Tosfos: "I can +2 this, but I want to be sure DannyS712 is OK with that. Please confirm." [extensions/GoogleCustomWikiSearch] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/662682 (owner: 10Zoranzoki21) [18:51:22] (03PS5) 10Jforrester: jjb: Drop rake-docker, no longer used [integration/config] - 10https://gerrit.wikimedia.org/r/681854 (https://phabricator.wikimedia.org/T280874) [18:51:28] (03PS5) 10Jforrester: dockerfiles: Drop rake, no longer used [integration/config] - 10https://gerrit.wikimedia.org/r/681855 (https://phabricator.wikimedia.org/T280874) [18:51:59] (03PS3) 10Jforrester: tests: Don't check for mwselenium-quibble-docker, we're killing it [integration/config] - 10https://gerrit.wikimedia.org/r/685632 [18:52:04] (03PS4) 10Jforrester: tests: Don't check for mwselenium-quibble-docker, we're killing it [integration/config] - 10https://gerrit.wikimedia.org/r/685632 [18:52:12] (03PS3) 10Jforrester: jjb: Drop mwselenium-quibble-docker, no longer used [integration/config] - 10https://gerrit.wikimedia.org/r/685633 (https://phabricator.wikimedia.org/T278203) [18:52:22] (03PS8) 10Jforrester: jjb: [mediawiki-selenium-integration-docker] Switch to buster [integration/config] - 10https://gerrit.wikimedia.org/r/674193 (https://phabricator.wikimedia.org/T278203) [18:52:41] (03PS9) 10Jforrester: dockerfiles: Drop quibble-stretch-bundle, unused [integration/config] - 10https://gerrit.wikimedia.org/r/674181 (https://phabricator.wikimedia.org/T252432) [18:52:48] (03PS10) 10Jforrester: dockerfiles: Drop quibble-stretch-bundle, unused [integration/config] - 10https://gerrit.wikimedia.org/r/674181 (https://phabricator.wikimedia.org/T252432) [18:54:52] Amir1: Everything looking OK? Can I start dismantling CI for ruby 2.3? ;-) [18:55:17] James_F: Have fun [18:55:35] nothing out of ordinary here [18:59:42] Amir1: you are now in ciadmin group so you shall be able to login jenkins and get an api token [19:01:06] Amir1: via https://integration.wikimedia.org/ci/user/ladsgroup/configure :] [19:03:08] Thanks hasharDinner ! [19:04:42] 10Continuous-Integration-Infrastructure: CI failures in "git-status" task related to submodules - https://phabricator.wikimedia.org/T284492 (10matmarex) Thanks for the fix. [19:21:43] hasharDinner: beside the README is there some sorts of documentation for CI? [19:26:19] Amir1: the doc portal is https://www.mediawiki.org/wiki/CI [19:26:39] but it is mostly runbooks, there are a few design documentations but I don't think they are much relevant [19:27:24] if you got time to allocate, we can do a few pairing and revisit them together. Like we capture your questions and my answers to the wikipages [19:28:01] for jenkins job builder that would be https://www.mediawiki.org/wiki/CI/JJB [19:28:19] and their online doc at https://jenkins-job-builder.readthedocs.io/ [19:28:42] 10Continuous-Integration-Infrastructure, 10LDAP-Access-Requests, 10SRE, 10SRE-Access-Requests: Requesting access to contint-admins for Ladsgroup - https://phabricator.wikimedia.org/T283925 (10hashar) Thank you very much @Marostegui , much appreciated. [19:28:52] that's still pretty great. Thank you. [19:30:07] CI/JJB was basically the exact page I was looking for [19:31:23] that should give all the steps to configure it [19:32:08] reading the online doc is probably a good thing to do as well. The one explaining the DSL is https://jenkins-job-builder.readthedocs.io/en/latest/definition.html [19:35:02] (03PS1) 10Thcipriani: Calendar: nick changed moving to libera [tools/release] - 10https://gerrit.wikimedia.org/r/698842 [19:35:10] (03PS1) 10BBlack: operations-dnslint: create version 0.0.10 [integration/config] - 10https://gerrit.wikimedia.org/r/698843 [19:35:12] (03PS1) 10BBlack: operations-dnslist: bump to 0.0.10 [integration/config] - 10https://gerrit.wikimedia.org/r/698844 [19:36:08] 10Release-Engineering-Team, 10MW-on-K8s, 10SRE, 10serviceops, 10Patch-For-Review: The restricted/mediawiki-multiversion image should include the production version of private/PrivateSettings.php - https://phabricator.wikimedia.org/T284582 (10dancy) 05Open→03Resolved a:03dancy @Joe This should be fi... [19:36:35] (03CR) 10Jeena Huneidi: [C: 03+2] "thanks!" [tools/release] - 10https://gerrit.wikimedia.org/r/698842 (owner: 10Thcipriani) [19:37:42] (03Merged) 10jenkins-bot: Calendar: nick changed moving to libera [tools/release] - 10https://gerrit.wikimedia.org/r/698842 (owner: 10Thcipriani) [19:40:17] !log gitlab1001: resetting all application data for a second attempt at test data creation [19:40:18] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [19:59:20] !log gitlab1001: gitlab-ansible run to reset configuration [19:59:21] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [20:28:45] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team (Seen), 10Desktop Improvements, 10Developer Productivity, and 2 others: Automatically display production content on Beta Cluster wikis on desktop (via an API request) - https://phabricator.wikimedia.org/T207508 (10Jdlrobson) 05Open→03Declined It... [20:32:10] !log gitlab1001: k6_gitlab: running test data creation [20:32:11] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [21:00:24] (03PS3) 10Jeena Huneidi: WIP: Xdebug: always install xdebug module, move config to core [releng/dev-images] - 10https://gerrit.wikimedia.org/r/692737 (https://phabricator.wikimedia.org/T273682) (owner: 10Brennen Bearnes) [21:06:47] (03PS4) 10Jeena Huneidi: WIP: Xdebug: always install xdebug module, move config to core [releng/dev-images] - 10https://gerrit.wikimedia.org/r/692737 (https://phabricator.wikimedia.org/T273682) (owner: 10Brennen Bearnes) [21:43:43] (03PS1) 10Brennen Bearnes: rename buster to fundraising-buster [releng/dev-images] - 10https://gerrit.wikimedia.org/r/698878 (https://phabricator.wikimedia.org/T273100) [21:58:41] (03PS1) 10Brennen Bearnes: WIP: add buster php images [releng/dev-images] - 10https://gerrit.wikimedia.org/r/698880 (https://phabricator.wikimedia.org/T273100) [21:59:22] (03CR) 10Jeena Huneidi: [C: 03+1] "depends on I0a94c3339915bbac50064a4cff01b8d84e689e8e" [integration/config] - 10https://gerrit.wikimedia.org/r/698774 (https://phabricator.wikimedia.org/T281132) (owner: 10Nikki Nikkhoui) [22:13:04] (03CR) 10Jforrester: [C: 03+2] tests: mute zuul output when testing layout [integration/config] - 10https://gerrit.wikimedia.org/r/698787 (https://phabricator.wikimedia.org/T232287) (owner: 10Hashar) [22:14:09] (03Merged) 10jenkins-bot: tests: mute zuul output when testing layout [integration/config] - 10https://gerrit.wikimedia.org/r/698787 (https://phabricator.wikimedia.org/T232287) (owner: 10Hashar) [22:22:03] 10Continuous-Integration-Infrastructure, 10Browser-Tests, 10Developer Productivity: Remove voting Selenium jobs from the wmf branches - https://phabricator.wikimedia.org/T284526 (10Jdforrester-WMF) > just like it was done for non-gate jobs (T225248). This is not true. They're voting everywhere they run. [22:22:18] 10Continuous-Integration-Infrastructure, 10MediaWiki-Core-Tests, 10Browser-Tests, 10Developer Productivity, 10Patch-For-Review: Consider moving browser based tests (Selenium and QUnit) to a non-voting pipeline - https://phabricator.wikimedia.org/T225248 (10Jdforrester-WMF) 05Resolved→03Declined Given... [22:28:02] 10Continuous-Integration-Infrastructure, 10CirrusSearch, 10Discovery-Search, 10Patch-For-Review: CirrusSearch cucumber runner system is not compatible with node 12 -> master is unmerge-able - https://phabricator.wikimedia.org/T284519 (10Jdforrester-WMF) 05Open→03Resolved a:03EBernhardson [22:33:20] (03PS2) 10Krinkle: cover: add link to clover.xml file [integration/docroot] - 10https://gerrit.wikimedia.org/r/698180 (https://phabricator.wikimedia.org/T221510) (owner: 10Hashar) [22:33:52] (03CR) 10Krinkle: [C: 03+2] "Repaired some of the original styling which stopped working correctly, and made it so that the meter and label are once again one clickabl" [integration/docroot] - 10https://gerrit.wikimedia.org/r/698180 (https://phabricator.wikimedia.org/T221510) (owner: 10Hashar) [22:35:01] (03PS1) 10Krinkle: readme: fix mistaken composer commands that were swapped around [integration/docroot] - 10https://gerrit.wikimedia.org/r/698886 [22:35:10] (03Merged) 10jenkins-bot: cover: add link to clover.xml file [integration/docroot] - 10https://gerrit.wikimedia.org/r/698180 (https://phabricator.wikimedia.org/T221510) (owner: 10Hashar) [22:37:39] 10Release-Engineering-Team: Improvements for the process of "WMF Releases" pages on MW - https://phabricator.wikimedia.org/T284615 (10Quiddity) [22:44:20] 10Continuous-Integration-Infrastructure, 10CirrusSearch, 10Discovery-Search, 10Patch-For-Review: CirrusSearch cucumber runner system is not compatible with node 12 -> master is unmerge-able - https://phabricator.wikimedia.org/T284519 (10EBernhardson) Test runner changes were minor: * Destroyed mwv instanc... [22:47:07] 10Continuous-Integration-Config, 10Release-Engineering-Team (Next), 10MediaWiki-Core-Tests, 10Code-Health, and 6 others: Reduce runtime of MW shared gate Jenkins jobs to 5 min - https://phabricator.wikimedia.org/T225730 (10Krinkle) @kostajh Is the time spent mainly in API login or UI login, or are they bot...