[00:54:23] (03CR) 10Milimetric: [V: 03+2 C: 03+2] Review access change [analytics/reportupdater-queries] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/709646 (https://phabricator.wikimedia.org/T287578) (owner: 10Awight) [02:48:43] (03PS2) 10Dduvall: WIP: Encapsulate auto-stage and rsync within multi-stage Dockerfile [tools/release] - 10https://gerrit.wikimedia.org/r/711019 [06:52:45] 10Continuous-Integration-Infrastructure, 10MediaWiki-Docker, 10mwcli, 10Patch-For-Review, 10User-Addshore: Set up CI for mwcli - https://phabricator.wikimedia.org/T248779 (10Addshore) For Gitlab https://gitlab.wikimedia.org/releng/cli/-/merge_requests/1 [06:52:55] 10Continuous-Integration-Infrastructure, 10MediaWiki-Docker, 10mwcli, 10Patch-For-Review, 10User-Addshore: Set up CI for mwcli - https://phabricator.wikimedia.org/T248779 (10Addshore) a:03Addshore [07:18:22] (03CR) 10Awight: "Thanks!" [analytics/reportupdater-queries] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/709646 (https://phabricator.wikimedia.org/T287578) (owner: 10Awight) [07:58:45] 10Gerrit, 10Mobile, 10Upstream: Can't type slash character ("/") in Gerrit web editor [fixed in Gerrit 3.5] - https://phabricator.wikimedia.org/T282387 (10Paladox) Upstream fix merged and I've backported it to https://gerrit-review.googlesource.com/c/plugins/codemirror-editor/+/314364 which has been merged. [08:18:07] 10Release-Engineering-Team, 10GitLab, 10Patch-For-Review: WARNING: In GitLab 14.0 we will begin removing all configuration backups older than yourgitlab_rails['backup_keep_time'] setting (currently set to: 259200) - https://phabricator.wikimedia.org/T288324 (10jcrespo) We now get: ` Cron /u... [08:24:49] PROBLEM - Work requests waiting in Zuul Gearman server on contint2001 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [150.0] https://www.mediawiki.org/wiki/Continuous_integration/Zuul https://grafana.wikimedia.org/dashboard/db/zuul-gearman?panelId=10&fullscreen&orgId=1 [08:35:47] 10Release-Engineering-Team (Doing), 10Quibble: Establish communication channel for Quibble development (plot twist: Slack channel) - https://phabricator.wikimedia.org/T286770 (10kostajh) >>! In T286770#7241175, @cscott wrote: > I generally use a Matrix client, to which I've bridged all my IRC and slack channel... [08:38:17] RECOVERY - Work requests waiting in Zuul Gearman server on contint2001 is OK: OK: Less than 100.00% above the threshold [90.0] https://www.mediawiki.org/wiki/Continuous_integration/Zuul https://grafana.wikimedia.org/dashboard/db/zuul-gearman?panelId=10&fullscreen&orgId=1 [09:08:03] 10Phabricator, 10DBA, 10Patch-For-Review: Failover m3 (phabricator) master (db1132) to a different host to upgrade its kernel - https://phabricator.wikimedia.org/T288197 (10Marostegui) [09:14:34] 10Release-Engineering-Team, 10SRE, 10Elections: Create list of developers eligible to vote on the 2021 board vote - https://phabricator.wikimedia.org/T288455 (10Qgil) Thank you for your quick replies! * SecurePoll needs Wimedia usernames (SUL). This might be tricky to extract. Options to do this seem to in... [09:26:23] PROBLEM - Work requests waiting in Zuul Gearman server on contint2001 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [150.0] https://www.mediawiki.org/wiki/Continuous_integration/Zuul https://grafana.wikimedia.org/dashboard/db/zuul-gearman?panelId=10&fullscreen&orgId=1 [09:39:55] RECOVERY - Work requests waiting in Zuul Gearman server on contint2001 is OK: OK: Less than 100.00% above the threshold [90.0] https://www.mediawiki.org/wiki/Continuous_integration/Zuul https://grafana.wikimedia.org/dashboard/db/zuul-gearman?panelId=10&fullscreen&orgId=1 [10:19:06] 10Continuous-Integration-Config, 10MediaWiki-extensions-WikibaseClient, 10MediaWiki-extensions-WikibaseRepository, 10Wikidata, and 2 others: Fix Wikibase test coverage - https://phabricator.wikimedia.org/T288396 (10Lucas_Werkmeister_WMDE) Related to T242617, I believe – it looks like the extension-coverage... [11:12:30] 10Release-Engineering-Team (Radar), 10SRE, 10serviceops: Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10Dzahn) [11:23:38] 10Release-Engineering-Team, 10SRE, 10Elections: Create list of developers eligible to vote on the 2021 board vote - https://phabricator.wikimedia.org/T288455 (10Dzahn) @Qgil Here is an alphabetical list of email addresses of all users with shell access: It's public info pulled out of the public git repo bu... [11:41:12] 10Continuous-Integration-Config, 10MW-1.37-notes (1.37.0-wmf.14; 2021-07-12), 10Patch-For-Review: Introduce non-voting jobs with quibble+apache - https://phabricator.wikimedia.org/T276428 (10kostajh) [13:11:53] 10Continuous-Integration-Config, 10MediaWiki-extensions-WikibaseClient, 10MediaWiki-extensions-WikibaseRepository, 10Wikidata, and 2 others: Fix Wikibase test coverage - https://phabricator.wikimedia.org/T288396 (10Reedy) I wonder if it's worth deleting the Wikibase directory so we don't get that "false po... [13:16:16] 10Continuous-Integration-Config, 10MediaWiki-extensions-WikibaseClient, 10MediaWiki-extensions-WikibaseRepository, 10Wikidata, and 2 others: Fix Wikibase test coverage - https://phabricator.wikimedia.org/T288396 (10Reedy) >>! In T288396#7271708, @Lucas_Werkmeister_WMDE wrote: > Related to T242617, I believ... [14:02:50] 10Continuous-Integration-Infrastructure, 10Browser-Tests, 10User-Addshore, 10User-zeljkofilipin: Centrally look for flakey browser tests - https://phabricator.wikimedia.org/T277205 (10Addshore) Re ran again per rumours of more flakiness. ` ls /srv/jenkins/builds/*-selenium-*/*/log | grep -v apache | xargs... [15:41:30] legoktm: does libup support checking python dependencies? I think the answer is "not yet [15:41:47] errr... "not yet", but I wanted to ask the expert [15:59:43] bd808: I sent 2 suggestions [16:06:42] !log Ran `sudo -u doc-uploader rm -rf /srv/doc/cover-extensions/Wikibase` on doc1001 for T288396 [16:06:46] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [16:06:46] T288396: Fix Wikibase test coverage - https://phabricator.wikimedia.org/T288396 [16:07:04] 10Continuous-Integration-Config, 10MediaWiki-extensions-WikibaseClient, 10MediaWiki-extensions-WikibaseRepository, 10Wikidata, and 2 others: Fix Wikibase test coverage - https://phabricator.wikimedia.org/T288396 (10Jdforrester-WMF) >>! In T288396#7272102, @Reedy wrote: > I wonder if it's worth deleting the... [16:07:23] 10Continuous-Integration-Config, 10MediaWiki-extensions-WikibaseClient, 10MediaWiki-extensions-WikibaseRepository, 10Wikidata, and 2 others: Re-start Wikibase test coverage reporting - https://phabricator.wikimedia.org/T288396 (10Jdforrester-WMF) [16:54:49] (03PS2) 10Jforrester: Zuul: Update e-mail address for Zabe in the allow list [integration/config] - 10https://gerrit.wikimedia.org/r/710671 (owner: 10Zabe) [16:54:55] (03CR) 10Jforrester: [C: 03+2] Zuul: Update e-mail address for Zabe in the allow list [integration/config] - 10https://gerrit.wikimedia.org/r/710671 (owner: 10Zabe) [16:55:59] (03Merged) 10jenkins-bot: Zuul: Update e-mail address for Zabe in the allow list [integration/config] - 10https://gerrit.wikimedia.org/r/710671 (owner: 10Zabe) [16:57:07] !log Zuul: Update e-mail address for Zabe in the allow list [16:57:09] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [17:00:31] 10Release-Engineering-Team, 10SRE, 10Elections: Create list of developers eligible to vote on the 2021 board vote - https://phabricator.wikimedia.org/T288455 (10Tgr) If we could produce a list of commit author email addresses for all Gerrit commits merged in the given period, which doesn't seem that hard, th... [18:02:55] bd808: yeah, "not yet". there's either WIP patch in Gerrit or in my local tree, I'll need to dig it up to see why I didn't finish it [18:03:31] pypa is working on an actual freely licensed security database for Python, so that's a pretty good motivating factor for me [18:04:54] legoktm: awesome. I would be happy to help with that so I can cross off T288535 in a way that doesn't make a new snowflake that needs tending forever. [18:04:54] T288535: Find vulnerabilty scanner to run periodically on Toolhub python dependencies - https://phabricator.wikimedia.org/T288535 [18:07:03] https://github.com/pypa/advisory-db [18:07:19] doesn't seem like a tool exists for it yet [18:07:41] but should be straightforward to parse the lockfile and iterate over the API [18:14:01] bd808: left a comment [18:42:10] does blubber support installing apt packages from a component? [18:42:37] aka apt::package_from_component in puppet https://gerrit.wikimedia.org/g/operations/puppet/+/556eeedfe27cb39e2a055fbb3ef7ca13d4b66aea/modules/apt/manifests/package_from_component.pp [18:53:23] Hmm.. Looks like there's support for specifying a "target release", but that's it. [18:54:07] What would the final apt-get command be in this example? [18:55:56] it's still apt-get install , but the component would be added as a new sources.list entry, and it would be apt pinned to priority=1001 [18:56:14] ah [18:57:02] I can create those files manually in the blubberfile, but would be nice if it took care of it automatically and correctly [18:57:05] I'll file a task [18:57:09] Sounds good. [19:38:39] 10Release-Engineering-Team (Doing), 10Patch-For-Review, 10Release, 10Train Deployments, 10User-jeena (Sprint 7/28-8/10): 1.37.0-wmf.18 deployment blockers - https://phabricator.wikimedia.org/T281159 (10jeena) [20:35:07] 10Release-Engineering-Team, 10Scap: Fix mwdebug dashboard to show mw and scap messages again - https://phabricator.wikimedia.org/T288576 (10Krinkle) [20:35:20] 10Release-Engineering-Team, 10Scap, 10Developer Productivity: Fix mwdebug dashboard to show mw and scap messages again - https://phabricator.wikimedia.org/T288576 (10Krinkle) [20:35:25] 10Release-Engineering-Team (Doing), 10Patch-For-Review, 10Release, 10Train Deployments, 10User-jeena (Sprint 7/28-8/10): 1.37.0-wmf.18 deployment blockers - https://phabricator.wikimedia.org/T281159 (10Jdlrobson) Dear train conductor, Just like last week, T281158#7253330, there is a possibility of minor... [20:41:23] 10Project-Admins, 10Serbian-Sites: Create #Serbian-Sites tag - https://phabricator.wikimedia.org/T212672 (10FriedrickMILBarbarossa) [21:15:28] 10Release-Engineering-Team (Doing), 10Patch-For-Review, 10Release, 10Train Deployments, 10User-jeena (Sprint 7/28-8/10): 1.37.0-wmf.18 deployment blockers - https://phabricator.wikimedia.org/T281159 (10jeena) [23:40:13] 10Release-Engineering-Team (Radar), 10Scap, 10Patch-For-Review, 10User-jijiki: Update Scap to perform rolling restart for all MW deploy - https://phabricator.wikimedia.org/T266055 (10thcipriani) Tomorrow at 16:00 UTC (9am US/Pacific) @dancy and I will be testing post-deployment-rolling-php-fpm-restart....