[00:00:38] (DatasourceError) firing: Queue (Jenkins jobs + Zuul functions) alert - https://grafana.wikimedia.org/alerting/grafana/iS0FSjJ4z/view - https://wikitech.wikimedia.org/wiki/Monitoring/DatasourceError - https://alerts.wikimedia.org/?q=alertname%3DDatasourceError [05:43:29] hey folks, I will be trying not to run the backport window this morning, since I have a patch I'd like to go during the window itself: anyone that can do it instead? (and yes, I will happily self deploy) [08:01:18] 10Project-Admins, 10Adiutor: Create project tag for Adiutor - https://phabricator.wikimedia.org/T353380 (10Tgr) 05Open→03Resolved a:03Tgr #adiutor [08:38:03] 10Release-Engineering-Team (Deployment Training Requests): Deployment training request for ssastry - https://phabricator.wikimedia.org/T353383 (10ArielGlenn) We missed you, I'm guessing that you got notice of this too late to make the training? We can reschedule in any case. [09:10:02] apergos: I could not make it to the backport window this morning. I had a dense agenda :/ [09:10:19] well there was no trainee so it turned ot ok [09:10:56] however, cc thcipriani I'm still trying to pass this work off to others, if you can make that happen, as I really should focus primarily on mw dev onboarding and actual work for some time [09:17:46] 10GitLab (Pipeline Services Migration🐤), 10collaboration-services: move commons-query.wikimedia.org and query.wikidata.org to kubernetes - https://phabricator.wikimedia.org/T350793 (10Gehel) Query Builder and Query GUI are owned and managed by WMDE. And change to the build process must at least be communicated... [09:25:10] 10Release-Engineering-Team (Deployment Training Requests): Deployment training request for ssastry - https://phabricator.wikimedia.org/T353383 (10Ladsgroup) I assume Subbu will participate the one later today given his timezone [09:51:17] 10Release-Engineering-Team (Deployment Training Requests): Deployment training request for ssastry - https://phabricator.wikimedia.org/T353383 (10ArielGlenn) I wonder why I thought he was in mine? Wishful thinking maybe. Hope it all goes well! [09:58:12] GitLab needs a short restart at around 11:00 UTC [10:03:15] 10GitLab, 10Release-Engineering-Team: `npm ci` not working on trusted runners for https://gitlab.wikimedia.org/repos/data-engineering/superset - https://phabricator.wikimedia.org/T353197 (10BTullis) @dancy - thanks so much for looking into it. I didn't spot that this ticket had been created, otherwise I would... [10:11:24] 10GitLab (Pipeline Services Migration🐤), 10WMDE-Analytics-Engineering, 10collaboration-services: move commons-query.wikimedia.org and query.wikidata.org to kubernetes - https://phabricator.wikimedia.org/T350793 (10Jelto) [10:27:32] 10GitLab (Account Approval), 10Release-Engineering-Team: Requesting GitLab account activation for USER[S] - https://phabricator.wikimedia.org/T353431 (10Hunsvotti) [10:27:34] 10Release-Engineering-Team, 10Scap, 10Sustainability (Incident Followup): Localisation cache must be purged after or during train deploy, not (just) before - https://phabricator.wikimedia.org/T263872 (10matmarex) [11:08:28] 10Continuous-Integration-Config, 10ci-test-error: apitests do not run across repositories - https://phabricator.wikimedia.org/T352887 (10Urbanecm_WMF) >>! In T352887#9404770, @Jdforrester-WMF wrote: > The api-tests were very intentionally only applied to core and not extensions in 26fb84df00 due to the cost of... [11:13:30] GitLab restart done [11:30:36] 10Continuous-Integration-Config, 10Release-Engineering-Team: tox v4 replacement for TOX_TESTENV_PASSENV - https://phabricator.wikimedia.org/T348871 (10Urbanecm_WMF) `labs/tools/wikinity` CI seems to broke because of this, as I made use of `pass_env` in my `tox.ini` file. Since the variables I'm accessing (name... [11:41:11] 10GitLab (Account Approval), 10Release-Engineering-Team: Requesting GitLab account activation for hunsvotti - https://phabricator.wikimedia.org/T353431 (10Anoop) [14:04:04] 10Release-Engineering-Team (Deployment Training Requests): Deployment training request for ssastry - https://phabricator.wikimedia.org/T353383 (10ssastry) Yes, I am just waking up. :-) So, will do training afternoon my time (CST) / late UTC. [14:05:15] 10Continuous-Integration-Config, 10Release-Engineering-Team: tox v4 replacement for TOX_TESTENV_PASSENV - https://phabricator.wikimedia.org/T348871 (10hashar) I went with tox 4.8.0 and further versions have bug fixes related to overriding settings: > 4.10.0 > --override foo+=bar appending syntax will now work... [14:34:35] (03PS1) 10Hashar: dockerfiles: create ci-bookworm base image [integration/config] - 10https://gerrit.wikimedia.org/r/983200 [14:44:53] 10GitLab (CI & Job Runners), 10Release-Engineering-Team (Onboarding 🚀): Automatically clean up unused buildkitd PersistentVolumeClaims periodically - https://phabricator.wikimedia.org/T351478 (10Sandeeps) 05Open→03In progress a:03Sandeeps [15:09:11] sandeep_: welcome in our public channel :-] [15:17:41] 10Release-Engineering-Team (Priority Backlog 📥), 10Projects-Cleanup, 10collaboration-services: Migrate SRE repositories to GitLab - Archiving unused Gerrit repositories - https://phabricator.wikimedia.org/T343707 (10LSobanski) >>! In T343707#9383933, @jcrespo wrote: >>>! In T343707#9383060, @LSobanski wrote:... [15:47:12] 10GitLab, 10Release-Engineering-Team: `npm ci` not working on trusted runners for https://gitlab.wikimedia.org/repos/data-engineering/superset - https://phabricator.wikimedia.org/T353197 (10dancy) Thanks for the info @BTullis. Let's leave this ticket open for a bit longer in case anyone else sees it and has s... [15:49:33] 10Gitlab-Application-Security-Pipeline, 10Security Team AppSec, 10Security-Team, 10Patch-For-Review, and 2 others: Address issues within certain Gitlab CI security templates - https://phabricator.wikimedia.org/T338034 (10mmartorana) [15:51:30] 10Gitlab-Application-Security-Pipeline, 10Security-Team, 10Documentation, 10SecTeam-Processed, 10Security: Update on-wiki documentation for the AppSec Pipeline for phase 2 work - https://phabricator.wikimedia.org/T346802 (10mmartorana) [15:57:17] hi releng! If I want to rename a docker image in the dev-images repo, is this all there is to it? https://gitlab.wikimedia.org/repos/releng/dev-images/-/merge_requests/59 [15:59:26] That looks reasonable to me. [16:01:30] I can merge and run the builds if desired. [16:01:38] ejegg: ^ [16:05:39] sounds good dancy, thanks! [16:05:48] OK.. Proceeding [16:08:21] !log Updating development images on contint primary for https://gitlab.wikimedia.org/repos/releng/dev-images/-/merge_requests/59 (T350442) [16:11:00] ejegg: Successfully published image docker-registry.discovery.wmnet/dev/fundraising-bullseye-php74-apache2:1.0.2 [16:11:51] Thanks so much, dancy! [16:31:38] 10Phabricator: Production error phabricator form is missing an obvious place to place the RequestID - https://phabricator.wikimedia.org/T352629 (10brennen) [16:52:23] 10Phabricator: Production error phabricator form is missing an obvious place to place the RequestID - https://phabricator.wikimedia.org/T352629 (1020after4) I think the intention is to share the "single document url" from logstash //instead of// the request id. The instructions are unclear, however, and could b... [17:25:01] 10Gitlab-Application-Security-Pipeline, 10Security-Team, 10SecTeam-Processed, 10Security, 10user-sbassett: [EPIC] Application Security Pipeline Components for Gitlab - Phase 2 Work - https://phabricator.wikimedia.org/T342177 (10sbassett) [17:25:15] 10Release-Engineering-Team (Seen), 10MW-on-K8s, 10SRE, 10Traffic, and 2 others: Move MediaWiki jobs to mw-on-k8s - https://phabricator.wikimedia.org/T349796 (10akosiaris) [17:25:25] 10Gitlab-Application-Security-Pipeline, 10Security Team AppSec, 10Security-Team, 10Patch-For-Review, and 2 others: Address issues within certain Gitlab CI security templates - https://phabricator.wikimedia.org/T338034 (10sbassett) [17:25:31] (03CR) 10Jforrester: [C: 03+2] dockerfiles: create ci-bookworm base image [integration/config] - 10https://gerrit.wikimedia.org/r/983200 (owner: 10Hashar) [17:26:11] 10Gitlab-Application-Security-Pipeline, 10Security Team AppSec, 10Security-Team, 10Patch-For-Review, and 2 others: Address issues within certain Gitlab CI security templates - https://phabricator.wikimedia.org/T338034 (10sbassett) 05In progress→03Resolved [17:26:37] (03Merged) 10jenkins-bot: dockerfiles: create ci-bookworm base image [integration/config] - 10https://gerrit.wikimedia.org/r/983200 (owner: 10Hashar) [17:57:30] 10Release-Engineering-Team (Radar), 10Tech-Docs-Team, 10Documentation: Create repository with configuration files for common CI use cases - https://phabricator.wikimedia.org/T352273 (10TBurmeister) I cloned the repo and was able to successfully run the tests and the sample services for each of the different... [18:42:52] 10Gitlab-Application-Security-Pipeline, 10Patch-For-Review, 10SecTeam-Processed, 10Security, 10user-sbassett: Improve related gitlab test repository - https://phabricator.wikimedia.org/T348788 (10CodeReviewBot) sbassett opened https://gitlab.wikimedia.org/repos/security/ci-cd-testing-gitlab-ci-security-t... [19:56:08] (03PS3) 10Hashar: dockerfiles: tox with Bookworm using pyenv [integration/config] - 10https://gerrit.wikimedia.org/r/983247 (https://phabricator.wikimedia.org/T342019) [19:56:15] well [19:58:06] tox v3 -> v4 upgrade is not far from winning the price for the worse upgrade [20:02:57] :-( [20:03:14] hashar: There's always Zuul \ Python 2 -> 3 in your future, instead? ;-) [20:03:29] that is 100% NOT going to happen :) [20:59:50] (03PS4) 10Hashar: dockerfiles: tox with Bookworm using pyenv [integration/config] - 10https://gerrit.wikimedia.org/r/983247 (https://phabricator.wikimedia.org/T342019) [21:04:16] oh [21:04:43] Hallelujah [21:04:49] I FOUND IT [21:05:10] set_env / pass_env in the repos tox.ini files should append to whatever is existing [21:05:11] bah [21:05:16] that is soooo broken [21:05:29] I think I will get rid of tox [22:10:13] (03CR) 10Hashar: [C: 03+2] dockerfiles: pass XDG_CACHE_HOME and set PY_COLORS=1 (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/965776 (https://phabricator.wikimedia.org/T348871) (owner: 10Hashar) [22:17:13] 10Continuous-Integration-Config, 10Release-Engineering-Team, 10Patch-For-Review: tox v4 replacement for TOX_TESTENV_PASSENV - https://phabricator.wikimedia.org/T348871 (10hashar) @Urbanecm_WMF @Xqt: I am sorry, tox v4 is broken in that regard :-\ I need CI to: * pass `XDG_CACHE_HOME` which is where pip will... [22:17:53] 10Continuous-Integration-Config, 10Release-Engineering-Team, 10Patch-For-Review, 10Upstream: tox v4 replacement for TOX_TESTENV_PASSENV - https://phabricator.wikimedia.org/T348871 (10hashar) [22:22:55] (03PS1) 10QChris: Allow “Gerrit Managers” to import history [extensions/Adiutor] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/983272 [22:22:57] (03CR) 10QChris: [V: 03+2 C: 03+2] Allow “Gerrit Managers” to import history [extensions/Adiutor] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/983272 (owner: 10QChris) [22:23:01] (03PS1) 10QChris: Import done. Revoke import grants [extensions/Adiutor] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/983273 [22:23:03] (03CR) 10QChris: [V: 03+2 C: 03+2] Import done. Revoke import grants [extensions/Adiutor] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/983273 (owner: 10QChris) [22:38:54] 10Release-Engineering-Team (Radar), 10Tech-Docs-Team, 10Documentation, 10Patch-For-Review: Create repository with configuration files for common CI use cases - https://phabricator.wikimedia.org/T352273 (10CodeReviewBot) tburmeister opened https://gitlab.wikimedia.org/repos/technical-documentation/deploymen... [22:56:55] 10Continuous-Integration-Config, 10Release-Engineering-Team (Priority Backlog 📥), 10MediaWiki-Core-Tests, 10Code-Health, and 8 others: Reduce runtime of MW shared gate Jenkins jobs to 5 min - https://phabricator.wikimedia.org/T225730 (10Krinkle) [23:12:38] (03PS1) 10Fabio carrieri: Edit Repo Config [analytics] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/975380 [23:17:07] 10Continuous-Integration-Config, 10Release-Engineering-Team, 10Patch-For-Review, 10Upstream: tox v4 replacement for TOX_TESTENV_PASSENV - https://phabricator.wikimedia.org/T348871 (10hashar) And the other patch for #upstream might be https://github.com/tox-dev/tox/pull/3173 so that when tox processes `test...