[00:19:25] (03PS1) 10Vaughn Walters: jjb: [catalyst-daily-PageTriage] Add PageTriage job [integration/config] - 10https://gerrit.wikimedia.org/r/1318803 (https://phabricator.wikimedia.org/T433085) [05:19:15] Project mediawiki-core-doxygen build #21893: 04FAILURE in 1 min 13 sec: https://integration.wikimedia.org/ci/job/mediawiki-core-doxygen/21893/ [06:32:27] Yippee, build fixed! [06:32:27] Project mediawiki-core-doxygen build #21894: 09FIXED in 14 min: https://integration.wikimedia.org/ci/job/mediawiki-core-doxygen/21894/ [08:02:11] (03CR) 10Hashar: [C:03+2] Switch translatewiki from ruby 2.7 to 3.3 [integration/config] - 10https://gerrit.wikimedia.org/r/1312474 (https://phabricator.wikimedia.org/T424966) (owner: 10Hashar) [08:04:10] (03Merged) 10jenkins-bot: Switch translatewiki from ruby 2.7 to 3.3 [integration/config] - 10https://gerrit.wikimedia.org/r/1312474 (https://phabricator.wikimedia.org/T424966) (owner: 10Hashar) [08:17:56] (03CR) 10JMeybohm: helm-linter: install helm319 along helm317 (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/1318680 (https://phabricator.wikimedia.org/T427403) (owner: 10Jelto) [08:52:39] (03PS1) 10Urbanecm: Zuul: [mediawiki/extensions/ImpactModule] Add basic tests [integration/config] - 10https://gerrit.wikimedia.org/r/1319036 (https://phabricator.wikimedia.org/T433353) [09:10:29] (03CR) 10Hashar: [C:03+2] Zuul: [mediawiki/extensions/ImpactModule] Add basic tests [integration/config] - 10https://gerrit.wikimedia.org/r/1319036 (https://phabricator.wikimedia.org/T433353) (owner: 10Urbanecm) [09:14:14] (03Merged) 10jenkins-bot: Zuul: [mediawiki/extensions/ImpactModule] Add basic tests [integration/config] - 10https://gerrit.wikimedia.org/r/1319036 (https://phabricator.wikimedia.org/T433353) (owner: 10Urbanecm) [09:16:58] (03CR) 10Hashar: [C:03+2] "Deployed!" [integration/config] - 10https://gerrit.wikimedia.org/r/1319036 (https://phabricator.wikimedia.org/T433353) (owner: 10Urbanecm) [09:17:03] thanks hashar, as always! [09:17:15] :] [09:17:28] I did not bother hunting for a change to recheck! [09:17:33] i just submitted one [09:17:38] <3 [09:17:43] happy Phan and structure tests fixing! [09:17:49] thanks! [09:22:04] (03PS2) 10Jelto: helm-linter: install helm319 along helm317 [integration/config] - 10https://gerrit.wikimedia.org/r/1318680 (https://phabricator.wikimedia.org/T427403) [09:23:38] (03CR) 10Jelto: helm-linter: install helm319 along helm317 (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/1318680 (https://phabricator.wikimedia.org/T427403) (owner: 10Jelto) [09:42:22] (03open) 10kbach: Add missing rule to RULE_REFERENCE.md [repos/ci-tools/wikimedia-spectral-ruleset] - 10https://gitlab.wikimedia.org/repos/ci-tools/wikimedia-spectral-ruleset/-/merge_requests/18 [09:54:24] 10Continuous-Integration-Config, 10Wikidata, 10Wikidata Lexicographical data, 10wmde-wikidata-tech, 13Patch-For-Review: Move Wikibase Lexeme's New Lexeme Special Page component's repository to Wikimedia Gerrit - https://phabricator.wikimedia.org/T424098#12166517 (10Lucas_Werkmeister_WMDE) 05Open→0... [10:30:00] (03PS1) 10Jelto: jjb/operations-misc.yaml: update helm-linter to 0.8.3 [integration/config] - 10https://gerrit.wikimedia.org/r/1319058 (https://phabricator.wikimedia.org/T427403) [11:15:16] 10Continuous-Integration-Config: [Request] Add me to trusted contributor in integration/config - https://phabricator.wikimedia.org/T432791#12166733 (10Les4353) @Aklapper [12:08:22] 10Continuous-Integration-Config: [Request] Add me to trusted contributor in integration/config - https://phabricator.wikimedia.org/T432791#12166882 (10Aklapper) > Codex have basiclly like zero active maintainers The amount of activity and merged changes on https://gerrit.wikimedia.org/r/q/project:design/codex d... [12:38:02] (03PS1) 10Hashar: zuul: add Les4353 to CI allowlist [integration/config] - 10https://gerrit.wikimedia.org/r/1319081 (https://phabricator.wikimedia.org/T432791) [12:39:23] (03CR) 10Hashar: [C:03+2] "Andre and I talked about it 😊" [integration/config] - 10https://gerrit.wikimedia.org/r/1319081 (https://phabricator.wikimedia.org/T432791) (owner: 10Hashar) [12:41:19] (03Merged) 10jenkins-bot: zuul: add Les4353 to CI allowlist [integration/config] - 10https://gerrit.wikimedia.org/r/1319081 (https://phabricator.wikimedia.org/T432791) (owner: 10Hashar) [12:44:39] 10Continuous-Integration-Config, 13Patch-For-Review: [Request] Add me to trusted contributor in integration/config - https://phabricator.wikimedia.org/T432791#12166991 (10hashar) 05Open→03Resolved a:03hashar Hello @Les4353, I have added you to the {nav Trusted Contributors} group in Gerrit, it brings... [12:48:03] FIRING: PuppetAgentStaleLastRun: Last Puppet run was over 24 hours ago on instance deployment-docker-mobileapps02 in project deployment-prep - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentStaleLastRun [12:48:10] 10Beta-Cluster-Infrastructure: Last Puppet run was over 24 hours ago on instance deployment-docker-mobileapps02 in project deployment-prep - https://phabricator.wikimedia.org/T433496 (10wmcs-alerts) 03NEW [13:01:53] (03open) 10lucaswerkmeister-wmde: Remove Lucas_WMDE from Wednesday backport window [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/254 [13:02:12] (03approved) 10jforrester: Remove Lucas_WMDE from Wednesday backport window [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/254 (owner: 10lucaswerkmeister-wmde) [13:11:02] (03CR) 10Hashar: [C:03+1] helm-linter: install helm319 along helm317 (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/1318680 (https://phabricator.wikimedia.org/T427403) (owner: 10Jelto) [13:49:36] (03CR) 10JMeybohm: [C:03+1] helm-linter: install helm319 along helm317 [integration/config] - 10https://gerrit.wikimedia.org/r/1318680 (https://phabricator.wikimedia.org/T427403) (owner: 10Jelto) [13:53:28] (03open) 10jforrester: deployment-calendar: Make each backport window addressable per day, and drop Lucas from the Wednesday one [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/255 [13:56:58] (03CR) 10Hashar: [C:03+2] "I have looked at the fullrun-default job output:" [integration/quibble] - 10https://gerrit.wikimedia.org/r/1314726 (https://phabricator.wikimedia.org/T432943) (owner: 10Phedenskog) [13:59:48] (03CR) 10Hashar: [C:03+2] "I think I have made it to have `npm ci` to run by default as a convenience when using `-c bash`, `--shell` or `-c' to easily be able to ru" [integration/quibble] - 10https://gerrit.wikimedia.org/r/1299658 (https://phabricator.wikimedia.org/T427922) (owner: 10Mhurd) [14:06:14] (03update) 10lucaswerkmeister-wmde: Remove Lucas_WMDE from Wednesday backport window [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/254 [14:15:45] (03Merged) 10jenkins-bot: Report npm install as its own stage [integration/quibble] - 10https://gerrit.wikimedia.org/r/1314726 (https://phabricator.wikimedia.org/T432943) (owner: 10Phedenskog) [14:20:58] (03Merged) 10jenkins-bot: Add --skip-npm-install to skip the standalone npm install [integration/quibble] - 10https://gerrit.wikimedia.org/r/1299658 (https://phabricator.wikimedia.org/T427922) (owner: 10Mhurd) [14:43:26] hashar: Do you have any advice or automation to handle restarting zuul when it is idle? [14:47:56] hashar: Ah, I see in https://www.mediawiki.org/wiki/Continuous_integration/Zuul#Restart that the normal restart procedure is graceful. That's nice. [14:51:57] (03CR) 10Ahmon Dancy: "This is live now" [integration/zuul] (patch-queue/debian/jessie-wikimedia) - 10https://gerrit.wikimedia.org/r/1311501 (https://phabricator.wikimedia.org/T432491) (owner: 10Jforrester) [14:52:22] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 07Zuul: Restrict depth of stacked commits processing in Zuul - https://phabricator.wikimedia.org/T432491#12167613 (10dancy) 05Open→03Resolved a:03dancy The change is deployed. [14:56:12] dancy: Let's hope it works! [14:56:37] I suppose we should exercise it [14:56:48] (03update) 10milazg: rules: Customize unused component validation to skip parameter schemas [repos/ci-tools/wikimedia-spectral-ruleset] - 10https://gitlab.wikimedia.org/repos/ci-tools/wikimedia-spectral-ruleset/-/merge_requests/17 (https://phabricator.wikimedia.org/T428147) [15:00:07] 10GitLab (CI & Job Runners): gitlab-runners: WMCS fleet became ~6.5x slower at BuildKit filesystem operations overnight on 8/9 July 2026 - https://phabricator.wikimedia.org/T433505 (10Jdforrester-WMF) 03NEW [15:04:53] 10GitLab (CI & Job Runners): gitlab-runners: WMCS fleet became ~6.5x slower at BuildKit filesystem operations overnight on 8/9 July 2026 - https://phabricator.wikimedia.org/T433505#12167692 (10dancy) https://gerrit.wikimedia.org/r/c/operations/puppet/+/1308767 (buildkitd: Bump buildkit image to wmf-v0.31.1) was... [15:13:11] (03update) 10milazg: rules: Customize unused component validation to skip parameter schemas [repos/ci-tools/wikimedia-spectral-ruleset] - 10https://gitlab.wikimedia.org/repos/ci-tools/wikimedia-spectral-ruleset/-/merge_requests/17 (https://phabricator.wikimedia.org/T428147) [15:24:12] 10Scap: Scap / Spiderpig should not warn about i18n rebuild whenever extension.json is changed - https://phabricator.wikimedia.org/T430750#12167779 (10dancy) An example of an extension.json change that did result in l10n rebuild: https://gerrit.wikimedia.org/r/c/mediawiki/extensions/cldr/+/1318704 [15:36:39] (03PS2) 10Vaughn Walters: jjb: [catalyst-daily-PageTriage] Add PageTriage job [integration/config] - 10https://gerrit.wikimedia.org/r/1318803 (https://phabricator.wikimedia.org/T433085) [15:39:03] FIRING: PuppetAgentFailure: Puppet agent failure detected on instance deployment-urldownloader04 in project deployment-prep - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentFailure [15:39:13] 10Beta-Cluster-Infrastructure: Puppet agent failure detected on instance deployment-urldownloader04 in project deployment-prep - https://phabricator.wikimedia.org/T433510 (10wmcs-alerts) 03NEW [15:47:51] 10GitLab (CI & Job Runners): gitlab-runners: WMCS fleet became ~6.5x slower at BuildKit filesystem operations overnight on 8/9 July 2026 - https://phabricator.wikimedia.org/T433505#12167898 (10Jdforrester-WMF) >>! In T433505#12167692, @dancy wrote: > https://gerrit.wikimedia.org/r/c/operations/puppet/+/1308767 (... [16:16:14] dancy: dduvall: Tyler told me about a proxy for package managers : https://github.com/git-pkgs/proxy [16:16:48] seems similar to Sonatype Nexus which I evaluated a decade ago but it only covered a few things at the time, and written in Java would have been tricky to contribute to it at the time [16:18:06] 06Project-Admins: Add pwangai in acl*Project-Admins to create Milestones in Test Platform - https://phabricator.wikimedia.org/T433515 (10pwangai) 03NEW [16:19:16] Project mediawiki-core-doxygen build #21904: 04FAILURE in 1 min 14 sec: https://integration.wikimedia.org/ci/job/mediawiki-core-doxygen/21904/ [16:45:05] 10GitLab (CI & Job Runners), 06Release-Engineering-Team, 07Essential-Work: Buildkit v0.32.0 released - https://phabricator.wikimedia.org/T433520 (10dancy) 03NEW [16:47:17] who ever in the team channel shared https://xyproblem.info/ is a genui [16:47:17] s [16:47:51] I have kept seeing that pattern over and over and over in my whole career [16:50:22] +1 [16:50:42] very common in IRC support [17:06:41] (03CR) 10Novem Linguae: jjb: [catalyst-daily-PageTriage] Add PageTriage job (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/1318803 (https://phabricator.wikimedia.org/T433085) (owner: 10Vaughn Walters) [17:09:36] 06Project-Admins, 06Release-Engineering-Team (Doing 😎): Add pwangai in acl*Project-Admins to create Milestones in Test Platform - https://phabricator.wikimedia.org/T433515#12168579 (10Aklapper) 05Open→03Resolved a:03Aklapper @pwangai: Here you go! Standard disclaimer from T706 where such requests oft... [17:11:24] (03CR) 10Vaughn Walters: jjb: [catalyst-daily-PageTriage] Add PageTriage job (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/1318803 (https://phabricator.wikimedia.org/T433085) (owner: 10Vaughn Walters) [17:13:29] (03CR) 10Novem Linguae: jjb: [catalyst-daily-PageTriage] Add PageTriage job (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/1318803 (https://phabricator.wikimedia.org/T433085) (owner: 10Vaughn Walters) [17:15:28] (03CR) 10Vaughn Walters: jjb: [catalyst-daily-PageTriage] Add PageTriage job (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/1318803 (https://phabricator.wikimedia.org/T433085) (owner: 10Vaughn Walters) [17:16:16] (03PS4) 10Aude: zuul: Add ReadingLists to extension-gate [integration/config] - 10https://gerrit.wikimedia.org/r/1184176 (https://phabricator.wikimedia.org/T403560) [17:23:58] (03PS3) 10Vaughn Walters: jjb: [catalyst-daily-CentralNotice] Add CentralNotice job [integration/config] - 10https://gerrit.wikimedia.org/r/1312592 (https://phabricator.wikimedia.org/T427006) [17:23:58] (03CR) 10Vaughn Walters: "This is ready for review. Note that merging it is still dependent on 1312579 though." [integration/config] - 10https://gerrit.wikimedia.org/r/1312592 (https://phabricator.wikimedia.org/T427006) (owner: 10Vaughn Walters) [17:24:49] (03CR) 10CI reject: [V:04-1] jjb: [catalyst-daily-CentralNotice] Add CentralNotice job [integration/config] - 10https://gerrit.wikimedia.org/r/1312592 (https://phabricator.wikimedia.org/T427006) (owner: 10Vaughn Walters) [17:25:11] (03PS4) 10Vaughn Walters: jjb: [catalyst-daily-CentralNotice] Add CentralNotice job [integration/config] - 10https://gerrit.wikimedia.org/r/1312592 (https://phabricator.wikimedia.org/T427006) [17:26:20] (03PS5) 10Vaughn Walters: jjb: [catalyst-daily-CentralNotice] Add CentralNotice job [integration/config] - 10https://gerrit.wikimedia.org/r/1312592 (https://phabricator.wikimedia.org/T427006) [17:28:03] (03CR) 10CI reject: [V:04-1] jjb: [catalyst-daily-CentralNotice] Add CentralNotice job [integration/config] - 10https://gerrit.wikimedia.org/r/1312592 (https://phabricator.wikimedia.org/T427006) (owner: 10Vaughn Walters) [17:31:57] 10Beta-Cluster-Infrastructure, 06Traffic: Puppet agent failure detected on instance deployment-urldownloader04 in project deployment-prep - https://phabricator.wikimedia.org/T433510#12168675 (10bd808) `lang=shell-session,counterexample bd808@deployment-urldownloader04:~$ sudo -i puppet agent -tv Info: Using en... [17:32:20] 10Beta-Cluster-Infrastructure, 06Traffic: Puppet agent failure detected on instance deployment-urldownloader04 in project deployment-prep - https://phabricator.wikimedia.org/T433510#12168680 (10bd808) [17:34:43] Yippee, build fixed! [17:34:44] Project mediawiki-core-doxygen build #21905: 09FIXED in 16 min: https://integration.wikimedia.org/ci/job/mediawiki-core-doxygen/21905/ [17:55:34] (03update) 10dancy: Dockerfile: Declare VOLUME for buildkit's state directory [repos/releng/buildkit] (wmf/build) - 10https://gitlab.wikimedia.org/repos/releng/buildkit/-/merge_requests/82 (https://phabricator.wikimedia.org/T433505) [17:55:39] (03open) 10dancy: Dockerfile: Declare VOLUME for buildkit's state directory [repos/releng/buildkit] (wmf/build) - 10https://gitlab.wikimedia.org/repos/releng/buildkit/-/merge_requests/82 (https://phabricator.wikimedia.org/T433505) [18:00:21] (03update) 10dancy: Dockerfile: Declare VOLUME for buildkit's state directory [repos/releng/buildkit] (wmf/build) - 10https://gitlab.wikimedia.org/repos/releng/buildkit/-/merge_requests/82 (https://phabricator.wikimedia.org/T433505) [18:04:57] (03merge) 10dancy: Dockerfile: Declare VOLUME for buildkit's state directory [repos/releng/buildkit] (wmf/build) - 10https://gitlab.wikimedia.org/repos/releng/buildkit/-/merge_requests/82 (https://phabricator.wikimedia.org/T433505) [18:09:43] 10Beta-Cluster-Infrastructure, 06Traffic: Puppet agent failure detected on instance deployment-urldownloader04 in project deployment-prep - https://phabricator.wikimedia.org/T433510#12168754 (10bd808) https://gerrit.wikimedia.org/r/plugins/gitiles/cloud/instance-puppet/+/639532e722ab8c72d172217972913e3096f856a... [18:13:07] 10Beta-Cluster-Infrastructure, 06Traffic: Puppet agent failure detected on instance deployment-urldownloader04 in project deployment-prep - https://phabricator.wikimedia.org/T433510#12168761 (10Dzahn) Left a comment on https://gerrit.wikimedia.org/r/c/operations/puppet/+/1319102 - that looks indeed like the cu... [18:15:59] 10Beta-Cluster-Infrastructure, 06Traffic: Puppet agent failure detected on instance deployment-urldownloader04 in project deployment-prep - https://phabricator.wikimedia.org/T433510#12168768 (10bd808) https://gerrit.wikimedia.org/r/plugins/gitiles/cloud/instance-puppet/+/c6da354cddb150ee9b6fe1232e2c2b94b333b92... [18:21:25] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 06collaboration-services, 13Patch-For-Review: setup 2 contint machines for jenkins - https://phabricator.wikimedia.org/T418521#12168793 (10Dzahn) To me this was truly the final step in resolving this ticket: The jenkins package has b... [18:22:07] 10Continuous-Integration-Infrastructure, 07Jenkins, 06collaboration-services: Update Jenkins hosts from Java 17 to Java 21 - https://phabricator.wikimedia.org/T418109#12168797 (10Dzahn) Today the jenkins package has finally been purged from contint1002/contint2002. So there is no more jenkins on bullseye... [18:24:03] RESOLVED: PuppetAgentFailure: Puppet agent failure detected on instance deployment-urldownloader04 in project deployment-prep - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentFailure [18:33:26] !log Buildkit v0.32.0 deployed to gitlab-cloud-runners staging and production (T433520) [18:33:29] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [18:33:29] T433520: Buildkit v0.32.0 released - https://phabricator.wikimedia.org/T433520 [18:33:46] 10GitLab (CI & Job Runners), 06Release-Engineering-Team, 07Essential-Work: Buildkit v0.32.0 released - https://phabricator.wikimedia.org/T433520#12168853 (10dancy) [18:34:16] 10Beta-Cluster-Infrastructure, 06Traffic: Puppet agent failure detected on instance deployment-urldownloader04 in project deployment-prep - https://phabricator.wikimedia.org/T433510#12168854 (10Dzahn) >>! In T433510#12168768, @bd808 wrote: > What is a reasonably test to see if the node is still working as expe... [18:36:14] (03open) 10dancy: Bump buildkitd to v0.32.2 [auto-deploy] [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/623 (https://phabricator.wikimedia.org/T433520) [18:37:06] (03update) 10dancy: Bump buildkitd to v0.32.0 [auto-deploy] [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/623 (https://phabricator.wikimedia.org/T433520) [18:37:10] (03update) 10dancy: Bump buildkitd to v0.32.0 [auto-deploy] [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/623 (https://phabricator.wikimedia.org/T433520) [18:38:17] (03merge) 10dancy: Bump buildkitd to v0.32.0 [auto-deploy] [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/623 (https://phabricator.wikimedia.org/T433520) [18:54:59] 06Release-Engineering-Team (Priority Backlog 📥), 07Essential-Work, 05Release, 05Train Deployments: 1.47.0-wmf.13 deployment blockers - https://phabricator.wikimedia.org/T430832#12168904 (10Ottomata) [20:01:00] 10GitLab (CI & Job Runners), 06Release-Engineering-Team, 07Essential-Work: Buildkit v0.32.0 released - https://phabricator.wikimedia.org/T433520#12169126 (10dancy) a:03dancy [20:05:49] 10GitLab (CI & Job Runners), 13Patch-For-Review: gitlab-runners: WMCS fleet became ~6.5x slower at BuildKit filesystem operations overnight on 8/9 July 2026 - https://phabricator.wikimedia.org/T433505#12169148 (10dancy) @Jdforrester-WMF Please try going back to wmcs runners and let me know how it goes. [20:12:19] 10GitLab (CI & Job Runners), 13Patch-For-Review: gitlab-runners: WMCS fleet became ~6.5x slower at BuildKit filesystem operations overnight on 8/9 July 2026 - https://phabricator.wikimedia.org/T433505#12169161 (10dancy) Mention: T429988 [20:25:50] 10Beta-Cluster-Infrastructure, 06Traffic: Puppet agent failure detected on instance deployment-urldownloader04 in project deployment-prep - https://phabricator.wikimedia.org/T433510#12169216 (10bd808) 05Open→03Resolved a:03bd808 `lang=shell-session root@deployment-mediawiki14:~# curl --proxy http://d... [20:28:38] 06Project-Admins: Create project tag for - https://phabricator.wikimedia.org/T433540 (10BrokenBuilder) 03NEW [20:32:56] (03update) 10ejegg: Update fundraising ML image to use WSGI [repos/releng/dev-images] - 10https://gitlab.wikimedia.org/repos/releng/dev-images/-/merge_requests/109 [20:35:45] (03update) 10ejegg: Update fundraising ML image to use WSGI [repos/releng/dev-images] - 10https://gitlab.wikimedia.org/repos/releng/dev-images/-/merge_requests/109 [20:40:20] (03approved) 10ejegg: fundraising: Fix broken Depends reference [repos/releng/dev-images] - 10https://gitlab.wikimedia.org/repos/releng/dev-images/-/merge_requests/112 (owner: 10krinkle) [20:41:23] 10GitLab (CI & Job Runners), 06Release-Engineering-Team, 07Essential-Work: Buildkit v0.32.0 released - https://phabricator.wikimedia.org/T433520#12169291 (10dancy) 05Open→03Resolved [20:42:46] (03PS3) 10Vaughn Walters: jjb: [catalyst-daily-PageTriage] Add PageTriage job [integration/config] - 10https://gerrit.wikimedia.org/r/1318803 (https://phabricator.wikimedia.org/T433085) [20:48:17] 06Project-Admins: Create project tag for Pride extension - https://phabricator.wikimedia.org/T433540#12169307 (10Nemoralis) [21:00:57] 10Beta-Cluster-Infrastructure: Last Puppet run was over 24 hours ago on instance deployment-docker-mobileapps02 in project deployment-prep - https://phabricator.wikimedia.org/T433496#12169376 (10bd808) `lang=shell-session,counterexample bd808@deployment-docker-mobileapps02:~$ sudo -i puppet agent -tv Error: No s... [21:07:03] (03PS1) 10Vaughn Walters: jjb: [catalyst-daily-TemplateData] Add TemplateData job [integration/config] - 10https://gerrit.wikimedia.org/r/1319173 (https://phabricator.wikimedia.org/T433091) [21:07:03] (03CR) 10Vaughn Walters: "This is ready for review." [integration/config] - 10https://gerrit.wikimedia.org/r/1319173 (https://phabricator.wikimedia.org/T433091) (owner: 10Vaughn Walters) [21:08:26] (03CR) 10Vaughn Walters: "This is ready for review. Dependencies have been merged now." [integration/config] - 10https://gerrit.wikimedia.org/r/1318803 (https://phabricator.wikimedia.org/T433085) (owner: 10Vaughn Walters) [21:24:07] (03approved) 10damilare: Update fundraising ML image to use WSGI [repos/releng/dev-images] - 10https://gitlab.wikimedia.org/repos/releng/dev-images/-/merge_requests/109 (owner: 10ejegg) [21:24:19] (03merge) 10damilare: Update fundraising ML image to use WSGI [repos/releng/dev-images] - 10https://gitlab.wikimedia.org/repos/releng/dev-images/-/merge_requests/109 (owner: 10ejegg) [21:30:26] hi releng folks, I think maybe we jumped the gun on that merge [21:30:29] ^^^ [21:30:37] I mean, it's a perfectly fine MR [21:30:51] I just remember someone telling me not to merge without publishing [21:31:06] and I'm still not sure if I can publish images to the docker repo [21:31:41] so anyway, if anyone is available to publish that and get the docker repo back in sync with the git repo that would be great! [21:31:49] ejegg: I can do that for you [21:31:55] 10Beta-Cluster-Infrastructure: Last Puppet run was over 24 hours ago on instance deployment-docker-mobileapps02 in project deployment-prep - https://phabricator.wikimedia.org/T433496#12169495 (10bd808) `lang=shell-session bd808@deployment-docker-mobileapps02:~$ sudo du -sh /var/log/* | sort -h | tail -5 62M... [21:33:18] !log Updating development images on contint primary for https://gitlab.wikimedia.org/repos/releng/dev-images/-/merge_requests/109 [21:33:19] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [21:37:13] thank you dancy ! [21:40:48] ejegg: Successfully published image docker-registry.discovery.wmnet/dev/fundraising-ml-trixie:1.1.0 [21:41:03] rockin! [21:44:15] 10Beta-Cluster-Infrastructure: Last Puppet run was over 24 hours ago on instance deployment-docker-mobileapps02 in project deployment-prep - https://phabricator.wikimedia.org/T433496#12169517 (10bd808) Let's try turning the log level waaaay down. https://gerrit.wikimedia.org/r/plugins/gitiles/cloud/instance-pupp... [21:54:39] 06Project-Admins: Create project tag for Pride extension - https://phabricator.wikimedia.org/T433540#12169521 (10Peachey88) 05Open→03Resolved a:03Peachey88 Requested project #mediawiki-extensions-pride has been created, Source repo can be updated once the gerrit repo is created :) [22:13:03] RESOLVED: PuppetAgentStaleLastRun: Last Puppet run was over 24 hours ago on instance deployment-docker-mobileapps02 in project deployment-prep - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentStaleLastRun