[06:53:53] 06serviceops, 10envoy, 06SRE, 06Data-Platform-SRE (2025.10.17 - 2025.11.07), 07Essential-Work: Upgrade Envoy to v1.29.12 on wcqs and wdqs hosts - https://phabricator.wikimedia.org/T404867#11322129 (10Gehel) p:05Triage→03High [08:13:42] 06serviceops, 13Patch-For-Review: Migrate the etcd main cluster to cfssl-based PKI - https://phabricator.wikimedia.org/T352245#11322191 (10MoritzMuehlenhoff) >>! In T352245#11296077, @Scott_French wrote: > * I believe it makes sense to proceed similarly to the earlier switch for `profile::etcd::tlsproxy` - i.e... [09:53:02] 06serviceops, 10envoy, 06SRE, 06Data-Platform-SRE (2025.10.17 - 2025.11.07), 07Essential-Work: Upgrade Envoy to v1.29.12 on wcqs and wdqs hosts - https://phabricator.wikimedia.org/T404867#11322413 (10Gehel) a:03Gehel A quick read of the puppet repo indicates that we use envoy only through `include prof... [09:56:49] 06serviceops, 10envoy, 06SRE, 06Data-Platform-SRE (2025.10.17 - 2025.11.07), 07Essential-Work: Upgrade Envoy to v1.29.12 on wcqs and wdqs hosts - https://phabricator.wikimedia.org/T404867#11322431 (10MoritzMuehlenhoff) >>! In T404867#11322413, @Gehel wrote: > A quick read of the puppet repo indicates tha... [09:57:29] 06serviceops, 10envoy, 06SRE, 06Data-Platform-SRE (2025.10.17 - 2025.11.07), 07Essential-Work: Upgrade Envoy to v1.32.12 on wcqs and wdqs hosts - https://phabricator.wikimedia.org/T404867#11322433 (10MoritzMuehlenhoff) [13:37:25] 06serviceops, 10envoy, 06SRE, 06Data-Platform-SRE (2025.10.17 - 2025.11.07), 07Essential-Work: Upgrade Envoy to v1.32.12 on wcqs and wdqs hosts - https://phabricator.wikimedia.org/T404867#11323077 (10Gehel) Tested on wdqs2025 (our usual test node): ` gehel@wdqs2025:~$ sudo apt install -y envoyproxy=1.32... [13:47:07] 06serviceops, 10envoy, 06SRE, 06Data-Platform-SRE (2025.10.17 - 2025.11.07), 07Essential-Work: Upgrade Envoy to v1.32.12 on wcqs and wdqs hosts - https://phabricator.wikimedia.org/T404867#11323092 (10Gehel) 05Open→03Resolved [13:50:56] 06serviceops, 10envoy, 06SRE, 06Data-Platform-SRE (2025.10.17 - 2025.11.07), 07Essential-Work: Upgrade Envoy to v1.32.12 on wcqs and wdqs hosts - https://phabricator.wikimedia.org/T404867#11323106 (10Gehel) Manual test works. [[ https://grafana.wikimedia.org/goto/dU16ulgDg?orgId=1 | Graphs ]] still l... [15:16:20] running "helmfile -i diff" in the deployment-charts checkout on deploy2002 prints the following error, known issue? [15:16:21] in ./helmfile.yaml: error during ../global.yaml.part.0 parsing: template: stringTemplate:1:49: executing "stringTemplate" at <.Values.kubernetesVersion>: map has no entry for key "kubernetesVersion" [15:26:13] moritzm: which service? [15:29:16] /srvd/deployment-charts/helmfile.d/services/proton [15:29:20] /srv/deployment-charts/helmfile.d/services/proton actually [15:32:26] thanks, looking [15:34:58] it's due to a hack of mine and I'm working on a proper fix, but I'll fix it improperly for the time being [15:37:30] no rush, this doesn't block me, I can just as well wait for a proper fix [15:45:01] moritzm: I think you're just missing the '-e ENVIRONMENT' flag [15:45:28] like in 'helmfile -e staging diff' [15:45:41] (-i does not make sense on diff, not sure if it's accepted) [15:47:01] oh right, indeed. sorry for the noise [15:55:14] oh, that'd do it! [15:55:26] * Raine is apparently not particularly focused today [15:55:35] that error is not a helpful one though [15:55:58] I'm not sure how to get helmfile to produce a better error though [15:57:38] thatstheneatpart.gif [17:57:11] 06serviceops, 13Patch-For-Review: MediaWiki on PHP 8.3 production workload migration - https://phabricator.wikimedia.org/T405955#11324543 (10Scott_French) As of 17:30 - 17:45 UTC we're enrolling 25% of eligible cookie-enabled external clients and serving 10% of mw-api-int / mw-jobrunner traffic on PHP 8.3. Thi... [17:57:42] 06serviceops, 13Patch-For-Review: MediaWiki on PHP 8.3 production workload migration - https://phabricator.wikimedia.org/T405955#11324547 (10Scott_French) [19:32:39] 06serviceops, 10MW-on-K8s: Support shell to mw-experimental pod - https://phabricator.wikimedia.org/T405688#11324923 (10Krinkle) >>! In T405688#11302125, @jijiki wrote: > @Krinkle Please have a go running P84273 on the deployment host, and let me know if it helps This is great. I've used it several times alre... [21:15:03] 06serviceops, 06DC-Ops, 10ops-eqiad, 06SRE: Q2:rack/setup/install wikikube-worker11XX - https://phabricator.wikimedia.org/T408749 (10Jhancock.wm) 03NEW [21:16:42] 06serviceops, 06DC-Ops, 10ops-eqiad, 06SRE: Q2:rack/setup/install wikikube-worker11XX - https://phabricator.wikimedia.org/T408749#11325280 (10Jhancock.wm) @Clement_Goubert could you (or someone on your team) please fill out the Hostname/racking details section and update the puppet files if needed? Thank you! [21:17:05] 06serviceops, 06DC-Ops, 10ops-eqiad, 06SRE: Q2:rack/setup/install wikikube-worker11XX - https://phabricator.wikimedia.org/T408749#11325282 (10Jhancock.wm) [21:38:02] 06serviceops, 06DC-Ops, 10ops-eqiad, 06SRE: Q2:rack/setup/install wikikube-worker1335-59 - https://phabricator.wikimedia.org/T408752 (10Jhancock.wm) 03NEW