[07:01:28] 10serviceops, 10DBA, 10Data-Engineering, 10Discovery-Search, and 9 others: codfw row D switches upgrade - https://phabricator.wikimedia.org/T335042 (10Marostegui) [07:02:01] 10serviceops, 10DBA, 10Data-Engineering, 10Discovery-Search, and 9 others: codfw row D switches upgrade - https://phabricator.wikimedia.org/T335042 (10Marostegui) @jcrespo kindly check what is needed for backup involved hosts, thanks! [07:29:34] 10serviceops, 10DBA, 10Data-Engineering, 10Discovery-Search, and 9 others: codfw row D switches upgrade - https://phabricator.wikimedia.org/T335042 (10jcrespo) [07:30:41] 10serviceops, 10DBA, 10Data-Engineering, 10Discovery-Search, and 9 others: codfw row D switches upgrade - https://phabricator.wikimedia.org/T335042 (10jcrespo) >>! In T335042#8795210, @Marostegui wrote: > @jcrespo kindly check what is needed for backup involved hosts, thanks! Done. [08:59:32] heads up: I'm pushing a new version of helm-linter based on bullseye [08:59:49] I will rollback if I find issues [09:00:01] jayme: ^^ In particular [09:00:30] thanks. Any specific reason? [09:00:37] (apart from OS upgrade) [09:00:45] python 3.9 [09:01:00] so that sextant can work without me adding 3.7 compats :P [09:01:08] if that fails, I'll do that [09:01:15] ah, that makes sense [09:01:20] if this fails, moving to bullseye [09:01:48] after the update, I think my scaffolding patch is almost final, I found a way to run fixtures and found a few bugs already [09:03:09] we can add other stuff to the model/modules later, like a component to define cronjobs, one for daemonsets... [09:03:45] btw we should clean up fixtures in the repo [09:03:49] They're all over the place [09:03:51] nice! I wasn't sure if you'd already collect feedback for it but it seems like you do [09:04:15] might be I just forgot that you asked for it..sorry :/ [09:32:34] elukey: why does rake require istioctl 1.9.5 specifically? [09:32:43] and otoh on bullseye we have 1.15 [09:32:50] 10serviceops, 10SRE, 10CommRel-Specialists-Support (Apr-Jun-2023), 10Datacenter-Switchover, 10User-notice: CommRel support for April 2023 Datacenter Switchback - https://phabricator.wikimedia.org/T334671 (10Clement_Goubert) [09:33:27] 10serviceops, 10SRE, 10Datacenter-Switchover: March 2023 Datacenter Switchover SRE-side Communication - https://phabricator.wikimedia.org/T329042 (10Clement_Goubert) [09:33:41] joe: mmm I don't recall to have done it, but maybe it was for linting the custom.d configs? And yes now we use 1.15.7 [09:33:48] ok [09:34:18] so we should definitely move to 1.15.7 right? [09:35:47] yep yep all clusters are on it [09:39:10] ok, can I ask you to review https://gerrit.wikimedia.org/r/c/operations/deployment-charts/+/910431 then? [09:41:58] the -1 from ci is because I was waiting before switching [09:42:18] 10serviceops, 10SRE, 10Datacenter-Switchover: March 2023 Datacenter Switchover SRE-side Communication - https://phabricator.wikimedia.org/T329042 (10Clement_Goubert) [09:45:13] joe: I've +1ed [09:45:23] yeah saw it, thanks [09:45:33] I'll merge as soon as the zuul patch goes through [09:45:47] oh..maybe that is not even in the helm-linter image [09:47:01] wdym? [09:47:04] it is [09:47:12] just the wrong version with the old image [09:47:39] ah, yeah. I was thinking we added a different apt component for it [10:11:48] uhm not sure what's going on, my recheck is stuck in the queue since 7 minutes [10:11:57] sorry, in execution [10:13:03] finally worked [10:13:17] but might this has to do with moving to bullseye? [10:22:17] yeah definitely looks like it [10:22:37] it takes 3 minutes on my 6 yrs old desktop [10:34:32] looks like we'll have to implement some optimizations [15:40:13] 10serviceops, 10Infrastructure-Foundations, 10WikimediaDebug, 10Performance-Team (Radar): Upgrade php-excimer package from 1.0.4 to 1.1.1 - https://phabricator.wikimedia.org/T332964 (10MoritzMuehlenhoff) I've built packages which are initially available under https://people.wikimedia.org/~jmm/excimer/. T... [17:17:23] 10serviceops, 10DC-Ops, 10SRE, 10ops-codfw: hw troubleshooting: PSU failure for parse2010.codfw.wmnet - https://phabricator.wikimedia.org/T335138 (10Aklapper) [17:48:00] 10serviceops, 10Infrastructure-Foundations, 10WikimediaDebug, 10Performance-Team (Radar): Upgrade php-excimer package from 1.0.4 to 1.1.1 - https://phabricator.wikimedia.org/T332964 (10Krinkle) a:03Krinkle [17:49:40] 10serviceops, 10Infrastructure-Foundations, 10WikimediaDebug, 10Performance-Team (Radar): Upgrade php-excimer package from 1.0.4 to 1.1.1 - https://phabricator.wikimedia.org/T332964 (10Krinkle) Thanks! To double check that I undertand where you're asking (I've not done this before for Debian packages) — I... [21:08:40] 10serviceops, 10SRE, 10CommRel-Specialists-Support (Apr-Jun-2023), 10Datacenter-Switchover, 10User-notice: CommRel support for April 2023 Datacenter Switchback - https://phabricator.wikimedia.org/T334671 (10sgrabarczuk)