[06:47:02] 10Mail, 10Data-Platform-SRE, 10Infrastructure-Foundations: kerberos manage_principals.py emails go to spam - https://phabricator.wikimedia.org/T318155 (10MoritzMuehlenhoff) Maybe a very quick fix with immediate impact is to simply move away from using the local hostname in the From: (Currently root@krb1001.... [08:40:06] hi all just an fyi i need to drop mel of at the airport so will be afk for a couple of hours from about 11:00 UTC [08:47:53] ack [09:07:37] Exciting news... A truck from my ISP has pulled a few streets down. I'm still not particularly hopeful [09:08:39] slyngs: now you can be sure your internet *will* go down shortly, you can't know if/when it will get back up :-P [09:09:38] I've been on a 4G modem for 12 days now, unless they drive their truck into the tower in the other end of town I think I'm safe [09:12:32] ahahahah [09:14:00] You might be right though, the same company delivers electricity... I guess they could cut that. They won't be delivering neither internet or power at the new house [10:11:49] 10netops, 10Infrastructure-Foundations, 10ops-codfw: Upgrade new codfw switches to Juniper recommended - https://phabricator.wikimedia.org/T341670 (10ayounsi) [10:24:17] 10SRE-tools, 10netops, 10Infrastructure-Foundations, 10SRE: Setup zero touch provisioning (ZTP) for network devices - https://phabricator.wikimedia.org/T336485 (10ayounsi) Could potentially help {T341670} [10:41:19] slyngs: volans: jhathaway: fyi puppetdb seems to have calmed down. i have cerated a follow up task with notes from my troublshooting here https://phabricator.wikimedia.org/T341674 [10:41:45] great, so no call needed today? [10:41:51] i dont think so [10:42:03] perfect [10:42:07] queue has been at 1 all morning [13:07:08] 10netops, 10Infrastructure-Foundations, 10SRE, 10ops-codfw: Upgrade new codfw switches to Juniper recommended - https://phabricator.wikimedia.org/T341670 (10Papaul) @ayounsi we can still factory reset them and do ZTP again. [14:04:27] topranks: moritzm: i wonder if its better to move our meeting to 14:30 (or now ish) as i just noticed the product and tech meeting has been schedualed for 15:00 [14:05:35] 14:30 works for me, best to avoid overlap with the product & tech one yeah [14:05:47] im good with that [14:07:50] is something I'm supposed to join too and I missed? [14:08:04] topranks, jbond: sounds good [14:08:41] volans: i dont hink so its about QoS marking in puppet, you are of course welcome im sure [14:08:51] volans: it's the rewrite-spicerack-in-perl meeting, but I can't tell you about it! [14:08:59] ahahahah [14:09:01] all yours then :D [14:09:07] :d lol [14:09:11] this new spicerack is gonna be amazing :D [14:09:23] will it be a one-liner? [14:09:36] CI will fail if it's more than a one-liner,yes [14:12:02] good! [15:07:39] 10CAS-SSO, 10Infrastructure-Foundations, 10SecTeam-Processed, 10Security: CVE-2022-22965: Spring Framework RCE via data binding - https://phabricator.wikimedia.org/T305371 (10sbassett) [15:37:07] slyngs: FYI I think https://wikitech.wikimedia.org/wiki/Ganeti#Create_a_VM still needs some updates for the reimage/makevm support you recently added [21:00:44] 10Puppet, 10Infrastructure-Foundations, 10Puppet CI, 10SRE, and 2 others: puppet master command will be removed in puppet 6 - https://phabricator.wikimedia.org/T236373 (10jbond) @hashar is there a way we can control which worker a pcc job will run on based on the some param we pass to the `operations-puppe...