[08:26:26] 10netops, 10Data-Services, 10Infrastructure-Foundations, 10Wikidata, and 5 others: Do not rate limit dumps from internal network - https://phabricator.wikimedia.org/T222349 (10Gehel) [09:00:09] I have been decommissioning ganeti5003, but the DNS sync step at the end of the decom cookbook failed on all DNS hosts with this error: [09:00:18] https://phabricator.wikimedia.org/P42717 [09:00:21] known issue? [09:02:45] moritzm: not known to me at least :) [09:04:48] so there is no 10.132.129.X in netbox so that makes sens in a way, looking [09:05:00] ack, thx [09:06:46] I think I know what's going on, not sure yet how to fix it though [09:09:00] for the decom cookbook, I'll simply tell it to skip that step and proceed, right? [09:10:14] moritzm: I'm sending a fix shortly [09:10:41] moritzm: but yes you can skip and we can take care of DNS later on [09:11:54] ack, thx [09:13:10] moritzm: https://gerrit.wikimedia.org/r/c/operations/dns/+/868620 [09:15:12] lgtm, +1d [09:17:36] moritzm: alright! can you re-try the dns cookbook? [09:18:19] ack, doing that now [09:21:19] sre.dns.netbox prompts nothing to commit [09:22:07] ok! I think we're all good now [09:23:15] ack, nice [09:35:58] yes, the change were pushed to the netbox repo but not deployed, when XioNoX has run the authdns-update that run has deployed both his manual change and the pushed netbox changes [09:36:03] just FYI :) [09:36:26] and yes we should re-evaluate how we export reverse zones from netbox [11:32:41] moritzm: I know you're working on the bookworm puppetdb, maybe it should not be part of A:puppetdb for now, as for example run-puppet-agent fails, but YMMV [11:39:59] it should have clean puppet runs by Monday, need to merge a patch first which unbreaks nginx [11:40:31] ack, just FYI, I was surprised by the failure, then noticed bookwork :D [20:44:48] 10Mail, 10Infrastructure-Foundations, 10SRE: Replace Exim with Postfix on mail servers - https://phabricator.wikimedia.org/T325394 (10jhathaway) [20:45:42] 10Mail, 10Infrastructure-Foundations, 10SRE: Puppetry - https://phabricator.wikimedia.org/T325395 (10jhathaway) [20:46:42] 10Mail, 10Infrastructure-Foundations, 10SRE: Postfix Module - https://phabricator.wikimedia.org/T325396 (10jhathaway) [20:47:45] 10Mail, 10Infrastructure-Foundations, 10SRE: Rspamd module - https://phabricator.wikimedia.org/T325397 (10jhathaway) [20:48:28] 10Mail, 10Infrastructure-Foundations, 10SRE: Postfix MTA Profile - https://phabricator.wikimedia.org/T325398 (10jhathaway) [21:05:34] 10Mail, 10Infrastructure-Foundations, 10SRE: Provision mta-inbound-infra - https://phabricator.wikimedia.org/T325401 (10jhathaway) [21:07:55] 10Mail, 10Infrastructure-Foundations, 10SRE: mta-outbound-infra - https://phabricator.wikimedia.org/T325402 (10jhathaway) [21:08:15] 10Mail, 10Infrastructure-Foundations, 10SRE: Provision mta-outbound-infra - https://phabricator.wikimedia.org/T325402 (10jhathaway) [21:10:51] 10Mail, 10Infrastructure-Foundations, 10SRE: MTA Provisioning - https://phabricator.wikimedia.org/T325403 (10jhathaway) [21:11:29] 10Mail, 10Infrastructure-Foundations, 10SRE: MTA Provisioning - https://phabricator.wikimedia.org/T325403 (10jhathaway) [21:11:31] 10Mail, 10Infrastructure-Foundations, 10SRE: Provision mta-inbound-infra - https://phabricator.wikimedia.org/T325401 (10jhathaway) [21:11:37] 10Mail, 10Infrastructure-Foundations, 10SRE: Replace Exim with Postfix on mail servers - https://phabricator.wikimedia.org/T325394 (10jhathaway) [21:11:43] 10Mail, 10Infrastructure-Foundations, 10SRE: Provision mta-outbound-infra - https://phabricator.wikimedia.org/T325402 (10jhathaway) [21:11:49] 10Mail, 10Infrastructure-Foundations, 10SRE: Replace Exim with Postfix on mail servers - https://phabricator.wikimedia.org/T325394 (10jhathaway) [21:11:55] 10Mail, 10Infrastructure-Foundations, 10SRE: MTA Provisioning - https://phabricator.wikimedia.org/T325403 (10jhathaway) [21:13:24] 10Mail, 10Infrastructure-Foundations, 10SRE: Provision mta-inbound-lists - https://phabricator.wikimedia.org/T325404 (10jhathaway) [21:14:15] 10Mail, 10Infrastructure-Foundations, 10SRE: Provision mta-outbound-lists - https://phabricator.wikimedia.org/T325405 (10jhathaway) [21:15:03] 10Mail, 10Infrastructure-Foundations, 10SRE: mta-inbound-wiki - https://phabricator.wikimedia.org/T325406 (10jhathaway) [21:15:37] 10Mail, 10Infrastructure-Foundations, 10SRE: mta-outbound-wiki - https://phabricator.wikimedia.org/T325407 (10jhathaway) [21:16:06] 10Mail, 10Infrastructure-Foundations, 10SRE: Provision mta-outbound-wiki - https://phabricator.wikimedia.org/T325407 (10jhathaway) [21:16:13] 10Mail, 10Infrastructure-Foundations, 10SRE: Provision mta-inbound-wiki - https://phabricator.wikimedia.org/T325406 (10jhathaway) [21:16:40] 10Mail, 10Infrastructure-Foundations, 10SRE: Replace Null client configs - https://phabricator.wikimedia.org/T325408 (10jhathaway) [21:17:13] 10Mail, 10Infrastructure-Foundations, 10SRE: Remove Exim based MTAs - https://phabricator.wikimedia.org/T325409 (10jhathaway) [21:30:28] 10Mail, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review: Postfix Module - https://phabricator.wikimedia.org/T325396 (10jhathaway) @jbond, happy to discuss any concerns you have with vendoring this module, either on this ticket or on gerrit. [22:52:42] 10SRE-tools, 10Infrastructure-Foundations, 10Patch-For-Review, 10cloud-services-team (Kanban): WMCS Cookbook Automation Q2 tracking task - https://phabricator.wikimedia.org/T319401 (10Volans)