[06:49:02] hey, does anyone here know why https://gerrit.wikimedia.org/r/plugins/gitiles/operations/puppet/+/236bca04c631da8bebca54baf4c9aaaef011ab4f doesn't seem to have applied to pdev-ppc.puppet-dev.eqiad1.wikimedia.cloud? normally I'd ask jbond but he's not around atm, and I'd like to get rid of the legacy endpoint where it's the last client using that [08:07:26] 10netops, 10Infrastructure-Foundations, 10SRE: Cannot verify NTP status asw1-b12-drmrs - https://phabricator.wikimedia.org/T305840 (10ayounsi) I had a quick look as well, but didn't make any progress. I tried to bounce NTP with: `lang=diff [edit system] + processes { + ntp disable; + } ! inacti... [08:33:26] 10netbox, 10netops, 10DC-Ops, 10Infrastructure-Foundations: Avoid ghost hosts on the network - https://phabricator.wikimedia.org/T306007 (10ayounsi) p:05Triage→03Low [09:19:39] taavi: AFAICT the config in the host's /etc/puppet/puppet.conf has: [09:19:42] server = puppetmaster.cloudinfra.wmflabs.org [09:19:50] and that comes from hieradata [09:19:51] puppetmaster: "puppetmaster.cloudinfra.wmflabs.org" [09:19:56] in hieradata/cloud/eqiad1.yaml [09:21:21] volans: no, I'm talking about the custom enc endpoint - usually it's configured in /etc/puppet/hiera.yaml but this VM does not seem to have that file somehow [09:23:38] have you checked in horizon if it has any particular config there? [09:24:33] I don't see anything that should affect hiera lookups [09:26:09] what's its hiera_config value? [09:27:40] it should be using the default value unless I'm missing something [09:27:42] from role::puppetmaster::standalone it seems that hiera_config is passed to the puppetmaster class that is the one creating /etc/puppet/hiera.yaml [13:22:29] 10netops, 10Infrastructure-Foundations, 10SRE: Unify loopback filters between CR routers and L3 switches - https://phabricator.wikimedia.org/T304553 (10cmooney) 05Open→03Resolved [15:32:35] 10netops, 10DC-Ops, 10Infrastructure-Foundations, 10SRE, and 2 others: Q3:(Need By: TBD) rack/setup/install 2 new labstore hosts - https://phabricator.wikimedia.org/T302981 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by cmjohnson@cumin1001 for host cloudstore1010.wikimedia.org w... [15:34:10] 10CAS-SSO, 10Data-Catalog, 10Data-Engineering, 10Infrastructure-Foundations: Switch DataHub authentication to OIDC - https://phabricator.wikimedia.org/T305874 (10BTullis) [15:40:33] 10netops, 10DC-Ops, 10Infrastructure-Foundations, 10SRE, and 2 others: Q3:(Need By: TBD) rack/setup/install 2 new labstore hosts - https://phabricator.wikimedia.org/T302981 (10Cmjohnson) @volans @Papaul I get this during the install. This requires a manual entry [ (1*installer) 2 shell 3 sh... [15:45:31] 10netops, 10DC-Ops, 10Infrastructure-Foundations, 10SRE, and 2 others: Q3:(Need By: TBD) rack/setup/install 2 new labstore hosts - https://phabricator.wikimedia.org/T302981 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by cmjohnson@cumin1001 for host cloudstore1010.wikimedia.org with... [15:57:32] 10netops, 10DC-Ops, 10Infrastructure-Foundations, 10SRE, and 2 others: Q3:(Need By: TBD) rack/setup/install 2 new labstore hosts - https://phabricator.wikimedia.org/T302981 (10Cmjohnson) a:05Cmjohnson→03nskaggs These servers fail partman, it appears that the installer is looking for an answer that is n... [18:21:08] 10netbox, 10netops, 10DC-Ops, 10Infrastructure-Foundations: Avoid ghost hosts on the network - https://phabricator.wikimedia.org/T306007 (10cmooney) The other alternative is that we poll the box for its interfaces and actively disable any that are on the device but not mentioned in Netbox. I messed about... [18:58:56] 10SRE-tools, 10Infrastructure-Foundations, 10SRE, 10tox-wikimedia, and 2 others: Introduce Python code formatters usage - https://phabricator.wikimedia.org/T211750 (10jhathaway) Our we ready to consider running black on our puppet repo? [19:00:31] 10Mail, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review: Exim emitting warnings about tainted filenames - https://phabricator.wikimedia.org/T305962 (10jhathaway) 05Open→03Resolved a:03jhathaway merged! [21:17:28] 10netops, 10DC-Ops, 10Infrastructure-Foundations, 10SRE, 10ops-ulsfo: (Need By: TBD) rack/setup/install new mr1-ulsfo - https://phabricator.wikimedia.org/T294314 (10RobH) [21:21:33] 10netops, 10DC-Ops, 10Infrastructure-Foundations, 10SRE, 10ops-ulsfo: (Need By: TBD) rack/setup/install new mr1-ulsfo - https://phabricator.wikimedia.org/T294314 (10RobH) a:05RobH→03ayounsi Arzhel, When we set this up, I recall you saying you didn't want to move the connections in netbox, and wanted... [21:47:55] 10SRE-tools, 10Infrastructure-Foundations, 10SRE, 10tox-wikimedia, and 2 others: Introduce Python code formatters usage - https://phabricator.wikimedia.org/T211750 (10Volans) >>! In T211750#7853334, @jhathaway wrote: > Our we ready to consider running black on our puppet repo? I'm not sure, personally I t...