[09:13:20] 10netops, 10Infrastructure-Foundations: Can't commit on asw-b-codfw - https://phabricator.wikimedia.org/T295118 (10ayounsi) p:05Triage→03High [09:13:29] fun times https://phabricator.wikimedia.org/T295118 [09:14:45] 10netops, 10Infrastructure-Foundations: Can't commit on asw-b-codfw - https://phabricator.wikimedia.org/T295118 (10ayounsi) [09:15:26] volans|off: got the email too, thx! Love the name "The Art of the Possible" [12:22:22] moritzm, jbond, https://gerrit.wikimedia.org/r/c/operations/puppet/+/737020 [12:23:20] +1 [12:23:24] XioNoX: [12:23:27] thx! [12:24:46] but the syntax is wrong [12:24:52] this will cause a ferm run time failure I think [12:25:03] had just followed up on the patch [12:25:31] PCC doesn't catch these kinds of errors since the ferm define is only evaluated on the reload [12:25:58] moritzm: thx, fixing [12:27:00] moritzm: https://gerrit.wikimedia.org/r/c/operations/puppet/+/737023 [12:27:49] and +1d :-) [12:28:50] 10CAS-SSO, 10Infrastructure-Foundations, 10SRE, 10User-jbond: Document IDP MFA policy and processes - https://phabricator.wikimedia.org/T284725 (10MoritzMuehlenhoff) 05Open→03In progress [12:29:06] moritzm: weird, I don't see any error on the puppet run and ferm seems fine (but not updated) on install1003 [12:29:46] I'm pretty the sure the old format would break, this has been an issue in the past [12:29:59] but the revised format works as expected now? [12:30:24] moritzm: I don't see the new rules installed [12:30:40] but no clear signs off brekage [12:31:09] moritzm: nevermind :) CRITICAL - degraded: The following units failed: ferm.service [12:31:10] in a meeting now, can have a look at 1003 in a bit [12:31:14] ok [13:33:00] https://github.com/netbox-community/netbox/releases/tag/v3.1-beta1 [14:03:10] 10CAS-SSO, 10netbox, 10Infrastructure-Foundations, 10User-jbond: investigate netbox loging issues - https://phabricator.wikimedia.org/T295148 (10jbond) p:05Triage→03Medium [14:41:37] 10Puppet, 10Cloud-VPS, 10Infrastructure-Foundations, 10User-dcaro, 10cloud-services-team (Kanban): Investigate use of Puppet "environments" for per-project Puppet manifests - https://phabricator.wikimedia.org/T170370 (10dcaro) [14:41:56] 10puppet-compiler, 10Infrastructure-Foundations, 10User-dcaro: PCC Improve dev environment - https://phabricator.wikimedia.org/T294624 (10dcaro) 05Open→03Resolved [19:57:02] 10netops, 10Infrastructure-Foundations, 10SRE: Move management routers ssh port - https://phabricator.wikimedia.org/T277438 (10RobH)