[05:46:00] <wikibugs>	 10netops, 10Infrastructure-Foundations, 10Traffic: Test depool of drmrs - https://phabricator.wikimedia.org/T344968 (10ayounsi) p:05Triage→03High
[06:59:45] <wikibugs>	 10SRE-tools, 10Infrastructure-Foundations, 10SRE: sre.ganeti.makevm: Create machine types - https://phabricator.wikimedia.org/T344972 (10MoritzMuehlenhoff)
[07:00:04] <wikibugs>	 10SRE-tools, 10Infrastructure-Foundations, 10SRE: sre.ganeti.makevm: Create machine types - https://phabricator.wikimedia.org/T344972 (10MoritzMuehlenhoff) p:05Triage→03Medium a:03MoritzMuehlenhoff
[08:45:55] <wikibugs>	 10netops, 10Infrastructure-Foundations, 10SRE, 10Traffic: Test depool of drmrs - https://phabricator.wikimedia.org/T344968 (10Joe) A couple things: first of all, the recent issues with repooling esams were mostly due to the insufficient caching in its backend, even more than starting with a completely cold...
[08:57:38] <wikibugs>	 10netops, 10Infrastructure-Foundations, 10SRE, 10Traffic: Test depool of drmrs - https://phabricator.wikimedia.org/T344968 (10KOfori) @Joe certainly not now with all the trouble but at some point when things have stabilized, we should do it.
[09:30:33] <moritzm>	 is there some known issue with puppetdb? got the following traceback when installing a new VM: https://phabricator.wikimedia.org/P51431
[10:03:16] <wikibugs>	 10CAS-SSO, 10Data-Platform-SRE, 10Infrastructure-Foundations: Switch DataHub authentication to OIDC - https://phabricator.wikimedia.org/T305874 (10jbond) @Stevemunene @BTullis great work on the progress you have made and sorry for my silence.  Just want to say +1 to using option 1.  the id value you have the...
[10:09:26] <jbond>	 moritzm: hmm possibly i made a chnage yesterday let me take a look
[10:11:19] <moritzm>	 it might have been just a little lagged, the record appeared later
[10:11:31] <jbond>	 no i see in the logs you got a 500
[10:11:36] <moritzm>	 and I ran puppet manually over the instal_console to complete
[10:11:51] <moritzm>	 ok
[10:26:42] <jbond>	 moritzm: i have deployed a hopfull fiux, just poping out for a walk but will check with a full reimage when back
[10:27:20] <moritzm>	 cheers!
[12:05:30] <jbond>	 moritzm: just to confirm looks fixed now
[12:06:10] <moritzm>	 excellent, thanks :-)
[12:07:11] <jbond>	 np
[13:19:20] <wikibugs>	 10Puppet, 10netbox, 10Infrastructure-Foundations, 10SRE, and 3 others: Netbox: use the netbox to  also sync networks and network devices - https://phabricator.wikimedia.org/T329272 (10jbond)
[13:44:15] <wikibugs>	 10SRE-tools, 10Cloud-VPS, 10Infrastructure-Foundations, 10Goal, and 2 others: cloudcumin: decide sudoers rules for users without global root - https://phabricator.wikimedia.org/T325067 (10fnegri) I created a patch to propose a specific solution for this task: https://gerrit.wikimedia.org/r/952448  Before m...
[14:18:54] <jinxer-wm>	 (SystemdUnitFailed) firing: netbox_report_accounting_run.service Failed on netbox1002:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed
[14:48:54] <jinxer-wm>	 (SystemdUnitFailed) resolved: netbox_report_accounting_run.service Failed on netbox1002:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed