[08:00:21] <dcaro>	 morning!
[08:04:13] <taavi>	 o/
[08:22:47] <godog>	 greetings
[08:44:44] <Reedy>	 taavi: Any chance you could help further with the person that has broken toolforge with their SSH key
[09:20:13] <dcaro>	 I poked slyngs and moritz on the ticket (T360488), they might be able to help with the idm/ldap side of things
[09:20:14] <stashbot>	 T360488: Missing Perl packages on dev.toolforge.org for anomiebot workflows - https://phabricator.wikimedia.org/T360488
[09:20:20] <dcaro>	 oops, wrong ticket
[09:20:31] <dcaro>	 T401318
[09:20:32] <stashbot>	 T401318: 500 Internal Server Error when trying to access ssh keys on toolsadmin - https://phabricator.wikimedia.org/T401318
[09:21:06] <slyngs>	 dcaro: I'll take a look. Thanks
[09:21:13] <dcaro>	 thanks!
[09:21:24] <taavi>	 Reedy: will be half an hour until I'm back in front of a computer, but I can certainly remove the broken key from ldap which should let them add a working one back
[09:22:13] <Reedy>	 Cheers. Yeah, that would be good to start with
[09:52:51] <taavi>	 Reedy: https://phabricator.wikimedia.org/T401318#11067587
[10:23:37] <dcaro>	 thanks taavi !
[14:55:35] <andrewbogott>	 dcaro: is https://phabricator.wikimedia.org/T348662 the proper bug for tracking "we restart nfs workers pretty often" or is there a better one?  I updated the description on that bug to try to make it a bit broader...
[14:56:01] <dcaro>	 yep, that's the one 👍
[14:56:48] <andrewbogott>	 great
[14:57:25] <godog>	 speaking of which, where is said 'nfs is stuck' alert defined ? I couldn't find it from a quick grep in alerts.git or puppet.git
[14:59:11] <dcaro>	 godog: that's in the metricsinfra DB I think
[14:59:30] <dcaro>	 https://wikitech.wikimedia.org/wiki/Help:Cloud_VPS_managed_monitoring
[14:59:33] <dcaro>	 it's a whole setup
[14:59:56] <godog>	 dcaro: ack thank you, definitely something I'll chew on
[18:02:11] * dcaro off
[18:02:14] <dcaro>	 cya!