[15:10:16] <_joe_> [PSA] On thursday I'm presenting the "application request flow" chat from our onboarding series [15:11:02] <_joe_> if anyone is interested, please let me know. It's of course designed for people who know little to nothing about our infra, so it should mostly boring if you've been around long enough [15:34:11] volans: fyi netbox guide says you can ask Cas for help if stuck [15:34:40] It looks like they were off boarded earlier in the year (although still have an active SUL account) [15:48:16] RhinosF1: that's correct, thanks for noticing, let me fix wikitech [15:48:54] volans: can you nag ITS to lock SUL too? [15:49:04] https://meta.wikimedia.org/wiki/Special:CentralAuth?target=CRusnov+%28WMF%29 [15:49:26] RhinosF1: were you referring to https://wikitech.wikimedia.org/wiki/DNS/Netbox#Who_can_I_ping_for_questions? ? [15:49:59] volans: yes [15:51:57] {done} [15:52:57] * RhinosF1 doesn't remember the form for ITS to get them to lock an account so assumes you can find it [15:53:10] They used to be a public support ticket thing [15:56:15] I'll check with their former manager, thx [16:01:12] :) [17:12:36] headsup: with https://gerrit.wikimedia.org/r/c/operations/puppet/+/525220 the readonly replicas are now the default for LDAP clients, if you run into any edge cases missed please ping Andrew B and myself [17:13:43] the end goal here is that access to the r/w servers is limited to the LVSed readonly replicas and a few select exceptions like LDAP management hosts [17:59:08] probably very pointless heads up, but the highly reliable {{cn}} downdetector is showing a lot of services having issues, so seems like an upstream drama in progress.. https://usercontent.irccloud-cdn.com/file/6dxRn4jT/image.png [18:11:02] looks like https://status.cloud.google.com/incidents/6PM5mNd43NbMqjCZ5REh [18:11:17] won't affect us directly but thanks for the heads up :) [18:19:57] for the newer users or a reminder for those who have not updated in a while (like myself): https://www.mediawiki.org/wiki/Git/Reviewers#operations/puppet is where the Gerrit review-bot is configured to automatically add people to certain changes in Gerrit, based on role names, module names or regexes. might be useful for review efficiency to add yourself [18:23:04] mutante: You know I was only wondering earlier why j.bond was auto-added to every homer review. Thanks! [18:24:35] hehee, yea, indeed [19:00:22] did something just happen in eqiad? Some hosts just cycled power [19:00:26] as seen in -operations [19:00:50] andrewbogott: see what chris logged [19:01:05] he is moving cables from one switch to another [19:01:06] mgmt [19:01:20] oh, just mgmt [19:01:21] ok [23:54:56] Anyone around for a review of https://gerrit.wikimedia.org/r/c/operations/puppet/+/739375? systemd is complaining that `Nov 16 23:20:04 elastic1049 systemd[1]: [/lib/systemd/system/elasticsearch_6@.service:21] Executable path is not absolute, ignoring: systemd-tmpfiles --create /usr/lib/tmpfiles.d/elasticsearch.conf`, so I think it just wants the absolute path to `systemd-tmpfiles` [23:57:40] ryankemper: +1'd. I think if you use the puppet systemd::unit abstraction it'll complain if the paths aren't absolute