[07:25:33] 10Puppet, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review: Duplicate monitoring for systemd::timer::job - https://phabricator.wikimedia.org/T303253 (10Joe) Hi, as stated in the email thread, I don't think this is a good course of action. `systemd::monitor` offers more functionality than the generic... [08:53:38] 10Puppet, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review: Duplicate monitoring for systemd::timer::job - https://phabricator.wikimedia.org/T303253 (10fgiunchedi) An update based on the feedback received by SREs: individual alerts for each `::job` are considered useful because the alerts can be dow... [09:07:56] topranks: XioNoX: https://github.com/KatharaFramework/Kathara looks intresting [09:07:59] https://ripe85.ripe.net/archives/video/941/ [09:09:39] jbond: thanks, yep definitely looks interesting [09:09:58] seems to do the same thing as containerlab, will need to dig in to grok the differences [09:10:58] yes no ideas if one is better then the other [09:12:36] In theory it'd be easy enough for me to port the work I've done for containerlab over if there was a reason [09:12:51] the hard part there is building the representation of our network from Netbox [09:13:05] outputting a different-format conf file from that data ought not to be too tricky [09:15:36] i have not looked at container lab but the network topolagy config file in this looked very simple, but the devil is in the detail :) [09:17:23] clab is very simple tbh, you just define nodes (of type x, y or z) and then the links between them [09:17:50] ack [09:19:22] Example if you're interested: https://phabricator.wikimedia.org/P36690 [09:20:01] most of the work I've done is to generate this, so easy to change the output. I'll take a look at the presentation [09:21:30] yes id say take a look at the presentation it should give you an idea of if its worth exploring more :)P [10:13:05] FYI there's FNMNotReported alert firing [10:52:31] 10Puppet, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review: Duplicate monitoring for systemd::timer::job - https://phabricator.wikimedia.org/T303253 (10jcrespo) > we want to move "systemd unit failed" off Icinga and onto AM too This is higher level, and out of scope of this ticket, but I wonder if... [11:51:24] 10Mail, 10Data-Engineering-Operations, 10Data-Engineering-Planning, 10SRE, 10Patch-For-Review: Change the analytics-alerts email alias to a mailman distribution list - https://phabricator.wikimedia.org/T315486 (10BTullis) OK, thanks all. I'll make that change to the exim aliases file: `analytics-alerts:... [13:42:38] 10Puppet, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review: Duplicate monitoring for systemd::timer::job - https://phabricator.wikimedia.org/T303253 (10fgiunchedi) >>! In T303253#8348894, @jcrespo wrote: >> we want to move "systemd unit failed" off Icinga and onto AM too > > This is higher level, a... [14:02:32] jbond: i probably can spend some time on the puppet packages if you have pointers where to get started [14:34:44] taavi: i see you are in debian-pupppet on oftc. i think the best way to progress this would be to ask there. its been a couple of weeks since i looked at the current status and i dont see anything on the mailing list. [14:35:02] the last i checked the plan was still to vendor in jruby as per https://wiki.debian.org/Teams/Puppet/Work#The_JRuby_problem [14:35:22] buyt the salsa project has not been updated in some time so not sure where/if there is any public progress [14:36:11] althugh i will say im not a debian dev and all though i can hack around in packaging i will 301 you to moritzm for more usefull guidence :) [14:40:16] agreed, getting in touch with #debian-puppet or Jérôme Charaoui (who's the main driver) is probably the best next step [14:40:28] I don't have a good overview what is needed myself at this point [15:22:01] 10Mail, 10Data-Engineering-Operations, 10Data-Engineering-Planning, 10SRE: Change the analytics-alerts email alias to a mailman distribution list - https://phabricator.wikimedia.org/T315486 (10BTullis) After modifying the alias I also needed to set the following option in mailman. {F35641648,width=80%} [15:22:38] 10Mail, 10Data-Engineering-Operations, 10Data-Engineering-Planning, 10SRE: Change the analytics-alerts email alias to a mailman distribution list - https://phabricator.wikimedia.org/T315486 (10BTullis) 05Open→03Resolved [16:01:09] 10Packaging, 10Infrastructure-Foundations, 10SRE: Update php-xdebug to 2.7.2 in apt.wikimedia.org - https://phabricator.wikimedia.org/T263933 (10Tgr) 05Open→03Invalid After {T271649} and the switch to PHP 7.4, Vagrant now uses XDebug 3. [16:29:13] 10netops, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review, 10cloud-services-team (Kanban): Move WMCS servers to 1 NIC - https://phabricator.wikimedia.org/T319184 (10aborrero) [22:37:28] 10netops, 10DC-Ops, 10Infrastructure-Foundations, 10SRE, and 3 others: Q3:(Need By: TBD) rack/setup/install 2 new labstore hosts - https://phabricator.wikimedia.org/T302981 (10Andrew)