[02:16:25] 10Puppet, 10Data-Services, 10Infrastructure-Foundations, 10SRE, 10cloud-services-team (Kanban): clouddumps1002: ferm is being started on every puppet run - https://phabricator.wikimedia.org/T323324 (10Andrew) >>! In T323324#8517754, @Dzahn wrote: > @Andrew Is it not maybe 65.19.157.35 ? Because that is... [08:04:41] 10netops, 10Infrastructure-Foundations, 10SRE, 10SRE-OnFire, and 2 others: Upgrade POPs asw to Junos 21 - https://phabricator.wikimedia.org/T316532 (10ayounsi) On ulsfo: > I had no issues in the lab going from 14.1X53-D54.1 (It was the only available in the lab) to 19.1. (the closest version available on t... [08:50:30] 10Puppet, 10Data-Services, 10Infrastructure-Foundations, 10SRE, 10cloud-services-team (Kanban): clouddumps1002: ferm is being started on every puppet run - https://phabricator.wikimedia.org/T323324 (10taavi) can you try running `ferm-status` with `--verbose`? [09:31:41] 10netops, 10Infrastructure-Foundations, 10SRE, 10SRE-OnFire, and 2 others: Upgrade POPs asw to Junos 21 - https://phabricator.wikimedia.org/T316532 (10ops-monitoring-bot) Icinga downtime and Alertmanager silence (ID=43642849-a893-44f6-961e-0bb82f3a9b4e) set by ayounsi@cumin1001 for 2:00:00 on 36 host(s) an... [10:00:10] excellent news: https://tracker.debian.org/news/1406353/accepted-puppetserver-6180-2-source-all-into-experimental/ [10:00:24] ^ jbond, jhathaway [10:01:23] moritzm: aweseom thanks [10:01:48] ill try bnuilding it in wmcs see what its like [10:02:14] I doubt that'll work, we'd run into the same issues as with the attempted puppetdb backport [10:02:24] better upgrade a bullseye VM to bookworm [10:02:29] ahh yes good point [10:02:32] and add the stock package from experimental [10:02:33] thx [10:02:49] nice [10:02:54] I think that also settles your comment from the OKR gdoc from yesterday :-) [10:03:26] yes agree :) [10:03:59] a similar approach as for puppetdb is probably best, i.e. to directly move to bookworm early and use those stock packages, then we are also able to contribute fixes/tests which are meaningful to Debian [10:15:26] 10netops, 10Infrastructure-Foundations, 10SRE, 10SRE-OnFire, and 2 others: Upgrade POPs asw to Junos 21 - https://phabricator.wikimedia.org/T316532 (10ayounsi) [10:15:51] 10netops, 10Infrastructure-Foundations, 10SRE, 10SRE-OnFire, and 2 others: Upgrade POPs asw to Junos 21 - https://phabricator.wikimedia.org/T316532 (10ayounsi) 10min downtime, everything went smooth. [10:16:45] 10netops, 10Infrastructure-Foundations, 10SRE, 10SRE-OnFire, and 2 others: Upgrade POPs asw to Junos 21 - https://phabricator.wikimedia.org/T316532 (10ayounsi) [12:04:11] 10netops, 10Infrastructure-Foundations, 10SRE: cr2-esams:FPC0 Parity error - https://phabricator.wikimedia.org/T318783 (10ayounsi) 05Open→03Resolved I shutdown the linecard and remote hands re-seat it. Hopefully that solved it for good. [14:14:14] moritzm: XioNoX: fyi i have deployed the updated proxy config to sretest [14:18:13] ack, I'll run some tests with a systemd user w/ shell tomorrow [14:18:51] sweet! [14:20:36] cheers [15:10:46] moritzm: very exciting about puppet server, thanks [15:20:58] 10Puppet, 10Data-Services, 10Infrastructure-Foundations, 10SRE, 10cloud-services-team (Kanban): clouddumps1002: ferm is being started on every puppet run - https://phabricator.wikimedia.org/T323324 (10Andrew) >>! In T323324#8518687, @taavi wrote: > can you try running `ferm-status` with `--verbose`? Yea... [21:28:39] 10Puppet, 10Data-Services, 10Infrastructure-Foundations, 10SRE, 10cloud-services-team (Kanban): clouddumps1002: ferm is being started on every puppet run - https://phabricator.wikimedia.org/T323324 (10Dzahn) >>! In T323324#8518330, @Andrew wrote: >>>! In T323324#8517754, @Dzahn wrote: >> @Andrew Is it no...