[00:18:51] 10Puppet, 10Beta-Cluster-Infrastructure, 10Infrastructure-Foundations, 10Beta-Cluster-reproducible, 10Patch-For-Review: Beta cluster MediaWiki code not updating - https://phabricator.wikimedia.org/T300591 (10Tgr) [00:21:05] 10Puppet, 10Beta-Cluster-Infrastructure, 10Infrastructure-Foundations, 10Beta-Cluster-reproducible, 10Patch-For-Review: Beta cluster MediaWiki code not updating - https://phabricator.wikimedia.org/T300591 (10Tgr) That seemed to fix it for now. jenkins scap [[https://integration.wikimedia.org/ci/view/Beta... [00:37:38] 10Puppet, 10Beta-Cluster-Infrastructure, 10Infrastructure-Foundations, 10Beta-Cluster-reproducible, 10Patch-For-Review: Beta cluster MediaWiki code not updating - https://phabricator.wikimedia.org/T300591 (10Tgr) @ema seems fixed but I'm not sure if this is the direction we want to go in (as opposed to f... [07:23:21] 10Puppet, 10Beta-Cluster-Infrastructure, 10Infrastructure-Foundations, 10Beta-Cluster-reproducible: Beta cluster MediaWiki code not updating - https://phabricator.wikimedia.org/T300591 (10AlexisJazz) Beta cluster is down again. (see T300525#7666400) [07:42:11] a few network to code demos in there https://www.youtube.com/playlist?list=PLinuRwpnsHadQBZNaWnzXreRTr5LCwlWN I haven't watched any yet though [09:04:27] I keep getting [09:04:27] FIRING:1] BGP peer above prefix limit global (cr2-esams.wikimedia.org warning [09:04:38] seems it's for the same ASN too, so it's the same alert [09:21:45] paravoid: I can remove the nagging part of the alert :) [09:22:30] well that's one thing, but I don't mind that that much :) [09:23:10] paravoid: yeah it was set to send a reminder every 15min... [09:23:22] I removed it, it should notify only once now [16:33:50] 10Puppet, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review, 10User-jbond: replace all puppet crons with systemd timers - https://phabricator.wikimedia.org/T273673 (10Dzahn) removed a bunch of "cron" strings from snapshot: https://gerrit.wikimedia.org/r/c/operations/puppet/+/736074 [17:36:01] 10netops, 10Infrastructure-Foundations, 10SRE, 10fundraising-tech-ops: Upgrade pfw to Junos 20+ - https://phabricator.wikimedia.org/T295691 (10Papaul) ` request system software add no-copy unlink ` started at 10:38am CT and complete at 10.52am CT ~ 13mins ` request system reboot ` started... [17:39:07] 10netops, 10Infrastructure-Foundations, 10SRE, 10fundraising-tech-ops: Upgrade pfw to Junos 20+ - https://phabricator.wikimedia.org/T295691 (10Papaul) 05Open→03Resolved a:03Papaul Complete [17:42:17] 10netops, 10Infrastructure-Foundations, 10SRE, 10fundraising-tech-ops: Upgrade pfw to Junos 20+ - https://phabricator.wikimedia.org/T295691 (10Papaul) 05Resolved→03Open [17:53:23] 10netops, 10Infrastructure-Foundations, 10SRE, 10fundraising-tech-ops: Upgrade pfw to Junos 20+ - https://phabricator.wikimedia.org/T295691 (10Jgreen) [17:54:45] 10netops, 10Infrastructure-Foundations, 10SRE, 10fundraising-tech-ops: Upgrade pfw to Junos 20+ - https://phabricator.wikimedia.org/T295691 (10Jgreen) We're planning to do the upgraded during the Fundraising planned maintenance window of 5/16/2022 to 5/20/2022.