[08:34:41] 10netops, 10Infrastructure-Foundations: cr2-esams:FPC0 Parity error - https://phabricator.wikimedia.org/T318783 (10ayounsi) p:05Triage→03Medium [09:24:03] 10SRE-tools, 10Infrastructure-Foundations, 10SRE, 10Spicerack: More structured cookbooks to reboot hosts - https://phabricator.wikimedia.org/T252807 (10jbond) >>! In T252807#8238563, @Volans wrote: > Other things that should be verified/done: > * ensure that hosts that are already depooled (either with `no... [09:28:11] 10SRE-tools, 10Infrastructure-Foundations, 10SRE, 10Spicerack: More structured cookbooks to reboot hosts - https://phabricator.wikimedia.org/T252807 (10Volans) >>! In T252807#8267630, @jbond wrote: >>>! In T252807#8238563, @Volans wrote: >> Other things that should be verified/done: >> * ensure that hosts... [09:33:38] 10SRE-tools, 10Infrastructure-Foundations, 10SRE, 10Spicerack: Investigate converting LBRemoteCluster cookbooks to SRELBBatchRunnerBase - https://phabricator.wikimedia.org/T318787 (10jbond) [09:33:55] 10SRE-tools, 10Infrastructure-Foundations, 10SRE, 10Spicerack: Investigate converting LBRemoteCluster cookbooks to SRELBBatchRunnerBase - https://phabricator.wikimedia.org/T318787 (10jbond) p:05Triage→03Medium [09:36:04] 10SRE-tools, 10Infrastructure-Foundations, 10SRE, 10Spicerack: More structured cookbooks to reboot hosts - https://phabricator.wikimedia.org/T252807 (10jbond) >>! In T252807#8267637, @Volans wrote: >>>! In T252807#8267630, @jbond wrote: >>>>! In T252807#8238563, @Volans wrote: >>> Other things that should... [09:53:53] 10SRE-tools, 10DNS, 10Infrastructure-Foundations, 10Traffic, 10Patch-For-Review: DNS repo: add Jenkins job to ensure there are no duplicates - https://phabricator.wikimedia.org/T155761 (10Volans) I think that the only patch left to be merged is https://gerrit.wikimedia.org/r/c/operations/dns/+/793728, pe... [10:18:15] 10SRE-tools, 10Infrastructure-Foundations, 10SRE, 10Spicerack: Investigate converting LBRemoteCluster cookbooks to SRELBBatchRunnerBase - https://phabricator.wikimedia.org/T318787 (10MoritzMuehlenhoff) There's some overlap with T317855 as well [14:14:10] going to deploy the routinator/systemd change now [14:15:37] lgtm [14:22:49] all fine, I also reinstalled routinator on rpki2002 to replay the error that happened during the 0.10->0.11 update and the override works as expected, so we don't see that error with future updates [14:24:21] nice! [15:25:02] 10netops, 10Infrastructure-Foundations, 10SRE: Add peering sessions on cr1-eqiad Equinix port - https://phabricator.wikimedia.org/T294948 (10ayounsi) 05Open→03Resolved a:03ayounsi I used the new peering cookbook to mass email the ~76 AS that were on cr2 but not cr1. About ~10 replied quickly and some n... [15:32:16] 10netops, 10Infrastructure-Foundations, 10SRE, 10ops-eqiad, 10Sustainability (Incident Followup): eqiad row C switch fabric recabling - https://phabricator.wikimedia.org/T313384 (10ayounsi) @Jclark-ctr @wiki_willy do you have any update about this task? This is set to high priority as it is to prevent an... [16:44:49] thanks to the new peering cookbook we got from table 1 to table 2 in a few seconds, while it would have taken much more before: https://phabricator.wikimedia.org/P35094 - also we didn't know those sessions were missing. [16:57:11] nice work XioNoX :) [16:58:29] thanks to all the reviewers :) [17:02:42] great!