[08:38:58] 10netops, 06Infrastructure-Foundations: Investigate internal rejected prefixes - https://phabricator.wikimedia.org/T423384 (10ayounsi) 03NEW p:05Triage→03Low [08:39:48] 10netops, 06Infrastructure-Foundations, 10observability, 10Prod-Kubernetes, and 5 others: Increase visibility of kubernetes network status - https://phabricator.wikimedia.org/T356877#11823153 (10ayounsi) > Regarding the count of "prefixes received by the switch but not accepted", I think as a first step it... [12:21:11] 10SRE-tools, 06Data-Platform-SRE, 06Infrastructure-Foundations: debmonitor-client crashes for growthbook image - https://phabricator.wikimedia.org/T423413 (10Clement_Goubert) 03NEW [12:28:57] 10SRE-tools, 06Data-Platform-SRE, 06Infrastructure-Foundations: debmonitor-client crashes for growthbook image - https://phabricator.wikimedia.org/T423413#11824005 (10brouberol) So, one peculiarity with the growthbook image is that the software depends on both node24 and python3.11. The first is bundle in tr... [12:33:14] 10SRE-tools, 06Data-Platform-SRE, 06Infrastructure-Foundations: debmonitor-client crashes for growthbook image - https://phabricator.wikimedia.org/T423413#11824026 (10brouberol) One thing we could do here is unset `PYTHONPATH` while running the command? ` # PYTHONPATH= debmonitor-client -n -i blah > blah.tmp... [14:04:41] 07Puppet, 06Infrastructure-Foundations, 13Patch-For-Review: alert1002.wikimedia.org: Puppet warning of too many entries in /etc/acmecerts/icinga - https://phabricator.wikimedia.org/T401858#11824480 (10jhathaway) 05Open→03Resolved [14:27:05] 10SRE-tools, 06Data-Platform-SRE, 06Infrastructure-Foundations: debmonitor-client crashes for growthbook image - https://phabricator.wikimedia.org/T423413#11824649 (10brouberol) [14:53:19] 10netops, 06Infrastructure-Foundations, 06SRE: No not announce OSPF routes in unicast BGP on Nokia SR-Linux - https://phabricator.wikimedia.org/T423430 (10cmooney) 03NEW p:05Triage→03Low [14:53:23] 10netops, 06Infrastructure-Foundations: Investigate internal rejected prefixes - https://phabricator.wikimedia.org/T423384#11824787 (10cmooney) [14:53:26] 10netops, 06Infrastructure-Foundations, 06SRE: No not announce OSPF routes in unicast BGP on Nokia SR-Linux - https://phabricator.wikimedia.org/T423430#11824786 (10cmooney) [14:59:11] 10netops, 06Infrastructure-Foundations, 06SRE: Don't announce OSPF routes in unicast BGP on Nokia SR-Linux - https://phabricator.wikimedia.org/T423430#11824827 (10cmooney) [15:45:21] 07Puppet, 06cloud-services-team, 10Cloud-VPS: Repeated Puppet failures for PetScan - https://phabricator.wikimedia.org/T366141#11825251 (10A_smart_kitten) (belatedly triaging into the #cloud-vps project, but @magnus I assume that it might be good if you could confirm whether or not this remains an issue `:)`) [15:55:51] 07Puppet: Add PATCH method to Wmflib::HTTP::Method - https://phabricator.wikimedia.org/T392096#11825327 (10A_smart_kitten) @fabfur Just going through some older tasks, just wanted to check if this should still remain open or not (as its patch is merged)? [16:21:30] 10netops, 06DC-Ops, 06Infrastructure-Foundations, 10ops-eqiad, 06SRE: Standardize management routers interfaces - https://phabricator.wikimedia.org/T421674#11825509 (10VRiley-WMF) I have plugged in 1 QFX-SFP-1GE-T into mr1-eqiad ge-0/0/7 [17:19:19] 07Puppet, 06cloud-services-team, 10Cloud-VPS: Repeated Puppet failures for PetScan - https://phabricator.wikimedia.org/T366141#11826138 (10bd808) 05Open→03Declined petscan4 was replaced by petscan5 in mid-2024. If and when something like this happens again the next step in investigating is to ssh int... [19:49:43] 10netops, 06Infrastructure-Foundations, 13Patch-For-Review: mr1-eqiad: move from OSPF to BGP - https://phabricator.wikimedia.org/T421238#11826839 (10cmooney) 05Resolved→03Open a:05Papaul→03cmooney Re-opening this so we can look at the automation changes that are needed to remove tthe OSPF stuff (see...