[08:01:16] 10netops, 10DBA, 10Data-Engineering-Planning, 10Data-Persistence, and 11 others: codfw row A switches upgrade - https://phabricator.wikimedia.org/T327925 (10Marostegui) [08:26:20] \o/ https://tracker.debian.org/news/1416851/accepted-python-gjson-100-1-source-all-into-unstable/ [08:30:42] 10netops, 10Infrastructure-Foundations, 10SRE, 10serviceops: Optimize k8s same row traffic flows - https://phabricator.wikimedia.org/T328523 (10ayounsi) >> However using Calico's numAllowedLocalASNumbers config knob will be needed, as all the nodes from a given cluster use the same AS#. > > You could als... [08:34:12] 10netops, 10Infrastructure-Foundations, 10SRE: Allow managing drmrs DHCP settings with Homer - https://phabricator.wikimedia.org/T328737 (10MoritzMuehlenhoff) [08:40:44] moritzm: <333 [08:41:14] XioNoX: that's the policy that was in place when I joined... :) [09:57:21] I get a sneaking feeling that all the wiki stuff is just a cover, and in reality the whole thing is just a Debian recruiting platform set up by moritzm [09:59:05] * moritzm is already on the prowl for the next target [10:34:09] 10SRE-tools, 10Ganeti, 10Infrastructure-Foundations, 10Patch-For-Review: Update makevm to include completion of the installation with the puppet runs - https://phabricator.wikimedia.org/T306661 (10SLyngshede-WMF) In tests others have seen the following message: NetboxHostNotFoundError [10:37:57] 10SRE-tools, 10Ganeti, 10Infrastructure-Foundations, 10Patch-For-Review: Update makevm to include completion of the installation with the puppet runs - https://phabricator.wikimedia.org/T306661 (10elukey) Tried to test the new ganeti cookbook with a local checkout of the cookbook repo + custom config on cu... [10:42:24] 10netops, 10Infrastructure-Foundations, 10SRE: Improve Homer output when Juniper device rejects config - https://phabricator.wikimedia.org/T328747 (10cmooney) p:05Triage→03Low [10:56:15] 10netops, 10DBA, 10Data-Engineering-Planning, 10Data-Persistence, and 11 others: codfw row A switches upgrade - https://phabricator.wikimedia.org/T327925 (10MoritzMuehlenhoff) [11:41:41] 10netops, 10Infrastructure-Foundations, 10SRE: Improve Homer output when Juniper device rejects config - https://phabricator.wikimedia.org/T328747 (10cmooney) [11:41:51] 10netops, 10Infrastructure-Foundations, 10SRE, 10serviceops: Calico and BFD - https://phabricator.wikimedia.org/T328338 (10ayounsi) [12:03:40] 10netops, 10Infrastructure-Foundations, 10SRE, 10serviceops: Calico and BFD - https://phabricator.wikimedia.org/T328338 (10cmooney) > Unfortunately, as mentioned in https://blog.ipspace.net/2021/09/graceful-restart.html "BGP Graceful Restart (RFC 4724) looks like it’s been designed by cowboys" as there is... [12:25:25] 10puppet-compiler, 10Infrastructure-Foundations, 10Datacenter-Switchover: Ensure compilers update /etc/conftool-state/mediawiki.yaml - https://phabricator.wikimedia.org/T290665 (10Clement_Goubert) Is this work still ongoing? If not, would it be possible to update the doc before {T327920} ? [13:15:13] 10netops, 10Infrastructure-Foundations, 10SRE, 10serviceops: Calico and BFD - https://phabricator.wikimedia.org/T328338 (10ayounsi) 05Open→03Resolved a:03ayounsi After a discussion with @akosiaris the initial BFD need was for an Anycast experiment and as explained in T238909#8585199 this is not in sc... [13:50:14] 10puppet-compiler, 10Infrastructure-Foundations, 10Datacenter-Switchover, 10Patch-For-Review: Ensure compilers update /etc/conftool-state/mediawiki.yaml - https://phabricator.wikimedia.org/T290665 (10jbond) @Clement_Goubert unfortunatly this is still just a static file that needs a manual update. I hav pr... [14:03:38] 10puppet-compiler, 10Infrastructure-Foundations, 10Datacenter-Switchover, 10Patch-For-Review: Ensure compilers update /etc/conftool-state/mediawiki.yaml - https://phabricator.wikimedia.org/T290665 (10jbond) @Clement_Goubert i have justed drafted a new [[ https://gerrit.wikimedia.org/r/c/operations/puppet/+... [14:50:35] 10puppet-compiler, 10Infrastructure-Foundations, 10Datacenter-Switchover, 10Patch-For-Review: Ensure compilers update /etc/conftool-state/mediawiki.yaml - https://phabricator.wikimedia.org/T290665 (10Clement_Goubert) Thanks @jbond ! It'll update the file in max 30 minutes, that sounds good enough for me si... [14:55:03] 10SRE-tools, 10Discovery-Search, 10Elasticsearch, 10Spicerack: elasticsearch spicerack module failes with most recent elastic-curator - https://phabricator.wikimedia.org/T328775 (10jbond) p:05Triage→03Medium [14:55:58] 10SRE-tools, 10Discovery-Search, 10Elasticsearch, 10Infrastructure-Foundations, 10Spicerack: elasticsearch spicerack module failes with most recent elastic-curator - https://phabricator.wikimedia.org/T328775 (10bking) [14:57:12] 10puppet-compiler, 10Infrastructure-Foundations, 10Datacenter-Switchover, 10Patch-For-Review: Ensure compilers update /etc/conftool-state/mediawiki.yaml - https://phabricator.wikimedia.org/T290665 (10jbond) >>! In T290665#8585408, @Clement_Goubert wrote: > Thanks @jbond ! It'll update the file in max 30 mi... [15:28:06] 10puppet-compiler, 10Infrastructure-Foundations, 10Datacenter-Switchover, 10Patch-For-Review: Ensure compilers update /etc/conftool-state/mediawiki.yaml - https://phabricator.wikimedia.org/T290665 (10jbond) 05Open→03Resolved >>! In T290665#8585319, @jbond wrote: > @Clement_Goubert i have justed drafted... [15:31:56] 10puppet-compiler, 10Infrastructure-Foundations, 10Datacenter-Switchover, 10Patch-For-Review: Ensure compilers update /etc/conftool-state/mediawiki.yaml - https://phabricator.wikimedia.org/T290665 (10Clement_Goubert) Thank you very much :) [19:53:13] 10netops, 10Infrastructure-Foundations, 10SRE, 10cloud-services-team (FY2022/2023-Q3): Configure cloudsw1-b1-codfw and migrate cloud hosts in codfw B1 to it - https://phabricator.wikimedia.org/T327919 (10cmooney) I tried to enable the CR uplinks from the new cloudsw but there is a bit of a snag. The CR do... [22:15:00] 10netops, 10DBA, 10Data-Engineering-Planning, 10Data-Persistence, and 11 others: codfw row A switches upgrade - https://phabricator.wikimedia.org/T327925 (10colewhite)