[00:46:36] 06Traffic, 10conftool: Fix requestctl naming collision on "sites" - https://phabricator.wikimedia.org/T358825 (10RLazarus) p:05Triage→03Medium [15:52:38] (LVSRealserverMSS) firing: (3) Unexpected MSS value on 103.102.166.226:443 @ ncredir5001 - TODO - https://alerts.wikimedia.org/?q=alertname%3DLVSRealserverMSS [15:57:38] (LVSRealserverMSS) firing: (3) Unexpected MSS value on 103.102.166.226:443 @ ncredir5001 - TODO - https://alerts.wikimedia.org/?q=alertname%3DLVSRealserverMSS [16:02:38] (LVSRealserverMSS) resolved: (3) Unexpected MSS value on 103.102.166.226:443 @ ncredir5001 - TODO - https://alerts.wikimedia.org/?q=alertname%3DLVSRealserverMSS [16:16:39] If anyone here has some time to help dancy figure out how to configure the beta cluster Varnish edge to drop unwanted bot traffic, https://phabricator.wikimedia.org/T358817. You can find dancy in #wikimedia-releng and the security channel to coordinate. He's been trying to use the older `blocked_nets` stuff in the Puppet managed VCL, but apparently something is not going right for him. [16:17:56] bd808: can we invite him here? more eyes here than in releng I guess [16:18:18] sukhe: yeah, let me poke him... [16:18:22] thanks! [16:19:01] Hello! [16:19:10] hi dancy [16:19:23] how can we help with blocked_nets? [16:21:47] ok I see your comment [16:22:49] So on deployment-cache-text08.deployment-prep.eqiad1.wikimedia.cloud there's stuff in /etc/varnish (particularly blocked-nets.inc.vcl and the files that include it: wikimedia_misc-frontend.vcl and wikimedia_text-frontend.vcl) that looks like it should "work".. but it doesn't (traffic not blocked) so I'm confused. :-)) [16:27:12] dancy: looking [16:33:26] dancy: see PM please [17:26:20] 10netops, 06Infrastructure-Foundations, 06SRE: Packet Drops on Eqiad ASW -> CR uplinks - https://phabricator.wikimedia.org/T291627#9591343 (10Jclark-ctr) [17:26:38] 10netops, 06Infrastructure-Foundations, 10SRE-Sprint-Week-Sustainability-March2023, 10ops-eqiad: eqiad: upgrade row C and D uplinks from 4x10G to 1x40G - https://phabricator.wikimedia.org/T313463#9591341 (10Jclark-ctr) 05Open→03Resolved disconnected and removed from netbox [17:55:22] 06Traffic, 10Beta-Cluster-Infrastructure, 06Release-Engineering-Team: beta cluster: profile::cache::varnish::frontend needs to reload varnish-frontend.service when /etc/varnish/blocked-nets.inc.vcl changes - https://phabricator.wikimedia.org/T358887#9591495 (10dancy) [17:55:30] 06Traffic, 10Beta-Cluster-Infrastructure, 06Release-Engineering-Team: beta cluster: profile::cache::varnish::frontend needs to reload varnish-frontend.service when /etc/varnish/blocked-nets.inc.vcl changes - https://phabricator.wikimedia.org/T358887#9591494 (10dancy) Pinging folks who've recently modified th...