[09:28:00] 10Traffic, 10SRE, 10envoy, 10serviceops, 10Patch-For-Review: Upgrade Envoy to supported version - https://phabricator.wikimedia.org/T300324 (10JMeybohm) [10:55:29] 10Traffic, 10SRE, 10envoy, 10serviceops: Set a limit to the number of allowed active connections via runtime key overload.global_downstream_max_connections - https://phabricator.wikimedia.org/T340955 (10JMeybohm) [11:09:05] 10netops, 10Infrastructure-Foundations, 10SRE: Connection errors from users on Vodafone DE (AS3209) [28.06.2023] - https://phabricator.wikimedia.org/T340670 (10cmooney) 05Open→03Resolved a:03cmooney Session is re-established ~20 mins now and there has been no increase in NELs for this ASN. Marking as... [11:32:57] 10Domains, 10SRE: Mark Monitor administration panel (redirects for wikimedia.pl) - https://phabricator.wikimedia.org/T333827 (10LSobanski) 05Open→03Resolved a:03LSobanski Resolving as there's nothing for SRE to do right now. @Jacek_Broda_WMPL, please reopen if needed after the conversation with Legal. [13:02:49] 10Traffic, 10SRE: provide haproxy silent-drop support for port 80 as well - https://phabricator.wikimedia.org/T340983 (10Vgutierrez) [13:03:04] 10Traffic, 10SRE: provide haproxy silent-drop support for port 80 as well - https://phabricator.wikimedia.org/T340983 (10Vgutierrez) p:05Triage→03Medium [13:39:50] 10Traffic, 10Performance-Team, 10SRE, 10SRE-swift-storage, 10Patch-For-Review: Automatically clean up unused thumbnails in Swift - https://phabricator.wikimedia.org/T211661 (10MatthewVernon) Worth noting here that we are now expiring objects that have an expiry header set (work was T229584). [14:23:08] 10Traffic, 10SRE: provide haproxy silent-drop support for port 80 as well - https://phabricator.wikimedia.org/T340983 (10Fabfur) Just as reminder: As agreed with @Vgutierrez we decided to split the current haproxy acls/other actions per frontend in hieradata, eg.: ` profile::cache::haproxy::acls: tls:... [15:50:39] 10Traffic, 10SRE, 10envoy, 10serviceops, 10Patch-For-Review: Upgrade Envoy to supported version - https://phabricator.wikimedia.org/T300324 (10JMeybohm) mw and restbase canaries as well as mathoid are running 1.23.10 since today. If nothing comes up I will roll the update out to the rest of the fleet tom... [16:12:54] 10Traffic, 10ops-codfw: ManagementSSHDown - https://phabricator.wikimedia.org/T340960 (10Vgutierrez) unresponsive management interface results in puppet being super slow loading facts: ` Jul 3 15:41:54 lvs2013 puppet-agent[1417206]: Loading facts Jul 3 15:58:08 lvs2013 puppet-agent[1417206]: Caching catalog...