[00:38:31] 06Traffic, 06DC-Ops, 10ops-drmrs: hw troubleshooting: Memory failure for cp6008.drmrs.wmnet - https://phabricator.wikimedia.org/T431651#12224558 (10ssingh) Hi @RobH: The DHL tracking says that the shipment is "on hold" since August 7. Do we have any idea what is happening here? Customs clearance? [00:39:19] 06Traffic, 06DC-Ops, 10ops-drmrs: hw troubleshooting: Memory failure for cp6008.drmrs.wmnet - https://phabricator.wikimedia.org/T431651#12224559 (10ssingh) Though it says "Clearance processing complete at MARSEILLE - FRANCE " which I am assuming means it went through that... [06:03:21] 10netops, 06Traffic, 06Infrastructure-Foundations, 06SRE, 13Patch-For-Review: BFD session fails from Anycast hosts over IPv6 on boot - https://phabricator.wikimedia.org/T434806#12224818 (10ayounsi) We should reach out to the BIRD team, even if there is a race condition, BIRD's BFD probably needs to come... [14:08:21] 10netops, 10fundraising-tech-ops, 06Infrastructure-Foundations, 06SRE: Upgrade JunOS on pfw1-eqiad and pfw1-codfw - https://phabricator.wikimedia.org/T434865#12226495 (10cmooney) >>! In T434865#12221432, @Jgreen wrote: > @cmooney this happens to be a FR maintenance week, is it feasible to plan it sometime... [15:19:57] o/ we'd like to migrate the ncredir certificate check to prometheus - it's a simple check although the new one gives a basic tcp check for free along with the cert https://gerrit.wikimedia.org/r/c/operations/puppet/+/1307419 [15:40:34] hnowlan: wow, really coming in hot with all the improvements. Thanks so much! Looking [15:41:00] ty! <3 [15:42:53] jeez, I didn't realize it would be so simple to move it [15:52:40] hnowlan: You'll know better than me, but wouldn't the blackbox check need to move over to the prometheus host? [15:54:21] Hii, thanks for merging the patch of thumb.wikimedia.org, one thing, it still responds from appservers instead of swift https://thumb.wikimedia.org/wikipedia/commons/thumb/f/fc/Sch%C3%B6nwald_im_Schwarzwald%2C_Escheckstra%C3%9Fe_--_2025_--_0147.jpg/1280px-Sch%C3%B6nwald_im_Schwarzwald%2C_Escheckstra%C3%9Fe_--_2025_--_0147.jpg [15:54:39] maybe there are more patches needed [15:55:22] I can investigate if that's not an intentional thing ("oh yeah, we know, X just needs patching, we haven't done it yet") [15:56:40] brett: the check itself gets deployed to the prometheus instances through that definition, it's pretty neat [15:56:54] got it, thanks for confirming my read [15:58:44] Amir1: I do know that slyngs intended on pushing through an lvs patch tomorrow [15:59:25] oh okay, thanks. I wait then [17:52:58] 06Traffic, 06Data-Engineering: Normalize URI host in Turnilo's webrequest_sampled_live - https://phabricator.wikimedia.org/T434766#12227945 (10Ottomata) [17:54:07] 06Traffic, 06Data-Engineering: Normalize URI host in Turnilo's webrequest_sampled_live - https://phabricator.wikimedia.org/T434766#12227948 (10Ottomata) Adding #traffic for benthos field addition request. If that is done, #data-platform-sre can likely update required druid/turnilo configs if needed. [17:54:17] 06Traffic, 06Data-Engineering, 06Data-Engineering-Radar: Normalize URI host in Turnilo's webrequest_sampled_live - https://phabricator.wikimedia.org/T434766#12227957 (10Ottomata) [18:03:18] 06Traffic, 06Data-Engineering: Turnilo: X-Is-Browser filter doesn't work (always HTTP 500) - https://phabricator.wikimedia.org/T435152#12228038 (10Ottomata) Hm. @JAllemandou ? https://gerrit.wikimedia.org/r/plugins/gitiles/operations/deployment-charts/+blame/0fa2c5a03d925b49fad6c5c171408cafa4a8a08b/helmfile.... [18:06:30] 06Traffic, 06Data-Engineering: Turnilo: X-Is-Browser filter doesn't work (always HTTP 500) - https://phabricator.wikimedia.org/T435152#12228048 (10CDanis) Please see also https://gerrit.wikimedia.org/r/c/operations/deployment-charts/+/1305478 If there's a way we can get both split-by and filter-by to work (e... [18:13:32] 06Traffic, 07Browser-Support-Apple-Safari, 07Browser-Support-Firefox, 07Browser-Support-Google-Chrome, 07User-notice: Discovery: Deprecation of TLS 1.2 - https://phabricator.wikimedia.org/T367821#12228077 (10BCornwall) A good reason to continue to support TLS 1.2 for longer than e.g. 1.0/1.1 was supporte... [18:25:19] 10netops, 10fundraising-tech-ops, 06Infrastructure-Foundations, 06SRE: Upgrade JunOS on pfw1-eqiad and pfw1-codfw - https://phabricator.wikimedia.org/T434865#12228113 (10cmooney) As discussed on irc I'll kick off the upgrade on pfw1-codfw at 09:00am UTC tomrorow (Wed Aug 19th). [18:28:11] 06Traffic, 06Machine-Learning-Team (Q1 FY2026-27): CDN caching request for TTS v1 audio files - https://phabricator.wikimedia.org/T434046#12228123 (10BCornwall) Hi, @isarantopoulos! Thanks for bringing this to our attention. There are some questions that we have and would love to get clarification on, such as...