[09:29:27] 10netops, 10Infrastructure-Foundations: Optimise WMF WAN Network Configuration - https://phabricator.wikimedia.org/T297355 (10cmooney) p:05Triage→03Medium [09:32:03] 10netops, 10Infrastructure-Foundations: Optimise WMF WAN Network Configuration - https://phabricator.wikimedia.org/T297355 (10cmooney) [09:32:30] 10netops, 10Infrastructure-Foundations: Optimise WMF WAN Network Configuration - https://phabricator.wikimedia.org/T297355 (10cmooney) [12:21:27] 10netops, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review, 10Sustainability (Incident Followup): Use next-hop-self for iBGP sessions - https://phabricator.wikimedia.org/T295672 (10cmooney) p:05High→03Low Ok I have applied the changes on cr1-eqiad and cr2-eqiad. All went as expected. Paste w... [14:00:58] 10Traffic, 10SRE, 10Patch-For-Review: Test envoyproxy as a WMF's CDN TLS terminator with real traffic - https://phabricator.wikimedia.org/T271421 (10Vgutierrez) 05Open→03In progress [14:45:11] hello folks [14:45:27] I am planning to stop kafka on kafka-main2003 later on and reimage the host to buster [14:46:41] IIRC purged pulls from both kafka main clusters, so it may experience some temp timeouts, but the kafka client protocol should handle everything [14:46:46] lemme know if it is not a good time [15:33:42] while looking for outstanding issues for kafka-main2003, I found (again) https://phabricator.wikimedia.org/T267867 [15:33:45] ema: --^ [15:34:11] I don't recall if we did anything about it, but it may rehappen if I reimage kafka-main2003 :D [16:18:49] elukey: ah yes, IIRC this is one of those issues where rdkafka upstream says "please update and try again", isn't it? [17:01:26] ema: in theory this is what they answer if there is no clear stacktrace etc.. [17:01:51] I have manually stopped kafka (that is more graceful for clients) on kafka-main2003, will wait some minutes before reimaging [17:01:54] to see if anything comes up [20:07:22] 10Wikimedia-Apache-configuration, 10Fundraising-Backlog, 10SRE, 10Thank-You-Page, and 4 others: Deal with donatewiki Thank You page launching in apps - https://phabricator.wikimedia.org/T259312 (10ABorbaWMF) Appears to be fixed on 6.8.2 (1868)