[10:45:48] effie, claime: will either of you be around during the upcoming deployment window to keep an eye on jobrunners? [10:46:44] yes, time? [10:47:35] effie: 13:00 u5tc [10:49:54] I should be around [11:07:05] same here [11:34:51] Hi! So I'm here asking the question again [11:35:01] "Chinese Wikipedia is looking..." <- About this [12:15:23] "https://phabricator.wikimedia...." <- This task is not the same as my request above (it is about accessing uncensored Wikipedia content, but my request is about a registration portal), but both utilize domain fronting from 3rd-party services, so I think they share the same similarities. [12:17:27] I would be grateful for any response [12:19:44] brett: could you maybe see if your comments on https://phabricator.wikimedia.org/T327286 apply to diskdance[m]'s Q from weekend? [12:19:51] 08:41:13 Chinese Wikipedia is looking into setting up a registration portal so people from China can create accounts with ease. After some discussion somebody pointed out that domain fronting is the only way to make it resistant to censorship. I'm here asking for comments from SRE. Is it technically feasible for WMF to use domain fronting? Thanks. [13:36:41] arturo: hi! I will be slowly rolling out https://gerrit.wikimedia.org/r/c/operations/puppet/+/922514 shortly [13:36:48] https://gerrit.wikimedia.org/r/c/operations/puppet/+/922514/14/hieradata/role/common/wmcs/cloudlb.yaml [13:37:05] "almost" a NOOP for you but just a heads-up [13:37:06] thanks :) [14:16:12] sukhe: ACK [14:16:29] thanks :) [14:18:42] +1'd [14:18:52] merging and rolling out slowly, role by role [14:55:17] RhinosF1: I used pretty vague verbiage, so it could probably even apply to an online food order to SRE [14:55:41] is that a different ticket? I'm not seeing that quote in the link [14:55:42] brett: do you have any thoughts [14:56:06] The quote isn't related to the ticket but a very similar idea to the ticket [14:56:26] You said traffic couldn't support domain fronting last time in very vague words due to the time to maintain [14:57:29] arturo: all good, merged on wmcs, no change [14:57:32] I think that's a pretty major undertaking that would require buy-in from multiple teams for dubious gain. It'd be super awesome to have in theory but I believe it to be an unwise dedication of resources given that we're already struggling to keep up as it is [14:58:14] diskdance[m]: ^ [14:58:16] I don't think we have the wherewithall to keep up with the whackamole of chinese censors [14:58:47] or rather, I think that we should have a concerted effort if we do want to engage in that battle [14:59:03] aka more important people than me :) [15:29:41] sigh, the rota has me on call while I'm no vacation. [15:31:54] Anyone free w/c 28 August who can swap a Europe-TZ oncall shift, please? [15:34:30] s/no/on/ [15:45:24] Emperor: I also got shuffled into a vacation week, do you want to swap with the week of 2023-07-24 (where I'm on vacation), then I take your week starting on 2023-08-28? [16:01:22] moritzm: that works for me, yes please. [16:02:22] sounds good, let's sort out the override stuff tomorrow [16:02:31] +1 [16:23:07] duesen: claim.e and I believe that we made it better, since it is getting late in this side of the world, happy to move forward tomorrow with de, and maybe with enwiki later in the day [16:54:24] backlog down toe 30s already [16:54:25] nice [16:59:44] yeah, we'll see how it copes with de/en tomorrow [17:00:53] jobrunners are running at around 45% active workers [17:01:14] Hello 👋 [17:01:37] You can find the latency plots here: [17:01:46] stat1009.eqiad.wmnet:/home/jameel/ProbeAnalysis/files/plots [17:02:06] You can find the before/after comparison plots here: [17:02:15] stat1009.eqiad.wmnet:/home/jameel/TimingAnalysis/files/plots [17:02:54] This is regarding the presentation during today's SRE meeting [18:27:30] If no one objects, I will de-pool sessionstore/codfw for bullseye upgrades momentarily /cc denisse & mutante [18:27:52] urandom: ACK, thanks!!