[12:48:45] 👋 Is there any update with https://phabricator.wikimedia.org/T431838 ? Ideally we would like to get this unblocked to continue with this weeks release [13:11:35] nemo-yiannis: unfortunately c.laime is OOO and I don't know who else has the context, other than swfrench-wmf (US time) [13:15:22] ok [13:25:37] (on phone) ah, I didn't realize they were going to be out! in that case, rolling back the patch is really the only obvious option. I'll be "at work" in about 30 minutes, and if no one else has done so by then, I will [13:56:11] nemo-yiannis: if I'm able to get that revert live in the next ~ 30 mins or so, will you be able to start the new RT testing run at that point? [13:56:22] yes [13:57:36] great, I'll keep you posted [13:59:05] sounds good, thanks [14:24:36] nemo-yiannis: the revert is about 50% rolled out globally, but has reached all of eqiad. if your client is in a cloud VPS there, I think you should be good to go. [14:28:33] yes its eqiad [14:28:34] only [14:28:44] let me check first locally [14:28:56] (I've also double checked locally as well, and seems to work) [14:30:26] ok yeah a single test run worked locally [14:30:30] i think we are good, thanks! [14:30:53] no problem! I'll follow up with c.laime when they're back about a permanent solution [14:31:31] thanks for your patience and apologies for this happening a bit later in the day than ideal :) [15:13:56] swfrench-wmf: I uploaded a questionable patch that maybe could work [15:24:17] effie: awesome, thanks! feel free to add me to review, and maybe we can switch to that as a narrower option until we have an in-REST-gateway solution. [15:24:35] excellent, thanks