[07:36:48] <_joe_> kamila_: sounds pretty random tbh [07:37:38] <_joe_> elukey: please before reimaging the second set of registries just make sure that we have had a mediawiki deployment [08:22:30] _joe_ yep yep this is the idea, I'll also let the mw switchover days to pass etc.. likely the reimages + decom of old VMs will happen next eek [08:22:33] *week [09:06:43] me and tappof are upgrading mtail on bookworm hosts, JFYI, that's lists* and ncredir* cc vgutierrez eoghan https://phabricator.wikimedia.org/T375085 [09:07:19] cheers [09:14:45] godog: rgr, thanks [14:40:07] hi folks, just a friendly reminder that we'll begin switchover day 1 [0] in about 20 minutes, starting with a site-depool of eqiad. thanks in advance for your assistance / patience :) [14:40:07] [0] https://wikitech.wikimedia.org/wiki/Switch_Datacenter#Traffic [14:40:25] gl! [14:50:14] Hi all! Can someone enlighten me on whether we filter request headers going to application servers? Will arbitrary custom headers make it through, or is there a whitelist? [14:53:18] duesen: there's a denylist of headers that are deleted at the edge https://gerrit.wikimedia.org/g/operations/puppet/+/1a47c963e07c3ba6ba0abf47423abab23b03bbd7/hieradata/common/profile/cache/haproxy.yaml#156 [14:54:21] cdanis: ah, ok, so there's a blacklist. but some custom x-foo-bar should go through? [14:54:53] I think the negative would be easier to answer: "I would like to do X and wonder if that would work" [14:55:07] duesen: yes I think so :) [14:55:41] yep [14:56:34] jynus: true. so, I'm trying to check whether I can activate restbase compat mode for certain rest endpoints, which should be triggered by x-restbase-compat=true. I'm having no luck and I'm trying to find out why :) [14:58:18] duesen: which rest endpoints, do you have a curl invocation? [14:58:52] cdanis: i think i'm missing something obvious. Let my try this locally first. I'll come back if I can't figure it out. [14:59:00] ok! [15:04:54] FYI, switchover has started - I'll be posting updates mainly in -operations [15:50:05] cdanis: turns out it's a caching issue - missing vary header! that threw me off :) [15:50:17] ah yes, that will do it [15:52:24] I'd like to deploy a backport to fix that, within the next hour. Any concerns with that? [15:52:48] Should I ask in another channel as well? I can never figure out what that best place is for that question. [15:55:17] duesen: typically #wikimedia-operations -- right now I'd wait for a positive ack from swfrench-wmf, who's chasing down some last switchover-related items [15:55:53] ok thanks, i'll ask there. I have the fix almost ready, but it'll have to go through CI anyway.