[09:39:53] brouberol: thanks for the hint in https://phabricator.wikimedia.org/T360598, I think you saved us a ton of time digging into an infrastructure we are admittedly not well versed in as a team. [09:40:16] my pleasure! I think it'd be valuable to form a kafka SIG at some point [09:40:29] to share knowledge & all [09:40:45] 💯 [09:43:43] is there anything you need from me at that point or are you handling the refresh / restart? [09:44:35] no, I think I got it [09:45:03] 🤞, but I may be back for advice if something shows up [09:45:07] thanks again [09:47:52] anytime [11:28:07] Dear SREs, we will be switching over the deployment server, please refrain from using it until further notice [13:17:34] Dear SREs, deployment server is switched to deploy1002 [13:18:16] ty! [13:42:21] blubber pipeline question: there was an attempt to add a new image flavour but the image didn't get built, what's wrong? context is https://gerrit.wikimedia.org/r/c/mediawiki/libs/Shellbox/+/1002402 [13:42:57] s/flavour/variant [13:43:21] I can see PipelineBot publishing the other variants but not the new one [13:44:24] kamila_: it's missing from .pipeline/config.yaml [13:45:00] oh, ok, thanks a lot taavi <3 [16:13:48] volans: question: in the cookbook run for the DNS one we just merged [16:14:00] I see "Sleeping for 5 seconds" before the downtiming [16:14:12] shouldn't it have been 60 here if we set depool_sleep to 60? [16:14:34] on the other hand, I do see sleeping for 60 when repooling, which does match repool_sleep [16:14:43] START - Cookbook sre.dns.roll-reboot rolling reboot on A:dnsbox [16:14:43] Sleeping for 5 seconds [16:14:44] Scheduling downtime on Icinga server alert1001.wikimedia.org for hosts: dns1004 [16:15:18] Is this a case of volans getting his own medicine? [16:16:03] marostegui: no idea, I usually err on the side of "it's me" vs "the compiler (aka volans) is wrong" :) [16:16:17] haha [16:16:56] lol wow [16:17:13] deepol_sleep = 60 [16:17:33] that explains it :) [16:22:38] I would have assumed the 5s was for some other part of the process [16:22:56] (e.g. to execute+verify the downtiming itself) [16:23:09] that follows after this step [16:27:18] whoops... sorry for having missed that :) [16:27:24] yes tht explains it [16:30:34] see marostegui not enough of my medicine as it didn't prevented this to pass CI :-P [16:56:45] <_joe_> volans: your medicine prevents code with comments with periods at the end of sentences to be merged, it doesn't prevent logical errors in cookbooks [16:57:07] :-P [16:57:12] miaou [16:57:29] my medicine is designed to trigger you j.oe :D [16:58:32] <_joe_> and I fire back by applying black to all the things [16:59:34] aww, you guys are so sweet <3 [16:59:44] * Emperor runs and hides [16:59:51] <_joe_> Emperor: we banter since 2008 [17:00:21] <_joe_> by now I know exactly how to put breadcrumbs in my code that will trigger volans [17:00:29] <_joe_> ask Amir1 if you don't believe me :D [17:01:53] heh [17:01:56] I concur [19:32:14] Please see RichSmith's message in -tech regarding captcha errors