[14:25:43] I just got a "Original error: upstream connect error or disconnect/reset before headers. reset reason: overflow" [14:25:48] something going on? [14:26:51] And now: [14:26:56] Request from 2600:4041:51ec:c500:11c:89f4:5ab2:a0b0 via cp1085.eqiad.wmnet, ATS/9.1.4 [14:26:56] Error: 502, Broken pipe at 2023-04-17 14:26:18 GMT [14:28:19] SRE's are aware and dealing with it... [14:28:27] k, thanks. [15:25:13] volans: if you are around, quick question [15:25:19] sure [15:25:27] if the first puppet run in a cookbook fails and then we do a "retry" and it works [15:25:32] the cookbook reports a failure with: [15:25:34] > First Puppet run failed, asking the operator what to do [15:25:39] as the thing that failed [15:25:50] is that intentional? or is something else wrong here that I am missing? [15:26:07] let me check the logs [15:26:22] thanks [15:26:23] lvs1020 [15:26:29] we have seen it with other LVSes before too [15:26:44] usually the first one we reimage in site, if we don't update the iface names quickly enough [15:27:01] then we do them and retry and even though everything else works, it still says it failed because of this [15:27:04] and hence the question [15:28:09] ah you mean the final state of the cookbook [15:28:18] but it does run fine, correct? [15:28:19] yep [15:28:21] to both [15:28:31] ok, might be a bug, checking [15:28:43] the retry was added later [15:28:51] ok thank you [15:29:03] not urgent [15:32:27] sukhe: confirmed, the fact that the failure was registered is what makes it say FAIL, but ofc it should not be that, as most a warning [15:32:59] volans: thanks for checking [15:35:03] volans: happy to open a task or even patch [15:58:18] sukhe: a task would be great, I looked at it and started to make a patch but I'd like to refactor a bit that part [15:58:44] volans: sure, I will file one today after the SRE meeting [15:58:57] thx [17:37:26] re: above, I filed https://phabricator.wikimedia.org/T334880 ["cookbooks.sre.hosts.reimage should not fail if the first Puppet run failed and if the user was prompted"] [17:37:46] thanks!