[03:15:13] 10GitLab, 06Release-Engineering-Team, 10mwcli: Possibly rename mwcli and mwcli gitlab repo - https://phabricator.wikimedia.org/T384781#10502811 (10Samwilson) That's an interesting idea. My understanding of mwcli is that it's for managing a Docker based development environment and specifically for Wikimedia s... [07:19:00] 10GitLab, 06Release-Engineering-Team, 10mwcli: Possibly rename mwcli and mwcli gitlab repo - https://phabricator.wikimedia.org/T384781#10502986 (10Addshore) > That's an interesting idea. My understanding of mwcli is that it's for managing a Docker based development environment and specifically for Wikimedia... [09:42:14] hashar: hey, looks like I missed our meeting... I just got back home and made a coffee. If you like we can chat now :) [09:44:14] duesen: ah yeah sure sorry. Let me pour a coffee [09:49:47] 10GitLab (Pipeline Services Migration🐤), 10Wikimedia-Portals: Migrate Wikimedia Portals from Gerrit to GitLab - https://phabricator.wikimedia.org/T344743#10503239 (10Aklapper) [10:47:04] 10Gerrit, 06Release-Engineering-Team: Timeout when trying to connect to gerrit over ssh - https://phabricator.wikimedia.org/T385019 (10daniel) 03NEW [10:48:39] 10Gerrit, 06Release-Engineering-Team: Timeout when trying to connect to gerrit over ssh - https://phabricator.wikimedia.org/T385019#10503547 (10daniel) {F58307616} Output of `mtr gerrit.wikimedia.org` [10:52:45] (03PS1) 10Hashar: Do not copy Code-Review +2 [puppet] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/1114966 [10:53:44] (03CR) 10Hashar: [V:03+2 C:03+2] Do not copy Code-Review +2 [puppet] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/1114966 (owner: 10Hashar) [11:07:11] duesen: on that ssh trace https://phabricator.wikimedia.org/T385019 , did that one actually completed? [11:07:25] the timing states 11:33 and tries to connect over IPv6 [11:07:36] yes [11:07:54] took several minutes, but eventually it compelted [11:08:10] which would be consistent with tcp struggling with packet loss. [11:09:49] do you have the rest of ssh debug log that shows it retried and connected eventually? [11:11:16] yes. i'll add it to the ticket [11:11:25] do you want the entire thing, or just the next five lines? [11:13:12] 10Gerrit, 06Release-Engineering-Team: Timeout when trying to connect to gerrit over ssh - https://phabricator.wikimedia.org/T385019#10503614 (10daniel) [11:13:28] hashar: I updated the ticket [11:13:36] the next few lines are: [11:13:40] https://www.irccloud.com/pastebin/1NIizAR1/ [11:15:28] 10Gerrit, 06Release-Engineering-Team: Timeout when trying to connect to gerrit over ssh - https://phabricator.wikimedia.org/T385019#10503626 (10hashar) ` 11:33 [review/daniel_kinzler/dispatch-job] ~/code/mediawiki> ssh -vv -xp29418 daniel@gerrit.wikimedia.org gerrit query --format=JSON --current-patch-set chan... [11:15:47] It would have been nice to have a timestamp on each line of output... so I googled, and found the ts command. Huh. [11:15:57] yeah [11:16:04] I was going to suggest that [11:16:53] the command is a bit clumpsy, I alway shave to look up the manpage [11:19:10] time ssh .... 2>&1 | ts -s "%H:%M:%.S" [11:19:37] that would prefix the lines with the duration since the start of the command [11:20:03] what I suspect is that for some reason the IPv6 connection fails and there is a several minutes timeout [11:20:10] then that fallback to IPv4 which does work [11:20:28] so tentatively if you do `ssh -6` you would get the long timeout [11:20:35] and `ssh -4` would always work [11:21:39] see eg https://www.gridpp.ac.uk/wiki/IPv6_Fallback#Long_connection_delays [11:22:10] so it can't connect to IPv6 [11:22:18] the ICMP packet is not emitted/received [11:22:28] and the stack wait + potentially retry [11:22:34] so for example it would wait 90 seconds [11:22:40] and retry 3 times? [11:22:43] yea, but why does ipv6 fail in the first place? [11:22:51] who knows! [11:23:03] filtering on your end or on Gerrit side [11:23:10] or maybe the ICMP packet is rejected [11:23:17] but maybe the v4 is always working [11:23:32] if it was totally filtered, I'd always have the issue. BUt I only have it intermittently [11:23:44] yeah :-\ [11:23:59] oh you mean ipv6 never works, but normally i get the icmp packet, so the fallback is fast? [11:24:16] that I can easily test, hold on [11:25:55] you can force the IP version using `ssh -4` or `ssh -6` [11:26:13] the thing is that in your trace, the v6 definitely never completed [11:26:17] and fallback on v4 [11:26:30] https://www.irccloud.com/pastebin/vbDuXbkC/ [11:26:56] works fine with -6 [11:27:01] yeah and sometime it works :b [11:27:31] which means that the problem isn't that IPv6 is filtered/broken anywhere along the way. [11:28:22] can you update the ticket with the info you found? [11:34:29] (03PS1) 10Jelto: Revert "Do not copy Code-Review +2" [puppet] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/1114980 [11:36:32] (03CR) 10Jelto: [V:03+2] Revert "Do not copy Code-Review +2" [puppet] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/1114980 (owner: 10Jelto) [11:37:45] 10Gerrit, 06Release-Engineering-Team: Timeout when trying to connect to gerrit over ssh - https://phabricator.wikimedia.org/T385019#10503708 (10daniel) > My fringe theory is that it first attempts to connect over IPv6, fails after some timeout and eventually fallback to IPv4. That might be a dual stack issue :... [11:44:14] 10Gerrit, 06Release-Engineering-Team: Timeout when trying to connect to gerrit over ssh - https://phabricator.wikimedia.org/T385019#10503736 (10hashar) The OpenSSH Client has: > **ConnectionAttempts** > > Specifies the number of tries (one per second) to make before exiting. The argument must be an integer.... [11:44:16] duesen: I posted some updates on the ticket yes [11:44:22] I am off fr lunch [11:57:20] 10Beta-Cluster-Infrastructure: frwiki betalabs: Error 1146: Table 'frwiki.blobs1' doesn't exist - https://phabricator.wikimedia.org/T385025 (10Urbanecm_WMF) 03NEW [12:14:49] 06Release-Engineering-Team, 10Scap, 06serviceops, 13Patch-For-Review: Retire use of scap proxies - https://phabricator.wikimedia.org/T384196#10503795 (10hnowlan) [12:23:49] hashar: thank you! I lowered the timeout. Two minutes is silly. If it takes onger than 10 seconds to connect, it's not gonna happen... [12:47:10] (03CR) 10Hashar: [V:03+2 C:03+2] "I think the issue is the section overrides all properties from the parent All-Projects when I guess I assumed it would extend it. So as th" [puppet] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/1114966 (owner: 10Hashar) [12:51:32] 10GitLab (Pipeline Services Migration🐤), 06collaboration-services, 13Patch-For-Review: move os-reports.wikimedia.org to kubernetes - https://phabricator.wikimedia.org/T350794#10503890 (10Arnoldokoth) [13:09:27] 10Scap (SpiderPig 🕸️): SpiderPig UI: add pagination support - https://phabricator.wikimedia.org/T385029 (10lwatson) 03NEW [13:10:05] 10Scap (SpiderPig 🕸️): SpiderPig UI: add pagination support - https://phabricator.wikimedia.org/T385029#10503956 (10lwatson) [13:10:07] 10Release-Engineering-Team (Doing 😎), 10Scap (SpiderPig 🕸️), 10Codex, 10Design-System-Team (Roadmap), 07Epic: [EPIC] scap web interface: Create SpiderPig web UI - https://phabricator.wikimedia.org/T375782#10503957 (10lwatson) [13:11:05] 10Scap (SpiderPig 🕸️): Spiderpig UI: Codex components for Main Page - https://phabricator.wikimedia.org/T379412#10503961 (10lwatson) [13:12:13] 10Phabricator, 06SRE, 06Traffic: Phabricator should cache tasks for a few minutes for logged-out users - https://phabricator.wikimedia.org/T274228#10503972 (10Aklapper) Does anyone have sufficient understanding to outline the next potential steps in the blurry territories between undermaintained Phorge upstr... [13:16:26] 06Release-Engineering-Team, 10WMF-General-or-Unknown: Improve wgBetaFeaturesAllowList permission/sign-off process - https://phabricator.wikimedia.org/T380929#10503994 (10Aklapper) →14Duplicate dup:03T352825 [13:23:43] 10Beta-Cluster-Infrastructure: frwiki betalabs: Error 1146: Table 'frwiki.blobs1' doesn't exist - https://phabricator.wikimedia.org/T385025#10504027 (10Urbanecm_WMF) @tstarling It seems like you were the one who created the wiki (judging from 05c0b87c806724dfea1e8c07c730472d72e6d0f2), and it seems like it is for... [14:18:32] 10Gerrit, 06Release-Engineering-Team: Timeout when trying to connect to gerrit over ssh - https://phabricator.wikimedia.org/T385019#10504387 (10mszabo) `ssh -6` is fairly fast for me. I wonder if this may be an ISP issue. [14:30:04] 10Gerrit, 06Release-Engineering-Team: Timeout when trying to connect to gerrit over ssh - https://phabricator.wikimedia.org/T385019#10504464 (10daniel) >>! In T385019#10504387, @mszabo wrote: > `ssh -6` is fairly fast for me. I wonder if this may be an ISP issue. It's fast for me most of the time as well. But... [14:57:50] 10GitLab (Pipeline Services Migration🐤), 06collaboration-services, 13Patch-For-Review: move os-reports.wikimedia.org to kubernetes - https://phabricator.wikimedia.org/T350794#10504766 (10Jelto) We are facing multiple issues with running `kubectl` in a cronjob approach. The version of `kubectl` has to be kept... [15:56:09] (03update) 10dancy: spiderpig: CAS auth integration [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/625 [16:07:04] 10Release-Engineering-Team (Priority Backlog 📥), 13Patch-For-Review, 05Release, 05Train Deployments: 1.44.0-wmf.14 deployment blockers - https://phabricator.wikimedia.org/T382365#10505162 (10Jdlrobson-WMF) [16:09:57] 10Gerrit, 06Release-Engineering-Team: Timeout when trying to connect to gerrit over ssh - https://phabricator.wikimedia.org/T385019#10505172 (10hashar) With mtr you can try establishing tcp connections (with a simple SYN) and see whether any timeout/are rejected: ` mtr -6 --tcp -P 29418 gerrit.wikimedia.org `... [16:11:37] (03PS1) 10Ejegg: Test SmashPig against PHP8.2 [integration/config] - 10https://gerrit.wikimedia.org/r/1115064 [16:12:36] Hi releng, I am once again asking for your help :) We'd like to start testing SmashPig against PHP8.2 as well ^^^ [16:13:40] (03CR) 10CI reject: [V:04-1] Test SmashPig against PHP8.2 [integration/config] - 10https://gerrit.wikimedia.org/r/1115064 (owner: 10Ejegg) [16:15:28] jenkins says no :P [16:22:58] lol [16:23:03] pretty please? [16:24:14] (03PS2) 10Ejegg: Test SmashPig against PHP8.2 [integration/config] - 10https://gerrit.wikimedia.org/r/1115064 [16:24:52] I can't for the life of me figure out where the composer-test-phpXX-only etc names are generated [16:25:46] (03PS1) 10Hashar: Do not copy Code-Review +2 (take 2) [puppet] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/1115068 [16:26:05] (03CR) 10CI reject: [V:04-1] Test SmashPig against PHP8.2 [integration/config] - 10https://gerrit.wikimedia.org/r/1115064 (owner: 10Ejegg) [16:33:18] !log gerrit: marked all legacy Puppet modules as read-only ( https://gerrit.wikimedia.org/r/admin/repos/q/filter:operations/puppet/ ) and removed the associated GitHub mirrors that existed for some of them [16:33:19] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [16:37:47] (03PS3) 10Ejegg: Test SmashPig against PHP8.2 [integration/config] - 10https://gerrit.wikimedia.org/r/1115064 [16:37:59] ah they're right in layout.yaml itself! [16:50:13] looks like jenkins is OK with PS3 of that change, Reedy! [16:52:14] -only-except-experimental [16:54:43] (03CR) 10Reedy: [C:03+2] Test SmashPig against PHP8.2 [integration/config] - 10https://gerrit.wikimedia.org/r/1115064 (owner: 10Ejegg) [16:55:21] lol, that's how the other -only tests are laid out :) [16:55:34] thank you Reedy [16:56:32] (03Merged) 10jenkins-bot: Test SmashPig against PHP8.2 [integration/config] - 10https://gerrit.wikimedia.org/r/1115064 (owner: 10Ejegg) [16:57:06] !log Reloading Zuul to deploy https://gerrit.wikimedia.org/r/1115064 [16:57:06] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [17:03:55] (03CR) 10Jforrester: "Why are you only testing against one target at once? Is composer-test-php74-or-later, the standard template to use, not appropriate?" [integration/config] - 10https://gerrit.wikimedia.org/r/1115064 (owner: 10Ejegg) [17:26:18] (03CR) 10Jforrester: "Sorry, yes, it's for that, I was asking about the other three FR-special cases. Happy to deploy this as-is and we can do the rest later." [integration/config] - 10https://gerrit.wikimedia.org/r/1114447 (owner: 10Ejegg) [17:29:30] (03CR) 10Jforrester: "(There's also the vendor repo's checkouts, which you'll need to change.)" [integration/config] - 10https://gerrit.wikimedia.org/r/1114447 (owner: 10Ejegg) [17:37:02] (03PS1) 10Jforrester: Zuul: [mediawiki/extensions/cldr] Re-enable FR-tech job as voting, passes fine [integration/config] - 10https://gerrit.wikimedia.org/r/1115084 [17:37:02] (03PS1) 10Jforrester: Zuul: [mediawiki/extensions/cldr] Add FR REL1_43-php82 as experimental [integration/config] - 10https://gerrit.wikimedia.org/r/1115085 [17:38:51] (03CR) 10Jforrester: [C:03+2] Zuul: [mediawiki/extensions/cldr] Re-enable FR-tech job as voting, passes fine [integration/config] - 10https://gerrit.wikimedia.org/r/1115084 (owner: 10Jforrester) [17:38:58] (03CR) 10Jforrester: [C:03+2] Zuul: [mediawiki/extensions/cldr] Add FR REL1_43-php82 as experimental [integration/config] - 10https://gerrit.wikimedia.org/r/1115085 (owner: 10Jforrester) [17:40:06] (03Merged) 10jenkins-bot: Zuul: [mediawiki/extensions/cldr] Re-enable FR-tech job as voting, passes fine [integration/config] - 10https://gerrit.wikimedia.org/r/1115084 (owner: 10Jforrester) [17:40:21] (03Merged) 10jenkins-bot: Zuul: [mediawiki/extensions/cldr] Add FR REL1_43-php82 as experimental [integration/config] - 10https://gerrit.wikimedia.org/r/1115085 (owner: 10Jforrester) [17:40:31] !log Zuul: [mediawiki/extensions/cldr] Re-enable FR-tech job as voting, passes fine [17:40:32] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [17:40:43] !log Zuul: [mediawiki/extensions/cldr] Add FR REL1_43-php82 as experimental [17:40:44] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [17:46:30] (03PS5) 10Jforrester: Zuul: [mediawiki/extensions/cldr] Restore FR gate-and-submit job tests [integration/config] - 10https://gerrit.wikimedia.org/r/1113586 [17:47:44] (03CR) 10CI reject: [V:04-1] Zuul: [mediawiki/extensions/cldr] Restore FR gate-and-submit job tests [integration/config] - 10https://gerrit.wikimedia.org/r/1113586 (owner: 10Jforrester) [17:48:02] (03PS1) 10Jforrester: Zuul: Add FR REL1_43-php82 as experimental to other extensions [integration/config] - 10https://gerrit.wikimedia.org/r/1115087 [17:49:16] (03CR) 10Jforrester: [C:03+2] Zuul: Add FR REL1_43-php82 as experimental to other extensions [integration/config] - 10https://gerrit.wikimedia.org/r/1115087 (owner: 10Jforrester) [17:49:23] (03CR) 10CI reject: [V:04-1] Zuul: Add FR REL1_43-php82 as experimental to other extensions [integration/config] - 10https://gerrit.wikimedia.org/r/1115087 (owner: 10Jforrester) [17:51:08] (03PS2) 10Jforrester: Zuul: Add FR REL1_43-php82 as experimental to other extensions [integration/config] - 10https://gerrit.wikimedia.org/r/1115087 [17:52:49] (03CR) 10Jforrester: [C:03+2] Zuul: Add FR REL1_43-php82 as experimental to other extensions [integration/config] - 10https://gerrit.wikimedia.org/r/1115087 (owner: 10Jforrester) [17:54:02] (03Merged) 10jenkins-bot: Zuul: Add FR REL1_43-php82 as experimental to other extensions [integration/config] - 10https://gerrit.wikimedia.org/r/1115087 (owner: 10Jforrester) [17:54:09] !log Zuul: Add FR REL1_43-php82 as experimental to other extensions [17:54:10] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [17:58:29] (03PS1) 10Jforrester: Zuul: Make FR REL1_43-php82 voting for cldr and FEU, passing [integration/config] - 10https://gerrit.wikimedia.org/r/1115088 [18:01:40] (03CR) 10Jforrester: "OK, update:" [integration/config] - 10https://gerrit.wikimedia.org/r/1114447 (owner: 10Ejegg) [18:02:01] (03CR) 10Jforrester: [C:03+2] Zuul: Make FR REL1_43-php82 voting for cldr and FEU, passing [integration/config] - 10https://gerrit.wikimedia.org/r/1115088 (owner: 10Jforrester) [18:02:04] thanks Jdlrobson [18:03:16] (03Merged) 10jenkins-bot: Zuul: Make FR REL1_43-php82 voting for cldr and FEU, passing [integration/config] - 10https://gerrit.wikimedia.org/r/1115088 (owner: 10Jforrester) [18:03:25] ejegg: We can enable the REL1_43-php82 DI job for FR's special branches of MW-core and vendor, but it'll just fail, which presumably you don't want. :-) [18:03:36] !log Zuul: Make FR REL1_43-php82 voting for cldr and FEU [18:03:36] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [18:03:40] (03PS6) 10Jforrester: Zuul: [mediawiki/extensions/cldr] Restore FR gate-and-submit job tests [integration/config] - 10https://gerrit.wikimedia.org/r/1113586 [18:05:43] (03CR) 10Jforrester: [C:03+2] Zuul: [mediawiki/extensions/cldr] Restore FR gate-and-submit job tests [integration/config] - 10https://gerrit.wikimedia.org/r/1113586 (owner: 10Jforrester) [18:07:20] (03Merged) 10jenkins-bot: Zuul: [mediawiki/extensions/cldr] Restore FR gate-and-submit job tests [integration/config] - 10https://gerrit.wikimedia.org/r/1113586 (owner: 10Jforrester) [18:11:34] (03PS2) 10Jforrester: Zuul: [mediawiki/core] Test fundraising branches against PHP 8.2 [integration/config] - 10https://gerrit.wikimedia.org/r/1114447 (owner: 10Ejegg) [18:16:36] (03CR) 10Jforrester: [C:04-1] "Presumably we don't want to do this until it passes?" [integration/config] - 10https://gerrit.wikimedia.org/r/1114447 (owner: 10Ejegg) [19:44:50] hi releng, fyi there's an UBN that we have cherry picks that should fix it -- Catrope should be following up with it: https://phabricator.wikimedia.org/T385055 [19:59:07] (03CR) 10CDanis: [C:03+1] "This is a +1 from me, given that today is the second time in the past month that we've been delayed shipping a UBN!-fixing cherry-pick to " [integration/config] - 10https://gerrit.wikimedia.org/r/1109435 (owner: 10Jforrester) [20:00:03] (03PS2) 10Jforrester: Zuul: Don't run selenium tests for wmf/ branch back-ports [integration/config] - 10https://gerrit.wikimedia.org/r/1109435 [20:16:18] also, I'd love a CR on ^ https://gerrit.wikimedia.org/r/c/integration/config/+/1109435 [20:26:06] (03CR) 10Hashar: [C:03+2] "James and I talked about it earlier which has led to this patch. I wasn't sure how to get it approved by developers, then I guess the Sele" [integration/config] - 10https://gerrit.wikimedia.org/r/1109435 (owner: 10Jforrester) [20:27:24] (03Merged) 10jenkins-bot: Zuul: Don't run selenium tests for wmf/ branch back-ports [integration/config] - 10https://gerrit.wikimedia.org/r/1109435 (owner: 10Jforrester) [20:28:53] RoanKattouw: I am dropping the Selenium tests from the wmf/ branches (thanks James_F for the patch and cdanis for the +1 ) [20:29:15] which also mean the patch you have +2ed https://gerrit.wikimedia.org/r/c/mediawiki/core/+/1115098 [20:29:25] no more runs the wmf tests and would merge faster hopefully [20:47:57] 10Gerrit, 06Release-Engineering-Team, 06collaboration-services: Rename gerrit2 unix user to gerrit and assign a fixed uid - https://phabricator.wikimedia.org/T338470#10506291 (10Dzahn) 05Open→03Stalled This is fixed for NEW gerrit machines but we are not changing it for the existing gerrit server. So now... [21:13:44] Thanks! I'm finally going to deploy these patches now, sorry for the delay [21:54:03] Ok that deploy just succeeded, but despite that scap said it failed?! [21:54:25] 21:52:33 backport failed: Command '['/usr/bin/scap', 'sync-world', '--pause-after-testserver-sync', '--notify-user=cdanis', 'Backport for [[gerrit:1115099|resourceloader: Fix hash computation for virtual files with versionFilePath (T385055)]], [[gerrit:1115098|resourceloader: Fix hash computation for virtual files with versionFilePath (T385055)]]']' returned non-zero exit status 1. (scap version: 4.134.0) [21:54:26] T385055: Search disappearing on focus (t.useId is not a function) - https://phabricator.wikimedia.org/T385055 [21:54:46] Oh I think it's because of this: [21:54:47] 21:52:27 sudo -u mwdeploy -n -- /usr/bin/rsync -l deployment.codfw.wmnet::common/wikiversions*.{json,php} /srv/mediawiki (ran as mwdeploy@mw2410.codfw.wmnet) returned [255]: ssh: Could not resolve hostname mw2410.codfw.wmnet: Name or service not known [21:57:15] mw2410 was renamed earlier.. [21:57:22] hnowlan: if you're still about ^ [21:57:31] 16:41 hnowlan@cumin2002: START - Cookbook sre.hosts.rename from mw2410 to wikikube-worker2242 [22:02:11] 10Scap: Consolidate log output if patch is being backported to multiple branches at the same time - https://phabricator.wikimedia.org/T385116 (10Reedy) 03NEW [22:02:16] 10Scap: Consolidate log output if patch is being backported to multiple branches at the same time - https://phabricator.wikimedia.org/T385116#10506623 (10Reedy) p:05Triage→03Low [22:05:52] (03CR) 10Hashar: [C:03+2] zuul: introduce test-wmf pipeline (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/533885 (owner: 10Hashar) [22:08:21] 06Release-Engineering-Team, 10Scap, 06serviceops, 13Patch-For-Review: Retire use of scap proxies - https://phabricator.wikimedia.org/T384196#10506629 (10Reedy) ` [21:55:11] FYI this scap run did print an error: [21:55:12] 21:52:27 sudo -u mwdeploy -n -- /usr/bin/rsync -l deploym... [22:12:07] (03PS2) 10Hashar: zuul: remove composer variant from wmf branches [integration/config] - 10https://gerrit.wikimedia.org/r/1115118 [22:12:08] (03CR) 10Hashar: [C:03+1] "Based on the zuul-layout-diff output, that looks fine :)" [integration/config] - 10https://gerrit.wikimedia.org/r/1115118 (owner: 10Hashar) [22:34:27] RoanKattouw: running puppet on the deploy host should fix that in theory [23:04:57] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for [YOUR DEVELOPER ACCOUNT USERNAME HERE] - https://phabricator.wikimedia.org/T385125 (10Sanskardubeydev) 03NEW [23:14:54] 10Diffusion, 10Phabricator, 10Release-Engineering-Team (Priority Backlog 📥), 10Wikimedia-GitHub: Mirroring of toolforge/spacemedia repo from Diffusion to GitHub is broken - https://phabricator.wikimedia.org/T385126 (10Aklapper) 03NEW p:05Triage→03Low [23:22:17] Project mediawiki-core-doxygen build #7802: 04FAILURE in 4 min 14 sec: https://integration.wikimedia.org/ci/job/mediawiki-core-doxygen/7802/ [23:22:31] FIRING: [2x] ProbeDown: Service gerrit1003:443 has failed probes (http_gerrit_tls_ip4) - https://wikitech.wikimedia.org/wiki/Runbook#gerrit1003:443 - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://alerts.wikimedia.org/?q=alertname%3DProbeDown [23:22:35] 06Release-Engineering-Team, 06collaboration-services: ProbeDown - https://phabricator.wikimedia.org/T385127 (10phaultfinder) 03NEW [23:32:31] RESOLVED: [2x] ProbeDown: Service gerrit1003:443 has failed probes (http_gerrit_tls_ip4) - https://wikitech.wikimedia.org/wiki/Runbook#gerrit1003:443 - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://alerts.wikimedia.org/?q=alertname%3DProbeDown [23:37:27] (03PS1) 10Ejegg: Fix CiviCRM test pipeline [integration/config] - 10https://gerrit.wikimedia.org/r/1115131 [23:38:26] hi again releng! I found another thing to change to get CiviCRM tests all the way switched over to php8.2 ^^^ [23:44:24] 10Diffusion, 10Phabricator, 10Release-Engineering-Team (Priority Backlog 📥), 06collaboration-services: Diffusion repository URIs are a mix of observing gerrit-replica vs gerrit - https://phabricator.wikimedia.org/T385128 (10Aklapper) 03NEW p:05Triage→03Low