[00:00:34] (DatasourceError) firing: Queue (Jenkins jobs + Zuul functions) alert - https://grafana.wikimedia.org/alerting/grafana/iS0FSjJ4z/view - https://wikitech.wikimedia.org/wiki/Monitoring/DatasourceError - https://alerts.wikimedia.org/?q=alertname%3DDatasourceError [00:05:35] (DatasourceError) resolved: Queue (Jenkins jobs + Zuul functions) alert - https://grafana.wikimedia.org/alerting/grafana/iS0FSjJ4z/view - https://wikitech.wikimedia.org/wiki/Monitoring/DatasourceError - https://alerts.wikimedia.org/?q=alertname%3DDatasourceError [05:19:13] 10GitLab: GitLab login 422: email has been taken - https://phabricator.wikimedia.org/T353122 (10MilkyDefer) [08:18:41] 10Continuous-Integration-Config, 10MobileFrontend, 10Developer Productivity, 10Web-Team-Backlog (Needs Prioritization (Tech)): Export MobileFrontend dist files as CI artifacts - https://phabricator.wikimedia.org/T352240 (10kostajh) > I think it might be worth re-evaluating the use of Webpack in MobileFront... [09:39:42] 10GitLab (Project Migration), 10collaboration-services: Migrate SRE repositories to GitLab - operations/debs - https://phabricator.wikimedia.org/T341991 (10LSobanski) [09:43:28] (03CR) 10Hashar: [C: 03+2] Zuul: Add the ContactManager extension to CI [integration/config] - 10https://gerrit.wikimedia.org/r/981630 (owner: 10Zoranzoki21) [09:44:53] slyngs: good morning :) I am adding `operations/software/debmonitor-client` to the zuul/jenkins ci [09:44:56] (03CR) 10Hashar: [C: 03+2] Add debmonitor-client repo [integration/config] - 10https://gerrit.wikimedia.org/r/981464 (owner: 10Slyngshede) [09:45:07] hashar: Cool, thanks [09:45:20] (03Merged) 10jenkins-bot: Zuul: Add the ContactManager extension to CI [integration/config] - 10https://gerrit.wikimedia.org/r/981630 (owner: 10Zoranzoki21) [09:45:30] note, the debian-glue job would only triggers for patches touching something under `./debian` directory [09:45:56] Seems reasonable enough :-) [09:46:13] (03CR) 10Hashar: [C: 03+2] "Deployed" [integration/config] - 10https://gerrit.wikimedia.org/r/981630 (owner: 10Zoranzoki21) [09:47:23] (03Merged) 10jenkins-bot: Add debmonitor-client repo [integration/config] - 10https://gerrit.wikimedia.org/r/981464 (owner: 10Slyngshede) [09:48:56] slyngs: I have triggered a ci `recheck` on https://gerrit.wikimedia.org/r/c/operations/software/debmonitor-client/+/981463 we will see what happens :) [09:49:33] Works on my machine (tm) [09:49:53] * hashar ships slyngs' laptop to prod [09:50:10] Just need a very long ethernet cable [09:50:27] intuitively I would keep the server and client in the same git repo to ease testing between the twos [09:50:32] then I guess you have a good reason for the split :) [09:50:57] `09:48:44 gbp:error: v0.3.2 is not a valid treeishè [09:51:07] I guess cause tags have to be pushed [09:51:55] It doesn't have tags yet, and tox failed as well [09:52:08] also gbp config has `upstream-branch=master` and `debian-branch=debian` [09:52:27] but the change https://gerrit.wikimedia.org/r/c/operations/software/debmonitor-client/+/981463 mix up both the upstream source code and the debian packaging [09:52:56] We decided to split the repository to make it easier to move the server part forward [09:53:00] +1 [09:53:34] Yeah, I'll need to figure out if we want to keep the debian stuff in a separate branch or just have it in the master branch. [09:54:08] I am not sure whether we have a consistent way of doing it :( [09:55:04] Probably not... It only works on deb based distributions, so there might not be a big need for a debian branch. Anyway, I shall go fix the brokeness... in a bit [09:55:24] ping me if you need help, maybe I can assist :-] [09:55:32] Thanks :-) [09:55:50] and I am happy to be the otherside of a long rant/discussion about the debian packaging tooling + how it is integrated on our CI [09:56:06] (last time the person went to install Arch Linux) [09:56:17] (kidding) [09:56:52] (03CR) 10Hashar: [C: 03+2] Archive pdns-recursor repositories [integration/config] - 10https://gerrit.wikimedia.org/r/981573 (https://phabricator.wikimedia.org/T347623) (owner: 10BCornwall) [09:58:31] (03Merged) 10jenkins-bot: Archive pdns-recursor repositories [integration/config] - 10https://gerrit.wikimedia.org/r/981573 (https://phabricator.wikimedia.org/T347623) (owner: 10BCornwall) [09:59:28] (03CR) 10Hashar: [C: 03+2] "I have deleted the GitHub mirrors" [integration/config] - 10https://gerrit.wikimedia.org/r/981573 (https://phabricator.wikimedia.org/T347623) (owner: 10BCornwall) [10:04:24] (03CR) 10Hashar: [C: 03+2] Archive operations/software/varnish/vhtcpd [integration/config] - 10https://gerrit.wikimedia.org/r/981394 (owner: 10BCornwall) [10:06:08] (03CR) 10Hashar: [C: 03+2] Archive operations/debs/coredns [integration/config] - 10https://gerrit.wikimedia.org/r/981384 (https://phabricator.wikimedia.org/T347623) (owner: 10BCornwall) [10:06:25] (03Merged) 10jenkins-bot: Archive operations/software/varnish/vhtcpd [integration/config] - 10https://gerrit.wikimedia.org/r/981394 (owner: 10BCornwall) [10:08:21] (03Merged) 10jenkins-bot: Archive operations/debs/coredns [integration/config] - 10https://gerrit.wikimedia.org/r/981384 (https://phabricator.wikimedia.org/T347623) (owner: 10BCornwall) [10:13:10] (03CR) 10Hashar: [C: 03+2] Archive libvmod-{header,re2,tbf,uuid,vslp} [integration/config] - 10https://gerrit.wikimedia.org/r/980975 (https://phabricator.wikimedia.org/T347623) (owner: 10BCornwall) [10:13:19] (03CR) 10CI reject: [V: 04-1] Archive libvmod-{header,re2,tbf,uuid,vslp} [integration/config] - 10https://gerrit.wikimedia.org/r/980975 (https://phabricator.wikimedia.org/T347623) (owner: 10BCornwall) [10:33:07] 10Release-Engineering-Team (Seen), 10MW-on-K8s, 10SRE, 10Traffic, 10serviceops: Move MediaWiki jobs to mw-on-k8s - https://phabricator.wikimedia.org/T349796 (10hnowlan) [11:06:17] (03PS3) 10Hashar: Archive libvmod-{header,re2,tbf,uuid,vslp} [integration/config] - 10https://gerrit.wikimedia.org/r/980975 (https://phabricator.wikimedia.org/T347623) (owner: 10BCornwall) [11:07:25] (03CR) 10Hashar: [C: 03+2] "I have rebased and fixed the conflicts with the archival of operations/software/varnish/vhtcpd I31a48cc693e287a96c3f209f0c01f2bda15e64bb" [integration/config] - 10https://gerrit.wikimedia.org/r/980975 (https://phabricator.wikimedia.org/T347623) (owner: 10BCornwall) [11:09:11] (03Merged) 10jenkins-bot: Archive libvmod-{header,re2,tbf,uuid,vslp} [integration/config] - 10https://gerrit.wikimedia.org/r/980975 (https://phabricator.wikimedia.org/T347623) (owner: 10BCornwall) [12:09:27] 10Continuous-Integration-Config, 10ci-test-error: CI tests for the ContactManager extension are failing because of missing php-imap library - https://phabricator.wikimedia.org/T353137 (10Kizule) [12:11:34] 10Continuous-Integration-Config, 10ci-test-error: CI tests for the ContactManager extension are failing because of missing php-imap library - https://phabricator.wikimedia.org/T353137 (10Kizule) [14:57:49] Hello, I have a new kukkuri publishing job that seems to be having trouble using `npm` on the trusted gitlab runners due to network access. https://gitlab.wikimedia.org/repos/data-engineering/superset/-/jobs/174546#L1005 [14:58:33] I thought that this was generally permitted now, as per this update: https://phabricator.wikimedia.org/T320730#9245430 [14:58:52] Could anyone take a quick look and tell me if I'm doing something wrong please? [14:58:55] Thanks. [15:05:57] 10Continuous-Integration-Config, 10ci-test-error: CI tests for the ContactManager extension are failing because of missing php-imap library - https://phabricator.wikimedia.org/T353137 (10hashar) The workaround I found is to set the imap extension in the composer configuration to some arbitrary version: ` lang=... [15:42:10] 10GitLab (Project Migration), 10collaboration-services, 10Patch-For-Review, 10SRE Observability (FY2023/2024-Q2): Migrate SRE repositories to GitLab - operations/alerts - https://phabricator.wikimedia.org/T349626 (10LSobanski) a:03LSobanski [15:53:35] 10Release-Engineering-Team (Priority Backlog 📥), 10Projects-Cleanup, 10collaboration-services: Migrate SRE repositories to GitLab - Archiving unused Gerrit repositories - https://phabricator.wikimedia.org/T343707 (10LSobanski) operations/software/wmfdb [17:09:00] 10GitLab (Account Approval), 10Release-Engineering-Team: Requesting GitLab account activation for Hawkeye7 - https://phabricator.wikimedia.org/T353036 (10bd808) This task arose because of a comment I made on {T311466}: >>! In T311466#9392219, @bd808 wrote: >>>! In T311466#9392107, @Hawkeye7 wrote: >> When I tr... [17:09:41] 10GitLab (Account Approval), 10Release-Engineering-Team: Requesting GitLab account activation for Ross Mallett - https://phabricator.wikimedia.org/T353036 (10bd808) [17:31:29] 10GitLab (Account Approval), 10Release-Engineering-Team: Requesting GitLab account activation for Ross Mallett - https://phabricator.wikimedia.org/T353036 (10bd808) 05Open→03Resolved The https://gitlab.wikimedia.org/rmallett account exists since 2021-11-26 and is marked as active. That resolves the specif... [17:34:59] 10GitLab, 10Striker: Maintainer 'Ross Mallett' unable to create new GitLab repositories connected to the 'milhistbot' tool using Striker - https://phabricator.wikimedia.org/T353176 (10bd808) [17:36:37] 10GitLab (Integrations), 10Striker, 10User-bd808: Maintainer 'Ross Mallett' unable to create new GitLab repositories connected to the 'milhistbot' tool using Striker - https://phabricator.wikimedia.org/T353176 (10bd808) 05Open→03In progress p:05Triage→03Medium a:03bd808 [17:37:22] btullis: I took a look. This part of the output looks suspicious: `RUN npm "--proxy" "${HTTPS_PROXY:+null}" "ci"` [17:40:00] btullis: but I see now that you added that in an attempt to debug. [17:41:01] The http_proxy, https_proxy, and no_proxy environment variables are set up for you by kokkuri. [17:42:17] It's unclear why you're getting ECONNRESET. I see jobs from other repos successfully using npm on the trusted runners. For example https://gitlab.wikimedia.org/repos/abstract-wiki/wikifunctions/function-evaluator/-/jobs/174482 [17:42:21] 10GitLab (Project Migration), 10Traffic, 10Patch-For-Review: Migrate Traffic repositories from Gerrit to Gitlab - https://phabricator.wikimedia.org/T347623 (10BCornwall) [17:46:48] 10GitLab (Project Migration), 10Traffic, 10Patch-For-Review: Migrate Traffic repositories from Gerrit to Gitlab - https://phabricator.wikimedia.org/T347623 (10BCornwall) [17:59:08] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team, 10MediaWiki-extensions-StopForumSpam, 10Quibble: api.php?format=json (FormatJson.php) Allowed memory size fatal error in quibble-vendor-mysql-php74-selenium-docker - https://phabricator.wikimedia.org/T353001 (10sbassett) Well, this does a... [18:09:40] 10GitLab (Project Migration), 10Traffic, 10Patch-For-Review: Migrate Traffic repositories from Gerrit to Gitlab - https://phabricator.wikimedia.org/T347623 (10BCornwall) [18:09:56] 10GitLab (Integrations), 10Striker, 10User-bd808: Maintainer 'Ross Mallett' unable to create new GitLab repositories connected to the 'milhistbot' tool using Striker - https://phabricator.wikimedia.org/T353176 (10bd808) This is basically the lookup algorithm that is failing when Striker tries to create a new... [18:12:36] 10GitLab (Integrations), 10Striker, 10User-bd808: Maintainer 'Ross Mallett' unable to create new GitLab repositories connected to the 'milhistbot' tool using Striker - https://phabricator.wikimedia.org/T353176 (10bd808) @Hawkeye7 You should be able to fix this problem specifically for your https://gitlab.wik... [18:16:51] btullis: I re-ran the job. It seemed to make more progress than your earlier attempts, but it still failed: https://gitlab.wikimedia.org/repos/data-engineering/superset/-/jobs/174596 [18:17:16] 10Gerrit: Gerrit UI shows PCC data on non-puppet.git patches that had experimental builds - https://phabricator.wikimedia.org/T353181 (10taavi) [18:35:01] 10GitLab (Integrations), 10Striker, 10User-bd808: Maintainer 'Ross Mallett' unable to create new GitLab repositories connected to the 'milhistbot' tool using Striker - https://phabricator.wikimedia.org/T353176 (10bd808) Past-bd808 knew this was a potential problem, but present bd808 forgot: >>! In T343485#9... [18:39:44] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team, 10MediaWiki-extensions-StopForumSpam, 10Quibble: api.php?format=json (FormatJson.php) Allowed memory size fatal error in quibble-vendor-mysql-php74-selenium-docker - https://phabricator.wikimedia.org/T353001 (10sbassett) 05Open→03Resol... [18:43:07] 10GitLab (Integrations), 10Striker, 10User-bd808: GitLab users with only provider=cas3 identies as not found when Striker attempts to create GitLab repostories - https://phabricator.wikimedia.org/T353176 (10bd808) [18:43:14] 10GitLab (Integrations), 10Striker, 10User-bd808: GitLab users with only provider=cas3 identies are not found when Striker attempts to create GitLab repostories - https://phabricator.wikimedia.org/T353176 (10bd808) [18:45:31] 10Release-Engineering-Team (Priority Backlog 📥), 10Release, 10Train Deployments, 10User-brennen: 1.42.0-wmf.9 deployment blockers - https://phabricator.wikimedia.org/T350085 (10brennen) [19:59:40] 10Release-Engineering-Team, 10Fundraising-Backlog, 10MediaWiki-extensions-FundraiserLandingPage, 10donate.wikimedia.org, and 2 others: donate.wikimedia.org landing pages don't have descriptions in search engine results - https://phabricator.wikimedia.org/T254808 (10Ejegg) @Pcoombe I just tried adding All... [20:44:51] 10Release-Engineering-Team: `npm ci` not working on trusted runners for https://gitlab.wikimedia.org/repos/data-engineering/superset - https://phabricator.wikimedia.org/T353197 (10dancy) [20:45:28] 10GitLab, 10Release-Engineering-Team: `npm ci` not working on trusted runners for https://gitlab.wikimedia.org/repos/data-engineering/superset - https://phabricator.wikimedia.org/T353197 (10dancy) [21:14:12] (03PS2) 10Jforrester: jjb: Migrate codex-docker-doc-* to Node 18 [integration/config] - 10https://gerrit.wikimedia.org/r/980389 (https://phabricator.wikimedia.org/T352768) [21:14:14] (03PS2) 10Jforrester: Zuul: [design/codex] Switch to Node 18 [integration/config] - 10https://gerrit.wikimedia.org/r/980390 (https://phabricator.wikimedia.org/T352768) [21:14:28] (03CR) 10Jforrester: [C: 03+2] "Deployed." [integration/config] - 10https://gerrit.wikimedia.org/r/980389 (https://phabricator.wikimedia.org/T352768) (owner: 10Jforrester) [21:14:34] (03CR) 10Jforrester: [C: 03+2] Zuul: [design/codex] Switch to Node 18 [integration/config] - 10https://gerrit.wikimedia.org/r/980390 (https://phabricator.wikimedia.org/T352768) (owner: 10Jforrester) [21:16:25] (03Merged) 10jenkins-bot: jjb: Migrate codex-docker-doc-* to Node 18 [integration/config] - 10https://gerrit.wikimedia.org/r/980389 (https://phabricator.wikimedia.org/T352768) (owner: 10Jforrester) [21:16:30] (03Merged) 10jenkins-bot: Zuul: [design/codex] Switch to Node 18 [integration/config] - 10https://gerrit.wikimedia.org/r/980390 (https://phabricator.wikimedia.org/T352768) (owner: 10Jforrester) [21:17:34] !log Zuul: [design/codex] Switch to Node 18 for T352768 [21:17:38] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [21:17:38] T352768: Migrate Codex CI from Node 16 to Node 18 - https://phabricator.wikimedia.org/T352768 [21:26:29] 10Phabricator: Phabricator: "Construction of a DateTime() with epoch 'YYYY-MM-DD' raised an exception" - https://phabricator.wikimedia.org/T353102 (10Aklapper) We have three custom date fields: "Est. Start Date", "Due Date", "Release Date". There is no faulty value in `maniphest_customfieldstorage` but in `mani... [21:27:02] 10Phabricator: Phabricator: "Construction of a DateTime() with epoch 'YYYY-MM-DD' raised an exception" - https://phabricator.wikimedia.org/T353102 (10Aklapper) Found https://phabricator.wikimedia.org/T204756 triggering this. That's the only occurrence in our DB. We should manually UPDATE the two database values... [21:31:15] (03PS2) 10Jforrester: jjb: Drop branchdeploy-codex-node16-npm-docker, no longer used [integration/config] - 10https://gerrit.wikimedia.org/r/980393 (https://phabricator.wikimedia.org/T352768) [21:31:19] 10Continuous-Integration-Config: Upgrade all CI jobs for WMF-deployed projects from Node 16 to Node 18 - https://phabricator.wikimedia.org/T331180 (10Jdforrester-WMF) [21:31:35] (03CR) 10Jforrester: [C: 03+1] "Let's wait a week or two for Codex to confirm Node 18 is fully working." [integration/config] - 10https://gerrit.wikimedia.org/r/980393 (https://phabricator.wikimedia.org/T352768) (owner: 10Jforrester) [21:31:56] 10Continuous-Integration-Config, 10Codex, 10Design-Systems-Team, 10Patch-For-Review: Migrate Codex CI from Node 16 to Node 18 - https://phabricator.wikimedia.org/T352768 (10Jdforrester-WMF) 05Open→03Resolved a:03Jdforrester-WMF >>! In T352768#9392102, @egardner wrote: >>>! In T352768#9382994, @Jdforr... [21:36:36] 10Continuous-Integration-Config, 10Codex, 10Design-Systems-Team, 10Patch-For-Review: Migrate Codex CI from Node 16 to Node 18 - https://phabricator.wikimedia.org/T352768 (10egardner) >>! In T352768#9398075, @Jdforrester-WMF wrote: >>>! In T352768#9392102, @egardner wrote: >>>>! In T352768#9382994, @Jdforre... [22:17:02] 10Phabricator (Upstream), 10Upstream: Phabricator Exception: Construction of a DateTime() with epoch raised - https://phabricator.wikimedia.org/T210338 (10Aklapper) >>! In T210338#5309933, @Aklapper wrote: > Cannot reproduce this problem anymore on https://phabricator.wikimedia.org/T204757 That's because "Kri... [22:17:16] 10Phabricator: Phabricator: "Construction of a DateTime() with epoch 'YYYY-MM-DD' raised an exception" - https://phabricator.wikimedia.org/T353102 (10Aklapper) [22:17:28] 10Phabricator (Upstream), 10Upstream: Phabricator Exception: Construction of a DateTime() with epoch raised - https://phabricator.wikimedia.org/T210338 (10Aklapper) [22:43:43] (03PS2) 10Hashar: Add a banner for the 2023 developer survey [software/gerrit] (deploy/wmf/stable-3.5) - 10https://gerrit.wikimedia.org/r/974166 (https://phabricator.wikimedia.org/T351109) [22:47:30] (03CR) 10Hashar: "PS2 adds a `[DISMISS]` button next to the link. On click that:" [software/gerrit] (deploy/wmf/stable-3.5) - 10https://gerrit.wikimedia.org/r/974166 (https://phabricator.wikimedia.org/T351109) (owner: 10Hashar) [22:51:31] ^ the lame "let users dismiss a banner by using localStorage" [23:28:01] 10Release-Engineering-Team (Priority Backlog 📥), 10Release, 10Train Deployments, 10User-brennen: 1.42.0-wmf.9 deployment blockers - https://phabricator.wikimedia.org/T350085 (10matmarex) [23:31:05] 10GitLab (Integrations), 10Striker, 10User-bd808: GitLab users with only provider=cas3 identies are not found when Striker attempts to create GitLab repostories - https://phabricator.wikimedia.org/T353176 (10bd808) `lang=shell-session $ export GITLAB_HOST=gitlab.wikimedia.org $ glab api users --paginate > pa...