[00:59:23] (03CR) 10Raymond Ndibe: tox-poetry-buster: upgrade poetry install script and upgrade to 1.2.2 (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/850515 (https://phabricator.wikimedia.org/T321915) (owner: 10David Caro) [02:54:07] (03PS1) 10Krinkle: zuul: Remove unused lib/bootstrap/ and TwbsPageBase.php [integration/docroot] - 10https://gerrit.wikimedia.org/r/851746 (https://phabricator.wikimedia.org/T322168) [02:54:09] (03PS1) 10Krinkle: [WIP] zuul: Convert logic to vanilla JavaScript [integration/docroot] - 10https://gerrit.wikimedia.org/r/851747 [08:17:27] (03CR) 10David Caro: tox-poetry-buster: upgrade poetry install script and upgrade to 1.2.2 (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/850515 (https://phabricator.wikimedia.org/T321915) (owner: 10David Caro) [09:55:05] 10Release-Engineering-Team (Seen), 10MW-on-K8s, 10SRE, 10Traffic, and 3 others: Deploy mediawiki kubernetes services - https://phabricator.wikimedia.org/T321786 (10Clement_Goubert) [09:55:45] 10Release-Engineering-Team (Seen), 10MW-on-K8s, 10SRE, 10Traffic, and 2 others: Create mw-videoscaler helmfile deployment - https://phabricator.wikimedia.org/T321899 (10Clement_Goubert) 05Open→03Stalled Following https://gerrit.wikimedia.org/r/c/operations/deployment-charts/+/850095/comment/af29135f_66... [09:56:57] !log update to HAProxy 2.6.6 in deployment-cache-(text|upload)07 - T321775 [09:56:59] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [09:56:59] T321775: Upgrade HAProxy on cp nodes to 2.6.x LTS - https://phabricator.wikimedia.org/T321775 [10:25:41] 10Continuous-Integration-Infrastructure, 10Patch-For-Review: Update Zuul status page to WMUI (remove last bit of Bootstrap) - https://phabricator.wikimedia.org/T322168 (10Umherirrender) [10:45:35] 10GitLab (CI & Job Runners), 10Release-Engineering-Team, 10serviceops-collab: Self-build and publish buildkit helper images - https://phabricator.wikimedia.org/T321316 (10Jelto) >>! In T321316#8360286, @dduvall wrote: > > The copy image is used to provide semantics for `ADD`/`COPY` Dockerfile instructions (... [10:54:09] hashar: in Gerrit, there used to be an easy way to get the commit hash of a merged patch. Do you know if upstream removed that functionality, or was it moved somewhere else in the UI? [10:54:51] Ah... it's next to the patchset version picker. It used to be in the top left, IIRC [10:54:53] kostajh: hmm [10:55:05] yes indeed [10:55:08] they must have moved it [10:55:17] https://imgur.com/a/UPLJn2W [10:55:29] I think Google has mouse movement/click tracking on their internal instances [10:55:43] and use those data to understand end users behavior and move some elements here and there [10:56:05] and/or UX people are enhancing things [10:56:41] ack [10:56:44] looks like in Gerrit 3.7 (we run 3.4) it is still at the same place https://gerrit-review.googlesource.com/c/bazlets/+/348435 [11:17:03] 10Continuous-Integration-Infrastructure, 10Patch-For-Review: poetry is not working in tox-poetry-buster:0.0.2 - https://phabricator.wikimedia.org/T321915 (10hashar) [11:18:35] 10Continuous-Integration-Infrastructure, 10Patch-For-Review: poetry is not working in tox-poetry-buster:0.0.2 - https://phabricator.wikimedia.org/T321915 (10hashar) The Docker images uses `get-poetry.py` without specifying any version: ` lang=Dockerfile RUN python3 /opt/poetry/get-poetry.py --no-modify-path `... [11:25:34] (03CR) 10Hashar: tox-poetry-buster: upgrade poetry install script and upgrade to 1.2.2 (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/850515 (https://phabricator.wikimedia.org/T321915) (owner: 10David Caro) [11:25:38] (03PS7) 10Hashar: tox-poetry-buster: upgrade poetry install script and upgrade to 1.2.2 [integration/config] - 10https://gerrit.wikimedia.org/r/850515 (https://phabricator.wikimedia.org/T321915) (owner: 10David Caro) [11:26:18] (03CR) 10Hashar: [C: 03+2] "Thanks!! :] I will build it, switch the jobs to the new image and recheck the faulty patch at https://gerrit.wikimedia.org/r/c/cloud/toolf" [integration/config] - 10https://gerrit.wikimedia.org/r/850515 (https://phabricator.wikimedia.org/T321915) (owner: 10David Caro) [11:27:26] F~. [11:27:43] Sorry, dead term [11:28:06] (03Merged) 10jenkins-bot: tox-poetry-buster: upgrade poetry install script and upgrade to 1.2.2 [integration/config] - 10https://gerrit.wikimedia.org/r/850515 (https://phabricator.wikimedia.org/T321915) (owner: 10David Caro) [11:33:54] (03PS1) 10Hashar: jjb: update tox-poetry-docker [integration/config] - 10https://gerrit.wikimedia.org/r/852153 (https://phabricator.wikimedia.org/T321915) [11:39:05] 10Continuous-Integration-Infrastructure, 10Patch-For-Review: poetry is not working in tox-poetry-buster:0.0.2 - https://phabricator.wikimedia.org/T321915 (10hashar) 05Open→03Resolved a:03dcaro https://gerrit.wikimedia.org/r/c/cloud/toolforge/toolforge-cli/+/850506 works now! Thank you to have gotten rid... [11:39:09] 10Continuous-Integration-Infrastructure, 10Patch-For-Review: Add Python 3.9 to Wikimedia CI - https://phabricator.wikimedia.org/T289222 (10hashar) [11:41:41] 10Beta-Cluster-Infrastructure, 10serviceops, 10Beta-Cluster-reproducible: Thumbnails on beta cluster return 503 Service Unavailable - https://phabricator.wikimedia.org/T321654 (10jbond) [12:11:05] o_O https://integration.wikimedia.org/zuul/ looks different [12:12:29] Lucas_WMDE: Krinkle has done some modifications recently [12:13:08] I haven't reviewed them yet though, I guess he went to deploy them ;) [12:13:50] looks more modern, but also less readable unless I zoom to 150% or so [12:30:41] 10Scap, 10SRE: Wrong umask when deploying from screen - https://phabricator.wikimedia.org/T200690 (10jbond) 05Open→03Resolved a:03jbond >>! In T200690#8265133, @dancy wrote: > @Tgr Can you confirm that this is still a problem? As there has been no response and the fact this task is now ~4 years old im g... [12:35:30] Lucas_WMDE: patch welcome that preserves three columns and mostly not wrapping job names. WMUI is more in efficient in space than bootstrap but also there's a sidebar.. fiddled a lot to strike a balance. I made some unimportant text smaller to feel more focussed. But we could try to bump Project and job names up a bit. Will continue a bit more today to get rid of the old bootstrap code [12:35:47] https://phabricator.wikimedia.org/T322168 [12:36:38] I’ll try to take a look later [12:37:16] but my interpretation of the tiny pipeline descriptions wasn’t “these are unimportant and I shouldn’t read them” but rather “wow I need to zoom in a lot to be able to read these” [12:37:24] even already knowing what the descriptions are :/ [12:42:23] (03CR) 10Hashar: [C: 03+2] Zuul: [mediawiki/extensions/PhotoSwipe] Add [integration/config] - 10https://gerrit.wikimedia.org/r/851623 (owner: 10Umherirrender) [12:43:32] hmm the Zuul status page doesn't work for me :D [12:43:38] Uncaught ReferenceError: zuul_start is not defined [12:43:38] https://integration.wikimedia.org/zuul/init.js:54 [12:43:39] https://integration.wikimedia.org/zuul/init.js:56 [12:43:53] damn cache [12:44:26] (03Merged) 10jenkins-bot: Zuul: [mediawiki/extensions/PhotoSwipe] Add [integration/config] - 10https://gerrit.wikimedia.org/r/851623 (owner: 10Umherirrender) [12:45:23] I had to purge my browser cache [12:48:25] (03CR) 10Hashar: [C: 03+2] "I have updated the job earlier." [integration/config] - 10https://gerrit.wikimedia.org/r/852153 (https://phabricator.wikimedia.org/T321915) (owner: 10Hashar) [12:50:12] (03Merged) 10jenkins-bot: jjb: update tox-poetry-docker [integration/config] - 10https://gerrit.wikimedia.org/r/852153 (https://phabricator.wikimedia.org/T321915) (owner: 10Hashar) [12:52:31] hashar: yeah there's something weird about int.wm.o and doc.wm.o I've reported this a number of times especially for code coverage reports. Affects cache POPs as well. When a report is regenerated, the first view on it can often be stale even if hours later. Then the second one after that is fine. We could add a cache buster or shorten the cache somewhere to eg 5min should be more than enough [12:53:08] Probably a side effect of Varnish cache_misc now being merged into cache_text. That made many miss web services more cached [14:23:29] Hi i am trying to add the branch name as part of the docker image tag when publishing images using CI. In the jenkins logs I see that `branch: null`. Is there any example on how to do that using pipelinelib? [14:23:53] Here is what we tried: https://gerrit.wikimedia.org/r/c/mediawiki/services/mobileapps/+/851612 [14:29:15] 10GitLab (CI & Job Runners), 10Release-Engineering-Team, 10mwcli, 10serviceops-collab: Consider adding "official" golang images to list of allowed images for gitlab runners - https://phabricator.wikimedia.org/T320825 (10Jelto) [14:31:03] nemo-yiannis: it is broken, the commit is checkout detached thus `GIT_BRANCH` is set to `detached` and the exposed setup.branch is indeed set to null [14:32:04] can we use ZUUL_BRANCH instead? I tried once but failed: https://integration.wikimedia.org/ci/job/trigger-mobileapps-pipeline-publish/53/console [14:32:16] nemo-yiannis: may you file a task in Phabricator against `#releasepipeline` [14:32:32] ok [14:33:08] there must be something broken somewhere in the code but I can't tell where since I am not familiar with it :-\ [14:44:03] (03CR) 10Hashar: [C: 04-1] "CI triggers for 3.6, 3.7 and 3.8. Don't you want to add 3.9? I am not sure why you drop 3.8 but keep 3.6/3.7 ;)" [integration/config] - 10https://gerrit.wikimedia.org/r/851599 (owner: 10Xqt) [14:55:25] FYI it came up in the Language team chat (as well, reading the backlog here) that the lighweight text on gray backround on https://integration.wikimedia.org/zuul/ is more difficult to read than in the old look, especially the cards [14:58:07] 10Beta-Cluster-Infrastructure, 10serviceops, 10Beta-Cluster-reproducible: Thumbnails on beta cluster return 503 Service Unavailable - https://phabricator.wikimedia.org/T321654 (10AlexisJazz) The message has changed: >Unauthorized >This server could not verify that you are authorized to access the document y... [15:01:11] Nikerabbit: Agreed. Very hard to read. Anemic font [15:06:12] congrats jeena on 4 years! [15:09:01] Yay! Congrats! [15:14:54] ^ [15:30:11] 10Beta-Cluster-Infrastructure, 10serviceops, 10Beta-Cluster-reproducible: Thumbnails on beta cluster return 503 Service Unavailable - https://phabricator.wikimedia.org/T321654 (10Vgutierrez) that message is provided by deployment-ms-fe03, I've captured one of my requests between ats-be in deployment-cache-up... [15:31:28] (03PS1) 10Lucas Werkmeister (WMDE): Remove .zuul-change font-weight [integration/docroot] - 10https://gerrit.wikimedia.org/r/852221 (https://phabricator.wikimedia.org/T322168) [15:31:48] dancy: ^ might help with the “anemic” font (at least it looks better to me) [15:32:22] and congrats jeena \o/ [15:49:13] 10Beta-Cluster-Infrastructure, 10serviceops, 10Beta-Cluster-reproducible: Thumbnails on beta cluster return 503 Service Unavailable - https://phabricator.wikimedia.org/T321654 (10Vgutierrez) digging a little bit on swift logs: ` Nov 2 15:40:41 deployment-ms-fe03 proxy-server: ERROR with Account server 172.1... [15:53:41] 10Beta-Cluster-Infrastructure, 10serviceops, 10Beta-Cluster-reproducible: Thumbnails on beta cluster return 503 Service Unavailable - https://phabricator.wikimedia.org/T321654 (10Vgutierrez) well... deployment-ms-be05 and deployment-ms-be06 have been powered off.. I'm assuming because those two are running d... [15:54:25] anybody knows who handles deployment-prep swift deploy? [15:54:59] deployment-ms-be0[56] have been powered off cause those were running debian stretch [15:55:31] so basically deployment-ms-fe03 doesn't have available backends anymore, hence upload.wikimedia.beta.wmflabs.org is broken [16:00:33] vgutierrez: no-one, T215217 [16:00:33] T215217: deployment-prep: Code stewardship request - https://phabricator.wikimedia.org/T215217 [16:01:09] lovely(TM) [16:10:50] 10Beta-Cluster-Infrastructure: Create new deployment-ms-be instances running Debian Bullseye - https://phabricator.wikimedia.org/T322231 (10Vgutierrez) [16:18:09] 10Beta-Cluster-Infrastructure: Create new deployment-ms-be instances running Debian Bullseye - https://phabricator.wikimedia.org/T322231 (10taavi) [16:18:12] 10Beta-Cluster-Infrastructure, 10SRE-swift-storage: Upgrade deployment-prep Swift cluster to Debian Buster or newer - https://phabricator.wikimedia.org/T298253 (10taavi) [16:18:33] thx taavi :) [16:26:17] 10Beta-Cluster-Infrastructure: Create new deployment-ms-be instances running Debian Bullseye - https://phabricator.wikimedia.org/T322231 (10Vgutierrez) p:05Triage→03Medium [16:30:13] 10Beta-Cluster-Infrastructure, 10Cloud-VPS (Debian Stretch Deprecation): Cloud VPS "deployment-prep" project Stretch deprecation - https://phabricator.wikimedia.org/T306068 (10Vgutierrez) [16:50:56] (03CR) 10Ahmon Dancy: "A couple of nits, otherwise ok" [tools/release] - 10https://gerrit.wikimedia.org/r/849172 (owner: 10Stef Dunlap) [16:51:31] 10Phabricator, 10Dumps-Generation, 10serviceops-collab, 10cloud-services-team (Kanban): The service unit dumps-fetch-phabdumps.service is in failed status on host clouddumps1002 - https://phabricator.wikimedia.org/T322221 (10Dzahn) [17:00:17] 10Release-Engineering-Team (Seen), 10serviceops-collab: contint hardware refresh - https://phabricator.wikimedia.org/T294276 (10Dzahn) [17:02:07] (03CR) 10Hashar: [C: 03+2] "Indeed that was barely readable to me as well. Tested locally using:" [integration/docroot] - 10https://gerrit.wikimedia.org/r/852221 (https://phabricator.wikimedia.org/T322168) (owner: 10Lucas Werkmeister (WMDE)) [17:02:48] (03Merged) 10jenkins-bot: Remove .zuul-change font-weight [integration/docroot] - 10https://gerrit.wikimedia.org/r/852221 (https://phabricator.wikimedia.org/T322168) (owner: 10Lucas Werkmeister (WMDE)) [17:03:06] 10Release-Engineering-Team (Seen), 10serviceops-collab: contint hardware refresh - https://phabricator.wikimedia.org/T294276 (10Dzahn) [17:04:32] 10Phabricator, 10Dumps-Generation, 10serviceops-collab, 10cloud-services-team (Kanban): The service unit dumps-fetch-phabdumps.service is in failed status on host clouddumps1002 - https://phabricator.wikimedia.org/T322221 (10Dzahn) 05Open→03In progress p:05Triage→03Medium [17:08:48] 10Phabricator, 10Dumps-Generation, 10serviceops-collab, 10cloud-services-team (Kanban): The service unit dumps-fetch-phabdumps.service is in failed status on host clouddumps1002 - https://phabricator.wikimedia.org/T322221 (10Dzahn) Hello @Andrew! Getting right on this. I see that meanwhile someone added `p... [17:11:24] 10Beta-Cluster-Infrastructure, 10Patch-For-Review: Create new deployment-ms-be instances running Debian Bullseye - https://phabricator.wikimedia.org/T322231 (10Vgutierrez) 05Open→03In progress [17:11:26] 10Beta-Cluster-Infrastructure, 10serviceops, 10Beta-Cluster-reproducible: Thumbnails on beta cluster return 503 Service Unavailable - https://phabricator.wikimedia.org/T321654 (10Vgutierrez) [17:11:48] (03CR) 10Xqt: [pywikibot/core] Use Python 3.9 instead of 3.8 for fasttest (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/851599 (owner: 10Xqt) [17:16:54] (03PS1) 10Xqt: [pywikibot/core] Add deeptest with Python 3.9 [integration/config] - 10https://gerrit.wikimedia.org/r/852248 [17:18:33] (03CR) 10Hashar: [C: 03+2] "I have created the Jenkins job, will reload Zuul as soon as this merges." [integration/config] - 10https://gerrit.wikimedia.org/r/852248 (owner: 10Xqt) [17:20:15] 10Beta-Cluster-Infrastructure: Set up an alerting server - https://phabricator.wikimedia.org/T318247 (10TheresNoTime) a:05TheresNoTime→03None [17:20:20] 10Beta-Cluster-Infrastructure, 10SRE-OnFire, 10Patch-For-Review, 10Sustainability (Incident Followup): Add basic alerting to the Beta Cluster - https://phabricator.wikimedia.org/T315695 (10TheresNoTime) a:05TheresNoTime→03None [17:20:31] (03Merged) 10jenkins-bot: [pywikibot/core] Add deeptest with Python 3.9 [integration/config] - 10https://gerrit.wikimedia.org/r/852248 (owner: 10Xqt) [17:21:28] (03CR) 10Hashar: [C: 03+2] "Deployed" [integration/config] - 10https://gerrit.wikimedia.org/r/852248 (owner: 10Xqt) [17:24:48] (03CR) 10Xqt: [pywikibot/core] Add deeptest with Python 3.9 (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/852248 (owner: 10Xqt) [17:25:04] 10Release-Engineering-Team, 10serviceops, 10Patch-For-Review: PendingDeprecationWarning on update_version.py - https://phabricator.wikimedia.org/T310133 (10TheresNoTime) a:05TheresNoTime→03None [17:28:33] 10Phabricator, 10Dumps-Generation, 10serviceops-collab, 10cloud-services-team (Kanban): The service unit dumps-fetch-phabdumps.service is in failed status on host clouddumps1002 - https://phabricator.wikimedia.org/T322221 (10Dzahn) So.. what's actually happening here is totally unrelated to either phab1001... [17:41:32] 10Phabricator, 10Dumps-Generation, 10serviceops-collab, 10Patch-For-Review, 10cloud-services-team (Kanban): The service unit dumps-fetch-phabdumps.service is in failed status on host clouddumps1002 - https://phabricator.wikimedia.org/T322221 (10Dzahn) @Andrew fixed! ` root@clouddumps1002:/# /usr/local/b... [17:41:54] 10Phabricator, 10Dumps-Generation, 10serviceops-collab, 10Patch-For-Review, 10cloud-services-team (Kanban): The service unit dumps-fetch-phabdumps.service is in failed status on host clouddumps1002 - https://phabricator.wikimedia.org/T322221 (10Dzahn) 05In progress→03Resolved [18:00:02] Thanks greg-g dancy brennen Lucas_WMDE :) [18:22:58] 10Phabricator, 10Release-Engineering-Team (Bonus Level 🕹️), 10serviceops-collab: decom phab2001 - https://phabricator.wikimedia.org/T322250 (10Dzahn) [18:23:26] 10Phabricator, 10Release-Engineering-Team (Bonus Level 🕹️), 10serviceops-collab: decom phab2001 - https://phabricator.wikimedia.org/T322250 (10Dzahn) 05Open→03In progress [18:23:29] 10Phabricator, 10Release-Engineering-Team (Bonus Level 🕹️), 10serviceops, 10serviceops-collab, 10Patch-For-Review: move phabricator to new hardware generation - https://phabricator.wikimedia.org/T280597 (10Dzahn) [18:38:30] 10Phabricator, 10Dumps-Generation, 10serviceops-collab, 10Patch-For-Review, 10cloud-services-team (Kanban): The service unit dumps-fetch-phabdumps.service is in failed status on host clouddumps1002 - https://phabricator.wikimedia.org/T322221 (10Andrew) thanks! [18:48:30] 10Beta-Cluster-Infrastructure, 10serviceops, 10Beta-Cluster-reproducible: Thumbnails on beta cluster return 503 Service Unavailable - https://phabricator.wikimedia.org/T321654 (10TheresNoTime) p:05Triage→03High Bumping this one //up// a bit as it's broken our testing of [[ https://en.wikipedia.beta.wmfla... [19:05:44] 10Release-Engineering-Team (GitLab II: Wrath of Kahn 👾), 10Scap, 10serviceops-collab: Set up equivalent of the scap-tox-publish job in scap's .gitlab-ci.yml - https://phabricator.wikimedia.org/T321629 (10dancy) 05Open→03Resolved [19:05:46] 10Release-Engineering-Team (GitLab II: Wrath of Kahn 👾), 10Scap: Get scap CI working on GitLab - https://phabricator.wikimedia.org/T319335 (10dancy) [19:10:42] 10Phabricator, 10Release-Engineering-Team (Bonus Level 🕹️), 10serviceops-collab, 10Patch-For-Review: decom phab2001 - https://phabricator.wikimedia.org/T322250 (10Dzahn) the git-ssh service has been removed from LVS on lvs servers and is removed from DNS, but there is still pybal data here, we should clean... [19:20:05] 10GitLab (Infrastructure), 10serviceops-collab: Migrate gitlab-test instance to bullseye - https://phabricator.wikimedia.org/T318521 (10Dzahn) I wanted to click and create the instance gitlab-prod-1002 for this. But we are out of quota in the cloud VPS project again. (due to puppetdb, deployment server, vrts... [19:23:30] (03PS3) 10Stef Dunlap: Use a more portable shebang in build scripts [tools/release] - 10https://gerrit.wikimedia.org/r/849172 [19:24:28] (03CR) 10Stef Dunlap: Use a more portable shebang in build scripts (032 comments) [tools/release] - 10https://gerrit.wikimedia.org/r/849172 (owner: 10Stef Dunlap) [19:37:32] 10GitLab, 10serviceops-collab: ensure Gitlab logs end up in logstash - https://phabricator.wikimedia.org/T322261 (10Dzahn) [19:37:57] 10GitLab, 10serviceops-collab: ensure Gitlab logs end up in logstash - https://phabricator.wikimedia.org/T322261 (10Dzahn) [19:54:32] (03CR) 10Ahmon Dancy: [C: 03+2] Use a more portable shebang in build scripts (031 comment) [tools/release] - 10https://gerrit.wikimedia.org/r/849172 (owner: 10Stef Dunlap) [19:55:14] (03Merged) 10jenkins-bot: Use a more portable shebang in build scripts [tools/release] - 10https://gerrit.wikimedia.org/r/849172 (owner: 10Stef Dunlap) [20:17:01] (03CR) 10Ahmon Dancy: [C: 03+2] Dockerfiles: Combine apt-get update and apt-get install commands [tools/train-dev] - 10https://gerrit.wikimedia.org/r/842844 (owner: 10Ahmon Dancy) [20:17:32] (03Merged) 10jenkins-bot: Dockerfiles: Combine apt-get update and apt-get install commands [tools/train-dev] - 10https://gerrit.wikimedia.org/r/842844 (owner: 10Ahmon Dancy) [20:22:08] when did Zuul get a makeover?? :D [20:26:25] 10Beta-Cluster-Infrastructure, 10serviceops, 10Beta-Cluster-reproducible: Thumbnails on beta cluster return 503 Service Unavailable - https://phabricator.wikimedia.org/T321654 (10Vgutierrez) @TheresNoTime this should be fixed as a side effect of powering the old instances on to be able to add the new instanc... [20:27:06] TheresNoTime: Yesterday I think :P [20:28:57] 10Beta-Cluster-Infrastructure, 10serviceops, 10Beta-Cluster-reproducible: Thumbnails on beta cluster return 503 Service Unavailable - https://phabricator.wikimedia.org/T321654 (10TheresNoTime) >>! In T321654#8364815, @Vgutierrez wrote: > @TheresNoTime this should be fixed as a side effect of powering the old... [20:29:33] 10Beta-Cluster-Infrastructure, 10serviceops, 10Beta-Cluster-reproducible: Thumbnails on beta cluster return 503 Service Unavailable - https://phabricator.wikimedia.org/T321654 (10Vgutierrez) 05Open→03Resolved a:03Vgutierrez [20:32:48] it's pretttyyy [20:44:43] (03PS1) 10Ahmon Dancy: Migrate scap repo to gitlab [tools/scap] - 10https://gerrit.wikimedia.org/r/852294 [20:45:00] (03CR) 10CI reject: [V: 04-1] Migrate scap repo to gitlab [tools/scap] - 10https://gerrit.wikimedia.org/r/852294 (owner: 10Ahmon Dancy) [20:45:05] 10Release-Engineering-Team (GitLab II: Wrath of Kahn 👾), 10Scap: Get scap CI working on GitLab - https://phabricator.wikimedia.org/T319335 (10dancy) 05Open→03Resolved [20:48:06] (03PS2) 10Ahmon Dancy: Migrate scap repo to gitlab [tools/scap] - 10https://gerrit.wikimedia.org/r/852294 [20:48:29] (03CR) 10CI reject: [V: 04-1] Migrate scap repo to gitlab [tools/scap] - 10https://gerrit.wikimedia.org/r/852294 (owner: 10Ahmon Dancy) [20:51:09] 10Release-Engineering-Team (GitLab II: Wrath of Kahn 👾), 10Scap: Migrate scap to gitlab - https://phabricator.wikimedia.org/T322269 (10dancy) [20:54:44] (03PS1) 10Ahmon Dancy: Remove everything related to scap CI [integration/config] - 10https://gerrit.wikimedia.org/r/852299 (https://phabricator.wikimedia.org/T322269) [20:57:39] (03CR) 10CI reject: [V: 04-1] Remove everything related to scap CI [integration/config] - 10https://gerrit.wikimedia.org/r/852299 (https://phabricator.wikimedia.org/T322269) (owner: 10Ahmon Dancy) [20:58:25] (03PS2) 10Ahmon Dancy: Remove everything related to scap CI [integration/config] - 10https://gerrit.wikimedia.org/r/852299 (https://phabricator.wikimedia.org/T322269) [21:02:50] (03CR) 10Ahmon Dancy: "Hi Antoine. Please merge as you see fit." [integration/config] - 10https://gerrit.wikimedia.org/r/852299 (https://phabricator.wikimedia.org/T322269) (owner: 10Ahmon Dancy) [21:03:31] (03PS3) 10Ahmon Dancy: Migrate scap repo to gitlab [tools/scap] - 10https://gerrit.wikimedia.org/r/852294 (https://phabricator.wikimedia.org/T322269) [21:04:10] (03CR) 10CI reject: [V: 04-1] Migrate scap repo to gitlab [tools/scap] - 10https://gerrit.wikimedia.org/r/852294 (https://phabricator.wikimedia.org/T322269) (owner: 10Ahmon Dancy) [22:41:43] (03PS3) 10Jforrester: Docker: Drop scap-deps-stretch, no longer used [integration/config] - 10https://gerrit.wikimedia.org/r/852299 (https://phabricator.wikimedia.org/T322269) (owner: 10Ahmon Dancy) [22:41:45] (03PS1) 10Jforrester: Zuul: [mediawiki/tools/scap] Mark as archived [integration/config] - 10https://gerrit.wikimedia.org/r/852310 (https://phabricator.wikimedia.org/T322269) [22:41:47] (03PS1) 10Jforrester: jjb: Drop scap jobs [integration/config] - 10https://gerrit.wikimedia.org/r/852311 (https://phabricator.wikimedia.org/T322269) [22:42:02] (03CR) 10Jforrester: [C: 03+2] Zuul: [mediawiki/tools/scap] Mark as archived [integration/config] - 10https://gerrit.wikimedia.org/r/852310 (https://phabricator.wikimedia.org/T322269) (owner: 10Jforrester) [22:43:49] (03Merged) 10jenkins-bot: Zuul: [mediawiki/tools/scap] Mark as archived [integration/config] - 10https://gerrit.wikimedia.org/r/852310 (https://phabricator.wikimedia.org/T322269) (owner: 10Jforrester) [22:44:15] !log Zuul: [mediawiki/tools/scap] Mark as archived for T322269 [22:44:17] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [22:44:17] T322269: Migrate scap to gitlab - https://phabricator.wikimedia.org/T322269 [22:44:29] Thanks James_F! [22:44:45] dancy: Delighted to help move things to GitLab. ;-) [22:44:52] (03CR) 10Jforrester: [C: 03+2] jjb: Drop scap jobs [integration/config] - 10https://gerrit.wikimedia.org/r/852311 (https://phabricator.wikimedia.org/T322269) (owner: 10Jforrester) [22:46:47] (03Merged) 10jenkins-bot: jjb: Drop scap jobs [integration/config] - 10https://gerrit.wikimedia.org/r/852311 (https://phabricator.wikimedia.org/T322269) (owner: 10Jforrester) [22:46:53] (03CR) 10Jforrester: [C: 03+2] Docker: Drop scap-deps-stretch, no longer used [integration/config] - 10https://gerrit.wikimedia.org/r/852299 (https://phabricator.wikimedia.org/T322269) (owner: 10Ahmon Dancy) [22:47:29] (03Abandoned) 10Jforrester: php_fpm: simplify restart logic [tools/scap] - 10https://gerrit.wikimedia.org/r/810047 (owner: 10Giuseppe Lavagetto) [22:47:37] (03Abandoned) 10Jforrester: Require hashes when installing dependencies [tools/scap] - 10https://gerrit.wikimedia.org/r/838758 (owner: 10Hashar) [22:47:49] (03CR) 10Jforrester: [V: 03+2 C: 03+2] Migrate scap repo to gitlab [tools/scap] - 10https://gerrit.wikimedia.org/r/852294 (https://phabricator.wikimedia.org/T322269) (owner: 10Ahmon Dancy) [22:48:12] 10Release-Engineering-Team (GitLab II: Wrath of Kahn 👾), 10Scap, 10Patch-For-Review: Migrate scap to gitlab - https://phabricator.wikimedia.org/T322269 (10Jdforrester-WMF) [22:48:40] (03Merged) 10jenkins-bot: Docker: Drop scap-deps-stretch, no longer used [integration/config] - 10https://gerrit.wikimedia.org/r/852299 (https://phabricator.wikimedia.org/T322269) (owner: 10Ahmon Dancy) [22:50:00] dancy: Sadly there's no way to make https://github.com/wikimedia/scap mirror GitLab right now, right? Should I just leave it as-is? [22:53:29] Yeah, I suppose. Can you add a note to the ticket about this please? [22:58:40] James_F: it should be possible to setup a push mirror from gitlab to github. https://docs.gitlab.com/ee/user/project/repository/mirror/push.html [22:59:23] bd808: Hmm. Neat. Manually each time is a bit meh though. I guess someone will write it into a script. [22:59:30] yeah [22:59:40] (What? Me? Nerd-sniping?! Never!) [23:00:19] especially because there doesn't seem to be a credential store so every time we need to rotate the github creds it's going to suck without automation [23:00:28] Yeah, muchly. [23:01:16] I see you made T321597 for this, nice. [23:01:16] T321597: Mirror repositories hosted on our GitLab to GitHub - https://phabricator.wikimedia.org/T321597 [23:02:52] the quick and dirty "fix" could be a gitlab api updating bot running in Toolforge, but I'm not sure that many folks other than me would see that as a reasonable solution :) [23:04:07] The gerrit->GitHub script right now runs in priv'ed mode on the contint boxes, right? So no reason we couldn't do it the same way with an API access into GitLab from the contint box, which by definition has access to secrets… [23:04:27] Or is this GitLab feature only UX-accessible, not via its API? [23:04:37] https://docs.gitlab.com/ee/api/remote_mirrors.html suggests it could work. [23:05:01] yeah. it is supposed to all be API automatable [23:05:23] OK, so a cron job on contint.wikimedia.org should have enough access I guess.