[00:04:13] 10Gerrit, 10Release-Engineering-Team, 10SecTeam-Processed, 10Security: Gerrit security release 3.3.10 - https://phabricator.wikimedia.org/T304226 (10DannyS712) This seems to have broken the ability to page between search results for repositories, there is no option to see a page 2 at https://gerrit.wikimed... [07:17:37] Is someone willing to grant me administrator access on wikitech for like a day so that I can get around the title blacklist to create a new account `DannyS712 bot`? (asking for a day since I might not be around when this is done, I only need it for a few minutes and can promise not to use the rights for anything other than creating the account). [07:17:37] https://wikitech.wikimedia.org/wiki/Special:UserRights/DannyS712 [07:20:56] (sorry if this is the wrong channel to be asking in) [08:34:26] 10GitLab (Infrastructure), 10serviceops: GitLab minor version upgrade: 14.9.x - https://phabricator.wikimedia.org/T304622 (10Jelto) @Arnoldokoth and I will do the upgrade of GitLab + Runners on Monday after 4pm UTC. [09:22:55] (03CR) 10Hashar: [C: 03+2] "Thanks!!!" [integration/config] - 10https://gerrit.wikimedia.org/r/773635 (https://phabricator.wikimedia.org/T304147) (owner: 10Kosta Harlan) [09:41:08] (03Merged) 10jenkins-bot: dockerfiles: Update Quibble to 1.4.4-s1 [integration/config] - 10https://gerrit.wikimedia.org/r/773635 (https://phabricator.wikimedia.org/T304147) (owner: 10Kosta Harlan) [09:43:03] !log Building Quibble Docker images to rename quibble-with-apache to quibble-with-supervisord [09:43:04] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [09:43:05] kostajh: ^ :] [09:43:09] thank you for the series of patch [10:17:11] Project beta-code-update-eqiad build #385060: 15ABORTED in 9.8 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/385060/ [10:17:24] Project beta-code-update-eqiad build #385061: 15ABORTED in 8.2 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/385061/ [10:23:35] hashar: hopefully they work... [10:25:03] images built [10:27:07] hmm [10:27:27] it is a mess [10:33:31] (03CR) 10Hashar: [C: 04-1] "This update the entrypoint for the jjb jobs from quibble-with-apache to quibble-with-supervisord which is good." [integration/config] - 10https://gerrit.wikimedia.org/r/773636 (https://phabricator.wikimedia.org/T304147) (owner: 10Kosta Harlan) [10:33:39] kostajh: we need to split the next change ( https://gerrit.wikimedia.org/r/c/integration/config/+/773636 ) [10:33:45] cause it rename the entrypoint which is good [10:34:05] but also cause a few other jobs to switch to the 1.4.4 image but with the /usr/local/quibble entrypoint [10:34:08] hence without memcached [10:34:21] I will split it [10:36:46] oh dear [10:36:49] sorry [10:37:00] no worries :D [10:37:20] I guess enabling the memcached configuration solely on whether php-memcached is enabled is a bit of a surprising pattern [10:37:26] since it also requires memcached to be running [10:37:35] (03PS2) 10Hashar: jjb: Use quibble-with-supervisord entrypoint [integration/config] - 10https://gerrit.wikimedia.org/r/773636 (https://phabricator.wikimedia.org/T304147) (owner: 10Kosta Harlan) [10:37:58] and yeah, we should make quibble-with-supervisord the default, mo [10:37:59] *imo [10:38:20] then we have used quibble-with-apache as a feature flag [10:38:32] hashar: right. another option would be to pass in a command line arg to quibble, like --use-memcache and then LocalSettings is adjusted accordingly [10:38:32] and I am not sure whether we use apache for all mediawiki* jobs [10:40:11] and no that will not work grr [10:41:36] what won't work? [10:42:10] I have amended your patch to s/quibble-with-apache/quibble-with-supervisord/ [10:42:13] but that doesn't bump the images [10:43:10] and if we bump the images as you did [10:43:23] some would use /usr/local/quibble and thus no supervisord [10:43:36] so I think we should change the default ENTRYPOINT [10:43:47] and get rid of `entrypoint: quibble-with-supervisord` [10:43:57] that sounds good to me. simpler [10:43:58] or to say it otherwise, have the image to always run supervisord [10:44:35] which mean that maybe some job will start using Apache [10:45:07] (03CR) 10Hashar: [C: 04-1] jjb: Use quibble-with-supervisord entrypoint [integration/config] - 10https://gerrit.wikimedia.org/r/773636 (https://phabricator.wikimedia.org/T304147) (owner: 10Kosta Harlan) [10:46:08] aka https://gerrit.wikimedia.org/r/c/integration/config/+/773637 is good [10:47:00] I am going to deploy those bundle jobs, that is a good isolated test case [10:47:11] sounds good [10:47:30] I think that was my intention anyway -- prove that the bundle job works, the proceed with the rest of the jobs. But I got the order wrong :( [10:47:34] (03PS2) 10Hashar: dockerfiles: Update quibble-buster-php72-bundle to 1.4.4-s2 [integration/config] - 10https://gerrit.wikimedia.org/r/773637 (https://phabricator.wikimedia.org/T304147) (owner: 10Kosta Harlan) [10:47:39] yeah [10:47:41] makes sense :] [10:47:53] 10pm patches are hard ! [10:48:00] heh [10:49:57] (03PS2) 10Hashar: jjb: Update mwselenium jobs to use quibble 1.4.4-s2 [integration/config] - 10https://gerrit.wikimedia.org/r/773638 (https://phabricator.wikimedia.org/T304147) (owner: 10Kosta Harlan) [10:50:19] (03CR) 10Hashar: [C: 03+2] dockerfiles: Update quibble-buster-php72-bundle to 1.4.4-s2 [integration/config] - 10https://gerrit.wikimedia.org/r/773637 (https://phabricator.wikimedia.org/T304147) (owner: 10Kosta Harlan) [10:51:01] (03CR) 10Kosta Harlan: [C: 03+1] jjb: Update mwselenium jobs to use quibble 1.4.4-s2 [integration/config] - 10https://gerrit.wikimedia.org/r/773638 (https://phabricator.wikimedia.org/T304147) (owner: 10Kosta Harlan) [10:51:21] we should phase out that legacy mediawiki ruby selenium lib really [10:51:25] (03PS3) 10Hashar: jjb: Update mwselenium jobs to use quibble 1.4.4-s2 [integration/config] - 10https://gerrit.wikimedia.org/r/773638 (https://phabricator.wikimedia.org/T304147) (owner: 10Kosta Harlan) [10:52:22] (03Merged) 10jenkins-bot: dockerfiles: Update quibble-buster-php72-bundle to 1.4.4-s2 [integration/config] - 10https://gerrit.wikimedia.org/r/773637 (https://phabricator.wikimedia.org/T304147) (owner: 10Kosta Harlan) [10:52:31] hashar: do we need to do something about the wikibase-client-docker and wikibase-repo-docker jobs? [10:52:46] those are references in the bug report, but not in the commit message you just updated about jobs affected [10:52:56] they will need supervisord as well to get memcached enabled [10:54:41] hashar: i'm confused, cause it looks like they inherit from job_quibble, so they should have had memcached service running already? [10:55:01] 10Project-Admins, 10User-DannyS712: Create User-ItamarWMDE project - https://phabricator.wikimedia.org/T302225 (10ItamarWMDE) Sorry for the delayed response, I was away for a couple of weeks, thank you @DannyS712! [10:55:09] depends on the entrypoint being used I guess [10:55:21] if there is none that is the docker image one being used /usr/local/bin/quibble [10:55:25] and hence there is no supervisord [10:58:54] Successfully published image docker-registry.discovery.wmnet/releng/quibble-buster-php72-bundle:1.4.4-s2 [11:01:04] (03CR) 10Hashar: [C: 03+2] jjb: Update mwselenium jobs to use quibble 1.4.4-s2 [integration/config] - 10https://gerrit.wikimedia.org/r/773638 (https://phabricator.wikimedia.org/T304147) (owner: 10Kosta Harlan) [11:02:05] something running at https://integration.wikimedia.org/ci/job/legacy-quibble-rubyselenium-docker/4285/console [11:03:35] (03Merged) 10jenkins-bot: jjb: Update mwselenium jobs to use quibble 1.4.4-s2 [integration/config] - 10https://gerrit.wikimedia.org/r/773638 (https://phabricator.wikimedia.org/T304147) (owner: 10Kosta Harlan) [11:03:35] `/nonexistent` is not a directory. Says bundle… not a new issue, though [11:03:57] oh shit [11:04:00] rolling back [11:04:24] Or is it? [11:04:45] (03PS1) 10Hashar: Revert "jjb: Update mwselenium jobs to use quibble 1.4.4-s2" [integration/config] - 10https://gerrit.wikimedia.org/r/773695 [11:04:51] (03CR) 10Hashar: [C: 03+2] Revert "jjb: Update mwselenium jobs to use quibble 1.4.4-s2" [integration/config] - 10https://gerrit.wikimedia.org/r/773695 (owner: 10Hashar) [11:05:39] the wikibase ruby selenium job fails with [11:05:40] Failed to open TCP connection to 127.0.0.1:9412 (Connection refused - connect(2) for "127.0.0.1" port 9412) (Faraday::ConnectionFailed) [11:06:27] https://integration.wikimedia.org/ci/job/legacy-quibble-rubyselenium-docker/4285/console [11:06:37] (03CR) 10jerkins-bot: [V: 04-1] Revert "jjb: Update mwselenium jobs to use quibble 1.4.4-s2" [integration/config] - 10https://gerrit.wikimedia.org/r/773695 (owner: 10Hashar) [11:07:16] πŸ‘€ [11:08:29] (03PS2) 10Hashar: Revert "jjb: Update mwselenium jobs to use quibble 1.4.4-s2" [integration/config] - 10https://gerrit.wikimedia.org/r/773695 [11:08:55] (03CR) 10Hashar: [C: 03+2] "commit-message failed due to a long line" [integration/config] - 10https://gerrit.wikimedia.org/r/773695 (owner: 10Hashar) [11:09:27] quibble-buster-php72-bundle/mwselenium.sh:export MEDIAWIKI_URL=http://127.0.0.1:9412/index.php/ [11:09:27] quibble-buster-php72-bundle/mwselenium.sh:export MEDIAWIKI_API_URL=http://127.0.0.1:9412/api.php [11:09:27] quibble-fresnel/Dockerfile.template:ENV MW_SERVER="http://127.0.0.1:9412" [11:09:29] fun [11:09:42] hardcoded values [11:09:47] though Quibble supposedly set them [11:11:06] (03Merged) 10jenkins-bot: Revert "jjb: Update mwselenium jobs to use quibble 1.4.4-s2" [integration/config] - 10https://gerrit.wikimedia.org/r/773695 (owner: 10Hashar) [11:18:19] +MEDIAWIKI_URL="${MW_SERVER}"/index.php/ [11:18:35] then there is MW_SCRIPT_PATH=/ [11:18:39] I don't know what to do with it :D [11:18:59] I will just ignore it I guess [11:24:00] (03PS1) 10Hashar: dockerfiles: unhardcode MEDIAWIKI_URL and MEDIAWIKI_API_URL [integration/config] - 10https://gerrit.wikimedia.org/r/773759 [11:29:24] (03PS1) 10Hashar: dockerfiles: quibble-fresnel rm MW_SERVER and MW_SCRIPT_PATH [integration/config] - 10https://gerrit.wikimedia.org/r/773761 [11:29:38] kostajh: ^ those unhardcode port 9412 :] [11:31:28] lgtm [11:31:35] (03CR) 10Kosta Harlan: [C: 03+1] dockerfiles: unhardcode MEDIAWIKI_URL and MEDIAWIKI_API_URL [integration/config] - 10https://gerrit.wikimedia.org/r/773759 (owner: 10Hashar) [11:32:15] (03CR) 10Kosta Harlan: [C: 03+1] dockerfiles: quibble-fresnel rm MW_SERVER and MW_SCRIPT_PATH (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/773761 (owner: 10Hashar) [11:32:30] (03PS1) 10Hashar: jjb: Update mwselenium jobs to use quibble 1.4.4-s3 [integration/config] - 10https://gerrit.wikimedia.org/r/773762 (https://phabricator.wikimedia.org/T304147) [11:32:43] (03CR) 10Hashar: [C: 03+2] dockerfiles: unhardcode MEDIAWIKI_URL and MEDIAWIKI_API_URL [integration/config] - 10https://gerrit.wikimedia.org/r/773759 (owner: 10Hashar) [11:32:48] (03CR) 10Hashar: [C: 03+2] dockerfiles: quibble-fresnel rm MW_SERVER and MW_SCRIPT_PATH [integration/config] - 10https://gerrit.wikimedia.org/r/773761 (owner: 10Hashar) [11:33:04] CI config is a long tail of copy paste technical debt [11:34:36] (03Merged) 10jenkins-bot: dockerfiles: unhardcode MEDIAWIKI_URL and MEDIAWIKI_API_URL [integration/config] - 10https://gerrit.wikimedia.org/r/773759 (owner: 10Hashar) [11:34:44] (03Merged) 10jenkins-bot: dockerfiles: quibble-fresnel rm MW_SERVER and MW_SCRIPT_PATH [integration/config] - 10https://gerrit.wikimedia.org/r/773761 (owner: 10Hashar) [11:40:56] (03PS3) 10Kosta Harlan: jjb: Add patch-phpbench pipeline, and add GrowthExperiments as first test [integration/config] - 10https://gerrit.wikimedia.org/r/741976 (https://phabricator.wikimedia.org/T291549) [11:41:50] (03CR) 10Kosta Harlan: "One thing I am not sure about -- whether this job will correctly run phpbench for just the extension/skin for the example addition to Grow" [integration/config] - 10https://gerrit.wikimedia.org/r/741976 (https://phabricator.wikimedia.org/T291549) (owner: 10Kosta Harlan) [11:42:04] (03CR) 10jerkins-bot: [V: 04-1] jjb: Add patch-phpbench pipeline, and add GrowthExperiments as first test [integration/config] - 10https://gerrit.wikimedia.org/r/741976 (https://phabricator.wikimedia.org/T291549) (owner: 10Kosta Harlan) [11:42:20] Successfully published image docker-registry.discovery.wmnet/releng/quibble-fresnel:1.4.4-s2 [11:42:20] Successfully published image docker-registry.discovery.wmnet/releng/quibble-buster-php72-bundle:1.4.4-s3 [11:43:13] checking at https://integration.wikimedia.org/ci/job/legacy-quibble-rubyselenium-docker/4286/ [11:43:28] hashar: I was tempted yesterday to start playing with CI config @ gitlab, do you know if there are already some working gitlab-ci.yaml somewhere? [11:44:16] https://integration.wikimedia.org/ci/job/integration-config-tox-docker/8637/console i've looked at this three times but can't see the error message [11:45:16] arturo: we should probably add some examples here https://www.mediawiki.org/wiki/Gitlab/Workflows/CI [11:45:46] here's one example https://gitlab.wikimedia.org/repos/releng/cli/-/blob/main/.gitlab-ci.yml [11:46:06] and a much simpler one https://gitlab.wikimedia.org/kharlan/fix-suggester-bot/-/blob/main/.gitlab-ci.yml [11:46:19] SUCCESS [11:47:24] kostajh: yes please. An example for what previously was the tox checker in jenkins/gerrit would be super-usefull [11:47:28] (03CR) 10Hashar: [C: 03+2] "Verified by rebuilding legacy-quibble-rubyselenium-docker and this time it passed :]" [integration/config] - 10https://gerrit.wikimedia.org/r/773762 (https://phabricator.wikimedia.org/T304147) (owner: 10Hashar) [11:48:12] arturo: not sure how it works :) [11:48:26] one of the problem with the /releng/ images is that they are a bit hardcoded with the current CI in mind [11:48:28] (03PS4) 10Kosta Harlan: jjb: Add patch-phpbench pipeline, and add GrowthExperiments as first test [integration/config] - 10https://gerrit.wikimedia.org/r/741976 (https://phabricator.wikimedia.org/T291549) [11:48:44] specially the releng/tox images attempts to checkout the patch using $ZUUL_* env variable iirc [11:49:25] (03Merged) 10jenkins-bot: jjb: Update mwselenium jobs to use quibble 1.4.4-s3 [integration/config] - 10https://gerrit.wikimedia.org/r/773762 (https://phabricator.wikimedia.org/T304147) (owner: 10Hashar) [11:49:28] (03CR) 10jerkins-bot: [V: 04-1] jjb: Add patch-phpbench pipeline, and add GrowthExperiments as first test [integration/config] - 10https://gerrit.wikimedia.org/r/741976 (https://phabricator.wikimedia.org/T291549) (owner: 10Kosta Harlan) [11:49:30] or maybe not anymore and it ENTRYPOINT ["tox"] [11:53:30] (03PS5) 10Kosta Harlan: jjb: Add patch-phpbench pipeline, and add GrowthExperiments as first test [integration/config] - 10https://gerrit.wikimedia.org/r/741976 (https://phabricator.wikimedia.org/T291549) [11:54:09] arturo: looks like this is a python example with gitlab-ci https://gitlab.wikimedia.org/repos/research/knowledge-gaps/-/blob/main/.gitlab-ci.yml [11:54:30] (03CR) 10jerkins-bot: [V: 04-1] jjb: Add patch-phpbench pipeline, and add GrowthExperiments as first test [integration/config] - 10https://gerrit.wikimedia.org/r/741976 (https://phabricator.wikimedia.org/T291549) (owner: 10Kosta Harlan) [11:55:15] (03PS6) 10Kosta Harlan: jjb: Add patch-phpbench pipeline, and add GrowthExperiments as first test [integration/config] - 10https://gerrit.wikimedia.org/r/741976 (https://phabricator.wikimedia.org/T291549) [11:56:06] right [11:56:09] let me try that one! [11:56:23] (03CR) 10jerkins-bot: [V: 04-1] jjb: Add patch-phpbench pipeline, and add GrowthExperiments as first test [integration/config] - 10https://gerrit.wikimedia.org/r/741976 (https://phabricator.wikimedia.org/T291549) (owner: 10Kosta Harlan) [11:59:03] (03PS7) 10Kosta Harlan: jjb: Add patch-phpbench pipeline, and add GrowthExperiments as first test [integration/config] - 10https://gerrit.wikimedia.org/r/741976 (https://phabricator.wikimedia.org/T291549) [12:07:10] (03CR) 10Kosta Harlan: "Can be tested with I487357e97ce6436ed11614a182b3e0fe562ab2af" [integration/config] - 10https://gerrit.wikimedia.org/r/741976 (https://phabricator.wikimedia.org/T291549) (owner: 10Kosta Harlan) [12:07:55] (03Abandoned) 10Kosta Harlan: jjb: Use quibble-with-supervisord entrypoint [integration/config] - 10https://gerrit.wikimedia.org/r/773636 (https://phabricator.wikimedia.org/T304147) (owner: 10Kosta Harlan) [12:52:58] (03PS1) 10Hashar: jjb: mediawiki-fresnel-patch-docker to Quibble 1.4.4 [integration/config] - 10https://gerrit.wikimedia.org/r/773766 [12:54:16] kostajh: so hmm for the 1.4.4 update we also need to change the entry point to quibble-with-supervisord [12:54:24] for memcached [12:54:35] and that also mean maybe some jobs switch to Apache as a result [12:54:46] at least I got the fresnel job updated and passing! [12:55:24] (03CR) 10Hashar: [C: 03+2] "I did a build on CI and it passed :)" [integration/config] - 10https://gerrit.wikimedia.org/r/773766 (owner: 10Hashar) [12:58:06] (03Merged) 10jenkins-bot: jjb: mediawiki-fresnel-patch-docker to Quibble 1.4.4 [integration/config] - 10https://gerrit.wikimedia.org/r/773766 (owner: 10Hashar) [13:26:01] hashar: right, we need to change the entrypoint [13:26:38] (03CR) 10Kosta Harlan: jjb: Add patch-phpbench pipeline, and add GrowthExperiments as first test (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/741976 (https://phabricator.wikimedia.org/T291549) (owner: 10Kosta Harlan) [13:27:48] kostajh: yes which does two changes: switch to apache, add memcached :) [13:28:00] that worked for the fresnel job though! [13:45:34] kostajh: hashar: my first sucessfull job https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-framework-api/-/jobs/11682 [13:46:00] congratulations [13:47:14] arturo: nice! [13:48:00] since I anticipate a lot of my repos using the same gitlab-ci.yaml file, I factorized it [13:48:04] https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-framework-api/-/commit/d5859722a3b0caa7a65992d436297e0ee49593f3 [13:51:06] 10GitLab (Project Migration), 10Release-Engineering-Team (Done by Feb 23 🧟), 10User-brennen: Early adoption signup for WMF GitLab - https://phabricator.wikimedia.org/T282842 (10kostajh) >>! In T282842#7114542, @kostajh wrote: > @Tgr and I are interested to migrate https://gerrit.wikimedia.org/r/plugins/gitil... [14:51:44] (03PS8) 10Kosta Harlan: jjb: Add mediawiki-phpbench-patch-docker, add GrowthExperiments as first test [integration/config] - 10https://gerrit.wikimedia.org/r/741976 (https://phabricator.wikimedia.org/T291549) [14:52:21] hashar: ^ maybe I got it right [14:55:18] maybe [14:55:30] checking it, I don't think the job has to be entirely copied [14:55:48] the `!!merge : *job_quibble` inserts everything [14:57:31] good point [14:57:32] (03PS9) 10Kosta Harlan: jjb: Add mediawiki-phpbench-patch-docker, add GrowthExperiments as first test [integration/config] - 10https://gerrit.wikimedia.org/r/741976 (https://phabricator.wikimedia.org/T291549) [14:58:45] https://integration.wikimedia.org/ci/job/mediawiki-phpbench-patch-docker/2/console [14:58:56] 00:00:04.922 /tmp/jenkins8198548914348104797.sh: line 4: syntax error near unexpected token `}' [14:58:57] lol [14:59:07] eh [14:59:11] what did i do [15:01:28] trying a fix [15:03:23] hashar: i gotta go, maybe back on a bit later. https://gerrit.wikimedia.org/r/c/mediawiki/extensions/GrowthExperiments/+/722594 is a change that should work with it. thanks for your help :) [15:03:35] kostajh: awesome thanks [15:03:38] I will complete it [15:11:03] (03PS10) 10Hashar: jjb: Add mediawiki-phpbench-patch-docker, add GrowthExperiments as first test [integration/config] - 10https://gerrit.wikimedia.org/r/741976 (https://phabricator.wikimedia.org/T291549) (owner: 10Kosta Harlan) [15:11:48] (03PS1) 10Jaime Nuche: lock: refactor to simplify code [tools/scap] - 10https://gerrit.wikimedia.org/r/773792 (https://phabricator.wikimedia.org/T302905) [15:11:50] (03PS1) 10Jaime Nuche: scap prep: support for serialization of concurrent processes [tools/scap] - 10https://gerrit.wikimedia.org/r/773793 [15:13:56] (03CR) 10jerkins-bot: [V: 04-1] lock: refactor to simplify code [tools/scap] - 10https://gerrit.wikimedia.org/r/773792 (https://phabricator.wikimedia.org/T302905) (owner: 10Jaime Nuche) [15:14:25] (03CR) 10jerkins-bot: [V: 04-1] scap prep: support for serialization of concurrent processes [tools/scap] - 10https://gerrit.wikimedia.org/r/773793 (owner: 10Jaime Nuche) [15:24:23] 10Release-Engineering-Team, 10CirrusSearch, 10dev-images, 10Discovery-Search (Current work): Create docker elasticsearch images with wmf search plugins - https://phabricator.wikimedia.org/T304290 (10dcausse) Pinging releng for help on how to proceed with the gitlab MR and the deployment of the images to th... [15:26:49] (03PS2) 10Jaime Nuche: lock: refactor to simplify code [tools/scap] - 10https://gerrit.wikimedia.org/r/773792 (https://phabricator.wikimedia.org/T302905) [15:26:51] (03PS2) 10Jaime Nuche: scap prep: support for serialization of concurrent processes [tools/scap] - 10https://gerrit.wikimedia.org/r/773793 [15:29:11] (03CR) 10jerkins-bot: [V: 04-1] scap prep: support for serialization of concurrent processes [tools/scap] - 10https://gerrit.wikimedia.org/r/773793 (owner: 10Jaime Nuche) [15:31:23] (03CR) 10Hashar: "gotta polish it a bit since that requires a composer install inside the extension" [integration/config] - 10https://gerrit.wikimedia.org/r/741976 (https://phabricator.wikimedia.org/T291549) (owner: 10Kosta Harlan) [15:46:52] (03PS11) 10Hashar: jjb: Add mediawiki-phpbench-patch-docker, add GrowthExperiments as first test [integration/config] - 10https://gerrit.wikimedia.org/r/741976 (https://phabricator.wikimedia.org/T291549) (owner: 10Kosta Harlan) [15:48:56] (03CR) 10Hashar: [C: 03+2] "Will deployed and recheck https://gerrit.wikimedia.org/r/c/mediawiki/extensions/GrowthExperiments/+/722594 ;)" [integration/config] - 10https://gerrit.wikimedia.org/r/741976 (https://phabricator.wikimedia.org/T291549) (owner: 10Kosta Harlan) [15:49:04] kostajh: success :] [15:51:00] (03Merged) 10jenkins-bot: jjb: Add mediawiki-phpbench-patch-docker, add GrowthExperiments as first test [integration/config] - 10https://gerrit.wikimedia.org/r/741976 (https://phabricator.wikimedia.org/T291549) (owner: 10Kosta Harlan) [15:52:47] (03CR) 10Ahmon Dancy: [C: 03+2] make-release: hardened branch existence detection [tools/release] - 10https://gerrit.wikimedia.org/r/773504 (https://phabricator.wikimedia.org/T303828) (owner: 10Hashar) [15:53:45] (03Merged) 10jenkins-bot: make-release: hardened branch existence detection [tools/release] - 10https://gerrit.wikimedia.org/r/773504 (https://phabricator.wikimedia.org/T303828) (owner: 10Hashar) [16:09:06] (03CR) 10Ahmon Dancy: [C: 04-1] Remove phatalityId concept, search for task title instead (032 comments) [releng/phatality] - 10https://gerrit.wikimedia.org/r/773515 (owner: 10Krinkle) [16:09:13] (03CR) 10Ahmon Dancy: [C: 04-1] "Love this idea." [releng/phatality] - 10https://gerrit.wikimedia.org/r/773515 (owner: 10Krinkle) [16:19:57] (03CR) 10Ahmon Dancy: lock: refactor to simplify code (032 comments) [tools/scap] - 10https://gerrit.wikimedia.org/r/773792 (https://phabricator.wikimedia.org/T302905) (owner: 10Jaime Nuche) [16:25:38] (03PS4) 10Krinkle: Remove phatalityId concept, search for task title instead [releng/phatality] - 10https://gerrit.wikimedia.org/r/773515 [16:26:41] (03CR) 10Krinkle: Remove phatalityId concept, search for task title instead (031 comment) [releng/phatality] - 10https://gerrit.wikimedia.org/r/773515 (owner: 10Krinkle) [16:27:28] (03PS1) 10Hashar: jjb: drop THING_SUBNAME in mediawiki-phpbench-patch-docker [integration/config] - 10https://gerrit.wikimedia.org/r/773807 (https://phabricator.wikimedia.org/T291549) [16:28:07] (03PS2) 10Hashar: jjb: drop THING_SUBNAME in mediawiki-phpbench-patch-docker [integration/config] - 10https://gerrit.wikimedia.org/r/773807 (https://phabricator.wikimedia.org/T291549) [16:28:19] (03CR) 10Ahmon Dancy: [C: 03+1] Remove phatalityId concept, search for task title instead [releng/phatality] - 10https://gerrit.wikimedia.org/r/773515 (owner: 10Krinkle) [16:29:13] 10Release-Engineering-Team (πŸš‚πŸ§ͺ Trainsperiment Week), 10Infrastructure-Foundations, 10SRE: Need a service account on deploy servers - https://phabricator.wikimedia.org/T303857 (10thcipriani) > Approving manager: @thcipriani Approved from my side! Tagging #SRE as well β€” not sure about the current best task i... [16:29:46] Just a quick sanity check from the wmcs team: do people here regard gitlab.wm.o more-or-less ready for prime-time? Can I start storing code there without risk of a full wipe-and-reset in the future? [16:29:50] (03CR) 10jerkins-bot: [V: 04-1] jjb: drop THING_SUBNAME in mediawiki-phpbench-patch-docker [integration/config] - 10https://gerrit.wikimedia.org/r/773807 (https://phabricator.wikimedia.org/T291549) (owner: 10Hashar) [16:32:30] andrewbogott: I think brennen could say more technical things about it, but I'll offer that we're no longer at a wipe-and-reset stage -- your code is safe there. We've still got rough edges (integration with our other systems is lacking), but basic code review works. Testing also works with some caveats that are rapidly evolving. [16:32:54] (03CR) 10Brennen Bearnes: [C: 03+1] Remove phatalityId concept, search for task title instead [releng/phatality] - 10https://gerrit.wikimedia.org/r/773515 (owner: 10Krinkle) [16:33:01] thcipriani: that's great, 'code is safe' is the main bar I care about today. thanks! [16:33:24] And we won't make your life harder by putting real-world code in there, I take it? [16:34:14] correct -- that would not make our life any harder than we've already opted into :) [16:34:28] ok! thx [16:34:38] (03PS3) 10Jaime Nuche: scap prep: support for serialization of concurrent processes [tools/scap] - 10https://gerrit.wikimedia.org/r/773793 [16:34:40] (03PS1) 10Jaime Nuche: blubber: use `pip` to install Python test dependencies [tools/scap] - 10https://gerrit.wikimedia.org/r/773809 [16:36:40] (03CR) 10jerkins-bot: [V: 04-1] blubber: use `pip` to install Python test dependencies [tools/scap] - 10https://gerrit.wikimedia.org/r/773809 (owner: 10Jaime Nuche) [16:37:12] (03CR) 10jerkins-bot: [V: 04-1] scap prep: support for serialization of concurrent processes [tools/scap] - 10https://gerrit.wikimedia.org/r/773793 (owner: 10Jaime Nuche) [16:39:11] (03PS2) 10Jaime Nuche: blubber: use `pip` to install Python test dependencies [tools/scap] - 10https://gerrit.wikimedia.org/r/773809 [16:39:13] (03PS4) 10Jaime Nuche: scap prep: support for serialization of concurrent processes [tools/scap] - 10https://gerrit.wikimedia.org/r/773793 [16:39:15] (03PS3) 10Hashar: jjb: drop THING_SUBNAME in mediawiki-phpbench-patch-docker [integration/config] - 10https://gerrit.wikimedia.org/r/773807 (https://phabricator.wikimedia.org/T291549) [16:40:10] (03PS4) 10Hashar: jjb: drop THING_SUBNAME in mediawiki-phpbench-patch-docker [integration/config] - 10https://gerrit.wikimedia.org/r/773807 (https://phabricator.wikimedia.org/T291549) [16:42:08] (03CR) 10jerkins-bot: [V: 04-1] scap prep: support for serialization of concurrent processes [tools/scap] - 10https://gerrit.wikimedia.org/r/773793 (owner: 10Jaime Nuche) [16:42:56] (03CR) 10jerkins-bot: [V: 04-1] blubber: use `pip` to install Python test dependencies [tools/scap] - 10https://gerrit.wikimedia.org/r/773809 (owner: 10Jaime Nuche) [16:43:32] 10Release-Engineering-Team (πŸš‚πŸ§ͺ Trainsperiment Week), 10Infrastructure-Foundations, 10SRE, 10serviceops: Need a service account on deploy servers - https://phabricator.wikimedia.org/T303857 (10jcrespo) Normally this kind of tasks would be routed by the person in clinic duty, but I just happened to see him g... [16:45:25] 10Release-Engineering-Team (πŸš‚πŸ§ͺ Trainsperiment Week), 10Infrastructure-Foundations, 10SRE, 10SRE-Access-Requests, 10serviceops: Need a service account on deploy servers - https://phabricator.wikimedia.org/T303857 (10Dzahn) [16:48:38] 10Release-Engineering-Team (πŸš‚πŸ§ͺ Trainsperiment Week), 10Infrastructure-Foundations, 10SRE, 10SRE-Access-Requests, 10serviceops: Need a service account on deploy servers - https://phabricator.wikimedia.org/T303857 (10Joe) a:03Joe I'll take care of this, as I assume it's not urgent to be completed before... [16:56:45] well I am off [16:56:51] merry week-end [16:57:32] (03CR) 10Hashar: [C: 03+2] jjb: drop THING_SUBNAME in mediawiki-phpbench-patch-docker [integration/config] - 10https://gerrit.wikimedia.org/r/773807 (https://phabricator.wikimedia.org/T291549) (owner: 10Hashar) [16:59:49] (03Merged) 10jenkins-bot: jjb: drop THING_SUBNAME in mediawiki-phpbench-patch-docker [integration/config] - 10https://gerrit.wikimedia.org/r/773807 (https://phabricator.wikimedia.org/T291549) (owner: 10Hashar) [17:32:37] 10Release-Engineering-Team (πŸš‚πŸ§ͺ Trainsperiment Week), 10Infrastructure-Foundations, 10SRE, 10SRE-Access-Requests, 10serviceops: Need a service account on deploy servers - https://phabricator.wikimedia.org/T303857 (10dancy) Hi @Joe. This request is not urgent so it can wait until next week. The plan is f... [17:50:27] (03PS3) 10Jaime Nuche: blubber: use `pip` to install Python test dependencies [tools/scap] - 10https://gerrit.wikimedia.org/r/773809 [17:50:29] (03PS5) 10Jaime Nuche: scap prep: support for serialization of concurrent processes [tools/scap] - 10https://gerrit.wikimedia.org/r/773793 [17:51:03] (03PS1) 10Ahmon Dancy: AnsiColorFormatter: Don't use colors if stderr is not a TTY [tools/scap] - 10https://gerrit.wikimedia.org/r/773828 [17:52:11] (03CR) 10jerkins-bot: [V: 04-1] blubber: use `pip` to install Python test dependencies [tools/scap] - 10https://gerrit.wikimedia.org/r/773809 (owner: 10Jaime Nuche) [17:52:34] (03PS1) 10Ahmon Dancy: scap sync-world: Add --stop-before-sync option [tools/scap] - 10https://gerrit.wikimedia.org/r/773829 [17:53:40] (03CR) 10jerkins-bot: [V: 04-1] scap prep: support for serialization of concurrent processes [tools/scap] - 10https://gerrit.wikimedia.org/r/773793 (owner: 10Jaime Nuche) [17:53:52] (03PS1) 10Ahmon Dancy: _call_rebuildLocalisationCache: move legacy setup handling outside of _rebuild [tools/scap] - 10https://gerrit.wikimedia.org/r/773830 [17:55:13] (03CR) 10Ahmon Dancy: [C: 03+2] _call_rebuildLocalisationCache: move legacy setup handling outside of _rebuild [tools/scap] - 10https://gerrit.wikimedia.org/r/773830 (owner: 10Ahmon Dancy) [17:56:01] (03Merged) 10jenkins-bot: _call_rebuildLocalisationCache: move legacy setup handling outside of _rebuild [tools/scap] - 10https://gerrit.wikimedia.org/r/773830 (owner: 10Ahmon Dancy) [17:58:27] (03CR) 10Krinkle: [C: 03+1] AnsiColorFormatter: Don't use colors if stderr is not a TTY [tools/scap] - 10https://gerrit.wikimedia.org/r/773828 (owner: 10Ahmon Dancy) [18:04:11] (03PS4) 10Jaime Nuche: blubber: use `pip` to install Python test dependencies [tools/scap] - 10https://gerrit.wikimedia.org/r/773809 [18:04:13] (03PS6) 10Jaime Nuche: scap prep: support for serialization of concurrent processes [tools/scap] - 10https://gerrit.wikimedia.org/r/773793 [18:05:41] (03CR) 10Ahmon Dancy: [C: 03+2] AnsiColorFormatter: Don't use colors if stderr is not a TTY [tools/scap] - 10https://gerrit.wikimedia.org/r/773828 (owner: 10Ahmon Dancy) [18:05:48] (03CR) 10Ahmon Dancy: [C: 03+2] "Thanks Timo!" [tools/scap] - 10https://gerrit.wikimedia.org/r/773828 (owner: 10Ahmon Dancy) [18:06:25] (03Merged) 10jenkins-bot: AnsiColorFormatter: Don't use colors if stderr is not a TTY [tools/scap] - 10https://gerrit.wikimedia.org/r/773828 (owner: 10Ahmon Dancy) [18:24:28] 10Phabricator, 10Release-Engineering-Team (Priority Backlog πŸ“₯), 10Discovery-Search (Current work): Ensure Phabricator is compatible with Elasticsearch 7.10 - https://phabricator.wikimedia.org/T303445 (10thcipriani) Hi @Gehel I have been at least able to confirm (via a phab admin page you might not be able to... [18:51:18] (03PS3) 10Jaime Nuche: lock: refactor to simplify code [tools/scap] - 10https://gerrit.wikimedia.org/r/773792 (https://phabricator.wikimedia.org/T302905) [18:51:20] (03PS5) 10Jaime Nuche: blubber: use `pip` to install Python test dependencies [tools/scap] - 10https://gerrit.wikimedia.org/r/773809 [18:51:22] (03PS7) 10Jaime Nuche: scap prep: support for serialization of concurrent processes [tools/scap] - 10https://gerrit.wikimedia.org/r/773793 [18:54:00] (03CR) 10Jaime Nuche: lock: refactor to simplify code (032 comments) [tools/scap] - 10https://gerrit.wikimedia.org/r/773792 (https://phabricator.wikimedia.org/T302905) (owner: 10Jaime Nuche) [18:54:49] (03CR) 10Ahmon Dancy: lock: refactor to simplify code (031 comment) [tools/scap] - 10https://gerrit.wikimedia.org/r/773792 (https://phabricator.wikimedia.org/T302905) (owner: 10Jaime Nuche) [18:55:48] (03CR) 10Ahmon Dancy: [C: 03+1] lock: refactor to simplify code [tools/scap] - 10https://gerrit.wikimedia.org/r/773792 (https://phabricator.wikimedia.org/T302905) (owner: 10Jaime Nuche) [18:57:15] (03PS6) 10Jaime Nuche: blubber: use `pip` to install Python test dependencies [tools/scap] - 10https://gerrit.wikimedia.org/r/773809 (https://phabricator.wikimedia.org/T302905) [18:57:17] (03PS8) 10Jaime Nuche: scap prep: support for serialization of concurrent processes [tools/scap] - 10https://gerrit.wikimedia.org/r/773793 (https://phabricator.wikimedia.org/T302905) [19:00:20] 10Release-Engineering-Team, 10MediaWiki-Release-Tools, 10Wikimedia-Logstash: check-new-error-tasks/check.sh gets a 404 for dashboard export URL since OpenSearch upgrade - https://phabricator.wikimedia.org/T304734 (10brennen) [19:00:44] 10Release-Engineering-Team (Yak Shaving πŸƒπŸͺ’), 10MediaWiki-Release-Tools, 10Wikimedia-Logstash, 10User-brennen: check-new-error-tasks/check.sh gets a 404 for dashboard export URL since OpenSearch upgrade - https://phabricator.wikimedia.org/T304734 (10brennen) a:03brennen [19:05:21] (03CR) 10Jaime Nuche: "Tested manually on train-dev to verify behavior has not changed" [tools/scap] - 10https://gerrit.wikimedia.org/r/773792 (https://phabricator.wikimedia.org/T302905) (owner: 10Jaime Nuche) [19:05:55] (03CR) 10Jaime Nuche: "Besides the automated tests, also verified new behavior manually on train-dev" [tools/scap] - 10https://gerrit.wikimedia.org/r/773793 (https://phabricator.wikimedia.org/T302905) (owner: 10Jaime Nuche) [19:14:03] (03CR) 10Jaime Nuche: [C: 04-1] scap sync-world: Add --stop-before-sync option (032 comments) [tools/scap] - 10https://gerrit.wikimedia.org/r/773829 (owner: 10Ahmon Dancy) [19:15:37] (03PS2) 10Ahmon Dancy: scap sync-world: Add --stop-before-sync option [tools/scap] - 10https://gerrit.wikimedia.org/r/773829 [19:15:53] (03CR) 10Ahmon Dancy: "Thanks for the review!" [tools/scap] - 10https://gerrit.wikimedia.org/r/773829 (owner: 10Ahmon Dancy) [19:18:00] (03CR) 10Jaime Nuche: [C: 03+2] scap sync-world: Add --stop-before-sync option [tools/scap] - 10https://gerrit.wikimedia.org/r/773829 (owner: 10Ahmon Dancy) [19:18:44] (03Merged) 10jenkins-bot: scap sync-world: Add --stop-before-sync option [tools/scap] - 10https://gerrit.wikimedia.org/r/773829 (owner: 10Ahmon Dancy) [19:21:20] (03CR) 10Ahmon Dancy: [C: 03+2] lock: refactor to simplify code [tools/scap] - 10https://gerrit.wikimedia.org/r/773792 (https://phabricator.wikimedia.org/T302905) (owner: 10Jaime Nuche) [19:23:33] (03Merged) 10jenkins-bot: lock: refactor to simplify code [tools/scap] - 10https://gerrit.wikimedia.org/r/773792 (https://phabricator.wikimedia.org/T302905) (owner: 10Jaime Nuche) [19:53:44] (03PS1) 10Brennen Bearnes: check-new-error-tasks: use new saved object API [tools/release] - 10https://gerrit.wikimedia.org/r/773839 (https://phabricator.wikimedia.org/T304734) [19:56:10] 10Release-Engineering-Team (Yak Shaving πŸƒπŸͺ’), 10MediaWiki-Release-Tools, 10Wikimedia-Logstash, 10Patch-For-Review, 10User-brennen: check-new-error-tasks/check.sh gets a 404 for dashboard export URL since OpenSearch upgrade - https://phabricator.wikimedia.org/T304734 (10brennen) 05Openβ†’03In progress [20:02:50] !log mediawiki-new-errors: ran check-new-error-tasks/check.sh and cleared "resolved" filters [20:02:51] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [20:16:52] (03PS1) 10Krinkle: Add experimental job for phatality [integration/config] - 10https://gerrit.wikimedia.org/r/773866 [20:16:54] (03PS1) 10Krinkle: Enable phatality CI job for real [integration/config] - 10https://gerrit.wikimedia.org/r/773867 [20:18:01] (03CR) 10Krinkle: [C: 03+2] Add experimental job for phatality [integration/config] - 10https://gerrit.wikimedia.org/r/773866 (owner: 10Krinkle) [20:18:12] brennen: nice :) [20:19:41] 10GitLab (CI & Job Runners), 10Security Team AppSec, 10Security-Team, 10SecTeam-Processed, 10Security: Merge templates that are part of initial release to production branch - https://phabricator.wikimedia.org/T303482 (10sbassett) [20:19:44] 10GitLab (CI & Job Runners), 10Security Team AppSec, 10Security-Team, 10Security: Create initial proof of concept application security pipeline repository - https://phabricator.wikimedia.org/T289293 (10sbassett) [20:19:50] 10GitLab (CI & Job Runners), 10Security Team AppSec, 10Security-Team, 10Security: Design and Build Application Security Pipeline Components for Gitlab - https://phabricator.wikimedia.org/T289290 (10sbassett) [20:19:53] (03Merged) 10jenkins-bot: Add experimental job for phatality [integration/config] - 10https://gerrit.wikimedia.org/r/773866 (owner: 10Krinkle) [20:20:11] 10GitLab (CI & Job Runners), 10Security Team AppSec, 10Security-Team, 10SecTeam-Processed, 10Security: Research best ways to pass certain credentials to external services within application security-related ci templates - https://phabricator.wikimedia.org/T295508 (10sbassett) [20:20:17] 10GitLab (CI & Job Runners), 10Security Team AppSec, 10Security-Team, 10Security: Create initial proof of concept application security pipeline repository - https://phabricator.wikimedia.org/T289293 (10sbassett) [20:20:23] 10GitLab (CI & Job Runners), 10Security Team AppSec, 10Security-Team, 10Security: Design and Build Application Security Pipeline Components for Gitlab - https://phabricator.wikimedia.org/T289290 (10sbassett) [20:22:13] !log Reloading Zuul to deploy https://gerrit.wikimedia.org/r/773866 [20:22:14] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [20:22:25] (03CR) 10Krinkle: "check experimental" [releng/phatality] - 10https://gerrit.wikimedia.org/r/772916 (owner: 10Krinkle) [20:22:27] 10GitLab (CI & Job Runners), 10Security Team AppSec, 10Security-Team, 10Security: Create initial proof of concept application security pipeline repository - https://phabricator.wikimedia.org/T289293 (10sbassett) [20:23:47] (03PS5) 10Krinkle: test: Introduce unit tests, covering task formatting helper [releng/phatality] - 10https://gerrit.wikimedia.org/r/772916 (https://phabricator.wikimedia.org/T304736) [20:23:49] (03PS2) 10Krinkle: Enable phatality CI job for real [integration/config] - 10https://gerrit.wikimedia.org/r/773867 (https://phabricator.wikimedia.org/T304736) [20:23:56] 10GitLab (CI & Job Runners), 10Security Team AppSec, 10Security-Team, 10Security: Create initial proof of concept application security pipeline repository - https://phabricator.wikimedia.org/T289293 (10sbassett) [20:24:00] (03PS4) 10Krinkle: helpers: Simplify makeTitle by delegating formatting to MediaWiki core [releng/phatality] - 10https://gerrit.wikimedia.org/r/772918 [20:24:06] 10GitLab (CI & Job Runners), 10Security Team AppSec, 10Security-Team, 10Security: Design and Build Application Security Pipeline Components for Gitlab - https://phabricator.wikimedia.org/T289290 (10sbassett) [20:24:14] (03CR) 10Krinkle: "check experimental" [releng/phatality] - 10https://gerrit.wikimedia.org/r/772918 (owner: 10Krinkle) [20:24:18] (03PS5) 10Krinkle: Remove phatalityId concept, search for task title instead [releng/phatality] - 10https://gerrit.wikimedia.org/r/773515 [20:24:26] (03CR) 10Krinkle: "check experimental" [releng/phatality] - 10https://gerrit.wikimedia.org/r/773515 (owner: 10Krinkle) [20:24:46] (03CR) 10Kosta Harlan: "Thank you for working on this. Unfortunately it's close, but not exactly what I need. The --phpunit-aggregate flag will only get recognize" [integration/config] - 10https://gerrit.wikimedia.org/r/741976 (https://phabricator.wikimedia.org/T291549) (owner: 10Kosta Harlan) [20:25:26] 10GitLab (CI & Job Runners), 10Release-Engineering-Team, 10Security Team AppSec, 10Security-Team, 10Security: Evaluate and confirm potential licensing issues for gitlab appsec pipeline tools - https://phabricator.wikimedia.org/T304737 (10sbassett) [20:30:27] (03PS1) 10Kosta Harlan: jjb: Adjust phpbench args [integration/config] - 10https://gerrit.wikimedia.org/r/773869 (https://phabricator.wikimedia.org/T291549) [20:31:27] anyone around to possibly test out ^ [20:44:13] 10GitLab (CI & Job Runners), 10Release-Engineering-Team, 10Security Team AppSec, 10Security-Team, 10Security: Evaluate and confirm potential licensing issues for gitlab appsec pipeline tools - https://phabricator.wikimedia.org/T304737 (10sbassett) [20:51:18] (03PS1) 10Dduvall: WIP: scap blame-trace for investigating MW stack traces [tools/scap] - 10https://gerrit.wikimedia.org/r/773870 [20:51:32] 10GitLab (CI & Job Runners), 10Release-Engineering-Team, 10Security Team AppSec, 10Security-Team, 10Security: Evaluate and confirm potential licensing issues for gitlab appsec pipeline tools - https://phabricator.wikimedia.org/T304737 (10sbassett) [20:51:53] (03CR) 10jerkins-bot: [V: 04-1] WIP: scap blame-trace for investigating MW stack traces [tools/scap] - 10https://gerrit.wikimedia.org/r/773870 (owner: 10Dduvall) [20:52:50] (03CR) 10Dduvall: "There are likely many issues with this right now as I hacked it out quickly following our Trainsperiments Week. :)" [tools/scap] - 10https://gerrit.wikimedia.org/r/773870 (owner: 10Dduvall) [20:53:51] 10GitLab (CI & Job Runners), 10Release-Engineering-Team, 10Security Team AppSec, 10Security-Team, 10Security: Evaluate and confirm potential licensing issues for gitlab appsec pipeline tools - https://phabricator.wikimedia.org/T304737 (10sbassett) [21:00:49] (03PS2) 10Dduvall: WIP: scap blame-trace for investigating MW stack traces [tools/scap] - 10https://gerrit.wikimedia.org/r/773870 [21:01:23] (03CR) 10jerkins-bot: [V: 04-1] WIP: scap blame-trace for investigating MW stack traces [tools/scap] - 10https://gerrit.wikimedia.org/r/773870 (owner: 10Dduvall) [22:05:01] Project beta-update-databases-eqiad build #57490: 15ABORTED in 45 min: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/57490/ [22:21:09] (03PS1) 10Ahmon Dancy: AnsiColorFormatter: Don't use colors if stderr is not a TTY (update) [tools/scap] - 10https://gerrit.wikimedia.org/r/773884 [22:22:27] (03PS1) 10Ahmon Dancy: Add --no-logo flag to scap sync-world [tools/scap] - 10https://gerrit.wikimedia.org/r/773885 [23:05:06] Project beta-update-databases-eqiad build #57491: 15ABORTED in 45 min: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/57491/ [23:08:24] what's going on there... [23:19:38] Reedy: looks a bit like https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/57490/console failed and now things are angry? I feel like the fix for this in the past has been running /usr/local/bin/wmf-beta-update-databases.py manually. [23:20:01] Ah [23:20:09] It's the link rebuild patch [23:20:17] Not really a complete surprise that's slow... :) [23:21:56] !log running /usr/local/bin/wmf-beta-update-databases.py manually [23:21:57] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [23:48:36] Project beta-update-databases-eqiad build #57492: 04FAILURE in 28 min: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/57492/ [23:51:30] !log temporarily turning off period building of beta-update-databases-eqiad until it's run to completion [23:51:32] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL