[00:01:39] (DatasourceError) firing: Queue (Jenkins jobs + Zuul functions) alert - https://grafana.wikimedia.org/alerting/grafana/iS0FSjJ4z/view - https://wikitech.wikimedia.org/wiki/Monitoring/DatasourceError - https://alerts.wikimedia.org/?q=alertname%3DDatasourceError [00:02:33] 10Continuous-Integration-Infrastructure, 06SRE, 06collaboration-services, 10vm-requests: Ganeti VM for contint migration - https://phabricator.wikimedia.org/T358237#9582138 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by dzahn@cumin1002 for host contint1003.eqiad.wmnet with OS bullse... [00:06:39] (DatasourceError) resolved: Queue (Jenkins jobs + Zuul functions) alert - https://grafana.wikimedia.org/alerting/grafana/iS0FSjJ4z/view - https://wikitech.wikimedia.org/wiki/Monitoring/DatasourceError - https://alerts.wikimedia.org/?q=alertname%3DDatasourceError [00:31:09] 10GitLab: Account pending approval banner shown on initial sign-in gives no context for how to proceed - https://phabricator.wikimedia.org/T353752#9582219 (10bd808) >>! In T353752#9582175, @Lofhi wrote: > In my experience, I was confirmed after a brief wait. You [[https://wikitech.wikimedia.org/w/index.php?titl... [00:44:20] 10GitLab: Account pending approval banner shown on initial sign-in gives no context for how to proceed - https://phabricator.wikimedia.org/T353752#9582224 (10Lofhi) >>! In T353752#9582219, @bd808 wrote: > You [[https://wikitech.wikimedia.org/w/index.php?title=Tool:Gitlab-account-approval/Log&diff=prev&oldid=2154... [00:47:44] 10Scap, 10Now this 🫠, 13Patch-For-Review: Scap backporting a patch that gets a -2 hangs - https://phabricator.wikimedia.org/T350628#9582225 (10Sandeeps) 05Open→03In progress [01:05:06] 10GitLab: Account pending approval banner shown on initial sign-in gives no context for how to proceed - https://phabricator.wikimedia.org/T353752#9582268 (10bd808) >>! In T353752#9582224, @Lofhi wrote: > Also, it took me months to understand that I could create a Wikimedia Developer (//oh wait it's not only for... [06:58:59] I’m [08:37:26] 06Release-Engineering-Team, 10Temporary accounts, 06Trust and Safety Product Team, 13Patch-For-Review: Create jobs that run PHPUnit, Selenium, and API testing tests with temp account feature flag enabled - https://phabricator.wikimedia.org/T355879#9582644 (10kostajh) [09:09:54] 06Release-Engineering-Team, 06Data-Platform-SRE, 06collaboration-services, 07Security: Investigate replacing Archiva with Gitlab repositories - https://phabricator.wikimedia.org/T358612#9582690 (10LSobanski) [09:29:02] 06Release-Engineering-Team, 06Data-Platform-SRE, 06collaboration-services, 07Security: Investigate replacing Archiva with Gitlab repositories - https://phabricator.wikimedia.org/T358612#9582717 (10Gehel) p:05Triage→03Medium [09:37:00] 06Release-Engineering-Team, 06Data-Platform-SRE, 06Java-Scala-Standardization, 06collaboration-services, 07Security: Investigate replacing Archiva with Gitlab repositories - https://phabricator.wikimedia.org/T358612#9582740 (10Gehel) [10:33:44] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team: Ssh / user issue with integration-agent-docker-1057.integration.eqiad1.wikimedia.cloud - https://phabricator.wikimedia.org/T349681#9582882 (10hashar) Related is {T324934} which is `sssd` being killed by the Linux out of memory manager and the... [12:36:30] hi releng folks. We just got a dev-images merge request merged in. Could someone please let us know how we trigger publishing the new Docker images to the wmf registry? https://gitlab.wikimedia.org/repos/releng/dev-images/-/merge_requests/63 [13:15:51] jgleeson: who ever merged it should have trigger the build! [13:19:50] hashar: how do we do that? [13:20:18] it was an fr-tech engineer who reviewed and merged it [13:20:28] yeah but then they can deploy [13:20:41] so that repository should only have change merged by people that can actually deploky/build the images [13:21:51] hmm hashar I merged this one last week but I can't see any option to deploy/build https://gitlab.wikimedia.org/repos/releng/dev-images/-/merge_requests/62 [13:22:01] where should I be looking? [13:22:26] I guess those other images haven't been built either? [13:26:46] jgleeson: one needs shell access to the contint machines with some sudo rules applied [13:26:55] so essentially, that is releng members [13:29:13] gotcha [13:30:05] part of me wonders whether this is the right place we should be hosting our local docker dev environment images [13:31:02] but I think around the time we started working on it we'd noticed other teams using it for a similar purpose [13:32:00] ejegg is a maintainer on that repo https://gitlab.wikimedia.org/repos/releng/dev-images/-/project_members [13:32:06] added by brennen [13:32:49] and the last two merged requests did not get pulled on the server / did not result in the images being built [13:32:53] it looks like we're all maintainers [13:36:41] yeah :/ [13:36:50] and I don't know what kind of permissions each of gitlab roles grant [13:37:15] but surely on that repo, the sole persons that should be able to merge a merge request would be the one able to manually build the images [13:37:21] until I guess we got some system to build them [13:37:28] or grant the permissions to build to others [13:37:38] or hand it off to CI [13:39:11] yeah that makes sense [13:39:48] it would be good for us to know how to do that as it can block us from merging docker config dependant on new images which are merged but not deployed [13:40:36] could you do us a big favour and deploy these two images? https://gitlab.wikimedia.org/repos/releng/dev-images/-/merge_requests/63 [13:41:12] I'll mentioned to greg-g about getting us access and training to deploy them also [13:41:17] mention* [13:45:25] 10Phabricator, 06Release-Engineering-Team, 13Patch-For-Review, 15User-brennen: Update wmf/stable to Phorge upstream's 2023.49 stable release - https://phabricator.wikimedia.org/T358610#9583534 (10valerio.bozzolan) [13:49:55] (03PS3) 10Jforrester: Zuul: [wikimedia/iegreview] Mark as archived [integration/config] - 10https://gerrit.wikimedia.org/r/1007012 (https://phabricator.wikimedia.org/T351889) (owner: 10Dzahn) [13:50:23] (03PS4) 10Jforrester: Zuul: [wikimedia/iegreview] Mark as archived [integration/config] - 10https://gerrit.wikimedia.org/r/1007012 (https://phabricator.wikimedia.org/T351889) (owner: 10Dzahn) [13:50:38] (03CR) 10Jforrester: [C: 03+2] Zuul: [wikimedia/iegreview] Mark as archived [integration/config] - 10https://gerrit.wikimedia.org/r/1007012 (https://phabricator.wikimedia.org/T351889) (owner: 10Dzahn) [13:52:11] (03Merged) 10jenkins-bot: Zuul: [wikimedia/iegreview] Mark as archived [integration/config] - 10https://gerrit.wikimedia.org/r/1007012 (https://phabricator.wikimedia.org/T351889) (owner: 10Dzahn) [13:52:57] 10Continuous-Integration-Config, 07I18n, 10Language-2024-January-March, 10Language-Technical Support (Current) , 07affects-translatewiki.net: Automatically allow id HTML attribute in message translations - https://phabricator.wikimedia.org/T357086#9583555 (10Amire80) [13:53:23] !log Zuul: [wikimedia/iegreview] Mark as archived for T351889 [13:53:26] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [13:53:26] T351889: Archive IEG-grant-review / iegreview - https://phabricator.wikimedia.org/T351889 [13:54:53] 10Phabricator, 06Release-Engineering-Team, 13Patch-For-Review, 15User-brennen: Update wmf/stable to Phorge upstream's 2023.49 stable release - https://phabricator.wikimedia.org/T358610#9583577 (10valerio.bozzolan) This is probably the very first version requiring the usual database upgrade script, since it... [13:59:35] (03PS3) 10Jforrester: Zuul: [mediawiki/extensions/ImageCompare] Mark as archived [integration/config] - 10https://gerrit.wikimedia.org/r/1007015 (https://phabricator.wikimedia.org/T353968) (owner: 10Dzahn) [14:00:11] (03CR) 10Jforrester: [C: 03+2] Zuul: [mediawiki/extensions/ImageCompare] Mark as archived [integration/config] - 10https://gerrit.wikimedia.org/r/1007015 (https://phabricator.wikimedia.org/T353968) (owner: 10Dzahn) [14:01:43] (03Merged) 10jenkins-bot: Zuul: [mediawiki/extensions/ImageCompare] Mark as archived [integration/config] - 10https://gerrit.wikimedia.org/r/1007015 (https://phabricator.wikimedia.org/T353968) (owner: 10Dzahn) [14:02:36] !log Zuul: [mediawiki/extensions/ImageCompare] Mark as archived for T353968 [14:02:39] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [14:02:39] T353968: Archive the ImageCompare extension - https://phabricator.wikimedia.org/T353968 [14:04:07] 06Release-Engineering-Team, 10Temporary accounts, 06Trust and Safety Product Team, 13Patch-For-Review: Create jobs that run PHPUnit, Selenium, and API testing tests with temp account feature flag enabled - https://phabricator.wikimedia.org/T355879#9583644 (10Dreamy_Jazz) [14:05:41] (03PS2) 10Jforrester: Zuul: [mediawiki/extensions/MagicNumberedHeadings] Mark as archived [integration/config] - 10https://gerrit.wikimedia.org/r/1007016 (https://phabricator.wikimedia.org/T353966) (owner: 10Dzahn) [14:07:02] (03PS2) 10Jforrester: Zuul: [mediawiki/extensions/Cite] Publish JS docs post-merge [integration/config] - 10https://gerrit.wikimedia.org/r/1007262 (https://phabricator.wikimedia.org/T358641) (owner: 10Awight) [14:07:54] (03CR) 10Jforrester: "Note that this will cause a failed job on all non-master publishes (until the dependent commit slowly makes its way out to release branche" [integration/config] - 10https://gerrit.wikimedia.org/r/1007262 (https://phabricator.wikimedia.org/T358641) (owner: 10Awight) [14:08:01] (03CR) 10Jforrester: [C: 03+2] Zuul: [mediawiki/extensions/MagicNumberedHeadings] Mark as archived [integration/config] - 10https://gerrit.wikimedia.org/r/1007016 (https://phabricator.wikimedia.org/T353966) (owner: 10Dzahn) [14:08:23] (03CR) 10Jforrester: [C: 03+2] Zuul: [mediawiki/extensions/Cite] Publish JS docs post-merge [integration/config] - 10https://gerrit.wikimedia.org/r/1007262 (https://phabricator.wikimedia.org/T358641) (owner: 10Awight) [14:08:33] jgleeson: I am building the images [14:09:09] (03Merged) 10jenkins-bot: Zuul: [mediawiki/extensions/MagicNumberedHeadings] Mark as archived [integration/config] - 10https://gerrit.wikimedia.org/r/1007016 (https://phabricator.wikimedia.org/T353966) (owner: 10Dzahn) [14:09:21] jgleeson: and yeah +1 on getting training + access for FR team members. I guess it is all about knowing the pitfalls of `docker-pkg`, adding some shell rules and people in the proper puppet group and some pairing [14:09:29] (03Merged) 10jenkins-bot: Zuul: [mediawiki/extensions/Cite] Publish JS docs post-merge [integration/config] - 10https://gerrit.wikimedia.org/r/1007262 (https://phabricator.wikimedia.org/T358641) (owner: 10Awight) [14:09:30] we will see whether they build [14:10:20] !log Zuul: [mediawiki/extensions/MagicNumberedHeadings] Mark as archived for T353966 [14:10:23] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [14:10:23] T353966: Archive the MagicNumberedHeadings extension - https://phabricator.wikimedia.org/T353966 [14:10:30] !log Zuul: [mediawiki/extensions/Cite] Publish JS docs post-merge for T358641 [14:10:33] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [14:10:33] T358641: Cite js docs should be published to doc.wikimedia.org - https://phabricator.wikimedia.org/T358641 [14:13:01] (03PS2) 10Jforrester: jjb, Zuul: [labs/tools/wikibugs2] Mark as archived, drop job [integration/config] - 10https://gerrit.wikimedia.org/r/1007020 (https://phabricator.wikimedia.org/T358630) (owner: 10BryanDavis) [14:13:03] (03PS1) 10Jforrester: Docker: [curl] Drop, no longer used [integration/config] - 10https://gerrit.wikimedia.org/r/1007334 (https://phabricator.wikimedia.org/T358630) [14:15:05] (03CR) 10Hashar: [C: 03+2] Docker: [curl] Drop, no longer used [integration/config] - 10https://gerrit.wikimedia.org/r/1007334 (https://phabricator.wikimedia.org/T358630) (owner: 10Jforrester) [14:15:22] hashar: Isn't life great? [14:15:26] (03CR) 10Jforrester: [C: 03+2] jjb, Zuul: [labs/tools/wikibugs2] Mark as archived, drop job [integration/config] - 10https://gerrit.wikimedia.org/r/1007020 (https://phabricator.wikimedia.org/T358630) (owner: 10BryanDavis) [14:15:27] James_F: what is replacing wikibugs2? [14:15:34] hashar: It's moved to GitLab. [14:15:41] lol [14:15:41] good luck :) [14:16:13] All praise to bd808. [14:16:44] (03Merged) 10jenkins-bot: jjb, Zuul: [labs/tools/wikibugs2] Mark as archived, drop job [integration/config] - 10https://gerrit.wikimedia.org/r/1007020 (https://phabricator.wikimedia.org/T358630) (owner: 10BryanDavis) [14:16:47] (03Merged) 10jenkins-bot: Docker: [curl] Drop, no longer used [integration/config] - 10https://gerrit.wikimedia.org/r/1007334 (https://phabricator.wikimedia.org/T358630) (owner: 10Jforrester) [14:16:52] then given wikibugs2 relay notifications from Gerrit, I am not sure it was worth migrating it to Gitlab [14:17:11] It also relays notifications from GitLab. [14:17:15] Or… will. [14:17:21] no no [14:17:23] I've lost track. [14:17:40] we all agreed wikibugs2 should disappear cause it is arch/code is terrible and not worth salvaging [14:17:50] !log Zuul: [labs/tools/wikibugs2] Mark as archived for T358630 [14:17:53] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [14:17:53] T358630: Archive labs/tools/wikibugs2 Gerrit repository - https://phabricator.wikimedia.org/T358630 [14:17:57] "We"? I don't remember that meeting. :-) [14:18:12] so I don't think it was any necessarily to migrate that bitrotting/abandonware tool [14:20:02] James_F: because Gitlab CE does not offer the events we would need unless we get the EE version [14:20:17] Oh, fun. [14:20:30] So we'd need to scrape/etc. instead of using the event loop? [14:20:34] I thought that actually got figured out? [14:20:45] * James_F defers to the people actually doing the work. [14:21:03] yeah [14:21:22] and valhallasw (the original author) said we should sessentially scrap the code [14:21:31] Anyway I’m sorry you hate it hashar, but I’ve decided to try to make wikibugs a little better. [14:21:46] (same situation for git reviewers which code base is even older, and gitlab does not even support adding reviewers so that is not even a topic) [14:22:13] then yeah I guess if one is willing to enhance a bit of wikibugs as it stands now, it might as well be done on Gitlab [14:22:34] or let things bitrott and write something a new to handle the notifications [14:22:57] I moved it to GitLab mostly to make it easier to integrate with Toolforge things [14:22:58] thanks hashar. yep we're accustomed to the docker-pkg dance but we tend to use it without pushing to the registry and just build locally [14:23:53] bd808: yeah no complaint [14:24:11] bd808: I am just surprised to see activity on goo'old wikibugs :D [14:25:01] jgleeson: all images built and published apparently succesfully https://phabricator.wikimedia.org/P58078 [14:25:11] thank you!!! [14:25:46] oh wait [14:25:55] I think that's the earlier patch [14:26:16] that should be both [14:26:33] hashar: It’s greg-g’s fault. He pinged me for help getting the irc bot working and that led to me looking at the task board and then deciding to try to fix some stuff. :) [14:26:50] oh yes you're right hashar I see both [15:31:39] 06Release-Engineering-Team, 10Account Approval: Requesting GitLab account activation for ebomani - https://phabricator.wikimedia.org/T358680 (10EBomani) [16:06:22] (03PS1) 10Hashar: jjb: remove useless yard generated file [integration/config] - 10https://gerrit.wikimedia.org/r/1007389 [16:24:37] 10Scap, 10Now this 🫠: handle logstash timeouts separately from spikes in errors reported by logstash - https://phabricator.wikimedia.org/T144033#9584333 (10dancy) 05Open→03Resolved scap 4.67.0 has been deployed with this change. [16:24:42] 10Beta-Cluster-Infrastructure, 10Deployments, 10Wikimedia-Logstash, 10observability: scap on beta cluster does not run anymore due to logstash being down - https://phabricator.wikimedia.org/T143982#9584335 (10dancy) [16:26:07] !log Upgrading scap to latest code revision in beta cluster [16:26:09] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [16:26:23] (03CR) 10Hashar: [C: 03+2] "Tested and that removed the useless file :)" [integration/config] - 10https://gerrit.wikimedia.org/r/1007389 (owner: 10Hashar) [16:27:36] (03Merged) 10jenkins-bot: jjb: remove useless yard generated file [integration/config] - 10https://gerrit.wikimedia.org/r/1007389 (owner: 10Hashar) [16:30:51] 06Release-Engineering-Team, 10Account Approval: Requesting GitLab account activation for ebomani - https://phabricator.wikimedia.org/T358680#9584365 (10brennen) 05Open→03Resolved [16:31:20] 06Release-Engineering-Team, 10Account Approval: Requesting GitLab account activation for ebomani - https://phabricator.wikimedia.org/T358680#9584374 (10brennen) Looks like the bot already approved this one - you should be good to go. [16:35:12] Project beta-code-update-eqiad build #485397: 04FAILURE in 2 min 11 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/485397/ [16:37:57] 06Release-Engineering-Team, 10Account Approval: Requesting GitLab account activation for ebomani - https://phabricator.wikimedia.org/T358680#9584416 (10EBomani) Thanks! [16:45:12] Project beta-code-update-eqiad build #485398: 04STILL FAILING in 2 min 11 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/485398/ [16:55:10] Project beta-code-update-eqiad build #485399: 04STILL FAILING in 2 min 9 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/485399/ [17:04:09] 10Diffusion, 06Release-Engineering-Team, 06collaboration-services, 13Patch-For-Review: Make https://git.wikimedia.org not redirect to Phabricator Diffusion - https://phabricator.wikimedia.org/T323073#9584548 (10Jelto) >>! In T323073#9581649, @Jdforrester-WMF wrote: > More generally I feel we should be usin... [17:04:36] 06Release-Engineering-Team, 10Temporary accounts, 06Trust and Safety Product Team, 13Patch-For-Review: Create jobs that run PHPUnit, Selenium, and API testing tests with temp account feature flag enabled - https://phabricator.wikimedia.org/T355879#9584550 (10thcipriani) It sounds like the problem you're tr... [17:05:12] Project beta-code-update-eqiad build #485400: 04STILL FAILING in 2 min 12 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/485400/ [17:15:14] Project beta-code-update-eqiad build #485401: 04STILL FAILING in 2 min 14 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/485401/ [17:25:13] Project beta-code-update-eqiad build #485402: 04STILL FAILING in 2 min 12 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/485402/ [17:35:10] Project beta-code-update-eqiad build #485403: 04STILL FAILING in 2 min 10 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/485403/ [17:45:13] Project beta-code-update-eqiad build #485404: 04STILL FAILING in 2 min 12 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/485404/ [17:55:08] Project beta-code-update-eqiad build #485405: 04STILL FAILING in 2 min 8 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/485405/ [18:05:13] Project beta-code-update-eqiad build #485406: 04STILL FAILING in 2 min 12 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/485406/ [18:12:20] 00:02:11.581 No security patches found for master! [18:12:21] 00:02:11.581 Run again with -Drequire_security_patches:False to disable this check. [18:15:12] Project beta-code-update-eqiad build #485407: 04STILL FAILING in 2 min 11 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/485407/ [18:25:12] Project beta-code-update-eqiad build #485408: 04STILL FAILING in 2 min 11 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/485408/ [18:35:14] Project beta-code-update-eqiad build #485409: 04STILL FAILING in 2 min 14 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/485409/ [18:45:12] Project beta-code-update-eqiad build #485410: 04STILL FAILING in 2 min 11 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/485410/ [18:55:09] Project beta-code-update-eqiad build #485411: 04STILL FAILING in 2 min 8 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/485411/ [19:00:12] 06Release-Engineering-Team, 10Account Approval: Requesting GitLab account activation for Melos - https://phabricator.wikimedia.org/T358711 (10Melos) [19:05:10] Project beta-code-update-eqiad build #485412: 04STILL FAILING in 2 min 9 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/485412/ [19:15:13] Project beta-code-update-eqiad build #485413: 04STILL FAILING in 2 min 12 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/485413/ [19:18:02] 10Continuous-Integration-Infrastructure, 06SRE, 06collaboration-services, 10vm-requests, 13Patch-For-Review: Ganeti VM for contint migration - https://phabricator.wikimedia.org/T358237#9585216 (10Dzahn) The VM has been created and releng-roots already have shell access. The "ci" prod role is not applied... [19:25:06] Project beta-code-update-eqiad build #485414: 04STILL FAILING in 2 min 6 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/485414/ [19:30:41] 06Release-Engineering-Team, 10Account Approval: Requesting GitLab account activation for USER[S] - https://phabricator.wikimedia.org/T358714 (10kolbert) [19:35:14] Project beta-code-update-eqiad build #485415: 04STILL FAILING in 2 min 14 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/485415/ [19:35:23] 06Release-Engineering-Team, 10Account Approval: Requesting GitLab account activation for EPIC - https://phabricator.wikimedia.org/T358716 (10EPIC) [19:44:17] 10Phabricator, 06Release-Engineering-Team, 06collaboration-services, 13Patch-For-Review, 15User-brennen: Update wmf/stable to Phorge upstream's 2023.49 stable release - https://phabricator.wikimedia.org/T358610#9585332 (10Dzahn) [19:45:13] Project beta-code-update-eqiad build #485416: 04STILL FAILING in 2 min 12 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/485416/ [19:45:54] 06Release-Engineering-Team, 10Account Approval, 15User-Urbanecm: Requesting GitLab account activation for Melos - https://phabricator.wikimedia.org/T358711#9585340 (10Melos) 05Open→03Resolved a:03Urbanecm [19:55:10] Project beta-code-update-eqiad build #485417: 04STILL FAILING in 2 min 9 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/485417/ [20:05:11] Project beta-code-update-eqiad build #485418: 04STILL FAILING in 2 min 11 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/485418/ [20:15:12] Project beta-code-update-eqiad build #485419: 04STILL FAILING in 2 min 12 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/485419/ [20:25:09] Project beta-code-update-eqiad build #485420: 04STILL FAILING in 2 min 9 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/485420/ [20:29:30] 06Release-Engineering-Team, 10Temporary accounts, 06Trust and Safety Product Team, 13Patch-For-Review: Create jobs that run PHPUnit, Selenium, and API testing tests with temp account feature flag enabled - https://phabricator.wikimedia.org/T355879#9585434 (10kostajh) I thought about this task some more, an... [20:35:12] Project beta-code-update-eqiad build #485421: 04STILL FAILING in 2 min 11 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/485421/ [20:45:10] Project beta-code-update-eqiad build #485422: 04STILL FAILING in 2 min 9 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/485422/ [21:15:12] Project beta-code-update-eqiad build #485425: 04STILL FAILING in 2 min 12 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/485425/ [21:16:00] ^ this one's a scap change, should be an easy fi [21:16:01] x [21:25:10] Project beta-code-update-eqiad build #485426: 04STILL FAILING in 2 min 9 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/485426/ [21:35:12] Project beta-code-update-eqiad build #485427: 04STILL FAILING in 2 min 11 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/485427/ [21:45:13] Project beta-code-update-eqiad build #485428: 04STILL FAILING in 2 min 12 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/485428/ [21:55:09] Project beta-code-update-eqiad build #485429: 04STILL FAILING in 2 min 9 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/485429/ [22:02:59] (03PS1) 10Thcipriani: beta-code-update-eqiad: There are no security patches in beta [integration/config] - 10https://gerrit.wikimedia.org/r/1007439 (https://phabricator.wikimedia.org/T350070) [22:05:12] Project beta-code-update-eqiad build #485430: 04STILL FAILING in 2 min 11 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/485430/ [22:05:21] (03CR) 10Ahmon Dancy: [C: 03+1] "This is a reasonable quick workaround. I'll make a corresponding change to the scap.cfg that is deployed via puppet." [integration/config] - 10https://gerrit.wikimedia.org/r/1007439 (https://phabricator.wikimedia.org/T350070) (owner: 10Thcipriani) [22:13:19] 06Release-Engineering-Team: Solve OSV Double-Pipeline Problem without Requiring Many Default Rules - https://phabricator.wikimedia.org/T358728 (10cmassaro) [22:15:12] Project beta-code-update-eqiad build #485431: 04STILL FAILING in 2 min 12 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/485431/ [22:20:13] (03CR) 10Ahmon Dancy: [C: 03+2] beta-code-update-eqiad: There are no security patches in beta [integration/config] - 10https://gerrit.wikimedia.org/r/1007439 (https://phabricator.wikimedia.org/T350070) (owner: 10Thcipriani) [22:21:34] (03Merged) 10jenkins-bot: beta-code-update-eqiad: There are no security patches in beta [integration/config] - 10https://gerrit.wikimedia.org/r/1007439 (https://phabricator.wikimedia.org/T350070) (owner: 10Thcipriani) [22:23:09] (03CR) 10Ahmon Dancy: [C: 03+2] "Deployed" [integration/config] - 10https://gerrit.wikimedia.org/r/1007439 (https://phabricator.wikimedia.org/T350070) (owner: 10Thcipriani) [22:23:35] !log jjb-update beta-code-update-eqiad [22:23:37] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [22:25:10] Project beta-code-update-eqiad build #485432: 04STILL FAILING in 2 min 9 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/485432/ [22:26:00] thcipriani: I'm removing /srv/patches/master/core/01-DONTREMOVE.patch [22:33:14] 06Release-Engineering-Team, 10Temporary accounts, 06Trust and Safety Product Team, 13Patch-For-Review: Create jobs that run PHPUnit, Selenium, and API testing tests with temp account feature flag enabled - https://phabricator.wikimedia.org/T355879#9585719 (10hashar) We talked a bit about the task during ou... [22:35:11] Yippee, build fixed! [22:35:11] Project beta-code-update-eqiad build #485433: 09FIXED in 2 min 10 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/485433/ [22:40:03] 10Scap, 06Data-Engineering, 06Data-Platform-SRE: analytics/refinery: Stop using git-fat - https://phabricator.wikimedia.org/T328472#9585732 (10dancy) Hi folks. scaps git-lfs support has been fixed so we can migrate analytics/refinery to git-lfs. To enable LFS for this repo in Gerrit, I need to know what yo... [22:41:45] Project beta-scap-sync-world build #144620: 04FAILURE in 6 min 34 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/144620/ [22:44:37] 06Release-Engineering-Team, 10Account Approval: Requesting GitLab account activation for jonkolbert - https://phabricator.wikimedia.org/T358714#9585734 (10Pppery) [22:47:23] Project beta-scap-sync-world build #144621: 04STILL FAILING in 1 min 8 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/144621/ [22:48:54] Looking into that. [22:54:51] Fixed [22:56:16] Yippee, build fixed! [22:56:17] Project beta-scap-sync-world build #144622: 09FIXED in 5 min 58 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/144622/