[00:03:09] 10GitLab (Account Approval), 06Release-Engineering-Team (Doing 😎): Requesting GitLab account activation for Srilasyapragathi - https://phabricator.wikimedia.org/T410225#11411599 (10Aklapper) 05Openβ†’03Resolved a:03Aklapper Approved. [00:03:54] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for hacksyn - https://phabricator.wikimedia.org/T408161#11411604 (10Aklapper) @Hacksyn: Do you remember any name(s) of project(s) that you were involved in, by any chance? [01:46:14] 06Release-Engineering-Team, 10MediaWiki-extensions-Cargo, 06Security-Team, 07SecTeam-Processed: Remove REL-style release branches from the Cargo extension git repository - https://phabricator.wikimedia.org/T407862#11411670 (10Samwilson) > You could (or, maybe, I could as an admin) change that field to Proj... [02:27:06] 06Release-Engineering-Team, 10MediaWiki-extensions-Cargo, 06Security-Team, 07SecTeam-Processed: Remove REL-style release branches from the Cargo extension git repository - https://phabricator.wikimedia.org/T407862#11411677 (10Reedy) Should be trivial enough… want to file a task about it? [04:18:12] 06Release-Engineering-Team, 10MediaWiki-extensions-Cargo, 06Security-Team, 07SecTeam-Processed: Remove REL-style release branches from the Cargo extension git repository - https://phabricator.wikimedia.org/T407862#11411736 (10Samwilson) I think T70939 might cover it. [07:41:45] !log integration: integration-castor05: rm -fR /srv/castor/castor-mw-ext-and-skins/master/mediawiki-node20/ [07:41:46] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [07:49:46] (03PS1) 10Phedenskog: jjb: Remove daily webdriver.io jobs for core [integration/config] - 10https://gerrit.wikimedia.org/r/1211995 (https://phabricator.wikimedia.org/T410889) [07:51:39] (03PS1) 10Phedenskog: jjb: Remove daily webdriver.io jobs for core [integration/config] - 10https://gerrit.wikimedia.org/r/1211995 (https://phabricator.wikimedia.org/T410889) [08:54:57] (03PS2) 10Hashar: jjb: Remove daily webdriver.io jobs for core [integration/config] - 10https://gerrit.wikimedia.org/r/1211995 (https://phabricator.wikimedia.org/T410889) (owner: 10Phedenskog) [08:56:51] (03CR) 10Hashar: "I ran `./utils/jjb-diff.sh` to list the affected jobs:" [integration/config] - 10https://gerrit.wikimedia.org/r/1211995 (https://phabricator.wikimedia.org/T410889) (owner: 10Phedenskog) [09:50:40] (03PS1) 10Hashar: Zuul: add VisualEditor when Flow is a dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1212072 [09:50:59] (03CR) 10Hashar: [C:03+2] Zuul: add VisualEditor when Flow is a dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1212072 (owner: 10Hashar) [09:52:43] (03Merged) 10jenkins-bot: Zuul: add VisualEditor when Flow is a dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1212072 (owner: 10Hashar) [10:55:03] maintenance-disconnect-full-disks build 758262 integration-agent-docker-1056 (/: 36%, /srv: 96%, /var/lib/docker: 39%): OFFLINE due to disk space [11:00:03] maintenance-disconnect-full-disks build 758263 integration-agent-docker-1056 (/: 36%, /srv: 58%, /var/lib/docker: 38%): RECOVERY disk space OK [12:00:03] maintenance-disconnect-full-disks build 758275 integration-agent-docker-1040 (/: 36%, /srv: 99%, /var/lib/docker: 32%): OFFLINE due to disk space [12:05:03] maintenance-disconnect-full-disks build 758276 integration-agent-docker-1040 (/: 36%, /srv: 15%, /var/lib/docker: 32%): RECOVERY disk space OK [12:40:03] maintenance-disconnect-full-disks build 758283 integration-agent-docker-1056 (/: 36%, /srv: 97%, /var/lib/docker: 38%): OFFLINE due to disk space [12:45:03] maintenance-disconnect-full-disks build 758284 integration-agent-docker-1056 (/: 36%, /srv: 24%, /var/lib/docker: 38%): RECOVERY disk space OK [13:11:24] Hi folks, today too I'm unable to open gerrit. Everything else works fine, I assume I'm once again getting hit by abuse prevention. Could someone please help me figure this out? I can provide more info in private. [13:12:11] (Needless to say it's kinda urgent, because I can't do my job without gerrit...) [13:13:29] hashar: pinging in case you can help ^^ [13:14:32] o/ [13:14:35] 06Release-Engineering-Team (Doing 😎), 10Catalyst (Luka Moli Telo), 07Essential-Work: Migration to MariaDB operator: Patchdemo DB - https://phabricator.wikimedia.org/T408118#11412870 (10jnuche) [13:14:53] Daimona: yeah you most probably got blocked :-/ [13:15:03] we blocked a bunch of IP ranges yesterday [13:15:25] then iirc you were victim of the concurrent connection limit [13:15:44] Yayyyyyy :D [13:15:55] And yeah I was, that's why I'm no longer surprised [13:15:56] and I don't know how to check the nft table [13:16:04] I can share my IP with you in private [13:16:09] as to why you would make too many concurrent requests .. that is a mystery [13:16:34] lets follow up in _security cause we need someone that knwos about nftable [13:18:07] 06Release-Engineering-Team (Priority Backlog πŸ“₯), 07Essential-Work, 05Release, 05Train Deployments: 1.46.0-wmf.4 deployment blockers - https://phabricator.wikimedia.org/T408274#11412877 (10jnuche) 05Openβ†’03Resolved Things have been stable for more than 4h now [13:20:14] 10Gerrit, 10CAS-SSO, 06Infrastructure-Foundations: Use IDP for authentication in Gerrit - https://phabricator.wikimedia.org/T147864#11412908 (10Tacsipacsi) 05Stalledβ†’03Open Thanks for the response! So it’s ready to be worked on, even if that work is unlikely to happen in the near future (at least by staf... [13:40:34] 10Phabricator, 06Release-Engineering-Team (Priority Backlog πŸ“₯): Review and clean up Unresolved Setup Issues in production - https://phabricator.wikimedia.org/T401163#11413011 (10Aklapper) Done this again today, not sure how it got reinstated: * https://phabricator.wikimedia.org/config/issue/config.unknown.gitb... [13:43:01] Project beta-scap-sync-world build #234200: 04FAILURE in 7 min 53 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/234200/ [13:49:00] Project beta-scap-sync-world build #234201: 04STILL FAILING in 2 min 4 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/234201/ [13:56:58] Project beta-scap-sync-world build #234202: 04STILL FAILING in 1 min 42 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/234202/ [14:06:57] Project beta-scap-sync-world build #234203: 04STILL FAILING in 1 min 45 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/234203/ [14:15:56] No such service: MetricsPlatform.ConfigsFetcher [14:17:07] Project beta-scap-sync-world build #234204: 04STILL FAILING in 1 min 52 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/234204/ [14:26:38] https://gerrit.wikimedia.org/r/c/mediawiki/extensions/GrowthExperiments/+/1212149 [14:27:18] Project beta-scap-sync-world build #234205: 04STILL FAILING in 2 min 0 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/234205/ [14:37:11] Project beta-scap-sync-world build #234206: 04STILL FAILING in 1 min 54 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/234206/ [14:52:49] Yippee, build fixed! [14:52:49] Project beta-scap-sync-world build #234207: 09FIXED in 7 min 28 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/234207/ [14:54:22] thanks zabe [14:59:09] Project beta-scap-sync-world build #234208: 04FAILURE in 2 min 21 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/234208/ [15:08:29] Yippee, build fixed! [15:08:30] Project beta-scap-sync-world build #234209: 09FIXED in 2 min 36 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/234209/ [15:45:33] 06Project-Admins, 06Release-Engineering-Team (Doing 😎), 10VerySmallGLAM: Create project tag for #crm4wb - https://phabricator.wikimedia.org/T410504#11413507 (10Olea) Thanks! [16:20:18] (03PS1) 10Hashar: Zuul: disable recursion with AbuseFilter/ConfirmEdit [integration/config] - 10https://gerrit.wikimedia.org/r/1212184 [16:20:36] (03PS2) 10Hashar: Zuul: disable recursion with AbuseFilter/ConfirmEdit [integration/config] - 10https://gerrit.wikimedia.org/r/1212184 (https://phabricator.wikimedia.org/T389998) [17:55:37] James_F: want to pull the trigger on https://gerrit.wikimedia.org/r/c/integration/config/+/1204910? [18:01:01] (03PS11) 10Krinkle: Zuul: Drop PHP 8.1 testing from MW ecosystem master, switch default to 8.3 [integration/config] - 10https://gerrit.wikimedia.org/r/1204910 (owner: 10Jforrester) [18:01:01] (03CR) 10Krinkle: "Going ahead, as James is OOO until begining of next week. This LGTM." [integration/config] - 10https://gerrit.wikimedia.org/r/1204910 (owner: 10Jforrester) [18:03:03] (03CR) 10Zfilipin: "Let's discuss it first in our team meeting." [integration/config] - 10https://gerrit.wikimedia.org/r/1211995 (https://phabricator.wikimedia.org/T410889) (owner: 10Phedenskog) [18:03:21] (03CR) 10Krinkle: [C:03+2] Zuul: Drop PHP 8.1 testing from MW ecosystem master, switch default to 8.3 [integration/config] - 10https://gerrit.wikimedia.org/r/1204910 (owner: 10Jforrester) [18:04:50] (03Merged) 10jenkins-bot: Zuul: Drop PHP 8.1 testing from MW ecosystem master, switch default to 8.3 [integration/config] - 10https://gerrit.wikimedia.org/r/1204910 (owner: 10Jforrester) [18:20:18] wheee [18:25:17] misses a reload or something? currently it still starts jobs with php8.1. [18:30:28] I'm guessing Krinkle hasn't deployed it yet [18:34:01] fair [19:00:27] 10Phabricator, 07Performance Issue: Herald rules causing delays to task edit saves - getting worse - https://phabricator.wikimedia.org/T108586#11414050 (10valerio.bozzolan) >>! In T108586#11259630, @A_smart_kitten wrote: > Noting that after asking upstream (https://we.phorge.it/Q207) about the possibility of H... [19:09:54] 10Phabricator, 07Performance Issue: Herald rules causing delays to task edit saves - getting worse - https://phabricator.wikimedia.org/T108586#11414085 (10valerio.bozzolan) P.S. in phabricator.wikimedia.org - has it ever been necessary to manually disable Herald rules for de-activated ("disabled") users? Just... [21:16:55] Project beta-scap-sync-world build #234246: 04FAILURE in 1 min 47 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/234246/ [21:27:13] Yippee, build fixed! [21:27:13] Project beta-scap-sync-world build #234247: 09FIXED in 1 min 55 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/234247/ [22:06:59] Project beta-scap-sync-world build #234251: 04FAILURE in 1 min 44 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/234251/ [22:17:07] Project beta-scap-sync-world build #234252: 04STILL FAILING in 1 min 47 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/234252/ [22:24:59] !log Reloading Zuul to deploy https://gerrit.wikimedia.org/r/1204910 [22:25:00] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [22:25:06] zabe: done :) [22:27:02] Project beta-scap-sync-world build #234253: 04STILL FAILING in 1 min 48 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/234253/ [22:37:10] Yippee, build fixed! [22:37:10] Project beta-scap-sync-world build #234254: 09FIXED in 1 min 58 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/234254/ [22:54:17] (03PS1) 10Zabe: zuul: Run phan on php 8.2 for REL1_45 [integration/config] - 10https://gerrit.wikimedia.org/r/1212257 [22:55:48] (03CR) 10CI reject: [V:04-1] zuul: Run phan on php 8.2 for REL1_45 [integration/config] - 10https://gerrit.wikimedia.org/r/1212257 (owner: 10Zabe) [22:56:40] (03PS2) 10Zabe: zuul: Run phan on php 8.3 for REL1_45 [integration/config] - 10https://gerrit.wikimedia.org/r/1212257 [22:59:05] (03CR) 10Zabe: Zuul: Drop PHP 8.1 testing from MW ecosystem master, switch default to 8.3 (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/1204910 (owner: 10Jforrester) [23:06:58] Project beta-scap-sync-world build #234257: 04FAILURE in 1 min 45 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/234257/ [23:17:17] Yippee, build fixed! [23:17:17] Project beta-scap-sync-world build #234258: 09FIXED in 2 min 1 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/234258/ [23:19:46] Krinkle: the patched accidentally caused the diffConfig job in operations/mediawiki-config to be voting now while it is always marked as failed if something changed [23:21:15] (03PS1) 10Zabe: zuul: Migrate operations/mediawiki-config to php 8.3 [integration/config] - 10https://gerrit.wikimedia.org/r/1212268 [23:22:30] We could revert https://gerrit.wikimedia.org/g/integration/config/+/9b13e0ccee2a9efc296ee0dc64e3109d30817b46/zuul/layout.yaml#1354 back to php 8.1 or alternatively migrate mediawiki-config php 8.3 ^ [23:23:08] sorry, wrong link: https://gerrit.wikimedia.org/r/plugins/gitiles/integration/config/+/refs/heads/master/zuul/layout.yaml#1354 [23:25:03] (03CR) 10Majavah: [C:03+2] zuul: Migrate operations/mediawiki-config to php 8.3 [integration/config] - 10https://gerrit.wikimedia.org/r/1212268 (owner: 10Zabe) [23:26:32] (03Merged) 10jenkins-bot: zuul: Migrate operations/mediawiki-config to php 8.3 [integration/config] - 10https://gerrit.wikimedia.org/r/1212268 (owner: 10Zabe) [23:26:55] Project beta-scap-sync-world build #234259: 04FAILURE in 1 min 43 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/234259/ [23:27:09] !log reload zuul for https://gerrit.wikimedia.org/r/1212268 [23:27:10] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [23:30:00] taavi: thanks! [23:32:02] (03CR) 10Krinkle: [C:03+2] Zuul: Drop PHP 8.1 testing from MW ecosystem master, switch default to 8.3 (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/1204910 (owner: 10Jforrester) [23:32:22] (03CR) 10Krinkle: [C:03+2] zuul: Run phan on php 8.3 for REL1_45 [integration/config] - 10https://gerrit.wikimedia.org/r/1212257 (owner: 10Zabe) [23:32:26] (03CR) 10Krinkle: zuul: Run phan on php 8.3 for REL1_45 [integration/config] - 10https://gerrit.wikimedia.org/r/1212257 (owner: 10Zabe) [23:32:44] (03PS3) 10Krinkle: zuul: Run phan on php 8.3 for REL1_45 [integration/config] - 10https://gerrit.wikimedia.org/r/1212257 (https://phabricator.wikimedia.org/T358666) (owner: 10Zabe) [23:32:49] (03CR) 10Krinkle: [C:03+2] zuul: Run phan on php 8.3 for REL1_45 [integration/config] - 10https://gerrit.wikimedia.org/r/1212257 (https://phabricator.wikimedia.org/T358666) (owner: 10Zabe) [23:34:16] (03Merged) 10jenkins-bot: zuul: Run phan on php 8.3 for REL1_45 [integration/config] - 10https://gerrit.wikimedia.org/r/1212257 (https://phabricator.wikimedia.org/T358666) (owner: 10Zabe) [23:35:26] !log Reloading Zuul to deploy https://gerrit.wikimedia.org/r/1212257 [23:35:27] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [23:37:14] Yippee, build fixed! [23:37:14] Project beta-scap-sync-world build #234260: 09FIXED in 2 min 0 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/234260/