[01:22:23] 10GitLab (Infrastructure), 10Data-Persistence-Backup, 10serviceops, 10serviceops-collab, and 2 others: Backups for GitLab - https://phabricator.wikimedia.org/T274463 (10Dzahn) ` 01:04 <+icinga-wm> PROBLEM - Check systemd state on gitlab1004 is CRITICAL: CRITICAL - degraded: The following units failed:... [03:15:10] php lint failed: [03:15:10] Parse error: syntax error, unexpected 'public' (T_PUBLIC), expecting variable (T_VARIABLE) in /srv/mediawiki-staging/php-1.39.0-wmf.19/vendor/symfony/console/Attribute/AsCommand.php on line 21 [03:15:26] wtf [03:22:25] has sync-dir been broken since October 2021? [03:23:14] were lint checks removed from sync-world because our repo doesn't pass lint anymore? [03:27:41] does core depend on a package that requires PHP 8.0? [03:32:03] OK, I found T301344, which answers these questions [03:32:04] T301344: Can't sync vendor - https://phabricator.wikimedia.org/T301344 [03:50:26] 10Scap: Can't sync vendor - https://phabricator.wikimedia.org/T301344 (10tstarling) I made https://github.com/symfony/console/pull/79 [04:02:45] 10Phabricator: After user awards a token to a task, Advanced Search would think relevant to the author of the task - https://phabricator.wikimedia.org/T312188 (10IN) [04:49:10] 10Scap: Can't sync vendor - https://phabricator.wikimedia.org/T301344 (10tstarling) Actually https://github.com/symfony/symfony/pull/46866 [06:21:58] 10Phabricator: After user awards a token to a task, Advanced Search would think relevant to the author of the task - https://phabricator.wikimedia.org/T312188 (10Aklapper) 05Open→03Invalid Indeed. That's intentional by the developers of Phabricator and not a bug. [07:53:08] (03CR) 10Jaime Nuche: "Thanks for the fix Ahmon!" [tools/scap] - 10https://gerrit.wikimedia.org/r/810397 (https://phabricator.wikimedia.org/T310395) (owner: 10Ahmon Dancy) [08:23:18] (03CR) 10Jaime Nuche: [C: 03+2] main._apache_sync_command: add missing parameter default value (031 comment) [tools/scap] - 10https://gerrit.wikimedia.org/r/785121 (owner: 10Jaime Nuche) [09:42:21] Project beta-code-update-eqiad build #398920: 15ABORTED in 8.1 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/398920/ [09:43:25] Project beta-code-update-eqiad build #398921: 15ABORTED in 24 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/398921/ [10:54:08] 10GitLab (CI & Job Runners), 10Release-Engineering-Team (GitLab-a-thon 🦊), 10Patch-For-Review, 10User-brennen: Authenticate trusted runners for registry access against GitLab using temporary JSON Web Token - https://phabricator.wikimedia.org/T308501 (10Joe) >>! In T308501#7935758, @dancy wrote: > @dduvall... [11:22:18] (03PS1) 10Daimona Eaytoy: Add the CampaignEvents extension to make-release [tools/release] - 10https://gerrit.wikimedia.org/r/811689 (https://phabricator.wikimedia.org/T311752) [11:22:33] 10GitLab (CI & Job Runners), 10Release-Engineering-Team (GitLab-a-thon 🦊), 10Patch-For-Review, 10User-brennen: Authenticate trusted runners for registry access against GitLab using temporary JSON Web Token - https://phabricator.wikimedia.org/T308501 (10Joe) We don't use a version of nginx compiled with the... [11:28:45] (03PS2) 10Daimona Eaytoy: Start branching CampaignEvents for Wikimedia production [tools/release] - 10https://gerrit.wikimedia.org/r/811689 (https://phabricator.wikimedia.org/T311752) [11:29:34] (03CR) 10Daimona Eaytoy: "Adding reviewers based on the last merged patches." [tools/release] - 10https://gerrit.wikimedia.org/r/811689 (https://phabricator.wikimedia.org/T311752) (owner: 10Daimona Eaytoy) [11:29:42] (03CR) 10Jaime Nuche: [C: 04-1] "Not sure how this change relates to T266055." [tools/scap] - 10https://gerrit.wikimedia.org/r/811373 (https://phabricator.wikimedia.org/T266055) (owner: 10Ahmon Dancy) [13:40:34] 10Phabricator, 10Release-Engineering-Team, 10Machine-Learning-Team (Active Tasks), 10User-MarcoAurelio: Github's wikimedia/ores not mirroring to Gerrit's scoring/ores/ores - https://phabricator.wikimedia.org/T311390 (10elukey) @MarcoAurelio Thanks a lot for the help! I hope to be able to deprecate all thes... [13:51:10] You're welcome, elukey :) [14:28:51] 10Beta-Cluster-Infrastructure, 10Abstract Wikipedia team: Alerting for function-* services on Beta - https://phabricator.wikimedia.org/T310184 (10Jdforrester-WMF) Is there anything I can do to help with this? [15:01:49] (03CR) 10Ahmon Dancy: Clean up php fpm restart (034 comments) [tools/scap] - 10https://gerrit.wikimedia.org/r/811373 (https://phabricator.wikimedia.org/T266055) (owner: 10Ahmon Dancy) [15:04:39] (03CR) 10Ahmon Dancy: main._apache_sync_command: add missing parameter default value (031 comment) [tools/scap] - 10https://gerrit.wikimedia.org/r/785121 (owner: 10Jaime Nuche) [15:09:27] 10Phabricator, 10Project-Admins, 10Codex: Create custom Phabricator Forms for Codex tasks - https://phabricator.wikimedia.org/T312232 (10Jdforrester-WMF) [15:13:59] 10Phabricator, 10Project-Admins, 10Codex: Create custom Phabricator Forms for Codex tasks - https://phabricator.wikimedia.org/T312232 (10AnneT) [15:15:35] James_F: the `(edited)` is part of the task title? [15:17:01] (03PS4) 10Ahmon Dancy: Clean up php fpm restart [tools/scap] - 10https://gerrit.wikimedia.org/r/811373 (https://phabricator.wikimedia.org/T266055) [15:17:27] (03CR) 10Ahmon Dancy: Clean up php fpm restart (032 comments) [tools/scap] - 10https://gerrit.wikimedia.org/r/811373 (https://phabricator.wikimedia.org/T266055) (owner: 10Ahmon Dancy) [15:38:45] hauskatze: I'm just copy-pasting the request from another channel, it's Anne's plan. Best ask on-task? [15:42:51] 10Phabricator, 10Project-Admins, 10Codex: Create custom Phabricator Forms for Codex tasks - https://phabricator.wikimedia.org/T312232 (10MarcoAurelio) There's also {T310627} which may or may not be related. [16:10:40] (03Abandoned) 10Ahmon Dancy: Add directory mode check to TimeoutLock [tools/scap] - 10https://gerrit.wikimedia.org/r/810069 (https://phabricator.wikimedia.org/T310395) (owner: 10Ahmon Dancy) [16:20:35] (03CR) 10Ahmon Dancy: Add auto mode to stage-train (034 comments) [tools/scap] - 10https://gerrit.wikimedia.org/r/809220 (https://phabricator.wikimedia.org/T310395) (owner: 10Ahmon Dancy) [16:46:00] 10Phabricator (Upstream), 10Release-Engineering-Team, 10SecTeam-Processed, 10Security, 10Vuln-MissingAuthz: Possible to make restricted files public on Phabricator via Diffusion - https://phabricator.wikimedia.org/T307750 (10sbassett) 05Open→03Resolved Resolving under previous assumptions. [16:46:39] 10Phabricator (Upstream), 10Release-Engineering-Team, 10SecTeam-Processed, 10Security, 10Vuln-MissingAuthz: Possible to make restricted files public on Phabricator via Diffusion - https://phabricator.wikimedia.org/T307750 (10sbassett) [16:58:02] 10Release-Engineering-Team, 10Data-Persistence (Consultation), 10Security-API-Service, 10Security-Team, and 2 others: Determine CI best practices for service which connects to MySQL - https://phabricator.wikimedia.org/T308789 (10sbassett) [17:00:48] 10Phabricator, 10Project-Admins, 10Release-Engineering-Team (Radar), 10Security-Team, and 2 others: Move the #acl_security_volunteer policy outside of #acl_security - https://phabricator.wikimedia.org/T305890 (10sbassett) p:05Triage→03Low [17:01:02] 10Phabricator, 10Project-Admins, 10Release-Engineering-Team (Radar), 10Security-Team, and 2 others: Move the #acl_security_volunteer policy outside of #acl_security - https://phabricator.wikimedia.org/T305890 (10sbassett) Given that T298784 has been reopened, I'm going to backlog this task for now, as we'r... [17:31:17] 10Beta-Cluster-Infrastructure: Error: 502, Next Hop Connection Failed (Jul 2022) - https://phabricator.wikimedia.org/T312252 (10AlexisJazz) [17:31:17] 10Beta-Cluster-Infrastructure: Error: 502, Next Hop Connection Failed (Jul 2022) - https://phabricator.wikimedia.org/T312252 (10AlexisJazz) [17:32:13] 10Beta-Cluster-Infrastructure, 10Analytics, 10Beta-Cluster-reproducible: 502, connect failed for intake-analytics.wikimedia.beta.wmflabs.org (Mar 2022) - https://phabricator.wikimedia.org/T303160 (10AlexisJazz) [17:32:20] 10Beta-Cluster-Infrastructure, 10Abstract Wikipedia team: Alerting for function-* services on Beta - https://phabricator.wikimedia.org/T310184 (10ori) a:05ori→03maryyang [17:32:22] Project beta-scap-sync-world build #58481: 04FAILURE in 7 min 30 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/58481/ [17:32:38] 10Beta-Cluster-Infrastructure, 10Abstract Wikipedia team: Alerting for function-* services on Beta - https://phabricator.wikimedia.org/T310184 (10ori) @maryyang has been working on this [17:32:44] 10Continuous-Integration-Config, 10Security-Team, 10Security: Add some form of static analysis for package-lock.json - https://phabricator.wikimedia.org/T242058 (10sbassett) 05Open→03In progress p:05Triage→03Medium [17:32:46] Project beta-update-databases-eqiad build #59811: 04FAILURE in 12 min: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/59811/ [17:32:59] 10Beta-Cluster-Infrastructure, 10SRE, 10Traffic, 10Beta-Cluster-reproducible: Beta cluster down: Error: 502, Next Hop Connection Failed (Feb 2022) - https://phabricator.wikimedia.org/T302699 (10AlexisJazz) [17:34:17] 10Beta-Cluster-Infrastructure, 10Abstract Wikipedia team: Alerting for function-* services on Beta - https://phabricator.wikimedia.org/T310184 (10maryyang) Oops I created a separate task: https://phabricator.wikimedia.org/T311457. Lemme know if I should merge the two. [17:34:43] (03CR) 10Dduvall: "I still need to functionally test this but looks good to me aside from one nit/question." [tools/scap] - 10https://gerrit.wikimedia.org/r/809220 (https://phabricator.wikimedia.org/T310395) (owner: 10Ahmon Dancy) [17:35:39] (03CR) 10Ahmon Dancy: Add auto mode to stage-train (031 comment) [tools/scap] - 10https://gerrit.wikimedia.org/r/809220 (https://phabricator.wikimedia.org/T310395) (owner: 10Ahmon Dancy) [17:35:42] 10Beta-Cluster-Infrastructure, 10Beta-Cluster-reproducible: Beta cluster down: Error: 502, Next Hop Connection Failed - https://phabricator.wikimedia.org/T300525 (10AlexisJazz) [17:35:44] 10Beta-Cluster-Infrastructure, 10Analytics, 10Beta-Cluster-reproducible, 10User-Urbanecm: 502, connect failed for intake-analytics.wikimedia.beta.wmflabs.org - https://phabricator.wikimedia.org/T289029 (10AlexisJazz) [17:35:54] Project mediawiki-core-doxygen-docker build #35459: 04FAILURE in 31 min: https://integration.wikimedia.org/ci/job/mediawiki-core-doxygen-docker/35459/ [17:36:10] Yippee, build fixed! [17:36:11] Project beta-scap-sync-world build #58482: 09FIXED in 1 min 17 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/58482/ [17:38:00] (03PS4) 10Ahmon Dancy: Add auto mode to stage-train [tools/scap] - 10https://gerrit.wikimedia.org/r/809220 (https://phabricator.wikimedia.org/T310395) [17:38:16] (03CR) 10Ahmon Dancy: Add auto mode to stage-train (031 comment) [tools/scap] - 10https://gerrit.wikimedia.org/r/809220 (https://phabricator.wikimedia.org/T310395) (owner: 10Ahmon Dancy) [17:41:18] 10Beta-Cluster-Infrastructure: Beta cluster unreachable when interacting with sessions (Error: 502, Next Hop Connection Failed) - https://phabricator.wikimedia.org/T284279 (10AlexisJazz) [17:41:20] 10Beta-Cluster-Infrastructure, 10Beta-Cluster-reproducible, 10User-Ryasmeen, 10User-zeljkofilipin: Beta Cluster is down - https://phabricator.wikimedia.org/T267551 (10AlexisJazz) [17:41:22] 10Beta-Cluster-Infrastructure, 10SRE, 10Traffic, 10User-DannyS712: 502 error on beta commons - https://phabricator.wikimedia.org/T250103 (10AlexisJazz) [17:43:39] 10Beta-Cluster-Infrastructure: Beta cluster unreachable when interacting with sessions (Error: 502, Next Hop Connection Failed) - https://phabricator.wikimedia.org/T284279 (10AlexisJazz) [17:43:41] 10Beta-Cluster-Infrastructure, 10Beta-Cluster-reproducible, 10User-Ryasmeen, 10User-zeljkofilipin: Beta Cluster is down - https://phabricator.wikimedia.org/T267551 (10AlexisJazz) [17:43:44] 10Beta-Cluster-Infrastructure, 10SRE, 10Traffic, 10User-DannyS712: 502 error on beta commons - https://phabricator.wikimedia.org/T250103 (10AlexisJazz) [17:44:32] 10Beta-Cluster-Infrastructure: Beta cluster unreachable when interacting with sessions (Error: 502, Next Hop Connection Failed) - https://phabricator.wikimedia.org/T284279 (10AlexisJazz) [17:44:34] 10Beta-Cluster-Infrastructure, 10Beta-Cluster-reproducible, 10User-Ryasmeen, 10User-zeljkofilipin: Beta Cluster is down - https://phabricator.wikimedia.org/T267551 (10AlexisJazz) [17:44:38] 10Beta-Cluster-Infrastructure, 10SRE, 10Traffic, 10User-DannyS712: 502 error on beta commons - https://phabricator.wikimedia.org/T250103 (10AlexisJazz) [17:46:32] 10GitLab (CI & Job Runners), 10Release-Engineering-Team (GitLab-a-thon 🦊), 10Patch-For-Review, 10User-brennen: Authenticate trusted runners for registry access against GitLab using temporary JSON Web Token - https://phabricator.wikimedia.org/T308501 (10dduvall) >>! In T308501#8055020, @Joe wrote: > We don'... [18:17:33] Yippee, build fixed! [18:17:34] Project mediawiki-core-doxygen-docker build #35460: 09FIXED in 13 min: https://integration.wikimedia.org/ci/job/mediawiki-core-doxygen-docker/35460/ [18:29:53] Yippee, build fixed! [18:29:53] Project beta-update-databases-eqiad build #59812: 09FIXED in 9 min 52 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/59812/ [18:32:55] (03CR) 10Krinkle: [C: 04-1] zuul: Fix/remove links to non-existent Grafana graphs (031 comment) [integration/docroot] - 10https://gerrit.wikimedia.org/r/810979 (https://phabricator.wikimedia.org/T307405) (owner: 10Stang) [18:54:16] 10Beta-Cluster-Infrastructure, 10Abstract Wikipedia team: Alerting for function-* services on Beta - https://phabricator.wikimedia.org/T310184 (10ori) [20:36:22] (03CR) 10Ahmon Dancy: Clean up php fpm restart (031 comment) [tools/scap] - 10https://gerrit.wikimedia.org/r/811373 (https://phabricator.wikimedia.org/T266055) (owner: 10Ahmon Dancy) [21:08:28] (03PS1) 10Ahmon Dancy: Reduce verbosity of "scap prep auto" [tools/scap] - 10https://gerrit.wikimedia.org/r/811777 [22:08:08] (03CR) 10Jeena Huneidi: [C: 03+2] "LGTM" [tools/scap] - 10https://gerrit.wikimedia.org/r/809220 (https://phabricator.wikimedia.org/T310395) (owner: 10Ahmon Dancy) [22:13:26] (03Merged) 10jenkins-bot: Add auto mode to stage-train [tools/scap] - 10https://gerrit.wikimedia.org/r/809220 (https://phabricator.wikimedia.org/T310395) (owner: 10Ahmon Dancy) [22:21:57] 10GitLab (CI & Job Runners), 10Release-Engineering-Team (GitLab-a-thon 🦊), 10Infrastructure-Foundations, 10SRE, and 4 others: Access to trusted gitlab runners for gitlab-roots (or appropriate similar group) - https://phabricator.wikimedia.org/T308350 (10Dzahn) The change has been approved and then deployed... [22:34:16] 10GitLab (CI & Job Runners), 10Release-Engineering-Team (GitLab-a-thon 🦊), 10Infrastructure-Foundations, 10SRE, and 4 others: Access to trusted gitlab runners for gitlab-roots (or appropriate similar group) - https://phabricator.wikimedia.org/T308350 (10Dzahn) 05Open→03Resolved ` [gitlab-runner1002:~]... [23:11:41] (03CR) 10Jeena Huneidi: [C: 03+2] "LGTM" [tools/scap] - 10https://gerrit.wikimedia.org/r/811777 (owner: 10Ahmon Dancy) [23:17:06] (03Merged) 10jenkins-bot: Reduce verbosity of "scap prep auto" [tools/scap] - 10https://gerrit.wikimedia.org/r/811777 (owner: 10Ahmon Dancy) [23:38:08] (03PS1) 10Jeena Huneidi: Set umask in file creating cmds [tools/scap] - 10https://gerrit.wikimedia.org/r/811785 [23:47:13] (03PS2) 10Jeena Huneidi: Set umask in file creating cmds [tools/scap] - 10https://gerrit.wikimedia.org/r/811785 [23:51:15] (03CR) 10CI reject: [V: 04-1] Set umask in file creating cmds [tools/scap] - 10https://gerrit.wikimedia.org/r/811785 (owner: 10Jeena Huneidi)