[00:04:35] 10GitLab (Integrations), 10Phabricator, 10Release-Engineering-Team (GitLab III: GitLab in LA πŸͺƒ), 10User-brennen: Comment on Phabricator when an updated merge request contains a new bug trailer - https://phabricator.wikimedia.org/T325116 (10brennen) 05In progressβ†’03Resolved [00:04:39] 10GitLab (Integrations), 10Phabricator, 10Release-Engineering-Team (GitLab III: GitLab in LA πŸͺƒ), 10User-brennen: Comment on Phabricator tasks for new, merged, and abandoned changes on GitLab - https://phabricator.wikimedia.org/T324150 (10brennen) [00:13:26] 10Release-Engineering-Team (Seen), 10MW-on-K8s, 10SRE, 10Traffic, and 2 others: Serve production traffic via Kubernetes - https://phabricator.wikimedia.org/T290536 (10colewhite) [00:48:59] 10GitLab: Import Merge Requests from GitHub read-only mirrored repos into GitLab - https://phabricator.wikimedia.org/T325106 (10bd808) One advantage that Gnome has for implementing this that our GitLab deployment does not have today: "GNOME's GitLab instance also supports GitHub as one of the possible authentica... [01:22:48] (03PS1) 10Tim Starling: Add Jonathanischoice to trusted email list [integration/config] - 10https://gerrit.wikimedia.org/r/867734 [01:28:33] (03CR) 10Reedy: [C: 03+2] Add Jonathanischoice to trusted email list [integration/config] - 10https://gerrit.wikimedia.org/r/867734 (owner: 10Tim Starling) [01:30:31] (03Merged) 10jenkins-bot: Add Jonathanischoice to trusted email list [integration/config] - 10https://gerrit.wikimedia.org/r/867734 (owner: 10Tim Starling) [01:31:05] !log Reloading Zuul to deploy https://gerrit.wikimedia.org/r/867734 [01:31:06] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [01:32:15] 10GitLab: Import Merge Requests from GitHub read-only mirrored repos into GitLab - https://phabricator.wikimedia.org/T325106 (10Aklapper) p:05Triageβ†’03Lowest [02:08:35] (03PS1) 10Tim Starling: Compile PHP extensions with -Wall -Werror [integration/config] - 10https://gerrit.wikimedia.org/r/867735 [03:43:17] 10Release-Engineering-Team (Priority Backlog πŸ“₯), 10MW-1.40-notes (1.40.0-wmf.13; 2022-12-05), 10Patch-For-Review, 10Release, 10Train Deployments: 1.40.0-wmf.13 deployment blockers - https://phabricator.wikimedia.org/T320518 (10demon) 05Openβ†’03Resolved [03:48:10] 10Scap: sync-* scripts should have ability to limit target nodes - https://phabricator.wikimedia.org/T162208 (10demon) 05Openβ†’03Declined [06:04:08] 10GitLab, 10Wikimedia-GitHub: Import Merge Requests from GitHub read-only mirrored repos into GitLab - https://phabricator.wikimedia.org/T325106 (10Legoktm) [06:13:02] Project beta-code-update-eqiad build #422018: 04FAILURE in 0.67 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/422018/ [06:14:16] (03PS1) 10Legoktm: Don't use tox 4 [integration/tox-wikimedia] - 10https://gerrit.wikimedia.org/r/867741 (https://phabricator.wikimedia.org/T325118) [06:14:18] (03PS1) 10Legoktm: Update my email address [integration/tox-wikimedia] - 10https://gerrit.wikimedia.org/r/867742 [06:14:20] (03PS1) 10Legoktm: Drop pre-3.7 support [integration/tox-wikimedia] - 10https://gerrit.wikimedia.org/r/867743 [06:14:22] (03PS1) 10Legoktm: Release 0.0.4 [integration/tox-wikimedia] - 10https://gerrit.wikimedia.org/r/867744 [06:16:34] (03CR) 10CI reject: [V: 04-1] Release 0.0.4 [integration/tox-wikimedia] - 10https://gerrit.wikimedia.org/r/867744 (owner: 10Legoktm) [06:16:36] (03CR) 10CI reject: [V: 04-1] Drop pre-3.7 support [integration/tox-wikimedia] - 10https://gerrit.wikimedia.org/r/867743 (owner: 10Legoktm) [06:17:54] (03CR) 10CI reject: [V: 04-1] Don't use tox 4 [integration/tox-wikimedia] - 10https://gerrit.wikimedia.org/r/867741 (https://phabricator.wikimedia.org/T325118) (owner: 10Legoktm) [06:18:06] (03CR) 10CI reject: [V: 04-1] Update my email address [integration/tox-wikimedia] - 10https://gerrit.wikimedia.org/r/867742 (owner: 10Legoktm) [06:20:06] heh, flake8 is wrong [06:22:56] (03PS2) 10Legoktm: Don't use tox 4, drop pre-3.7 support [integration/tox-wikimedia] - 10https://gerrit.wikimedia.org/r/867741 (https://phabricator.wikimedia.org/T325118) [06:22:58] (03PS2) 10Legoktm: Update my email address [integration/tox-wikimedia] - 10https://gerrit.wikimedia.org/r/867742 [06:23:00] (03PS2) 10Legoktm: Release 0.0.4 [integration/tox-wikimedia] - 10https://gerrit.wikimedia.org/r/867744 [06:23:01] Project beta-code-update-eqiad build #422019: 04STILL FAILING in 0.66 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/422019/ [06:23:34] (03Abandoned) 10Legoktm: Drop pre-3.7 support [integration/tox-wikimedia] - 10https://gerrit.wikimedia.org/r/867743 (owner: 10Legoktm) [06:25:40] (03CR) 10Legoktm: [C: 03+2] Don't use tox 4, drop pre-3.7 support [integration/tox-wikimedia] - 10https://gerrit.wikimedia.org/r/867741 (https://phabricator.wikimedia.org/T325118) (owner: 10Legoktm) [06:25:46] (03CR) 10Legoktm: [C: 03+2] Update my email address [integration/tox-wikimedia] - 10https://gerrit.wikimedia.org/r/867742 (owner: 10Legoktm) [06:25:52] (03CR) 10Legoktm: [C: 03+2] Release 0.0.4 [integration/tox-wikimedia] - 10https://gerrit.wikimedia.org/r/867744 (owner: 10Legoktm) [06:27:57] (03Merged) 10jenkins-bot: Don't use tox 4, drop pre-3.7 support [integration/tox-wikimedia] - 10https://gerrit.wikimedia.org/r/867741 (https://phabricator.wikimedia.org/T325118) (owner: 10Legoktm) [06:28:02] (03Merged) 10jenkins-bot: Update my email address [integration/tox-wikimedia] - 10https://gerrit.wikimedia.org/r/867742 (owner: 10Legoktm) [06:28:07] (03Merged) 10jenkins-bot: Release 0.0.4 [integration/tox-wikimedia] - 10https://gerrit.wikimedia.org/r/867744 (owner: 10Legoktm) [06:33:01] Project beta-code-update-eqiad build #422020: 04STILL FAILING in 0.67 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/422020/ [06:43:01] Project beta-code-update-eqiad build #422021: 04STILL FAILING in 0.67 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/422021/ [06:43:37] 10GitLab, 10Wikimedia-GitHub: Import Merge Requests from GitHub read-only mirrored repos into GitLab - https://phabricator.wikimedia.org/T325106 (10Tgr) Why not have cross-realm auth, though? [06:53:01] Project beta-code-update-eqiad build #422022: 04STILL FAILING in 0.68 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/422022/ [07:03:08] Project beta-code-update-eqiad build #422023: 04STILL FAILING in 7.4 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/422023/ [07:12:26] (03CR) 10Hashar: [C: 03+2] wm-checks-api: show processor prototype name on error [software/gerrit] (deploy/wmf/stable-3.5) - 10https://gerrit.wikimedia.org/r/867648 (owner: 10Hashar) [07:12:37] (03CR) 10Hashar: [C: 03+2] wm-checks-api: parse PipelineLib messages [software/gerrit] (deploy/wmf/stable-3.5) - 10https://gerrit.wikimedia.org/r/867656 (owner: 10Hashar) [07:12:59] (03Merged) 10jenkins-bot: wm-checks-api: show processor prototype name on error [software/gerrit] (deploy/wmf/stable-3.5) - 10https://gerrit.wikimedia.org/r/867648 (owner: 10Hashar) [07:13:01] Project beta-code-update-eqiad build #422024: 04STILL FAILING in 0.73 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/422024/ [07:13:06] (03Merged) 10jenkins-bot: wm-checks-api: parse PipelineLib messages [software/gerrit] (deploy/wmf/stable-3.5) - 10https://gerrit.wikimedia.org/r/867656 (owner: 10Hashar) [07:16:15] 10GitLab: Import Merge Requests from GitHub read-only mirrored repos into GitLab - https://phabricator.wikimedia.org/T325106 (10hashar) [07:18:26] I will fix up beta-code-update-eqiad [07:18:29] it is an issue with git [07:22:39] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team: beta-code-update-eqiad: - https://phabricator.wikimedia.org/T325128 (10hashar) [07:23:01] Project beta-code-update-eqiad build #422025: 04STILL FAILING in 0.67 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/422025/ [07:27:34] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team: beta-code-update-eqiad: - https://phabricator.wikimedia.org/T325128 (10hashar) I have looked at Gerrit and nothing significant merged at the time. Eventually I found out `git` package has been upgraded on the machine: ` name=/var/log/apt/history.log S... [07:33:02] Project beta-code-update-eqiad build #422026: 04STILL FAILING in 1.2 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/422026/ [07:42:13] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team, 10serviceops: git: detected dubious ownership in repository at '/srv/mediawiki-staging' - https://phabricator.wikimedia.org/T325128 (10hashar) [07:42:27] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team, 10serviceops: git: detected dubious ownership in repository at '/srv/mediawiki-staging' - https://phabricator.wikimedia.org/T325128 (10hashar) p:05Triageβ†’03High [07:43:01] Project beta-code-update-eqiad build #422027: 04STILL FAILING in 0.63 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/422027/ [07:52:35] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team, 10serviceops: git: detected dubious ownership in repository at '/srv/mediawiki-staging' - https://phabricator.wikimedia.org/T325128 (10hashar) Another note is we have the git repository flagged as shared between user by setting `core.sharedRepository... [07:53:01] Project beta-code-update-eqiad build #422028: 04STILL FAILING in 0.66 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/422028/ [07:58:17] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team, 10serviceops: git: detected dubious ownership in repository at '/srv/mediawiki-staging' - https://phabricator.wikimedia.org/T325128 (10hashar) a:03hashar [08:03:01] Project beta-code-update-eqiad build #422029: 04STILL FAILING in 0.65 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/422029/ [08:13:01] Project beta-code-update-eqiad build #422030: 04STILL FAILING in 0.66 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/422030/ [08:16:45] Yippee, build fixed! [08:16:46] Project beta-code-update-eqiad build #422031: 09FIXED in 2 min 59 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/422031/ [08:30:03] (03PS2) 10Giuseppe Lavagetto: deployments: add mediawiki infrastructure windows [tools/release] - 10https://gerrit.wikimedia.org/r/867570 [08:43:11] !log deployment-prep: fixed beta-code-update-eqiad Jenkins job by cherry-picking https://gerrit.wikimedia.org/r/c/operations/puppet/+/868002 | T325128 [08:43:13] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [08:43:14] T325128: git: detected dubious ownership in repository at '/srv/mediawiki-staging' - https://phabricator.wikimedia.org/T325128 [08:43:45] Krinkle: PipelineBot is now recognized by the checks UI plugin https://gerrit.wikimedia.org/r/c/labs/codesearch/+/861508 ;) [09:26:02] 10Release-Engineering-Team (Priority Backlog πŸ“₯), 10Patch-For-Review, 10Release, 10Train Deployments: 1.40.0-wmf.14 deployment blockers - https://phabricator.wikimedia.org/T320519 (10hashar) [10:04:23] 10GitLab, 10serviceops-collab: Optimize Gitlab Backups - https://phabricator.wikimedia.org/T324506 (10Jelto) >>! In T324506#8444449, @Arnoldokoth wrote: > As an idea, I was combing through the docs (https://docs.gitlab.com/ee/raketasks/backup_gitlab.html#incremental-repository-backups) and noticed Gitlab suppo... [10:10:31] 10Project-Admins: Create a subproject for WMES - https://phabricator.wikimedia.org/T325044 (10Aklapper) Requested public project #Fediverso_WMES has been created: https://phabricator.wikimedia.org/project/view/6299/ (In case you need to edit the project or project workboard itself at some point and lack permiss... [10:10:39] 10Project-Admins: Create a subproject for WMES - https://phabricator.wikimedia.org/T325044 (10Aklapper) 05Openβ†’03Resolved a:03Aklapper [10:12:28] (03PS1) 10Kosta Harlan: Skip API testing tests for Quibble ci-fullrun with sqlite [integration/config] - 10https://gerrit.wikimedia.org/r/868034 (https://phabricator.wikimedia.org/T322716) [10:27:14] (03CR) 10Hashar: [C: 03+2] "Excellent, thank you ;)" [integration/config] - 10https://gerrit.wikimedia.org/r/868034 (https://phabricator.wikimedia.org/T322716) (owner: 10Kosta Harlan) [10:27:29] 10GitLab, 10Release-Engineering-Team, 10serviceops-collab, 10Patch-For-Review: Align the GitLab runner tags - https://phabricator.wikimedia.org/T325069 (10Jelto) p:05Triageβ†’03Medium I prepared two changes to use `trusted` tag for Trusted Runners and `wmcs` for Shared Runners in WMCS. I'd suggest to su... [10:27:46] 10GitLab, 10Release-Engineering-Team, 10serviceops-collab, 10Patch-For-Review: Align the GitLab runner tags - https://phabricator.wikimedia.org/T325069 (10Jelto) a:03Jelto [10:29:00] (03Merged) 10jenkins-bot: Skip API testing tests for Quibble ci-fullrun with sqlite [integration/config] - 10https://gerrit.wikimedia.org/r/868034 (https://phabricator.wikimedia.org/T322716) (owner: 10Kosta Harlan) [10:42:54] 10Release-Engineering-Team (Priority Backlog πŸ“₯), 10Patch-For-Review, 10Release, 10Train Deployments: 1.40.0-wmf.14 deployment blockers - https://phabricator.wikimedia.org/T320519 (10hashar) The fix for T325137 is being worked on and we should have a hotfix in the afternoon. Once backported, I will promote... [10:47:31] 10Project-Admins: Create a subproject for WMES - https://phabricator.wikimedia.org/T325044 (10Mentxuwiki) Thank you very much! [12:10:37] 10Release-Engineering-Team (Priority Backlog πŸ“₯), 10Patch-For-Review, 10Release, 10Train Deployments: 1.40.0-wmf.14 deployment blockers - https://phabricator.wikimedia.org/T320519 (10daniel) >>! In T320519#8466074, @hashar wrote: > The fix for T325137 is being worked on and we should have a hotfix in the af... [12:12:11] 10Release-Engineering-Team (Priority Backlog πŸ“₯), 10Patch-For-Review, 10Release, 10Train Deployments: 1.40.0-wmf.14 deployment blockers - https://phabricator.wikimedia.org/T320519 (10Ladsgroup) I'll backport it between my meetings. [12:27:38] 10Release-Engineering-Team (Seen), 10MW-on-K8s, 10SRE, 10Traffic, and 3 others: Serve production traffic via Kubernetes - https://phabricator.wikimedia.org/T290536 (10Ladsgroup) This is not really user-impacting, specially given that mw-on-k8s is on test2wiki only but I think it should show up in next week... [12:34:25] hashar: nice RE pipeline lib [12:53:51] 10Release-Engineering-Team (Seen), 10MW-on-K8s, 10SRE, 10Traffic, and 3 others: Serve production traffic via Kubernetes - https://phabricator.wikimedia.org/T290536 (10akosiaris) >>! In T290536#8466377, @Ladsgroup wrote: > - Inviting tech users to test our the new infra and let us know of issues early on.... [14:54:32] 10Continuous-Integration-Infrastructure, 10SRE, 10decommission-hardware, 10ops-eqiad, 10serviceops-collab: decommission contint1001.wikimedia.org (dcops) - https://phabricator.wikimedia.org/T325102 (10Jclark-ctr) [14:54:39] 10Continuous-Integration-Infrastructure, 10SRE, 10decommission-hardware, 10ops-eqiad, 10serviceops-collab: decommission contint1001.wikimedia.org (dcops) - https://phabricator.wikimedia.org/T325102 (10Jclark-ctr) 05Openβ†’03Resolved [14:54:45] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Seen), 10serviceops-collab, 10Patch-For-Review: contint1001 hardware failures (remove contint1001 from production) - https://phabricator.wikimedia.org/T324698 (10Jclark-ctr) [15:14:27] 10Continuous-Integration-Config, 10Codex, 10Design-Systems-Team (Design-Systems-Sprint), 10Patch-For-Review: docs: Consider making the latest release branch the default for the live docs site - https://phabricator.wikimedia.org/T311097 (10AnneT) Moving this to Ready for Design because we need to figure out... [16:10:09] 10Release-Engineering-Team (Priority Backlog πŸ“₯), 10Patch-For-Review, 10Release, 10Train Deployments: 1.40.0-wmf.14 deployment blockers - https://phabricator.wikimedia.org/T320519 (10hashar) [16:40:08] 10Release-Engineering-Team, 10Wikimedia-Phabricator-Extensions, 10serviceops-collab: Disable "Browse Gerrit Projects" on https://phabricator.wikimedia.org/r/ - https://phabricator.wikimedia.org/T228507 (10hashar) @Dzahn if you need to phase out the Differential repo rPHEX , we can migrate it to Gerrit which... [16:42:18] 10Release-Engineering-Team, 10Wikimedia-Phabricator-Extensions, 10serviceops-collab: Disable "Browse Gerrit Projects" on https://phabricator.wikimedia.org/r/ - https://phabricator.wikimedia.org/T228507 (10brennen) > @Dzahn if you need to phase out the Differential repo rPHEX , we can migrate it to Gerrit whi... [17:09:46] (03PS1) 10Volans: Zuul: [cloud/wmcs-cookbooks] Setup CI [integration/config] - 10https://gerrit.wikimedia.org/r/868134 [17:18:29] jnuche: slyngs proposed a Docker image for OpenLDAP https://gitlab.wikimedia.org/repos/releng/dev-images/-/merge_requests/22 it has a few interesting bits to apparently provision some bits here and there [17:18:43] maybe that can be used as an inspiration / helper for the Jenkins OpenLDAP image [17:19:10] hashar: yeah, thanks, I'm already using that image as a reference :) [17:25:15] nice ;] [17:28:04] 10GitLab: Import Merge Requests from GitHub read-only mirrored repos into GitLab - https://phabricator.wikimedia.org/T325106 (10bd808) >>! In T325106#8465674, @Tgr wrote: > Why not have cross-realm auth, though? That is a fair question, but maybe better handled as a separate topic. The biggest question I suppos... [17:45:20] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team, 10serviceops, 10Patch-For-Review: git: detected dubious ownership in repository at '/srv/mediawiki-staging' - https://phabricator.wikimedia.org/T325128 (10Southparkfan) [[ https://wikitech.wikimedia.org/wiki/Help:Standalone_puppetmaster | Standalon... [17:57:54] 10Continuous-Integration-Infrastructure, 10OOUI, 10Regression: OOUI PHP demos page is broken (again) - https://phabricator.wikimedia.org/T322357 (10hashar) doc.wikimedia.org is hosted on doc1002.eqiad.wmnet which has Buster. It gets PHP from Debian and thus runs PHP 7.3. We might be able to upgrade it to PH... [18:03:14] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team, 10serviceops, 10Patch-For-Review: git: detected dubious ownership in repository at '/srv/mediawiki-staging' - https://phabricator.wikimedia.org/T325128 (10hashar) For WMCS Standalone puppetmasters I am not sure how it should behave. I have discove... [18:06:27] 10Continuous-Integration-Infrastructure, 10OOUI, 10Regression: OOUI PHP demos page is broken (again) - https://phabricator.wikimedia.org/T322357 (10Krinkle) @hashar Do we have enabled and access to some kind of error_log for the doc1002 php-fpm instance where we might find about PHP Deprecated warnings etc?... [18:08:56] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team, 10serviceops, 10Patch-For-Review: git: detected dubious ownership in repository at '/srv/mediawiki-staging' - https://phabricator.wikimedia.org/T325128 (10taavi) Sort of related for standalone puppetmasters: {T152059} [18:13:39] 10Continuous-Integration-Infrastructure, 10OOUI, 10Regression: OOUI PHP demos page is broken (again) - https://phabricator.wikimedia.org/T322357 (10hashar) >>! In T322357#8468528, @Krinkle wrote: > @hashar Do we have enabled and access to some kind of error_log for the doc1002 php-fpm instance where we might... [18:15:50] (03CR) 10Hashar: [C: 03+2] Zuul: [cloud/wmcs-cookbooks] Setup CI [integration/config] - 10https://gerrit.wikimedia.org/r/868134 (owner: 10Volans) [18:17:52] (03Merged) 10jenkins-bot: Zuul: [cloud/wmcs-cookbooks] Setup CI [integration/config] - 10https://gerrit.wikimedia.org/r/868134 (owner: 10Volans) [18:18:38] !log Reloaded Zuul for "Zuul: [cloud/wmcs-cookbooks] Setup CI" https://gerrit.wikimedia.org/r/c/integration/config/+/868134 [18:18:39] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [18:18:47] (03CR) 10Hashar: [C: 03+2] "deployed!" [integration/config] - 10https://gerrit.wikimedia.org/r/868134 (owner: 10Volans) [18:29:30] 10GitLab, 10Release-Engineering-Team, 10serviceops-collab, 10Patch-For-Review: Align the GitLab runner tags - https://phabricator.wikimedia.org/T325069 (10bd808) I know that I am a leading contributor to this problem, but "cloud" is pretty closely tied to [[https://wikitech.wikimedia.org/wiki/Help:Cloud_Se... [18:32:44] (03CR) 10RLazarus: [C: 03+1] deployments: add mediawiki infrastructure windows [tools/release] - 10https://gerrit.wikimedia.org/r/867570 (owner: 10Giuseppe Lavagetto) [18:33:41] (03CR) 10ClΓ©ment Goubert: [C: 03+1] deployments: add mediawiki infrastructure windows [tools/release] - 10https://gerrit.wikimedia.org/r/867570 (owner: 10Giuseppe Lavagetto) [18:45:32] 10GitLab (Administration, Settings & Policy), 10Release-Engineering-Team (Priority Backlog πŸ“₯), 10Product-Analytics, 10Privacy, 10User-brennen: Request for Private repos to be enabled - https://phabricator.wikimedia.org/T305082 (10kzimmerman) I would like to raise the priority of this request, so that our... [19:12:44] 10GitLab, 10Wikimedia-GitHub, 10Security: Support Github login in Gitlab - https://phabricator.wikimedia.org/T325235 (10Tgr) [19:15:32] (03CR) 10Thcipriani: [C: 03+2] "Next calendar will autogenerate on Sat. 2022-12-17 @2am UTC" [tools/release] - 10https://gerrit.wikimedia.org/r/867570 (owner: 10Giuseppe Lavagetto) [19:16:21] (03Merged) 10jenkins-bot: deployments: add mediawiki infrastructure windows [tools/release] - 10https://gerrit.wikimedia.org/r/867570 (owner: 10Giuseppe Lavagetto) [19:20:58] 10GitLab, 10Wikimedia-GitHub, 10Security: Support Github login in Gitlab - https://phabricator.wikimedia.org/T325235 (10Tgr) Tagged as #security because the Gitlab doc on Github has a [[https://docs.gitlab.com/ee/integration/github.html#check-for-security-vulnerabilities|security notice]] about the Github in... [19:21:54] 10GitLab: Import Merge Requests from GitHub read-only mirrored repos into GitLab - https://phabricator.wikimedia.org/T325106 (10Tgr) Filed as {T325235}. [19:25:25] hashar: I don't have sudo on doc1002, I guess you can check the error log? [19:28:26] we should make a ticket to get logs from doc into logstash, my team can fix that [19:28:31] if they are not there yet [19:28:45] also doc1002 got rebooted but it doesn't sound like that has anything to do with it [19:29:53] php-fpm.conf:error_log = /var/log/php7.3-fpm.log [19:29:53] php.ini:error_reporting = E_ALL & ~E_DEPRECATED & ~E_STRICT [19:30:43] grep error /var/log/php7.3-fpm.log [19:30:43] [11-Dec-2022 00:00:04] NOTICE: error log file re-opened [19:31:03] not much but maybe error_reporting needs to be more verbose. sorry gotta go to meeting [19:33:42] hashar: oh, I see. it *excludes* E_DEPRECATED [19:33:50] yeah that's not useful during upgrades :D [19:34:16] probably a good call overall, I mean, in general most stuff runing there we don't need/want/can't change as being upstream, so it's fine if some of it uses old functionality. [19:34:26] but maybe every once in a while yeah, opening it up for a few days would be good [20:21:36] 10Phabricator, 10Code-Review-Workgroup, 10Developer Productivity, 10Epic: Determine options to improve work flow between Phabricator and Gerrit - https://phabricator.wikimedia.org/T232656 (10Tgr) [20:27:08] 10Phabricator, 10Code-Review-Workgroup, 10GerritBot, 10Developer Productivity: Indicate WIP status of patches on Phabricator patch list - https://phabricator.wikimedia.org/T325239 (10Tgr) [20:36:14] (03PS1) 10Samtar: deployments-calendar: Add TheresNoTime [tools/release] - 10https://gerrit.wikimedia.org/r/868164 [20:38:28] (03PS2) 10Samtar: deployments-calendar: Add TheresNoTime [tools/release] - 10https://gerrit.wikimedia.org/r/868164 [20:39:16] (03CR) 10Samtar: "(TIL you can add `--reviewers` via the `git-review` command)" [tools/release] - 10https://gerrit.wikimedia.org/r/868164 (owner: 10Samtar) [20:53:52] Krinkle: yea, ACK, excludes deprecated. unfortunately this looks like a default for everything that gets php-fpm so far, so not unique setting for doc [20:54:21] would have to be made flexible in general [20:54:33] mutante: well, not for mw in prod. but maybe that doesn't use the php-fpm puppet profiles [20:55:30] I will make a ticket for "get logs from doc machines into logstash". we have similar ones for other services [20:55:35] semi-relatedly [20:56:02] the php-fpm logging options might be more for serviceops [21:02:36] ...there is an entire custom Puppet function that creates the php.ini for mw/prod, wmflib::php_ini [21:02:59] Krinkle: yeah deprecation/strict are disabled by default cause for most purposes they are useless ;) [21:03:17] I mean, as a consumer of a php app [21:04:43] for logs, we must have some logging pipeline which is able to consume the php-fpm errors using json/ECS logging format or something like that. I guess that can be a task for observability unless they only care of the underlying infra rather than setting up new sources [21:07:50] https://phabricator.wikimedia.org/T325245 [21:08:51] here is how it works: [21:09:27] step 1: use rsyslog::input:files to send logs to rsyslog on the machines: https://gerrit.wikimedia.org/r/c/operations/puppet/+/848547 [21:09:40] step 2: tell rsyslog to ship to kafka: https://gerrit.wikimedia.org/r/c/operations/puppet/+/849169 [21:10:19] step 3: should be in logstash, but need to filter by something like: filter: program:"input-file-..." [21:25:09] 10GitLab (Administration, Settings & Policy), 10Release-Engineering-Team (Priority Backlog πŸ“₯), 10Product-Analytics, 10Privacy, 10User-brennen: Request for Private repos to be enabled - https://phabricator.wikimedia.org/T305082 (10mpopov) @EChetty (tagged but currently on leave) has been in touch with @th... [21:28:19] 10GitLab (Administration, Settings & Policy), 10Release-Engineering-Team (Priority Backlog πŸ“₯), 10Product-Analytics, 10Privacy, 10User-brennen: Request for Private repos to be enabled - https://phabricator.wikimedia.org/T305082 (10mpopov) I also want it noted that we have a need for this and having privat... [22:18:24] (03PS2) 10Hashar: Compile PHP extensions with -Wall -Werror [integration/config] - 10https://gerrit.wikimedia.org/r/867735 (owner: 10Tim Starling) [22:20:27] (03CR) 10CI reject: [V: 04-1] Compile PHP extensions with -Wall -Werror [integration/config] - 10https://gerrit.wikimedia.org/r/867735 (owner: 10Tim Starling) [22:21:29] (03PS3) 10Hashar: Compile PHP extensions with -Wall -Werror [integration/config] - 10https://gerrit.wikimedia.org/r/867735 (owner: 10Tim Starling) [22:26:19] (03PS1) 10Hashar: jjb: use -Wall -Werror for php extensions [integration/config] - 10https://gerrit.wikimedia.org/r/868184 [22:26:37] (03CR) 10Hashar: [C: 03+2] "I have amended the patch to:" [integration/config] - 10https://gerrit.wikimedia.org/r/867735 (owner: 10Tim Starling) [22:28:50] (03Merged) 10jenkins-bot: Compile PHP extensions with -Wall -Werror [integration/config] - 10https://gerrit.wikimedia.org/r/867735 (owner: 10Tim Starling) [22:53:20] (03CR) 10Hashar: [C: 03+2] "Successfully published image docker-registry.discovery.wmnet/releng/php82-compile:0.1.1" [integration/config] - 10https://gerrit.wikimedia.org/r/867735 (owner: 10Tim Starling) [22:53:58] (03CR) 10Hashar: "INFO:jenkins_jobs.builder:Number of jobs generated: 5" [integration/config] - 10https://gerrit.wikimedia.org/r/868184 (owner: 10Hashar) [22:54:06] (03CR) 10Hashar: [C: 03+2] jjb: use -Wall -Werror for php extensions [integration/config] - 10https://gerrit.wikimedia.org/r/868184 (owner: 10Hashar) [22:54:55] !log Updated PHP compile jobs to compile with `CFLAGS=-Wall -Werror` https://gerrit.wikimedia.org/r/c/integration/config/+/868184/ [22:54:58] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [22:55:27] 10Scap: scap backport fails with "Multiple changes found" - https://phabricator.wikimedia.org/T325252 (10Tgr) [22:56:12] (03Merged) 10jenkins-bot: jjb: use -Wall -Werror for php extensions [integration/config] - 10https://gerrit.wikimedia.org/r/868184 (owner: 10Hashar) [22:59:29] 10Scap: scap backport fails with "Multiple changes found" - https://phabricator.wikimedia.org/T325252 (10Tgr) Should have searched first, duh. [22:59:33] 10Scap: scap backport fails with "Multiple changes found" - https://phabricator.wikimedia.org/T325252 (10Tgr) [22:59:39] 10Release-Engineering-Team, 10Scap: scap backport: Multiple changes found for Ifb0316256bdec5008acc48544ddd3e2bf71b6d41 - https://phabricator.wikimedia.org/T323277 (10Tgr) [23:00:32] 10Release-Engineering-Team, 10Scap: scap backport: Multiple changes found for Ifb0316256bdec5008acc48544ddd3e2bf71b6d41 - https://phabricator.wikimedia.org/T323277 (10Tgr) The patch has a cherry-pick, cherry-picks have the same change ID. It's not that uncommon for a depndency of a backport to itself have a b... [23:00:39] (03PS1) 10Dreamy Jazz: Make CentralAuth a dependency for MassMessage [integration/config] - 10https://gerrit.wikimedia.org/r/868193 (https://phabricator.wikimedia.org/T145430) [23:02:32] 10Release-Engineering-Team, 10Scap: scap backport does not handle Depends-On header correctly - https://phabricator.wikimedia.org/T324275 (10Tgr) The error is right after `Checking for relation chains and Depends-Ons` and the ID in the error is the one for the Depends-On so that seems to work as expected. [23:32:59] (03PS1) 10Jeena Huneidi: gitlab: train-dev has migrated to gitlab [tools/train-dev] - 10https://gerrit.wikimedia.org/r/868202 [23:33:26] (03CR) 10CI reject: [V: 04-1] gitlab: train-dev has migrated to gitlab [tools/train-dev] - 10https://gerrit.wikimedia.org/r/868202 (owner: 10Jeena Huneidi) [23:37:19] (03CR) 10Jeena Huneidi: [V: 03+2 C: 03+2] gitlab: train-dev has migrated to gitlab [tools/train-dev] - 10https://gerrit.wikimedia.org/r/868202 (owner: 10Jeena Huneidi) [23:37:37] (03CR) 10CI reject: [V: 04-1] gitlab: train-dev has migrated to gitlab [tools/train-dev] - 10https://gerrit.wikimedia.org/r/868202 (owner: 10Jeena Huneidi) [23:42:14] (03PS1) 10Jeena Huneidi: layout.yaml: remove train-dev repo [integration/config] - 10https://gerrit.wikimedia.org/r/868203 (https://phabricator.wikimedia.org/T323225) [23:45:04] (03PS2) 10Jeena Huneidi: gitlab: train-dev has migrated to gitlab [tools/train-dev] - 10https://gerrit.wikimedia.org/r/868202 (https://phabricator.wikimedia.org/T323225) [23:45:27] (03CR) 10CI reject: [V: 04-1] gitlab: train-dev has migrated to gitlab [tools/train-dev] - 10https://gerrit.wikimedia.org/r/868202 (https://phabricator.wikimedia.org/T323225) (owner: 10Jeena Huneidi)