[06:51:11] (03CR) 10Hashar: [C:03+2] Zuul: Add Nic Jansma to CI allowlist [integration/config] - 10https://gerrit.wikimedia.org/r/1174547 (owner: 10Pppery) [06:53:30] (03CR) 10CI reject: [V:04-1] Zuul: Add Nic Jansma to CI allowlist [integration/config] - 10https://gerrit.wikimedia.org/r/1174547 (owner: 10Pppery) [07:02:42] (03PS1) 10Hashar: tox: pin python-jenkins==1.8.2 [integration/config] - 10https://gerrit.wikimedia.org/r/1175397 [07:05:24] (03CR) 10Hashar: [C:03+2] tox: pin python-jenkins==1.8.2 [integration/config] - 10https://gerrit.wikimedia.org/r/1175397 (owner: 10Hashar) [07:05:56] (03CR) 10Hashar: [C:03+2] "CI failed cause python-jenkins dropped support for python 2: I1e1eb2726281001fae4b2b410187c138278be6af :)" [integration/config] - 10https://gerrit.wikimedia.org/r/1174547 (owner: 10Pppery) [07:07:40] (03Merged) 10jenkins-bot: tox: pin python-jenkins==1.8.2 [integration/config] - 10https://gerrit.wikimedia.org/r/1175397 (owner: 10Hashar) [07:08:20] (03Merged) 10jenkins-bot: Zuul: Add Nic Jansma to CI allowlist [integration/config] - 10https://gerrit.wikimedia.org/r/1174547 (owner: 10Pppery) [08:52:08] (03PS1) 10Hashar: build: upgrade QUnit [software/gerrit] (deploy/wmf/stable-3.10) - 10https://gerrit.wikimedia.org/r/1175475 [08:52:50] (03CR) 10CI reject: [V:04-1] build: upgrade QUnit [software/gerrit] (deploy/wmf/stable-3.10) - 10https://gerrit.wikimedia.org/r/1175475 (owner: 10Hashar) [09:01:19] 10Phabricator, 10Release-Engineering-Team (Doing 😎), 06Connection-Team: Rename @Campaigns-engineering account in Phabricator - https://phabricator.wikimedia.org/T401095 (10Aklapper) 03NEW p:05Triageβ†’03Low [09:02:17] 10Phabricator, 10Release-Engineering-Team (Doing 😎), 06Connection-Team: Rename @Campaigns-engineering Phab account to @Slack_connector_for_Campaigns_engineering - https://phabricator.wikimedia.org/T401095#11056754 (10Aklapper) 05Openβ†’03Resolved [09:09:11] (03PS2) 10Hashar: build: upgrade QUnit [software/gerrit] (deploy/wmf/stable-3.10) - 10https://gerrit.wikimedia.org/r/1175475 [09:21:53] 10GitLab (Infrastructure), 06collaboration-services, 13Patch-For-Review: Gitlab switchover (gitlab2002 β†’ gitlab1004) - https://phabricator.wikimedia.org/T400252#11056802 (10Jelto) 05Openβ†’03Resolved The switchover from `gitlab2002` to `gitlab1004` happened last week. Restore is enabled on `gitlab2002`... [10:34:00] 10Phabricator: Allow Security Team members to see MFA status of a Phab user account - https://phabricator.wikimedia.org/T401106 (10Aklapper) 03NEW p:05Triageβ†’03Low [10:34:09] 10Phabricator: Allow Security Team members to see MFA status of a Phab user account - https://phabricator.wikimedia.org/T401106#11057049 (10Aklapper) [10:34:11] 10Phabricator, 10Release-Engineering-Team (Priority Backlog πŸ“₯): Update to Phorge upstream 202x.xx release (the one after 2025.18) - https://phabricator.wikimedia.org/T393840#11057050 (10Aklapper) [10:34:14] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for SaintWolf - https://phabricator.wikimedia.org/T399836#11057051 (10SaintWolf) Hi @thcipriani , I pretend to implement a private MediaWiki and some off the features that I want to install need access to the GitLab t... [10:36:10] 10Phabricator: Allow Security Team members to see MFA status of a Phab user account - https://phabricator.wikimedia.org/T401106#11057056 (10Aklapper) [10:38:07] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for SaintWolf - https://phabricator.wikimedia.org/T399836#11057058 (10Aklapper) @SaintWolf: Thanks for the reply! Could you be more specific, please, and also include URLs what you're referring to? You should be able... [10:45:36] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for SaintWolf - https://phabricator.wikimedia.org/T399836#11057088 (10SaintWolf) Right now, I don't have the url's that I've tried to use. I've stopped the work since I was waiting your response. What I want to implem... [11:20:27] (03update) 10jnuche: Finalize "next" patches when prepping a new train branch [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/912 (https://phabricator.wikimedia.org/T295925) (owner: 10dancy) [13:10:43] 10GitLab (Infrastructure), 06collaboration-services: Troubleshoot GitLab nftables throttling after switchover - https://phabricator.wikimedia.org/T400971#11057442 (10Jelto) p:05Triageβ†’03Medium I spot-checked the IPs which would currently be blocked on `gitlab1004` and all of them are legitimate users or ru... [13:58:03] 10Continuous-Integration-Infrastructure, 07Jenkins, 06Release-Engineering-Team, 06collaboration-services: dpkg error when deploying Jenkins to releases2003.codfw.wmnet - https://phabricator.wikimedia.org/T400645#11057595 (10jnuche) I'm also confused by the sequence of events here. After https://gerrit... [14:28:59] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 06collaboration-services: Puppet failures on integration-agent instances - unable to connect to integration-puppetserver-01 - https://phabricator.wikimedia.org/T401123 (10brennen) 03NEW [14:40:11] !log attempting soft reboot in horizon interface on integration-puppsetserver-01 (T401123) [14:40:15] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [14:40:15] T401123: Puppet failures on integration-agent instances - unable to connect to integration-puppetserver-01 - https://phabricator.wikimedia.org/T401123 [14:40:48] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 06collaboration-services: Puppet failures on integration-agent instances - unable to connect to integration-puppetserver-01 - https://phabricator.wikimedia.org/T401123#11057851 (10brennen) Unable to ssh to puppetserver. In horizon log tab f... [14:44:47] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 06collaboration-services: Puppet failures on integration-agent instances - unable to connect to integration-puppetserver-01 - https://phabricator.wikimedia.org/T401123#11057859 (10brennen) After reboot: ` brennen@integration-agent-docker-1... [14:47:47] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 06collaboration-services: Puppet failures on integration-agent instances - unable to connect to integration-puppetserver-01 - https://phabricator.wikimedia.org/T401123#11057865 (10Andrew) Puppet 7 servers never fail to surprise me with how... [15:37:31] (03merge) 10dancy: JobLog.vue: Increase scrollback to 10000 lines [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/931 [15:39:29] 10Continuous-Integration-Infrastructure (Zuul upgrade), 06collaboration-services: Provision kubeconfig file with credentials for the nodepool user - https://phabricator.wikimedia.org/T400850#11058023 (10Arnoldokoth) a:03Dzahn [15:40:45] 10GitLab (Administration, Settings & Policy), 06collaboration-services: Impersonation of bot accounts on GitLab is broken - https://phabricator.wikimedia.org/T400685#11058025 (10Arnoldokoth) p:05Triageβ†’03Medium [15:42:26] (03open) 10dancy: .gitlab-ci.yml: Don't install python3-venv [repos/releng/gitlab-trusted-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-trusted-runner/-/merge_requests/131 [15:42:30] (03update) 10dancy: .gitlab-ci.yml: Don't install python3-venv [repos/releng/gitlab-trusted-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-trusted-runner/-/merge_requests/131 [15:43:35] (03merge) 10dancy: .gitlab-ci.yml: Don't install python3-venv [repos/releng/gitlab-trusted-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-trusted-runner/-/merge_requests/131 [15:48:12] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 06collaboration-services: Puppet failures on integration-agent instances - unable to connect to integration-puppetserver-01 - https://phabricator.wikimedia.org/T401123#11058060 (10dancy) Thanks @brennen ! [15:53:22] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 06collaboration-services: Puppet failures on integration-agent instances - unable to connect to integration-puppetserver-01 - https://phabricator.wikimedia.org/T401123#11058084 (10brennen) > Puppet 7 servers never fail to surprise me with h... [16:08:34] !log integration: resize integration-puppetserver-01 to g4.cores4.ram8.disk20; confirmed restart and successful puppet run from an integration agent (T401123) [16:08:36] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [16:08:37] T401123: Puppet failures on integration-agent instances - unable to connect to integration-puppetserver-01 - https://phabricator.wikimedia.org/T401123 [16:11:08] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 06collaboration-services: Puppet failures on integration-agent instances - unable to connect to integration-puppetserver-01 - https://phabricator.wikimedia.org/T401123#11058152 (10brennen) 05Openβ†’03Resolved a:03brennen [16:18:32] 10Beta-Cluster-Infrastructure, 06Data-Engineering, 06MW-Interfaces-Team, 10WMF-JobQueue, 10Event-Platform: eqiad.mediawiki.job.sendCampaignEmail (and possibly others) seemingly aren't enqueued in beta - https://phabricator.wikimedia.org/T401002#11058183 (10Daimona) p:05Triageβ†’03High Checking the arch... [16:26:51] 10Continuous-Integration-Infrastructure (Zuul upgrade), 06collaboration-services, 13Patch-For-Review: allow new zuul executor VMs in prod to talk to cloud VPS - https://phabricator.wikimedia.org/T394838#11058222 (10Dzahn) The suggested firewall change to open port 6443 on installservers (proxies) has been de... [16:31:05] 10Scap, 10MediaWiki-Release-Tools, 13Patch-For-Review: PHP Fatal error: Cannot redeclare wikidiff2_do_diff() - https://phabricator.wikimedia.org/T340862#11058233 (10Lucas_Werkmeister_WMDE) I ran into this issue today as well: `lang=shell-session lucaswerkmeister-wmde@deploy1003 /srv/mediawiki-staging $ sca... [16:32:30] 10Continuous-Integration-Infrastructure (Zuul upgrade), 06collaboration-services, 13Patch-For-Review: allow new zuul executor VMs in prod to talk to cloud VPS - https://phabricator.wikimedia.org/T394838#11058235 (10bd808) Now that the squid proxy allows connecting to port 6443 outbound we can connect to the... [16:53:03] 10Continuous-Integration-Infrastructure (Zuul upgrade), 06collaboration-services: Provision kubeconfig file with credentials for the nodepool user - https://phabricator.wikimedia.org/T400850#11058310 (10bd808) Per findings in {T394838}, the `clusters[0].cluster` object should include `proxy-url: http://webprox... [16:53:13] (03open) 10bd808: kubeconfig: Support `--proxy-url` declaration [repos/releng/zuul/tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/releng/zuul/tofu-provisioning/-/merge_requests/47 (https://phabricator.wikimedia.org/T394838 https://phabricator.wikimedia.org/T400850) [17:02:33] (03merge) 10bd808: kubeconfig: Support `--proxy-url` declaration [repos/releng/zuul/tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/releng/zuul/tofu-provisioning/-/merge_requests/47 (https://phabricator.wikimedia.org/T394838 https://phabricator.wikimedia.org/T400850) [17:11:42] 10Continuous-Integration-Infrastructure (Zuul upgrade), 06collaboration-services: Provision kubeconfig file with credentials for the nodepool user - https://phabricator.wikimedia.org/T400850#11058379 (10bd808) [17:11:51] 10Continuous-Integration-Infrastructure (Zuul upgrade), 06collaboration-services: allow new zuul executor VMs in prod to talk to cloud VPS - https://phabricator.wikimedia.org/T394838#11058382 (10bd808) [17:23:19] 10Scap, 10MediaWiki-Release-Tools, 13Patch-For-Review: PHP Fatal error: Cannot redeclare wikidiff2_do_diff() - https://phabricator.wikimedia.org/T340862#11058435 (10dancy) If the issue with `internal_stubs` is resolved, we move on to this issue: ` Parse error: syntax error, unexpected token "::", expecting... [17:30:38] (03update) 10dancy: Add `scap lint` command [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/932 (https://phabricator.wikimedia.org/T340862) [17:30:39] (03open) 10dancy: Add `scap lint` command [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/932 (https://phabricator.wikimedia.org/T340862) [17:32:16] (03update) 10dancy: Add `scap lint` command [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/932 (https://phabricator.wikimedia.org/T340862) [17:34:22] (03merge) 10dancy: Add `scap lint` command [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/932 (https://phabricator.wikimedia.org/T340862) [17:37:09] (03update) 10dancy: lint.py: Don't lint phan's internal stubs [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/933 (https://phabricator.wikimedia.org/T340862) [17:37:09] (03open) 10dancy: lint.py: Don't lint phan's internal stubs [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/933 (https://phabricator.wikimedia.org/T340862) [17:39:31] (03merge) 10dancy: lint.py: Don't lint phan's internal stubs [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/933 (https://phabricator.wikimedia.org/T340862) [17:43:25] (03update) 10dancy: Don't lint phan's internal stubs (fixed) [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/199 (https://phabricator.wikimedia.org/T340862) [17:43:27] (03open) 10dancy: Don't lint phan's internal stubs (fixed) [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/199 (https://phabricator.wikimedia.org/T340862) [17:44:45] (03close) 10dancy: lint.py: Don't lint phan's internal stubs [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/754 (https://phabricator.wikimedia.org/T340862) (owner: 10reedy) [17:46:34] (03open) 10dancy: Release 4.195.0 [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/934 [17:48:14] (03merge) 10dancy: Release 4.195.0 [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/934 [17:58:28] 10Beta-Cluster-Infrastructure, 06Data-Engineering, 06MW-Interfaces-Team, 10WMF-JobQueue, 10Event-Platform: eqiad.mediawiki.job.sendCampaignEmail (and possibly others) seemingly aren't enqueued in beta - https://phabricator.wikimedia.org/T401002#11058539 (10Ottomata) > However, kafkacat does not show the... [18:23:01] (03open) 10jgleeson: Add PHP debug.ini configuration linking to Docker containers [repos/releng/dev-images] - 10https://gitlab.wikimedia.org/repos/releng/dev-images/-/merge_requests/82 (https://phabricator.wikimedia.org/T396171) [18:23:23] 06Project-Admins, 10Q1 FY2025/26 July 1st - September 30th: Consider archiving `Q1 FY2025/26 July 1st - September 30th` - https://phabricator.wikimedia.org/T401018#11058648 (10A_smart_kitten) [FWIW, I didn't originally notice that this was created as a subproject of #data-engineering (rather than as a top-leve... [18:42:11] (03update) 10jgleeson: Add PHP debug.ini configuration linking to Docker containers [repos/releng/dev-images] - 10https://gitlab.wikimedia.org/repos/releng/dev-images/-/merge_requests/82 (https://phabricator.wikimedia.org/T396171) [18:42:35] 10Beta-Cluster-Infrastructure, 06Data-Engineering, 06MW-Interfaces-Team, 10WMF-JobQueue, 10Event-Platform: eqiad.mediawiki.job.sendCampaignEmail (and possibly others) seemingly aren't enqueued in beta - https://phabricator.wikimedia.org/T401002#11058745 (10Daimona) Ah indeed, I SSHed to deployment-kafka-... [18:42:48] (03update) 10jgleeson: Add PHP debug.ini configuration linking to Docker containers [repos/releng/dev-images] - 10https://gitlab.wikimedia.org/repos/releng/dev-images/-/merge_requests/82 (https://phabricator.wikimedia.org/T396171) [18:43:24] 06Project-Admins, 10Q1 FY2025/26 July 1st - September 30th: Consider archiving `Q1 FY2025/26 July 1st - September 30th` - https://phabricator.wikimedia.org/T401018#11058747 (10Ottomata) Thanks. FYI @Ahoelzl is OOO for a week or two. [18:51:46] 10Beta-Cluster-Infrastructure, 06Data-Engineering, 06MW-Interfaces-Team, 10WMF-JobQueue, 10Event-Platform: eqiad.mediawiki.job.sendCampaignEmail (and possibly others) seemingly aren't enqueued in beta - https://phabricator.wikimedia.org/T401002#11058753 (10Ottomata) ! Indeed! ` otto@deployment-kafka-mai... [18:54:21] Hi folks, I'm guessing that putting a URL in the Depends-On: block of a commit message will break things, but it got me wondering if there's a structured way to point to a GitLab dependency in a Gerrit commit message? [18:55:13] 10Beta-Cluster-Infrastructure, 06Data-Engineering, 06MW-Interfaces-Team, 10WMF-JobQueue, 10Event-Platform: eqiad.mediawiki.job.sendCampaignEmail (and possibly others) seemingly aren't enqueued in beta - https://phabricator.wikimedia.org/T401002#11058755 (10Ottomata) I restarted kafka on kafka-main-6. ka... [18:56:00] 10Beta-Cluster-Infrastructure, 06Data-Engineering, 06MW-Interfaces-Team, 10WMF-JobQueue, 10Event-Platform: eqiad.mediawiki.job.sendCampaignEmail (and possibly others) seemingly aren't enqueued in beta - https://phabricator.wikimedia.org/T401002#11058756 (10Ottomata) I don't know what happened, and unders... [18:56:18] jgleeson: this has definitely been asked before and i'm trying to remember where we landed [19:00:28] i may be thinking more of the question of trying to handle depends-on within gitlab [19:00:37] ah [19:01:18] brennen: side thought, was the original plan to migrate from gerrit to gitlab and we're still on that path? [19:01:22] thcipriani, do you have any memory of prior discussion of tagging gerrit patches as depending on gitlab stuff? [19:02:03] the original plan was to migrate from gerrit to gitlab and we are... not really doing that any more. [19:02:35] greg-g: just pointed me at this https://lists.wikimedia.org/hyperkitty/list/wikitech-l@lists.wikimedia.org/thread/3Y2RZKZGYXZWCHY7OEZJMXCFLOZC5G3J/ [19:02:42] thanks [19:02:47] yeah. [19:02:51] ohai [19:02:52] jgleeson: there is no structured way to do point a Gerrit change to a GitLab change. [19:03:24] you could put a url in Depends-On but that will have no meaning for our CI/Gerrit [19:03:25] i had thought we'd filed something at some point, but the last time we really talked about it may have been when we were still actively pursuing a full migration. [19:03:45] and thus assuming it'd be solved by not having a gerrit any more. [19:03:56] good solution at the time :) [19:04:09] (sorry) [19:05:30] Delabs-On: [19:05:37] :> [19:37:26] This will be more feasible with the new zuul [19:37:48] (to some extent, I expect) [19:51:26] (03open) 10dancy: README:md: Test change, to be reverted [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/490 [19:51:29] (03update) 10dancy: README:md: Test change, to be reverted [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/490 [19:52:32] (03merge) 10dancy: README:md: Test change, to be reverted [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/490 [19:53:27] (03open) 10dancy: Revert "README:md: Test change, to be reverted" [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/491 [19:53:30] (03update) 10dancy: Revert "README:md: Test change, to be reverted" [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/491 [19:59:37] dancy: oh neat [20:08:46] 10Continuous-Integration-Config, 10Continuous-Integration-Infrastructure (Zuul upgrade), 06Release-Engineering-Team, 10MediaWiki-Vagrant, 07Essential-Work: Migrate mediawiki/vagrant CI to Bullseye and remove custom image - https://phabricator.wikimedia.org/T398469#11058950 (10Tgr) I don't think MW-Va... [20:13:48] 10Beta-Cluster-Infrastructure, 06Data-Engineering, 06MW-Interfaces-Team, 10WMF-JobQueue, 10Event-Platform: eqiad.mediawiki.job.sendCampaignEmail (and possibly others) seemingly aren't enqueued in beta - https://phabricator.wikimedia.org/T401002#11058965 (10Daimona) 05Openβ†’03Resolved a:03Ottomata... [20:15:05] (03PS1) 10GergΕ‘ Tisza: Make MW-Vagrant tests non-voting [integration/config] - 10https://gerrit.wikimedia.org/r/1175591 (https://phabricator.wikimedia.org/T398469) [20:16:31] (03CR) 10CI reject: [V:04-1] Make MW-Vagrant tests non-voting [integration/config] - 10https://gerrit.wikimedia.org/r/1175591 (https://phabricator.wikimedia.org/T398469) (owner: 10GergΕ‘ Tisza) [20:25:53] 10Beta-Cluster-Infrastructure, 06Data-Engineering, 06MW-Interfaces-Team, 10WMF-JobQueue, 10Event-Platform: eqiad.mediawiki.job.sendCampaignEmail (and possibly others) seemingly aren't enqueued in beta - https://phabricator.wikimedia.org/T401002#11059022 (10bd808) Is there some monitoring that we shou... [20:28:19] thcipriani: is releng the steward for mediawiki-docker? I noticed just now it is absent from mw:Maintainers. Don't want to over-assume, so figured I'd ask :) [20:28:54] 10Beta-Cluster-Infrastructure: Update interwiki table on beta cluster - https://phabricator.wikimedia.org/T400488#11059031 (10bd808) 05Openβ†’03Resolved a:03Reedy The "fix" implemented here was not what @aude asked for, but we were able to find and correct a configuration diff from production. [20:31:28] 10Beta-Cluster-Infrastructure: No Puppet resources found on instance deployment-ms-be07 on project deployment-prep - https://phabricator.wikimedia.org/T400308#11059052 (10bd808) 05Openβ†’03Invalid Things seem to have fixed themselves: `lang=shell-session bd808@deployment-ms-be07:~$ sudo -i puppet agent -tv... [20:34:37] 10Beta-Cluster-Infrastructure, 06Infrastructure-Foundations, 13Patch-For-Review, 07Puppet: Puppet configures kernel.core_pattern |/usr/lib/systemd/systemd-coredump, but systemd-coredump is not installed - https://phabricator.wikimedia.org/T400247#11059070 (10bd808) a:03Lucas_Werkmeister_WMDE [20:41:31] (03approved) 10ejegg: Add PHP debug.ini configuration linking to Docker containers [repos/releng/dev-images] - 10https://gitlab.wikimedia.org/repos/releng/dev-images/-/merge_requests/82 (https://phabricator.wikimedia.org/T396171) (owner: 10jgleeson) [20:41:49] (03merge) 10ejegg: Add PHP debug.ini configuration linking to Docker containers [repos/releng/dev-images] - 10https://gitlab.wikimedia.org/repos/releng/dev-images/-/merge_requests/82 (https://phabricator.wikimedia.org/T396171) (owner: 10jgleeson) [20:46:46] (03PS2) 10GergΕ‘ Tisza: Make MW-Vagrant tests non-voting [integration/config] - 10https://gerrit.wikimedia.org/r/1175591 (https://phabricator.wikimedia.org/T398469) [20:48:13] (03CR) 10CI reject: [V:04-1] Make MW-Vagrant tests non-voting [integration/config] - 10https://gerrit.wikimedia.org/r/1175591 (https://phabricator.wikimedia.org/T398469) (owner: 10GergΕ‘ Tisza) [20:48:44] 10Beta-Cluster-Infrastructure, 06Data-Engineering, 06MW-Interfaces-Team, 10WMF-JobQueue, 10Event-Platform: eqiad.mediawiki.job.sendCampaignEmail (and possibly others) seemingly aren't enqueued in beta - https://phabricator.wikimedia.org/T401002#11059120 (10Ottomata) Monitoring [[ https://grafana-rw.w... [20:55:01] 10Beta-Cluster-Infrastructure, 06Data-Engineering, 06MW-Interfaces-Team, 10WMF-JobQueue, 10Event-Platform: eqiad.mediawiki.job.sendCampaignEmail (and possibly others) seemingly aren't enqueued in beta (kafka split-brain) - https://phabricator.wikimedia.org/T401002#11059146 (10bd808) [21:09:27] 10WikimediaDebug, 10MediaWiki-Core-Profiler, 06serviceops: Switch wmf-config/Profiler from Tideways to XHProf - https://phabricator.wikimedia.org/T401152 (10Krinkle) 03NEW [21:09:42] 10WikimediaDebug, 10MediaWiki-Core-Profiler, 06serviceops: Switch wmf-config/Profiler from Tideways to XHProf - https://phabricator.wikimedia.org/T401152#11059226 (10Krinkle) [21:09:47] 10WikimediaDebug, 10MediaWiki-Core-Profiler, 06serviceops: Switch wmf-config/Profiler from Tideways to XHProf - https://phabricator.wikimedia.org/T401152#11059229 (10Krinkle) [21:18:48] 10WikimediaDebug, 10MediaWiki-Core-Profiler, 06serviceops: Switch wmf-config/Profiler from Tideways to XHProf - https://phabricator.wikimedia.org/T401152#11059277 (10Krinkle) [21:19:06] 10WikimediaDebug, 10MediaWiki-Core-Profiler, 06MediaWiki-Platform-Team, 06serviceops: Switch wmf-config/Profiler from Tideways to XHProf - https://phabricator.wikimedia.org/T401152#11059283 (10Krinkle) [21:28:13] Krinkle: RelEng as maintainers makes sense for mediawiki-docker. Although there's nothing in the roadmap we are the right-est folks to talk to about it for now. [21:52:56] 10WikimediaDebug, 10MediaWiki-Core-Profiler, 06MediaWiki-Platform-Team, 06serviceops: Switch wmf-config/Profiler from Tideways to XHProf - https://phabricator.wikimedia.org/T401152#11059363 (10Scott_French) Thanks for filing this @Krinkle. So, for the production use case, the switch from installing php-ti... [21:56:12] 10Phabricator, 06Release-Engineering-Team: Phorge setup check caching is misbehaving, leading to many duck-sound=quack requests - https://phabricator.wikimedia.org/T401157 (10brennen) 03NEW [22:10:18] 10Phabricator, 06Release-Engineering-Team: Phorge setup check caching is misbehaving, leading to many duck-sound=quack requests - https://phabricator.wikimedia.org/T401157#11059391 (10Dzahn) Regarding APCU: On phab1004 I can confirm the Debian package is installed: ` dpkg ... php-apcu install ` I can... [22:12:35] 10Phabricator, 06Release-Engineering-Team: Phorge setup check caching is misbehaving, leading to many duck-sound=quack requests - https://phabricator.wikimedia.org/T401157#11059392 (10brennen) `BUT, actually running a phpinfo() shows:` This might differ for php-fpm rather than cli, but I do not it's not menti... [22:17:27] 10Phabricator, 06Release-Engineering-Team: Phorge setup check caching is misbehaving, leading to many duck-sound=quack requests - https://phabricator.wikimedia.org/T401157#11059397 (10Dzahn) /etc/php/7.4/fpm/conf.d/20-apcu.ini [22:44:17] 10Phabricator, 06Release-Engineering-Team: Phorge setup check caching is misbehaving, leading to many duck-sound=quack requests - https://phabricator.wikimedia.org/T401157#11059418 (10Dzahn) ` [phab1004:~] $ cat /tmp/check.php [phab100...