[00:40:40] 06serviceops, 13Patch-For-Review: Upgrade mw-debug/next to PHP 8.3 - https://phabricator.wikimedia.org/T401254#11100754 (10Scott_French) The functionality in T401721 for automatically managing `php.version` is now live, so we should be able to take advantage of that here. [10:30:04] 06serviceops, 10Data-Platform-SRE (2025.08.16 - 2025.09.05), 10SRE Observability (FY2025/2026-Q1): Ensure DPE SRE can receive alerts for applications hosted in wikikube - https://phabricator.wikimedia.org/T398073#11101542 (10BTullis) [11:24:32] Hi, if serviceops have a minute, I would appreciate a review on this https://gerrit.wikimedia.org/r/c/operations/puppet/+/1180134 [11:27:46] 06serviceops, 10iPoid-Service, 06Trust and Safety Product Team: Increase RAM available to ipoid's updater container - https://phabricator.wikimedia.org/T402388 (10STran) 03NEW [11:29:24] 06serviceops, 10iPoid-Service, 06Trust and Safety Product Team, 07Performance Issue: Increase RAM available to ipoid's updater container - https://phabricator.wikimedia.org/T402388#11101935 (10Reedy) [11:31:18] Amir1: taking a look [11:31:34] thank you! It should be straightforward [11:33:10] Yep :D [11:33:20] \o/ [11:38:37] 06serviceops, 10iPoid-Service, 06Trust and Safety Product Team, 07Performance Issue: Increase RAM available to ipoid's updater container - https://phabricator.wikimedia.org/T402388#11101964 (10Clement_Goubert) p:05Triage→03High a:03Clement_Goubert [11:44:16] 06serviceops, 06DBA, 13Patch-For-Review: Expose tables catalog in config master - https://phabricator.wikimedia.org/T398943#11101969 (10Ladsgroup) 05Open→03Resolved https://config-master.wikimedia.org/mediawiki-tables.json \o/ \o/ \o/ I'll update a lot of tools to use this instead. [11:54:57] 06serviceops, 10iPoid-Service, 06Trust and Safety Product Team, 07Performance Issue: Increase RAM available to ipoid's updater container - https://phabricator.wikimedia.org/T402388#11101981 (10Clement_Goubert) 05Open→03In progress If it can help point you towards the problem: - The Pod doesn't get OOMK... [11:59:17] 06serviceops, 10iPoid-Service, 06Trust and Safety Product Team, 13Patch-For-Review, 07Performance Issue: Increase RAM available to ipoid's updater container - https://phabricator.wikimedia.org/T402388#11101993 (10STran) > We can raise the memory limit within reason, I think 24GB should be enough to start... [12:12:30] 06serviceops, 10iPoid-Service, 06Trust and Safety Product Team, 13Patch-For-Review, 07Performance Issue: Increase RAM available to ipoid's updater container - https://phabricator.wikimedia.org/T402388#11102014 (10Clement_Goubert) No I don't think it's a disk space issue, more of a file-handling one, if i... [12:18:27] 06serviceops, 10iPoid-Service, 06Trust and Safety Product Team, 13Patch-For-Review, 07Performance Issue: Increase RAM available to ipoid's updater container - https://phabricator.wikimedia.org/T402388#11102025 (10Clement_Goubert) I'm going to deploy the memory limit update, but that will only take effect... [12:39:19] 06serviceops, 10iPoid-Service, 06Trust and Safety Product Team, 07Performance Issue: Increase RAM available to ipoid's updater container - https://phabricator.wikimedia.org/T402388#11102071 (10STran) > Do you want me to kill the current one and restart a run manually This would be great, thanks! It's not... [14:30:42] 06serviceops, 10MW-on-K8s, 06SRE, 06Traffic, 10Release-Engineering-Team (Seen): Serve production traffic via Kubernetes - https://phabricator.wikimedia.org/T290536#11102470 (10Clement_Goubert) 05In progress→03Resolved [16:14:35] 06serviceops, 06MW-Interfaces-Team, 07OKR-Work, 13Patch-For-Review: Identify and configure rest.php routes in REST gateway - https://phabricator.wikimedia.org/T400132#11102997 (10hnowlan) 05Open→03Resolved a:03hnowlan Considering this closed for now - we can follow up in other issues if testing r... [16:17:14] 06serviceops, 06MW-Interfaces-Team, 07OKR-Work: Route test2wiki rest.php APIs through rest-gateway - https://phabricator.wikimedia.org/T402412 (10hnowlan) 03NEW [17:59:01] 06serviceops, 06MediaWiki-Engineering, 07PHP 8.3 support: PHP Deprecated: Using ${var} in strings is deprecated, use {$var} instead in /srv/monitoring/lib.php on line 99 - https://phabricator.wikimedia.org/T402424 (10Scott_French) 03NEW [18:21:18] 06serviceops, 13Patch-For-Review: Upgrade mw-debug/next to PHP 8.3 - https://phabricator.wikimedia.org/T401254#11103442 (10Scott_French) After some discussion, the decision was made to go ahead with the upgrade, with the expectation that the log monitoring / triage process will be solidified before testing sta... [18:26:32] 06serviceops, 07PHP 8.3 support: PHP Deprecated: Using ${var} in strings is deprecated, use {$var} instead in /srv/monitoring/lib.php on line 99 - https://phabricator.wikimedia.org/T402424#11103453 (10Krinkle) [19:20:17] 06serviceops, 10WMF-JobQueue: Jobs sometimes disappear without a trace (except "Exec error in cpjobqueue" / "Error: socket hang up" from change-propagation service) - https://phabricator.wikimedia.org/T402435#11103709 (10matmarex) [19:22:18] 06serviceops, 10WMF-JobQueue, 10MediaWiki-Platform-Team (Radar): Jobs sometimes disappear without a trace (except "Exec error in cpjobqueue" / "Error: socket hang up" from change-propagation service) - https://phabricator.wikimedia.org/T402435#11103740 (10matmarex) [21:34:42] 06serviceops: Upgrade mw-debug/next to PHP 8.3 - https://phabricator.wikimedia.org/T401254#11104407 (10Scott_French) [21:39:08] 06serviceops: Upgrade mw-debug/next to PHP 8.3 - https://phabricator.wikimedia.org/T401254#11104412 (10Scott_French) [21:39:28] 06serviceops: Upgrade mw-debug/next to PHP 8.3 - https://phabricator.wikimedia.org/T401254#11104414 (10Scott_French) 05Open→03Resolved [21:56:15] 06serviceops, 10Scap: Provide MediaWiki app image PHP version in helm values - https://phabricator.wikimedia.org/T401721#11104468 (10Scott_French) [21:58:35] 06serviceops, 10Scap: Provide MediaWiki app image PHP version in helm values - https://phabricator.wikimedia.org/T401721#11104485 (10Scott_French) At this point, the last step is to clean up the now-unused `vnd.wikimedia.mediawiki.php.version` label. Since this will result in a full image build, it would be ni...