[00:54:01] 06serviceops, 13Patch-For-Review: Migrate production Shellbox services to PHP 8.3 - https://phabricator.wikimedia.org/T403284#11170615 (10Scott_French) As planned, I've reverted the pilot at the end of the day today. Still no issues apparent after nearly 8 hours with ~ 9% of traffic serving on 8.3. Unless some... [12:10:47] 06serviceops, 10Dumps-Generation, 10MW-on-K8s, 10Data-Platform-SRE (2025.09.05 - 2025.09.26), 07Essential-Work: Investigate memcache errors during wikidata and commons dumps runs - https://phabricator.wikimedia.org/T401425#11172103 (10Gehel) [12:10:56] 06serviceops, 10Data-Platform-SRE (2025.09.05 - 2025.09.26), 07Essential-Work, 10SRE Observability (FY2025/2026-Q1): Ensure DPE SRE can receive alerts for applications hosted in wikikube - https://phabricator.wikimedia.org/T398073#11172106 (10Gehel) [14:53:59] 06serviceops, 06MediaWiki-Platform-Team, 07Epic: Migrate Wikimedia production from PHP 8.1 to PHP 8.3 - https://phabricator.wikimedia.org/T360995#11173219 (10Krinkle) [14:54:02] 06serviceops, 13Patch-For-Review: Configure mw-next-routing for the PHP 8.3 migration - https://phabricator.wikimedia.org/T403655#11173220 (10Krinkle) [15:03:04] 06serviceops, 10envoy, 06SRE, 13Patch-For-Review: Upgrade Envoy to v1.26.8 and drop buster - https://phabricator.wikimedia.org/T402584#11173253 (10elukey) >>! In T402584#11166132, @elukey wrote: > Ack! Upgraded staging, and pinged the DSE SREs as well on slack to gather their opinion about ownership etc..... [15:20:21] 06serviceops, 06Infrastructure-Foundations: Upgrade k8s deployments with prometheus-statsd-exporter 0.0.10 - https://phabricator.wikimedia.org/T404368 (10elukey) 03NEW p:05Triage→03High [15:20:59] Hi folks! I'd need to deploy some services to pick up docker image updates: https://phabricator.wikimedia.org/T404368 [15:23:52] ah not only deploy, I also need to set the new image as well [15:23:56] * elukey sighs [15:42:12] ok should be https://gerrit.wikimedia.org/r/c/operations/deployment-charts/+/1187485 [15:53:08] elukey: I think they're inheriting the default from puppet. lemme check real quick [15:53:40] yup: https://gerrit.wikimedia.org/g/operations/puppet/+/fae4547207886224220ae15e3a6dcca0657f8288/hieradata/role/common/deployment_server/kubernetes.yaml#325 [15:53:50] swfrench-wmf: I've commented on the cr ...ah, too slow :D [15:54:28] jayme: ah, thanks! :) [15:55:05] thanks! Forgot about it, I am filing a new one [15:56:21] filed https://gerrit.wikimedia.org/r/c/operations/puppet/+/1187489 [16:17:25] at some point we'll have buster-free clusters :D [16:17:51] from my checks statsd should be the remaining ones [16:17:59] just in time to start with bullseye [16:25:39] 06serviceops, 06DC-Ops, 10ops-codfw, 06SRE: Q1:rack/setup/install wikikube-ctrl2006 - https://phabricator.wikimedia.org/T400661#11173683 (10Jhancock.wm) [18:43:47] 06serviceops, 06MediaWiki-Platform-Team, 07Epic: Migrate Wikimedia production from PHP 8.1 to PHP 8.3 - https://phabricator.wikimedia.org/T360995#11174060 (10Krinkle) [19:06:24] 06serviceops: Migrate production Shellbox services to PHP 8.3 - https://phabricator.wikimedia.org/T403284#11174141 (10Scott_French) After a couple of hours with shellbox-constraints fully migrated, no issues encountered so far, based on: * General service health ([[ https://grafana.wikimedia.org/d/RKogW1m7z/shel... [19:07:11] 06serviceops: Migrate production Shellbox services to PHP 8.3 - https://phabricator.wikimedia.org/T403284#11174142 (10Scott_French) [19:07:20] 06serviceops: Migrate production Shellbox services to PHP 8.3 - https://phabricator.wikimedia.org/T403284#11174144 (10Scott_French) [19:08:33] 06serviceops: Configure mw-next-routing for the PHP 8.3 migration - https://phabricator.wikimedia.org/T403655#11174146 (10Scott_French) [19:12:28] 06serviceops: Configure mw-next-routing for the PHP 8.3 migration - https://phabricator.wikimedia.org/T403655#11174174 (10Scott_French) [19:13:29] 06serviceops, 13Patch-For-Review: Configure the WikimediaEvents extension for the PHP 8.3 migration - https://phabricator.wikimedia.org/T403657#11174176 (10Scott_French) [19:13:33] 06serviceops, 06MediaWiki-Platform-Team, 07Epic: Migrate Wikimedia production from PHP 8.1 to PHP 8.3 - https://phabricator.wikimedia.org/T360995#11174177 (10Scott_French) [19:13:46] 06serviceops, 13Patch-For-Review: Configure the WikimediaEvents extension for the PHP 8.3 migration - https://phabricator.wikimedia.org/T403657#11174178 (10Scott_French) 05Open→03In progress p:05Triage→03Medium [19:29:27] 06serviceops: Migrate production Shellbox services to PHP 8.3 - https://phabricator.wikimedia.org/T403284#11174215 (10Scott_French) [19:29:30] 06serviceops, 06MediaWiki-Platform-Team, 07Epic: Migrate Wikimedia production from PHP 8.1 to PHP 8.3 - https://phabricator.wikimedia.org/T360995#11174216 (10Scott_French) [19:31:27] 06serviceops: Prepare PHP 8.3 service images for Shellbox - https://phabricator.wikimedia.org/T403283#11174221 (10Scott_French) [19:31:31] 06serviceops: Prepare PHP 8.3 production images - https://phabricator.wikimedia.org/T398246#11174222 (10Scott_French) [19:42:55] 06serviceops, 06MediaWiki-Platform-Team, 07Epic: Migrate Wikimedia production from PHP 8.1 to PHP 8.3 - https://phabricator.wikimedia.org/T360995#11174244 (10Krinkle) //Progress report 18 Aug - 4 Sep (three weeks) for WE6.4.5 (Unblock PHP 8.3 upgrade, [m:FY2025-2026#Q1](https://meta.wikimedia.org/wiki/FY2025... [20:26:13] 06serviceops, 06Content-Transform-Team, 13Patch-For-Review: Migrate parsoidtest1001 to PHP 8.3 - https://phabricator.wikimedia.org/T403772#11174368 (10Scott_French) p:05Triage→03Medium [20:26:50] 06serviceops, 06MediaWiki-Platform-Team, 07Epic: Migrate Wikimedia production from PHP 8.1 to PHP 8.3 - https://phabricator.wikimedia.org/T360995#11174379 (10Scott_French) [20:26:51] 06serviceops, 06Content-Transform-Team, 13Patch-For-Review: Migrate parsoidtest1001 to PHP 8.3 - https://phabricator.wikimedia.org/T403772#11174378 (10Scott_French) [22:41:12] 06serviceops: Configure the WikimediaEvents extension for the PHP 8.3 migration - https://phabricator.wikimedia.org/T403657#11174676 (10Scott_French) 05In progress→03Resolved The config change is now live, and I've verified that: * I do not erroneously receive the `PHP_ENGINE` enrollment cookie (sampling... [23:08:20] 06serviceops: Configure mw-next-routing for the PHP 8.3 migration - https://phabricator.wikimedia.org/T403655#11174701 (10Scott_French) 05In progress→03Resolved Since no further work is tracked here, I am going to resolve this. The remaining changes to [[ https://gerrit.wikimedia.org/r/plugins/gitiles/op...