[05:46:21] 10serviceops, 10Continuous-Integration-Infrastructure, 10SRE: Undeploy patch to use old PHP serialization in PHP 7.4 - https://phabricator.wikimedia.org/T318918 (10Joe) a:03Joe [05:55:40] 10serviceops, 10SRE, 10Patch-For-Review, 10Performance Issue: PHP 7.2 is very slow on an allocation-intensive benchmark - https://phabricator.wikimedia.org/T230861 (10Joe) 05Open→03Resolved a:03Joe Tentatively resolving because we've moved past php 7.2 and we seem to have reverted the php 7.2-only st... [09:45:57] FYI, there's still a few CRITICALs for random mw hosts related to PHP 7.2: "The following units failed: php7.2-fpm_check_restart.service" [09:48:51] moritzm: checking [09:50:19] it might just need a systemd reset-failed [09:50:28] yep, that's what I think [09:50:39] It's weird that it happens randomly though [09:50:53] some hosts get the issue, some not [09:51:20] race condition on when the puppet run that removed them had run [09:51:27] compared with then the unit failed I guess [09:51:56] possibly yes [10:00:08] 10serviceops, 10Prod-Kubernetes, 10Kubernetes, 10Patch-For-Review: Update Kubernetes clusters to v1.23 - https://phabricator.wikimedia.org/T307943 (10Clement_Goubert) [10:00:30] moritzm: fixed [10:04:23] thx [10:25:53] 10serviceops, 10RESTBase: PCS caching and pregeneration when restbase is decommissioned - https://phabricator.wikimedia.org/T319365 (10daniel) @Jdlrobson just pointed me to {T214000} [10:26:16] 10serviceops, 10RESTBase: PCS caching and pregeneration when restbase is decommissioned - https://phabricator.wikimedia.org/T319365 (10daniel) [10:27:30] 10serviceops, 10RESTBase: PCS caching and pregeneration when restbase is decommissioned - https://phabricator.wikimedia.org/T319365 (10daniel) [11:21:21] 10serviceops, 10Continuous-Integration-Infrastructure, 10SRE: Undeploy patch to use old PHP serialization in PHP 7.4 - https://phabricator.wikimedia.org/T318918 (10Joe) 05Open→03Resolved [11:30:13] 10serviceops, 10Continuous-Integration-Infrastructure, 10SRE: Undeploy patch to use old PHP serialization in PHP 7.4 - https://phabricator.wikimedia.org/T318918 (10Joe) [11:30:27] 10serviceops, 10Dumps-Generation, 10Patch-For-Review, 10Performance-Team (Radar): Migrate WMF production from PHP 7.2 to PHP 7.4 - https://phabricator.wikimedia.org/T271736 (10Joe) 05In progress→03Resolved With one last outstanding patch to cleanup mediawiki-config, I think we can anyways declare this... [11:30:31] 10serviceops, 10PHP 7.4 support, 10Platform Team Workboards (Clinic Duty Team): Rename articles and users to prepare for PHP 7.3 unicode changes - https://phabricator.wikimedia.org/T292552 (10Joe) [11:30:39] 10serviceops, 10MediaWiki-Releasing, 10MW-1.40-notes (1.40.0-wmf.4; 2022-10-03): Drop PHP 7.2 & 7.3 support from MediaWiki master branch, once Wikimedia production is on 7.4 - https://phabricator.wikimedia.org/T261872 (10Joe) [11:31:47] 10serviceops, 10PHP 7.4 support, 10Platform Team Workboards (Clinic Duty Team): Rename articles and users to prepare for PHP 7.3 unicode changes - https://phabricator.wikimedia.org/T292552 (10Joe) The migration is now complete; We should proceed with running the necessary scripts to rename users and remove t... [12:52:57] 10serviceops, 10Continuous-Integration-Infrastructure, 10SRE: Undeploy patch to use old PHP serialization in PHP 7.4 - https://phabricator.wikimedia.org/T318918 (10Lucas_Werkmeister_WMDE) 05Resolved→03Open As far as I can tell, this is done in production (thanks Joe!), but not yet in CI – a change I just... [13:44:41] 10serviceops, 10serviceops-collab, 10GitLab (CI & Job Runners), 10Patch-For-Review, and 2 others: Deploy buildkitd to trusted GitLab runners - https://phabricator.wikimedia.org/T308271 (10Jelto) Cross-post from T308501#8290690: it seems we have our first successful [buildkitd build job](https://gitlab.wik... [14:00:34] 10serviceops, 10Continuous-Integration-Infrastructure, 10SRE: Undeploy patch to use old PHP serialization in PHP 7.4 - https://phabricator.wikimedia.org/T318918 (10hashar) James has made the necessary CI updates and I have deployed them. [14:04:23] 10serviceops, 10Continuous-Integration-Infrastructure, 10SRE: Undeploy patch to use old PHP serialization in PHP 7.4 - https://phabricator.wikimedia.org/T318918 (10Joe) 05Open→03Resolved Sorry @LucasWerkmeister I assumed this task was about updating production. Re-resolving then :) [14:08:35] 10serviceops, 10Continuous-Integration-Infrastructure, 10SRE: Undeploy patch to use old PHP serialization in PHP 7.4 - https://phabricator.wikimedia.org/T318918 (10Lucas_Werkmeister_WMDE) The change for T316923 is passing in CI now (currently going through test-and-submit), so I think this is indeed done. Th... [14:10:31] 10serviceops, 10Infrastructure-Foundations: Make gVisor packages available via apt.wikimedia.org - https://phabricator.wikimedia.org/T316879 (10Joe) 05Open→03In progress a:03Joe [16:05:13] 10serviceops, 10Infrastructure-Foundations, 10Patch-For-Review: Make gVisor packages available via apt.wikimedia.org - https://phabricator.wikimedia.org/T316879 (10Jdforrester-WMF) >>! In T316879#8292022, @gerritbot wrote: > Change 839632 had a related patch set uploaded (by Jforrester; author: Jforrester):... [17:44:04] 10serviceops, 10serviceops-collab, 10Patch-For-Review: Review DNS TTLs for ServiceOps-Collab owned services - https://phabricator.wikimedia.org/T315319 (10Dzahn) 05In progress→03Resolved phabricator, gerrit, gerrit-replica, gitlab, gitlab-replica all use 300 now [20:07:56] 10serviceops, 10serviceops-collab, 10GitLab (CI & Job Runners), 10Patch-For-Review, and 2 others: Deploy buildkitd to trusted GitLab runners - https://phabricator.wikimedia.org/T308271 (10dduvall)