[06:33:34] 06serviceops, 06MediaWiki-Platform-Team, 07Epic: Migrate Wikimedia production from PHP 8.1 to PHP 8.3 - https://phabricator.wikimedia.org/T360995#11317366 (10Krinkle) //Progress report for 13 Oct - 24 Oct (two weeks) on WE6.4.8 Support PHP 8.3 upgrade ([m:FY2025-2026#Q2](https://meta.wikimedia.org/wiki/Wikim... [09:35:46] 06serviceops, 10MediaWiki-Special-pages, 07Wikimedia-production-error: MediaWiki periodic job update-special-pages-s3 failed - https://phabricator.wikimedia.org/T408530#11317835 (10A_smart_kitten) Hello #serviceops! Please could you grab the stack trace & error time for this when an SRE has some time spare? [09:36:45] 06serviceops, 10envoy, 06SRE, 13Patch-For-Review: Upgrade Envoy to v1.29.12 - https://phabricator.wikimedia.org/T403663#11317841 (10LSobanski) Untagging #collaboration-services based on https://phabricator.wikimedia.org/T403663#11196043 [09:46:25] 06serviceops, 10MediaWiki-Special-pages, 07Wikimedia-production-error: MediaWiki periodic job update-special-pages-s3 failed - https://phabricator.wikimedia.org/T408530#11317903 (10Clement_Goubert) ` testwiki Mostlinkedtemplates [QueryPage] RuntimeException from line 630 of /srv/mediawiki/php-1.45... [10:24:50] 06serviceops, 10MediaWiki-Special-pages, 07Wikimedia-production-error: MediaWiki periodic job update-special-pages-s3 failed - https://phabricator.wikimedia.org/T408530#11318060 (10Zabe) The url it should be using is http://localhost:6206/published/datasets/querypage/MostTranscludedPages/testwiki.json, see t... [10:25:07] 06serviceops, 10MediaWiki-Special-pages, 07Wikimedia-production-error: MediaWiki periodic job update-special-pages-s3 failed - https://phabricator.wikimedia.org/T408530#11318061 (10Zabe) [10:37:36] 06serviceops, 10MediaWiki-Special-pages, 07Wikimedia-production-error: MediaWiki periodic job update-special-pages-s3 failed - https://phabricator.wikimedia.org/T408530#11318131 (10Zabe) Running on a debug host, the url is working. ` zabe@deploy2002:~$ mw-debug-repl testwiki Becoming root... Finding a mw-de... [14:00:49] 06serviceops, 10Prod-Kubernetes, 07Kubernetes: charlie wiped cluster redeployment use-case - https://phabricator.wikimedia.org/T406212#11318797 (10JMeybohm) >>! In T406212#11238224, @RLazarus wrote: > What's the best query to check the cluster is wiped? Sorry, late to the party due to PTO. I don't think the... [15:15:41] 06serviceops, 10MediaWiki-Special-pages, 07Wikimedia-production-error: MediaWiki periodic job update-special-pages-s3 failed - https://phabricator.wikimedia.org/T408530#11319274 (10Scott_French) @Zabe - Alas, there was a step I missed. Sorry about that! In short, mw-cron and mw-script are "special" in terms... [16:01:43] 06serviceops, 10MediaWiki-Special-pages, 07Wikimedia-production-error: MediaWiki periodic job update-special-pages-s3 failed - https://phabricator.wikimedia.org/T408530#11319554 (10Zabe) It works. Thanks! ` zabe@deploy2002:~$ mwscript-k8s -f -- updateSpecialPages.php testwiki --only Mostlinkedtemplates ⏳ St... [16:23:40] 06serviceops, 10MediaWiki-Special-pages, 07Wikimedia-production-error: MediaWiki periodic job update-special-pages-s3 failed - https://phabricator.wikimedia.org/T408530#11319754 (10A_smart_kitten) Thanks all! Is it worth someone with access deleting & re-running this mw-cron job? [16:57:11] 06serviceops, 06MW-Interfaces-Team, 10RESTBase-API, 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 07OKR-Work: AQS Wikimedia REST API - new API version - https://phabricator.wikimedia.org/T407863#11320121 (10Ottomata) I just deployed edit-analytics with the metrics/v3/edits/per_editor endpo... [17:38:52] 06serviceops, 13Patch-For-Review: MediaWiki on PHP 8.3 production workload migration - https://phabricator.wikimedia.org/T405955#11320387 (10Scott_French) As of ~ 17:30 UTC we're now enrolling 10% of eligible cookie-enabled external clients and serving 5% of mw-api-int / mw-jobrunner traffic on PHP 8.3. No iss... [17:40:19] 06serviceops, 13Patch-For-Review: MediaWiki on PHP 8.3 production workload migration - https://phabricator.wikimedia.org/T405955#11320408 (10Scott_French) [17:56:32] 06serviceops, 10MediaWiki-Special-pages, 07Wikimedia-production-error: MediaWiki periodic job update-special-pages-s3 failed - https://phabricator.wikimedia.org/T408530#11320471 (10Scott_French) @A_smart_kitten - Ah, good idea! I've gone ahead and cleared the failed job, so the alert should clear. I've not... [18:38:08] 06serviceops, 06MW-Interfaces-Team, 10RESTBase-API, 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 07OKR-Work: AQS Wikimedia REST API - new API version - https://phabricator.wikimedia.org/T407863#11320671 (10HCoplin-WMF) Hey -- sorry for the delay on my side! Still getting caught up on a fe... [18:39:27] 06serviceops, 10MediaWiki-Special-pages, 07Wikimedia-production-error: MediaWiki periodic job update-special-pages-s3 failed - https://phabricator.wikimedia.org/T408530#11320690 (10A_smart_kitten) 05Open→03Resolved a:03Scott_French Okay :) I'll boldly resolve this for now then, as (if I'm reading t... [18:57:04] 06serviceops, 06MW-Interfaces-Team, 10RESTBase-API, 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 07OKR-Work: AQS Wikimedia REST API - new API version - https://phabricator.wikimedia.org/T407863#11320731 (10Ottomata) > could you confirm that the version change is going to be applied for al... [19:17:01] 06serviceops, 06MW-Interfaces-Team, 10RESTBase-API, 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 07OKR-Work: AQS Wikimedia REST API - new API version - https://phabricator.wikimedia.org/T407863#11320810 (10HCoplin-WMF) > Even though these are brand new, we wanted to version them at the s... [19:30:14] 06serviceops, 06MW-Interfaces-Team, 10RESTBase-API, 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 07OKR-Work: AQS Wikimedia REST API - new API version - https://phabricator.wikimedia.org/T407863#11320883 (10Ottomata) > each type of metric is basically its own microservice Which begs the qu... [20:48:40] 06serviceops, 10envoy, 06SRE, 13Patch-For-Review: Envoy config updates from v1.29 - https://phabricator.wikimedia.org/T404036#11321177 (10RLazarus) 05Open→03Resolved