[09:43:36] 06serviceops, 10Maps: Staging kartotherian fails with "upstream request timeout" - https://phabricator.wikimedia.org/T411857 (10Jgiannelos) 03NEW [09:58:45] 06serviceops, 10Maps: Staging kartotherian fails with "upstream request timeout" - https://phabricator.wikimedia.org/T411857#11435956 (10elukey) I see a lot of `{"level":"error","timestamp":"2025-12-05T09:35:50.078Z","message":"error marshalling tile: ERROR: permission denied for table planet_osm_polygon_landu... [12:36:07] 06serviceops: Monitor hCaptcha (upstream) status - https://phabricator.wikimedia.org/T411255#11436246 (10Raine) 05Declined→03Open p:05Triage→03Low The extension does not distinguish between hCaptcha being unreachable due to the upstream being gone vs our proxy being gone. Therefore, I think that having b... [13:44:00] 06serviceops, 10Maps: Staging kartotherian fails with "upstream request timeout" - https://phabricator.wikimedia.org/T411857#11436349 (10elukey) ` elukey@deploy2002:~$ curl -k "https://10.64.70.93:6543/img/osm-intl,12,31.807,34.673,355x390.png?lang=he&domain=he.wikipedia.org&title=%D7%9E%D7%92%D7%93%D7%9C%D7%9... [14:16:36] 06serviceops, 13Patch-For-Review: docker-registry.wikimedia.org keeps serving bad blobs - https://phabricator.wikimedia.org/T390251#11436436 (10elukey) @akosiaris do you think that the idea of forming a dedicated working group for the next couple of quarters could be feasible? I can take care of kicking it off... [14:23:32] 06serviceops, 10Maps: Staging kartotherian fails with "upstream request timeout" - https://phabricator.wikimedia.org/T411857#11436473 (10ihurbain) @elukey it woooorks! thank you :D [14:38:29] 06serviceops, 10Maps: Staging kartotherian fails with "upstream request timeout" - https://phabricator.wikimedia.org/T411857#11436496 (10elukey) 05Open→03Resolved a:03elukey Perfect :) [16:04:01] 06serviceops, 13Patch-For-Review: MediaWiki on PHP 8.3 production workload migration - https://phabricator.wikimedia.org/T405955#11436747 (10Scott_French) 05Open→03Resolved Thank you for taking care of the mediawiki-dumps-legacy toolbox release, @BTullis. That now covers everything I intend to explici... [16:44:53] 06serviceops, 07Epic, 06MediaWiki-Platform-Team (Kanban Board): Migrate Wikimedia production from PHP 8.1 to PHP 8.3 - https://phabricator.wikimedia.org/T360995#11436856 (10Krinkle) [17:28:05] 06serviceops, 10MediaWiki-Core-AuthManager, 10MediaWiki-Documentation, 10MediaWiki-extensions-OATHAuth, and 3 others: Document best practices for user login for different types of applications if using 2FA - https://phabricator.wikimedia.org/T255370#11436995 (10TBurmeister) a:05TBurmeister→03None The c... [18:03:25] 06serviceops, 07Epic, 06MediaWiki-Platform-Team (Kanban Board): Migrate Wikimedia production from PHP 8.1 to PHP 8.3 - https://phabricator.wikimedia.org/T360995#11437108 (10Krinkle) Proposed changes for the checklist so far: * ([diff](https://wikitech.wikimedia.org/w/index.php?title=PHP_upgrade_process_for... [18:06:06] 06serviceops, 10MediaWiki-Core-AuthManager, 10MediaWiki-Documentation, 10MediaWiki-extensions-OATHAuth, and 3 others: Document best practices for user login for different types of applications if using 2FA - https://phabricator.wikimedia.org/T255370#11437111 (10TBurmeister) Related: **Investigate 2FA suppo...