[02:12:25] 06serviceops, 13Patch-For-Review: MediaWiki on PHP 8.1 production traffic ramp-up - https://phabricator.wikimedia.org/T383845#10635273 (10Scott_French) As of ~ 18:20 UTC today, mw-api-int, mw-parsoid, and mw-jobrunner have been fully migrated to PHP 8.1. This concludes the large / high-traffic services, leavin... [09:25:19] 06serviceops, 06Data-Engineering, 10Data-Platform-SRE (2025.03.01 - 2025.03.21), 10Discovery-Search (2025.03.01 - 2025.03.21): Search Update Pipeline requests to Action API are logged as coming from 127.0.0.1 - https://phabricator.wikimedia.org/T388855#10635587 (10JMeybohm) Hi @dcausse , I'll be out for sa... [09:28:24] 06serviceops, 10CirrusSearch, 10Data-Platform-SRE (2025.03.01 - 2025.03.21), 10Discovery-Search (2025.03.01 - 2025.03.21): Repartition [eqiad|codfw].cirrussearch.update_pipeline.update.v1 topics in kafka-main@[eqiad|codfw] - https://phabricator.wikimedia.org/T387863#10635595 (10brouberol) 05Open→03R... [09:29:44] 06serviceops, 10CirrusSearch, 10Data-Platform-SRE (2025.03.01 - 2025.03.21), 10Discovery-Search (2025.03.01 - 2025.03.21): Repartition [eqiad|codfw].cirrussearch.update_pipeline.update.v1 topics in kafka-main@[eqiad|codfw] - https://phabricator.wikimedia.org/T387863#10635600 (10brouberol) And the same... [09:35:05] 06serviceops, 10CirrusSearch, 10Data-Platform-SRE (2025.03.01 - 2025.03.21), 10Discovery-Search (2025.03.01 - 2025.03.21): Repartition [eqiad|codfw].cirrussearch.update_pipeline.update.v1 topics in kafka-main@[eqiad|codfw] - https://phabricator.wikimedia.org/T387863#10635610 (10dcausse) @brouberol than... [09:41:14] 06serviceops, 10CirrusSearch, 10Data-Platform-SRE (2025.03.01 - 2025.03.21), 10Discovery-Search (2025.03.01 - 2025.03.21): Repartition [eqiad|codfw].cirrussearch.update_pipeline.update.v1 topics in kafka-main@[eqiad|codfw] - https://phabricator.wikimedia.org/T387863#10635614 (10brouberol) Hmm, as we're... [09:42:09] 06serviceops, 10CirrusSearch, 10Data-Platform-SRE (2025.03.01 - 2025.03.21), 10Discovery-Search (2025.03.01 - 2025.03.21): Repartition [eqiad|codfw].cirrussearch.update_pipeline.update.v1 topics in kafka-main@[eqiad|codfw] - https://phabricator.wikimedia.org/T387863#10635615 (10brouberol) Good call! Th... [09:47:18] 06serviceops, 10CirrusSearch, 10Data-Platform-SRE (2025.03.01 - 2025.03.21), 10Discovery-Search (2025.03.01 - 2025.03.21): Repartition [eqiad|codfw].cirrussearch.update_pipeline.update.v1 topics in kafka-main@[eqiad|codfw] - https://phabricator.wikimedia.org/T387863#10635616 (10dcausse) @brouberol thanks! [09:53:03] o/ we have a patch to change the wdqs endpoint that kartotherian is using (https://gerrit.wikimedia.org/r/c/operations/deployment-charts/+/1127856) do you know who we can ping for a review? [09:53:38] 06serviceops, 06Infrastructure-Foundations, 10Maps (Kartotherian): Scale up Kartotherian on Wikikube and move live traffic to it - https://phabricator.wikimedia.org/T386926#10635618 (10elukey) @Jgiannelos I found https://github.com/mapnik/node-mapnik/issues/1004#issuecomment-2503339079 that is very interesti... [09:59:33] dcausse: o/ alreayd replied, you can work with me on that one [09:59:41] elukey: thanks!! [11:00:12] dcausse: +1ed thanks! Is there any difference that I should look for / expect for this change? From the kartotherian pov [11:40:32] 06serviceops, 07Datacenter-Switchover, 13Patch-For-Review: 🧭 Northward Datacentre Switchover (March 2025) - https://phabricator.wikimedia.org/T385155#10635782 (10ops-monitoring-bot) hnowlan@cumin2002 - Cookbook cookbooks.sre.switchdc.mediawiki.01-stop-maintenance for datacenter switchover from eqiad to codfw... [11:53:06] 06serviceops, 07Datacenter-Switchover, 13Patch-For-Review: 🧭 Northward Datacentre Switchover (March 2025) - https://phabricator.wikimedia.org/T385155#10635898 (10ops-monitoring-bot) hnowlan@cumin2002 - Cookbook cookbooks.sre.switchdc.mediawiki.01-stop-maintenance for datacenter switchover from eqiad to codfw... [12:03:18] 06serviceops, 07Datacenter-Switchover, 13Patch-For-Review: 🧭 Northward Datacentre Switchover (March 2025) - https://phabricator.wikimedia.org/T385155#10635918 (10ops-monitoring-bot) hnowlan@cumin2002 - Cookbook cookbooks.sre.switchdc.mediawiki.08-start-maintenance for datacenter switchover from eqiad to codf... [12:03:31] 06serviceops, 07Datacenter-Switchover: Update Kubernetes library version in spicerack - https://phabricator.wikimedia.org/T388874 (10hnowlan) 03NEW [13:07:29] 06serviceops, 07Datacenter-Switchover: Update Kubernetes library version in spicerack - https://phabricator.wikimedia.org/T388874#10636062 (10Volans) Given spicerack dependencies are debian packages and we're currently on bullseye this need to either wait for the bookworm upgrade (if version `22.6.0` is recent... [13:19:55] elukey: unfortunately I don't really know how kartotherian works nor how to test it, on deploying I can check that the queries are flowing properly to the right wdqs endpoint, perhaps that's enough for testing? [13:31:51] dcausse: FYI Luca is out this afternoon [23:15:23] 06serviceops, 07Datacenter-Switchover, 07User-notice: MoveComms support for March 2025 Datacentre switchover - https://phabricator.wikimedia.org/T387444#10638126 (10Quiddity)