[08:44:05] 06serviceops, 10[DEPRECATED] wdwb-tech, 10Citoid, 06Content-Transform-Team, and 9 others: Migrate node-based services in production to node18 - https://phabricator.wikimedia.org/T349118#9993694 (10Pginer-WMF) [09:11:12] 06serviceops, 10WMDE-TechWish-Maintenance, 07Epic, 10Maps (Kartotherian), 13Patch-For-Review: Move Kartotherian to Kubernetes - https://phabricator.wikimedia.org/T216826#9993860 (10awight) @elukey I'll split off the usage investigation into a subtask. Some questions come to mind about exactly what we wa... [09:18:15] 06serviceops, 10WMDE-TechWish-Maintenance, 07Epic, 10Maps (Kartotherian), 13Patch-For-Review: Move Kartotherian to Kubernetes - https://phabricator.wikimedia.org/T216826#9993864 (10awight) One point which I feel is important to keep in mind when discussing deprecation or a major upgrade is that some good... [09:24:19] 06serviceops, 10WMDE-TechWish-Maintenance, 07Epic, 10Maps (Kartotherian), 13Patch-For-Review: Move Kartotherian to Kubernetes - https://phabricator.wikimedia.org/T216826#9993886 (10SLopes-WMF) @elukey, @awight, Maps is owned by the Content Transform team since late 2021. Competing priorities and lack of... [09:29:41] 06serviceops, 10Wikidata, 10wmde-wikidata-tech, 10Data-Platform-SRE (2024.07.08 - 2024.07.28), 03Discovery-Search (Current work): Request permission to create 4 kafka topics in kafka-main (WDQS graph split) - https://phabricator.wikimedia.org/T367510#9993911 (10dcausse) [09:37:42] 06serviceops, 10Wikidata, 10wmde-wikidata-tech, 10Data-Platform-SRE (2024.07.08 - 2024.07.28), 03Discovery-Search (Current work): Request permission to create 4 kafka topics in kafka-main (WDQS graph split) - https://phabricator.wikimedia.org/T367510#9993936 (10dcausse) The new code has been deployed thi... [14:13:57] 06serviceops, 10Wikidata, 06Wikidata Dev Team, 10Wikidata-Termbox, and 2 others: [SW] [GENERAL] Simplify Termbox SSR test release - https://phabricator.wikimedia.org/T355955#9994858 (10Lucas_Werkmeister_WMDE) [14:34:54] 06serviceops, 10Wikidata, 06Wikidata Dev Team, 10Wikidata-Termbox, 10wmde-wikidata-tech: [SW] [GENERAL] Simplify Termbox SSR test release - https://phabricator.wikimedia.org/T355955#9994927 (10Lucas_Werkmeister_WMDE) > This `test` release is fairly different in how it talks to the network. (I donโ€™t reall... [14:48:49] claime: hey! sorry I think our shuffling of tasks has caught you out again [14:49:34] sry - it's arnau.d this time has depooled too early - ignore me :) [14:50:51] topranks: haha no I just checked this time :D [14:51:19] next Tuesday is the last one :) [14:57:18] 06serviceops: sextant: support module garbage collection - https://phabricator.wikimedia.org/T369932#9995111 (10JMeybohm) I think this would be nice to make and keep things a bit more tidy ๐Ÿ‘ [15:04:52] 06serviceops, 07Wikimedia-production-error: Misbehaving mw-api-ext pods serving 5xx - https://phabricator.wikimedia.org/T370425 (10jijiki) 03NEW p:05Triageโ†’03High [15:06:41] 06serviceops, 07Wikimedia-production-error: Misbehaving mw-api-ext pods serving 5xx - https://phabricator.wikimedia.org/T370425#9995168 (10jijiki) [15:14:59] 06serviceops, 06Data-Platform-SRE, 10Dumps-Generation, 10MW-on-K8s, 06Release-Engineering-Team: Migrate current-generation dumps to run from our containerized images - https://phabricator.wikimedia.org/T352650#9995235 (10VirginiaPoundstone) @Joe thanks for the ping. Just to keep you posted about our prog... [15:15:48] 06serviceops, 06Data Products, 06Data-Platform-SRE, 10Dumps-Generation, and 2 others: Migrate current-generation dumps to run from our containerized images - https://phabricator.wikimedia.org/T352650#9995239 (10VirginiaPoundstone) [18:24:30] 06serviceops, 10MW-on-K8s, 06SRE, 06Traffic, and 2 others: Spin down api_appserver and appserver clusters - https://phabricator.wikimedia.org/T367949#9996177 (10Scott_French) `appservers-ro.discovery.wmnet` and `api-ro.discovery.wmnet` now resolve to failoid, by way of manually updating their `DYNA` record... [19:51:42] 06serviceops, 07Wikimedia-production-error: Misbehaving mw-api-ext pods serving 5xx - https://phabricator.wikimedia.org/T370425#9996695 (10Scott_French) In both cases, workers start failing with SIGILL at the start of badness, e.g. (from `mw-api-ext.eqiad.main-7686884f77-ql69d`): ` [18-Jul-2024 06:23:21] WARN... [20:19:21] 06serviceops, 06collaboration-services, 06SRE: add bullseye support to deployment server puppet role - upgrade deployment server in devtools - https://phabricator.wikimedia.org/T363415#9996755 (10Dzahn) This latest merge today finally fixed the puppet runs on `deploy-1006` (T370436) [21:07:39] 06serviceops, 10Wikidata, 10wmde-wikidata-tech, 10Data-Platform-SRE (2024.07.08 - 2024.07.28), 03Discovery-Search (Current work): Request permission to create 4 kafka topics in kafka-main (WDQS graph split) - https://phabricator.wikimedia.org/T367510#9996901 (10bking) @dcausse re: your comment > > I b...