[05:42:33] Morning folks! o/ [07:00:31] 10Machine-Learning-Team, 10Data-Engineering, 10Data-Persistence, 10Infrastructure-Foundations, and 7 others: eqiad row D switches upgrade - https://phabricator.wikimedia.org/T333377 (10Marostegui) [07:00:51] 10Machine-Learning-Team, 10DBA, 10Data-Engineering, 10Infrastructure-Foundations, and 7 others: eqiad row D switches upgrade - https://phabricator.wikimedia.org/T333377 (10Marostegui) [07:08:18] 10Machine-Learning-Team, 10DBA, 10Data-Engineering, 10Infrastructure-Foundations, and 8 others: eqiad row D switches upgrade - https://phabricator.wikimedia.org/T333377 (10Marostegui) [07:10:09] 10Machine-Learning-Team, 10DBA, 10Data-Engineering, 10Infrastructure-Foundations, and 8 others: eqiad row D switches upgrade - https://phabricator.wikimedia.org/T333377 (10Marostegui) @jcrespo could you double check the backup-related hosts? Thanks! [07:10:24] 10Machine-Learning-Team, 10Data-Engineering, 10Data-Persistence, 10Discovery-Search, and 8 others: codfw row C switches upgrade - https://phabricator.wikimedia.org/T334049 (10ayounsi) p:05Triage→03Medium [07:12:32] 10Machine-Learning-Team, 10DBA, 10Data-Engineering, 10Infrastructure-Foundations, and 8 others: eqiad row D switches upgrade - https://phabricator.wikimedia.org/T333377 (10Marostegui) [07:12:58] 10Machine-Learning-Team, 10Data-Engineering, 10Data-Persistence, 10Discovery-Search, and 8 others: codfw row C switches upgrade - https://phabricator.wikimedia.org/T334049 (10ayounsi) [07:13:16] 10Machine-Learning-Team, 10DBA, 10Data-Engineering, 10Infrastructure-Foundations, and 8 others: eqiad row D switches upgrade - https://phabricator.wikimedia.org/T333377 (10Marostegui) m3-master and m5-master have been failed over. [07:13:27] hello folks :) [07:13:48] 10Machine-Learning-Team, 10DBA, 10Data-Engineering, 10Discovery-Search, and 8 others: codfw row C switches upgrade - https://phabricator.wikimedia.org/T334049 (10Marostegui) [07:21:13] 10Machine-Learning-Team, 10DBA, 10Data-Engineering, 10Discovery-Search, and 8 others: codfw row C switches upgrade - https://phabricator.wikimedia.org/T334049 (10Marostegui) @ayounsi to confirm, codfw will be depooled before this maintenance right? @akosiaris @Joe ? [07:30:39] 10Machine-Learning-Team, 10DBA, 10Data-Engineering, 10Discovery-Search, and 9 others: codfw row C switches upgrade - https://phabricator.wikimedia.org/T334049 (10akosiaris) Yes, we 'll have to depool codfw. [07:30:55] 10Machine-Learning-Team, 10DBA, 10Data-Engineering, 10Discovery-Search, and 9 others: codfw row C switches upgrade - https://phabricator.wikimedia.org/T334049 (10ayounsi) >>! In T334049#8757732, @Marostegui wrote: > @ayounsi to confirm, codfw will be depooled before this maintenance right? @akosiaris @Joe... [07:31:25] 10Machine-Learning-Team, 10DBA, 10Data-Engineering, 10Discovery-Search, and 9 others: codfw row C switches upgrade - https://phabricator.wikimedia.org/T334049 (10MoritzMuehlenhoff) [07:32:50] o/ Luca [07:37:53] 10Machine-Learning-Team, 10DBA, 10Data-Engineering, 10Infrastructure-Foundations, and 7 others: eqiad row D switches upgrade - https://phabricator.wikimedia.org/T333377 (10MoritzMuehlenhoff) [07:45:38] 10Machine-Learning-Team, 10DBA, 10Data-Engineering, 10Infrastructure-Foundations, and 7 others: eqiad row D switches upgrade - https://phabricator.wikimedia.org/T333377 (10jcrespo) [07:46:29] 10Machine-Learning-Team, 10DBA, 10Data-Engineering, 10Infrastructure-Foundations, and 7 others: eqiad row D switches upgrade - https://phabricator.wikimedia.org/T333377 (10jcrespo) >>! In T333377#8757686, @Marostegui wrote: > @jcrespo could you double check the backup-related hosts? Thanks! Documented- mi... [07:47:36] 10Machine-Learning-Team, 10DBA, 10Data-Engineering, 10Infrastructure-Foundations, and 7 others: eqiad row D switches upgrade - https://phabricator.wikimedia.org/T333377 (10jcrespo) [08:01:57] 10Machine-Learning-Team, 10DBA, 10Data-Engineering, 10Discovery-Search, and 9 others: codfw row C switches upgrade - https://phabricator.wikimedia.org/T334049 (10Marostegui) [08:03:29] 10Machine-Learning-Team, 10DBA, 10Data-Engineering, 10Discovery-Search, and 9 others: codfw row C switches upgrade - https://phabricator.wikimedia.org/T334049 (10Marostegui) @jcrespo kindly check backup servers needs. Thanks [08:19:05] 10Machine-Learning-Team, 10DBA, 10Data-Engineering, 10Discovery-Search, and 9 others: codfw row C switches upgrade - https://phabricator.wikimedia.org/T334049 (10jcrespo) [08:35:56] going to run some errands, bbiab [08:39:00] morning! [09:28:50] hello :) [09:43:49] 10Machine-Learning-Team, 10SRE, 10serviceops: Import and deploy istio 1.15.7 - https://phabricator.wikimedia.org/T334068 (10elukey) [10:09:06] 10Machine-Learning-Team, 10Add-Link, 10Growth-Team (Current Sprint), 10User-notice: Deploy "add a link" to 7th round of wikis - https://phabricator.wikimedia.org/T304551 (10Sgs) >>! In T304551#8734963, @Trizek-WMF wrote: > Can we schedule a release date for these wikis? > Can it be next week (Wed April 5)... [10:11:54] 10Machine-Learning-Team, 10Add-Link, 10Growth-Team (Current Sprint), 10User-notice: Deploy "add a link" to 8th round of wikis - https://phabricator.wikimedia.org/T308133 (10Sgs) >>! In T308133#8750592, @Trizek-WMF wrote: > Do you mean `fywiki`? No, I actually miss-read Kevin's comment and disabled //fiwiki... [10:42:38] 10Machine-Learning-Team, 10Add-Link, 10Growth-Team (Current Sprint), 10Patch-For-Review, 10User-notice: Deploy "add a link" to 9th round of wikis - https://phabricator.wikimedia.org/T308134 (10Sgs) >>! In T308134#8718876, @Trizek-WMF wrote: > @Sgs, based on the fact that a majority of models aren't worki... [11:32:38] 10Machine-Learning-Team, 10DBA, 10Data-Engineering, 10Infrastructure-Foundations, and 7 others: eqiad row D switches upgrade - https://phabricator.wikimedia.org/T333377 (10hnowlan) [11:33:34] 10Machine-Learning-Team, 10DBA, 10Data-Engineering, 10Discovery-Search, and 9 others: codfw row C switches upgrade - https://phabricator.wikimedia.org/T334049 (10hnowlan) [12:11:22] 10Machine-Learning-Team, 10DBA, 10Data-Engineering, 10Infrastructure-Foundations, and 8 others: eqiad row D switches upgrade - https://phabricator.wikimedia.org/T333377 (10ayounsi) [12:27:36] 10Machine-Learning-Team, 10Add-Link, 10Growth-Team (Current Sprint), 10Patch-For-Review, 10User-notice: Deploy "add a link" to 7th round of wikis - https://phabricator.wikimedia.org/T304551 (10Trizek-WMF) Communities haven't yet been informed as I was waiting for your reply. One week passed since I sugge... [12:29:28] 10Machine-Learning-Team, 10Add-Link, 10Growth-Team (Current Sprint), 10Patch-For-Review, 10User-notice: Deploy "add a link" to 7th round of wikis - https://phabricator.wikimedia.org/T304551 (10Trizek-WMF) [12:42:54] 10Machine-Learning-Team, 10Add-Link, 10Growth-Team (Current Sprint), 10Patch-For-Review, 10User-notice: Deploy "add a link" to 7th round of wikis - https://phabricator.wikimedia.org/T304551 (10Sgs) >>! In T304551#8758879, @Trizek-WMF wrote: > Communities haven't yet been informed as I was waiting for you... [14:00:57] be there in a sec [14:12:24] 10Machine-Learning-Team, 10Data-Engineering, 10Research, 10Event-Platform Value Stream (Sprint 11), 10Patch-For-Review: Design event schema for ML scores/recommendations on current page state - https://phabricator.wikimedia.org/T331401 (10Ottomata) Nice! I'll add some comments there, but ask another que... [14:21:13] 10Machine-Learning-Team, 10Add-Link, 10Growth-Team (Current Sprint), 10User-notice: Deploy "add a link" to 8th round of wikis - https://phabricator.wikimedia.org/T308133 (10Trizek-WMF) [14:29:08] 10Machine-Learning-Team, 10Add-Link, 10Growth-Team (Current Sprint), 10User-notice: Deploy "add a link" to 8th round of wikis - https://phabricator.wikimedia.org/T308133 (10Trizek-WMF) >>! In T308133#8758395, @Sgs wrote: >>>! In T308133#8750592, @Trizek-WMF wrote: >> Do you mean `fywiki`? > No, I actually... [14:34:09] 10Machine-Learning-Team, 10Add-Link, 10Growth-Team (Current Sprint), 10User-notice: Deploy "add a link" to 9th round of wikis - https://phabricator.wikimedia.org/T308134 (10Trizek-WMF) I tested the models, and everything works fine, except: * **[[https://hr.wikipedia.org/w/index.php?title=Special:Search&ns... [15:05:52] 10Machine-Learning-Team, 10DBA, 10Data-Engineering, 10Discovery-Search, and 9 others: codfw row C switches upgrade - https://phabricator.wikimedia.org/T334049 (10colewhite) [15:22:41] kevinbazira: o/ is there a reason why we don't deploy trwiki-damaging and goodfaith model? [15:23:02] I found those models were uploaded in the model storage, but no isvc deployed on Lift Wing [15:27:09] aiko: o/ I don't remember any reason as to why they are not deployed. [15:27:49] We can go ahead and deploy them. [15:29:28] I see they exist in ORES so we should deploy them [15:36:15] kevinbazira: okay then please deploy them when you have a moment, thanks! :) [15:37:39] alright, I will deploy them. [15:40:37] and would be great to update the docs as well. https://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing#Current_Inference_Services [15:41:15] yeah sure, will update the docs too. [15:57:39] 10Lift-Wing, 10Machine-Learning-Team: Put the model binaries hosted on Lift Wing to the Analytics published folder - https://phabricator.wikimedia.org/T334111 (10achou) [16:52:25] * elukey afk! [16:52:30] have a good rest of the day folks [17:01:33] me2! speak tomorrow! [17:02:42] 10Machine-Learning-Team, 10Add-Link, 10Growth-Team (Current Sprint), 10User-notice: Deploy "add a link" to 9th round of wikis - https://phabricator.wikimedia.org/T308134 (10Trizek-WMF) a:05Trizek-WMF→03Sgs [19:59:04] Night all!