[00:41:19] 07artificial-intelligence, 06Commons, 10MediaSearch, 06Structured-Data-Backlog: Add AI-powered visual search for Wikimedia Commons images - https://phabricator.wikimedia.org/T408018#11321806 (10itsmoon) I am building a MediaWiki gadget tool that will allow users to reverse image search from a filename or U... [07:58:41] 06Machine-Learning-Team, 06Discovery-Search: Initial task generation and ingestion to Cassandra and Search weight tags - https://phabricator.wikimedia.org/T408533#11322171 (10dcausse) [08:16:53] Good morning [08:18:09] o/ [08:19:45] hey folks, as FYI ml-serve1012 (the new MI300X-equipped host running with Debian Trixie etc..) is uncordoned on ml-serve1012, but I added k8s taints to prevent "regular" pods to be scheduled. Only the ones tolerating the taints will go there, but as precaution please check where pods get deployed after the next deployment on ml-serve-eqiad (I'll do it as well) [08:19:52] cc: klausman_, dpogorzelski [08:20:22] kk [08:48:55] looking at cumin i see a lot of similarity with how command execution works on saltstack [08:50:29] i used to have my own take/side project on command execution as well some time ago, https://git.pogorzelski.dev/dawid/speedrun , but I dropped the ball over the years [09:11:01] seems i can't execute commands via cumin on rootles cumin because i lack a krb identity, but i have a ticket for that so hopefully it's sorted soon [09:20:30] calROger! [09:21:09] (hwy is ther erandom stuff in my input buffer?!) [09:36:15] dpogorzelski: the rootless cumin is a project that hasn't really been completed yet, you'll need to wait for full root access [09:37:19] behind the scenes it uses https://clustershell.readthedocs.io/en/latest/ [10:10:27] morning! [10:37:28] hi [11:28:03] 06Machine-Learning-Team: Create a Tone Suggestion Generator in LiftWing - https://phabricator.wikimedia.org/T408538#11322735 (10achou) @Ottomata Thanks! I totally forgot to try another datacenter :D @BWojtowicz-WMF Here's an enwiki page content change event I grabbed: P84342. The content is in revision.content_... [11:34:45] 06Machine-Learning-Team, 06Discovery-Search: Initial task generation and ingestion to Cassandra and Search weight tags - https://phabricator.wikimedia.org/T408533#11322747 (10achou) [11:40:39] 06Machine-Learning-Team: Create a Tone Suggestion Generator in LiftWing - https://phabricator.wikimedia.org/T408538#11322768 (10achou) [13:59:05] 06Machine-Learning-Team: Move inference-services repo from Gerrit to GitLab - https://phabricator.wikimedia.org/T408690 (10isarantopoulos) 03NEW [14:05:06] 10Lift-Wing, 06Machine-Learning-Team, 10Wikidata, 06Wikimedia Enterprise, 10Wikimedia Enterprise - Content Integrity: Request to host Wikidata Revert Risk on Lift Wing - https://phabricator.wikimedia.org/T406179#11323186 (10kevinbazira) The revertrisk-wikidata-metadata model-server prototype has been upd... [14:21:07] 06Machine-Learning-Team, 06DC-Ops, 10ops-codfw, 06SRE: DIMM_A2 errors for ml-serve2001 - https://phabricator.wikimedia.org/T408516#11323275 (10Jhancock.wm) @elukey i couldn't find anything in particular that is causing this. I did upgrade the bios and idrac. that should help mitigate it. I do know this ser... [14:38:01] 06Machine-Learning-Team, 06DC-Ops, 10ops-codfw, 06SRE: DIMM_A2 errors for ml-serve2001 - https://phabricator.wikimedia.org/T408516#11323359 (10ops-monitoring-bot) Host ml-serve2001 powercycled by elukey@cumin2002 with reason: Testing powercycle cookbook [15:01:02] (03PS1) 10Bartosz Wójtowicz: revise-tone: Add Tune Suggestion Generator. [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1199806 (https://phabricator.wikimedia.org/T408538) [15:06:17] 06Machine-Learning-Team: Promote dpogorzelski from ops-limited to ops - https://phabricator.wikimedia.org/T408702 (10DPogorzelski-WMF) 03NEW [15:36:02] 10Lift-Wing, 06Machine-Learning-Team, 10Wikidata, 06Wikimedia Enterprise, 10Wikimedia Enterprise - Content Integrity: Request to host Wikidata Revert Risk on Lift Wing - https://phabricator.wikimedia.org/T406179#11323718 (10Trokhymovych) Thank you for sharing details and working on it, @kevinbazira! Mod... [16:48:12] 06Machine-Learning-Team, 10SRE-Access-Requests: Promote dpogorzelski from ops-limited to ops - https://phabricator.wikimedia.org/T408702#11324214 (10elukey) [16:54:34] 06Machine-Learning-Team, 10SRE-Access-Requests: Promote dpogorzelski from ops-limited to ops - https://phabricator.wikimedia.org/T408702#11324247 (10elukey) a:05DPogorzelski-WMF→03None [17:51:13] 06Machine-Learning-Team, 06Data-Persistence, 10Data-Persistence-Design-Review, 06Growth-Team, and 3 others: Data Persistence Design Review: Improve Tone Suggested Edits newcomer task - https://phabricator.wikimedia.org/T401021#11324507 (10achou) Trying to address the blocking ones: - Naming Keyspace: **ml... [18:06:24] 06Machine-Learning-Team, 06Data-Persistence, 10Data-Persistence-Design-Review, 06Growth-Team, and 3 others: Data Persistence Design Review: Improve Tone Suggested Edits newcomer task - https://phabricator.wikimedia.org/T401021#11324575 (10Michael) @Eevans and I just had a short call to clarify some of the... [18:23:03] 06Machine-Learning-Team, 06SRE, 10SRE-Access-Requests: Promote dpogorzelski from ops-limited to ops - https://phabricator.wikimedia.org/T408702#11324633 (10Dzahn) @elukey Does this now need approval from Mark? It seems to me it does because he is the group owner of ops. [18:45:13] 06Machine-Learning-Team, 10Recommendation-API: Collection data unavailable in several rec-api hosts - https://phabricator.wikimedia.org/T406854#11324729 (10SBisson) 05Resolved→03Open We're seeing this problem again right now. [18:48:14] 06Machine-Learning-Team, 06LPL Hypothesis, 10Recommendation-API: Collection data unavailable in several rec-api hosts - https://phabricator.wikimedia.org/T406854#11324737 (10SBisson) [19:26:52] 06Machine-Learning-Team, 06Data-Persistence, 10Data-Persistence-Design-Review, 06Growth-Team, and 3 others: Data Persistence Design Review: Improve Tone Suggested Edits newcomer task - https://phabricator.wikimedia.org/T401021#11324847 (10Eevans) [20:20:07] 06Machine-Learning-Team, 06Data-Persistence, 10Data-Persistence-Design-Review, 06Growth-Team, and 3 others: Data Persistence Design Review: Improve Tone Suggested Edits newcomer task - https://phabricator.wikimedia.org/T401021#11325074 (10Eevans) >>! In T401021#11324507, @achou wrote: > Trying to address t... [20:25:08] 06Machine-Learning-Team, 06Data-Persistence, 10Data-Persistence-Design-Review, 06Growth-Team, and 3 others: Data Persistence Design Review: Improve Tone Suggested Edits newcomer task - https://phabricator.wikimedia.org/T401021#11325097 (10Eevans) [20:25:49] 06Machine-Learning-Team, 06Data-Persistence, 10Data-Persistence-Design-Review, 06Growth-Team, and 3 others: Data Persistence Design Review: Improve Tone Suggested Edits newcomer task - https://phabricator.wikimedia.org/T401021#11325119 (10Eevans)