[00:46:03] (03PS1) 10Tim Starling: ORES exception handling review [extensions/ORES] - 10https://gerrit.wikimedia.org/r/1187586 [07:08:27] Hello! [08:09:24] hello! [08:11:27] good morning :) [08:20:47] 06Machine-Learning-Team, 05Goal: Merge articletopic outlink model transformer and predictor pods - https://phabricator.wikimedia.org/T404294#11175328 (10BWojtowicz-WMF) 05Open→03In progress a:03BWojtowicz-WMF [08:41:11] (03PS1) 10Bartosz Wójtowicz: outlink-topic-model: Merge transformer and predictor pods. [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1187739 (https://phabricator.wikimedia.org/T404294) [08:42:41] (03CR) 10CI reject: [V:04-1] outlink-topic-model: Merge transformer and predictor pods. [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1187739 (https://phabricator.wikimedia.org/T404294) (owner: 10Bartosz Wójtowicz) [08:45:41] morning! [09:52:13] FYI in order to progress with merging the outlink transformer and predictor into a single deployment (and single image), I will first remove the `outlink-transformer` CI stage from the integration/config repo, which I'm doing in this patch: https://gerrit.wikimedia.org/r/c/integration/config/+/1187752 [09:52:38] I already created a patch for combining those in inference-services, but CI rejects it as it expects to run 2 CI stages (one for transformer and one for predictor). Once we remove the `outlink-transformer` stage, we can progress with reviewing+merging the patch in inference-services - https://gerrit.wikimedia.org/r/c/machinelearning/liftwing/inference-services/+/1187739 [10:24:07] This sounds good, but I'm thinking that it would cause us some headaches if we needed to rollback as we would have to re-add the CI jobs in the integration//config repo [10:25:30] alternatively we could: [10:25:30] 1. leave the transformer as is and add the preprocessing functionality in the predictor part [10:25:30] 2. deploy it and test it using only the predictor pod [10:25:30] 3. once we know everything is ok, clean up the transformer image along with the CI jobs [10:38:00] I see and I like the idea to make it more 2-step like you proposed 🙌 will move the CI change into WIP for now and update the inference-services to leave the transformer as is for now [10:41:49] cool, both ways would def work. Just looking for the option with less headaches [10:52:25] I pasted a summary of the above discussion in the task -> https://phabricator.wikimedia.org/T404294#11175648 [12:27:33] 06Machine-Learning-Team, 05Goal, 13Patch-For-Review: Q1 FY2025-26 Goal: Scaling Add-a-link to more wikis via production (airflow) pipelines - https://phabricator.wikimedia.org/T398950#11175895 (10OKarakaya-WMF) [13:07:01] (03PS1) 10Zabe: Replace most usages of rc_type with rc_source [extensions/ORES] - 10https://gerrit.wikimedia.org/r/1187802 (https://phabricator.wikimedia.org/T74157) [13:10:25] (03PS2) 10Zabe: Replace most usages of rc_type with rc_source [extensions/ORES] - 10https://gerrit.wikimedia.org/r/1187802 (https://phabricator.wikimedia.org/T74157) [13:12:41] (03PS3) 10Zabe: Replace most usages of rc_type with rc_source [extensions/ORES] - 10https://gerrit.wikimedia.org/r/1187802 (https://phabricator.wikimedia.org/T74157) [13:16:46] (03PS1) 10Zabe: Allow filtering models by rc_source instead of rc_type [extensions/ORES] - 10https://gerrit.wikimedia.org/r/1187807 (https://phabricator.wikimedia.org/T74157) [13:17:54] (03PS2) 10Zabe: Allow filtering models by rc_source instead of rc_type [extensions/ORES] - 10https://gerrit.wikimedia.org/r/1187807 (https://phabricator.wikimedia.org/T74157) [13:19:45] (03PS3) 10Zabe: Allow filtering models by rc_source instead of rc_type [extensions/ORES] - 10https://gerrit.wikimedia.org/r/1187807 (https://phabricator.wikimedia.org/T74157) [13:24:39] (03PS8) 10Bartosz Wójtowicz: outlink-topic-model: Merge transformer and predictor pods. [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1187739 (https://phabricator.wikimedia.org/T404294) [13:27:33] (03CR) 10CI reject: [V:04-1] Replace most usages of rc_type with rc_source [extensions/ORES] - 10https://gerrit.wikimedia.org/r/1187802 (https://phabricator.wikimedia.org/T74157) (owner: 10Zabe) [13:51:16] 06Machine-Learning-Team, 05Goal, 13Patch-For-Review: Q1 FY2025-26 Goal: Scaling Add-a-link to more wikis via production (airflow) pipelines - https://phabricator.wikimedia.org/T398950#11176246 (10isarantopoulos) I'm just copying Ozge's comment from the task description: **Progress update on the hypothesis... [13:52:39] 06Machine-Learning-Team, 05Goal, 13Patch-For-Review: Q1 FY2025-26 Goal: Scaling Add-a-link to more wikis via production (airflow) pipelines - https://phabricator.wikimedia.org/T398950#11176249 (10isarantopoulos) [14:18:28] (03CR) 10CI reject: [V:04-1] Allow filtering models by rc_source instead of rc_type [extensions/ORES] - 10https://gerrit.wikimedia.org/r/1187807 (https://phabricator.wikimedia.org/T74157) (owner: 10Zabe) [14:24:18] (03PS4) 10Zabe: Allow filtering models by rc_source instead of rc_type [extensions/ORES] - 10https://gerrit.wikimedia.org/r/1187807 (https://phabricator.wikimedia.org/T74157) [14:37:23] (03CR) 10CI reject: [V:04-1] Allow filtering models by rc_source instead of rc_type [extensions/ORES] - 10https://gerrit.wikimedia.org/r/1187807 (https://phabricator.wikimedia.org/T74157) (owner: 10Zabe) [14:58:55] (03PS1) 10Sbisson: fetch_appendix_section_titles: correctly handle 'get' return [research/recommendation-api] - 10https://gerrit.wikimedia.org/r/1187840 (https://phabricator.wikimedia.org/T404448) [15:01:24] 06Machine-Learning-Team, 06Growth-Team, 06Research, 10Revise-Tone-Structured-Task, and 2 others: Analyze samples of articles to see how many structured tasks we might be able to generate - https://phabricator.wikimedia.org/T401968#11176559 (10achou) Update: - Using a larger sample size (~1k) - EN: **46... [15:15:21] (03PS1) 10Sbisson: Fix sections fetch for redirects [research/recommendation-api] - 10https://gerrit.wikimedia.org/r/1187845 (https://phabricator.wikimedia.org/T404223) [15:40:27] (03PS1) 10Sbisson: Increase httpx client max_connections for better consurency [research/recommendation-api] - 10https://gerrit.wikimedia.org/r/1187848 [15:54:22] 06Machine-Learning-Team, 05Goal, 07OKR-Work: Q1 FY2025-26 Goal: Apply the Tone Check model to published articles, to learn whether we can build a pool of high-quality structured tasks for new editors - https://phabricator.wikimedia.org/T392283#11176753 (10achou) **Weekly Report** Progress update on the hypo... [23:41:59] 06Machine-Learning-Team, 10MediaWiki-extensions-ORES, 06Data-Persistence, 10MediaWiki-Recent-changes, and 2 others: Index for RC filterable ORES scores - https://phabricator.wikimedia.org/T403003#11178022 (10tstarling)