[07:08:37] <isaranto>	 good morning!
[07:08:40] <isaranto>	 I added https://github.com/kserve/kserve/issues/3098
[07:21:21] <elukey>	 o/
[07:21:41] <elukey>	 klausman: fine to ping anytime, I read pings when I get online, they are not pages, don't worry :)
[07:21:54] <klausman>	 Ok goody :)
[07:22:08] <klausman>	 (same here)
[09:19:15] <aiko>	 elukey: welcome back Luca! :)
[10:33:16] <wikibugs>	 10Machine-Learning-Team, 10API Platform, 10Anti-Harassment, 10Content-Transform-Team, and 19 others: Migrate PipelineLib repos to GitLab - https://phabricator.wikimedia.org/T332953 (10Physikerwelt)
[10:35:11] <wikibugs>	 10Machine-Learning-Team, 10API Platform, 10Anti-Harassment, 10Content-Transform-Team, and 19 others: Migrate PipelineLib repos to GitLab - https://phabricator.wikimedia.org/T332953 (10Physikerwelt)
[11:00:01] * klausman lunch
[11:04:00] <isaranto>	 for me as well!
[11:20:26] <chrisalbon_>	 Good morning all
[11:26:42] <klausman>	 Hey Chris!
[11:41:36] <isaranto>	 Good morning!
[12:31:01] <wikibugs>	 10Machine-Learning-Team, 10ORES, 10All-and-every-Wikisource, 10ArticlePlaceholder, and 55 others: Remove unnecessary targets definitions - https://phabricator.wikimedia.org/T328497 (10phuedx)
[12:56:12] <wikibugs>	 10Machine-Learning-Team, 10Patch-For-Review, 10Research (FY2023-24-Research-July-September): Deploy multilingual readability model to LiftWing - https://phabricator.wikimedia.org/T334182 (10MGerlach) weekly update: * ML Team started work on moving model to production in liftwing (see above) * Revising model...
[12:57:22] <wikibugs>	 10Machine-Learning-Team, 10Add-Link, 10Growth-Team: Investigate why the add-a-link training pipeline concludes with missing datasets - https://phabricator.wikimedia.org/T344832 (10kevinbazira) Thank you for the clarification @nshahquinn-wmf.
[13:01:37] <wikibugs>	 10Machine-Learning-Team, 10Add-Link, 10Growth-Team: Investigate why the add-a-link training pipeline concludes with missing datasets - https://phabricator.wikimedia.org/T344832 (10kevinbazira) @MGerlach and I looked into why the spark jobs in the training pipeline weren't running and discovered that they wer...
[13:06:57] <wikibugs>	 10Machine-Learning-Team, 10Add-Link, 10Growth-Team: Investigate why the add-a-link training pipeline concludes with missing datasets - https://phabricator.wikimedia.org/T344832 (10kevinbazira) The next step was to adapt the entire training pipeline (i.e `run-pipeline.sh`) to use a packed env and on running i...
[13:56:07] <isaranto>	 I have deployed the correct version of articlequality
[13:56:41] <isaranto>	 *for enwiki
[13:57:19] <isaranto>	 however I face the following issue in staging: there are 2 pods for enwiki as the old revision (00008) did not terminate . In production all went fine and old pods were removed
[13:58:48] <isaranto>	 while checking the revision I see that both revisions (8 and 9) have desired replicas set to 1.
[13:58:54] <isaranto>	 klausman: any ideas?
[13:59:08] <klausman>	 having a look
[13:59:31] <klausman>	 eqiad, I presume?
[13:59:48] <isaranto>	 ml-staging-codfw
[13:59:54] <isaranto>	 eqiad and codfw in prod are fine
[14:03:06] <klausman>	 This sometimes happens when old revisions don't go away. It's not quite clear, why.
[14:03:19] <klausman>	 I've run kubectl delete revisions -n revscoring-articlequality enwiki-articlequality-predictor-default-00007 enwiki-articlequality-predictor-default-00008
[14:03:21] <isaranto>	 I see it is terminating now, did you remove the revision?
[14:03:50] <klausman>	 see above :)
[14:03:57] <isaranto>	 aa ok thank youu
[14:04:38] <klausman>	 I don't know if you would be able to do the delete as well, maybe try next time this happens. If not, pinging me or Luca is fine :)
[14:10:13] <isaranto>	 I don't think it is supposed to be deleted. It is ok for older revisions to exist but the DESIRED_REPLICAS should be set to 0
[14:10:24] <isaranto>	 at least that is what I see in prod
[14:10:56] <klausman>	 Yeah, it definitely is weird, and manual interevention should not be necessary
[14:38:19] <wikibugs>	 10Machine-Learning-Team: Provide an API endpoint that returns the model's metadata in Lift Wing - https://phabricator.wikimedia.org/T340824 (10isarantopoulos) I have opened the following issue on GH https://github.com/kserve/kserve/issues/3098 and also opened a relevant conversation in the community's kserve sla...
[15:32:34] <klausman>	 I'm heading out now \o I'll be back in two weeks, on the 11th
[15:32:42] <klausman>	 Don't party too hard without me ;)
[15:54:32] <isaranto>	 Bye Tobias! Hope you have a nice time :)
[16:02:28] <chrisalbon_>	 Bye Tobias!
[19:27:30] <wikibugs>	 10Machine-Learning-Team, 10Add-Link, 10Growth-Team (Current Sprint), 10Patch-For-Review: Automate unpublishing of add-a-link datasets - https://phabricator.wikimedia.org/T344799 (10Urbanecm_WMF) a:03kevinbazira
[19:28:10] <wikibugs>	 10Machine-Learning-Team, 10Add-Link, 10Growth-Team (Current Sprint), 10Patch-For-Review: Automate unpublishing of add-a-link datasets - https://phabricator.wikimedia.org/T344799 (10Urbanecm_WMF) This task is currently blocked on {T344832}, which causes CI to fail on the patch here (or any other patch in `r...
[19:28:19] <wikibugs>	 10Machine-Learning-Team, 10Add-Link, 10Growth-Team (Current Sprint), 10Patch-For-Review: Automate unpublishing of add-a-link datasets - https://phabricator.wikimedia.org/T344799 (10Urbanecm_WMF) p:05Triage→03Low
[21:42:50] <wikibugs>	 10Machine-Learning-Team, 10Add-Link, 10CommRel-Specialists-Support (Jul-Sep-2023), 10Growth-Team (Current Sprint), 10User-notice: Deploy "add a link" to 10th round of wikis - https://phabricator.wikimedia.org/T308135 (10Etonkovidova) 05Open→03Resolved >>! In T308135#9047447, @Trizek-WMF wrote: > Ever...