[07:55:04] (03PS1) 10Kevin Bazira: article-country: process inputs from source event stream [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1111565 (https://phabricator.wikimedia.org/T382295) [08:26:44] FIRING: LiftWingServiceErrorRate: ... [08:26:50] LiftWing service has a high rate of non 2/3/400 error code responses - https://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Alerts#LiftWingServiceErrorRate - https://grafana.wikimedia.org/d/G7yj84Vnk/istio?orgId=1&refresh=30s&var-cluster=eqiad%20prometheus/k8s-mlserve&var-namespace=revscoring-editquality-damaging&var-backend=ptwiki-damaging-predictor-default.%2A - https://alerts.wikimedia.org/?q=alertname%3DLiftWingServiceErrorRate [08:36:44] RESOLVED: LiftWingServiceErrorRate: ... [08:36:44] LiftWing service has a high rate of non 2/3/400 error code responses - https://wikitech.wikimedia.org/wiki/Machine_Learning/LiftWing/Alerts#LiftWingServiceErrorRate - https://grafana.wikimedia.org/d/G7yj84Vnk/istio?orgId=1&refresh=30s&var-cluster=eqiad%20prometheus/k8s-mlserve&var-namespace=revscoring-editquality-damaging&var-backend=ptwiki-damaging-predictor-default.%2A - https://alerts.wikimedia.org/?q=alertname%3DLiftWingServiceErrorRate [08:58:13] hello! [09:04:07] (03CR) 10Gkyziridis: [C:03+2] "LGTM" [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1110804 (https://phabricator.wikimedia.org/T383312) (owner: 10Gkyziridis) [09:07:36] (03Merged) 10jenkins-bot: articletopic_outlink: update kserve to 0.14.1 [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1110804 (https://phabricator.wikimedia.org/T383312) (owner: 10Gkyziridis) [09:31:48] (03PS2) 10Kevin Bazira: article-country: process inputs from source event stream [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1111565 (https://phabricator.wikimedia.org/T382295) [09:58:49] 10Lift-Wing, 06Machine-Learning-Team, 13Patch-For-Review: [onboarding] Update articletopic outlink to kserve 0.14.1 - https://phabricator.wikimedia.org/T383312#10461413 (10kevinbazira) @gkyziridis, in the case of T383312#10461340, we can update both `values-ml-staging-codfw.yaml` and `values.yaml`. When depl... [10:13:35] morning Ilias o/ [10:16:13] 10Lift-Wing, 06Machine-Learning-Team, 13Patch-For-Review: [onboarding] Update articletopic outlink to kserve 0.14.1 - https://phabricator.wikimedia.org/T383312#10461482 (10kevinbazira) Looks like CI/CD is not triggered for the predictor image in [[ https://gerrit.wikimedia.org/r/1111580 | 1111580 ]]. I've du... [10:25:05] aiko: 你好 [10:41:13] Morning everyone! [10:43:03] Guten Tag o/ [11:13:56] klausman: Thnx for working on my accesses. I reviewed https://gerrit.wikimedia.org/r/c/operations/puppet/+/1109414 and LGTM I left a comment. [11:14:19] ack, thank you! [13:12:26] (03PS1) 10Nik Gkountas: Move logic from fetcher to collection_fetcher [research/recommendation-api] - 10https://gerrit.wikimedia.org/r/1111616 [13:12:26] (03PS1) 10Nik Gkountas: collection_fetcher: refactor batch processing [research/recommendation-api] - 10https://gerrit.wikimedia.org/r/1111617 [13:12:26] (03PS1) 10Nik Gkountas: collection_fetcher: refactor article fetching from Wikidata API [research/recommendation-api] - 10https://gerrit.wikimedia.org/r/1111618 [13:13:54] (03CR) 10CI reject: [V:04-1] Move logic from fetcher to collection_fetcher [research/recommendation-api] - 10https://gerrit.wikimedia.org/r/1111616 (owner: 10Nik Gkountas) [13:14:20] (03CR) 10CI reject: [V:04-1] collection_fetcher: refactor batch processing [research/recommendation-api] - 10https://gerrit.wikimedia.org/r/1111617 (owner: 10Nik Gkountas) [13:50:05] (03PS2) 10Nik Gkountas: Move collection-related logic from fetcher to collection_fetcher [research/recommendation-api] - 10https://gerrit.wikimedia.org/r/1111616 [13:50:15] (03PS2) 10Nik Gkountas: collection_fetcher: refactor batch processing [research/recommendation-api] - 10https://gerrit.wikimedia.org/r/1111617 [13:50:45] (03CR) 10CI reject: [V:04-1] Move collection-related logic from fetcher to collection_fetcher [research/recommendation-api] - 10https://gerrit.wikimedia.org/r/1111616 (owner: 10Nik Gkountas) [13:56:19] (03CR) 10Nik Gkountas: "recheck" [research/recommendation-api] - 10https://gerrit.wikimedia.org/r/1111616 (owner: 10Nik Gkountas) [13:57:20] (03PS2) 10Nik Gkountas: collection_fetcher: refactor article fetching from Wikidata API [research/recommendation-api] - 10https://gerrit.wikimedia.org/r/1111618 [14:34:42] (03CR) 10Kevin Bazira: [C:03+2] "Thanks for the review, Aiko. I have tested the page_change_event.json example you shared and it works fine. :)" [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1111565 (https://phabricator.wikimedia.org/T382295) (owner: 10Kevin Bazira) [14:35:27] (03Merged) 10jenkins-bot: article-country: process inputs from source event stream [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1111565 (https://phabricator.wikimedia.org/T382295) (owner: 10Kevin Bazira) [14:58:42] 06Machine-Learning-Team, 05Goal: Order 1 GPU for Lift Wing - https://phabricator.wikimedia.org/T341699#10462504 (10elukey) 05Open→03Resolved [15:05:40] 06Machine-Learning-Team, 06Infrastructure-Foundations, 06serviceops: Migrate the ownership of Docker images in production-images repo to mailing lists - https://phabricator.wikimedia.org/T373526#10462535 (10elukey) To summarize the current state: Single owner: ` cert-manager/build/control: Janis Meybohm (03CR) 10Eamedina: [C:03+1] "This and previous patches in the relation chain are testing well for me, I don't see anything wrong with this refactor. Leaving it +1 for " [research/recommendation-api] - 10https://gerrit.wikimedia.org/r/1111618 (owner: 10Nik Gkountas) [18:52:39] (03CR) 10Eamedina: collection_fetcher: refactor batch processing (031 comment) [research/recommendation-api] - 10https://gerrit.wikimedia.org/r/1111617 (owner: 10Nik Gkountas) [18:52:56] (03CR) 10Eamedina: [C:03+1] Move collection-related logic from fetcher to collection_fetcher [research/recommendation-api] - 10https://gerrit.wikimedia.org/r/1111616 (owner: 10Nik Gkountas) [22:43:23] FIRING: SLOMetricAbsent: - https://alerts.wikimedia.org/?q=alertname%3DSLOMetricAbsent [22:48:23] RESOLVED: SLOMetricAbsent: - https://alerts.wikimedia.org/?q=alertname%3DSLOMetricAbsent