[05:54:49] 10artificial-intelligence, 10VisualEditor, 10VisualEditor-MediaWiki-References: generate citation error should auto-consult AI, or notify devs, so they can try to improve it - https://phabricator.wikimedia.org/T341420 (10ThurnerRupert) @HaeB tried with bing, and the result was: ` - Please generate a valid... [07:30:30] (03CR) 10Kevin Bazira: Set up production and test images for the recommendation-api migration (031 comment) [research/recommendation-api] - 10https://gerrit.wikimedia.org/r/932810 (https://phabricator.wikimedia.org/T339890) (owner: 10Kevin Bazira) [07:52:54] o/ [07:53:04] Good morning and have a great week everybody! [07:55:50] o/ [08:45:44] can anybody point me to a table where I can find requests to .wikimedia.org domain and subdomains? [08:46:32] at the moment I want to check ores requests [08:47:00] you can use turnilo, the traffic is sampled (1/128th) [08:47:46] aa yes [08:47:57] isaranto: https://w.wiki/6$Kt [08:48:19] keep in mind that those are only external calls, so for example you will not see the mw extension user agent or changeprop [08:48:32] if you need also those, I'd suggest the ores logstash dashboard [08:48:33] thanks luca! any idea about a relevant hive table? [08:49:17] for external traffic? [08:49:55] 10Machine-Learning-Team, 10serviceops: Replace the current recommendation-api service with a newer version - https://phabricator.wikimedia.org/T338471 (10SCherukuwada) Thanks for all the inputs. I'd like to verify my expectations around service teams and infrastructure commitments first before I comment furth... [08:50:46] ideally for all traffic. but if you are aware of sth internal or external only any would do [08:52:05] isaranto: I don't think that we have a hive table for internal traffic, the only way is logstash [08:52:20] ack, thanks! [08:52:24] webrequests are only related to what we gather from the varnish caches [11:12:37] * elukey lunch! [12:06:39] 10Machine-Learning-Team, 10Foundational Technology Requests: Content Translation Recommendations API - https://phabricator.wikimedia.org/T293648 (10santhosh) @elukey not an answer to your question, but trying to assess the effort required here. Like everybody else we are also constrained by people capacity :-)... [13:32:20] isaranto: it's deployed in testwiki now, I'm not sure if it's working though. My edits don't get reflected in ores_classification table [13:32:54] (but other wikis work fine) [13:33:14] are you getting requests? [13:33:28] thanks Amir1 ! any other way to check on mediawiki side other than https://quarry.wmcloud.org/? [13:34:03] maybe stat machines? [13:34:13] https://wikitech.wikimedia.org/wiki/Analytics/Systems/MariaDB [13:34:33] but they should get replicated to the cloud so that's not an issue [13:35:20] ok thanks! I havent seen any requests (or anything related). it may be a network issue, since it is the first time I try the internal endpoint [13:48:06] 10Machine-Learning-Team: [ores-legacy] Clienterror - https://phabricator.wikimedia.org/T341479 (10isarantopoulos) [13:48:45] 10Machine-Learning-Team: [ores-legacy] Clienterror is returned in some responses - https://phabricator.wikimedia.org/T341479 (10isarantopoulos) [14:27:42] 10Machine-Learning-Team: Add ores like threshold support in LW for revscoring models - https://phabricator.wikimedia.org/T341483 (10isarantopoulos) [14:41:20] 10Machine-Learning-Team: [ores-legacy] Clienterror is returned in some responses - https://phabricator.wikimedia.org/T341479 (10elukey) On the lift wing side: ` 2023-07-10 14:34:36,651 root ERROR LiftWing call for model damaging and rev-id 949448248 raised a ClientError excp with message: 0, message=... [14:43:03] 10Machine-Learning-Team: [ores-legacy] add support for ORES v1 - https://phabricator.wikimedia.org/T341486 (10isarantopoulos) [14:44:32] sigh --^ [14:45:13] this one seems easy -famous last words :) [14:45:34] isaranto: any known/reachable owner? We could ask them to migrate to v3 or Lift Wing [14:45:35] just the last one about v1 [14:46:06] I meant if there are any know User Agents etc.. [14:46:11] *known [14:46:21] that we could use to reach out to whoever calls ores with v1 [14:46:57] I just realized that we also need a task to add better access logs + a logstash dashboard [14:50:21] ack [14:50:59] there is no known user agent. I see browsers or empty user-agents in a sample I have gone through [14:51:50] isaranto: let's keep in mind https://meta.wikimedia.org/wiki/User-Agent_policy [14:52:24] TIL [14:52:40] we can always think that we'll not support v1, and we can implement a quick error response that returns a msg with the policy linked [14:53:17] thanks for the link, this is nice [14:55:34] we'll have to draw a line at some point [15:16:21] 10Machine-Learning-Team, 10Patch-For-Review: Host the recommendation-api container on LiftWing - https://phabricator.wikimedia.org/T339890 (10kevinbazira) The NodeJS recommendation-api already has entries to the CI pipeline (in jjb/project-pipelines.yaml and zuul/layout.yaml) that publish [[ https://docker-reg... [16:01:24] 10Machine-Learning-Team, 10Foundational Technology Requests: Content Translation Recommendations API - https://phabricator.wikimedia.org/T293648 (10isarantopoulos) @santhosh By ownership we are mostly referring to implementing new features. We are already working on deploying this flask app as a service on the... [16:06:35] going afk folks, have a nice evening/rest of day! [16:14:29] 10Machine-Learning-Team, 10CirrusSearch, 10Discovery-Search (Current work), 10Patch-For-Review: Add outlink topic model predictions to CirrusSearch indices - https://phabricator.wikimedia.org/T328276 (10CodeReviewBot) ebernhardson merged https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/me... [16:35:54] * elukey afk! [16:50:42] 10Machine-Learning-Team, 10CirrusSearch, 10Discovery-Search (Current work), 10Patch-For-Review: Add outlink topic model predictions to CirrusSearch indices - https://phabricator.wikimedia.org/T328276 (10EBernhardson) This has been shipped, our pipelines are now reading from `event.mediawiki_page_outlink_to... [18:55:41] 10Machine-Learning-Team: FeatureNotFound exception in revertrisk multi-lingual - https://phabricator.wikimedia.org/T340812 (10leila) [18:57:26] 10Machine-Learning-Team: Pop index out of range exception in revertrisk multi lingual - https://phabricator.wikimedia.org/T340813 (10leila) [18:58:48] 10Machine-Learning-Team, 10CirrusSearch, 10Discovery-Search (Current work), 10Patch-For-Review: Add outlink topic model predictions to CirrusSearch indices - https://phabricator.wikimedia.org/T328276 (10Isaac) This is excellent @EBernhardson and agreed on the update rate meeting expectations, especially be... [21:36:39] 10Machine-Learning-Team, 10CirrusSearch, 10Discovery-Search (Current work), 10Patch-For-Review: Add outlink topic model predictions to CirrusSearch indices - https://phabricator.wikimedia.org/T328276 (10KStoller-WMF) @Isaac Exciting, thanks for the update! [22:27:27] how are we supposed to make POST reqs to liftwing? [22:27:39] curl 'https://inference.discovery.wmnet:3044/v1/models/testwiki-damaging:predict' with etc. [22:27:42] is giving me this [22:27:48] curl: (7) Failed to connect to inference.discovery.wmnet port 3044: Connection refused [22:30:40] nvm, found out that the port is wrong