[02:35:07] (03PS1) 10Cicalese: Update PHP and version queries [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1024530 [02:39:45] (03PS2) 10Cicalese: Update PHP and version queries [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1024530 [08:12:58] (03CR) 10Joal: [V:03+1] "This is ready for review!" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1023828 (https://phabricator.wikimedia.org/T355588) (owner: 10Joal) [09:21:48] 10Data-Engineering (Q4 2024 April 1st - June 30th), 13Patch-For-Review: [Maintenance] Migrate ReportUpdater browser queries to Airflow - https://phabricator.wikimedia.org/T354552#9747240 (10CodeReviewBot) joal opened https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/666 Update... [09:47:24] 10Data-Engineering (Q4 2024 April 1st - June 30th), 13Patch-For-Review: [Maintenance] Migrate ReportUpdater browser queries to Airflow - https://phabricator.wikimedia.org/T354552#9747287 (10CodeReviewBot) joal closed https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/666 Update... [09:48:43] 10Data-Engineering (Q4 2024 April 1st - June 30th), 13Patch-For-Review: [Maintenance] Migrate ReportUpdater browser queries to Airflow - https://phabricator.wikimedia.org/T354552#9747288 (10CodeReviewBot) joal reopened https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/666 Updat... [09:48:49] 10Data-Engineering (Q4 2024 April 1st - June 30th), 13Patch-For-Review: [Maintenance] Migrate ReportUpdater browser queries to Airflow - https://phabricator.wikimedia.org/T354552#9747289 (10CodeReviewBot) joal merged https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/666 Update... [09:50:19] !log Deploy Airflow browser-metrics fix [09:50:20] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [10:05:31] 06Data-Engineering, 06Data Products, 10Observability-Logging, 06Traffic, 13Patch-For-Review: Move analytics log from Varnish to HAProxy - https://phabricator.wikimedia.org/T351117#9747347 (10Fabfur) > - there's couple of CRs pending (linked to this phab) and I'd like to have a second run on the event sc... [10:20:25] 06Data-Engineering, 10Data Pipelines: [Airflow Migration] Migrate reportupdater jobs - https://phabricator.wikimedia.org/T307540#9747363 (10JAllemandou) [10:49:59] btullis: Good morning! Would you have some time for me now? I'd like us to deprecate reportupdater :) [10:50:41] joal: Yes. Can I just grab a coffee? 4 mins in the batcave? [10:50:53] Yessir! [11:08:21] !log removed the symlink `/srv/published/datasets/periodic/reports` on an-launcher1002 to cease publishing reportupdata jobs from this host (T307540) [11:08:24] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [11:08:26] T307540: [Airflow Migration] Migrate reportupdater jobs - https://phabricator.wikimedia.org/T307540 [11:22:25] 06Data-Engineering, 10Data Pipelines, 13Patch-For-Review: [Airflow Migration] Migrate reportupdater jobs - https://phabricator.wikimedia.org/T307540#9747575 (10JAllemandou) Reportupdater jobs have all been either deprecated or migrated to Airflow! The report-updater jobs have been stopped, and data-synchroni... [13:46:32] (03PS4) 10Gehel: Sort pom.xml according to standard sortpom order. [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1014516 (https://phabricator.wikimedia.org/T360219) [13:46:32] (03PS6) 10Gehel: Start using wmf-jvm-parent-pom. [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1014517 [13:46:32] (03PS5) 10Gehel: Remove duplication from parent pom. [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1014546 (https://phabricator.wikimedia.org/T360219) [13:46:32] (03PS4) 10Gehel: Sort the dependencyManagement section according to sortPom. [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1014564 (https://phabricator.wikimedia.org/T360219) [13:46:33] (03PS4) 10Gehel: Move version configuration of dependencies to main pom. [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1014601 (https://phabricator.wikimedia.org/T360219) [13:47:17] (03Abandoned) 10Gehel: Sort some refinery modules according to sortPom. [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1015035 (https://phabricator.wikimedia.org/T360219) (owner: 10Gehel) [13:47:45] (03Abandoned) 10Gehel: Correct stlye issues with spotless. [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1015075 (owner: 10Gehel) [13:49:04] 06Data-Engineering, 06Data Products, 10Observability-Logging, 06Traffic, 13Patch-For-Review: Move analytics log from Varnish to HAProxy - https://phabricator.wikimedia.org/T351117#9747984 (10Ottomata) > Do you suggest to use something like uslfo_webrequest_text instead? The current naming 'convention' i... [13:50:54] joal: I rebased the refinery migration to the new parent pom: https://gerrit.wikimedia.org/r/c/analytics/refinery/source/+/1014601 (and the chain). [14:31:20] Thank you so much gehel - I'll be on holidays next week, but I promise I'll look when I come back [14:33:40] joal: damn! bad timing! [14:35:45] g [14:49:03] gehel: I'm gonna be bold and merge them all :) [14:49:09] I think it can only help [14:49:30] gehel: they should be no-op right? [14:49:44] they should, but should you trust me? [14:50:03] I trust you more than I should, maybe, but I definitely do :D [14:50:24] Risk should be low [14:50:32] Yeah [14:51:15] Plus, no actual code will be running with those changes, except one: it'll be good testing :) [14:51:26] Banzai! I merge [14:51:43] (03CR) 10Joal: [C:03+2] "LGTM - Thanks for doing this gehel" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1014516 (https://phabricator.wikimedia.org/T360219) (owner: 10Gehel) [14:53:34] joal: thanks! [15:01:59] (03Merged) 10jenkins-bot: Sort pom.xml according to standard sortpom order. [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1014516 (https://phabricator.wikimedia.org/T360219) (owner: 10Gehel) [15:20:46] joal: I see you've merged the first one, did you merge the full chain? [15:26:53] gehel: in meeting, will do just after [15:29:05] (03CR) 10Joal: [C:03+2] "LGTM - Merging" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1014517 (owner: 10Gehel) [15:29:10] gehel: one more --^ [15:39:49] (03Merged) 10jenkins-bot: Start using wmf-jvm-parent-pom. [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1014517 (owner: 10Gehel) [15:55:58] 06Data-Engineering, 10Event-Platform: [Event Platform] Instrument EventBus with prometheus MW Statslib - https://phabricator.wikimedia.org/T363587 (10Ottomata) 03NEW [16:01:42] (03CR) 10Joal: [C:03+2] "LGTM - merging" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1014546 (https://phabricator.wikimedia.org/T360219) (owner: 10Gehel) [16:19:55] (03Merged) 10jenkins-bot: Remove duplication from parent pom. [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1014546 (https://phabricator.wikimedia.org/T360219) (owner: 10Gehel) [16:25:45] (03CR) 10Joal: [C:03+2] "LGTM - Merging" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1014564 (https://phabricator.wikimedia.org/T360219) (owner: 10Gehel) [16:28:25] (03PS2) 10Xcollazo: SQL queries that format the base Commons Impact Metrics datasets into the expected shape for Cassandra. [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1023461 (https://phabricator.wikimedia.org/T358707) [16:30:02] (03CR) 10Xcollazo: [V:03+1] "All right, this set of SQL queries are ready for review." [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1023461 (https://phabricator.wikimedia.org/T358707) (owner: 10Xcollazo) [16:32:08] 10Data-Engineering (Q4 2024 April 1st - June 30th), 06Data Products, 13Patch-For-Review: Modify ClickStreamBuilder pipeline to cope with pagelinks schema changes - https://phabricator.wikimedia.org/T355588#9748568 (10CodeReviewBot) joal opened https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/... [16:43:14] (03Merged) 10jenkins-bot: Sort the dependencyManagement section according to sortPom. [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1014564 (https://phabricator.wikimedia.org/T360219) (owner: 10Gehel) [16:50:19] (03CR) 10Joal: [C:03+2] "LGTM - Merging" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1014601 (https://phabricator.wikimedia.org/T360219) (owner: 10Gehel) [17:07:57] (03Merged) 10jenkins-bot: Move version configuration of dependencies to main pom. [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1014601 (https://phabricator.wikimedia.org/T360219) (owner: 10Gehel) [17:13:30] All merged gehel! [17:14:02] (03PS7) 10Joal: Update ClickstreamBuilder [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1023828 (https://phabricator.wikimedia.org/T355588) [17:36:08] joal: great! Thanks! [20:58:10] 10Data-Engineering (Q4 2024 April 1st - June 30th): [Maintenance] Migrate wmcs to Airflow - https://phabricator.wikimedia.org/T357938#9749836 (10amastilovic) a:03amastilovic