[12:34:37] (03CR) 10Joal: [C:03+2] "Merging for release" [analytics/gobblin-wmf] - 10https://gerrit.wikimedia.org/r/1078623 (https://phabricator.wikimedia.org/T376144) (owner: 10Joal) [12:36:31] (03Merged) 10jenkins-bot: Update time-partitioned-flag data publisher [analytics/gobblin-wmf] - 10https://gerrit.wikimedia.org/r/1078623 (https://phabricator.wikimedia.org/T376144) (owner: 10Joal) [12:37:40] Starting build #2 for job analytics-gobblin-wmf-maven-release [12:38:02] !log Release new gobblin-wmf artifact to archiva [12:38:03] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [12:40:16] Project analytics-gobblin-wmf-maven-release build #2: 09SUCCESS in 2 min 36 sec: https://integration.wikimedia.org/ci/job/analytics-gobblin-wmf-maven-release/2/ [13:11:52] (03PS1) 10Joal: Add new gobblin jar and update symlinks [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1092824 (https://phabricator.wikimedia.org/T376144) [14:02:45] (03CR) 10Joal: [V:03+2 C:03+2] "Self merging for deploy" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1092824 (https://phabricator.wikimedia.org/T376144) (owner: 10Joal) [14:05:27] !log Deploying refinery wioth scap for gobblin release [14:05:29] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [14:23:50] !log failed deployed (rolled back) due to disk-space on an-launcher1002 [14:23:53] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [15:29:58] 06Data-Engineering, 06MediaWiki-Platform-Team, 10MediaWiki-ResourceLoader, 07Schema-change: Drop unused module_deps table from MediaWiki schema - https://phabricator.wikimedia.org/T379661#10336253 (10phuedx) [15:36:36] 06Data-Engineering, 10ConfirmEdit (CAPTCHA extension), 06Data Products, 10MediaWiki-extensions-EventLogging, 10Metrics Platform: Send captcha API response data to event logging - https://phabricator.wikimedia.org/T379179#10336293 (10phuedx) @VirginiaPoundstone: This seems like a good candidate for a tigh... [15:54:04] 06Data-Engineering, 06Data Products, 10Event-Platform: Add schema diffing support to jsonschema-tools and run diff in CI - https://phabricator.wikimedia.org/T321850#10336434 (10mforns) @Ottomata Is there anything we Data Products could do to help with this? Or is it just as a heads up? 🙏 [15:55:56] hello! I have a change for Eventbus to add a maintenance script (doesn't actually impact the extension at all) - can I +2 this myself or what's the usual workflow? https://gerrit.wikimedia.org/r/c/mediawiki/extensions/EventBus/+/1078692 [16:09:36] 06Data-Engineering, 06MediaWiki-Engineering, 10MediaWiki-extensions-WikimediaEvents, 06MediaWiki-Platform-Team, and 4 others: Add Prometheus support to statsd.js via mw.track() - https://phabricator.wikimedia.org/T355837#10336563 (10larissagaulia) [16:28:11] 06Data-Engineering, 10CirrusSearch, 10Structured Data Engineering, 06Structured-Data-Backlog, and 2 others: Migrate image recommendation to use page_weighted_tags_changed stream - https://phabricator.wikimedia.org/T372912#10336660 (10mfossati) [16:34:31] 06Data-Engineering, 10CirrusSearch, 10Structured Data Engineering, 06Structured-Data-Backlog, and 2 others: Migrate image recommendation to use page_weighted_tags_changed stream - https://phabricator.wikimedia.org/T372912#10336684 (10dcausse) Checking the data of the last 5 snapshots I see for commons: ` 2... [16:44:09] 06Data-Engineering, 10CirrusSearch, 10Structured Data Engineering, 06Structured-Data-Backlog, and 2 others: Migrate image recommendation to use page_weighted_tags_changed stream - https://phabricator.wikimedia.org/T372912#10336730 (10mfossati) >>! In T372912#10336684, @dcausse wrote: > What's surprising is... [16:49:32] 06Data-Engineering, 10CirrusSearch, 10Structured Data Engineering, 06Structured-Data-Backlog, and 2 others: Migrate image recommendation to use page_weighted_tags_changed stream - https://phabricator.wikimedia.org/T372912#10336760 (10dcausse) >>! In T372912#10336730, @mfossati wrote: >>>! In T372912#103366... [16:50:21] 06Data-Engineering, 06MediaWiki-Engineering, 10MediaWiki-extensions-WikimediaEvents, 06MediaWiki-Platform-Team, and 4 others: Add Prometheus support to statsd.js via mw.track() - https://phabricator.wikimedia.org/T355837#10336752 (10larissagaulia) a:03Krinkle [17:00:13] 06Data-Engineering, 10CirrusSearch, 10Structured Data Engineering, 06Structured-Data-Backlog, and 2 others: Migrate image recommendation to use page_weighted_tags_changed stream - https://phabricator.wikimedia.org/T372912#10336798 (10mfossati) >>! In T372912#10336760, @dcausse wrote: > to avoid sending too... [17:07:04] 06Data-Engineering, 10CirrusSearch, 10Structured Data Engineering, 06Structured-Data-Backlog, and 2 others: Migrate image recommendation to use page_weighted_tags_changed stream - https://phabricator.wikimedia.org/T372912#10336830 (10dcausse) >>! In T372912#10336798, @mfossati wrote: >>>! In T372912#103367... [17:22:06] 06Data-Engineering, 10Data-Engineering-Wikistats, 10Technical-Tool-Request: Ranked list of all Wikipedias by yearly readership growth - https://phabricator.wikimedia.org/T224963#10336923 (10Aklapper) p:05High→03Medium a:05Perohanych→03None @Perohanych: Removing task assignee as this open task has bee... [17:25:38] !log pause airflow refine_hourly job to prevent it to starve other jobs [17:25:39] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [17:29:21] (03PS1) 10Joal: Remove dead code, doc and artifacts [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1092879 [17:49:06] 06Data-Engineering, 10Data Pipelines: [Iceberg] Migrate event_santised to Iceberg - https://phabricator.wikimedia.org/T311765#10337249 (10Aklapper) a:05JAllemandou→03None @JAllemandou: Removing task assignee as this open task has been assigned for more than two years - See the email sent to task assignee o... [17:49:26] 06Data-Engineering, 10Data Pipelines, 13Patch-Needs-Improvement: [Iceberg] Update Refine Sanitize to insert into Iceberg tables - https://phabricator.wikimedia.org/T311739#10337252 (10Aklapper) a:05JAllemandou→03None @JAllemandou: Removing task assignee as this open task has been assigned for more than t... [17:49:59] 06Data-Engineering, 10Data Pipelines, 06Product-Analytics, 06Research: Update HDFS links tables as Mediawiki changes - https://phabricator.wikimedia.org/T304979#10337257 (10Aklapper) a:05JAllemandou→03None @JAllemandou: Removing task assignee as this open task has been assigned for more than two years... [17:51:13] 06Data-Engineering: Event Utilities partially downloads schemas - https://phabricator.wikimedia.org/T309717#10337275 (10Aklapper) a:05Ottomata→03None @Ottomata: Removing task assignee as this open task has been assigned for more than two years - See the email sent to task assignee on October 11th. Please ass... [17:51:21] 06Data-Engineering, 06Product-Analytics, 10Event-Platform: Migrate legacy metawiki schemas to Event Platform - https://phabricator.wikimedia.org/T259163#10337272 (10Aklapper) a:05Ottomata→03None @Ottomata: Removing task assignee as this open task has been assigned for more than two years - See the email... [18:30:23] (03PS1) 10Snwachukwu: Update Geoeditors Edits Monthly to support Temp Accounts. [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1092890 (https://phabricator.wikimedia.org/T379768) [20:44:15] FIRING: HdfsCapacityRemainingPercent: Alarmingly low free space on the analytics-hadoop HDFS cluster. - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Hadoop/Alerts#HDFS_Capacity_Remaining - https://grafana.wikimedia.org/d/000000585/hadoop?var-hadoop_cluster=analytics-hadoop&orgId=1&panelId=106&fullscreen - https://alerts.wikimedia.org/?q=alertname%3DHdfsCapacityRemainingPercent [20:59:15] RESOLVED: HdfsCapacityRemainingPercent: Alarmingly low free space on the analytics-hadoop HDFS cluster. - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Hadoop/Alerts#HDFS_Capacity_Remaining - https://grafana.wikimedia.org/d/000000585/hadoop?var-hadoop_cluster=analytics-hadoop&orgId=1&panelId=106&fullscreen - https://alerts.wikimedia.org/?q=alertname%3DHdfsCapacityRemainingPercent [21:12:15] FIRING: HdfsCapacityRemainingPercent: Alarmingly low free space on the analytics-hadoop HDFS cluster. - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Hadoop/Alerts#HDFS_Capacity_Remaining - https://grafana.wikimedia.org/d/000000585/hadoop?var-hadoop_cluster=analytics-hadoop&orgId=1&panelId=106&fullscreen - https://alerts.wikimedia.org/?q=alertname%3DHdfsCapacityRemainingPercent [21:21:31] (03PS1) 10Snwachukwu: Update Geoeditors Monthly to support Temp Accounts. [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1092916 (https://phabricator.wikimedia.org/T379769) [22:52:15] RESOLVED: HdfsCapacityRemainingPercent: Alarmingly low free space on the analytics-hadoop HDFS cluster. - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Hadoop/Alerts#HDFS_Capacity_Remaining - https://grafana.wikimedia.org/d/000000585/hadoop?var-hadoop_cluster=analytics-hadoop&orgId=1&panelId=106&fullscreen - https://alerts.wikimedia.org/?q=alertname%3DHdfsCapacityRemainingPercent [23:10:15] FIRING: HdfsCapacityRemainingPercent: Alarmingly low free space on the analytics-hadoop HDFS cluster. - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Hadoop/Alerts#HDFS_Capacity_Remaining - https://grafana.wikimedia.org/d/000000585/hadoop?var-hadoop_cluster=analytics-hadoop&orgId=1&panelId=106&fullscreen - https://alerts.wikimedia.org/?q=alertname%3DHdfsCapacityRemainingPercent [23:20:15] RESOLVED: HdfsCapacityRemainingPercent: Alarmingly low free space on the analytics-hadoop HDFS cluster. - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Hadoop/Alerts#HDFS_Capacity_Remaining - https://grafana.wikimedia.org/d/000000585/hadoop?var-hadoop_cluster=analytics-hadoop&orgId=1&panelId=106&fullscreen - https://alerts.wikimedia.org/?q=alertname%3DHdfsCapacityRemainingPercent [23:29:15] FIRING: HdfsCapacityRemainingPercent: Alarmingly low free space on the analytics-hadoop HDFS cluster. - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Hadoop/Alerts#HDFS_Capacity_Remaining - https://grafana.wikimedia.org/d/000000585/hadoop?var-hadoop_cluster=analytics-hadoop&orgId=1&panelId=106&fullscreen - https://alerts.wikimedia.org/?q=alertname%3DHdfsCapacityRemainingPercent [23:59:15] RESOLVED: HdfsCapacityRemainingPercent: Alarmingly low free space on the analytics-hadoop HDFS cluster. - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Hadoop/Alerts#HDFS_Capacity_Remaining - https://grafana.wikimedia.org/d/000000585/hadoop?var-hadoop_cluster=analytics-hadoop&orgId=1&panelId=106&fullscreen - https://alerts.wikimedia.org/?q=alertname%3DHdfsCapacityRemainingPercent