[00:11:53] (HiveServerHeapUsage) resolved: Hive Server JVM Heap usage is above 80% on an-coord1003:10100 - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Hive/Alerts#Hive_Server_Heap_Usage - https://grafana.wikimedia.org/d/000000379/hive?panelId=7&fullscreen&orgId=1&var-instance=an-coord1003:10100 - https://alerts.wikimedia.org/?q=alertname%3DHiveServerHeapUsage [01:38:53] (03CR) 10Ahoelzl: [C:03+1] "Looks good to me" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1006970 (owner: 10Aleksandar Mastilovic) [03:50:18] (03PS7) 10Snwachukwu: Mediawiki History Data Quality Metrics [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1008934 (https://phabricator.wikimedia.org/T354692) [03:50:58] (03CR) 10Snwachukwu: Mediawiki History Data Quality Metrics (032 comments) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1008934 (https://phabricator.wikimedia.org/T354692) (owner: 10Snwachukwu) [03:51:51] (03CR) 10Snwachukwu: Mediawiki History Data Quality Metrics (033 comments) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1008934 (https://phabricator.wikimedia.org/T354692) (owner: 10Snwachukwu) [10:05:39] 06Data-Engineering, 10Data-Platform-SRE (2024.03.25 - 2024.04.14), 13Patch-For-Review: 14Deprecate Hue and stop the services - 14https://phabricator.wikimedia.org/T341895#9668196 (10brouberol) 05Open→03Resolved [10:41:51] 06Data-Engineering, 10CheckUser: FYI: Changes to the cuc_agent column in the cu_changes table - https://phabricator.wikimedia.org/T361210 (10Dreamy_Jazz) 03NEW [10:42:46] 06Data-Engineering, 10CheckUser: FYI: Changes to the cuc_agent column in the cu_changes table - https://phabricator.wikimedia.org/T361210#9668649 (10Dreamy_Jazz) [10:43:27] 06Data-Engineering, 10CheckUser: FYI: Changes to the cuc_agent column in the cu_changes table - https://phabricator.wikimedia.org/T361210#9668650 (10Dreamy_Jazz) [11:06:19] (03PS5) 10Gmodena: Add gobblin job webrequest_frontend_rc0 [analytics/refinery] - 10https://gerrit.wikimedia.org/r/983926 (https://phabricator.wikimedia.org/T314956) (owner: 10Ottomata) [11:23:23] (03CR) 10Btullis: [C:03+1] "Looks good to me, thanks." [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1007690 (https://phabricator.wikimedia.org/T328472) (owner: 10Ahmon Dancy) [11:25:13] (03CR) 10Btullis: [C:03+1] "I'm happy to work with you to test and merge Ahmon, but I'm out next week. I could do today, or any time after April 8th." [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1007690 (https://phabricator.wikimedia.org/T328472) (owner: 10Ahmon Dancy) [11:36:44] 06Data-Engineering, 10Data-Platform-SRE (2024.03.25 - 2024.04.14), 13Patch-For-Review: 14Deprecate Hue and stop the services - 14https://phabricator.wikimedia.org/T341895#9668813 (10BTullis) 14I have archived these Wikitech pages: https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Hue https:... [12:31:25] (03CR) 10Gmodena: "LGTM, but I left you a couple of comments on the latest patch set." [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1008934 (https://phabricator.wikimedia.org/T354692) (owner: 10Snwachukwu) [13:18:07] (03CR) 10Snwachukwu: Mediawiki History Data Quality Metrics (032 comments) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1008934 (https://phabricator.wikimedia.org/T354692) (owner: 10Snwachukwu) [13:29:28] 10Data-Engineering (Sprint 9), 13Patch-For-Review: [Data Quality] Implement basic data quality metrics for MW history - https://phabricator.wikimedia.org/T354692#9669177 (10Snwachukwu) In the code implementation for change in size detection, I have compared previous snapshot and current snapshot by reading pre... [13:30:28] (03CR) 10Snwachukwu: "I have documented this in the phab ticket and also added a TODO task to code." [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1008934 (https://phabricator.wikimedia.org/T354692) (owner: 10Snwachukwu) [13:31:29] (03CR) 10Snwachukwu: "Ack" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1008934 (https://phabricator.wikimedia.org/T354692) (owner: 10Snwachukwu) [13:41:16] 06Data-Engineering, 10Data-Engineering-Dashiki, 06Data Products: Public dashboard process - https://phabricator.wikimedia.org/T361214#9669230 (10VirginiaPoundstone) [13:44:34] 06Data-Engineering, 10Data-Engineering-Dashiki, 06Data Products: Public dashboard process - https://phabricator.wikimedia.org/T361214#9669238 (10VirginiaPoundstone) Thank you @AndrewTavis_WMDE for submitting this feature request. This will help us think through your use case when we begin strategy work for p... [14:27:36] btullis: o/ [14:27:46] if you have a moment, lemme know if it makes sense https://phabricator.wikimedia.org/T361225 [14:27:51] I can take care of the updates [14:56:33] elukey: Oh, thanks so much. That has been on my mind to do, but I kept forgetting to apply it. [14:57:22] np! Ok if I proceed? [14:57:45] elukey: Yes, please do. [14:58:35] <3 [15:00:47] !log remove GPU labels in Hadoop Yarn for an-worker[1096-1099] (the hosts don't have a GPU anymore) - T361225 [15:00:50] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [15:00:50] done! [15:00:50] T361225: Update GPU labels in Hadoop 's Yarn config - https://phabricator.wikimedia.org/T361225 [15:32:36] (03CR) 10Gmodena: Mediawiki History Data Quality Metrics (033 comments) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1008934 (https://phabricator.wikimedia.org/T354692) (owner: 10Snwachukwu) [15:57:36] 06Data-Engineering, 06MW-Interfaces-Team: Getting added_lines data - https://phabricator.wikimedia.org/T331150#9669990 (10daniel) We actually have a somewhat nice REST API for fetching diffs that should fit the bill: https://en.wikipedia.org/w/rest.php/v1/revision/1215949997/compare/1215612564 [16:10:44] 06Data-Engineering, 06MW-Interfaces-Team: 14Getting added_lines data - 14https://phabricator.wikimedia.org/T331150#9670067 (10aaron) 05Open→03Declined 14An example of a diff where lines are added is https://en.wikipedia.org/w/index.php?title=User:Spicy/spihelper_log&curid=74418657&diff=1216025285&oldi... [16:20:46] (03CR) 10Btullis: [C:03+2] Add HQL query files for the "pingback" report [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1006970 (owner: 10Aleksandar Mastilovic) [16:20:51] (03CR) 10Btullis: [V:03+2 C:03+2] Add HQL query files for the "pingback" report [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1006970 (owner: 10Aleksandar Mastilovic) [16:21:32] (03CR) 10Btullis: [C:03+2] Switch from git-fat to git-lfs [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1007690 (https://phabricator.wikimedia.org/T328472) (owner: 10Ahmon Dancy) [16:21:34] (03CR) 10Btullis: [V:03+2 C:03+2] Switch from git-fat to git-lfs [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1007690 (https://phabricator.wikimedia.org/T328472) (owner: 10Ahmon Dancy) [16:22:20] !log deploying refinery to test the git-lfs integration with scap for T328472 [16:22:23] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [16:22:23] T328472: analytics/refinery: Stop using git-fat - https://phabricator.wikimedia.org/T328472 [16:29:38] (03CR) 10Btullis: [C:03+2] scap.cfg: Use git-lfs instead of git-fat [analytics/refinery/scap] - 10https://gerrit.wikimedia.org/r/1007692 (https://phabricator.wikimedia.org/T328472) (owner: 10Ahmon Dancy) [16:29:40] (03CR) 10Btullis: [V:03+2 C:03+2] scap.cfg: Use git-lfs instead of git-fat [analytics/refinery/scap] - 10https://gerrit.wikimedia.org/r/1007692 (https://phabricator.wikimedia.org/T328472) (owner: 10Ahmon Dancy) [16:46:53] (HiveServerHeapUsage) firing: Hive Server JVM Heap usage is above 80% on an-coord1003:10100 - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Hive/Alerts#Hive_Server_Heap_Usage - https://grafana.wikimedia.org/d/000000379/hive?panelId=7&fullscreen&orgId=1&var-instance=an-coord1003:10100 - https://alerts.wikimedia.org/?q=alertname%3DHiveServerHeapUsage [17:30:27] (03CR) 10Snwachukwu: [C:03+2] Mediawiki History Data Quality Metrics [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1008934 (https://phabricator.wikimedia.org/T354692) (owner: 10Snwachukwu) [17:43:25] (03Merged) 10jenkins-bot: Mediawiki History Data Quality Metrics [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1008934 (https://phabricator.wikimedia.org/T354692) (owner: 10Snwachukwu) [18:04:27] !log deploying refinery to HDFS. [18:04:30] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [20:47:08] (HiveServerHeapUsage) firing: Hive Server JVM Heap usage is above 80% on an-coord1003:10100 - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Hive/Alerts#Hive_Server_Heap_Usage - https://grafana.wikimedia.org/d/000000379/hive?panelId=7&fullscreen&orgId=1&var-instance=an-coord1003:10100 - https://alerts.wikimedia.org/?q=alertname%3DHiveServerHeapUsage [21:06:53] (HiveServerHeapUsage) resolved: Hive Server JVM Heap usage is above 80% on an-coord1003:10100 - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Hive/Alerts#Hive_Server_Heap_Usage - https://grafana.wikimedia.org/d/000000379/hive?panelId=7&fullscreen&orgId=1&var-instance=an-coord1003:10100 - https://alerts.wikimedia.org/?q=alertname%3DHiveServerHeapUsage [22:05:27] 14Analytics, 06Data Products: Add cawiki to clickstream dataset - https://phabricator.wikimedia.org/T327982#9671608 (10Htriedman) @VirginiaPoundstone should this be considered under the same auspices as T289532? It may be worthwhile to consider wrapping this up as part of that other task just to limit one-off...