[01:20:15] <jinxer-wm>	 FIRING: HdfsCapacityRemainingPercent: Alarmingly low free space on the analytics-hadoop HDFS cluster. - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Hadoop/Alerts#HDFS_Capacity_Remaining - https://grafana.wikimedia.org/d/000000585/hadoop?var-hadoop_cluster=analytics-hadoop&orgId=1&panelId=106&fullscreen - https://alerts.wikimedia.org/?q=alertname%3DHdfsCapacityRemainingPercent
[05:20:15] <jinxer-wm>	 FIRING: HdfsCapacityRemainingPercent: Alarmingly low free space on the analytics-hadoop HDFS cluster. - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Hadoop/Alerts#HDFS_Capacity_Remaining - https://grafana.wikimedia.org/d/000000585/hadoop?var-hadoop_cluster=analytics-hadoop&orgId=1&panelId=106&fullscreen - https://alerts.wikimedia.org/?q=alertname%3DHdfsCapacityRemainingPercent
[06:05:15] <jinxer-wm>	 RESOLVED: HdfsCapacityRemainingPercent: Alarmingly low free space on the analytics-hadoop HDFS cluster. - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Hadoop/Alerts#HDFS_Capacity_Remaining - https://grafana.wikimedia.org/d/000000585/hadoop?var-hadoop_cluster=analytics-hadoop&orgId=1&panelId=106&fullscreen - https://alerts.wikimedia.org/?q=alertname%3DHdfsCapacityRemainingPercent
[08:27:00] <wikibugs>	 (03CR) 10DCausse: Remove dead code, doc and artifacts (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1092879 (owner: 10Joal)
[08:47:15] <wikibugs>	 06Data-Engineering, 10CirrusSearch, 06Discovery-Search: Move oozie/util/swift/upload/ out of the refinery oozie folder - https://phabricator.wikimedia.org/T380343 (10dcausse) 03NEW
[08:47:43] <wikibugs>	 (03CR) 10DCausse: Remove dead code, doc and artifacts (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1092879 (owner: 10Joal)
[09:42:49] <wikibugs>	 (03CR) 10Aqu: "artifacts/org/wikimedia/analytics/refinery/refinery-core-0.2.49.2.jar" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1092879 (owner: 10Joal)
[10:41:58] <wikibugs>	 06Data-Engineering, 10Data-Platform-SRE (2024.11.09 - 2024.11.29): Draft a project plan for the Hadoop version 3 upgrade - https://phabricator.wikimedia.org/T379748#10339389 (10BTullis) This task may be a useful reference. It was an investigation of what we considered to be unrecoverable and requiring a backup...
[10:42:28] <wikibugs>	 10Data-Engineering (Q2 2024 October 1st - December 31th), 13Patch-For-Review: [Refine Refactoring] Refine jobs should be scheduled by Airflow: deployment - https://phabricator.wikimedia.org/T369845#10339394 (10Antoine_Quhen) Since the last fixes were deployed on 11/14, the DAG remained unpaused and operated co...
[16:19:17] <wikibugs>	 (03CR) 10Joal: Remove dead code, doc and artifacts (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1092879 (owner: 10Joal)
[16:21:46] <wikibugs>	 (03CR) 10Joal: "I have kept the `0.2.49.2-shaded` version. I think that's the one used by the job." [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1092879 (owner: 10Joal)
[16:46:30] <wikibugs>	 06Data-Engineering, 10CirrusSearch, 10Structured Data Engineering, 06Structured-Data-Backlog, and 2 others: Migrate image recommendation to use page_weighted_tags_changed stream - https://phabricator.wikimedia.org/T372912#10340891 (10mfossati) >>! In T372912#10336830, @dcausse wrote: > in the worst case sc...
[17:12:32] <joal>	 !log Deploying refinery with scap for gobblin release (2nd round)
[17:12:34] <stashbot>	 Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log
[17:21:28] <wikibugs>	 06Data-Engineering, 10Data Pipelines, 06Product-Analytics, 06Research: Update HDFS links tables as Mediawiki changes - https://phabricator.wikimedia.org/T304979#10341043 (10JAllemandou) 05Open→03Resolved
[17:24:50] <wikibugs>	 (03PS1) 10Btullis: Update Spark to version 3.5.3 [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1093393 (https://phabricator.wikimedia.org/T338057)
[17:26:58] <wikibugs>	 10Data-Engineering (Q2 2024 October 1st - December 31th), 06DBA, 07Schema-change-in-production: Drop deprecated abuse filter fields on wmf wikis - https://phabricator.wikimedia.org/T367781#10341055 (10bvibber) @ABran-WMF It really ought to have finished by now. ;) Go ahead and kill it, it's idempotent and I...
[17:29:13] <wikibugs>	 (03CR) 10CI reject: [V:04-1] Update Spark to version 3.5.3 [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1093393 (https://phabricator.wikimedia.org/T338057) (owner: 10Btullis)
[17:45:33] <joal>	 !log Deployed refinery on HDFS
[17:45:35] <stashbot>	 Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log
[20:31:15] <jinxer-wm>	 FIRING: HdfsCapacityRemainingPercent: Alarmingly low free space on the analytics-hadoop HDFS cluster. - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Hadoop/Alerts#HDFS_Capacity_Remaining - https://grafana.wikimedia.org/d/000000585/hadoop?var-hadoop_cluster=analytics-hadoop&orgId=1&panelId=106&fullscreen - https://alerts.wikimedia.org/?q=alertname%3DHdfsCapacityRemainingPercent
[20:36:15] <jinxer-wm>	 RESOLVED: HdfsCapacityRemainingPercent: Alarmingly low free space on the analytics-hadoop HDFS cluster. - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Hadoop/Alerts#HDFS_Capacity_Remaining - https://grafana.wikimedia.org/d/000000585/hadoop?var-hadoop_cluster=analytics-hadoop&orgId=1&panelId=106&fullscreen - https://alerts.wikimedia.org/?q=alertname%3DHdfsCapacityRemainingPercent
[20:40:08] <wikibugs>	 10Data-Engineering (Q2 2024 October 1st - December 31th), 10Dumps 2.0, 10Data-Platform-SRE (2024.11.09 - 2024.11.29): Test if an existing conda environment with Spark 3.1.2 clients works fine with Spark 3.5.3 - https://phabricator.wikimedia.org/T380417 (10xcollazo) 03NEW
[20:41:15] <jinxer-wm>	 FIRING: HdfsCapacityRemainingPercent: Alarmingly low free space on the analytics-hadoop HDFS cluster. - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Hadoop/Alerts#HDFS_Capacity_Remaining - https://grafana.wikimedia.org/d/000000585/hadoop?var-hadoop_cluster=analytics-hadoop&orgId=1&panelId=106&fullscreen - https://alerts.wikimedia.org/?q=alertname%3DHdfsCapacityRemainingPercent
[21:11:15] <jinxer-wm>	 RESOLVED: HdfsCapacityRemainingPercent: Alarmingly low free space on the analytics-hadoop HDFS cluster. - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Hadoop/Alerts#HDFS_Capacity_Remaining - https://grafana.wikimedia.org/d/000000585/hadoop?var-hadoop_cluster=analytics-hadoop&orgId=1&panelId=106&fullscreen - https://alerts.wikimedia.org/?q=alertname%3DHdfsCapacityRemainingPercent
[21:17:40] <wikibugs>	 10Data-Engineering (Q2 2024 October 1st - December 31th), 10Dumps 2.0, 10Data-Platform-SRE (2024.11.09 - 2024.11.29): Test if an existing conda environment with Spark 3.1.2 clients works fine with Spark 3.5.3 - https://phabricator.wikimedia.org/T380417#10342024 (10xcollazo)   Create new conda environment wit...
[21:25:58] <wikibugs>	 10Data-Engineering (Q2 2024 October 1st - December 31th), 10Dumps 2.0, 10Data-Platform-SRE (2024.11.09 - 2024.11.29): Test if an existing conda environment with Spark 3.1.2 clients works fine with Spark 3.5.3 - https://phabricator.wikimedia.org/T380417#10342041 (10xcollazo) Over at conda-analytics, I don't s...