[09:20:23] 06Data-Engineering, 06SRE, 10ops-eqiad: Degraded RAID on dumpsdata1007 - https://phabricator.wikimedia.org/T359702#9622742 (10Jclark-ctr) Ticket canceled by dell SR186677718 with no reason 14 hours after creating request. Resubmitted ticket request SR186760900. [12:09:53] (HdfsDataNodeHeapUsage) firing: Datanode heap usage on an-worker1158:51010 is above 90%. - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Hadoop/Alerts#HDFS_Datanode_JVM_Heap_Usage - https://grafana.wikimedia.org/d/000000585/hadoop?var-hadoop_cluster=analytics-hadoop&panelId=1&fullscreen&orgId=1 - https://alerts.wikimedia.org/?q=alertname%3DHdfsDataNodeHeapUsage [12:19:53] (HdfsDataNodeHeapUsage) resolved: Datanode heap usage on an-worker1158:51010 is above 90%. - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Hadoop/Alerts#HDFS_Datanode_JVM_Heap_Usage - https://grafana.wikimedia.org/d/000000585/hadoop?var-hadoop_cluster=analytics-hadoop&panelId=1&fullscreen&orgId=1 - https://alerts.wikimedia.org/?q=alertname%3DHdfsDataNodeHeapUsage [14:07:53] (HdfsDataNodeHeapUsage) firing: Datanode heap usage on an-worker1158:51010 is above 90%. - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Hadoop/Alerts#HDFS_Datanode_JVM_Heap_Usage - https://grafana.wikimedia.org/d/000000585/hadoop?var-hadoop_cluster=analytics-hadoop&panelId=1&fullscreen&orgId=1 - https://alerts.wikimedia.org/?q=alertname%3DHdfsDataNodeHeapUsage [14:12:53] (HdfsDataNodeHeapUsage) resolved: Datanode heap usage on an-worker1158:51010 is above 90%. - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Hadoop/Alerts#HDFS_Datanode_JVM_Heap_Usage - https://grafana.wikimedia.org/d/000000585/hadoop?var-hadoop_cluster=analytics-hadoop&panelId=1&fullscreen&orgId=1 - https://alerts.wikimedia.org/?q=alertname%3DHdfsDataNodeHeapUsage [14:38:56] 06Data-Engineering, 10Data Pipelines, 06SRE, 06Traffic-Icebox: Mobile redirects drop provenance parameters - https://phabricator.wikimedia.org/T252227#9623717 (10mpopov) +1 to Isaac's proposed solution of carrying `wprov` forward as `wprov` but also setting `rprov=1` in case of a redirect to simplify analy...