[00:07:21] <jinxer-wm>	 FIRING: MediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag: ...
[00:07:21] <jinxer-wm>	 High Kafka consumer lag for mw_content_history_reconcile_enrich in eqiad - TODO - https://grafana.wikimedia.org/d/K9x0c4aVk/flink-app?orgId=1&var-datasource=eqiad%20prometheus/k8s-dse&var-namespace=mw-content-history-reconcile-enrich&var-helm_release=production&var-operator_name=All&var-flink_job_name=mw_content_history_reconcile_enrich - https://alerts.wikimedia.org/?q=alertname%3DMediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag
[04:07:21] <jinxer-wm>	 FIRING: MediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag: ...
[04:07:21] <jinxer-wm>	 High Kafka consumer lag for mw_content_history_reconcile_enrich in eqiad - TODO - https://grafana.wikimedia.org/d/K9x0c4aVk/flink-app?orgId=1&var-datasource=eqiad%20prometheus/k8s-dse&var-namespace=mw-content-history-reconcile-enrich&var-helm_release=production&var-operator_name=All&var-flink_job_name=mw_content_history_reconcile_enrich - https://alerts.wikimedia.org/?q=alertname%3DMediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag
[08:07:21] <jinxer-wm>	 FIRING: MediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag: ...
[08:07:21] <jinxer-wm>	 High Kafka consumer lag for mw_content_history_reconcile_enrich in eqiad - TODO - https://grafana.wikimedia.org/d/K9x0c4aVk/flink-app?orgId=1&var-datasource=eqiad%20prometheus/k8s-dse&var-namespace=mw-content-history-reconcile-enrich&var-helm_release=production&var-operator_name=All&var-flink_job_name=mw_content_history_reconcile_enrich - https://alerts.wikimedia.org/?q=alertname%3DMediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag
[11:32:06] <jinxer-wm>	 RESOLVED: MediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag: ...
[11:32:06] <jinxer-wm>	 High Kafka consumer lag for mw_content_history_reconcile_enrich in eqiad - TODO - https://grafana.wikimedia.org/d/K9x0c4aVk/flink-app?orgId=1&var-datasource=eqiad%20prometheus/k8s-dse&var-namespace=mw-content-history-reconcile-enrich&var-helm_release=production&var-operator_name=All&var-flink_job_name=mw_content_history_reconcile_enrich - https://alerts.wikimedia.org/?q=alertname%3DMediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag
[11:41:32] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 06Infrastructure-Foundations, 10netops: Handle `network_flows_internal` data growth - https://phabricator.wikimedia.org/T412443#11456727 (10JAllemandou) That's right, the failue is due to OOM at Druid ingestion job. But it's better for us not inges...
[15:53:33] <wikibugs>	 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 06Infrastructure-Foundations, 10netops: Handle `network_flows_internal` data growth - https://phabricator.wikimedia.org/T412443#11457084 (10cmooney) >>! In T412443#11456727, @JAllemandou wrote: > That's right, the failue is due to OOM at Druid inge...