[00:08:56] <jinxer-wm>	 FIRING: PrometheusSeriesCreationRateAnomalyHigh: Anomalous increase in series creation rate on ops (codfw) - https://wikitech.wikimedia.org/wiki/Prometheus#Runbooks - https://grafana.wikimedia.org/d/taff979/prometheus-tsdb-cardinality-monitoring?orgId=1&from=now-14d&to=now&timezone=utc&var-prometheus=ops&var-site=codfw - https://alerts.wikimedia.org/?q=alertname%3DPrometheusSeriesCreationRateAnomalyHigh
[01:39:56] <jinxer-wm>	 FIRING: [2x] PrometheusSeriesCountAnomalyHigh: Anomalous increase in number of active series on k8s (codfw) - https://wikitech.wikimedia.org/wiki/Prometheus#Runbooks  - https://alerts.wikimedia.org/?q=alertname%3DPrometheusSeriesCountAnomalyHigh
[04:08:56] <jinxer-wm>	 FIRING: PrometheusSeriesCreationRateAnomalyHigh: Anomalous increase in series creation rate on ops (codfw) - https://wikitech.wikimedia.org/wiki/Prometheus#Runbooks - https://grafana.wikimedia.org/d/taff979/prometheus-tsdb-cardinality-monitoring?orgId=1&from=now-14d&to=now&timezone=utc&var-prometheus=ops&var-site=codfw - https://alerts.wikimedia.org/?q=alertname%3DPrometheusSeriesCreationRateAnomalyHigh
[05:09:56] <jinxer-wm>	 FIRING: [2x] PrometheusSeriesCountAnomalyHigh: Anomalous increase in number of active series on k8s (codfw) - https://wikitech.wikimedia.org/wiki/Prometheus#Runbooks  - https://alerts.wikimedia.org/?q=alertname%3DPrometheusSeriesCountAnomalyHigh
[07:29:56] <jinxer-wm>	 RESOLVED: PrometheusSeriesCountAnomalyHigh: Anomalous increase in number of active series on k8s (eqiad) - https://wikitech.wikimedia.org/wiki/Prometheus#Runbooks - https://grafana.wikimedia.org/d/taff979/prometheus-tsdb-cardinality-monitoring?orgId=1&from=now-14d&to=now&timezone=utc&var-prometheus=k8s&var-site=eqiad - https://alerts.wikimedia.org/?q=alertname%3DPrometheusSeriesCountAnomalyHigh
[07:33:56] <jinxer-wm>	 RESOLVED: PrometheusSeriesCreationRateAnomalyHigh: Anomalous increase in series creation rate on ops (codfw) - https://wikitech.wikimedia.org/wiki/Prometheus#Runbooks - https://grafana.wikimedia.org/d/taff979/prometheus-tsdb-cardinality-monitoring?orgId=1&from=now-14d&to=now&timezone=utc&var-prometheus=ops&var-site=codfw - https://alerts.wikimedia.org/?q=alertname%3DPrometheusSeriesCreationRateAnomalyHigh
[22:04:48] <jinxer-wm>	 FIRING: PuppetFailure: Puppet has failed on logging-hd2005:9100 - https://puppetboard.wikimedia.org/nodes?status=failed - https://grafana.wikimedia.org/d/yOxVDGvWk/puppet - https://alerts.wikimedia.org/?q=alertname%3DPuppetFailure
[22:14:48] <jinxer-wm>	 RESOLVED: PuppetFailure: Puppet has failed on logging-hd2005:9100 - https://puppetboard.wikimedia.org/nodes?status=failed - https://grafana.wikimedia.org/d/yOxVDGvWk/puppet - https://alerts.wikimedia.org/?q=alertname%3DPuppetFailure