[06:43:25] <jinxer-wm>	 FIRING: SystemdUnitFailed: sync-icinga-state.service on alert2002:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed
[07:04:35] <tappof>	 ^^ looking
[07:08:25] <jinxer-wm>	 RESOLVED: SystemdUnitFailed: sync-icinga-state.service on alert2002:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed
[17:30:40] <jinxer-wm>	 FIRING: [4x] LogstashKafkaConsumerLag: Too many messages in logging-eqiad for group logstash7-codfw - https://wikitech.wikimedia.org/wiki/Logstash#Kafka_consumer_lag  - https://alerts.wikimedia.org/?q=alertname%3DLogstashKafkaConsumerLag
[18:00:40] <jinxer-wm>	 FIRING: [4x] LogstashKafkaConsumerLag: Too many messages in logging-eqiad for group logstash7-codfw - https://wikitech.wikimedia.org/wiki/Logstash#Kafka_consumer_lag  - https://alerts.wikimedia.org/?q=alertname%3DLogstashKafkaConsumerLag
[19:20:40] <jinxer-wm>	 RESOLVED: [2x] LogstashKafkaConsumerLag: Too many messages in logging-eqiad for group logstash7-codfw - https://wikitech.wikimedia.org/wiki/Logstash#Kafka_consumer_lag  - https://alerts.wikimedia.org/?q=alertname%3DLogstashKafkaConsumerLag
[19:24:47] <dancy>	 Hello observability folks!  I noticed that beta's mediawiki logs have not been available at https://beta-logs.wmcloud.org/ since June 24 and I'm wondering if you can investigate things in the `logging` project side.  
[19:43:50] * cwhite 👀
[19:58:48] <denisse>	 Hi @dancy , do you happen to have task to track it?? 
[19:59:32] <dancy>	 I have not filed a task but I can do so now
[20:01:05] <dancy>	 https://phabricator.wikimedia.org/T430739
[21:20:10] <cwhite>	 dancy: should be resolved now
[21:36:11] <dancy>	 Thanks!