[14:02:19] (LogstashKafkaConsumerLag) firing: (2) Too many messages in logging-codfw for group logstash7-eqiad - https://wikitech.wikimedia.org/wiki/Logstash#Kafka_consumer_lag - https://alerts.wikimedia.org/?q=alertname%3DLogstashKafkaConsumerLag [14:12:19] (LogstashKafkaConsumerLag) firing: (2) Too many messages in logging-codfw for group logstash7-eqiad - https://wikitech.wikimedia.org/wiki/Logstash#Kafka_consumer_lag - https://alerts.wikimedia.org/?q=alertname%3DLogstashKafkaConsumerLag [14:17:19] (LogstashKafkaConsumerLag) resolved: (2) Too many messages in logging-codfw for group logstash7-eqiad - https://wikitech.wikimedia.org/wiki/Logstash#Kafka_consumer_lag - https://alerts.wikimedia.org/?q=alertname%3DLogstashKafkaConsumerLag [17:43:13] Warning: The directory '/srv/prometheus' contains 18399 entries, which exceeds the default soft limit 1000 and may cause excessive resource consumption and degraded performance. [17:43:28] added 2 more files :p [17:44:03] it says if we don't worry about performance we get set [17:44:07] max_files [21:57:14] Hi mutante, thanks for reporting that. :) [21:57:14] It's a known warning message, we're tracking it in T351643 [21:57:15] T351643: Warning re: excessive directory entries on prometheus with puppet7 - https://phabricator.wikimedia.org/T351643