[00:29:57] @team, I reviewed the documents shared during Data Persistence team meeting. Let us use this existing document to add/modify/update the projects that we want to work on - https://docs.google.com/spreadsheets/d/1Jd40bTZhlZg5u16u5jiLKATZLzeWFaULMlE_e1KYuIo/edit?gid=0#gid=0 [00:34:03] FIRING: PuppetFailure: Puppet has failed on ms-be2068:9100 - https://puppetboard.wikimedia.org/nodes?status=failed - https://grafana.wikimedia.org/d/yOxVDGvWk/puppet - https://alerts.wikimedia.org/?q=alertname%3DPuppetFailure [04:34:03] FIRING: PuppetFailure: Puppet has failed on ms-be2068:9100 - https://puppetboard.wikimedia.org/nodes?status=failed - https://grafana.wikimedia.org/d/yOxVDGvWk/puppet - https://alerts.wikimedia.org/?q=alertname%3DPuppetFailure [08:34:04] FIRING: PuppetFailure: Puppet has failed on ms-be2068:9100 - https://puppetboard.wikimedia.org/nodes?status=failed - https://grafana.wikimedia.org/d/yOxVDGvWk/puppet - https://alerts.wikimedia.org/?q=alertname%3DPuppetFailure [09:30:01] there's an alert for "Certificate for service data-gateway-staging:30443 is about to expire: The certificate presented by service data-gateway-staging:30443 is going to expire in 8h 8m 32s", known? [09:47:26] pc2018.codfw.wmnet is listed on zarcillo but not in https://phabricator.wikimedia.org/T395241 - do we know why? [10:25:34] I do see pc2018 there? [11:11:55] sorry, an off by one bug in my script :D [11:17:51] lol classic [11:27:42] https://gerrit.wikimedia.org/r/c/operations/puppet/+/1187773 [12:34:04] FIRING: PuppetFailure: Puppet has failed on ms-be2068:9100 - https://puppetboard.wikimedia.org/nodes?status=failed - https://grafana.wikimedia.org/d/yOxVDGvWk/puppet - https://alerts.wikimedia.org/?q=alertname%3DPuppetFailure [12:59:46] have a nice weekend [13:38:24] I thought you were going to say it was an off by one bug in your eyes [13:38:35] :D [13:55:33] In the weekly report of this week (essential work doc) unfortunately I don't think I captured everything since I usually just click on my profile in phabricator and go through things I've done but this week it has been so much that the profile goes back to only Tuesday so I'm missing stuff done on Monday and parts of Tuesday [13:57:03] Amir1: https://phabricator.wikimedia.org/feed/query/uHb90J4PZtb9/#R [13:57:26] ah TIL [13:59:59] thanks. added two more [16:34:04] FIRING: PuppetFailure: Puppet has failed on ms-be2068:9100 - https://puppetboard.wikimedia.org/nodes?status=failed - https://grafana.wikimedia.org/d/yOxVDGvWk/puppet - https://alerts.wikimedia.org/?q=alertname%3DPuppetFailure [20:34:04] FIRING: PuppetFailure: Puppet has failed on ms-be2068:9100 - https://puppetboard.wikimedia.org/nodes?status=failed - https://grafana.wikimedia.org/d/yOxVDGvWk/puppet - https://alerts.wikimedia.org/?q=alertname%3DPuppetFailure