[05:39:25] 10serviceops, 10SRE, 10Znuny, 10Sustainability (Incident Followup): enhance Znuny (otrs) alerting - https://phabricator.wikimedia.org/T303190 (10Peachey88) [17:22:49] 10serviceops, 10Infrastructure-Foundations, 10SRE: Cert renewal for {appserver,api}.svc.{eqiad,codfw}.wmnet - https://phabricator.wikimedia.org/T304237 (10RLazarus) p:05Triage→03High [17:26:10] 10serviceops, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review: Cert renewal for {appserver,api}.svc.{eqiad,codfw}.wmnet - https://phabricator.wikimedia.org/T304237 (10RLazarus) [17:39:34] 10serviceops, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review: Cert renewal for {appserver,api}.svc.{eqiad,codfw}.wmnet - https://phabricator.wikimedia.org/T304237 (10Volans) As for: > Evaluate whether there's a better monitoring strategy for future expiries than paging on Sunday :) I totally agr... [17:58:16] 10serviceops, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review: Cert renewal for {appserver,api}.svc.{eqiad,codfw}.wmnet - https://phabricator.wikimedia.org/T304237 (10Volans) As for: > Identify whether there are any more about to expire, for which we weren't alerted I've done a quick check and se... [18:23:23] 10serviceops, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review: Cert renewal for {appserver,api}.svc.{eqiad,codfw}.wmnet - https://phabricator.wikimedia.org/T304237 (10Volans) As for: > We didn't get a matching page, but the cert for api.svc.[site].wmnet will also expire Monday, 2022-03-28 14:39:16... [18:37:51] 10serviceops, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review: Cert renewal for {appserver,api}.svc.{eqiad,codfw}.wmnet - https://phabricator.wikimedia.org/T304237 (10Volans) And now both checks for api are in warning, as they should be, added item to the task description. [18:42:16] 10serviceops, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review: Cert renewal for {appserver,api}.svc.{eqiad,codfw}.wmnet - https://phabricator.wikimedia.org/T304237 (10Volans) [18:42:39] 10serviceops, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review: Cert renewal for {appserver,api}.svc.{eqiad,codfw}.wmnet - https://phabricator.wikimedia.org/T304237 (10Volans)