[01:42:40] <jinxer-wm>	 FIRING: SystemdUnitFailed: generate_vrts_aliases.service on mx-in2001:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed
[05:42:40] <jinxer-wm>	 FIRING: SystemdUnitFailed: generate_vrts_aliases.service on mx-in2001:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed
[05:56:26] <wikibugs>	 10Mail, 06Infrastructure-Foundations: Flapping SystemdUnitFailed: generate_vrts_aliases.service on mx-in2001 - https://phabricator.wikimedia.org/T433810 (10ayounsi) 03NEW
[09:42:25] <jinxer-wm>	 RESOLVED: SystemdUnitFailed: generate_vrts_aliases.service on mx-in2001:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed
[09:45:25] <jinxer-wm>	 FIRING: SystemdUnitFailed: generate_vrts_aliases.service on mx-in2001:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed
[12:44:40] <wikibugs>	 10SRE-tools, 06Infrastructure-Foundations, 10Spicerack: Clarify when spicerack/cumin is going to retry - https://phabricator.wikimedia.org/T433698#12178581 (10Mahveotm) Hi @fgiunchedi, I’d like to work on this. I'm propose retaining the delay while also adding a timezone-aware UTC retry timestamp, for exampl...
[13:09:15] <wikibugs>	 10SRE-tools, 06Infrastructure-Foundations, 10Spicerack, 13Patch-For-Review: Clarify when spicerack/cumin is going to retry - https://phabricator.wikimedia.org/T433698#12178692 (10Mahveotm) 05Open→03In progress
[13:45:25] <jinxer-wm>	 FIRING: SystemdUnitFailed: generate_vrts_aliases.service on mx-in2001:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed
[14:28:44] <wikibugs>	 10Mail, 06Infrastructure-Foundations: Flapping SystemdUnitFailed: generate_vrts_aliases.service on mx-in2001 - https://phabricator.wikimedia.org/T433810#12179006 (10LSobanski) a:03jhathaway
[14:28:51] <wikibugs>	 10Mail, 06Infrastructure-Foundations: Flapping SystemdUnitFailed: generate_vrts_aliases.service on mx-in2001 - https://phabricator.wikimedia.org/T433810#12179007 (10LSobanski) p:05Triage→03Medium
[17:45:40] <jinxer-wm>	 FIRING: SystemdUnitFailed: generate_vrts_aliases.service on mx-in2001:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed
[18:33:31] <wikibugs>	 10Mail, 06Infrastructure-Foundations: Flapping SystemdUnitFailed: generate_vrts_aliases.service on mx-in2001 - https://phabricator.wikimedia.org/T433810#12180333 (10jhathaway) 05Open→03Resolved the edits were correct, so I re-ran with the force flag.
[18:35:25] <jinxer-wm>	 RESOLVED: SystemdUnitFailed: generate_vrts_aliases.service on mx-in2001:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed
[19:24:50] <wikibugs>	 10netops, 06Infrastructure-Foundations, 10Prod-Kubernetes, 06ServiceOps: changeprop-jobqueue in codfw rows E & F has no IPv6 connectivity to kafka-main - https://phabricator.wikimedia.org/T433881 (10RLazarus) 03NEW
[19:39:59] <wikibugs>	 10netops, 06Infrastructure-Foundations, 10Prod-Kubernetes, 06ServiceOps, 13Patch-For-Review: changeprop-jobqueue in codfw rows E & F has no IPv6 connectivity to kafka-main - https://phabricator.wikimedia.org/T433881#12180507 (10Scott_French) This is an interesting one.  Pod `changeprop-production-6fbff89...
[20:39:50] <wikibugs>	 10netops, 06Infrastructure-Foundations, 10Prod-Kubernetes, 06ServiceOps, 13Patch-For-Review: changeprop-jobqueue in codfw rows E & F has no IPv6 connectivity to kafka-main - https://phabricator.wikimedia.org/T433881#12180782 (10RLazarus)