[03:11:41] <jinxer-wm>	 FIRING: NetboxAccounting: Netbox - Accounting job failed - https://wikitech.wikimedia.org/wiki/Netbox#Report_Alert - https://netbox.wikimedia.org/core/jobs/ - https://alerts.wikimedia.org/?q=alertname%3DNetboxAccounting
[04:11:41] <jinxer-wm>	 RESOLVED: NetboxAccounting: Netbox - Accounting job failed - https://wikitech.wikimedia.org/wiki/Netbox#Report_Alert - https://netbox.wikimedia.org/core/jobs/ - https://alerts.wikimedia.org/?q=alertname%3DNetboxAccounting
[10:42:25] <jinxer-wm>	 FIRING: SystemdUnitFailed: update-ubuntu-mirror.service on mirror1001:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed
[11:08:25] <wikibugs>	 10netops, 06Infrastructure-Foundations, 06SRE, 13Patch-For-Review: Servers exposing incorrect LLDP info - https://phabricator.wikimedia.org/T250367#11480693 (10elukey) Random thoughts after reading:  * Is sretest2003 the only one that shows this behavior, or do we have others? I am particularly interested...
[14:42:40] <jinxer-wm>	 FIRING: SystemdUnitFailed: update-ubuntu-mirror.service on mirror1001:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed
[16:42:25] <jinxer-wm>	 RESOLVED: SystemdUnitFailed: update-ubuntu-mirror.service on mirror1001:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed
[18:01:18] <wikibugs>	 10netops, 06FR-donorrelations, 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, and 2 others: Routing issue from payments hosts to 62.146.255.205 - https://phabricator.wikimedia.org/T413382 (10Dwisehaupt) 03NEW
[20:50:59] <wikibugs>	 10netops, 06FR-donorrelations, 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, and 3 others: Routing issue from payments hosts to 62.146.255.205 - https://phabricator.wikimedia.org/T413382#11482128 (10AKanji-WMF)
[20:52:16] <wikibugs>	 10netops, 06FR-donorrelations, 06Fundraising-Backlog, 10fundraising-tech-ops, and 2 others: Routing issue from payments hosts to 62.146.255.205 - https://phabricator.wikimedia.org/T413382#11482157 (10XenoRyet)
[20:52:26] <wikibugs>	 10netops, 06FR-donorrelations, 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, and 3 others: Routing issue from payments hosts to 62.146.255.205 - https://phabricator.wikimedia.org/T413382#11482161 (10AKanji-WMF)
[20:53:14] <wikibugs>	 10netops, 06FR-donorrelations, 06Fundraising-Backlog, 10fundraising-tech-ops, and 2 others: Routing issue from payments hosts to 62.146.255.205 - https://phabricator.wikimedia.org/T413382#11482240 (10XenoRyet)
[21:35:25] <jinxer-wm>	 FIRING: SystemdUnitFailed: dump_proxy_ranges.service on puppetserver1001:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed
[21:37:09] <cdanis>	 my fault, fixing :)
[21:40:25] <jinxer-wm>	 RESOLVED: SystemdUnitFailed: dump_proxy_ranges.service on puppetserver1001:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed
[21:43:25] <jinxer-wm>	 FIRING: SystemdUnitFailed: dump_proxy_ranges.service on puppetserver1001:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed
[21:53:25] <jinxer-wm>	 RESOLVED: SystemdUnitFailed: dump_proxy_ranges.service on puppetserver1001:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed
[22:11:47] <wikibugs>	 10netops, 06FR-donorrelations, 06Fundraising-Backlog, 10fundraising-tech-ops, and 2 others: Routing issue from payments hosts to 62.146.255.205 - https://phabricator.wikimedia.org/T413382#11482465 (10Dwisehaupt) For reference, we don't see this routing loop when checking from civi1002:  ` $ sudo traceroute...