[02:09:24] FIRING: SystemdUnitFailed: generate_os_reports.service on puppetdb2003:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed [06:09:24] FIRING: SystemdUnitFailed: generate_os_reports.service on puppetdb2003:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed [07:29:54] 10Mail, 06Infrastructure-Foundations, 06Trust-and-Safety: Mail from Bishzilla to emergency@wikimedia.org is possibly getting lost - https://phabricator.wikimedia.org/T338032#10060491 (10Nahid) Hey, let me investigate and get back. [09:30:27] 10netbox, 06Infrastructure-Foundations, 13Patch-For-Review: pynetbox incompatibility with Netbox >= 4.0.6 - https://phabricator.wikimedia.org/T371890#10060883 (10ayounsi) With the patches above, the last urgent-ish thing needed is to package the new pynetbox for the cumin hosts (bullseye) [10:09:24] FIRING: SystemdUnitFailed: generate_os_reports.service on puppetdb2003:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed [12:19:24] FIRING: [2x] SystemdUnitFailed: generate_vrts_aliases.service on mx-in1001:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed [12:53:39] 10netops, 06cloud-services-team, 10Cloud-VPS, 06Infrastructure-Foundations, and 2 others: Upgrade cloudsw1-c8-eqiad and cloudsw1-d5-eqiad to Junos 20+ - https://phabricator.wikimedia.org/T316544#10061502 (10cmooney) [12:58:08] 10SRE-tools, 06Infrastructure-Foundations: Allow debmonitor to store the Debian version-id in the OS field - https://phabricator.wikimedia.org/T368744#10061531 (10elukey) 05Open→03Resolved [13:19:24] FIRING: [2x] SystemdUnitFailed: generate_vrts_aliases.service on mx-in1001:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed [15:34:47] very frustrating.. I am trying to use https://www.supermicro.com/support/faqs/faq.cfm?faq=33898 with sretest2001 [15:34:55] and redfish tells me that the property is ready-only [15:34:57] * elukey flips table [15:44:46] 10SRE-tools, 06DC-Ops, 06Infrastructure-Foundations, 10Spicerack, 13Patch-For-Review: Spicerack: expand Supermicro support in the Redfish module - https://phabricator.wikimedia.org/T365372#10062169 (10elukey) Encountered an issue with the BMC's network config: ` supermicro_mgmt_network_changes = { "... [15:46:22] elukey: is it possible that your redfish user doesn't have the appropriate roles [15:46:37] * jhathaway admits he knows very little about using the redfish api [15:47:40] jhathaway: in theory no, I am logged in as ADMIN :( [15:49:41] hmm, and if you curl /redfish/v1/AccountService/Roles do you have all the roles? [15:52:12] yep yep I have [15:52:32] I would get another error if I was unprivileged I think [15:52:58] nod [15:53:54] maybe I got what's happening.. it is not documented, but there are also StaticIpv4Addresses options [15:54:12] they have probably changed the specs [15:54:15] without... examples [15:54:22] and I don't find any schema [15:54:28] (in their website) [15:54:30] "perfect" [15:54:31] * elukey cries in a corner [15:58:53] with static works [16:00:30] jhathaway: thanks for the brainbounce! [16:00:46] of course [17:19:24] FIRING: SystemdUnitFailed: generate_os_reports.service on puppetdb2003:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed [21:19:24] FIRING: SystemdUnitFailed: generate_os_reports.service on puppetdb2003:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed