[08:36:58] 10SRE-tools, 10Infrastructure-Foundations, 10Puppet-Core, 10SRE, 10Puppet (Puppet 7.0): Migrate roles to puppet7 - https://phabricator.wikimedia.org/T349619 (10MoritzMuehlenhoff) [09:15:24] 10SRE-tools, 10Infrastructure-Foundations, 10Puppet-Core, 10SRE, and 2 others: Migrate roles to puppet7 - https://phabricator.wikimedia.org/T349619 (10MoritzMuehlenhoff) [09:37:30] 10netbox, 10DC-Ops, 10Infrastructure-Foundations, 10Observability-Alerting, and 2 others: validate what we need from the check_eth check - https://phabricator.wikimedia.org/T333007 (10SLyngshede-WMF) [09:39:15] 10SRE-tools, 10Infrastructure-Foundations, 10Puppet-Core, 10SRE, and 2 others: Migrate roles to puppet7 - https://phabricator.wikimedia.org/T349619 (10MoritzMuehlenhoff) [09:46:24] 10SRE-tools, 10Infrastructure-Foundations, 10Puppet-Core, 10SRE, and 2 others: Migrate roles to puppet7 - https://phabricator.wikimedia.org/T349619 (10MoritzMuehlenhoff) [11:28:05] 10SRE-tools, 10Infrastructure-Foundations, 10Puppet-Core, 10SRE, and 2 others: Migrate roles to puppet7 - https://phabricator.wikimedia.org/T349619 (10MoritzMuehlenhoff) [11:44:23] (SystemdUnitFailed) firing: export_smart_data_dump.service Failed on ganeti2010:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed [11:46:11] 10SRE-tools, 10Infrastructure-Foundations, 10Puppet-Core, 10SRE, and 2 others: Migrate roles to puppet7 - https://phabricator.wikimedia.org/T349619 (10jbond) [12:19:58] 10SRE-tools, 10Infrastructure-Foundations, 10Puppet-Core, 10SRE, and 2 others: Migrate roles to puppet7 - https://phabricator.wikimedia.org/T349619 (10MoritzMuehlenhoff) [12:35:01] 10SRE-tools, 10Infrastructure-Foundations, 10Puppet-Core, 10SRE, 10Puppet (Puppet 7.0): Migrate roles to puppet7 - https://phabricator.wikimedia.org/T349619 (10MoritzMuehlenhoff) [12:35:24] 10netops, 10Infrastructure-Foundations, 10SRE: Netbox PuppetDB Import Script Failing for cloudnet1006 - https://phabricator.wikimedia.org/T350479 (10cmooney) [12:44:23] (SystemdUnitFailed) resolved: export_smart_data_dump.service Failed on ganeti2010:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed [13:51:01] 10SRE-tools, 10Infrastructure-Foundations, 10Puppet-Core, 10SRE, and 2 others: Migrate roles to puppet7 - https://phabricator.wikimedia.org/T349619 (10Gehel) For Search Platform, the best servers to experiment with (lowest risk) are: * relforge*: used for testing relevancy, no user traffic, very limited i... [13:53:57] 10SRE-tools, 10Infrastructure-Foundations, 10Puppet-Core, 10SRE, and 2 others: Migrate roles to puppet7 - https://phabricator.wikimedia.org/T349619 (10MoritzMuehlenhoff) [13:54:48] 10netops, 10Infrastructure-Foundations: cr2-eqiad xe-3/2/2 has errors for the past ~week - https://phabricator.wikimedia.org/T350869 (10BBlack) [13:59:42] 10netops, 10Infrastructure-Foundations: cr2-eqiad xe-3/2/2 has errors for the past ~week - https://phabricator.wikimedia.org/T350869 (10ayounsi) 05Open→03Declined Following up on T342502#9319222 Not ideal, but that should work out :) [14:11:28] slyngs volans re: https://phabricator.wikimedia.org/T350694 would you be available next week for a quick brainstorm chat re: some of the checks ? [14:11:57] Yes :-) [14:12:10] godog: sure, have you seen my comment? ( https://phabricator.wikimedia.org/T350694#9316590 ) [14:13:02] I have yeah [14:13:04] I don't see how that can be migrated at the moment, unless I'm missing some new magic in o11y-land [14:13:44] part of the reason why we should have an higher bandwidth chat about it [14:14:12] :D [14:14:24] need to step afk briefly, will send an invite later [14:15:42] ack, thx [14:19:34] 10SRE-tools, 10Infrastructure-Foundations, 10Puppet-Core, 10SRE, and 2 others: Migrate roles to puppet7 - https://phabricator.wikimedia.org/T349619 (10MoritzMuehlenhoff) [14:32:06] {{done}} [14:39:44] 10SRE-tools, 10Infrastructure-Foundations, 10Puppet-Core, 10SRE, and 2 others: Migrate roles to puppet7 - https://phabricator.wikimedia.org/T349619 (10MoritzMuehlenhoff) >>! In T349619#9319228, @Gehel wrote: > For Search Platform, the best servers to experiment with (lowest risk) are: > > * relforge*: use... [14:44:10] 10netops, 10Data-Platform-SRE, 10Infrastructure-Foundations, 10Product-Analytics, and 2 others: Maybe restrict domains accessible by webproxy - https://phabricator.wikimedia.org/T300977 (10ayounsi) [14:52:32] 10SRE-tools, 10Infrastructure-Foundations, 10Puppet-Core, 10SRE, and 2 others: Migrate roles to puppet7 - https://phabricator.wikimedia.org/T349619 (10MoritzMuehlenhoff) [14:53:57] (SystemdUnitFailed) firing: export_smart_data_dump.service Failed on ganeti2031:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed [15:01:29] 10netops, 10Infrastructure-Foundations, 10SRE: Netbox PuppetDB Import Script Failing for cloudnet1006 - https://phabricator.wikimedia.org/T350479 (10cmooney) 05Open→03Resolved >>! In T350479#9312405, @Volans wrote: > The code is not checking if he autoselection of the parent is None or not. Indeed. Why... [15:05:01] 10netops, 10Infrastructure-Foundations, 10SRE: Netbox PuppetDB Import Script Failing for cloudnet1006 - https://phabricator.wikimedia.org/T350479 (10cmooney) 05Resolved→03Open [15:08:50] 10netops, 10Infrastructure-Foundations, 10SRE: Netbox PuppetDB Import Script Failing for cloudnet1006 - https://phabricator.wikimedia.org/T350479 (10Volans) >>! In T350479#9319519, @cmooney wrote: > For now I'll update //customscripts/_common.py// so that it fails cleanly if this should occur. Not sure what... [15:53:57] (SystemdUnitFailed) resolved: export_smart_data_dump.service Failed on ganeti2031:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed [17:28:44] 10SRE-tools, 10Infrastructure-Foundations, 10Puppet-Core, 10SRE, and 2 others: Migrate roles to puppet7 - https://phabricator.wikimedia.org/T349619 (10jbond) [17:49:32] 10Puppet, 10iPoid-Service: Rename FEED_API_KEY - https://phabricator.wikimedia.org/T350903 (10kostajh) [18:00:24] 10SRE-tools, 10Infrastructure-Foundations, 10Puppet-Core, 10SRE, and 2 others: Migrate roles to puppet7 - https://phabricator.wikimedia.org/T349619 (10jbond) [22:58:29] 10CAS-SSO, 10Infrastructure-Foundations: Create OpenID Connect client - https://phabricator.wikimedia.org/T350725 (10CCicalese_WMF) [22:58:48] 10CAS-SSO, 10Infrastructure-Foundations: Create OpenID Connect client - https://phabricator.wikimedia.org/T350725 (10CCicalese_WMF) [23:53:07] 10netops, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review: Support Anycast GW on EVPN switches without unique IP - https://phabricator.wikimedia.org/T350579 (10cmooney) In terms of the config when we have 2 IPs on the interface with the VGA setup, there is some behaviour we need to be careful of....