[08:34:17] 10SRE-tools, 10DBA, 10Infrastructure-Foundations, 10Puppet-Core, and 2 others: puppet7 on cumin breaks database connections - https://phabricator.wikimedia.org/T352974 (10MoritzMuehlenhoff) >>! In T352974#9460261, @ABran-WMF wrote: > I ran the following test: with a custom PKI, Nice! Out of interest, whi... [08:39:48] 10SRE-tools, 10DBA, 10Infrastructure-Foundations, 10Puppet-Core, and 2 others: puppet7 on cumin breaks database connections - https://phabricator.wikimedia.org/T352974 (10ABran-WMF) >>! In T352974#9461185, @MoritzMuehlenhoff wrote: > Nice! Out of interest, which PKI tool did you use for your tests? As a ne... [08:49:00] 10SRE-tools, 10DBA, 10Infrastructure-Foundations, 10Puppet-Core, and 2 others: puppet7 on cumin breaks database connections - https://phabricator.wikimedia.org/T352974 (10MoritzMuehlenhoff) >>! In T352974#9461200, @ABran-WMF wrote: >>>! In T352974#9461185, @MoritzMuehlenhoff wrote: >> Nice! Out of interest... [09:49:15] 10netops, 10Infrastructure-Foundations, 10cloud-services-team: Remove cloud-support1-c-eqiad VLAN - https://phabricator.wikimedia.org/T355115 (10taavi) [09:49:39] 10netops, 10Infrastructure-Foundations, 10cloud-services-team: Remove cloud-support1-c-eqiad VLAN - https://phabricator.wikimedia.org/T355115 (10taavi) [10:28:02] topranks, XioNoX: I was wondering: peering notifications like "We will be performing maintenance on a router you are peering with. The BGP session may flap several times during this period.", are these useful for the maint calendar or do we not care? [10:28:21] moritzm: nah, you can ignore [10:28:34] agreed [10:28:45] only transit providers or if the whole IXP is going down [10:32:24] ack, thanks [11:00:02] 10SRE-tools, 10DBA, 10Infrastructure-Foundations, 10Puppet-Core, and 2 others: puppet7 on cumin breaks database connections - https://phabricator.wikimedia.org/T352974 (10Marostegui) Nice finding Arnaud! >>! In T352974#9461217, @MoritzMuehlenhoff wrote: > > Let's create a separate task for switching Orch... [11:09:39] 10SRE-tools, 10Infrastructure-Foundations: Long timeout on debmonitor client with server unreachable/unpingable - https://phabricator.wikimedia.org/T302205 (10fgiunchedi) The question on how to run debmonitor-client in Pontoon is an interesting one, though unrelated to this issue; debmonitor is not installed b... [13:17:54] 10netops, 10Infrastructure-Foundations, 10cloud-services-team, 10Patch-For-Review: Remove cloud-support1-c-eqiad VLAN - https://phabricator.wikimedia.org/T355115 (10ayounsi) Thanks, that's awesome ! For the record, they will need to be removed from `puppet:modules/network/data/data.yaml` as well as Netbox... [15:16:05] 10netops, 10Infrastructure-Foundations, 10cloud-services-team, 10Patch-For-Review: Remove cloud-support1-c-eqiad VLAN - https://phabricator.wikimedia.org/T355115 (10cmooney) >>! In T355115#9462157, @ayounsi wrote: > For the record, they will need to be removed from `puppet:modules/network/data/data.yaml` a... [15:28:06] 10netops, 10Infrastructure-Foundations, 10SRE, 10Traffic, and 2 others: Move lvs2012 from private1-b-codfw (row) to private1-b2-codfw (rack) vlan - https://phabricator.wikimedia.org/T352918 (10ops-monitoring-bot) Icinga downtime and Alertmanager silence (ID=38432fab-1dd6-4ffe-a093-648c38675985) set by cmoo... [15:36:23] 10SRE-tools, 10DBA, 10Infrastructure-Foundations, 10Puppet-Core, and 2 others: puppet7 on cumin breaks database connections - https://phabricator.wikimedia.org/T352974 (10BTullis) Good stuff! Does this mean that we can decline {T354411} now, or would you still prefer that role to be migrated back to puppet 5? [15:47:08] 10SRE-tools, 10DBA, 10Infrastructure-Foundations, 10Puppet-Core, and 2 others: Migrate MariaDB PKI - https://phabricator.wikimedia.org/T355157 (10ABran-WMF) [15:47:48] 10SRE-tools, 10DBA, 10Infrastructure-Foundations, 10Puppet-Core, and 2 others: puppet7 on cumin breaks database connections - https://phabricator.wikimedia.org/T352974 (10ABran-WMF) 05In progress→03Resolved [15:48:04] 10SRE-tools, 10Infrastructure-Foundations, 10Puppet-Core, 10SRE, and 5 others: Migrate roles to puppet7 - https://phabricator.wikimedia.org/T349619 (10ABran-WMF) [15:48:20] 10SRE-tools, 10DBA, 10Infrastructure-Foundations, 10Puppet-Core, and 2 others: puppet7 on cumin breaks database connections - https://phabricator.wikimedia.org/T352974 (10Marostegui) >>! In T352974#9462685, @BTullis wrote: > Good stuff! > Does this mean that we can decline {T354411} now, or would you still... [15:49:55] 10SRE-tools, 10DBA, 10Infrastructure-Foundations, 10Puppet-Core, and 2 others: Migrate MariaDB PKI - https://phabricator.wikimedia.org/T355157 (10Marostegui) p:05Triage→03High [16:47:10] 10netops, 10Infrastructure-Foundations, 10SRE, 10ops-codfw: Migrate mr1-codfw from asw-a1-codfw to lsw1-a2-codfw - https://phabricator.wikimedia.org/T348164 (10Papaul) 05Open→03Resolved Link removed [16:47:18] 10netops, 10Infrastructure-Foundations, 10SRE, 10ops-codfw: Codfw row A-B migration - non-standard device moves - https://phabricator.wikimedia.org/T348128 (10Papaul) [17:56:32] 10netops, 10Infrastructure-Foundations, 10SRE, 10Traffic, 10ops-codfw: Migrate lvs2013 and lvs2014 codfw row A-B connections to new switches - https://phabricator.wikimedia.org/T348218 (10cmooney) [17:57:06] 10netops, 10Infrastructure-Foundations, 10SRE, 10Traffic, 10ops-codfw: Move lvs2013 link to row A and connect to new row A/B vlans - https://phabricator.wikimedia.org/T352784 (10cmooney) 05Open→03Resolved Work complete, all looking good. [17:57:48] 10netops, 10Infrastructure-Foundations, 10SRE, 10Traffic, 10ops-codfw: Migrate lvs2013 and lvs2014 codfw row A-B connections to new switches - https://phabricator.wikimedia.org/T348218 (10cmooney) 05Open→03Resolved Work complete without issue. [17:57:56] 10netops, 10Infrastructure-Foundations, 10SRE, 10ops-codfw: Codfw row A-B migration - non-standard device moves - https://phabricator.wikimedia.org/T348128 (10cmooney) [18:06:30] 10netops, 10Infrastructure-Foundations, 10SRE, 10Traffic, 10ops-codfw: Migrate lvs2011 and lvs2012 to new top-of-rack switches - https://phabricator.wikimedia.org/T348178 (10cmooney) [18:07:01] 10netops, 10Infrastructure-Foundations, 10SRE, 10Traffic, 10ops-codfw: Move lvs2012 primary uplink and connect to new row A/B vlans - https://phabricator.wikimedia.org/T352909 (10cmooney) 05Open→03Resolved Work completed, all looking good. [18:07:14] 10netops, 10Infrastructure-Foundations, 10SRE, 10ops-codfw: Codfw row A-B migration - non-standard device moves - https://phabricator.wikimedia.org/T348128 (10cmooney) [20:24:28] 10SRE-tools, 10Infrastructure-Foundations: Reimage cookbook fails to downtime hosts when run concurrently - https://phabricator.wikimedia.org/T355187 (10Volans) p:05Triage→03Medium a:03Volans