[08:16:39] 10netbox, 10Infrastructure-Foundations, 10Patch-For-Review: Netbox: Add license keys as inventory items - https://phabricator.wikimedia.org/T311008 (10ayounsi) 05Open→03Resolved a:03ayounsi All done, and licenses removed from homer-private. https://netbox.wikimedia.org/dcim/inventory-items/?role_id=1 [09:23:40] 10netops, 10Infrastructure-Foundations, 10SRE, 10cloud-services-team (Kanban): Move WMCS servers to 1 NIC - https://phabricator.wikimedia.org/T319184 (10aborrero) [09:24:23] 10netops, 10Infrastructure-Foundations, 10SRE, 10cloud-services-team (Kanban): Move WMCS servers to 1 NIC - https://phabricator.wikimedia.org/T319184 (10aborrero) The problem described on {T319300} may block work on some servers, but we have plenty of others to migrate, so we should have enough work to do. [09:33:08] 10netops, 10Cloud-Services, 10Infrastructure-Foundations, 10SRE: Routing loop for unused WMCS IPs in 185.15.56.0/24 - https://phabricator.wikimedia.org/T315956 (10cmooney) 05Open→03Resolved [09:34:33] 10netops, 10Infrastructure-Foundations, 10SRE, 10cloud-services-team (Kanban): Move WMCS servers to 1 NIC - https://phabricator.wikimedia.org/T319184 (10aborrero) [09:35:50] 10netops, 10Infrastructure-Foundations, 10SRE: Set consistent MTUs - https://phabricator.wikimedia.org/T315838 (10cmooney) a:03cmooney Thanks @ayounsi. Yeah 9216 was default max I had used for the VXLAN stuff originally, but 9192 is more than enough to support a 9,000 byte IP packet and allow for the VXLA... [09:36:50] 10netops, 10Infrastructure-Foundations, 10SRE: Validate new (anycast) IPv6 /48 announcement being accepted by transits - https://phabricator.wikimedia.org/T301900 (10cmooney) 05Open→03Resolved Thanks @ayounsi. I didn't finish checking every single one but it was accepted by all our major transits and is... [11:32:25] 10netops, 10Ganeti, 10Infrastructure-Foundations: Investigate Ganeti in routed mode - https://phabricator.wikimedia.org/T300152 (10ayounsi) [12:06:52] 10SRE-tools, 10Infrastructure-Foundations, 10cloud-services-team (Kanban): WMCS Cookbook Automation Q2 tracking task - https://phabricator.wikimedia.org/T319401 (10Volans) p:05Triage→03Medium [12:07:34] jobo, jbond, XioNoX here's the task for the WMCS stuff ^^^ [12:07:46] feel free to amend/add things if you see any gaps [12:13:25] Thanks [12:31:19] cheers [12:43:04] 10netops, 10Infrastructure-Foundations, 10SRE, 10cloud-services-team (Kanban): Move WMCS servers to 1 NIC - https://phabricator.wikimedia.org/T319184 (10aborrero) [15:15:15] 10Mail, 10Data Engineering Planning, 10Data-Engineering-Operations, 10SRE: Add xcollazo@wikimedia.org to the analytics-alerts mailing list - https://phabricator.wikimedia.org/T315486 (10xcollazo) > Asking ITS to make it a Google group should be just an email to techsupport@ if that is an option. Agreed tha... [15:18:35] 10netops, 10Infrastructure-Foundations, 10SRE: Upgrade management routers and switches to Junos 21 - https://phabricator.wikimedia.org/T316529 (10Papaul) [15:18:54] 10netops, 10Infrastructure-Foundations, 10SRE: Upgrade network devices to Junos 20+ - https://phabricator.wikimedia.org/T316539 (10Papaul) [15:19:03] 10netops, 10Infrastructure-Foundations, 10SRE: Upgrade management routers and switches to Junos 21 - https://phabricator.wikimedia.org/T316529 (10Papaul) 05Open→03Resolved @ayounsi this is complete [15:59:31] 10SRE-tools, 10Infrastructure-Foundations, 10cloud-services-team (Kanban): WMCS Cookbook Automation Q2 tracking task - https://phabricator.wikimedia.org/T319401 (10dcaro) [16:00:40] 10SRE-tools, 10Infrastructure-Foundations, 10cloud-services-team (Kanban): WMCS Cookbook Automation Q2 tracking task - https://phabricator.wikimedia.org/T319401 (10dcaro) [16:02:58] 10SRE-tools, 10Infrastructure-Foundations, 10cloud-services-team (Kanban): WMCS Cookbook Automation Q2 tracking task - https://phabricator.wikimedia.org/T319401 (10dcaro) [16:03:40] 10SRE-tools, 10Infrastructure-Foundations, 10cloud-services-team (Kanban): WMCS Cookbook Automation Q2 tracking task - https://phabricator.wikimedia.org/T319401 (10dcaro) [16:21:41] 10Mail, 10Data Engineering Planning, 10Data-Engineering-Operations, 10SRE: Add xcollazo@wikimedia.org to the analytics-alerts mailing list - https://phabricator.wikimedia.org/T315486 (10BTullis) a:03BTullis [16:40:56] mforns: https://gerrit.wikimedia.org/r/c/analytics/refinery/scap/+/838856 <-- Here is the update for the refinery deploy targets [16:41:26] btullis: wrong chan? mforns is not here... [16:41:52] Yep, apologies. Fat fingers :-) [16:41:58] no worries :) [17:00:37] 10SRE-tools, 10Infrastructure-Foundations, 10cloud-services-team (Kanban): WMCS Cookbook Automation Q2 tracking task - https://phabricator.wikimedia.org/T319401 (10dcaro) [17:04:19] 10SRE-tools, 10Infrastructure-Foundations, 10cloud-services-team (Kanban): WMCS Cookbook Automation Q2 tracking task - https://phabricator.wikimedia.org/T319401 (10dcaro) [17:05:04] 10netops, 10Infrastructure-Foundations, 10SRE, 10ops-eqiad: eqiad: Move links to new MPC7E linecard - https://phabricator.wikimedia.org/T304712 (10Papaul) the 40G port in cr1-eqiad to connect asw-c2 and asw-d2 are reqady ` papaul@re0.cr1-eqiad> show interfaces terse | match et-1/1/ et-1/1/0... [17:47:01] 10netops, 10Infrastructure-Foundations, 10SRE: cr2-esams:FPC0 Parity error - https://phabricator.wikimedia.org/T318783 (10cmooney) I will reboot this tomorrow morning, Oct 6th at 08:00 and we can take it from there. [18:17:18] 10netops, 10Infrastructure-Foundations, 10SRE, 10cloud-services-team (Kanban): Move WMCS servers to 1 NIC - https://phabricator.wikimedia.org/T319184 (10cmooney) @aborrero Just something I noticed, you may already be aware in which case ignore. I was testing out an updated puppet to netbox import script... [19:20:22] 10Mail, 10Data Engineering Planning, 10Data-Engineering-Operations, 10SRE: Add xcollazo@wikimedia.org to the analytics-alerts mailing list - https://phabricator.wikimedia.org/T315486 (10Dzahn) team membership confirmed per https://www.mediawiki.org/wiki/Platform_Engineering_Team/Data_Value_Stream --- @xc... [19:25:10] 10Mail, 10Data Engineering Planning, 10Data-Engineering-Operations, 10SRE: Add xcollazo@wikimedia.org to the analytics-alerts mailing list - https://phabricator.wikimedia.org/T315486 (10xcollazo) Thank you @Dzahn! ( Side note: I have confirmed that we can make the list public if we choose to move it to Go... [19:28:22] 10Mail, 10Data Engineering Planning, 10Data-Engineering-Operations, 10SRE: Add xcollazo@wikimedia.org to the analytics-alerts mailing list - https://phabricator.wikimedia.org/T315486 (10Dzahn) @xcollazo ITS can create the group and then give admin ship to your team so that you can self-manage it. [19:36:02] 10Mail, 10Data Engineering Planning, 10Data-Engineering-Operations, 10SRE: Add xcollazo@wikimedia.org to the analytics-alerts mailing list - https://phabricator.wikimedia.org/T315486 (10xcollazo) @Dzahn: we discussed moving the list today and there was concern on whether we could make the content of the li... [19:39:48] 10Mail, 10Data Engineering Planning, 10Data-Engineering-Operations, 10SRE: Add xcollazo@wikimedia.org to the analytics-alerts mailing list - https://phabricator.wikimedia.org/T315486 (10Dzahn) @xcollazo There are 2 possible routes you can go. Both result in your team being able to self-manage the list. a)... [19:43:32] 10Mail, 10Data Engineering Planning, 10Data-Engineering-Operations, 10SRE: Add xcollazo@wikimedia.org to the analytics-alerts mailing list - https://phabricator.wikimedia.org/T315486 (10xcollazo) Ack @Dzahn, thank you for the context and options! Will discuss with team and get back to you.