[06:54:08] 10SRE-tools, 10DBA, 10Infrastructure-Foundations, 10Recommendation-API, and 2 others: Switchover m2 master (db1183 -> db1159) - https://phabricator.wikimedia.org/T300329 (10Marostegui) @bd808 @Krinkle @MoritzMuehlenhoff @kostajh @hnowlan @dpifke I would like to failover m2 master on **Thursday 3rd Feb at 9... [06:57:12] 10SRE-tools, 10DBA, 10Infrastructure-Foundations, 10Recommendation-API, and 2 others: Switchover m2 master (db1183 -> db1159) - https://phabricator.wikimedia.org/T300329 (10Marostegui) Adding also @akosiaris and @Volans [08:16:15] 10netops, 10DC-Ops, 10Infrastructure-Foundations, 10SRE, 10ops-drmrs: Q3:(Need By: ASAP) rack/setup/install cr[12]-drmrs - https://phabricator.wikimedia.org/T300277 (10ayounsi) a:05ayounsi→03RobH > Please note the above diagram has a mistake, showing both routers connecting to PP:15/16 when cr1:xe-0/... [08:40:20] 10SRE-tools, 10DBA, 10Infrastructure-Foundations, 10Recommendation-API, and 2 others: Switchover m2 master (db1183 -> db1159) - https://phabricator.wikimedia.org/T300329 (10kostajh) Sounds good to me (for mwaddlink). [09:40:12] 10SRE-tools, 10DBA, 10Infrastructure-Foundations, 10Recommendation-API, and 2 others: Switchover m2 master (db1183 -> db1159) - https://phabricator.wikimedia.org/T300329 (10Volans) Nothing to do for `debmonitor`, it will reconnect automatically to the new host, so anytime is good. [10:51:02] 10netops, 10Infrastructure-Foundations, 10SRE: Configuration of New Switches Eqiad Rows E-F - https://phabricator.wikimedia.org/T299758 (10cmooney) [10:54:19] 10netops, 10Infrastructure-Foundations, 10SRE: Configuration of New Switches Eqiad Rows E-F - https://phabricator.wikimedia.org/T299758 (10cmooney) Just to update we've had console access for most of this week and configuration / testing is under way. Will submit CRs when config is ready. [10:54:34] 10netops, 10Infrastructure-Foundations, 10SRE: Validate EVPN/VXLAN configuration for Juniper QFX Platform - https://phabricator.wikimedia.org/T294115 (10cmooney) 05Open→03Resolved Closing this task. Have discussed with @ayounsi and we are broadly in agreement on next steps for the Eqiad expansion. Furt... [11:45:35] 10netops, 10DC-Ops, 10Infrastructure-Foundations, 10SRE, 10ops-eqiad: Q2:(Need By: TBD) Rows E/F network racking task - https://phabricator.wikimedia.org/T292095 (10cmooney) Actually one thing that is outstanding I believe is to confirm the cable IDs? **Inter-Switch Links** I documented the inter-switc... [14:55:34] 10SRE-tools, 10DBA, 10Infrastructure-Foundations, 10Recommendation-API, and 2 others: Switchover m2 master (db1183 -> db1159) - https://phabricator.wikimedia.org/T300329 (10hnowlan) No concerns as regards `sockpuppet`, it is not currently receiving writes afaik. [15:02:33] 10SRE-tools, 10DBA, 10Infrastructure-Foundations, 10Recommendation-API, and 2 others: Switchover m2 master (db1183 -> db1159) - https://phabricator.wikimedia.org/T300329 (10akosiaris) Adding @Arnoldokoth as well for `vrts` (formerly named `otrs`). The software will automatically reconnect to the new host,... [15:07:50] 10SRE-tools, 10DBA, 10Infrastructure-Foundations, 10Recommendation-API, and 2 others: Switchover m2 master (db1183 -> db1159) - https://phabricator.wikimedia.org/T300329 (10akosiaris) As far as `recommendationapi` and `mwaddlink` go, for the former we know it will not have issues, for the latter, I have no... [17:00:15] 10SRE-tools, 10DBA, 10Infrastructure-Foundations, 10Recommendation-API, and 2 others: Switchover m2 master (db1183 -> db1159) - https://phabricator.wikimedia.org/T300329 (10dpifke) No objections from `xhgui` owners, the service is low traffic and should automatically reconnect. [17:07:19] 10SRE-tools, 10DBA, 10Infrastructure-Foundations, 10Recommendation-API, and 2 others: Switchover m2 master (db1183 -> db1159) - https://phabricator.wikimedia.org/T300329 (10bd808) >>! In T300329#7658612, @Marostegui wrote: > * iegreview PHP app without persistent connections, so it should recover fine. It... [18:32:55] 10netops, 10DC-Ops, 10Infrastructure-Foundations, 10SRE, 10ops-drmrs: Q3:(Need By: ASAP) rack/setup/install cr[12]-drmrs - https://phabricator.wikimedia.org/T300277 (10RobH) >>! In T300277#7658774, @ayounsi wrote: >> Please note the above diagram has a mistake, showing both routers connecting to PP:15/16... [18:46:02] 10netbox, 10Infrastructure-Foundations: Agree how to document intra-DC patch panels in Netbox - https://phabricator.wikimedia.org/T293221 (10wiki_willy) Hi @Papaul, @Cmjohnson, and @Jclark-ctr - let me know if you guys have any specific preferences or general feedback around this, before we proceed forward on... [18:54:48] 10netops, 10DC-Ops, 10Infrastructure-Foundations, 10SRE, 10ops-eqiad: Q2:(Need By: TBD) Rows E/F network racking task - https://phabricator.wikimedia.org/T292095 (10wiki_willy) Hi @cmooney - here's the doc that @Jclark-ctr put together when running the cables for the inter-switch links. Some of the cabl... [22:47:16] 10netops, 10DC-Ops, 10Infrastructure-Foundations, 10SRE, 10ops-drmrs: Q3:(Need By: ASAP) rack/setup/install cr[12]-drmrs - https://phabricator.wikimedia.org/T300277 (10RobH) Submitted the revised document (using numbered steps) to Interxion via ticket CS0433959. I listed @wiki_willy, @ayounsi, & @cmoone...