[08:11:43] 10serviceops, 10SRE, 10Traffic: Upgrade envoyproxy to 1.16.2 - https://phabricator.wikimedia.org/T271407 (10Vgutierrez) AFAIK this was only impacting envoy as the TLS terminator of the CDN and we went with HAProxy so this can be closed [10:36:41] 10serviceops, 10Data-Persistence, 10Toolhub, 10Datacenter-Switchover: What should happen to Toolhub during the 2023 DC switch? - https://phabricator.wikimedia.org/T329319 (10Clement_Goubert) [10:37:13] 10serviceops, 10Data-Persistence, 10SRE, 10Datacenter-Switchover: March 2023 Datacenter Switchover Blockers - https://phabricator.wikimedia.org/T328770 (10Clement_Goubert) [10:37:43] 10serviceops, 10Data-Persistence, 10Toolhub, 10Datacenter-Switchover: What should happen to Toolhub during the 2023 DC switch? - https://phabricator.wikimedia.org/T329319 (10Clement_Goubert) 05Open→03Resolved a:03Clement_Goubert I will consider this task resolved then, feel free to re-open if there a... [10:40:15] 10serviceops, 10Data-Persistence, 10SRE, 10Datacenter-Switchover: Ensure sre.switchdc.mediawiki live test multi-DC compatibility - https://phabricator.wikimedia.org/T329065 (10Clement_Goubert) 05Open→03Stalled Dry-runs and live-test stalled until resolution of {T329533} [10:40:20] 10serviceops, 10Data-Persistence, 10SRE, 10Datacenter-Switchover: March 2023 Datacenter Switchover Blockers - https://phabricator.wikimedia.org/T328770 (10Clement_Goubert) [10:41:10] 10serviceops, 10MW-on-K8s, 10Datacenter-Switchover, 10Patch-For-Review: Prepare mw-on-k8s for March 2023 Datacenter Switchover - https://phabricator.wikimedia.org/T327924 (10Clement_Goubert) p:05Triage→03High [10:43:36] 10serviceops, 10Data-Persistence, 10SRE, 10Datacenter-Switchover: Post March 2023 Datacenter Switchover Tasks - https://phabricator.wikimedia.org/T328907 (10Clement_Goubert) [10:44:43] 10serviceops, 10Data-Persistence, 10SRE, 10cloud-services-team, and 2 others: Wikitech issues for datacentre switchover (March 2023) - https://phabricator.wikimedia.org/T328768 (10Clement_Goubert) 05Open→03Resolved Resolving as wikitech will not be moving, but adding {T237773} to {T328907} [10:44:51] 10serviceops, 10Data-Persistence, 10SRE, 10Datacenter-Switchover: March 2023 Datacenter Switchover Blockers - https://phabricator.wikimedia.org/T328770 (10Clement_Goubert) [10:45:01] 10serviceops, 10Data-Persistence, 10SRE, 10Datacenter-Switchover, 10Performance-Team (Radar): March 2023 Datacenter Switchover - https://phabricator.wikimedia.org/T327920 (10Clement_Goubert) [11:16:09] 10serviceops: search service breaks rollback of sre.discovery.datacenter cookbook - https://phabricator.wikimedia.org/T329175 (10Clement_Goubert) 05Open→03Resolved [11:17:40] 10serviceops, 10MW-on-K8s, 10SRE, 10SRE Observability: Ingest php-slowlog in logstash - https://phabricator.wikimedia.org/T326794 (10Clement_Goubert) 05In progress→03Resolved [11:49:46] jayme: are you okay with the idea of us routing the unique-devices API through ingress? https://gerrit.wikimedia.org/r/889960 [11:53:27] hnowlan: generally speaking, yes. But it has still only been used for low traffic things for now. [11:54:12] also I've not read up to traffic expectations, if this will be in direct user path etc. Won't be able to take a closer look befor mid next week [12:01:53] no worries, this is blocked on service changes as is. We can catch up about it later [12:49:02] 10serviceops, 10Prod-Kubernetes, 10Kubernetes: Update staging-codfw to k8s 1.23 - https://phabricator.wikimedia.org/T326340 (10JMeybohm) [13:07:45] 10serviceops, 10Data-Persistence, 10SRE, 10Datacenter-Switchover, and 2 others: March 2023 Datacenter Switchover Excluded services - https://phabricator.wikimedia.org/T329193 (10Clement_Goubert) [13:30:35] 10serviceops, 10Foundational Technology Requests, 10Prod-Kubernetes, 10Shared-Data-Infrastructure, and 2 others: Update Kubernetes clusters to v1.23 - https://phabricator.wikimedia.org/T307943 (10JMeybohm) [14:12:00] 10serviceops, 10Foundational Technology Requests, 10Prod-Kubernetes, 10Shared-Data-Infrastructure, 10Kubernetes: Kubernetes v1.23 multi master setup is broken - https://phabricator.wikimedia.org/T329826 (10JMeybohm) [16:26:06] 10serviceops, 10SRE, 10Traffic: Upgrade envoyproxy to 1.16.2 - https://phabricator.wikimedia.org/T271407 (10BCornwall) 05Open→03Resolved a:03BCornwall Great, thanks! [17:30:54] 10serviceops, 10Kubernetes, 10Patch-For-Review: Add a second control-plane to wikikube staging clusters - https://phabricator.wikimedia.org/T329827 (10JMeybohm) a:03JMeybohm [19:27:49] 10serviceops, 10SRE, 10Traffic: Feedback for new service IP flowchart - https://phabricator.wikimedia.org/T279296 (10BCornwall) 05Open→03Resolved a:03BCornwall Seeing as that flowchart is in use at https://wikitech.wikimedia.org/wiki/Wikimedia_network_guidelines and there's not been any activity for a... [21:10:03] 10serviceops, 10DBA, 10Data-Persistence, 10Infrastructure-Foundations, and 9 others: codfw row B switches upgrade - https://phabricator.wikimedia.org/T327991 (10colewhite)