[00:05:03] 10serviceops, 10Phabricator, 10serviceops-collab, 10Release-Engineering-Team (The Decommission Mission 💀): Email tool maintainers about git-ssh deprecation on phabricator - https://phabricator.wikimedia.org/T313359 (10Dzahn) https://etherpad.wikimedia.org/p/1K-YSmk7PCIDjWlEQfMM [00:15:56] 10serviceops, 10Performance-Team, 10Code-Health-Objective, 10Platform Team Initiatives (Session Management Service (CDP2)), and 2 others: Determine multi-dc strategy for CentralAuth - https://phabricator.wikimedia.org/T267270 (10tstarling) [02:48:16] 10serviceops, 10MW-on-K8s, 10SRE, 10Shellbox, and 2 others: RFC: PHP microservice for containerized shell execution - https://phabricator.wikimedia.org/T260330 (10tstarling) [02:48:34] 10serviceops, 10MW-on-K8s, 10SRE: Sandbox/limit child processes within a container runtime - https://phabricator.wikimedia.org/T252745 (10tstarling) [02:48:42] 10serviceops, 10MW-on-K8s, 10SRE, 10Shellbox, and 2 others: RFC: PHP microservice for containerized shell execution - https://phabricator.wikimedia.org/T260330 (10tstarling) 05Open→03Resolved [02:51:27] 10serviceops, 10MW-on-K8s, 10SRE, 10Shellbox, and 2 others: RFC: PHP microservice for containerized shell execution - https://phabricator.wikimedia.org/T260330 (10tstarling) [06:26:21] 10serviceops, 10Performance-Team, 10SRE, 10Traffic, 10Patch-For-Review: Progressive Multi-DC roll out - https://phabricator.wikimedia.org/T279664 (10tstarling) [06:46:01] kubestagetcd2003 is back to it's original non-DRBD/plain disk storage [08:10:25] 10serviceops, 10Infrastructure-Foundations, 10Prod-Kubernetes, 10SRE, and 4 others: Create a cookbook to perform a rolling reboot of a kubernetes cluster - https://phabricator.wikimedia.org/T260661 (10JMeybohm) [08:16:49] 10serviceops, 10Phabricator, 10serviceops-collab, 10Release-Engineering-Team (The Decommission Mission 💀): Email tool maintainers about git-ssh deprecation on phabricator - https://phabricator.wikimedia.org/T313359 (10hashar) Phabricator keeps an history of push actions which can be seen at https://phabric... [08:34:16] 10serviceops, 10Prod-Kubernetes, 10Kubernetes: Switch to cgroup v2 and systemd as cgroup driver for docker and kubelet - https://phabricator.wikimedia.org/T313473 (10JMeybohm) [09:58:27] 10serviceops, 10GitLab (Project Migration): import subversion repos from Phabricator into Gitlab - https://phabricator.wikimedia.org/T308061 (10Aklapper) > I would rather keep the old subversion repos hosted on Phab I would not. I'd personally like to see repo hosting in Phab to be shut down. It's hard to writ... [09:59:59] 10serviceops, 10Phabricator, 10serviceops-collab, 10Release-Engineering-Team (The Decommission Mission 💀): Email tool maintainers about git-ssh deprecation on phabricator - https://phabricator.wikimedia.org/T313359 (10RhinosF1) I have quickly made a script to generate the list of all for the etherpad. It's... [10:09:03] 10serviceops, 10Phabricator, 10serviceops-collab, 10Release-Engineering-Team (The Decommission Mission 💀): Email tool maintainers about git-ssh deprecation on phabricator - https://phabricator.wikimedia.org/T313359 (10hashar) rPHTO is for Phabricator https://phabricator.wikimedia.org/diffusion/PHTO/manage/... [10:31:02] 10serviceops, 10Phabricator, 10serviceops-collab, 10Release-Engineering-Team (The Decommission Mission 💀): Email tool maintainers about git-ssh deprecation on phabricator - https://phabricator.wikimedia.org/T313359 (10RhinosF1) Etherpad is updated. Please also see {Tx} [10:33:10] 10serviceops, 10Phabricator, 10serviceops-collab, 10Release-Engineering-Team (The Decommission Mission 💀): Email tool maintainers about git-ssh deprecation on phabricator - https://phabricator.wikimedia.org/T313359 (10RhinosF1) [10:44:32] I'm going to move kubetcd2006 to DRDB temporarily, latency will go up [10:59:25] 10serviceops, 10Patch-For-Review, 10Performance-Team (Radar): Properly support php7.4 across the observability stack - https://phabricator.wikimedia.org/T312634 (10Joe) [11:03:13] 10serviceops, 10Performance-Team, 10Code-Health-Objective, 10Platform Team Initiatives (Session Management Service (CDP2)), and 2 others: Determine multi-dc strategy for CentralAuth - https://phabricator.wikimedia.org/T267270 (10tstarling) [11:06:16] 10serviceops, 10Patch-For-Review, 10Performance-Team (Radar): Properly support php7.4 across the observability stack - https://phabricator.wikimedia.org/T312634 (10Joe) The MediaWiki errors collected in logstash do indeed distinguish between php versions, as I verified by causing a fatal error in a php 7.4... [11:06:26] 10serviceops, 10Patch-For-Review, 10Performance-Team (Radar): Properly support php7.4 across the observability stack - https://phabricator.wikimedia.org/T312634 (10Joe) [11:09:10] 10serviceops, 10Patch-For-Review, 10Performance-Team (Radar): Properly support php7.4 across the observability stack - https://phabricator.wikimedia.org/T312634 (10Joe) What's left is, at this point, to remove prometheus-php-fpm-exporter from production, and to split flamegraphs. @Krinkle do you think we ne... [12:28:41] 10serviceops, 10Performance-Team, 10Platform Team Workboards (Clinic Duty Team), 10Sustainability (MediaWiki-MultiDC): Harmonize CentralAuth and core session TTL and migrate CentralAuth sessions to Kask - https://phabricator.wikimedia.org/T313496 (10tstarling) [12:29:55] 10serviceops, 10Prod-Kubernetes, 10Kubernetes: Update Kubernetes clusters to v1.23 - https://phabricator.wikimedia.org/T307943 (10JMeybohm) [13:08:31] 10serviceops, 10Performance-Team (Radar): Remove prometheus-phpfpm-exporter from physical hosts - https://phabricator.wikimedia.org/T313505 (10Joe) [14:11:53] 10serviceops, 10Patch-For-Review, 10Performance-Team (Radar): Properly support php7.4 across the observability stack - https://phabricator.wikimedia.org/T312634 (10Joe) [14:12:08] 10serviceops, 10Patch-For-Review, 10Performance-Team (Radar): Remove prometheus-phpfpm-exporter from physical hosts - https://phabricator.wikimedia.org/T313505 (10Joe) 05Open→03In progress p:05Triage→03High [15:30:03] 10serviceops, 10envoy, 10observability, 10Patch-For-Review, 10User-fgiunchedi: Envoy should listen on ipv6 and ipv4 - https://phabricator.wikimedia.org/T255568 (10Dzahn) I noticed recently that for example envoy on otrs1001 does not listen on IPv6 yet (when prometheus monitoring failed because it tries I... [16:27:10] 10serviceops, 10Phabricator, 10serviceops-collab, 10Release-Engineering-Team (The Decommission Mission 💀): Email tool maintainers about git-ssh deprecation on phabricator - https://phabricator.wikimedia.org/T313359 (10Dzahn) Thank you very much to @RhinosF1 for https://www.irccloud.com/pastebin/Rrnxda31/sc... [16:27:50] 10serviceops, 10Phabricator, 10serviceops-collab, 10Release-Engineering-Team (The Decommission Mission 💀): Email tool maintainers about git-ssh deprecation on phabricator - https://phabricator.wikimedia.org/T313359 (10Dzahn) [17:26:39] 10serviceops, 10Performance-Team, 10Scap: MW wmf-config tmp cache stays outdated after Scap deploy (opcache revalidation is off) - https://phabricator.wikimedia.org/T311788 (10dancy) >>! In T311788#8042839, @Krinkle wrote: > If we want to preserve the same working logic as before, we'd have to increase the t... [17:29:01] 10serviceops, 10Performance-Team, 10Scap: MW wmf-config tmp cache stays outdated after Scap deploy (opcache revalidation is off) - https://phabricator.wikimedia.org/T311788 (10Krinkle) @dancy As long as it means incurring cache misses instead of serving stale - Sounds good to me! We can afford a minute of fo... [17:45:56] 10serviceops, 10Performance-Team, 10Scap, 10Patch-For-Review: MW wmf-config tmp cache stays outdated after Scap deploy (opcache revalidation is off) - https://phabricator.wikimedia.org/T311788 (10dancy) I landed on a grace period of 3 minutes because the php-fpm-restart phase of scap currently takes about... [18:42:59] 10serviceops, 10SRE, 10SRE-OnFire, 10serviceops-collab, 10Patch-For-Review: productionize 'sremap' and 'filter_victorops_calendar' under sretools.wikimedia.org - https://phabricator.wikimedia.org/T313355 (10CDanis) [22:07:32] 10serviceops, 10Performance-Team, 10Scap: MW wmf-config tmp cache stays outdated after Scap deploy (opcache revalidation is off) - https://phabricator.wikimedia.org/T311788 (10dancy) 05Open→03Resolved [22:40:50] 10serviceops, 10GitLab (Project Migration): import subversion repos from Phabricator into Gitlab - https://phabricator.wikimedia.org/T308061 (10demon) >>! In T308061#8092652, @hashar wrote: > This way they can still be easily be browsed But are they being actively browsed beyond a stray link to them? Or is th... [22:58:38] 10serviceops, 10Performance-Team, 10Platform Team Workboards (Clinic Duty Team), 10Sustainability (MediaWiki-MultiDC): Harmonize CentralAuth and core session TTL and migrate CentralAuth sessions to Kask - https://phabricator.wikimedia.org/T313496 (10tstarling) The Kask config says ` # WARNING: The value... [23:01:46] 10serviceops, 10GitLab (Project Migration): import subversion repos from Phabricator into Gitlab - https://phabricator.wikimedia.org/T308061 (10bd808) For what it is worth, {rTSVN} is ancient now (read-only since 2014) and archived at https://archive.org/details/toolserver-svn. I don't think we need it anywher... [23:08:53] 10serviceops, 10GitLab (Project Migration): import subversion repos from Phabricator into Gitlab - https://phabricator.wikimedia.org/T308061 (10bd808) >>! In T308061#8096422, @bd808 wrote: > I think we can update the mw.o template to point to pages in https://static-codereview.wikimedia.org/MediaWiki/ instead... [23:33:56] 10serviceops, 10DNS, 10SRE, 10Traffic, and 4 others: Setup redirect of policy.wikimedia.org to Advocacy portal on Foundation website - https://phabricator.wikimedia.org/T310738 (10Dzahn) This has been deployed to all appservers and passes the tests in redirects and all other tests on all the hosts: ` [dep... [23:40:31] 10serviceops, 10DNS, 10SRE, 10Traffic, and 4 others: Setup redirect of policy.wikimedia.org to Advocacy portal on Foundation website - https://phabricator.wikimedia.org/T310738 (10Dzahn) test from external: ` curl -H "Host: policy.wikimedia.org" https://dyna.wikimedia.org ..

The document has moved 10serviceops, 10DNS, 10SRE, 10Traffic, and 4 others: Setup redirect of policy.wikimedia.org to Advocacy portal on Foundation website - https://phabricator.wikimedia.org/T310738 (10Dzahn) >>! In T310738#8070654, @Varnent wrote: > Just wanted to check on if there is anything else you are waiting from me on.... [23:59:20] 10serviceops, 10DNS, 10SRE, 10Traffic, and 4 others: Setup redirect of policy.wikimedia.org to Advocacy portal on Foundation website - https://phabricator.wikimedia.org/T310738 (10Dzahn) 05Open→03In progress p:05Medium→03High