[04:03:23] 06serviceops, 10Language-Technical Support, 06SRE, 10Wikimedia-Site-requests: Raise limit of $wgMaxArticleSize for Hebrew Wikisource - https://phabricator.wikimedia.org/T275319#9819571 (10Roxette5) Hello to everyone! I work primarily on the hebrew wikisource site, mostly involved in the religious texts etc... [06:00:58] 06serviceops, 10Language-Technical Support, 06SRE, 10Wikimedia-Site-requests: Raise limit of $wgMaxArticleSize for Hebrew Wikisource - https://phabricator.wikimedia.org/T275319#9819748 (10Fuzzy) I would like to point out that a similar issue arose a long time ago, regarding the length of custom signatures,... [08:08:22] 06serviceops, 06collaboration-services, 06Infrastructure-Foundations, 10Puppet-Core, and 5 others: Migrate roles to puppet7 - https://phabricator.wikimedia.org/T349619#9820025 (10MoritzMuehlenhoff) [09:58:09] 06serviceops, 10Prod-Kubernetes, 07Kubernetes: Rename wikikube worker nodes during OS reimage - https://phabricator.wikimedia.org/T365571 (10JMeybohm) 03NEW [10:02:25] 06serviceops, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Migrate wikikube control planes to hardware nodes - https://phabricator.wikimedia.org/T353464#9820355 (10ops-monitoring-bot) Deployed homer to cumin2002.codfw.wmnet,cumin1002.eqiad.wmnet with reason: Release v0.6.5 update to hostname to bgp... [10:02:30] 06serviceops, 10[DEPRECATED] wdwb-tech, 10Citoid, 06Content-Transform-Team-WIP, and 10 others: Migrate node-based services in production to node18 - https://phabricator.wikimedia.org/T349118#9820354 (10Jgiannelos) [11:06:31] 06serviceops, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Migrate wikikube control planes to hardware nodes - https://phabricator.wikimedia.org/T353464#9820497 (10hnowlan) All codfw wikikube-ctrl nodes are operational [11:35:53] 06serviceops, 10Prod-Kubernetes, 07Kubernetes: Rename wikikube worker nodes during OS reimage - https://phabricator.wikimedia.org/T365571#9820624 (10JMeybohm) [11:35:57] 06serviceops, 10Prod-Kubernetes, 13Patch-For-Review: Fix naming confusion around main/wikikube kubernetes clusters - https://phabricator.wikimedia.org/T336861#9820625 (10JMeybohm) [13:11:59] 06serviceops, 10MW-on-K8s, 10Observability-Metrics, 13Patch-For-Review, 10SRE Observability (FY2023/2024-Q4): Create a per-release deployment of statsd-exporter for mw-on-k8s - https://phabricator.wikimedia.org/T365265#9820968 (10fgiunchedi) I can't authoritatively answer the questions though IIRC from m... [13:34:04] 06serviceops, 10Prod-Kubernetes, 07Kubernetes: Rename wikikube worker nodes during OS reimage - https://phabricator.wikimedia.org/T365571#9821114 (10JMeybohm) @ayounsi I think we could test the rename cookbook together with {T350152} on the already cordoned `kubernetes2023.codfw.wmnet`, right? [13:41:16] 06serviceops, 10MW-on-K8s, 13Patch-For-Review: Move servers from the appserver/api cluster to kubernetes - https://phabricator.wikimedia.org/T351074#9821175 (10JMeybohm) [13:55:39] 06serviceops, 06Data-Persistence: Sessionstore's discovery TLS cert will expire before end of May 2024 - https://phabricator.wikimedia.org/T363996#9821312 (10Eevans) >>! In T363996#9816587, @elukey wrote: >>>! In T363996#9794048, @hnowlan wrote: >> Steps that I see: >> - Renewing the existing cergen cert to... [13:58:29] 06serviceops, 10Prod-Kubernetes, 07Kubernetes: Rename wikikube worker nodes during OS reimage - https://phabricator.wikimedia.org/T365571#9821320 (10ayounsi) Sounds good ! I'd recommend doing first a rename then normal re-image, then just a move-vlan, then on a different host, test both actions one after the... [14:35:44] 06serviceops, 06Data-Persistence: Sessionstore's discovery TLS cert will expire before end of May 2024 - https://phabricator.wikimedia.org/T363996#9821593 (10hnowlan) >>! In T363996#9821312, @Eevans wrote: >>>! In T363996#9816587, @elukey wrote: >>>>! In T363996#9794048, @hnowlan wrote: >>> Steps that I see:... [14:36:26] 06serviceops, 06Data-Persistence: Sessionstore's discovery TLS cert will expire before end of May 2024 - https://phabricator.wikimedia.org/T363996#9821591 (10MoritzMuehlenhoff) >>! In T363996#9821312, @Eevans wrote: >> +1! Not sure how to renew the existing cert since IIUC cergen wasn't used, but we can try to... [14:41:31] 06serviceops, 10Prod-Kubernetes, 07Kubernetes: Rename wikikube worker nodes during OS reimage - https://phabricator.wikimedia.org/T365571#9821636 (10JMeybohm) I've cleared out `kubernetes2023` and `kubernetes2032 ` for you to run tests. As the hosts are pooled=inactive and cordoned in k8s all you have to do... [15:01:37] 06serviceops, 10Prod-Kubernetes, 07Kubernetes: Rename wikikube worker nodes during OS reimage - https://phabricator.wikimedia.org/T365571#9821859 (10JMeybohm) [16:24:27] 06serviceops, 06MW-Interfaces-Team, 06Traffic: map the /api/ prefix to /w/rest.php - https://phabricator.wikimedia.org/T364400#9822316 (10daniel) [16:29:32] 06serviceops, 10MW-on-K8s, 13Patch-For-Review: Move servers from the appserver/api cluster to kubernetes - https://phabricator.wikimedia.org/T351074#9822361 (10JMeybohm) [17:01:01] 06serviceops, 06Content-Transform-Team, 07Essential-Work, 13Patch-For-Review, 07Wikimedia-Incident: Maps Unavailability due to thanos-swift cfssl rollout (14 Aug 2023) - https://phabricator.wikimedia.org/T344324#9822692 (10elukey) The code in https://gerrit.wikimedia.org/r/1035006 should work nicely, I... [18:22:47] 06serviceops, 06Data-Persistence, 13Patch-For-Review: Sessionstore's discovery TLS cert will expire before end of May 2024 - https://phabricator.wikimedia.org/T363996#9822928 (10hnowlan) Current situation - I have refreshed the .key file on the puppet master using a [[ https://gerrit.wikimedia.org/r/c/operat... [20:02:58] 06serviceops, 10Language-Technical Support, 06SRE, 10Wikimedia-Site-requests: Raise limit of $wgMaxArticleSize for Hebrew Wikisource - https://phabricator.wikimedia.org/T275319#9823208 (10Roxette5) @cscott - many thanks to you for your help - both in regard to this thread and the work you do for wikimedia... [20:34:58] 06serviceops, 06DC-Ops, 10ops-eqiad, 06SRE: Q4:rack/setup/install kafka-main100[6789] and kafka-main1010 - https://phabricator.wikimedia.org/T363212#9823336 (10VRiley-WMF) We have an open ticket with Dell for kafka-main1009. We have been through a flea power drain, NVRAM clear, trying to enter the server i... [22:24:54] 06serviceops: mw-api-ext unavailability 2024-05-22 18:30 UTC - https://phabricator.wikimedia.org/T365655 (10Scott_French) 03NEW