[03:07:59] 10serviceops, 10All-and-every-Wikisource, 10Thumbor, 10MW-1.41-notes (1.41.0-wmf.13; 2023-06-13), 10Patch-For-Review: Thumbor fails to render thumbnails of djvu/tiff/pdf files quite often in eqiad - https://phabricator.wikimedia.org/T337649 (10Samwilson) One relationship between OCR and Thumbor is becaus... [09:27:34] 10serviceops, 10Data-Platform-SRE, 10Discovery-Search (Current work): Enable mediawiki.cirrussearch.page_rerender.v1 on all public wikis - https://phabricator.wikimedia.org/T351503 (10dcausse) I think (please ignore if already done) we're still missing the partition count change on kafka-jumbo for both topics. [12:52:22] 10serviceops, 10MinT, 10Language-Team (Language-2023-October-December): Provide python3-build-bookworm docker image - https://phabricator.wikimedia.org/T352733 (10hashar) The base images are maintained by SRE #serviceops team in https://gerrit.wikimedia.org/g/operations/docker-images/production-images and sp... [13:06:00] 10serviceops, 10Prod-Kubernetes, 10Kubernetes, 10Patch-For-Review: Use cert-manager for service-proxy certificate creation - https://phabricator.wikimedia.org/T300033 (10JMeybohm) [13:08:44] 10serviceops, 10MinT, 10Language-Team (Language-2023-October-December), 10Patch-For-Review: Provide python3-build-bookworm docker image - https://phabricator.wikimedia.org/T352733 (10KartikMistry) >>! In T352733#9386409, @hashar wrote: > The base images are maintained by SRE #serviceops team in https://ger... [13:14:01] ^^ I have redirected Kartik here regarding the creation of a Bookworm based python image https://gerrit.wikimedia.org/r/c/operations/docker-images/production-images/+/980860/ [13:14:34] yep, oh they already created it [13:14:50] I was doing it, should maybe have said something x) [13:34:22] :D [13:34:30] hopefully that is a straightforward one to build [13:35:58] yeah, i'm wrestling docker-pkg locally as usual to verify the build :p (there's been a reinstall since last time I had to build an image) [13:39:32] I guess one day I should write a CI job which builds the images [14:16:03] 10serviceops, 10Data-Engineering, 10Data-Platform-SRE, 10SRE, and 3 others: Upgrade Kafka to 2.x or 3.x - https://phabricator.wikimedia.org/T300102 (10brouberol) > While we ought to consider an upgrade for all 4 clusters, from what I understand Jumbo can be upgraded independently. Are there any concerns wi... [14:31:40] 10serviceops, 10Data-Engineering, 10Data-Platform-SRE, 10SRE, and 3 others: Upgrade Kafka to 2.x or 3.x - https://phabricator.wikimedia.org/T300102 (10elukey) >>! In T300102#9386753, @brouberol wrote: > >> Specifically are there clients that publish to Kafka Jumbo directly or do all Kafka topics get mirro... [15:33:12] 10serviceops, 10Thumbor: Revisit thumbor's poolcounter integration - https://phabricator.wikimedia.org/T338297 (10Joe) a:03Joe [16:14:20] 10serviceops: Memcache improvements and essential work (FY 23-24) - https://phabricator.wikimedia.org/T352880 (10jijiki) p:05Triage→03Medium [16:28:25] 10serviceops, 10MW-on-K8s: Move servers from the appserver/api cluster to kubernetes - https://phabricator.wikimedia.org/T351074 (10Clement_Goubert) A couple updates from a meeting today with I/F, network and DCOps: Network's {T327938} will require us to change the VLAN and IP of the hosts in codfw rows A and... [16:28:46] 10serviceops, 10MW-on-K8s, 10SRE, 10Traffic, 10Release-Engineering-Team (Seen): Serve production traffic via Kubernetes - https://phabricator.wikimedia.org/T290536 (10hnowlan) [16:29:20] 10serviceops, 10MW-on-K8s, 10SRE, 10Traffic, and 2 others: Move MediaWiki jobs to mw-on-k8s - https://phabricator.wikimedia.org/T349796 (10hnowlan) 05Open→03In progress a:03hnowlan [16:36:48] 10serviceops, 10MW-on-K8s: Move servers from the appserver/api cluster to kubernetes - https://phabricator.wikimedia.org/T351074 (10Volans) >>! In T351074#9387219, @Clement_Goubert wrote: > If we need to do batches, it can be scripted. @Volans afaict we can do this between the reimage and adding the nodes to t... [16:37:46] 10serviceops, 10Infrastructure-Foundations, 10SRE, 10netops: Test IP-renumbering on a kubestage2002.codfw.wmnet - https://phabricator.wikimedia.org/T352883 (10Clement_Goubert) [16:38:09] 10serviceops, 10Infrastructure-Foundations, 10SRE, 10netops: Test IP-renumbering on kubestage2002.codfw.wmnet - https://phabricator.wikimedia.org/T352883 (10Clement_Goubert) [16:40:23] 10serviceops: Enable extstore to a subset of memcached servers (experiment) - https://phabricator.wikimedia.org/T352885 (10jijiki) p:05Triage→03Medium [16:41:16] 10serviceops, 10Infrastructure-Foundations, 10SRE, 10netops: Test IP-renumbering on kubestage2002.codfw.wmnet - https://phabricator.wikimedia.org/T352883 (10Clement_Goubert) p:05Triage→03Medium a:03Clement_Goubert [16:43:05] 10serviceops: Enable extstore to a subset of memcached servers (experiment) - https://phabricator.wikimedia.org/T352885 (10jijiki) [16:43:27] 10serviceops: Package latest version of prometheus-memcached-exporter - https://phabricator.wikimedia.org/T350807 (10jijiki) [16:44:16] 10serviceops: Package latest version of prometheus-memcached-exporter - https://phabricator.wikimedia.org/T350807 (10jijiki) [16:44:44] 10serviceops: Enable extstore to a subset of memcached servers (experiment) - https://phabricator.wikimedia.org/T352885 (10jijiki) [16:44:46] 10serviceops: Memcache improvements and essential work (FY 23-24) - https://phabricator.wikimedia.org/T352880 (10jijiki) [17:29:48] 10serviceops, 10DC-Ops, 10SRE, 10ops-eqiad, 10Patch-For-Review: Q2:rack/setup/install 3 sessionstore hosts (eqiad) - https://phabricator.wikimedia.org/T349875 (10VRiley-WMF) a:03VRiley-WMF [22:50:25] 10serviceops, 10Release-Engineering-Team (Seen): Rethinking Code Review and Deployment of MediaWiki - https://phabricator.wikimedia.org/T345670 (10apaskulin) [22:52:06] 10serviceops, 10Release-Engineering-Team (Seen): Rethinking Code Review and Deployment of MediaWiki - https://phabricator.wikimedia.org/T345670 (10apaskulin)