[06:48:40] 06serviceops, 06Commons, 10MediaWiki-File-management, 06SRE, and 2 others: Frequent "Error: 429, Too Many Requests" errors on pages with many (>50) thumbnails - https://phabricator.wikimedia.org/T266155#9765986 (10C.Suthorn) > Loading the original file or the 800px thumb would probably be non-ideal, partic... [08:39:15] 06serviceops, 06Commons, 10MediaWiki-File-management, 06SRE, and 2 others: Frequent "Error: 429, Too Many Requests" errors on pages with many (>50) thumbnails - https://phabricator.wikimedia.org/T266155#9766334 (10Bawolff) I think if we did deliver the wrong thumbsize, it only makes sense to deliver one la... [09:34:27] 06serviceops, 10Prod-Kubernetes, 07Kubernetes: Wikikube staging clusters are out of IPv4 Pod IP's - https://phabricator.wikimedia.org/T345823#9766568 (10cmooney) >>! In T345823#9763845, @JMeybohm wrote: > We decided during migration of production to a bigger Pod IP space that this will not be necessary f... [09:39:32] 06serviceops, 10Prod-Kubernetes, 07Kubernetes: Wikikube staging clusters are out of IPv4 Pod IP's - https://phabricator.wikimedia.org/T345823#9766574 (10JMeybohm) >>! In T345823#9766568, @cmooney wrote: >>>! In T345823#9763845, @JMeybohm wrote: >> We decided during migration of production to a bigger Pod... [10:12:04] 06serviceops, 10Prod-Kubernetes, 07Kubernetes: Wikikube staging clusters are out of IPv4 Pod IP's - https://phabricator.wikimedia.org/T345823#9766689 (10cmooney) >>! In T345823#9766574, @JMeybohm wrote: > 50 should be absolutely fine. My theory is that while I was moving around Pods and IP blocks in the... [11:32:20] 06serviceops, 10Prod-Kubernetes, 07Kubernetes: Migrate wikikube control planes to hardware nodes - https://phabricator.wikimedia.org/T353464#9767057 (10hnowlan) [11:33:22] 06serviceops, 10Prod-Kubernetes, 07Kubernetes: Migrate wikikube control planes to hardware nodes - https://phabricator.wikimedia.org/T353464#9767061 (10hnowlan) [13:36:22] 06serviceops, 06Machine-Learning-Team, 10MW-on-K8s, 06SRE, 13Patch-For-Review: Migrate ml-services to mw-api-int - https://phabricator.wikimedia.org/T362316#9767646 (10elukey) Status: Lift Wing codfw has been migrated successfully, we are going to do eqiad on Monday 6th. [15:39:04] 06serviceops, 06collaboration-services, 06Infrastructure-Foundations, 10Puppet-Core, and 5 others: Migrate roles to puppet7 - https://phabricator.wikimedia.org/T349619#9768239 (10Gehel) [15:41:22] 06serviceops, 10Data-Platform-SRE (2024.05.06 - 2024.05.26), 07Kubernetes, 13Patch-For-Review: Fix rendering issue in modules.app.job when cronjobs are enabled and private values are defined - https://phabricator.wikimedia.org/T362954#9768235 (10Gehel) [19:04:56] 06serviceops, 06collaboration-services, 06SRE: upgrade deployment servers to bullseye / add bullseye support to puppet role - https://phabricator.wikimedia.org/T363415#9768969 (10Dzahn)