[11:03:41] Stupid mw question: How is the DNS lookups handled in mw in prod (both bare and k8s)? i.e. how many things would break if trigger a lot of DNS lookups in mediawiki? Context: https://phabricator.wikimedia.org/T360029 [11:41:04] <_joe_> Amir1: everything [11:41:21] <_joe_> let me read this task [13:20:58] 06serviceops, 06DC-Ops, 10ops-codfw, 06SRE: mw2420-mw2451 do have unnecessary raid controllers (configured) - https://phabricator.wikimedia.org/T358489#9637825 (10Papaul) @JMeybohm hello is there anything DC-ops need to do on this task? [13:25:54] 06serviceops, 06SRE: mw2420-mw2451 do have unnecessary raid controllers (configured) - https://phabricator.wikimedia.org/T358489#9637831 (10JMeybohm) >>! In T358489#9637825, @Papaul wrote: > @JMeybohm hello is there anything DC-ops need to do on this task? No, all good from your end. Cheers [13:33:50] 06serviceops, 06Data Products: Service Ops Review of Metrics Platform Configuration Management UI - https://phabricator.wikimedia.org/T358577#9637876 (10MShilova_WMF) Hello @Kappakayala, please let us know if the March 22nd deadline is still feasible for this review. The most important is to learn early from y... [16:34:47] 06serviceops, 10Dumps-Generation, 06MediaWiki-Platform-Team: Migrate WMF production from PHP 7.4 to PHP 8.1 - https://phabricator.wikimedia.org/T319432#9638728 (10Jdforrester-WMF) [17:04:55] 06serviceops, 13Patch-For-Review: etcdmirror does not recover from a cleared waitIndex - https://phabricator.wikimedia.org/T358636#9638941 (10Scott_French) Coming back to this after pausing for the summit, I wanted to follow up on my comment that these benchmarks are measuring ideal throughput (not accounting... [18:12:49] 06serviceops, 06Commons: Commons thumbnails are broken for certain large sizes of thumbnail images - https://phabricator.wikimedia.org/T358738#9639336 (10TheDJ) [18:49:35] 06serviceops, 06Commons: Commons thumbnails are broken for certain large sizes of thumbnail images - https://phabricator.wikimedia.org/T358738#9639439 (10TheDJ) It seems codfw is now also in sync. Still kinda curious why there is no last-modified header on some of these responses now. [22:15:31] 06serviceops, 06Data-Engineering, 06MediaWiki-Engineering, 10WMF-JobQueue, and 2 others: Could not enqueue jobs: "Unable to deliver all events: 503: Service Unavailable" - https://phabricator.wikimedia.org/T249745#9640208 (10Ottomata) > I wonder if JobQueueGroup::lazyPush()/JobQueueEventBus could be rigged... [22:20:30] 06serviceops, 06Data-Engineering, 06MediaWiki-Engineering, 10WMF-JobQueue, and 2 others: Could not enqueue jobs: "Unable to deliver all events: 503: Service Unavailable" - https://phabricator.wikimedia.org/T249745#9640217 (10Ottomata) > This doesn't mean that MediaWiki shoudn't try to improve the situatio...