[01:44:52] 10serviceops, 10Community-Tech, 10Data-Persistence (Consultation), 10MediaWiki-extensions-Phonos, 10SRE: SRE/Data Persistence consultation — use of FSFileBackend for caching audio files - https://phabricator.wikimedia.org/T314789 (10Legoktm) >>! In T314789#8138964, @MusikAnimal wrote: > That's very helpf... [03:58:53] 10serviceops, 10Datasets-General-or-Unknown, 10Growth-Team, 10Developer Productivity: Allow use of wmf's MW CLI scripts on snapshot hosts instead of bypassing - https://phabricator.wikimedia.org/T314697 (10Tgr) Why do we even have a separate `expanddblist` and `$multiversion/bin/expanddblist` with basicall... [04:34:15] 10serviceops, 10Performance-Team, 10SRE, 10SRE-swift-storage, and 2 others: Progressive Multi-DC roll out - https://phabricator.wikimedia.org/T279664 (10tstarling) It looks like pywikibot is a decent test rig for session replication races. I installed pywikibot on a Linode instance in the Dallas region, wh... [09:44:30] bd808_: we're planning on having multiple thumbor workers per pod [09:48:35] _joe_: did that apply you tried earlier succeed? I see the same changes pending [09:48:58] <_joe_> hnowlan: I didn't try [09:49:03] <_joe_> I just checked the diffs [09:49:55] ah weird, there's an apply in the SAL [09:50:59] <_joe_> but no DONE, right? [09:51:08] <_joe_> I just ran helmfile -i -e codfw apply [09:51:18] <_joe_> then bailed out because I wasn't sure of the diffs [09:51:36] <_joe_> as in, I didn't feel confident deploying those without your approval [09:52:13] ahh ok [10:55:32] 10serviceops, 10Patch-For-Review, 10Performance-Team (Radar): Migrate WMF production from PHP 7.2 to PHP 7.4 - https://phabricator.wikimedia.org/T271736 (10Krinkle) [10:55:37] 10serviceops, 10WikimediaDebug, 10Patch-For-Review, 10Performance-Team (Radar): Add "php 7.4" option to the Wikimedia Debug extension - https://phabricator.wikimedia.org/T312653 (10Krinkle) 05Open→03Resolved [11:03:39] 10serviceops, 10Datasets-General-or-Unknown, 10Growth-Team, 10Developer Productivity: Allow use of wmf's MW CLI scripts on snapshot hosts instead of bypassing - https://phabricator.wikimedia.org/T314697 (10Krinkle) >>! In T314697#8139516, @Tgr wrote: > Why do we even have a separate `expanddblist` and `$mu... [12:47:19] 10serviceops, 10Data-Persistence-Backup, 10serviceops-collab, 10GitLab (Infrastructure), and 2 others: Backups for GitLab - https://phabricator.wikimedia.org/T274463 (10Jelto) Backups on `gitlab1004` failed again silently due to disk space issues. Restore on both replicas `gitlab1003` and `gitlab2002` fail... [12:48:15] 10serviceops, 10Community-Tech, 10Data-Persistence (Consultation), 10MediaWiki-extensions-Phonos, 10SRE: SRE/Data Persistence consultation — use of FSFileBackend for caching audio files - https://phabricator.wikimedia.org/T314789 (10TheDJ) >>! In T314789#8139432, @Legoktm wrote: > IMO the most important... [12:54:17] 10serviceops, 10Data-Persistence-Backup, 10serviceops-collab, 10GitLab (Infrastructure), and 2 others: Backups for GitLab - https://phabricator.wikimedia.org/T274463 (10jcrespo) Please note the patch is not complete, it was a discussion-starter. Let's try to meet to sync- my intention here is to try to hel... [13:16:43] 10serviceops, 10Community-Tech, 10Data-Persistence (Consultation), 10MediaWiki-extensions-Phonos, 10SRE: SRE/Data Persistence consultation — use of FSFileBackend for caching audio files - https://phabricator.wikimedia.org/T314789 (10TheresNoTime) >>! In T314789#8140256, @TheDJ wrote: > You can use lame a... [16:54:19] <_joe_> hnowlan: there's a few restbases in the racks for tomorrow [16:54:40] <_joe_> will you be around at approx 15-16Z [16:54:42] <_joe_> ? [19:19:07] 10serviceops, 10SRE, 10Continuous-Integration-Config, 10Release-Engineering-Team (CI & Testing services), 10Test-Coverage: Add pcov PHP extension to wikimedia apt so it can be used in Wikimedia CI - https://phabricator.wikimedia.org/T243847 (10Jdforrester-WMF) [20:53:14] 10serviceops, 10Patch-For-Review, 10Performance-Team (Radar): Migrate WMF production from PHP 7.2 to PHP 7.4 - https://phabricator.wikimedia.org/T271736 (10Jdforrester-WMF)