[00:00:40] (03PS2) 101Veertje: Fix login form: responsive labels and mobile-friendly layout [software/gerrit] (wmf/stable-3.10) - 10https://gerrit.wikimedia.org/r/1305745 [00:01:01] (03PS1) 101Veertje: Add daily background rotation from Wikimedia Commons (29 winter landscapes) [software/gerrit] (wmf/stable-3.10) - 10https://gerrit.wikimedia.org/r/1305786 [00:01:11] (03PS1) 101Veertje: Background rotation: add license links and Commons file page links to attribution [software/gerrit] (wmf/stable-3.10) - 10https://gerrit.wikimedia.org/r/1305787 [00:01:20] (03PS1) 101Veertje: Use full-original Commons URLs (no thumbnails) + fix author credits [software/gerrit] (wmf/stable-3.10) - 10https://gerrit.wikimedia.org/r/1305788 [00:01:30] (03PS1) 101Veertje: Add dark backdrop to footer and attribution for contrast over background images [software/gerrit] (wmf/stable-3.10) - 10https://gerrit.wikimedia.org/r/1305789 [00:01:39] (03PS1) 101Veertje: Footer and attribution in white box matching form card [software/gerrit] (wmf/stable-3.10) - 10https://gerrit.wikimedia.org/r/1305790 [00:01:49] (03PS1) 101Veertje: Move footer and attribution inside the login form card [software/gerrit] (wmf/stable-3.10) - 10https://gerrit.wikimedia.org/r/1305791 [00:01:58] (03PS1) 101Veertje: Author link opens Commons Media Viewer instead of plain file page [software/gerrit] (wmf/stable-3.10) - 10https://gerrit.wikimedia.org/r/1305792 [00:02:08] (03PS1) 101Veertje: Add featured desktop backgrounds (98 sampled) with winter/featured date switching [software/gerrit] (wmf/stable-3.10) - 10https://gerrit.wikimedia.org/r/1305793 [00:02:17] (03PS1) 101Veertje: Use 1920px thumbnails (API thumburl) instead of full-res originals [software/gerrit] (wmf/stable-3.10) - 10https://gerrit.wikimedia.org/r/1305794 [00:02:27] (03PS1) 101Veertje: Add preload link in head for faster background image loading [software/gerrit] (wmf/stable-3.10) - 10https://gerrit.wikimedia.org/r/1305795 [00:02:36] (03PS1) 101Veertje: Add footer links (Code of Conduct, Privacy Policy, Reset Password) with non-breaking space [software/gerrit] (wmf/stable-3.10) - 10https://gerrit.wikimedia.org/r/1305796 [00:30:56] (03PS1) 101Veertje: Fix login form: responsive labels and mobile-friendly layout [software/gerrit] (wmf/stable-3.10) - 10https://gerrit.wikimedia.org/r/1305800 [00:30:56] (03PS1) 101Veertje: Add daily background rotation with attribution and footer polish [software/gerrit] (wmf/stable-3.10) - 10https://gerrit.wikimedia.org/r/1305801 [00:34:55] Why are people suddenly contributing to our gerrit branch... [00:37:15] Hundreds of lines added + a couple features, but no tasks linked [00:47:45] (03Abandoned) 101Veertje: Author link opens Commons Media Viewer instead of plain file page [software/gerrit] (wmf/stable-3.10) - 10https://gerrit.wikimedia.org/r/1305792 (owner: 101Veertje) [00:50:30] (03Abandoned) 101Veertje: Move footer and attribution inside the login form card [software/gerrit] (wmf/stable-3.10) - 10https://gerrit.wikimedia.org/r/1305791 (owner: 101Veertje) [00:52:26] (03Abandoned) 101Veertje: Footer and attribution in white box matching form card [software/gerrit] (wmf/stable-3.10) - 10https://gerrit.wikimedia.org/r/1305790 (owner: 101Veertje) [00:53:09] (03Abandoned) 101Veertje: Add dark backdrop to footer and attribution for contrast over background images [software/gerrit] (wmf/stable-3.10) - 10https://gerrit.wikimedia.org/r/1305789 (owner: 101Veertje) [00:56:23] (03Abandoned) 101Veertje: Add footer links (Code of Conduct, Privacy Policy, Reset Password) with non-breaking space [software/gerrit] (wmf/stable-3.10) - 10https://gerrit.wikimedia.org/r/1305796 (owner: 101Veertje) [00:56:47] (03Abandoned) 101Veertje: Fix login form: use label elements instead of th for accessibility [software/gerrit] (wmf/stable-3.10) - 10https://gerrit.wikimedia.org/r/1305742 (owner: 101Veertje) [00:56:58] (03Abandoned) 101Veertje: Use full-original Commons URLs (no thumbnails) + fix author credits [software/gerrit] (wmf/stable-3.10) - 10https://gerrit.wikimedia.org/r/1305788 (owner: 101Veertje) [00:57:08] (03Abandoned) 101Veertje: Background rotation: add license links and Commons file page links to attribution [software/gerrit] (wmf/stable-3.10) - 10https://gerrit.wikimedia.org/r/1305787 (owner: 101Veertje) [00:57:21] (03Abandoned) 101Veertje: Use 1920px thumbnails (API thumburl) instead of full-res originals [software/gerrit] (wmf/stable-3.10) - 10https://gerrit.wikimedia.org/r/1305794 (owner: 101Veertje) [00:57:33] (03Abandoned) 101Veertje: Add preload link in head for faster background image loading [software/gerrit] (wmf/stable-3.10) - 10https://gerrit.wikimedia.org/r/1305795 (owner: 101Veertje) [00:57:44] (03Abandoned) 101Veertje: Add daily background rotation from Wikimedia Commons (29 winter landscapes) [software/gerrit] (wmf/stable-3.10) - 10https://gerrit.wikimedia.org/r/1305786 (owner: 101Veertje) [00:57:54] (03Abandoned) 101Veertje: Add featured desktop backgrounds (98 sampled) with winter/featured date switching [software/gerrit] (wmf/stable-3.10) - 10https://gerrit.wikimedia.org/r/1305793 (owner: 101Veertje) [00:59:44] (03Abandoned) 101Veertje: Fix login form: responsive labels and mobile-friendly layout [software/gerrit] (wmf/stable-3.10) - 10https://gerrit.wikimedia.org/r/1305745 (owner: 101Veertje) [01:17:42] 06Release-Engineering-Team (Radar), 06Infrastructure-Foundations, 06SRE, 13Patch-For-Review, 07User-notice: Sunsetting mirrors.wikimedia.org - https://phabricator.wikimedia.org/T416707#12057193 (10vaughnwalters) [02:36:11] 10Beta-Cluster-Infrastructure, 10Continuous-Integration-Config, 10Continuous-Integration-Infrastructure, 07Jenkins, and 3 others: Move beta cluster automatic deployment to a dedicated infrastructure - https://phabricator.wikimedia.org/T256168#12057340 (10Krinkle) Updated: * https://wikitech.wikimedia.org/w... [02:55:27] (03open) 10krinkle: Stop branching WikimediaApiPortal for wmf [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/250 (https://phabricator.wikimedia.org/T418494 https://phabricator.wikimedia.org/T429373 https://phabricator.wikimedia.org/T429374) [06:07:46] 10Gerrit, 06collaboration-services: Gerrit backups are growing - https://phabricator.wikimedia.org/T411583#12057520 (10ABran-WMF) based on `ncdu`, this is the top five of directories in /srv/gerrit which we backup: ` 56.6 GiB [########################] /site_path 52.9 GiB [###################### ] /git... [06:13:52] 10Gerrit, 06collaboration-services: Gerrit backups are growing - https://phabricator.wikimedia.org/T411583#12057524 (10jcrespo) Why are there 3 copies of what seems historic versions of the same files? Do we need to copy all 3 every hour? ` /git /git.2019-10-24 /git.2019-10-22 ` What about cache, do we need... [06:16:22] 10Gerrit, 06collaboration-services, 13Patch-For-Review: Gerrit backups are growing - https://phabricator.wikimedia.org/T411583#12057527 (10ABran-WMF) >>! In T411583#12057524, @jcrespo wrote: > What about cache, do we need to backup that? yes! because otherwise recovery would take ages. copies have been [[... [06:17:37] (03update) 10hashar: Stop branching WikimediaApiPortal for wmf [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/250 (https://phabricator.wikimedia.org/T418494 https://phabricator.wikimedia.org/T429373 https://phabricator.wikimedia.org/T429374) (owner: 10krinkle) [06:26:01] (03merge) 10hashar: Stop branching WikimediaApiPortal for wmf [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/250 (https://phabricator.wikimedia.org/T418494 https://phabricator.wikimedia.org/T429373 https://phabricator.wikimedia.org/T429374) (owner: 10krinkle) [06:40:37] (03CR) 10Hashar: jjb: trace git HTTPS transport on gated quibble jobs to debug gerrit resets (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/1305393 (https://phabricator.wikimedia.org/T429749) (owner: 10Arnaudb) [07:32:01] (03PS4) 10Arnaudb: jjb: trace git HTTPS transport on gated quibble jobs to debug gerrit resets [integration/config] - 10https://gerrit.wikimedia.org/r/1305393 (https://phabricator.wikimedia.org/T429749) [07:58:26] 10GitLab (CI & Job Runners), 06Release-Engineering-Team, 06collaboration-services, 13Patch-For-Review: Remove buildkit helper image docker/dockerfile-copy from build pipeline - https://phabricator.wikimedia.org/T321316#12057799 (10Jelto) [08:54:51] (03PS1) 10Techwizzie: Generate coverage reports for Wanda [integration/config] - 10https://gerrit.wikimedia.org/r/1305859 [08:57:18] (03PS2) 10Techwizzie: Generate coverage reports for Wanda [integration/config] - 10https://gerrit.wikimedia.org/r/1305859 [09:18:40] 10Gerrit, 06collaboration-services, 13Patch-For-Review: Gerrit backups are growing - https://phabricator.wikimedia.org/T411583#12058204 (10jcrespo) Sadly, all changes don't seem to have impacted the total backup size: ` id: 723055, ts: 2026-06-26 04:00:16, type: I, status: T, bytes: 31725911808 id: 723183,... [09:41:12] 06Release-Engineering-Team, 10Scap: https://versions.toolforge.org/ shows group2 as partially-deployed - https://phabricator.wikimedia.org/T430159#12058314 (10Aklapper) https://versions.toolforge.org/ looks correct now. Plus https://gitlab.wikimedia.org/repos/releng/release/-/commit/7bffd5104c55a12e1d7bd1962d9... [09:48:49] 10GitLab (Account Approval): Pending approval from GitLab administrator - https://phabricator.wikimedia.org/T430287 (10AadarshM07) 03NEW [10:06:15] 10GitLab (Account Approval): Pending approval from GitLab administrator - https://phabricator.wikimedia.org/T430287#12058418 (10Aklapper) Hi and welcome! Which project(s) in GitLab do you plan to work on? [11:36:55] 10GitLab (Account Approval): Request to unlock GitLab account for [Your Username] for contributing to TestKitchen (T429059) - https://phabricator.wikimedia.org/T430301 (10Zaidusyy) 03NEW [11:37:13] 10GitLab (Account Approval): Pending approval from GitLab administrator - https://phabricator.wikimedia.org/T430287#12058809 (10AadarshM07) Hi @Aklapper , I am working on the Indic Wikimedia Hackathon Hyderabad 2026. [11:43:51] 10GitLab (Account Approval): Request to unlock GitLab account for Zaidusyy for contributing to TestKitchen (T429059) - https://phabricator.wikimedia.org/T430301#12058819 (10Zaidusyy) [11:44:37] 10GitLab (Account Approval), 06Release-Engineering-Team (Doing 😎): Pending approval from GitLab administrator - https://phabricator.wikimedia.org/T430287#12058820 (10Aklapper) 05Open→03Resolved a:03Aklapper Access granted. Happy hacking! [11:45:49] 10GitLab (Account Approval), 06Release-Engineering-Team (Doing 😎): Request to unlock GitLab account for Zaidusyy for contributing to TestKitchen (T429059) - https://phabricator.wikimedia.org/T430301#12058824 (10Aklapper) 05Open→03Resolved a:03Aklapper Access granted. Happy hacking! [11:50:15] 10GitLab (Account Approval), 06Release-Engineering-Team (Doing 😎): Request to unlock GitLab account for Zaidusyy for contributing to TestKitchen (T429059) - https://phabricator.wikimedia.org/T430301#12058844 (10Zaidusyy) Thank you for granting access and for the quick response. I appreciate your help :) [13:30:06] (03CR) 10Hashar: [C:03+2] Zuul: [mediawiki/extensions/AtMentions] Re-enable master jobs [integration/config] - 10https://gerrit.wikimedia.org/r/1305386 (owner: 10Hslater) [13:30:07] (03CR) 10Hashar: [C:03+2] Zuul: [mediawiki/extensions/ContainerFilter] Re-enable master jobs [integration/config] - 10https://gerrit.wikimedia.org/r/1305663 (owner: 10Hslater) [13:32:06] (03Merged) 10jenkins-bot: Zuul: [mediawiki/extensions/AtMentions] Re-enable master jobs [integration/config] - 10https://gerrit.wikimedia.org/r/1305386 (owner: 10Hslater) [13:32:08] (03Merged) 10jenkins-bot: Zuul: [mediawiki/extensions/ContainerFilter] Re-enable master jobs [integration/config] - 10https://gerrit.wikimedia.org/r/1305663 (owner: 10Hslater) [13:32:21] (03CR) 10Hashar: [C:03+2] Generate coverage reports for Wanda [integration/config] - 10https://gerrit.wikimedia.org/r/1305859 (owner: 10Techwizzie) [13:33:06] (03PS3) 10Hashar: Zuul: generate coverage reports for Wanda [integration/config] - 10https://gerrit.wikimedia.org/r/1305859 (owner: 10Techwizzie) [13:33:20] (03CR) 10Hashar: [C:03+2] Zuul: generate coverage reports for Wanda [integration/config] - 10https://gerrit.wikimedia.org/r/1305859 (owner: 10Techwizzie) [13:35:07] (03Merged) 10jenkins-bot: Zuul: generate coverage reports for Wanda [integration/config] - 10https://gerrit.wikimedia.org/r/1305859 (owner: 10Techwizzie) [13:38:43] (03CR) 10Hashar: [C:03+2] "@sanjayipscoc@gmail.com I have manually triggered CI on the last change that got merged: Id21c36a9ef76129570c9bf62ac0c665ddfe41574 . The " [integration/config] - 10https://gerrit.wikimedia.org/r/1305859 (owner: 10Techwizzie) [13:42:04] 10Gerrit, 06collaboration-services: Gerrit backups are growing - https://phabricator.wikimedia.org/T411583#12059117 (10Dzahn) Those `git.2019*` directories are there from incidents in the past when git was messed up. I think Tyler worked on them back then. Since those are now years old I am pretty sure we coul... [13:45:12] 10Gerrit, 06collaboration-services: Gerrit backups are growing - https://phabricator.wikimedia.org/T411583#12059141 (10Dzahn) >>! In T411583#12058204, @jcrespo wrote: > | gerrit.wikimedia.org.https.access.log | 1830315220 | It seems like excluding the logs only had an impact on future backups but that... [13:59:45] !log T429658 krinkle@doc2003:/srv/doc/cover-extensions$ sudo -u doc-uploader rm -rf ShortUrl/ [13:59:47] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [13:59:47] T429658: Archive the ShortUrl extension - https://phabricator.wikimedia.org/T429658 [13:59:57] !log T429658 krinkle@doc1004:/srv/doc/cover-extensions$ sudo -u doc-uploader rm -rf ShortUrl/ [13:59:59] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [14:14:01] 10Beta-Cluster-Infrastructure: Error during startup of php8.3-fpm on deployment-jobrunner05.deployment-prep - https://phabricator.wikimedia.org/T430062#12059374 (10dancy) 05Open→03Declined [14:28:29] 10Continuous-Integration-Config, 10MinervaNeue, 05MW-1.47-notes (1.47.0-wmf.9; 2026-06-30): A MinervaNeue resourceloader module has hard dependency on Echo - https://phabricator.wikimedia.org/T429501#12059464 (10Jdlrobson-WMF) 05Open→03Resolved [14:30:47] (03PS1) 10Aude: Zuul: [mediawiki/extensions/Chart] Add Scribunto dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1305909 (https://phabricator.wikimedia.org/T430324) [14:33:16] (03PS1) 10Aude: Revert "Zuul: [mediawiki/extensions/WikimediaMaintenance] Add ReadingLists dependency" [integration/config] - 10https://gerrit.wikimedia.org/r/1305910 [14:34:51] (03CR) 10CI reject: [V:04-1] Revert "Zuul: [mediawiki/extensions/WikimediaMaintenance] Add ReadingLists dependency" [integration/config] - 10https://gerrit.wikimedia.org/r/1305910 (owner: 10Aude) [14:39:20] (03PS2) 10Aude: Revert "Zuul: [mediawiki/extensions/WikimediaMaintenance] ReadingLists dependency" [integration/config] - 10https://gerrit.wikimedia.org/r/1305910 [14:41:18] (03CR) 10CI reject: [V:04-1] Revert "Zuul: [mediawiki/extensions/WikimediaMaintenance] ReadingLists dependency" [integration/config] - 10https://gerrit.wikimedia.org/r/1305910 (owner: 10Aude) [14:43:20] (03PS3) 10Aude: Revert "Zuul: [mediawiki/extensions/WikimediaMaintenance] ReadingLists dep" [integration/config] - 10https://gerrit.wikimedia.org/r/1305910 [14:45:24] (03CR) 10CI reject: [V:04-1] Revert "Zuul: [mediawiki/extensions/WikimediaMaintenance] ReadingLists dep" [integration/config] - 10https://gerrit.wikimedia.org/r/1305910 (owner: 10Aude) [14:58:15] 10Beta-Cluster-Infrastructure, 06Data-Platform-SRE (2026-06-05 - 2026-06-26): Write lightweight OCI-image-based Puppet plans for beta cluster - https://phabricator.wikimedia.org/T425585#12059623 (10bking) OK, I have addressed the above concerns: [x] Attached/formatted/mounted/moved OpenSearch data a 60 GB cind... [14:58:37] 10Beta-Cluster-Infrastructure, 06Data-Platform-SRE (2026-06-05 - 2026-06-26): Write lightweight OCI-image-based Puppet plans for beta cluster - https://phabricator.wikimedia.org/T425585#12059627 (10bking) 05In progress→03Resolved [15:11:50] (03PS4) 10Aude: Revert "Zuul: [mediawiki/extensions/WikimediaMaintenance] ReadingLists dep" [integration/config] - 10https://gerrit.wikimedia.org/r/1305910 [15:12:26] (03PS5) 10Aude: Revert "Zuul: [mediawiki/extensions/WikimediaMaintenance] RL dep" [integration/config] - 10https://gerrit.wikimedia.org/r/1305910 [15:12:40] (03PS6) 10Aude: Revert "Zuul: [mediawiki/extensions/WikimediaMaintenance] RL dep" [integration/config] - 10https://gerrit.wikimedia.org/r/1305910 [15:41:42] (03CR) 10Hashar: [C:03+2] Revert "Zuul: [mediawiki/extensions/WikimediaMaintenance] RL dep" [integration/config] - 10https://gerrit.wikimedia.org/r/1305910 (owner: 10Aude) [15:43:27] (03Merged) 10jenkins-bot: Revert "Zuul: [mediawiki/extensions/WikimediaMaintenance] RL dep" [integration/config] - 10https://gerrit.wikimedia.org/r/1305910 (owner: 10Aude) [16:03:04] 06Release-Engineering-Team (Priority Backlog 📥), 05Release, 05Train Deployments: 1.47.0-wmf.8 deployment blockers - https://phabricator.wikimedia.org/T423917#12059891 (10thcipriani) 05Open→03Resolved >>! In T423917#12056375, @cscott wrote: > ##### Risky Patch! 🚂🔥 > > * **Change**: https://gerrit.w... [16:55:01] 10Beta-Cluster-Infrastructure: Beta cluster access via open proxies (due to internet censorship) - https://phabricator.wikimedia.org/T428989#12060061 (10bd808) 05Open→03Declined Blocks exist because of {T420833} and prior AI crawler attacks. Requests to open network ranges attached to specifically known... [16:55:41] 10Beta-Cluster-Infrastructure: No Puppet resources found on instance deployment-cirrussearch13 on project deployment-prep - https://phabricator.wikimedia.org/T429035#12060070 (10bd808) 05Open→03Invalid [16:57:26] 10Beta-Cluster-Infrastructure: Puppet agent failure detected on instance deployment-db16 in project deployment-prep - https://phabricator.wikimedia.org/T429257#12060107 (10bd808) 05Open→03Invalid `lang=shell-session bd808@deployment-db16:~$ sudo -i puppet agent -tv Info: Using environment 'production' In... [17:00:46] 10Beta-Cluster-Infrastructure, 10MediaWiki-Language-converter, 13Patch-Needs-Improvement: (Develop spec for) Test wiki for English language variants - https://phabricator.wikimedia.org/T143628#12060116 (10bd808) 05Open→03Declined No significant movement in 10 years. Let's call this a good idea that n... [17:01:11] dduvall: This patch is me trying to not backup VMs that are trivial to regenerate from scratch: https://gerrit.wikimedia.org/r/c/operations/puppet/+/1305937/2/modules/profile/templates/wmcs/backy2/wmcs_backup_instances.yaml.erb <- do my patterns for gitlab-runners and zuul look right to you? And are there other CI server sets that you think I can exclude? [17:03:33] I am surprised to see deployment servers in that list. Those strike me as one of the _least_ trivial to re-create. [17:04:00] same for puppet-diffs [17:04:43] in puppet-diffs I just exclude worker nodes don't I? [17:05:07] my recollection with deployment-prep is that we just didn't have room for them before. But I'll strike those lines for now and see how it goes [17:05:23] (although maybe not the docker workers because surely they can be recreacted trivially from puppet) [17:07:16] mutante: https://gerrit.wikimedia.org/r/c/operations/puppet/+/1305943 [17:08:31] andrewbogott: I don't know, maybe I should not make judgement calls on puppet-diffs. I just think it's a combo of "used by many every day" plus "unclear ownership" [17:08:54] andrewbogott: I can make one other comment though: devtools does not have an instance called "deployment-docker" [17:09:27] it's called deploy-1006 but let's keep it included [17:09:45] the actual puppet-diff runs are stored on NFS, so excluding the worker nodes shouldn't matter. [17:09:59] not sure what I was trying to do with devtools, looking... [17:11:02] I don't have an opinion on instances in deployment-prep. only on devtools and maybe zuul. [17:11:12] I think the devtools thing is a copy/paste error and I meant to exclude gitlab-runner-* [17:11:16] ok if I drop those? [17:11:19] puppet-diffs - important to have is all I can say [17:12:36] well, a gitlab-runner in the devtools project is by definition a test host [17:13:04] ok here's the latest: https://gerrit.wikimedia.org/r/c/operations/puppet/+/1305937/3/modules/profile/templates/wmcs/backy2/wmcs_backup_instances.yaml.erb [17:13:09] but a runner- in the gitlab-runners project is basically production [17:13:36] Right, but the question here is not "will losing this host cause downtime" the question is "are these cattle or pets?" [17:13:43] you don't back up cattle because you can just get more cattle. [17:13:55] * andrewbogott tortures the metaphor [17:15:54] I don't want to make that call by myself in an adhoc chat. Can I just add more reviewers and/or bring it up in my team. [17:16:27] curious.. is there an option to have a backup of _one_ of the machines but not all? [17:17:31] yes if you write me the convoluted regex that does that [17:17:54] but I still don't think it's meaningful to backup something that we can generate directly from a puppet prefix [17:18:57] Especially since there is 0 chance we can order an additional backup server this year since they now cost millions of dollars :( [17:20:11] but anyway, yes, feel free to add more reviewers. [17:20:26] well, either we have backups or we don't but excluding the most important things that are basically production seems at least surprising [17:23:02] will bring it up in the team. I think more input before casually merging it would be warranted. [17:24:02] I don't disagree with what you're saying, but I still maintain that "important for day-to-day use" and "difficult to recreate" are two different metrics. [17:24:46] Kernels are important but we don't back up the individual kernel of every server in prod [17:24:58] Or every k8s worker node [17:25:13] I guess in my experience almost nothing is truly trivial to recreate [17:25:21] at least if you have nothing to compare it to [17:25:42] sure, some worker nodes .. probably dont need all of them [17:26:22] hence the thought to have maybe one [17:26:50] that makes sense, although I sure hope that everything about those nodes is fully represented in puppet. Dan would know for sure. [17:31:37] andrewbogott: i would check with bd808 about deployment-prep instances [17:32:11] "do my patterns for gitlab-runners and zuul look right to you? And are there other CI server sets that you think I can exclude?" ? [17:34:08] just to better understand the implications, does this seem that servers that are not excluded will be updated/restarted automatically or is this solely about backups? [17:35:04] if it's just about backups, the gitlab-runner and zuul patterns look good to me [17:35:28] ...I don't understand the question about updated/restarted. [17:35:35] That's a list of hosts that are excluded from nightly backups. [17:35:51] (just the / drives; cinder volumes are handled elsewhere) [17:36:26] Is there likely to be a host of runner agents in the zuul3 project as well, or is that one just test/dev? [17:36:44] just checking that there wasn't some other use for the list beyond backups. sounds good! [17:36:53] and i see you have integration instances too, good good [17:37:02] you can exclude zuul3 stuff too [17:37:12] the whole project, or just certain hostnames? [17:37:18] whole project is fine [17:37:26] great! thank you [17:37:38] np [17:38:46] andrewbogott: i don't know about devtools either. maybe... jeena knows? [17:40:04] I looked at the backscroll and I don't follow [17:40:13] What devtools? [17:40:50] jeena, there are two hosts in the devtools project, gitlab-runner-[1007-1008] [17:41:11] I'm assuming that because of the generic name, those are puppet-generated hosts and it would be easy to make two more if the existing two were lost [17:41:28] * andrewbogott is trying to prune the set of backed up VMs to fit in backup storage [17:41:29] Oh I see...I don't know anything about that project [17:41:44] Re devtools: Jelto & Brennen are the right folks [17:41:49] Mostly Jelto I would say [17:41:53] ok! [17:42:41] please do not exclude any host in devtools. I commit to give you feedback on that project on Monday. [17:43:14] see https://phabricator.wikimedia.org/T429494 - WIP [17:46:11] * andrewbogott feels like he stumbled into a freudian free-association session [17:55:10] andrewbogott: seems like it would help to split the patch up by project owners and request review in gerrit. give folks time to send it around ownership circles if they don't have enough context, especially for things that have no real owner but are used by many folks like puppet-diff [17:55:27] you can add me as a reviewer for the gitlab-runner/zuul parts [18:34:12] 10Phabricator, 07affects-Miraheze: Rename user “31740” to `beedell.roke_julian_lockhart`. - https://phabricator.wikimedia.org/T430357 (10rokejulianlockhart) 03NEW [18:36:24] 10Phabricator: Rename user “31740” to `beedell.roke_julian_lockhart`. - https://phabricator.wikimedia.org/T430357#12060428 (10Pskyechology) [18:36:54] 10Phabricator: Rename user “31740” to `beedell.roke_julian_lockhart`. - https://phabricator.wikimedia.org/T430357#12060431 (10rokejulianlockhart) Thanks. Didn't mean to have that added; I imagine a bot did so. [18:42:33] 10Phabricator, 10MoveComms-Support: Requests for changes of the automated weekly Phabricator data for Tech News - https://phabricator.wikimedia.org/T428290#12060436 (10Aklapper) [18:43:56] (03update) 10dancy: scap.cfg: mediawiki_image_extra_packages netcat -> netcat-openbsd [repos/releng/train-dev] - 10https://gitlab.wikimedia.org/repos/releng/train-dev/-/merge_requests/183 [18:43:57] (03open) 10dancy: scap.cfg: mediawiki_image_extra_packages netcat -> netcat-openbsd [repos/releng/train-dev] - 10https://gitlab.wikimedia.org/repos/releng/train-dev/-/merge_requests/183 [18:45:03] (03merge) 10dancy: scap.cfg: mediawiki_image_extra_packages netcat -> netcat-openbsd [repos/releng/train-dev] - 10https://gitlab.wikimedia.org/repos/releng/train-dev/-/merge_requests/183 [18:47:27] 06Project-Admins, 06Release-Engineering-Team (Doing 😎): Request for project "User-tfogli" for organizing my personal workboard - https://phabricator.wikimedia.org/T430128#12060453 (10Aklapper) 05Open→03Resolved a:03Aklapper Requested public project has been created: #User-tappof (we use on Phab usern... [18:48:31] 10Phabricator (Upstream), 07Upstream: Typos on various codes? - https://phabricator.wikimedia.org/T430097#12060458 (10Aklapper) [18:48:32] 10Phabricator, 06Release-Engineering-Team (Priority Backlog 📥): Update to Phorge/Arcanist upstream 202x-xx-xx - https://phabricator.wikimedia.org/T428547#12060459 (10Aklapper) [18:54:00] 10Phabricator, 06Release-Engineering-Team (Doing 😎): Rename user “31740” to `beedell.roke_julian_lockhart`. - https://phabricator.wikimedia.org/T430357#12060464 (10Aklapper) 05Open→03Resolved a:03Aklapper [19:29:09] (03open) 10dancy: make-container-image: Build image source files owned by 'app', not www-data [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/251 (https://phabricator.wikimedia.org/T411063) [22:27:38] (03PS1) 10Eric Gardner: Add PageImages to MultimediaViewer's phan (and test) dependencies [integration/config] - 10https://gerrit.wikimedia.org/r/1305998