[07:33:03] 10serviceops, 10Release-Engineering-Team, 10SRE, 10Scap: Deploy Scap version 4.8.2 - https://phabricator.wikimedia.org/T309116 (10JMeybohm) Deployed to canaries, scap pull looks fine [07:40:41] found this little interesting project the other day. https://github.com/stefanprodan/podinfo [07:41:03] showcases some nice standard ways of setting up interaction points for services [07:44:15] 10serviceops, 10Infrastructure-Foundations, 10Scap, 10Release-Engineering-Team (Priority Backlog 📥): Use scap to deploy itself to scap targets - https://phabricator.wikimedia.org/T303559 (10jnuche) [08:19:07] and such a cute mascot! [08:51:34] 10serviceops, 10GitLab (Infrastructure), 10Patch-For-Review: bring new gitlab hardware servers into production - https://phabricator.wikimedia.org/T307142 (10Jelto) >>! In T307142#7976964, @Jelto wrote: > ... > I'll check bacula tomorrow for new backups of `gitlab1004` and make sure the replicas synced prope... [08:52:04] 10serviceops, 10GitLab (Infrastructure), 10Patch-For-Review: bring new gitlab hardware servers into production - https://phabricator.wikimedia.org/T307142 (10Jelto) [15:07:30] 10serviceops, 10Data-Persistence-Backup, 10GitLab (Infrastructure), 10Patch-For-Review, 10User-brennen: Backups for GitLab - https://phabricator.wikimedia.org/T274463 (10Jelto) After migrating to new hosts (T307142) we got a bacula alert about backups on `gitlab1001` (the old production machine): ` PROB... [15:12:53] 10serviceops, 10GitLab (Infrastructure), 10Patch-For-Review: bring new gitlab hardware servers into production - https://phabricator.wikimedia.org/T307142 (10Jelto) >>! In T307142#7978386, @Jelto wrote: > ... > One rsync job failed on the old production host `gitlab1001`. I'll take a closer look. I assume th... [15:30:43] 10serviceops, 10Data-Persistence-Backup, 10GitLab (Infrastructure), 10Patch-For-Review, 10User-brennen: Backups for GitLab - https://phabricator.wikimedia.org/T274463 (10jcrespo) Bacula is now happy: `Fresh: 116 jobs` Note on first setup, the backup check is quite sensitive, so anything that is not a su...