[00:01:34] <wikibugs>	 10GitLab (Infrastructure), 10serviceops-collab: Migrate gitlab-test instance to bullseye - https://phabricator.wikimedia.org/T318521 (10Dzahn) ` Error: Cannot create /etc/gitlab/config_backup/latest; parent directory /etc/gitlab/config_backup does not exist Error: /Stage[main]/Gitlab::Backup/File[/etc/gitlab/c...
[10:31:00] <wikibugs>	 10GitLab (Infrastructure), 10serviceops-collab, 10Patch-For-Review: Align and refactor GitLab restore scripts - https://phabricator.wikimedia.org/T326315 (10Jelto)
[14:26:25] <wikibugs>	 10GitLab (Infrastructure), 10serviceops-collab, 10Patch-For-Review: Automate GitLab version upgrade process - https://phabricator.wikimedia.org/T323569 (10ops-monitoring-bot) GitLab instance gitlab2002.wikimedia.org upgraded to version 15.5.7-ce.0
[14:34:28] <wikibugs>	 10GitLab (Infrastructure), 10serviceops-collab, 10Patch-For-Review: Automate GitLab version upgrade process - https://phabricator.wikimedia.org/T323569 (10Jelto) I started the cookbook without `--dry-run` and the same GitLab version on the replica (`gitlab2002`). Execution was successful (see above).  I'll o...
[14:34:50] <wikibugs>	 10GitLab (Infrastructure), 10serviceops-collab, 10Patch-For-Review: Automate GitLab version upgrade process - https://phabricator.wikimedia.org/T323569 (10Jelto)
[14:43:56] <wikibugs>	 10GitLab (Infrastructure), 10serviceops-collab: Migrate gitlab-test instance to bullseye - https://phabricator.wikimedia.org/T318521 (10Jelto) Thanks for looking at the test instance! We had the same issue with `gitlab-prod-1001` afair.  There is a [wiki page](https://wikitech.wikimedia.org/wiki/GitLab/Test_In...
[15:00:17] <wikibugs>	 10GitLab (Infrastructure), 10Release-Engineering-Team, 10serviceops-collab: GitLab minor version upgrade 15.7.3 - https://phabricator.wikimedia.org/T326815 (10Jelto)
[18:47:00] <wikibugs>	 10GitLab (Infrastructure), 10serviceops-collab: Migrate gitlab-test instance to bullseye - https://phabricator.wikimedia.org/T318521 (10Dzahn) >>! In T318521#8519718, @Jelto wrote: > We had the same issue with `gitlab-prod-1001` afair. >  > There is a [wiki page](https://wikitech.wikimedia.org/wiki/GitLab/Test...
[18:53:41] <wikibugs>	 10GitLab (Infrastructure), 10serviceops-collab: Migrate gitlab-test instance to bullseye - https://phabricator.wikimedia.org/T318521 (10taavi) How do you expect Let's Encrypt to perform the http-01 validation since gitlab-prod-1002 is not currently publicly accessible? Please be extra careful here that you don...
[18:54:55] <wikibugs>	 10GitLab (Infrastructure), 10serviceops-collab: Migrate gitlab-test instance to bullseye - https://phabricator.wikimedia.org/T318521 (10Dzahn) I don't expect anything, I just blindly follow docs to test if they work and report what happens.
[19:18:42] <wikibugs>	 10GitLab (Infrastructure), 10serviceops-collab: Migrate gitlab-test instance to bullseye - https://phabricator.wikimedia.org/T318521 (10Dzahn) Yes, floating IP / DNS records have to be setup and that makes sense.
[22:59:58] <wikibugs>	 10GitLab (Infrastructure), 10serviceops-collab: Migrate gitlab-test instance to bullseye - https://phabricator.wikimedia.org/T318521 (10Dzahn) 185.15.56.117 is now new floating IP associated with gitlab-prod-1002 (we got away with existing quota).  Existing floating IP is not mapped to instance "mapped fixed a...