[00:29:36] <mutante>	 crap, gitlab1001 ran out of disk
[00:29:52] <mutante>	 and is therefore down
[00:29:59] <mutante>	 I just freed some space though
[00:30:08] <mutante>	 and ... it's not 500 anymore..phew
[00:31:04] <mutante>	 00:30 <+icinga-wm> RECOVERY - Gitlab HTTPS healthcheck on gitlab.wikimedia.org is OK: HTTP OK: HTTP/1.1 200 OK - 121816 bytes in 0.197 second response time https://wikitech.wikimedia.org/wiki/GitLab%23Monitoring
[00:54:48] <wikibugs>	 10GitLab (Infrastructure), 10Data-Persistence-Backup, 10serviceops, 10Patch-For-Review, 10User-brennen: Backups for GitLab - https://phabricator.wikimedia.org/T274463 (10Dzahn) p:05Medium→03High
[19:03:38] <wikibugs>	 10GitLab (Infrastructure), 10DC-Ops, 10SRE, 10ops-eqiad, 10serviceops: Q3:(Need By: TBD) rack/setup/install gitlab100[3|4] and gitlab-runner100[2|3|4] - https://phabricator.wikimedia.org/T301177 (10Jclark-ctr)
[19:23:56] <wikibugs>	 10GitLab (Infrastructure), 10Data-Persistence-Backup, 10serviceops, 10Patch-For-Review, 10User-brennen: Backups for GitLab - https://phabricator.wikimedia.org/T274463 (10Jelto) >>! In T274463#7830451, @Stashbot wrote: > {nav icon=file, name=Mentioned in SAL (#wikimedia-operations), href=https://sal.toolf...