[09:33:19] FYI, I'm gradually upgrading Java on puppet servers, there might be occasional blips of failing Puppet runs during the restarts [09:47:37] ack! [10:52:20] moritzm: I've accidentally rebooted ganeti2042 when uploading the new license, I missed a flag and it applied the bios config too [10:54:31] no instances on it afaics, got very lucky [10:54:36] sorryyyy will be more careful [10:54:43] I don't see it in the D cluster on codfw [10:55:00] so it might not have been yet put into the cluster [10:56:01] total chance, I'll pay this somewhere in my week to balance my on-call-karma [10:56:09] you were lucky, it was just the broken server I took out of service yesterday: https://phabricator.wikimedia.org/T378358 [10:56:19] very lucky indeed [11:14:03] volans: don't be so judgemental :D [11:19:41] :D [13:28:25] back in my day, we used to reboot hypervisors on purpose ;P [14:41:40] wikitech-static disk is full because the images/archive dir is 60+GB, objections to me running deleteArchivedFiles.php? [14:41:54] It makes the sync fail [14:42:13] (I'll run it in 15/20 minutes if no objections are voiced) [14:42:36] +1 [14:47:43] sigh, +1, is there a timer for it already? [14:50:24] nope [14:54:02] volans: should I run it with --force to delete the rows from the filearchive table or is that unnecessary? [14:59:58] I don't see it run with --force in history, so proceeding to run it just in delete mode [15:02:44] claime: sorry dunno, never run it myself [15:03:02] Great the script doesn't work, returns 0 files deleted. I'm not the first one encoutering the problem, I see some find . -type f | xargs rm in history x) [15:03:59] claime: T348503 is not of much help [15:04:00] T348503: wikitech-static is out of disk - https://phabricator.wikimedia.org/T348503 [15:04:28] yeah