[13:15:11] <inflatador>	 I've tried to request a quota update multiple times for `pm20database` with https://cloudvps-quota.toolforge.org/ , it doesn't seem to create a Phab task. Should I just create one manually?
[13:15:32] <inflatador>	 more context in T430976
[13:15:32] <stashbot>	 T430976: Deploy a SPARQL instance for Projekt_Pressearchiv - https://phabricator.wikimedia.org/T430976
[13:50:38] <taavi>	 inflatador: sigh. i'm pretty sure the tool fails because it attempts to calculate the increase percentage which would be a division by zero in that case. so yeah, please file a task manually, I'll file one about the tool failing
[13:53:20] <inflatador>	 taavi ACK, np. Thanks for taking a look
[14:04:19] <inflatador>	 OK, T433839 is submitted
[14:04:20] <stashbot>	 T433839: Quota increase request for project pm20database - https://phabricator.wikimedia.org/T433839
[15:10:25] <andrewbogott>	 !status cloud-wide scratch NFS maintenance in progress
[15:14:05] <andrewbogott>	 !log cloudinfra-nfs running the migration cookbook for T433426
[15:14:09] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Cloudinfra-nfs/SAL
[15:14:09] <stashbot>	 T433426: Replace scratch-1.cloudinfra-nfs with a trixie VM - https://phabricator.wikimedia.org/T433426
[15:30:30] <wm-bb>	 <Yetkin> "webservice shell" gets stuck on terminal. Why?
[15:34:22] <dcaro>	 Yetkin, which tool?
[15:35:11] <wm-bb>	 <Yetkin> on bastion, after SSH...
[15:35:21] <wm-bb>	 <Yetkin> tool: superyetkin
[15:37:03] <dcaro>	 oh, we are working on it already :)
[15:37:39] <wm-bb>	 <Yetkin> you? working on what? 😊
[15:38:18] <dcaro>	 sorry, on the fix
[15:38:30] <dcaro>	 for the stuck webservice shell
[15:38:42] <wm-bb>	 <Yetkin> ok buddy, waiting
[15:49:51] <dcaro>	 !status incident ongoing, vms using scratch nfs and toolforge tools using nfs affected
[16:14:53] <andrewbogott>	 !status incident ongoing; some pods using scratch nfs are stuck but admins are rescheduling them
[16:14:54] <wmopbot>	 Too long status
[16:15:24] <andrewbogott>	 huh
[16:15:36] <andrewbogott>	 !status incident ongoing; pods using scratch nfs are stuck and rescheduling
[18:25:49] <bliviero>	 andrewbogott: it's been a couple of hours, is everything back to normal now?  (if so, status could be reset..)
[18:26:12] <andrewbogott>	 reboots are still underway. Lots of worker nodes!
[19:08:50] <wm-bot>	 !log valeriobozzolan@tools-bastion-15 tools.itwiki Updated deletionbot https://gitlab.wikimedia.org/valeriobozzolan/itwiki-deletions-info-bot/-/commit/999a5e7ac93feec5f1f0f6a640b6e80478935ecf
[19:08:53] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.itwiki/SAL
[20:07:04] <wm-bot>	 !log valeriobozzolan@tools-bastion-15 tools.itwiki deletionbot: testing in production lol
[20:07:06] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.itwiki/SAL
[20:40:46] <andrewbogott>	 !status ok
[21:47:41] <bawolff>	 Question: How strict are we on floating IP quota? I'm helping some people migrate their (utterly undocumented) cloud vps instance to new debian. Is me wanting to test the new instance without pulling the plug on the existing instance (yet) a valid reason to request a second floating IP?
[21:53:15] <bawolff>	 actually screw it, I'm just going to be bold about the whole thing
[23:02:53] <wm-bb>	 <harej> True heroes experiment in production