[08:25:00] <schiste>	 Question, I have a data project where I need to process bz2 archives to compute metrics. End goal will be to do all projects, but while building I'll use only nlwiki data to have a smaller storage need. If I store everything it would be around 9GB, if I drop raw data (which I can do but will mean redowloading each archives to reprocess data when we make big changes) I go down to around 3GB.
[08:26:21] <schiste>	 And only output and analytical data should be a bit below 1GB. Those are data that are not already computed by other tools I checked. My question becomes, should I proceed in looking at Toolforge as a hosting platform (so far I've only been running it locally)? I couldn't find hard numbers on storage, but I feel I'd be way over what is sensible.
[08:52:14] <taavi>	 schiste: single digit gigabytes are generally fine, yeah
[09:02:41] <schiste>	 Perfect, thanks taavi :)
[09:10:13] <dcaro>	 schiste: if it's temporary space, shuold be ok, you can use object storage to store the results (https://wikitech.wikimedia.org/wiki/Help:Object_storage_user_guide)
[09:10:30] <dcaro>	 did not see taavi's reply. yep :)
[10:57:59] * dcaro lunch
[11:10:30] <schiste>	 oh right I absolutely forgot we could have object storage. I'll look into it thanks dcaro :)
[13:10:03] <godog>	 !log paws enable maintain-dumps-nfs - T432583
[13:10:07] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Paws/SAL
[13:10:07] <stashbot>	 T432583: Make sure dumps-nfs mounts are propagated inside PAWS containers - https://phabricator.wikimedia.org/T432583
[13:42:49] <wm-bot>	 !log jeanfred@tools-bastion-15 tools.integraality Deploy ea800c5 (Add functional SPARQL tests against live endpoints)
[13:42:51] <wm-bot>	 !log jeanfred@tools-bastion-15 tools.integraality Deploy 881928b (Increase webservice memory limit to 1Gi)
[13:42:51] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.integraality/SAL
[13:42:52] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.integraality/SAL
[14:39:56] <taavi>	 !log paws stop running servers to pick up NFS changes T432583
[14:40:00] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Paws/SAL
[14:40:01] <stashbot>	 T432583: Make sure dumps-nfs mounts are propagated inside PAWS containers - https://phabricator.wikimedia.org/T432583
[15:33:26] <dcaro>	 !log restart tools-puppetserver-01, unresponsive
[15:33:28] <stashbot>	 dcaro: Unknown project "restart"
[15:33:32] <dcaro>	 !log tools restart tools-puppetserver-01, unresponsive
[15:33:33] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL
[15:41:21] <dcaro>	 !log tools tools-puppetserver-01 was out of memory because of java and killed sssd backend
[15:41:24] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL
[23:14:15] <wm-bot>	 !log lucaswerkmeister@tools-bastion-15 tools.quickcategories rm -rf www-unused-since-2024-09-18/ # old source code, venv etc. – 130 MB / 124 MiB
[23:14:17] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.quickcategories/SAL