[02:22:55] <wm-bb>	 <harej> andrewbogott: can you confirm that the DB volume is, once again, full? (I'm about ready to change tactics on this project)
[02:25:33] <andrewbogott>	 harej, /dev/sdb        216G  205G  352K 100% /var/lib/postgresql
[02:25:35] <andrewbogott>	 full
[02:31:54] <wm-bb>	 <harej> There we go. 220 GB *should have* been enough – my own computer reports that it's only 172 GB – but I am not going to ask for some unbounded quota.
[02:32:31] <wm-bb>	 <harej> Thank you for your help, this was perhaps not a good demonstration dataset.
[08:01:46] <majavah>	 !log toolsbeta replace toolsbeta-sgeexec-1002 with -1004 for T287666
[08:01:50] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Toolsbeta/SAL
[08:01:50] <stashbot>	 T287666: toolsbeta-sgeexec-1001/2: buster sgeexec apt fails to write to /tmp - https://phabricator.wikimedia.org/T287666
[08:32:17] <wm-bb>	 <yuvipanda> is there docs on self-merge guidelines for operations/puppet/
[10:06:56] <dcaro>	 yuvipanda: I don't remember anything specific, I know it's generally frowned upon, unless they are very small changes or they fix some critical urgent issue (not sure if that's what you are asking xd)
[13:44:31] <albertoleoncio>	 Question: How do I debug a 502 Bad Gateway error on my tool at toolforge?
[13:46:11] <albertoleoncio>	 I'm getting this error since yesterday, but I don't see a error.log to track it down
[13:49:25] <majavah>	 albertoleoncio: hi, which tool?
[13:50:00] <albertoleoncio>	 alberobot
[13:50:53] <albertoleoncio>	 Hi! :-D
[13:55:22] <majavah>	 albertoleoncio: I'm not exactly sure what happened to it, but I restarted your webservice (using `webservice restart` as your tool account) and now it seems to work again
[13:56:56] <albertoleoncio>	 majavah: Oh, ok. I'll try it if happens again. Thanks!
[15:56:08] <doctaxon>	 Hello, I have been in the wrong channel, here I'm right:
[15:56:14] <doctaxon>	 15:36 < doctaxon> Hi, I tried to contact anyone in Phabricator but got nobody: It's about the task T245965
[15:56:14] <stashbot>	 T245965: Image links from #ifexist:Media:... are not being registered properly on tawiktionary - https://phabricator.wikimedia.org/T245965
[15:56:17] <doctaxon>	 15:36 < stashbot> T245965: Image links from #ifexist:Media:... are not being registered properly on tawiktionary - https://phabricator.wikimedia.org/T245965
[15:56:20] <doctaxon>	 15:37 < doctaxon> I think the change in Mediawiki software isn't good, to get file names in image link table from images, which have been filtered by the ifexist-clause in templates. So I get images in the database query result, which are not linked from the page.
[15:57:02] <doctaxon>	 related to: git #66f7d36e - Record #ifexist media in imagelinks table (task T245965) by TChin“
[16:13:03] <bd808>	 doctaxon: this does sound frustrating for you. I think your messages about this same issue in the #mediawiki irc channel were sent to the correct place really. There are people in this channel who are affected by the data in the same way that you are, but any changes to fix this are a MediaWiki issue and not a Wikimedia Cloud issue.
[16:18:08] <doctaxon>	 thank you, but I am not frustrated but hope to find a good solution with mediawiki databse people
[20:16:37] <wm-bb>	 <harej> I am trying to delete my volume "dbdeploy" which is mounted to a VM which has since been deleted. You can't delete attached volumes so I tried unattaching it and was not able to.
[21:49:17] <bstorm>	 That's interesting harej. Which project is that?
[23:09:15] <wm-bb>	 <harej> bstorm: wikicite
[23:11:43] <bstorm>	 harej: shall I attempt to delete just to see what happens? There could be an issue with who is allowed to delete them, and my account has a lot of privs so it would tell us something at least. 
[23:18:04] <wm-bb>	 <harej> It might be a privileges thing, it told me I was not "allowed" or something.
[23:20:12] <bstorm>	 Can you make a ticket actually? That way I can both record deleting it on my end and track work to fix users being able to delete their things.
[23:28:34] <bstorm>	 I'd rather not blow away 100G of possible data without a persistent record at least :)
[23:29:31] <wm-bb>	 <harej> bstorm: problem appeared to resolve on its own, thank you though!
[23:29:38] <wm-bb>	 <harej> and, there was no irreplaceable data on that volume
[23:29:42] <bstorm>	 Well, that works :)
[23:29:56] <wm-bb>	 <harej> Or, you did something behind the scenes I didn't notice, thank you for that too
[23:31:47] <bstorm>	 Nah, I can't claim credit, unfortunately. I just sat here thinking hard while hovering over a delete button :)
[23:32:02] <Platonides>	 well, the right person looking at the problem is enough for most of them to go away