[01:43:25] hi, I have a SQLite database that I'm trying to delete and replace with an updated version, but the old version keeps re-materializing. I think it's because there's a Kubernetes shell pod that might be using that file, but how do I kill it? [01:44:47] Oh, there are instructions on the wiki. [01:46:02] But they don't work for this pod. [01:46:18] This is in the enwikt-translations tool. [02:32:49] Erutuon, what tool? [02:53:12] AntiComposite: enwikt-translations [02:54:21] according to https://k8s-status.toolforge.org/namespaces/tool-enwikt-translations/ there is a shell open and a webservice running [02:54:45] yeah, the shell-1642730971 seems to be un-killable [02:55:00] `kubectl delete pod shell-1642730971` should do it [02:56:58] oh, thanks... that seems to be working [02:57:19] I tried `kubectl get deployment` as the wiki suggested, but it didn't show the shell pod [02:59:32] yeah, the shell pod is just a singleton. it's supposed to be cleaned up by webservice when you leave it, but sometimes that doesn't happen. [02:59:51] `kubectl get all` will show you the everything (the same things as the k8s-status page) [10:12:36] !log maps revert quota changes requested on T299585 [10:12:39] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Maps/SAL [10:12:39] T299585: Request increased quota for maps Cloud VPS project - https://phabricator.wikimedia.org/T299585 [13:40:57] taavi: https://sal.toolforge.org/production returns 505 [13:41:08] *5003 [13:41:13] **500 [13:41:19] keyboard [13:43:15] Happended multiple times in the past: T296072, T259560 [13:43:18] T296072: SAL tool giving intermittent 500 Internal Server Errors - https://phabricator.wikimedia.org/T296072 [13:43:20] T259560: sal.toolforge.org is down - https://phabricator.wikimedia.org/T259560 [13:44:07] basically they need to restart the webservice I think [13:45:36] https://admin.toolforge.org/tool/sal says “they” would be bd808 or yuvipanda [13:45:40] (or any toolforge admin I suppose) [13:47:11] I can get to it in 20 minutes or so. [13:50:46] Thanks - no urgency :) [13:58:25] !log tools.sal restarted webservice [13:58:28] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.sal/SAL [13:58:32] hauskatze: try now? [14:04:40] Thanks taavi. I guess I should try harder to figure out what keeps causing the fcgi worker pool to be exhausted there. [14:33:47] * hauskatze was washing dishes - works now [14:34:30] ty all [14:50:35] !log tools.sal Update to php7.4 runtime; downgrade elasticsearch client to ^6.2.0 [14:50:37] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.sal/SAL