[00:40:38] !log tools.eatchabot truncated 4GB uwsgi.log to free space T284968 [00:40:40] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.eatchabot/SAL [00:40:41] T284968: eatchabot using a lot of NFS storage - https://phabricator.wikimedia.org/T284968 [01:18:13] !log admin running a modified version of the prometheus dir size cron in screen T284964 [01:18:16] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [01:18:17] T284964: 2021-06-15: Tools NFS share cleanup - https://phabricator.wikimedia.org/T284964 [09:48:11] Hi. Is it possible to run logrotate via kubernetes? [09:54:55] ma: what are you trying to achieve? [09:58:03] arturo: a tool I own generates logs which I'd like to trim when they exceed some size [09:58:13] and given that there are talks about deprecating cron [09:58:32] I though I'd rather setup that one via k8s [09:58:45] anyway, if it's too complex, I can trim them by hand :-) [09:59:03] yes, we are working on this https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/Toolforge_jobs but is not quite ready yet [09:59:22] I'm not sure if logorate is included in our containers [10:11:46] ma: what kind of tool is it? (kubernetes/grid, webservice, ...) [10:12:15] dcaro: pywikibot logs [10:12:52] I think I'll do it by hand. I know how to do it that way and it won't take time from others :-) [10:13:25] you can try setting up the https://docs.python.org/3/library/logging.handlers.html#logging.handlers.RotatingFileHandler [10:13:38] (if it's using python) that will do the log rotation from the app itself [10:13:52] (so no need for logrotate or other external cron/tool) [10:25:01] dcaro: thanks, I'll take a look at that too :) [12:54:40] !log wm-bot killed a few lingering connections to freenode (wm-bot on freenode is now discontinued) [12:54:42] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Wm-bot/SAL [15:28:21] !log wm-bot copied freenode channel config for #wikimedia-fundraising to libera [15:28:23] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Wm-bot/SAL [15:54:43] !log tools.robokobot truncated 42GB virgule.err file T284964 [15:54:45] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.robokobot/SAL [15:54:46] T284964: 2021-06-15: Tools NFS share cleanup - https://phabricator.wikimedia.org/T284964 [16:08:08] !log tools.persondata truncated 28GB person_bkl2.out T284964 [16:08:11] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.persondata/SAL [16:08:12] T284964: 2021-06-15: Tools NFS share cleanup - https://phabricator.wikimedia.org/T284964 [16:09:59] !log toolsbeta set toolsbeta-bastion-05 as grid submit host [16:10:02] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Toolsbeta/SAL [16:12:53] !log metrics infra add 8 CPU/16G RAM to quota T284973 [16:12:54] balloons: Unknown project "metrics" [16:12:54] T284973: Request increased quota for metricsinfra Cloud VPS project - https://phabricator.wikimedia.org/T284973 [16:12:58] !log metricsinfra add 8 CPU/16G RAM to quota T284973 [16:13:00] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Metricsinfra/SAL [16:15:50] !log tools deleting unused shutdown nodes: tools-checker-03 tools-k8s-haproxy-1 tools-k8s-haproxy-2 [16:15:53] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [16:31:20] !log tools.stimmberechtigung truncated 26GB error.log T284964 [16:31:23] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.stimmberechtigung/SAL [16:31:24] T284964: 2021-06-15: Tools NFS share cleanup - https://phabricator.wikimedia.org/T284964 [18:58:38] !log tools.lexeme-forms deployed 61a5e0fc18 (optional grammatical features) [18:58:40] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.lexeme-forms/SAL [19:02:10] !log tools cleared error status from a few queues [19:02:12] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [19:32:06] !log tools.lexeme-forms deployed d8eadd1cae (more optional grammatical features) [19:32:09] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.lexeme-forms/SAL [20:11:30] !log tools.lexeme-forms deployed 0b6fed0054 (even more optional grammatical features) [20:11:32] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.lexeme-forms/SAL [22:04:53] Is the Telegram bridge something I can configure for my own IRC channel, or is it strictly tied to Wikimedia Cloud? [22:07:22] hare: it's an instance of https://github.com/42wim/matterbridge [22:08:16] (which, despite the name, doesn't require any integration with mattermost) [22:20:50] hare: https://wikitech.wikimedia.org/wiki/Tool:Bridgebot [22:21:51] hare: open a ticket at https://phabricator.wikimedia.org/tag/tool-bridgebot/ if you want me to add a bridge for something at least vaguely wiki related. [22:22:06] I literally just got matterbridge working [22:22:10] it's super easy [22:23:30] I've been running it for a couple of years now with irc<->telegram bridges. I've had some problems with bridging into discord, but that's about it. [22:23:53] are there active discord brisges right now? [22:24:18] it would be nice to bridge the wikisource disocrd server to IRC, since discord is used more (currently) [22:25:58] I have all the discord bridges shutdown right now. I need to make some time to try brining it back up, but haven't been motivated to do that yet [22:26:55] does it normally bridge all the discord rooms to a single IRC channel? [22:27:10] it was bridging discord<->telegram for ukwiki for a while but never very stable. [22:28:01] as it would crash, or hang? [22:28:30] crash and take out all the other bridges which was the real problem [22:29:00] the discord part of matterbridge has gotten some attention from upstream since the last time I tried [22:30:18] hmm [22:34:55] i guess if that's an issue you could run it in a different k8s container [22:35:21] he says, indicating to his grandmother the correct ovisuction technique [22:38:02] :) [22:58:55] !log tools.bridgebot Adding #iabot bridge (T285021) [22:58:59] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.bridgebot/SAL [23:22:12] Wow [23:36:57] bd808, done, can you check the logs? [23:38:17] Galahad: nice! -1001369595641 is your Telegram channel id. [23:38:29] Thanks! [23:44:34] !log tools.bridgebot Adding #wikimedia-sp bridge (T283308) [23:44:37] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.bridgebot/SAL [23:45:34] Galahad: I think it should be up and running. Give it a try [23:47:05] ummmm... this is showing up in an unexpected channel [23:47:27] Galahad: Something is criss-crossed in my config... checking [23:47:52] k, bd808 [23:48:04] I'm checking both, group and channel [23:48:11] the messages are posting into the WMCS telegram :) [23:49:04] oooh, I see, that's make sense :) [23:49:07] ah.. because I grabbed the wrong channel id from the logs. blerg [23:50:09] Galahad: please send another message on your Telegram channel. [23:50:55] bd808, on my way [23:52:14] bd808, done [23:52:38] !log tools.bridgebot Adding #wikimedia-sp bridge (T283308) (try #2) [23:52:41] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.bridgebot/SAL [23:54:11] Galahad: ok, I think I got the config right this time. Try some more test messages and let me know if it works [23:56:29] bd808, the bridge works. Thanks for your useful bot! :) [23:56:36] yw