[11:51:43] !log lucaswerkmeister@tools-bastion-13 tools.ranker deployed 182a379534 (add health-check-path) [11:51:45] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.ranker/SAL [11:52:41] jesus, load average 9,79 on tools-bastion-13 [12:00:14] I sent an email to the user at the top of top/htop/systemd-cgtop [12:01:41] thanks! There's a vscode process stuck on nfs [12:02:18] just killed them [12:03:30] fair enough, I warned them in the email that this might happen ^^ [12:04:13] there was also some discussion on allowing vscode running on the bastions as the server binaries it uses are not open source [12:14:17] true, interesting point [12:33:32] the vscode server distributed by microsoft is clearly non-free and thus forbidden by the terms of use, the discussion is about whether we can automatically enforce that [12:41:53] this isn't the first time, right? [12:42:05] that we've had vscode-getting-stuck issues [12:43:32] yep [16:12:56] Hi! Is this page up-to-date? https://wikitech.wikimedia.org/wiki/Help:SSH_Fingerprints/bastion.bastioninfra-codfw1dev.codfw1dev.wmcloud.org [16:13:05] Asking because I get a different fingerprint. [16:15:07] it's codfw1dev, so probably not :-) [16:15:09] * taavi checks [16:16:15] taavi: there are free vscode forks, I wonder if we can use them [16:16:36] I use vscodium but I didn't check if it has a server [16:17:09] cwhite: https://wikitech.wikimedia.org/w/index.php?title=Help%3ASSH_Fingerprints%2Fbastion.bastioninfra-codfw1dev.codfw1dev.wmcloud.org&diff=2325776&oldid=2051881 [16:17:40] Thanks, taavi! [16:20:06] nemoralis: my understanding is that the licensing situation for vscode-server is similar to vscode itself, so it's only the microsoft-distributed binaries that are non-free [16:20:14] but I haven't looked very deep into it [16:22:44] can I get a +1 on this one? T399746 [16:22:46] T399746: Request to increase Object Storage capacity - Wikilink project - https://phabricator.wikimedia.org/T399746 [16:26:11] dhinus: {{done}} [16:26:29] thx [17:04:29] I have been noted that bots here are disconnecting together, some minutes ago wm-bb and wikibugs disconnected at the same second, that also happens with wmopbot and stashbot, they disconnect together almost daily [17:05:48] wmopbot and stashbot are running in the same node, tools-k8s-worker-nfs-12, maybe there is something in the k8s nodes that can be causing that? [17:08:39] I tryed to find some bug in the wmopbot code but the logs just show the connection was lost, wmopbot send ping to IRC server but does not receive the pong [17:11:03] wm-bb and wikibugs also have bouncer pods in the same node, tools-k8s-worker-105 [19:55:39] !log lucaswerkmeister@tools-bastion-13 tools.ranker deployed b6437657e4 (upgrade dependencies) [19:55:41] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.ranker/SAL [20:01:01] !log lucaswerkmeister@tools-bastion-13 tools.ranker deployed 068bd11336 (split dev requirements from prod requirements) [20:01:03] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.ranker/SAL [23:33:28] !log lucaswerkmeister@tools-bastion-13 tools.ranker deployed 5c0aff28d3 (change config keys to uppercase to work around T374780) [23:33:33] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.ranker/SAL [23:40:02] !log tools.ranker python3 -c 'import yaml; print(yaml.safe_dump(yaml.safe_load(open("config.yaml"))["OAUTH"]["CONSUMER_KEY"]))' | toolforge envvars create TOOL_OAUTH__CONSUMER_KEY [23:40:04] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.ranker/SAL [23:40:09] !log tools.ranker python3 -c 'import yaml; print(yaml.safe_dump(yaml.safe_load(open("config.yaml"))["OAUTH"]["CONSUMER_SECRET"]))' | toolforge envvars create TOOL_OAUTH__CONSUMER_SECRET [23:40:10] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.ranker/SAL [23:40:17] !log tools.ranker python3 -c 'import yaml; print(yaml.safe_dump(yaml.safe_load(open("config.yaml"))["SECRET_KEY"]))' | toolforge envvars create TOOL_SECRET_KEY [23:40:18] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.ranker/SAL [23:41:14] !log lucaswerkmeister@tools-bastion-13 tools.ranker commented out config.yaml, should use envvars instead [23:41:14] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.ranker/SAL [23:41:20] !log lucaswerkmeister@tools-bastion-13 tools.ranker deployed 11992d04c0 (read config from envvars) [23:41:21] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.ranker/SAL