[09:52:31] !log tools update pywikibot-scripts-stable image to v10.0.0 T385400 [09:52:35] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [09:52:35] T385400: New upstream release for Pywikibot - https://phabricator.wikimedia.org/T385400 [10:13:03] !log toolsbeta update cluster-info config map to use k8s.svc.toolsbeta.eqiad1.wikimedia.cloud service name T262562 [10:13:07] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Toolsbeta/SAL [10:13:07] T262562: [infra] Fix the mis-named k8s service in tools and toolsbeta projects - https://phabricator.wikimedia.org/T262562 [10:36:06] !log testlabs bootstrap networktests infra via https://gitlab.wikimedia.org/repos/cloud/cloud-vps/networktests-tofu-provisioning [10:36:08] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Testlabs/SAL [10:43:49] !log cloudinfra delete cloud-cumin-03, cloud-cumin-04 T367725 [10:43:52] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Cloudinfra/SAL [10:43:52] T367725: Get rid of cloud-cumin VMs in cloudinfra project - https://phabricator.wikimedia.org/T367725 [16:46:29] !log lucaswerkmeister@tools-bastion-13 tools.wd-image-positions webservice restart # clear out a stuck broken variable in toolforge-i18n [16:46:30] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.wd-image-positions/SAL [18:11:58] o_O I’m getting several “failed to remove contents in a temporary directory” errors from pip-sync [18:12:17] (it says I “can safely remove it manually” so I guess I’ll try that and see if I get any error messages…) [18:14:00] rmdir fails because the directories aren’t empty, the only contents are .nfs00000[hex] files, unlink that fails because “Device or resource busy” [18:14:02] yay nfs [18:14:16] probably harmless, at least [18:14:57] !log lucaswerkmeister@tools-bastion-13 tools.wd-image-positions deployed 840b383c90 (upgrade dependencies, including Flask 3.1.0 and toolforge-i18n 0.1.2) [18:14:59] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.wd-image-positions/SAL [18:15:35] (the directories are `/data/project/wd-image-positions/www/python/venv/lib/python3.11/site-packages/~*` FTR) [18:20:51] !log lucaswerkmeister@tools-bastion-13 tools.lexeme-forms deployed c6d552c9c3 (upgrade dependencies, including toolforge-i18n 0.1.2) [18:20:54] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.lexeme-forms/SAL [18:24:25] !log lucaswerkmeister@tools-bastion-13 tools.ranker deployed b0a9db1622 (upgrade dependencies, including Flask 3.1.0 and toolforge-i18n 0.1.2) [18:24:26] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.ranker/SAL [18:25:52] now removing the stale directories worked fine (and `rm -ri` didn’t prompt me about the .nfs files so I guess they went away on their own) \o/ [18:28:06] quarry down :( [18:35:50] fun [18:35:55] at least the alerting i set up for it works