[02:05:58] If someone (maybe musikanimal ?) can restart ipcheck.toolforge, that would be awesome [02:08:05] {{done}} [07:44:21] !log toolsbeta set 'dumps_use_nfs_lb: true' for toolsbeta-test-k8s-worker-nfs prefix [07:44:24] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Toolsbeta/SAL [07:58:24] !log toolsbeta test dumps-nfs switchover on toolsbeta-test-k8s-worker-nfs-8 [07:58:26] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Toolsbeta/SAL [08:22:23] !log toolsbeta test reboot all workers [08:22:26] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Toolsbeta/SAL [08:54:06] !log toolsbeta set 'dumps_use_nfs_lb: true' for mail, bastion, static prefixes [08:54:06] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Toolsbeta/SAL [08:54:08] Morning, T432097 appears to be new (or at least I didn't hit it until today) and is pretty bad behaviour. I don't have time to go fishing today if someone could have a poke. [08:54:08] T432097: [jobs-api] did not update the runtime, [components-api] did not actually get the image deployed - https://phabricator.wikimedia.org/T432097 [11:35:27] Looking [11:38:54] !log tools failing over redis to new trixie cluster T360704 [11:38:58] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [11:38:59] T360704: Upgrade Toolforge Redis cluster to Bookworm or newer - https://phabricator.wikimedia.org/T360704 [15:07:25] !log toolsbeta fail back to classic dumps nfs for toolsbeta-test-k8s-worker-nfs prefix [15:07:28] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Toolsbeta/SAL