[09:47:32] <wm-bot>	 !log tools.wd-image-positions <lucaswerkmeister> deployed 2bb7a08f06 (abort on invalid region instead of crashing)
[09:47:34] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.wd-image-positions/SAL
[09:49:17] <wm-bot>	 !log tools.wd-image-positions <lucaswerkmeister> deployed 4630899d1e (tweak message)
[09:49:18] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.wd-image-positions/SAL
[12:51:52] <wm-bot>	 !log tools.wd-image-positions <lucaswerkmeister> deployed 2264a649ae (flake8, updated dependencies)
[12:51:54] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.wd-image-positions/SAL
[12:59:22] <Rook>	 !log paws deploying T308862: Fix version of nbvconvert #158 47a7db6b320e70a4183b0a1891096ec5b00129fe
[12:59:24] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Paws/SAL
[12:59:24] <stashbot>	 T308862: fix renderer build - https://phabricator.wikimedia.org/T308862
[13:43:47] <wm-bot>	 !log tools.wd-image-positions <lucaswerkmeister> deployed 15ade38230 (Diffusion → GitLab)
[13:43:49] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.wd-image-positions/SAL
[15:17:36] <zabe>	 could someone restart the webservice of sal.toolforge.org? I'm seeing 500s.
[15:31:41] <RhinosF1>	 bd808: ^
[15:36:05] <wm-bot>	 !log tools.sal <bd808> Restart to clear errors reported on irc
[15:36:07] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.sal/SAL
[15:36:24] <RhinosF1>	 Ty bd808
[15:36:34] <bd808>	 thanks for the ping.
[15:37:30] <bd808>	 !log toolhub Update demo server to 4eed41
[15:37:31] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Toolhub/SAL
[15:40:43] <RhinosF1>	 Np
[17:04:50] <taavi>	 !log tools failover tools-redis to the updated cluster T278541
[17:04:53] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL
[17:04:53] <stashbot>	 T278541: Toolforge: migrate redis servers to Debian Buster or later - https://phabricator.wikimedia.org/T278541
[18:01:54] <Krinkle>	 !log tools.guc Switch webservice from old grid default to kubernetes and update to php7.4 image
[18:01:56] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.guc/SAL
[18:02:16] <Krinkle>	 !log tools.coverme Upgrade webservice from kubernetes php7.2 to php7.4
[18:02:17] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.coverme/SAL
[18:28:05] <wm-bot>	 !log tools.sal <bd808> Enabled https://wikitech.wikimedia.org/wiki/Help:Toolforge/Web/Lighttpd#Enable_status_and_statistics
[18:28:07] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.sal/SAL
[20:27:42] <wm-bot>	 !log tools.wd-image-positions <lucaswerkmeister> deployed a846c4f7f4 (refactor depicted.css)
[20:27:44] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.wd-image-positions/SAL
[20:29:06] <Krinkle>	 hm.. wikibugs is down?
[21:53:53] <anomie>	 Looks like the redis thing a few hours ago broke my bot, at least the timestamps match when it seems to have frozen up. Let's see if it comes back when I restart it.
[22:05:27] <anomie>	 Had to ssh into each runner and `kill -9` the bot's processes since `qdel` wasn't working. But now it seems to be working.
[22:26:25] <anomie>	 Or maybe not. I wonder if it's because I must have missed the memo about redis.svc.tools.eqiad1.wikimedia.cloud being the new name.
[23:01:48] <anomie>	 AnomieBOT's jobs still seem to be hanging up. No idea why.
[23:45:00] <anomie>	 Some "Error while reading from Redis server: Connection timed out" just popped up in the bot's logs.