[13:47:11] <wm-bot>	 !log lucaswerkmeister@tools-bastion-13 tools.ranker deployed d95b93c7b8 (l10n updates: mk)
[13:47:13] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.ranker/SAL
[13:49:50] <wm-bb>	 <lucaswerkmeister> are the network issues still ongoing btw? (re @wmtelegram_bot: <arturo> !status network outage)
[13:50:11] <arturo>	 no, we are good since yesterday
[13:50:16] <lucaswerkmeister>	 (apparently the topic on the IRC side is back to “Status: OK” but I don’t see a more recent !status message… did I miss a netsplit?)
[13:50:16] <lucaswerkmeister>	 ok
[13:50:32] <lucaswerkmeister>	 or maybe the bot that was supposed to process the !status had been affected by the outage 🤔
[13:50:37] <arturo>	 I think what happened is that the bot was offline and ignored the !status command
[13:50:43] <lucaswerkmeister>	 thanks anyway :)
[13:50:50] <arturo>	 welcome
[13:54:27] <lucaswerkmeister>	 https://tools-static.wmflabs.org/cdnjs/ajax/libs/twitter-bootstrap/4.6.0/css/bootstrap.min.css doesn’t load for me (504 gateway timeout)
[13:54:34] <lucaswerkmeister>	 whereas https://cdnjs.cloudflare.com/ajax/libs/twitter-bootstrap/4.6.0/css/bootstrap-grid.min.css loads fine
[13:54:57] <lucaswerkmeister>	 IIRC the former is just supposed to proxy the latter (to hide PII) – I wonder if cloudflare started to block us
[13:58:02] <taavi>	 !log tools reboot tools-static-15 due to stuck nginx worker processes
[13:58:05] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL
[13:59:05] <lucaswerkmeister>	 ah ok
[13:59:05] <taavi>	 lucaswerkmeister: now it does :-)
[13:59:11] <lucaswerkmeister>	 then I can skip filing a phab task ^^
[13:59:13] <lucaswerkmeister>	 thanks :)
[13:59:20] <lucaswerkmeister>	 yup now https://tools-static.wmflabs.org/lucaswerkmeister-test/indextest/index.html also works again
[14:10:10] <dhinus>	 that also triggered an alert 30 mins ago, but I was waiting in the hope it would self-heal :)
[15:41:34] <sbassett>	 eh, I might’ve killed global-search.toolforge.org?  was running a script, have since stopped.
[15:47:29] <bd808>	 sbassett: that's run by musikanimal and ebernhardson 
[15:53:23] <sbassett>	 bd808: Yeah, I’ve been talking to them on slack.  Just wanted to surface that here in case anyone else noticed.
[19:36:23] <Krinkle>	 hm.. codesearch is down?
[19:36:49] <Krinkle>	 https://grafana.wmcloud.org/d/0g9N-7pVz/cloud-vps-project-board?orgId=1&var-project=codesearch&var-instance=codesearch9&from=now-3h&to=now
[19:38:05] <Krinkle>	 horizon claims it is running
[19:38:31] <Krinkle>	 ssh not responding
[19:39:05] <Krinkle>	 !log codesearch Reboot codesearch9, web service was down and ssh not responding/timing out. Alert fired 41min ago about instance being perceiced as down.
[19:39:07] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Codesearch/SAL