[00:40:15] <Krinkle>	 effie: _joe_ I've added shellbox stability to Perf-ServiceOps doc for next time https://docs.google.com/document/d/1EVBFol4pEE6A_YBw5RW3dH4i8QdpPndQDIHYyshQbmc/edit. I keep noticing this in production error triage and it seems other deployers have been ignoring this for months. Maybe worth a look at it doesn't seem normal to me.
[07:35:16] <effie>	 great Krinkle, thanks!
[15:09:26] <urandom>	 as a heads-up, I'm going to depool sessionstore in codfw in ~30 minutes to do some troubleshooting (see https://phabricator.wikimedia.org/T327954#8613222 for more).  Other than adding a little latency to a (relatively) small subset of requests, there shouldn't be any impact.
[15:45:34] <urandom>	 Or maybe I won't be...
[15:45:39] <urandom>	 https://www.irccloud.com/pastebin/X8NtQhNI/
[15:52:07] <moritzm>	 dns4004 is being updated to Bullseye currently
[15:52:30] <moritzm>	 https://phabricator.wikimedia.org/T321309#8618179
[15:52:34] <sukhe>	 yep
[15:52:58] <sukhe>	 but I did remove it from the authdns_servers, so not sure why it's in this list?
[15:53:20] <sukhe>	 this is definitely dns4004
[16:00:57] <cdanis>	 it looks like
[16:01:02] <cdanis>	 https://gerrit.wikimedia.org/r/plugins/gitiles/operations/software/spicerack/+/refs/heads/master/spicerack/dnsdisc.py#53
[16:01:29] <cdanis>	 it looks like spicerack gets the list of authdnses from the cumin alias
[16:01:38] <cdanis>	 and then it wants to check the state on every one of those
[16:01:51] <cdanis>	 sukhe: XioNoX: ^
[16:02:06] <cdanis>	 this seems quite brittle if I'm understanding correctly
[16:12:41] <claime>	 it is
[17:32:02] <cdanis>	 filed https://phabricator.wikimedia.org/T329773
[19:33:30] <urandom>	 Ok —unless I hear any objections— I'll (attempt to) de-pool sessionstore in codfw shortly
[19:38:35] <cdanis>	 umm
[19:38:40] <cdanis>	 sirenbot dead? topic is wrong
[19:38:55] <cdanis>	 anyway cwhite herron ^ fyi re: sessionstore
[19:39:01] <cdanis>	 ... oh, sirenbot isn't opped.
[19:39:10] <rzl>	 yeah, when sirenbot crashes it autorestarts but does not automatically get topic rights in here
[19:39:17] <cdanis>	 and I don't have chanserv rights in here
[19:39:26] <rzl>	 it doesn't in -operations either but at least I have chanserv rights to fix it there
[19:39:31] <cdanis>	 cool
[19:39:34] <cdanis>	 coolcoolcool
[19:39:41] <urandom>	 so cool
[19:39:58] <sukhe>	 that's cool
[19:40:12] <cwhite>	 cool
[19:40:22] <cwhite>	 (thanks!)
[19:40:27] <sukhe>	 even cole thinks it's cool 
[19:40:32] <rzl>	 I meant to file a task about that last week but got distracted, doing it now
[19:40:52] <rzl>	 I think we can something something ircservserv about it
[20:11:03] <rzl>	 https://phabricator.wikimedia.org/T329791
[20:36:54] <bd808>	 topic lock is a pain in the butt. I know why we recommend using it, but I still hate it
[20:44:28] <rzl>	 yeah agree, the only thing worse than +t is -t
[21:28:18] <legoktm>	 I think you can set mode +O so it auto-ops
[21:29:15] <legoktm>	 There's also /cs topic which doesn't required being opped at all AIUI
[21:32:08] <legoktm>	 where is the source code of the bot?
[21:32:36] <legoktm>	 (found it)
[21:47:09] <legoktm>	 https://gitlab.wikimedia.org/repos/sre/vopsbot/-/merge_requests/10
[21:50:08] <legoktm>	 and https://github.com/lavagetto/ircbot/pull/1
[21:50:59] <legoktm>	 I suspect this nerdsnipe is really an elaborate ruse by _joe_ to get me to write golang code
[21:52:22] <_joe_>	 ^_^
[22:09:00] <inflatador>	 <3 the FAQ on that repo ;)
[22:11:00] <klausman>	 Cloud-native is a synonym for cloud-cuckoo-lander :-P
[22:27:04] <urandom>	 FYI: sessionstore in codfw has been repooled, and everything looks back to normal
[22:27:50] * urandom knocks vigorously on wood