[07:07:57] this is quite useful: https://architecturenotes.co/redis/ same as https://architecturenotes.co/fallacies-of-distributed-systems/ [07:42:40] in five minutes I'm going to disable Puppet in codfw and the edges for 15-20m for puppetdb2002 maintenance, let me know if that's currently a bad time for anyone [08:05:48] puppet is back on [11:12:04] Puppet will be disabled on a rather large number of hosts i few minutes. It should take to long, but let me know if this is a bad tme [11:12:06] time [11:31:54] Puppet is back [11:33:05] nice... maybe a !log entry on SAL would be good for that kind of thing [11:33:34] vgutierrez: Yes, absolutely. Sorry, I completely forgot [11:38:43] !log Migrate mdadm array checks to systemd timers. Gerrit: 819577 [11:38:45] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [15:05:08] all calmed today, there was a train rollback, but nothing sre-related [15:06:48] thanks, ack, jynus [18:27:39] hey, is -databases supposed to be invite-only? [18:27:50] I also got this odd behaviour where it says "18:22 -!- mutante #wikimedia-databases is already on channel [18:27:56] but I dont see it [18:28:13] * hauskatze eyes marostegui ^^ [18:28:15] and another user said it was invite-only for them [18:28:51] mmmm [18:28:54] it shouldn't be [18:29:08] ay [18:29:27] mutante: our channel isn't that one but data-persistence [18:29:37] so #wikimedia-data-persistence [18:29:42] marostegui: oooh, I see [18:29:48] once it was that..right [18:29:49] thanks [18:30:03] marostegui: os mudásteis? [18:30:07] yeah long ago [18:30:20] hauskatze: hace ya mucho tiempo si [18:30:24] más de un año creo [18:30:25] maybe that channel should redirect then [18:30:36] I think that was done at the time [18:30:41] marostegui: y sin avisar, qué mal :P [18:30:49] I don't remember the details, maybe sobanski does [18:31:20] hauskatze: creo que se redireccionaba [18:32:54] I’m pretty sure I set up a redirection when we moved channels [18:34:04] if you're already in the target channel, you'll get a weird error saying you can't join the redirecting one [18:34:20] and mutante was already in -data-persistence :) [18:35:16] 14:35:04 [ChanServ] Information on #wikimedia-databases: [18:35:16] 14:35:04 [ChanServ] Mode lock : +imnstf #wikimedia-data-persistence [18:35:20] looks correct to me [18:37:01] legoktm: I just remember that I'm in umode +Q which blocks channel redirecting [18:37:50] ahh, I forgot that was a thing too [18:38:51] and looking at the libera guide, I see new umodes have been added [18:39:06] I really only need +g [18:39:08] :P [21:26:51] is `pcc-worker1001` having trouble? I can't access my latest pcc run https://puppet-compiler.wmflabs.org/pcc-worker1001/1408/ without getting a 502 bad gateway [21:30:17] ryankemper: please report that on -cloud. if it persists.. but works for me now [21:30:24] i think cloud maintenance [21:30:39] it seemed like a short outage of the proxy in front of that instance [21:30:53] mutante: ack, thanks. and actually it just started working for me now, so was def a transient failure [21:31:11] possibly related to ongoing work by Andrew [21:31:27] [C: +2] Replace cloudservices1003 with cloudservices1005 [puppet] [21:31:47] there is that domain proxy service