[10:19:14] !incidents [10:19:15] 4463 (UNACKED) ProbeDown sre (10.2.2.53 ip4 thanos-query:443 probes/service http_thanos-query_ip4 eqiad) [10:19:17] !ack 4463 [10:19:18] 4463 (ACKED) ProbeDown sre (10.2.2.53 ip4 thanos-query:443 probes/service http_thanos-query_ip4 eqiad) [11:11:53] I need to do a homer commit on cr*codfw* and I'm seeing this in the diff - anyone know about it? https://phabricator.wikimedia.org/P57817 [11:13:14] topranks: ^ [11:14:05] * topranks looking [11:16:46] hnowlan: bad timing I am just merging a patch give me 2 mins [11:18:33] hnowlan: can you say "no" to that homer commit? [11:18:44] I'll run it here check it looks good [11:18:56] topranks: yep, nope'd [11:19:03] no rush [11:20:58] hnowlan: what cumin host are you using? [11:26:32] topranks: 1002 (oops) [11:27:04] that's fine, I'm using that too. [11:27:31] pushing the config here to the codfw cr's, change for mw2384 and mw2385? [11:28:10] yep, thank you! [11:28:23] done now [11:28:55] the config on the cr's was ahead of the homer repo needed to merge my patch [11:30:29] ah [12:04:26] I have a maintenance script that is running long term on a mwmaint host using tmux. This is https://wikitech.wikimedia.org/wiki/MediaModeration. [12:04:26] With the switchover from codfw to eqiad, will the script need to be stopped in advance of the switchover? If so, can I start the script running on eqiad a few days before? [12:17:36] <_joe_> Dreamy_Jazz: the script will need to be stopped during the switchover [12:17:46] <_joe_> and you will be able to restart it in eqiad afterwards [12:17:57] Thanks. [12:19:51] <_joe_> but not before [12:19:58] If I was to stop it about an hour before the 14:00 UTC switchover time, would that be okay? [12:20:07] <_joe_> because well, the local databases are read-only [12:20:25] <_joe_> Dreamy_Jazz: we will stop it for you during the preparation stages of the switchover [12:20:43] Can you stop it when it is on a tmux session? [12:20:49] <_joe_> yes [12:20:57] We had problems before with this as there was an exception and no-one knew how to stop it. [12:21:05] Until I woke up and stopped it. [12:21:05] <_joe_> both SIGTERM and SIGKILL are used [12:21:12] 👍 [12:21:43] Okay. I'll set a reminder for myself to start it again once the switchover is complete. Thanks. [12:22:31] <_joe_> in a not-so-far future, you should be able to run your script on kubernetes, and that will be executed on the correct cluster automatically :) [12:22:45] :D [12:23:15] We hope to get it running via operations/puppet once the backlog is completed [20:15:45] Is there something wrong with stashbot / wikitech? It's failing to log [20:22:07] Now fixed [20:23:50] curious. Did it just fix itself? [20:24:11] inflatador: no, I bribed Lucas_WMDE to restart it [20:29:54] RhinosF1 smart ;) [20:52:59] anyone try to talk to phabricator from a go app, and if so what library did you use?