[12:58:03] \o [15:03:20] workout, back in ~40 [15:13:54] for puppet deploy window later i have https://gerrit.wikimedia.org/r/c/operations/puppet/+/919216 [15:24:04] hmm, cindy getting timeouts ... can just increase them but i wonder why its running slower [15:38:23] back [15:38:33] ebernhardson :eyes on ^^ [15:39:29] oh nice, that merge in common.yaml might be an answer for our other java profile issues [15:44:27] ebernhardson merged and ran puppet on wcqs hosts. LMK if you run into any issues [15:49:23] hmm, example query still times out :( gotta look a little closer [15:52:30] inflatador: going to need to restart all the wcqs instances too, this changed a java startup option [15:56:27] ebernhardson ACK, will get that started [16:28:54] ebernhardson OK, should be good now. [16:36:13] lunch, back in ~1h [17:27:59] back [18:13:08] this should fix the alarms about blazegraph exporter failing on 2022: https://gerrit.wikimedia.org/r/c/operations/puppet/+/921081 [19:00:57] :) [19:03:48] cloudelastic plugin upgrade is done [19:06:04] codfw still in progress [19:34:14] getting some `elasticsearch-disable-readahead.service Failed` alerts, I'm assuming/hoping they will clear when the CODFW upgrades are done [19:40:53] quick break, back in 20 [20:09:49] back [20:34:34] ryankemper codfw upgrade is done, all clusters green [20:34:44] excellent. i'll get eqiad rolling [20:43:29] {◕ ◡ ◕}