[08:55:13] errand, back in 20' [11:03:19] Lunch [13:08:53] ebernhardson: Thank you for the patch (tests) that helped me understand quite a bit. From what I can tell, there’s no use case (in analytics/airflow/dags) that requires other partitions than the ones we can create with the new RangeHivePartitionSensor. Therefore, I’d refrain from porting HivePartitionRangeSensor for now. [14:02:57] ryankemper for awareness, I banned all row B and C hosts from T322082 , in addition to the row A hosts we banned yesterday. I wanted to be ready if we get the opportunity to move a few more [14:14:13] T322082: Q1:rerack elastic10[53-67] - https://phabricator.wikimedia.org/T322082 [15:46:10] \o [16:01:59] still doing DC Ops stuff, will not make unmtg [17:36:20] ryankemper we are in wikimedia-dcops if you wanna follow along, 2 hosts done so far [17:52:08] also https://etherpad.wikimedia.org/p/T322082 [17:56:03] note that we are currently red in omega, missing arywiki_content_1668547862 as I forgot to ban the B and C nodes before shutdown. This should resolve itself once the hosts rejoin the cluster [17:56:56] other clusters are green and we're probably not going to touch psi today [18:31:40] excellent! [19:14:20] might need your help to force reallocate shards on omega once all hosts are back [19:28:51] nm, we are back to green on omega [19:48:01] well thats annoying...some bot created a page in cindy's wiki while the test was running, causing it to fail :P https://cirrustest-cirrus-integ02.wmcloud.org/w/index.php?title=Why_Does_Bitcoin_Use_A_Lot_Energy&action=history [19:50:04] (it dispeared now, because i've restarted the test) [19:58:46] ryankemper can you do a quick peek at the prometheus node exporters on 1053-57? They are still failing on boot. I assume Puppet will fix them within the next 1/2 hr but just wanna make sure [20:20:19] inflatador: they look happy on icinga. 1058 and 1059 aren't however [20:21:25] ryankemper those are the last 2 Im working on [20:21:36] ack, gr8 [20:21:57] running to grocery store, ping me if there's anything to look at when i get back in ~40m [21:06:37] maintenance is complete, everything looks good! [21:45:27] \o/ [22:04:01] Ok, I'm heading out for the weekend...have a good one