[08:00:04] <slyngs>	 I'll be removing yet another Icinga check. It may cause Icinga to pop a bit of "Unknown" statuses for a few Puppet runs. I'll attempt to help it along.
[08:02:49] <slyngs>	 Apparently I already did that... never mind then.
[12:44:25] <dhinus>	 moritzm: I'm merging a puppet change and there's one from you
[12:44:28] <dhinus>	 "Enable maps-test2003 to maps-test2006"
[12:44:41] <dhinus>	 can I merge it?
[12:46:02] <moritzm>	 yes, please. I was about to
[12:46:07] <dhinus>	 ok!
[12:47:13] <dhinus>	 done
[12:47:28] <moritzm>	 thx
[13:08:57] <hnowlan>	 we'll be repooling codfw after the backport window ends 
[14:05:45] <hnowlan>	 pooling codfw now 
[14:11:09] <jelto>	 ack 🤞
[14:27:10] <claime>	 as far as mediawiki goes, looks good
[14:27:40] <hnowlan>	 yeah, pleasantly uneventful 
[14:28:17] <claime>	 hnowlan: https://grafana.wikimedia.org/goto/2zICncTHR?orgId=1 wall of requests x)
[14:29:42] <inflatador>	 does anyone know how to remove old servers from PCC? I've got a failure, but none of the failed hosts are active (https://puppet-compiler.wmflabs.org/output/1131087/3368/ )
[14:32:55] <hnowlan>	 repool all done o> 
[14:35:13] <claime>	 inflatador: https://wikitech.wikimedia.org/wiki/Help:Puppet-compiler#Manually_update_production
[14:35:52] <claime>	 If that fails to remove them (it did for me last time, don't know why), I had to do a nasty curl to deactivate the nodes in the pdb
[14:41:07] <inflatador>	 claime thanks! I'm guessing it will fail as those hosts have been out of commission for a looong time
[14:47:18] <claime>	 that's strange there isn't any file for these hosts on pcc-db1002, which according to wikitech would be expected for using the re: selector
[14:48:25] <claime>	 I'm not very knowledgeable on pcc, and last time I had only one host causing issue (and that was in the pcc run itself, not it including decommed hosts in the run)
[14:50:21] <inflatador>	 No worries, it still helped me fix the regexes for the existing hosts, which is all that I need ATM
[15:43:53] <jelto>	 GitLab needs a short maintenance break in around one hour
[16:03:00] <joal>	 Hello SRE team - for some time now you've had 2 datasources in Druid to explore Webrequest: webrequest_sampled_128 (the old one) and webrequest_sampled_live (the new one). We're confident now that the new one does the job, and we're removing the old one. If you have dashboards/tools still using the `webrequest_sampled_128` datasource, please switch to using `webrequest_sampled_live`. Thank you! 
[16:03:06] <joal>	 (ticket for reference: https://phabricator.wikimedia.org/T385198)
[16:03:12] <joal>	 Cross-posting from #operations --^
[16:05:01] <volans>	 thanks for the headsup joal, I've just commented on task for my bits
[16:07:03] <joal>	 Thanks volans :)
[17:02:34] <jelto>	 GitLab maintenance done
[21:20:26] <inflatador>	 heads up that I just merged a big change to site.pp https://gerrit.wikimedia.org/r/c/operations/puppet/+/1131087?tab=comments . No impact expected, but just as an FYI
[21:21:16] <rzl>	 inflatador: ack, thanks
[21:27:15] <topranks>	 also heads up I am draining traffic from cr1-drmrs to adjust the port configuration, no impact expected either 
[21:28:23] <rzl>	 👍