[09:33:44] <arturo>	 am I the only one experiencing this? T340947
[09:33:45] <stashbot>	 T340947: gerrit.w.o is not included in https://config-master.wikimedia.org/known_hosts - https://phabricator.wikimedia.org/T340947
[09:35:06] <taavi>	 my .ssh/config has an exclusion for gerrit and gitlab for the block that configures the prod known_hosts file and keys
[09:36:25] <volans>	 arturo: with gerrit.w.o you need to use the cloud key, not the production one, so it should not use the wmf-prod known hosts either IMHO
[09:37:23] <arturo>	 I use a dedicated ssh key for gerrit, but thing is the known hosts
[09:38:32] <volans>	 this is what the wmf-sre-laptop does: https://gerrit.wikimedia.org/r/plugins/gitiles/operations/debs/wmf-sre-laptop/+/refs/heads/master/configs/ssh-client-config#71
[09:41:18] <arturo>	 volans: my known_hosts for cloud is also automated, and it doesn't contain gerrit so it is the same problem
[09:41:38] <volans>	 you can point it to a dedicated one if you want
[09:42:09] <volans>	 or send a patch :D
[09:42:43] <arturo>	 not sure what to patch, my first impulse would be to include gerrit.w.o in the config-master file
[09:43:54] <volans>	 gerrit.wikimedia.org is included in the host's ssh_known_hosts in prod
[09:45:15] <volans>	 as it's exported via @@sshkey
[09:45:17] <taavi>	 P::gerrit exports it as a sshkey resource, but I think the config-master files query the sshkey facts directly instead of the exported resource
[09:47:25] <volans>	 $ssh_fingerprints = puppetdb::query_facts(['ssh', 'networking'])
[09:50:46] * volans replied on task
[09:58:37] <arturo>	 thanks!
[12:28:02] <kamila_>	 docker-registry.wikimedia.org pulls are broken for me over IPv6: it gets stuck after a few MB every time when I have v6 enabled, works fine over v4. Is it on my end?
[12:28:53] <godog>	 was there a known/reported problem with phab around 11:51 ? saw a bunch of timeouts talking to the api and phaultfinder (the alertmanager -> phab bot) ended up creating duplicates
[12:30:24] <godog>	 e.g https://phabricator.wikimedia.org/T340960
[12:58:04] <topranks>	 kamila_: docker pull over IPv6 seems to be working ok for me from docker-registry.wikimedia.org 
[12:58:33] <topranks>	 if you want to DM me your IPv6 address I can maybe check if we've any particular problems getting to you, but overall the service looks ok 
[12:58:46] <kamila_>	 topranks: thanks, good to know
[13:06:56] <vgutierrez>	 godog: re phabricator.. nothing weird on https://grafana.wikimedia.org/goto/D0jzEA9Vz?orgId=1
[13:10:25] <godog>	 vgutierrez: cheers, yeah I haven't been able to find anything obviously wrong either
[13:13:03] <vgutierrez>	 godog: but the timeout yo pasted is referred to prometheus1005.eqiad.wmnet.
[13:13:33] <vgutierrez>	 unless I'm missing something obvious
[13:16:54] <godog>	 vgutierrez: the timeout is for POST /alerts, there's a GET /metrics from prometheus1005 earlier indeed though that's unrelated