[14:26:48] <inflatador>	 Hey o11y! I want to monitor an external URL and I've been having trouble figuring out how to do that w/blackbox exporter. Is bb exporter preferred (a la https://github.com/wikimedia/operations-puppet/blob/production/modules/profile/manifests/microsites/query_service.pp#L39 ) or should we use monitoring::service a la modules/profile/manifests/query_service/monitor/wikidata.pp ?
[14:27:28] <inflatador>	 phab ticket is https://phabricator.wikimedia.org/T347355 if it helps
[14:29:48] <godog>	 inflatador: blackbox probes is the way to go / of the future
[14:30:54] <godog>	 if I understand the task right you'd like to probe for wdqs-ldf.discovery.wmnet ?
[14:31:00] <inflatador>	 godog ACK, is there a way to make the blackbox checks point directly to the URL? The targets I see in `/srv/prometheus/ops/targets/probes-custom_puppet-http.yaml` all seem to be IPs
[14:33:13] <godog>	 inflatador: yes, check modules/profile/manifests/microsites/monitoring.pp e.g. the check for 15.wikipedia.org
[14:33:32] <inflatador>	 godog somehow I missed your second msg, the URL we want is actually `"https://query.wikidata.org/bigdata/ldf?subject=wd%3AQ42&predicate=wdt%3AP31&object="`
[14:35:13] <inflatador>	 looks like the 15.wikipedia.org target renders to `- miscweb1003:30443@https://[10.2.2.70]:30443/` ? I don't want/need any IPs or references to physical hosts in my URL checks...let me know if I'm explaining it poorly
[14:35:14] <godog>	 inflatador: I see, yeah not that different, I think you got the right idea in the patches on the task
[14:36:05] <godog>	 that ip is the load balancer, then what happens is that blackbox-exporter is configured to send the correct Host: header (and SNI for tls)
[14:37:22] <godog>	 the current way to configure a check like that isn't the most intuitive or user friendly as you have experienced, we have https://phabricator.wikimedia.org/T312840 open though
[14:38:41] <inflatador>	 Is it possible to avoid that? I got into a pretty confusing scenario b/c that endpoint doesn't touch miscweb (unlike other query.wikidata.org endpoints) and I don't want to create an association between hosts or load balancers in a blackbox type check
[14:38:53] <inflatador>	 Ah, thanks for the ticket
[14:41:44] <godog>	 sure np
[19:20:59] <inflatador>	 go-dog or anyone else, is it possible to change the scrape interval on the prom checks? It looks like it's polling every second (config here https://gerrit.wikimedia.org/r/c/operations/puppet/+/979401/3/modules/profile/manifests/query_service/monitor/wikidata.pp )
[19:21:09] <inflatador>	 prom blackbox checks, that is
[19:23:28] <inflatador>	 looks like I'm getting multiple requests per second per poller
[19:41:44] <inflatador>	 nm, it's adding a target for every WDQS host