[11:57:55] Hi folks - I have a datapipeline running, and I want to do some basic checks when it's finished just to make sure it worked properly, and a way to alert our team if the numbers don't look right [11:57:55] ebernhardson suggested I write a python script to gather the numbers (by querying a public MW api, and parsing the json), then push to to prometheus using the push gateway, then set something up in alertmanager to tell us if (for example) the numbers have changed by >10% [11:57:55] ... he also mentioned using `write_to_textfile` instead of `push_to_gateway` [11:58:35] is there anyone to tell me whether this is the right way to go about things? [12:38:29] cormacparle: hi! I think the simplest method would be to use the pushgateway indeed i.e. this https://wikitech.wikimedia.org/wiki/Prometheus#Ephemeral_jobs_%28Pushgateway%29 [12:39:33] cormacparle: write_to_textfile is also an option, though we tend to use that for things that run "stabily" on hosts (e.g. as opposed to k8s) and would need to run as root or group 'prometheus' to be able to write the file [12:40:15] cormacparle: feel free to add me to the related code reviews and I'll be happy to assist/take a look [13:26:02] thanks godog ! [14:22:20] sure, anytime