[00:18:44] 10Analytics-Radar, 10Event-Platform, 10WMF-JobQueue, 10Wikibase change dispatching scripts to jobs, and 2 others: Queuing jobs is extremely slow - https://phabricator.wikimedia.org/T292048 (10Ladsgroup) It seems that it automagically got fixed: https://grafana.wikimedia.org/d/000000085/save-timing?viewPane... [01:45:17] 10Analytics, 10Event-Platform, 10Browser-Support-Microsoft-Edge: Problem with delay caused by intake-analytics.wikimedia.org - https://phabricator.wikimedia.org/T295427 (10Downsize43) Hi Aklapper, My ISP is Telstra Australia. I do no have access to any other ISP. The traffic from all Aust ISPs goes through... [06:47:09] hello folks! [06:47:10] https://wikitech.wikimedia.org/wiki/PKI/Cloud [06:48:53] it seems that we already have something for the cloud environment, not sure if deployment-prep is configured though [06:56:35] !log `systemctl start prometheus-mysqld-exporter@analytics_meta` on db1108 [06:56:37] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [07:37:13] 10Analytics-Radar, 10Data-Engineering, 10Event-Platform, 10SRE, 10Patch-For-Review: Allow kafka clients to verify brokers hostnames when using SSL - https://phabricator.wikimedia.org/T291905 (10elukey) First thing to follow up - deployment-prep: 1) we have a kafka cluster in there (for example, to test... [09:21:58] 10Analytics, 10Data-Engineering, 10Product-Analytics, 10Structured-Data-Backlog, and 3 others: Create a Commons equivalent of the wikidata_entity table in the Data Lake - https://phabricator.wikimedia.org/T258834 (10AKhatun_WMF) [09:51:42] elukey: ack, thanks. Good to know. Will research deployment prep a little more. [10:05:20] 10Analytics, 10Analytics-Kanban, 10Data-Engineering, 10Data-Engineering-Kanban, 10Patch-For-Review: Recreate analytics-meta replica on db1108 from master on an-coord1001 - https://phabricator.wikimedia.org/T295312 (10jcrespo) I was on vacations- you seemed to do well on your own :-). [11:24:57] btullis: not sure if PKI is available/set-up in there, in my opinion (for the moment) it is fine to re-use puppet host certs [11:30:16] i think it does have it setup [11:39:30] could be interesting to see if we can instruct profile::base::certificates to create a bundle/truststore in cloud containing the project's Puppet CA and the clouds Root PKI public cert [11:39:34] *cloud's [11:39:36] then it should work [11:39:56] (we should also add a kafka intermediate CA in the cloud's PKI of course) [12:06:52] 10Analytics, 10Analytics-Kanban, 10Data-Engineering, 10Data-Engineering-Kanban, 10Patch-For-Review: Recreate analytics-meta replica on db1108 from master on an-coord1001 - https://phabricator.wikimedia.org/T295312 (10BTullis) Thanks @jcrespo - nice to hear. > Consider setting up a parallel remote-backup... [12:18:50] 10Analytics, 10Analytics-Kanban, 10Data-Engineering, 10Data-Engineering-Kanban, 10Patch-For-Review: Recreate analytics-meta replica on db1108 from master on an-coord1001 - https://phabricator.wikimedia.org/T295312 (10BTullis) In the meantime, I notice that whilst we have weekly logical dumps of the `anal... [13:27:11] 10Analytics, 10Analytics-Kanban, 10Data-Engineering, 10Data-Engineering-Kanban, 10Patch-For-Review: Recreate analytics-meta replica on db1108 from master on an-coord1001 - https://phabricator.wikimedia.org/T295312 (10jcrespo) > ...it doesn't look like we have the daily snapshots of these instances config... [16:51:22] 10Analytics, 10Analytics-Kanban, 10Data-Engineering, 10Data-Engineering-Kanban, 10Patch-For-Review: Refactor analytics-meta MariaDB layout to use an-db100[12] - https://phabricator.wikimedia.org/T284150 (10BTullis) [17:28:51] 10Analytics, 10Analytics-Kanban, 10Data-Engineering, 10Data-Engineering-Kanban, 10Patch-For-Review: Refactor analytics-meta MariaDB layout to use an-db100[12] - https://phabricator.wikimedia.org/T284150 (10BTullis) [18:18:12] 10Analytics-Radar, 10Product-Analytics: Do the messages left for unregistered or logged-out IP editors get read by those editors? - https://phabricator.wikimedia.org/T291297 (10Whatamidoing-WMF) >>! In T291297#7385880, @mpopov wrote: > @Whatamidoing-WMF: Quick question about "to decide whether we need to re-st...