[00:10:06] 06Data-Engineering, 06Data Products, 06Data-Platform, 06Movement-Insights, and 2 others: Temporary Accounts Initiative (IP Masking) - Add user_is_temp to data tables - https://phabricator.wikimedia.org/T356701#9728476 (10nshahquinn-wmf) FYI, based on the results of T337103, `user_is_anonymous` and its sibl... [03:18:38] (03CR) 10Sg912: [C:03+1] "Thank you! 😊" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1019845 (https://phabricator.wikimedia.org/T358701) (owner: 10Mforns) [06:33:08] 06Data-Engineering: [DQ] Add support for distribution metrics in data quality exporters - https://phabricator.wikimedia.org/T362780#9728718 (10gmodena) [06:33:09] 06Data-Engineering: [DQ][NEEDS GROOMING] Add support for deequ's RowLevelSchemaValidator in refinery - https://phabricator.wikimedia.org/T362782#9728719 (10gmodena) [06:34:11] 06Data-Engineering: [DQ] Add support for distribution metrics in data quality exporters - https://phabricator.wikimedia.org/T362780#9728722 (10gmodena) [07:00:18] 06Data-Engineering, 06Data Products, 10Observability-Logging, 06Traffic, 13Patch-For-Review: Move analytics log from Varnish to HAProxy - https://phabricator.wikimedia.org/T351117#9728741 (10gmodena) 05Open→03Resolved >>! In T351117#9726516, @Fabfur wrote: >> I'm afraid mixing varnishkafka and be... [10:33:45] 06Data-Engineering, 10Data-Platform-SRE (2024.04.15 - 2024.05.05), 13Patch-For-Review: Migrate the matomo host to bookworm - https://phabricator.wikimedia.org/T349397#9729191 (10BTullis) I have updated the configuration on db1208 so that it replicates from matomo1003 instead of matomo1002. For some reason i... [10:33:46] 06Data-Engineering, 06Product-Analytics: Creating a Spark session causes a torrent of log spam - https://phabricator.wikimedia.org/T315024#9729192 (10AndrewTavis_WMDE) The one thing that I've been missing since implementing the suggestion from @Arinaigu [above](https://phabricator.wikimedia.org/T315024#9698551... [10:53:52] 06Data-Engineering, 06Data Products, 10Observability-Logging, 06Traffic, 13Patch-For-Review: Move analytics log from Varnish to HAProxy - https://phabricator.wikimedia.org/T351117#9729252 (10Fabfur) 05Resolved→03In progress The `haproxy_id` field has been added to messages. (PS. I'll keep this open... [11:28:14] 06Data-Engineering, 10Data-Platform-SRE (2024.04.15 - 2024.05.05), 13Patch-For-Review: Migrate the matomo host to bookworm - https://phabricator.wikimedia.org/T349397#9729276 (10ops-monitoring-bot) cookbooks.sre.hosts.decommission executed by btullis@cumin1002 for hosts: `matomo1002.eqiad.wmnet` - matomo1002... [11:30:11] 06Data-Engineering, 10Data-Platform-SRE (2024.04.15 - 2024.05.05), 13Patch-For-Review: Migrate the matomo host to bookworm - https://phabricator.wikimedia.org/T349397#9729278 (10BTullis) 05Open→03Resolved [11:50:34] (03PS1) 10Gmodena: development: webrequest: add haproxy_pid field [schemas/event/primary] - 10https://gerrit.wikimedia.org/r/1021902 (https://phabricator.wikimedia.org/T351117) [13:09:25] 06Data-Engineering, 10Cassandra, 06Data-Persistence, 06Data-Platform-SRE: Encrypt Airflow connections to AQS Cassandra - https://phabricator.wikimedia.org/T362181#9729473 (10elukey) @JAllemandou Hi! I have a question for you when you have a moment :) To make this work, we need to deploy a Java Truststore... [13:17:57] 14Analytics, 06Data-Engineering, 06DBA, 10Event-Platform: Eventually-Consistent MediaWiki state change events | MediaWiki events as source of truth - https://phabricator.wikimedia.org/T120242#9729499 (10dcausse) I think there are two issues to be discussed here. Defining qualitative requirements and how to... [14:33:24] 14Analytics, 06Data-Engineering, 06DBA, 10Event-Platform: Eventually-Consistent MediaWiki state change events | MediaWiki events as source of truth - https://phabricator.wikimedia.org/T120242#9729668 (10Ladsgroup) >>! In T120242#9726131, @Ottomata wrote: > There is a lil discussion about this topic in {T24... [15:17:28] (03CR) 10Mforns: [V:03+2] Add queries to format commons impact metrics data as dumps [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1019845 (https://phabricator.wikimedia.org/T358701) (owner: 10Mforns) [15:18:54] (03CR) 10Btullis: [C:03+1] "Shall we merge this now?" [analytics/hdfs-tools/deploy] - 10https://gerrit.wikimedia.org/r/887000 (https://phabricator.wikimedia.org/T328473) (owner: 10Chad) [16:42:18] (03CR) 10Xcollazo: [C:03+2] "SQL looks great. Output as per conversation with Marcel is right now reasonable with file sizes in the range of ~200K-200M. If we add to t" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1019845 (https://phabricator.wikimedia.org/T358701) (owner: 10Mforns) [17:52:46] 14Analytics, 10AQS2.0, 06Tech-Docs-Team, 10Data Products (Epics Timeline), and 2 others: AQS 2.0 user documentation - https://phabricator.wikimedia.org/T288664#9730350 (10apaskulin) [18:22:57] 14Analytics, 10AQS2.0, 06Tech-Docs-Team, 10Data Products (Epics Timeline), and 2 others: AQS 2.0 user documentation - https://phabricator.wikimedia.org/T288664#9730505 (10apaskulin) [18:25:26] 14Analytics, 10AQS2.0, 06Tech-Docs-Team, 10Data Products (Epics Timeline), and 2 others: AQS 2.0 user documentation - https://phabricator.wikimedia.org/T288664#9730519 (10apaskulin) [18:31:27] 14Analytics, 10AQS2.0, 06Tech-Docs-Team, 10Data Products (Epics Timeline), and 2 others: AQS 2.0 user documentation - https://phabricator.wikimedia.org/T288664#9730541 (10apaskulin) [18:37:17] 14Analytics, 10AQS2.0, 06Tech-Docs-Team, 10Data Products (Epics Timeline), and 2 others: AQS 2.0 user documentation - https://phabricator.wikimedia.org/T288664#9730549 (10apaskulin) [18:37:51] 14Analytics, 10AQS2.0, 06Tech-Docs-Team, 10Data Products (Epics Timeline), and 2 others: AQS 2.0 user documentation - https://phabricator.wikimedia.org/T288664#9730562 (10apaskulin) [21:02:18] 06Data-Engineering, 06MediaWiki-Engineering, 06serviceops, 10WMF-JobQueue, and 2 others: Could not enqueue jobs: "Unable to deliver all events: 503: Service Unavailable" - https://phabricator.wikimedia.org/T249745#9730773 (10Ottomata) > I fear I read that task, the way it is written at least, differently....