[01:37:13] (DiskSpace) firing: Disk space stat1008:9100:/srv 5.378% free - https://wikitech.wikimedia.org/wiki/Monitoring/Disk_space - https://grafana.wikimedia.org/d/000000377/host-overview?orgId=1&viewPanel=12&var-server=stat1008 - https://alerts.wikimedia.org/?q=alertname%3DDiskSpace [05:13:23] 10Data-Engineering, 10DBA: dbstore1003 filling up - https://phabricator.wikimedia.org/T336733 (10Marostegui) 05Open→03Resolved This should be enough to keep us fine until we receive the host to replace this one in Q1 ` root@dbstore1003:/srv# du -sh * 1.5T sqldata.s1 484G sqldata.s5 1.1T sqldata.s7 0 tmp.s1... [05:37:13] (DiskSpace) firing: Disk space stat1008:9100:/srv 5.377% free - https://wikitech.wikimedia.org/wiki/Monitoring/Disk_space - https://grafana.wikimedia.org/d/000000377/host-overview?orgId=1&viewPanel=12&var-server=stat1008 - https://alerts.wikimedia.org/?q=alertname%3DDiskSpace [06:54:53] 10Data-Engineering, 10Data-Platform-SRE, 10Patch-For-Review, 10Shared-Data-Infrastructure (Q4 Wrap up): Bring stat1009 into service - https://phabricator.wikimedia.org/T336036 (10Stevemunene) [07:55:52] PROBLEM - Kerberos KAdmin daemon on krb2002 is CRITICAL: PROCS CRITICAL: 0 processes with args /usr/sbin/kadmind https://wikitech.wikimedia.org/wiki/Analytics/Systems/Kerberos%23Daemons_and_their_roles [07:56:10] PROBLEM - Kerberos Kpropd daemon on krb1001 is CRITICAL: PROCS CRITICAL: 0 processes with args /usr/sbin/kpropd https://wikitech.wikimedia.org/wiki/Analytics/Systems/Kerberos%23Daemons_and_their_roles [08:20:47] FYI, the kadmin server is now back on krb1001 [08:26:11] moritzm: Ack and many thanks. [09:00:07] 10Data-Engineering-Planning, 10Data-Platform-SRE, 10Shared-Data-Infrastructure (Q4 Wrap up): Upgrade the spark YARN shuffler service on Hadoop workers from version 2 to 3 - https://phabricator.wikimedia.org/T332765 (10BTullis) I'm making reasonable progress on building a version of the spark 3.1.2 container,... [09:02:58] (03PS1) 10Aqu: Debug missing dependencies problem toImmutableList [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/922063 [09:15:50] 10Data-Engineering, 10AQS2.0, 10API Platform (AQS 2.0 Roadmap), 10Epic, and 2 others: AQS 2.0: Device Analytics service - https://phabricator.wikimedia.org/T288298 (10SGupta-WMF) [09:37:13] (DiskSpace) firing: Disk space stat1008:9100:/srv 5.377% free - https://wikitech.wikimedia.org/wiki/Monitoring/Disk_space - https://grafana.wikimedia.org/d/000000377/host-overview?orgId=1&viewPanel=12&var-server=stat1008 - https://alerts.wikimedia.org/?q=alertname%3DDiskSpace [09:37:50] (03CR) 10DCausse: Debug missing dependencies problem toImmutableList (032 comments) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/922063 (owner: 10Aqu) [09:38:50] 10Data-Engineering: NEW BUG REPORT remove mysql databases from SQLLab - https://phabricator.wikimedia.org/T337056 (10BTullis) Thanks for the suggestion @Mayakp.wiki It looks like it's a simple job to remove access to these databases from SQLLab, whilst leaving them available for use in existing dashboards. e.g... [09:52:54] 10Data-Engineering-Planning: Check home/HDFS leftovers of bmansurov - https://phabricator.wikimedia.org/T320367 (10Miriam) Looping in @fkaelin who probably has better suggestions on where to place these files, thank you! [09:59:06] 10Data-Engineering, 10Data-Platform-SRE, 10Observability-Alerting: Reduce IRC/alert noise associated with monitor_refine_ systemd timers from alertmanager - https://phabricator.wikimedia.org/T337052 (10fgiunchedi) >>! In T337052, @BTullis wrote: > Until we manage to do that, we're seeking some kind of soluti... [11:15:31] 10Data-Engineering-Planning, 10Data-Platform-SRE, 10Patch-For-Review, 10Shared-Data-Infrastructure (Q4 Wrap up): Upgrade the spark YARN shuffler service on Hadoop workers from version 2 to 3 - https://phabricator.wikimedia.org/T332765 (10BTullis) I have now completed the patch to build a container of spark... [11:42:21] 10Data-Engineering-Planning, 10Data-Platform-SRE, 10Patch-For-Review, 10Shared-Data-Infrastructure (Q4 Wrap up): Upgrade the spark YARN shuffler service on Hadoop workers from version 2 to 3 - https://phabricator.wikimedia.org/T332765 (10BTullis) I'm now building the spark:3.1.2 images. ` root@build2001:/s... [11:48:34] 10Data-Engineering-Planning, 10Data-Platform-SRE, 10Patch-For-Review, 10Shared-Data-Infrastructure (Q4 Wrap up): Upgrade the spark YARN shuffler service on Hadoop workers from version 2 to 3 - https://phabricator.wikimedia.org/T332765 (10CodeReviewBot) btullis opened https://gitlab.wikimedia.org/repos/data... [12:12:28] 10Quarry: superset to external db - https://phabricator.wikimedia.org/T336588 (10rook) 05Open→03Resolved a:03rook [12:13:08] 10Quarry: Add examples to superset - https://phabricator.wikimedia.org/T336945 (10rook) [12:13:18] 10Quarry: superset to external db - https://phabricator.wikimedia.org/T336588 (10rook) [12:13:24] 10Quarry: Public viewing of superset - https://phabricator.wikimedia.org/T336522 (10rook) [12:13:30] 10Quarry: Assign multiple roles on superset login - https://phabricator.wikimedia.org/T336539 (10rook) [12:14:17] 10Quarry: Add examples to superset - https://phabricator.wikimedia.org/T336945 (10rook) [12:14:23] 10Quarry: superset to external db - https://phabricator.wikimedia.org/T336588 (10rook) [12:14:29] 10Quarry: Public viewing of superset - https://phabricator.wikimedia.org/T336522 (10rook) [12:14:35] 10Quarry: Assign multiple roles on superset login - https://phabricator.wikimedia.org/T336539 (10rook) [12:16:05] (03CR) 10Ottomata: Debug missing dependencies problem toImmutableList (031 comment) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/922063 (owner: 10Aqu) [12:34:55] 10Data-Engineering-Planning, 10Data-Platform-SRE, 10Patch-For-Review, 10Shared-Data-Infrastructure (Q4 Wrap up): Upgrade the spark YARN shuffler service on Hadoop workers from version 2 to 3 - https://phabricator.wikimedia.org/T332765 (10BTullis) Images successfully published: ` == Step 2: publishing == Su... [12:39:12] 10Data-Engineering, 10Event-Platform Value Stream, 10Machine-Learning-Team: Create new mediawiki.page_links_change stream based on fragment/mediawiki/state/change/page - https://phabricator.wikimedia.org/T331399 (10Ottomata) @pfischer pasting some stuff from Slack here so it doesn't get lost. For the [[ htt... [12:43:40] (03Abandoned) 10Ottomata: development/ page change - Remove comment_html fields, bump to 2.0.0 [schemas/event/primary] - 10https://gerrit.wikimedia.org/r/855146 (https://phabricator.wikimedia.org/T308017) (owner: 10Ottomata) [12:44:12] 10Data-Engineering-Planning, 10Event-Platform Value Stream: Replace refinery-source Guava caches by Caffeine - https://phabricator.wikimedia.org/T325266 (10Antoine_Quhen) 05Open→03Resolved a:03Antoine_Quhen [12:48:21] (03PS5) 10Peter Fischer: Encode redirect targets in page change events. [schemas/event/primary] - 10https://gerrit.wikimedia.org/r/914867 (https://phabricator.wikimedia.org/T325315) [13:14:49] 10Data-Engineering, 10Data-Platform-SRE, 10LDAP-Access-Requests, 10SRE, and 3 others: Grant temporary access to web based Data Engineering tools to Bishop Fox - https://phabricator.wikimedia.org/T336357 (10jbond) 05In progress→03Resolved > Now that each user has been supplied with the credentials, I wi... [13:24:52] 10Data-Engineering, 10serviceops-radar, 10Event-Platform Value Stream (Sprint 14 A), 10Patch-For-Review: Store Flink HA metadata in Zookeeper - https://phabricator.wikimedia.org/T331283 (10JMeybohm) >>! In T331283#8859088, @Ottomata wrote: > Aye :) > >> It would be nice if that path could be baked into th... [13:25:07] 10Data-Engineering, 10Event-Platform Value Stream (Sprint 14 A): Enable HA failover for flink-kubernetes-operator - https://phabricator.wikimedia.org/T336185 (10Ottomata) a:03tchin [13:30:23] Hi ottomata - do you want to talk about scala and shaded jars? [13:37:13] (DiskSpace) firing: Disk space stat1008:9100:/srv 5.376% free - https://wikitech.wikimedia.org/wiki/Monitoring/Disk_space - https://grafana.wikimedia.org/d/000000377/host-overview?orgId=1&viewPanel=12&var-server=stat1008 - https://alerts.wikimedia.org/?q=alertname%3DDiskSpace [13:53:16] 10Data-Engineering-Planning, 10Data-Platform-SRE, 10Patch-For-Review, 10Shared-Data-Infrastructure (Q4 Wrap up): Upgrade the spark YARN shuffler service on Hadoop workers from version 2 to 3 - https://phabricator.wikimedia.org/T332765 (10BTullis) This seems to be working as expected. I had to make a new bu... [14:00:25] joal: hi sure, async here okay? [14:00:40] (also chatting about k8s ha deployments elsewhere... :) ) [14:00:52] joal: there is also a chat with aqu in slack, want to talk there? [14:05:34] stevemunene: o/ - stat1008's srv partition seems getting full, I believe that somebody has a ton of data in their home dirs... [14:06:26] going to slack ottomata :) [14:06:46] ottomata: o/ - found something interesting in alerts.wikimedia.org: Puppet CA certificate kafka_mirror_maker is about to expire [14:07:52] fab: ahem you have 1.2TB on stat1008, anything that can be dropped? [14:12:21] 10Data-Engineering: stat1008's /srv partition is getting full due to home dirs - https://phabricator.wikimedia.org/T337246 (10elukey) [14:12:23] stevemunene: --^ [14:19:33] elukey oh hm [14:20:05] 10Data-Engineering: stat1008's /srv partition is getting full due to home dirs - https://phabricator.wikimedia.org/T337246 (10Ottomata) @fkaelin [14:22:13] (DiskSpace) resolved: Disk space stat1008:9100:/srv 5.376% free - https://wikitech.wikimedia.org/wiki/Monitoring/Disk_space - https://grafana.wikimedia.org/d/000000377/host-overview?orgId=1&viewPanel=12&var-server=stat1008 - https://alerts.wikimedia.org/?q=alertname%3DDiskSpace [14:25:13] 10Data-Engineering, 10serviceops, 10Event-Platform Value Stream (Sprint 14 A), 10Patch-For-Review: New Service Request: flink-kubernetes-operator - https://phabricator.wikimedia.org/T333464 (10Ottomata) Based on a convo with @akosiaris, we need to undeploy flink-operator in staging-codfw, as well as mw-pag... [14:28:08] 10Data-Engineering: SQL lab access for Andrew McAllister - https://phabricator.wikimedia.org/T335940 (10AndrewTavis_WMDE) [14:36:09] elukey: i can't quite find where that alert is defined [14:36:18] I see ones for certs, but not for Puppet CA certificate ... ? [14:37:32] ottomata: it should be defined in the alerts repo [14:37:52] I think that it checks what cert in the puppet ca is about to expire [14:38:02] it happened some time ago also with the varnishkafka one [14:38:38] it would be nice to use the PKI but haven't checked yet how it works for client certs [14:39:38] oh...need to git pull, that's why. [14:39:39] doh [14:40:56] thanks, making a task [14:41:36] we could chat with John about how to improve the current situation and move to PKI, seems to be a good use case to remove some TOIL [14:41:45] (same thing for the varnishkafka cert) [14:41:50] i'll add that in the task [14:48:43] 10Data-Engineering, 10SRE, 10Shared-Data-Infrastructure, 10serviceops: kafka_mirror_maker TLS cert about to expire - 2023 - https://phabricator.wikimedia.org/T337248 (10Ottomata) [14:55:23] added some info to --^ [14:55:23] 10Data-Engineering, 10SRE, 10Shared-Data-Infrastructure, 10serviceops: kafka_mirror_maker TLS cert about to expire - 2023 - https://phabricator.wikimedia.org/T337248 (10elukey) Some info - the kafka mirror maker's cergen TLS cert has `kafka_mirror_maker` as CN, that is used as "username" in Kafka ACLs: `... [15:06:00] 10Data-Engineering-Planning, 10Event-Platform Value Stream (Sprint 14 A): Document Flink job deployment to k8s - https://phabricator.wikimedia.org/T329629 (10gmodena) There is some deployment documentation (dse-k8s) at https://www.mediawiki.org/wiki/Platform_Engineering_Team/Event_Platform_Value_Stream/Pyflink... [15:11:49] 10Data-Engineering-Planning, 10Data-Platform-SRE, 10Patch-For-Review, 10Shared-Data-Infrastructure (Q4 Wrap up): Upgrade the spark YARN shuffler service on Hadoop workers from version 2 to 3 - https://phabricator.wikimedia.org/T332765 (10CodeReviewBot) btullis merged https://gitlab.wikimedia.org/repos/data... [15:28:05] 10Data-Engineering-Planning, 10Epic, 10Event-Platform Value Stream (Sprint 14 A), 10Patch-For-Review: Deploy mediawiki-page-content-change-enrichment to wikikube k8s - https://phabricator.wikimedia.org/T325303 (10CodeReviewBot) otto opened https://gitlab.wikimedia.org/repos/data-engineering/eventutilities-... [15:45:19] 10Data-Engineering: SQL lab access for Andrew McAllister - https://phabricator.wikimedia.org/T335940 (10BTullis) I have added the `sql_lab` role to @AndrewTavis_WMDE 's account: `andrewtavis-wmde` so that should work now. It's worth noting that we have a ticket open regarding the automatic assignment of these p... [15:52:48] 10Data-Engineering: SQL lab access for Andrew McAllister - https://phabricator.wikimedia.org/T335940 (10AndrewTavis_WMDE) 05Open→03Resolved a:03AndrewTavis_WMDE Thank you, @BTullis! Can confirm on my end that I have the SQL Lab access. Marking this as resolved, which I'm assuming is the right action :) [15:58:15] 10Data-Engineering, 10Event-Platform Value Stream, 10Discovery-Search (Current work), 10Patch-For-Review: Add support for redirects in CirrusSearch - https://phabricator.wikimedia.org/T325315 (10pfischer) @daniel, thank you for your feedback! I reduced the [[ https://gerrit.wikimedia.org/r/c/mediawiki/exte... [15:58:38] 10Data-Engineering, 10Data Pipelines (Sprint 13): Implement new AQS endpoints for Knowledge Gap metrics - https://phabricator.wikimedia.org/T337059 (10Milimetric) p:05Triage→03Medium a:03nickifeajika [15:58:48] 10Data-Engineering, 10Data Pipelines (Sprint 13): Airflow job to load Knowledge Gap metrics into Cassandra - https://phabricator.wikimedia.org/T337060 (10Milimetric) p:05Triage→03Medium a:03nickifeajika [16:08:15] 10Data-Engineering, 10Data-Persistence, 10Security: Use user-specific passwords for accessing Analytics MariaDB replica databases - https://phabricator.wikimedia.org/T120532 (10jbond) [16:24:51] 10Data-Engineering, 10Data-Persistence, 10Security: Use user-specific passwords for accessing Analytics MariaDB replica databases - https://phabricator.wikimedia.org/T120532 (10jcrespo) Everybody be careful (I was confused for some time) when reading "Analytics MariaDB replica databases", wikireplicas alread... [16:46:30] 10Data-Engineering, 10SRE, 10Shared-Data-Infrastructure, 10serviceops: kafka_mirror_maker TLS cert about to expire - 2023 - https://phabricator.wikimedia.org/T337248 (10jbond) > maybe @jbond can chime in with some suggestions Happy too but i may need some more context :) specifically what is the endpoint... [16:48:01] 10Data-Engineering: NEW BUG REPORT remove mysql databases from SQLLab - https://phabricator.wikimedia.org/T337056 (10Mayakp.wiki) glad to know this is easy to do ! :) I guess a Slack chat (#working-with-data) or tagging the team on this task would be helpful to get buy-in. [17:09:53] 10Data-Engineering, 10SRE, 10Shared-Data-Infrastructure, 10serviceops: kafka_mirror_maker TLS cert about to expire - 2023 - https://phabricator.wikimedia.org/T337248 (10Ottomata) > specifically what is the endpoint that theses certs authenticate to Kafka brokers > is that allready managed by pki yup! Th... [17:20:38] 10Data-Engineering: stat1008's /srv partition is getting full due to home dirs - https://phabricator.wikimedia.org/T337246 (10matthiasmullie) Cleaned up ‘mlitn’ [17:43:58] 10Data-Engineering: stat1008's /srv partition is getting full due to home dirs - https://phabricator.wikimedia.org/T337246 (10Trokhymovych) Cleaned up 'trokhymovych' [17:55:14] 10Data-Engineering: Enable libmamba by default for conda environment solving - https://phabricator.wikimedia.org/T337258 (10Htriedman) [18:17:24] (03PS4) 10Nick Ifeajika: Add test for knowledge gap totals endpoint [analytics/aqs] - 10https://gerrit.wikimedia.org/r/915678 (https://phabricator.wikimedia.org/T337059) [18:21:01] (03CR) 10CI reject: [V: 04-1] Add test for knowledge gap totals endpoint [analytics/aqs] - 10https://gerrit.wikimedia.org/r/915678 (https://phabricator.wikimedia.org/T337059) (owner: 10Nick Ifeajika) [18:35:06] 10Data-Engineering-Planning, 10Epic, 10Event-Platform Value Stream (Sprint 14 A), 10Patch-For-Review: Deploy mediawiki-page-content-change-enrichment to wikikube k8s - https://phabricator.wikimedia.org/T325303 (10CodeReviewBot) otto merged https://gitlab.wikimedia.org/repos/data-engineering/eventutilities-... [18:38:38] 10Data-Engineering-Planning, 10Event-Platform Value Stream (Sprint 14 A): Document Flink job deployment to k8s - https://phabricator.wikimedia.org/T329629 (10gmodena) As for other docs to move: probably all links at https://www.mediawiki.org/wiki/Platform_Engineering_Team/Event_Platform_Value_Stream (expect ma... [18:51:49] (03CR) 10Milimetric: query finetuning (032 comments) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/914799 (owner: 10Nick Ifeajika) [18:59:03] 10Data-Engineering, 10Data-Engineering-Wikistats, 10Inuka-Team, 10Language-strategy, and 2 others: Have a way to show the most popular pages per country - https://phabricator.wikimedia.org/T207171 (10Htriedman) Hi @Strainu! I was the primary person who worked on implementing this data release for the past... [19:00:06] 10Data-Engineering, 10Data-release, 10Privacy Engineering, 10Research, 10Privacy: Evaluate a differentially private solution to release wikipedia's project-title-country data - https://phabricator.wikimedia.org/T267283 (10Htriedman) Following up on this as the primary person working on this project for... [19:15:56] 10Data-Engineering, 10Data-Engineering-Wikistats, 10Inuka-Team, 10Language-strategy, and 2 others: Have a way to show the most popular pages per country - https://phabricator.wikimedia.org/T207171 (10Strainu) Thanks Hal! I have a few follow-up questions: > This data is split by country and project and pa... [19:46:30] 10Quarry, 10Patch-For-Review: Add statistics to the homepage - https://phabricator.wikimedia.org/T204157 (10Framawiki) https://github.com/toolforge/quarry/pull/20 [20:13:01] 10Data-Engineering-Planning, 10Data-Platform-SRE, 10Shared-Data-Infrastructure (Q4 Wrap up): Upgrade the spark YARN shuffler service on Hadoop workers from version 2 to 3 - https://phabricator.wikimedia.org/T332765 (10BTullis) I made another mistake. I wanted to check that `spark-3.1.2-yarn-shuffle.jar` was... [20:13:54] 10Quarry, 10cloud-services-team (FY2022/2023-Q4): Move Quarry to be an installation of Superset - https://phabricator.wikimedia.org/T169452 (10Framawiki) I've tried Superset for the first time and found some small points: - query csv exports have a `b'` prefix in each cell. Here is the export of gendergap quer... [20:36:06] 10Data-Engineering, 10Anti-Harassment, 10Data-Persistence, 10IP Masking, and 2 others: Adding user_is_temp to the user table - https://phabricator.wikimedia.org/T333223 (10Ottomata) [[ https://www.mediawiki.org/wiki/Talk:User_account_types | Here is a reason ]] why working on {T336176} sooner rather than l... [20:36:28] 10Data-Engineering, 10Data-Persistence, 10Event-Platform Value Stream, 10IP Masking, 10Platform Engineering: MediaWiki user types - https://phabricator.wikimedia.org/T336176 (10Ottomata) [[ https://www.mediawiki.org/wiki/Talk:User_account_types | Here is a reason ]] why working on this sooner rather than... [20:40:16] 10Data-Engineering-Planning, 10DC-Ops, 10SRE, 10Shared-Data-Infrastructure, 10ops-eqiad: Q3:rack/setup/install an-worker11[49-56] - https://phabricator.wikimedia.org/T327295 (10Jclark-ctr) Configured raid on an-worker11(49,51,52,53,54,55,56) Unable to login to management on 50. need to verify psu1 on 49 [20:57:55] 10Data-Engineering, 10Data Pipelines (Sprint 13): Update Sqoop for externallinks table changes - https://phabricator.wikimedia.org/T335917 (10Antoine_Quhen) Do you know if there is a DB with the new schema version? It would be cool to have a place to test the import. [21:06:15] (03PS1) 10Aqu: Update Scoop scripts for mediawiki.externallinks schema change [analytics/refinery] - 10https://gerrit.wikimedia.org/r/922172 (https://phabricator.wikimedia.org/T335917) [21:07:42] 10Data-Engineering, 10Data Pipelines (Sprint 13), 10Patch-For-Review: Update Sqoop for externallinks table changes - https://phabricator.wikimedia.org/T335917 (10Antoine_Quhen) 05Open→03In progress [21:13:46] 10Data-Engineering, 10serviceops, 10Event-Platform Value Stream (Sprint 14 A), 10Patch-For-Review: New Service Request: flink-kubernetes-operator - https://phabricator.wikimedia.org/T333464 (10Ottomata) Working a bit on flink-kubernetes-operator dashboard; I think [[ https://lists.apache.org/thread/ccovbfl... [21:37:14] 10Data-Engineering, 10Data-Platform-SRE, 10LDAP-Access-Requests, 10Shared-Data-Infrastructure (Q4 Wrap up): Grant temporary access to web based Data Engineering tools to Bishop Fox - https://phabricator.wikimedia.org/T336357 (10BTullis) Yep, that's great thanks @jbond. I've just had confirmation by email t... [21:54:23] 10Data-Engineering, 10Data-Engineering-Wikistats, 10Inuka-Team, 10Language-strategy, and 2 others: Have a way to show the most popular pages per country - https://phabricator.wikimedia.org/T207171 (10Htriedman) @Strainu > I don't quite get this. If I query this URL I thought I get views from Romania drill... [21:56:47] 10Data-Engineering-Planning, 10Data-Platform-SRE, 10Patch-For-Review, 10Shared-Data-Infrastructure (Q4 Wrap up): Upgrade the spark YARN shuffler service on Hadoop workers from version 2 to 3 - https://phabricator.wikimedia.org/T332765 (10CodeReviewBot) btullis opened https://gitlab.wikimedia.org/repos/data... [21:56:57] 10Data-Engineering-Planning, 10Data-Platform-SRE, 10Patch-For-Review, 10Shared-Data-Infrastructure (Q4 Wrap up): Upgrade the spark YARN shuffler service on Hadoop workers from version 2 to 3 - https://phabricator.wikimedia.org/T332765 (10CodeReviewBot) [21:57:20] 10Analytics, 10AQS2.0, 10API Platform (AQS 2.0 Roadmap), 10Documentation, and 3 others: AQS 2.0 documentation - https://phabricator.wikimedia.org/T288664 (10apaskulin) [22:07:13] 10Data-Engineering, 10Data-Platform-SRE, 10Shared-Data-Infrastructure: Add checksumming of miniconda installer - https://phabricator.wikimedia.org/T337271 (10BTullis) [22:09:13] 10Data-Engineering, 10Data-Platform-SRE, 10Shared-Data-Infrastructure, 10Patch-For-Review: Add checksumming of miniconda installer - https://phabricator.wikimedia.org/T337271 (10CodeReviewBot) btullis opened https://gitlab.wikimedia.org/repos/data-engineering/conda-analytics/-/merge_requests/30 Add checks... [22:09:24] 10Data-Engineering, 10Data-Platform-SRE, 10Shared-Data-Infrastructure, 10Patch-For-Review: Add checksumming of miniconda installer - https://phabricator.wikimedia.org/T337271 (10CodeReviewBot) [22:12:23] !log installing conda-analytics-0.0.17.dev_amd64.deb to an-test-client1001 for T332765 [22:12:26] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [22:12:26] T332765: Upgrade the spark YARN shuffler service on Hadoop workers from version 2 to 3 - https://phabricator.wikimedia.org/T332765 [22:12:42] 10Data-Engineering-Planning, 10Data-Platform-SRE, 10Patch-For-Review, 10Shared-Data-Infrastructure (Q4 Wrap up): Upgrade the spark YARN shuffler service on Hadoop workers from version 2 to 3 - https://phabricator.wikimedia.org/T332765 (10BTullis) OK, this time I have built a debian package first and checke... [22:57:41] 10Quarry, 10cloud-services-team (FY2022/2023-Q4): Move Quarry to be an installation of Superset - https://phabricator.wikimedia.org/T169452 (10Liz) My only concern is that I'm not a programmer, just a regular editor, and I run several queries evert day that were written for me by more tech-minded editors. I ho...