[00:28:25] 10Data-Engineering (Q2 2024 October 1st - December 31th), 10MediaWiki-Platform-Team (Radar): Create legacy EventLogging proxy HTTP intake (for MediaWikiPingback) endpoint to EventGate - https://phabricator.wikimedia.org/T353817#10443222 (10Pppery) [00:28:35] 06Data-Engineering: New conda-analytics clone installs packages from Anaconda repository - https://phabricator.wikimedia.org/T383284#10443223 (10nshahquinn-wmf) [00:29:43] 06Data-Engineering: New conda-analytics clone installs packages from Anaconda repository - https://phabricator.wikimedia.org/T383284#10443230 (10nshahquinn-wmf) [02:57:36] FIRING: MediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag: ... [02:57:36] High Kafka consumer lag for mw_content_history_reconcile_enrich in eqiad - TODO - https://grafana.wikimedia.org/d/K9x0c4aVk/flink-app?orgId=1&var-datasource=eqiad%20prometheus/k8s&var-namespace=mw-content-history-reconcile-enrich&var-helm_release=production&var-operator_name=All&var-flink_job_name=mw_content_history_reconcile_enrich - https://alerts.wikimedia.org/?q=alertname%3DMediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag [03:02:36] RESOLVED: MediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag: ... [03:02:36] High Kafka consumer lag for mw_content_history_reconcile_enrich in eqiad - TODO - https://grafana.wikimedia.org/d/K9x0c4aVk/flink-app?orgId=1&var-datasource=eqiad%20prometheus/k8s&var-namespace=mw-content-history-reconcile-enrich&var-helm_release=production&var-operator_name=All&var-flink_job_name=mw_content_history_reconcile_enrich - https://alerts.wikimedia.org/?q=alertname%3DMediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag [03:04:36] FIRING: MediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag: ... [03:04:36] High Kafka consumer lag for mw_content_history_reconcile_enrich in eqiad - TODO - https://grafana.wikimedia.org/d/K9x0c4aVk/flink-app?orgId=1&var-datasource=eqiad%20prometheus/k8s&var-namespace=mw-content-history-reconcile-enrich&var-helm_release=production&var-operator_name=All&var-flink_job_name=mw_content_history_reconcile_enrich - https://alerts.wikimedia.org/?q=alertname%3DMediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag [03:09:36] RESOLVED: MediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag: ... [03:09:36] High Kafka consumer lag for mw_content_history_reconcile_enrich in eqiad - TODO - https://grafana.wikimedia.org/d/K9x0c4aVk/flink-app?orgId=1&var-datasource=eqiad%20prometheus/k8s&var-namespace=mw-content-history-reconcile-enrich&var-helm_release=production&var-operator_name=All&var-flink_job_name=mw_content_history_reconcile_enrich - https://alerts.wikimedia.org/?q=alertname%3DMediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag [03:12:23] 06Data-Engineering, 06Commons, 06Data-Persistence, 10MediaWiki-File-management, and 2 others: Migrate file tables to a modern layout (image/oldimage; file/file_revision; add primary keys) - https://phabricator.wikimedia.org/T28741#10443375 (10Bugreporter) Note: the proposed new schema tie media type to med... [04:28:36] FIRING: MediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag: ... [04:28:36] High Kafka consumer lag for mw_content_history_reconcile_enrich in eqiad - TODO - https://grafana.wikimedia.org/d/K9x0c4aVk/flink-app?orgId=1&var-datasource=eqiad%20prometheus/k8s&var-namespace=mw-content-history-reconcile-enrich&var-helm_release=production&var-operator_name=All&var-flink_job_name=mw_content_history_reconcile_enrich - https://alerts.wikimedia.org/?q=alertname%3DMediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag [04:33:36] RESOLVED: MediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag: ... [04:33:36] High Kafka consumer lag for mw_content_history_reconcile_enrich in eqiad - TODO - https://grafana.wikimedia.org/d/K9x0c4aVk/flink-app?orgId=1&var-datasource=eqiad%20prometheus/k8s&var-namespace=mw-content-history-reconcile-enrich&var-helm_release=production&var-operator_name=All&var-flink_job_name=mw_content_history_reconcile_enrich - https://alerts.wikimedia.org/?q=alertname%3DMediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag [04:42:36] FIRING: MediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag: ... [04:42:36] High Kafka consumer lag for mw_content_history_reconcile_enrich in eqiad - TODO - https://grafana.wikimedia.org/d/K9x0c4aVk/flink-app?orgId=1&var-datasource=eqiad%20prometheus/k8s&var-namespace=mw-content-history-reconcile-enrich&var-helm_release=production&var-operator_name=All&var-flink_job_name=mw_content_history_reconcile_enrich - https://alerts.wikimedia.org/?q=alertname%3DMediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag [05:02:36] RESOLVED: MediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag: ... [05:02:36] High Kafka consumer lag for mw_content_history_reconcile_enrich in eqiad - TODO - https://grafana.wikimedia.org/d/K9x0c4aVk/flink-app?orgId=1&var-datasource=eqiad%20prometheus/k8s&var-namespace=mw-content-history-reconcile-enrich&var-helm_release=production&var-operator_name=All&var-flink_job_name=mw_content_history_reconcile_enrich - https://alerts.wikimedia.org/?q=alertname%3DMediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag [05:05:36] FIRING: MediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag: ... [05:05:36] High Kafka consumer lag for mw_content_history_reconcile_enrich in eqiad - TODO - https://grafana.wikimedia.org/d/K9x0c4aVk/flink-app?orgId=1&var-datasource=eqiad%20prometheus/k8s&var-namespace=mw-content-history-reconcile-enrich&var-helm_release=production&var-operator_name=All&var-flink_job_name=mw_content_history_reconcile_enrich - https://alerts.wikimedia.org/?q=alertname%3DMediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag [05:10:36] RESOLVED: MediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag: ... [05:10:36] High Kafka consumer lag for mw_content_history_reconcile_enrich in eqiad - TODO - https://grafana.wikimedia.org/d/K9x0c4aVk/flink-app?orgId=1&var-datasource=eqiad%20prometheus/k8s&var-namespace=mw-content-history-reconcile-enrich&var-helm_release=production&var-operator_name=All&var-flink_job_name=mw_content_history_reconcile_enrich - https://alerts.wikimedia.org/?q=alertname%3DMediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag [05:43:36] FIRING: MediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag: ... [05:43:36] High Kafka consumer lag for mw_content_history_reconcile_enrich in eqiad - TODO - https://grafana.wikimedia.org/d/K9x0c4aVk/flink-app?orgId=1&var-datasource=eqiad%20prometheus/k8s&var-namespace=mw-content-history-reconcile-enrich&var-helm_release=production&var-operator_name=All&var-flink_job_name=mw_content_history_reconcile_enrich - https://alerts.wikimedia.org/?q=alertname%3DMediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag [05:48:36] RESOLVED: MediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag: ... [05:48:36] High Kafka consumer lag for mw_content_history_reconcile_enrich in eqiad - TODO - https://grafana.wikimedia.org/d/K9x0c4aVk/flink-app?orgId=1&var-datasource=eqiad%20prometheus/k8s&var-namespace=mw-content-history-reconcile-enrich&var-helm_release=production&var-operator_name=All&var-flink_job_name=mw_content_history_reconcile_enrich - https://alerts.wikimedia.org/?q=alertname%3DMediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag [05:53:36] FIRING: MediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag: ... [05:53:36] High Kafka consumer lag for mw_content_history_reconcile_enrich in eqiad - TODO - https://grafana.wikimedia.org/d/K9x0c4aVk/flink-app?orgId=1&var-datasource=eqiad%20prometheus/k8s&var-namespace=mw-content-history-reconcile-enrich&var-helm_release=production&var-operator_name=All&var-flink_job_name=mw_content_history_reconcile_enrich - https://alerts.wikimedia.org/?q=alertname%3DMediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag [05:58:36] RESOLVED: MediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag: ... [05:58:36] High Kafka consumer lag for mw_content_history_reconcile_enrich in eqiad - TODO - https://grafana.wikimedia.org/d/K9x0c4aVk/flink-app?orgId=1&var-datasource=eqiad%20prometheus/k8s&var-namespace=mw-content-history-reconcile-enrich&var-helm_release=production&var-operator_name=All&var-flink_job_name=mw_content_history_reconcile_enrich - https://alerts.wikimedia.org/?q=alertname%3DMediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag [06:03:36] FIRING: MediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag: ... [06:03:36] High Kafka consumer lag for mw_content_history_reconcile_enrich in eqiad - TODO - https://grafana.wikimedia.org/d/K9x0c4aVk/flink-app?orgId=1&var-datasource=eqiad%20prometheus/k8s&var-namespace=mw-content-history-reconcile-enrich&var-helm_release=production&var-operator_name=All&var-flink_job_name=mw_content_history_reconcile_enrich - https://alerts.wikimedia.org/?q=alertname%3DMediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag [06:23:36] RESOLVED: MediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag: ... [06:23:36] High Kafka consumer lag for mw_content_history_reconcile_enrich in eqiad - TODO - https://grafana.wikimedia.org/d/K9x0c4aVk/flink-app?orgId=1&var-datasource=eqiad%20prometheus/k8s&var-namespace=mw-content-history-reconcile-enrich&var-helm_release=production&var-operator_name=All&var-flink_job_name=mw_content_history_reconcile_enrich - https://alerts.wikimedia.org/?q=alertname%3DMediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag [06:34:36] FIRING: MediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag: ... [06:34:36] High Kafka consumer lag for mw_content_history_reconcile_enrich in eqiad - TODO - https://grafana.wikimedia.org/d/K9x0c4aVk/flink-app?orgId=1&var-datasource=eqiad%20prometheus/k8s&var-namespace=mw-content-history-reconcile-enrich&var-helm_release=production&var-operator_name=All&var-flink_job_name=mw_content_history_reconcile_enrich - https://alerts.wikimedia.org/?q=alertname%3DMediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag [06:44:36] RESOLVED: MediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag: ... [06:44:36] High Kafka consumer lag for mw_content_history_reconcile_enrich in eqiad - TODO - https://grafana.wikimedia.org/d/K9x0c4aVk/flink-app?orgId=1&var-datasource=eqiad%20prometheus/k8s&var-namespace=mw-content-history-reconcile-enrich&var-helm_release=production&var-operator_name=All&var-flink_job_name=mw_content_history_reconcile_enrich - https://alerts.wikimedia.org/?q=alertname%3DMediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag [06:48:00] 06Data-Engineering, 10ActiveAbstract, 10Dumps-Generation, 13Patch-For-Review: Undeploy and archive ActiveAbstract - https://phabricator.wikimedia.org/T382069#10443546 (10Jerrymaocn) Hi team, I am an engineer from Yahoo Search working on the wiki dataset. Thanks for all the support! From our understandin... [06:51:36] FIRING: MediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag: ... [06:51:36] High Kafka consumer lag for mw_content_history_reconcile_enrich in eqiad - TODO - https://grafana.wikimedia.org/d/K9x0c4aVk/flink-app?orgId=1&var-datasource=eqiad%20prometheus/k8s&var-namespace=mw-content-history-reconcile-enrich&var-helm_release=production&var-operator_name=All&var-flink_job_name=mw_content_history_reconcile_enrich - https://alerts.wikimedia.org/?q=alertname%3DMediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag [06:56:36] RESOLVED: MediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag: ... [06:56:36] High Kafka consumer lag for mw_content_history_reconcile_enrich in eqiad - TODO - https://grafana.wikimedia.org/d/K9x0c4aVk/flink-app?orgId=1&var-datasource=eqiad%20prometheus/k8s&var-namespace=mw-content-history-reconcile-enrich&var-helm_release=production&var-operator_name=All&var-flink_job_name=mw_content_history_reconcile_enrich - https://alerts.wikimedia.org/?q=alertname%3DMediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag [07:02:36] FIRING: MediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag: ... [07:02:36] High Kafka consumer lag for mw_content_history_reconcile_enrich in eqiad - TODO - https://grafana.wikimedia.org/d/K9x0c4aVk/flink-app?orgId=1&var-datasource=eqiad%20prometheus/k8s&var-namespace=mw-content-history-reconcile-enrich&var-helm_release=production&var-operator_name=All&var-flink_job_name=mw_content_history_reconcile_enrich - https://alerts.wikimedia.org/?q=alertname%3DMediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag [07:07:36] RESOLVED: MediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag: ... [07:07:36] High Kafka consumer lag for mw_content_history_reconcile_enrich in eqiad - TODO - https://grafana.wikimedia.org/d/K9x0c4aVk/flink-app?orgId=1&var-datasource=eqiad%20prometheus/k8s&var-namespace=mw-content-history-reconcile-enrich&var-helm_release=production&var-operator_name=All&var-flink_job_name=mw_content_history_reconcile_enrich - https://alerts.wikimedia.org/?q=alertname%3DMediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag [07:14:59] gmodena: is that ^ on your radar? [07:59:36] FIRING: MediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag: ... [07:59:36] High Kafka consumer lag for mw_content_history_reconcile_enrich in eqiad - TODO - https://grafana.wikimedia.org/d/K9x0c4aVk/flink-app?orgId=1&var-datasource=eqiad%20prometheus/k8s&var-namespace=mw-content-history-reconcile-enrich&var-helm_release=production&var-operator_name=All&var-flink_job_name=mw_content_history_reconcile_enrich - https://alerts.wikimedia.org/?q=alertname%3DMediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag [08:04:36] RESOLVED: MediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag: ... [08:04:36] High Kafka consumer lag for mw_content_history_reconcile_enrich in eqiad - TODO - https://grafana.wikimedia.org/d/K9x0c4aVk/flink-app?orgId=1&var-datasource=eqiad%20prometheus/k8s&var-namespace=mw-content-history-reconcile-enrich&var-helm_release=production&var-operator_name=All&var-flink_job_name=mw_content_history_reconcile_enrich - https://alerts.wikimedia.org/?q=alertname%3DMediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag [08:43:36] FIRING: MediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag: ... [08:43:36] High Kafka consumer lag for mw_content_history_reconcile_enrich in eqiad - TODO - https://grafana.wikimedia.org/d/K9x0c4aVk/flink-app?orgId=1&var-datasource=eqiad%20prometheus/k8s&var-namespace=mw-content-history-reconcile-enrich&var-helm_release=production&var-operator_name=All&var-flink_job_name=mw_content_history_reconcile_enrich - https://alerts.wikimedia.org/?q=alertname%3DMediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag [08:48:36] RESOLVED: MediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag: ... [08:48:36] High Kafka consumer lag for mw_content_history_reconcile_enrich in eqiad - TODO - https://grafana.wikimedia.org/d/K9x0c4aVk/flink-app?orgId=1&var-datasource=eqiad%20prometheus/k8s&var-namespace=mw-content-history-reconcile-enrich&var-helm_release=production&var-operator_name=All&var-flink_job_name=mw_content_history_reconcile_enrich - https://alerts.wikimedia.org/?q=alertname%3DMediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag [09:01:25] 06Data-Engineering, 06Data-Persistence, 10Dumps-Generation, 10Data-Platform-SRE (2024.11.30 - 2024.12.20), 13Patch-For-Review: Switch dumps 1.0 processes to use the analytics MariadB replicas (dbstore100[7-9]) - https://phabricator.wikimedia.org/T382947#10443749 (10Joe) I've created two patches, that imp... [09:21:36] FIRING: MediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag: ... [09:21:36] High Kafka consumer lag for mw_content_history_reconcile_enrich in eqiad - TODO - https://grafana.wikimedia.org/d/K9x0c4aVk/flink-app?orgId=1&var-datasource=eqiad%20prometheus/k8s&var-namespace=mw-content-history-reconcile-enrich&var-helm_release=production&var-operator_name=All&var-flink_job_name=mw_content_history_reconcile_enrich - https://alerts.wikimedia.org/?q=alertname%3DMediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag [09:26:36] RESOLVED: MediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag: ... [09:26:36] High Kafka consumer lag for mw_content_history_reconcile_enrich in eqiad - TODO - https://grafana.wikimedia.org/d/K9x0c4aVk/flink-app?orgId=1&var-datasource=eqiad%20prometheus/k8s&var-namespace=mw-content-history-reconcile-enrich&var-helm_release=production&var-operator_name=All&var-flink_job_name=mw_content_history_reconcile_enrich - https://alerts.wikimedia.org/?q=alertname%3DMediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag [09:28:18] (03CR) 10Gmodena: [C:03+1] Deequ: Account for filter condition in metric naming [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1107886 (https://phabricator.wikimedia.org/T353939) (owner: 10TChin) [09:51:37] 06Data-Engineering, 06Data-Persistence, 10Dumps-Generation, 10Data-Platform-SRE (2024.11.30 - 2024.12.20), 13Patch-For-Review: Switch dumps 1.0 processes to use the analytics MariadB replicas (dbstore100[7-9]) - https://phabricator.wikimedia.org/T382947#10443854 (10BTullis) >>! In T382947#10443749, @Joe... [10:16:36] FIRING: MediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag: ... [10:16:36] High Kafka consumer lag for mw_content_history_reconcile_enrich in eqiad - TODO - https://grafana.wikimedia.org/d/K9x0c4aVk/flink-app?orgId=1&var-datasource=eqiad%20prometheus/k8s&var-namespace=mw-content-history-reconcile-enrich&var-helm_release=production&var-operator_name=All&var-flink_job_name=mw_content_history_reconcile_enrich - https://alerts.wikimedia.org/?q=alertname%3DMediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag [10:21:36] RESOLVED: MediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag: ... [10:21:36] High Kafka consumer lag for mw_content_history_reconcile_enrich in eqiad - TODO - https://grafana.wikimedia.org/d/K9x0c4aVk/flink-app?orgId=1&var-datasource=eqiad%20prometheus/k8s&var-namespace=mw-content-history-reconcile-enrich&var-helm_release=production&var-operator_name=All&var-flink_job_name=mw_content_history_reconcile_enrich - https://alerts.wikimedia.org/?q=alertname%3DMediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag [10:40:02] 06Data-Engineering, 10ActiveAbstract, 10Dumps-Generation, 13Patch-For-Review: Undeploy and archive ActiveAbstract - https://phabricator.wikimedia.org/T382069#10443972 (10Ladsgroup) Thanks for checking! The urls and files should have the word "abstract" in them. For example this is for nlwiki: https://dumps... [12:31:40] 06Data-Engineering, 06Data-Platform-SRE, 10Dumps-Generation: WE 5.4 KR - Hypothesis 5.4.6 - Q3 FY24/25 - Validate Dumps 1.0 compatibility with PHP 8.1 - https://phabricator.wikimedia.org/T382484#10444159 (10BTullis) [14:35:02] 06Data-Engineering, 06Traffic: GeoDNS: Pipeline from event.development_network_probe to operations/dns.git - https://phabricator.wikimedia.org/T380626#10444613 (10Ottomata) This could be a little out of date, but: https://wikitech.wikimedia.org/wiki/Data_Platform/Systems/Airflow/Developer_guide/Python_Job_Rep... [14:38:51] 06Data-Engineering, 10Dumps-Generation: Wikimedia Downloads not complete - https://phabricator.wikimedia.org/T383030#10444631 (10xcollazo) From `snapshot1014`: `itwiki` run for `20250101` appears done: ` xcollazo@snapshot1014:/mnt/dumpsdata/xmldatadumps/private/itwiki/20250101$ tail -n 1 dumplog.txt 2025-01-... [14:41:15] 06Data-Engineering, 10Dumps-Generation: Wikimedia Downloads not complete - https://phabricator.wikimedia.org/T383030#10444642 (10xcollazo) @BTullis Dan seems OOO till next week. Do you recall how to run the rsync script manually? [14:49:11] 06Data-Engineering, 10Dumps-Generation: Wikimedia Downloads not complete - https://phabricator.wikimedia.org/T383030#10444692 (10BTullis) There is a service that runs continuously on dumpsdata1006. The service is a called `dumps-rsyncer.service` It claims to be running: ` btullis@dumpsdata1006:~$ systemctl sta... [14:50:01] 06Data-Engineering, 10Dumps-Generation: Wikimedia Downloads not complete - https://phabricator.wikimedia.org/T383030#10444696 (10BTullis) ` btullis@dumpsdata1006:~$ systemctl status dumps-rsyncer.service ● dumps-rsyncer.service - Dumps rsyncer service Loaded: loaded (/lib/systemd/system/dumps-rsyncer.ser... [15:59:40] 10Data-Engineering (Q2 2024 October 1st - December 31th), 10Dumps 2.0 (Kanban Board), 13Patch-For-Review: Enable HA for the mw-content-history-reconcile-enrich flink application - https://phabricator.wikimedia.org/T375176#10445041 (10tchin) Tried deploying to staging with @gmodena, got this error but it does... [18:36:21] 06Data-Engineering, 06Commons, 06Data-Persistence, 10MediaWiki-File-management, and 2 others: Migrate file tables to a modern layout (image/oldimage; file/filerevision; add primary keys) - https://phabricator.wikimedia.org/T28741#10445639 (10Krinkle) [18:40:50] 06Data-Engineering, 06Commons, 06Data-Persistence, 10MediaWiki-File-management, and 3 others: Migrate file tables to a modern layout (image/oldimage; file/filerevision; add primary keys) - https://phabricator.wikimedia.org/T28741#10445646 (10Krinkle) [18:44:22] (03PS1) 10Ottomata: gobblin eventlogging_legacy - use EventStreamConfig to pull topics [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1109477 (https://phabricator.wikimedia.org/T238230) [18:44:54] (03PS2) 10Ottomata: gobblin eventlogging_legacy - use EventStreamConfig to pull topics [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1109477 (https://phabricator.wikimedia.org/T238230) [18:45:22] (03PS3) 10Ottomata: gobblin eventlogging_legacy - use EventStreamConfig to pull topics [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1109477 (https://phabricator.wikimedia.org/T238230) [18:47:56] 06Data-Engineering, 10MediaWiki-extensions-EventLogging, 10Event-Platform, 13Patch-For-Review: Decommission EventLogging backend components by migrating to MEP - https://phabricator.wikimedia.org/T238230#10445659 (10Ottomata) [19:01:16] (03CR) 10Gmodena: [C:03+1] "Nice!" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1109477 (https://phabricator.wikimedia.org/T238230) (owner: 10Ottomata) [19:27:55] 06Data-Engineering, 10Dumps-Generation: Wikimedia Downloads not complete - https://phabricator.wikimedia.org/T383030#10445776 (10BTullis) I think that it is something to do with this [[https://gerrit.wikimedia.org/g/operations/puppet/+/6774c8266b12cfe283a2eff691e376fffa7f8f81/modules/dumps/files/generation/rsy... [20:05:16] 06Data-Engineering, 10Dumps-Generation: Wikimedia Downloads not complete - https://phabricator.wikimedia.org/T383030#10445832 (10xcollazo) IIRC, we've been here before. Perhaps we should wait until @Milimetric comes back, he had a manual way of resyncing all this, is just that, AFAIK, it is not documented. [22:07:39] 06Data-Engineering, 06Data-Engineering-Icebox: Public DataHub - https://phabricator.wikimedia.org/T366720#10446186 (10Ottomata) [22:07:40] 06Data-Engineering, 06Data-Engineering-Icebox, 10Event-Platform: Simplify EventBus code by deprecating EventBusFactory - https://phabricator.wikimedia.org/T370524#10446185 (10Ottomata) [22:07:43] 06Data-Engineering, 06Data-Engineering-Icebox, 06Research, 10Research-engineering, 10Event-Platform: Productionized Edit Types - https://phabricator.wikimedia.org/T351225#10446187 (10Ottomata) [22:07:45] 06Data-Engineering, 06Data-Engineering-Icebox, 10Data-Engineering-Wikistats, 10PageViewInfo, and 3 others: Pageviews Analysis 3.0 (Vue + Codex) - https://phabricator.wikimedia.org/T378549#10446184 (10Ottomata) [22:07:45] 06Data-Engineering, 06Data-Engineering-Icebox, 10Event-Platform: Utilize Kafka Headers - https://phabricator.wikimedia.org/T351089#10446188 (10Ottomata) [22:07:46] 06Data-Engineering, 06Data-Engineering-Icebox, 10Data-Engineering-Wikistats: Add punjabi language in Wikistats - https://phabricator.wikimedia.org/T344572#10446189 (10Ottomata) [22:07:48] 06Data-Engineering, 06Data-Engineering-Icebox, 10Data-Engineering-Jupyter: Read and process parquet files from Jupyter notebooks - https://phabricator.wikimedia.org/T338932#10446190 (10Ottomata) [22:07:52] 06Data-Engineering, 06Data-Engineering-Icebox, 10Data-Engineering-Wikistats, 07I18n: Fill in missing qqq.json and enforce in future - https://phabricator.wikimedia.org/T338072#10446191 (10Ottomata) [22:07:56] 06Data-Engineering, 06Data-Engineering-Icebox, 10Data-Engineering-Wikistats, 07I18n: In Wikistats, `npm run dev` only shows strings in English - https://phabricator.wikimedia.org/T337033#10446192 (10Ottomata) [22:08:00] 06Data-Engineering, 06Data-Engineering-Icebox, 10Data-Engineering-Wikistats, 07I18n, 13Patch-For-Review: Untranslatable strings in Wikistats - https://phabricator.wikimedia.org/T337032#10446193 (10Ottomata) [22:08:04] 06Data-Engineering, 06Data-Engineering-Icebox, 10Data-Engineering-Wikistats, 07I18n, 13Patch-For-Review: Wikistats 2 should translate month names and abbreviations - https://phabricator.wikimedia.org/T336815#10446194 (10Ottomata) [22:08:08] 06Data-Engineering, 06Data-Engineering-Icebox, 10Data-Engineering-Wikistats, 13Patch-For-Review: Change GitHub link to Gerrit in the Wikistats frontend - https://phabricator.wikimedia.org/T336765#10446195 (10Ottomata) [22:08:14] 06Data-Engineering, 06Data-Engineering-Icebox, 10Data-Engineering-Wikistats, 06translatewiki.net, 07I18n: Automate adding languages to wikistats - https://phabricator.wikimedia.org/T336752#10446196 (10Ottomata) [22:08:18] 06Data-Engineering, 06Data-Engineering-Icebox, 10MediaWiki-extensions-EventLogging, 10Metrics Platform: Determine what UserBucketService::getUserEditCountBucket should return for anons - https://phabricator.wikimedia.org/T329292#10446199 (10Ottomata) [22:08:25] 06Data-Engineering, 06Data-Engineering-Icebox, 10Data-Engineering-Wikistats: A way to see pageviews statistics on a geographical regional level - https://phabricator.wikimedia.org/T333718#10446197 (10Ottomata) [22:08:29] 06Data-Engineering, 06Data-Engineering-Icebox, 10Pageviews-API: Provide a mechanism to notify subscribers when page view data is available - https://phabricator.wikimedia.org/T326229#10446200 (10Ottomata) [22:08:33] 06Data-Engineering, 06Data-Engineering-Icebox, 10Data-Engineering-Wikistats, 07Russian-Sites: "Active editors by country" doesn't display numbers for Belarus, Kazakhstan, Russia - https://phabricator.wikimedia.org/T333716#10446198 (10Ottomata) [22:08:37] 06Data-Engineering, 06Data-Engineering-Icebox, 10Data-Engineering-Wikistats: User stats page - https://phabricator.wikimedia.org/T324993#10446201 (10Ottomata) [22:08:41] 06Data-Engineering, 06Data-Engineering-Icebox, 10Data-Engineering-Wikistats: Number of anonymous edits - https://phabricator.wikimedia.org/T323562#10446202 (10Ottomata) [22:08:45] 06Data-Engineering, 06Data-Engineering-Icebox, 10MediaWiki-extensions-EventLogging, 10Metrics Platform, 13Patch-Needs-Improvement: Deprecate/delete the mw.eventLog.Schema class - https://phabricator.wikimedia.org/T305491#10446205 (10Ottomata) [22:08:51] 06Data-Engineering, 06Data-Engineering-Icebox, 10Data-Engineering-Wikistats: Make it clear that WiViVi data is outdated - https://phabricator.wikimedia.org/T306478#10446204 (10Ottomata) [22:08:55] 06Data-Engineering, 06Data-Engineering-Icebox, 10Data-Engineering-Wikistats: Feature requests for Active Editors by Country - https://phabricator.wikimedia.org/T304720#10446206 (10Ottomata) [22:09:02] 06Data-Engineering, 06Data-Engineering-Icebox, 06Growth-Team, 10GrowthExperiments, and 3 others: Create a test for end-to-end event logging data verification of happy path with Special:Homepage and suggested edits - https://phabricator.wikimedia.org/T301463#10446209 (10Ottomata) [22:09:10] 06Data-Engineering, 06Data-Engineering-Icebox, 10Data-Engineering-Wikistats, 10Data Pipelines, and 3 others: Merge ks-Arab and ks-Deva to ks - https://phabricator.wikimedia.org/T314476#10446203 (10Ottomata) [22:09:14] 06Data-Engineering, 06Data-Engineering-Icebox, 14Data-Engineering-Kanban, 10Data-Engineering-Wikistats, 06Product-Analytics: Wikistats reports no mobile unique devices for Wikidata and MediaWiki.org - https://phabricator.wikimedia.org/T299559#10446210 (10Ottomata) [22:09:18] 06Data-Engineering, 06Data-Engineering-Icebox, 10Data-Engineering-Wikistats: Change state to store project as an array - https://phabricator.wikimedia.org/T283624#10446211 (10Ottomata) [22:09:22] 06Data-Engineering, 06Data-Engineering-Icebox, 10Data-Engineering-Wikistats, 07Epic: Add ability to compare wikis - https://phabricator.wikimedia.org/T283251#10446212 (10Ottomata) [22:09:26] 14Analytics-Radar, 06Data-Engineering, 06Data-Engineering-Icebox, 10Data-Engineering-Wikistats: Negative total number of bytes for German Wikipedia in 2001? - https://phabricator.wikimedia.org/T203906#10446214 (10Ottomata) [22:09:30] 06Data-Engineering, 06Data-Engineering-Icebox, 10Data-Engineering-Wikistats: Automate creation of sqoop list of wikis to import data for from sitematrix - https://phabricator.wikimedia.org/T190700#10446215 (10Ottomata) [22:09:34] 14Analytics-Radar, 06Data-Engineering, 06Data-Engineering-Icebox, 10Data-Engineering-Wikistats: WiViVi: Per-person should account for connected percentage? - https://phabricator.wikimedia.org/T172335#10446216 (10Ottomata) [22:09:38] 14Analytics-Radar, 06Data-Engineering, 06Data-Engineering-Icebox, 10Pageviews-API, and 3 others: views error in mostread feed - https://phabricator.wikimedia.org/T267624#10446213 (10Ottomata) [22:09:43] 14Analytics-Radar, 06Data-Engineering, 06Data-Engineering-Icebox, 10GLAM-Tech, 10Pageviews-API: WMF pageview API (404 error) when requesting statistics over around 1000 files on GLAMorgan - https://phabricator.wikimedia.org/T145197#10446217 (10Ottomata) [22:09:47] 06Data-Engineering, 06Data-Engineering-Icebox, 10MediaWiki-extensions-EventLogging, 10MediaWiki-General, 07Performance Issue: Add event tracking queue to MediaWiki core for loose coupling with EventLogging or other interested consumers - https://phabricator.wikimedia.org/T95356#10446218 (10Ottomata) [22:09:53] 06Data-Engineering, 06Data-Engineering-Icebox, 10Data-Engineering-Wikistats: Non-mobile UAs on mobile (2g/gprs, etc) IP-blocks - https://phabricator.wikimedia.org/T58628#10446219 (10Ottomata) [22:09:57] 14Analytics-Radar, 06Data-Engineering, 06Data-Engineering-Icebox, 10MediaWiki-extensions-EventLogging: SearchSatisfaction has validation errors for event.query - https://phabricator.wikimedia.org/T257331#10446222 (10Ottomata) [22:10:03] 06Data-Engineering, 06Data-Engineering-Icebox, 10Event-Platform: [EventGate] Failures when getting stream config from MediaWiki API - https://phabricator.wikimedia.org/T286793#10446221 (10Ottomata) [22:10:07] 06Data-Engineering, 06Data-Engineering-Icebox, 06Product-Analytics, 10Wmfdata-Python: Set up Wmfdata-Python integration test suite to run automatically - https://phabricator.wikimedia.org/T304547#10446224 (10Ottomata) [22:10:11] 06Data-Engineering, 06Data-Engineering-Icebox, 10Data-Engineering-Wikistats: Define reduce calculations needed to compute active editors per project family - https://phabricator.wikimedia.org/T249751#10446223 (10Ottomata) [22:10:15] 06Data-Engineering, 06Data-Engineering-Icebox, 10Data-Engineering-Wikistats: Confusing filtering on "Active editors by country" topic - https://phabricator.wikimedia.org/T300365#10446225 (10Ottomata) [22:10:19] 06Data-Engineering, 06Data-Engineering-Icebox, 06Movement-Insights, 10Wmfdata-Python, 07Documentation: Publish HTML docs for Wmfdata-Python on doc.wikimedia.org - https://phabricator.wikimedia.org/T298178#10446226 (10Ottomata) [22:10:23] 06Data-Engineering, 06Data-Engineering-Icebox, 10Data-Engineering-Wikistats, 13Patch-Needs-Improvement: Expand Wikiselector to allow more than one wiki - https://phabricator.wikimedia.org/T285050#10446228 (10Ottomata) [22:10:27] 06Data-Engineering, 06Data-Engineering-Icebox, 10Data-Engineering-Wikistats: Offer map and queries by subdivisions of countries - https://phabricator.wikimedia.org/T284294#10446229 (10Ottomata) [22:10:31] 06Data-Engineering, 06Data-Engineering-Icebox, 10Data-Engineering-Wikistats: Regional and group evaluations - https://phabricator.wikimedia.org/T264512#10446231 (10Ottomata) [22:10:35] 06Data-Engineering, 06Data-Engineering-Icebox, 10Data-Engineering-Wikistats: Wikistats should allow more than one project - https://phabricator.wikimedia.org/T283254#10446230 (10Ottomata) [22:10:43] 14Analytics, 06Data-Engineering, 06Data-Engineering-Icebox, 10EventStreams, and 4 others: [EPIC] Expose rdf-streaming-updater.mutation content through EventStreams - https://phabricator.wikimedia.org/T294133#10446227 (10Ottomata) [22:10:47] 06Data-Engineering, 06Data-Engineering-Icebox, 10Data-Engineering-Jupyter, 10CAS-SSO, and 2 others: Improve the JupyterHub services and use CAS/SSO - https://phabricator.wikimedia.org/T260386#10446233 (10Ottomata) [22:10:55] 06Data-Engineering, 06Data-Engineering-Icebox, 10Data-Engineering-Wikistats, 06Commons: Creating tools for compiling list of Wikimedia Commons users by contributions/uploads - https://phabricator.wikimedia.org/T263377#10446232 (10Ottomata) [22:11:01] 06Data-Engineering, 06Data-Engineering-Icebox, 10Data-Engineering-Wikistats: Country pageview breakdown by language - https://phabricator.wikimedia.org/T250001#10446234 (10Ottomata) [22:11:05] 06Data-Engineering, 06Data-Engineering-Icebox, 10Data-Engineering-Wikistats: Group pageview data per family in AQS so we can surface it in wikistats per-family pageview metrics - https://phabricator.wikimedia.org/T205730#10446237 (10Ottomata) [22:11:09] 06Data-Engineering, 06Data-Engineering-Icebox, 10Data-Engineering-Wikistats, 10Technical-Tool-Request: Ranked list of all Wikipedias by yearly readership growth - https://phabricator.wikimedia.org/T224963#10446235 (10Ottomata) [22:11:13] 14Analytics-Radar, 06Data-Engineering, 06Data-Engineering-Icebox, 10MediaWiki-extensions-EventLogging, 07Epic: Explore an API for logging events sampled by session - https://phabricator.wikimedia.org/T168380#10446238 (10Ottomata) [22:11:21] 14Analytics-Radar, 06Data-Engineering, 06Data-Engineering-Icebox, 10Pageviews-API, 10Tool-Pageviews: 429 Too Many Requests hit despite throttling to 100 req/sec - https://phabricator.wikimedia.org/T219857#10446236 (10Ottomata) [22:11:27] 06Data-Engineering, 06Data-Engineering-Icebox, 10Pageviews-API: Endpoint for average view rate in Pageview API - https://phabricator.wikimedia.org/T162933#10446239 (10Ottomata) [22:11:35] 06Data-Engineering, 06Data-Engineering-Icebox, 10Pageviews-API: Provide weekly top pageviews stats - https://phabricator.wikimedia.org/T133575#10446240 (10Ottomata) [22:11:39] 06Data-Engineering, 06Data-Engineering-Icebox, 10Data-Engineering-Wikistats: Link uploads reportcard from binaries stats - https://phabricator.wikimedia.org/T62391#10446241 (10Ottomata) [22:11:43] 06Data-Engineering, 06Data-Engineering-Icebox, 10Data-Engineering-Wikistats: stats.wikimedia.org needs options to see exact counts and dates - https://phabricator.wikimedia.org/T37150#10446242 (10Ottomata) [22:11:47] 06Data-Engineering, 06Data-Engineering-Icebox, 10Data-Engineering-Jupyter, 06Data-Platform-SRE, 06Product-Analytics: Remove anaconda-wmf package from the cluster - https://phabricator.wikimedia.org/T337963#10446243 (10Ottomata) [22:11:53] 06Data-Engineering, 06Data-Engineering-Icebox, 06Product-Analytics, 10Wmfdata-Python: PyHive ignores SET statements with a leading newline - https://phabricator.wikimedia.org/T334442#10446244 (10Ottomata) [22:11:57] 06Data-Engineering, 06Data-Engineering-Icebox, 06Product-Analytics, 10Wmfdata-Python: Support querying a range of hourly data partitions - https://phabricator.wikimedia.org/T294654#10446246 (10Ottomata) [22:12:01] 06Data-Engineering, 06Data-Engineering-Icebox, 10Data-Engineering-Wikistats, 10Movement-Metrics: Support including edits to deleted pages in editing metrics - https://phabricator.wikimedia.org/T295212#10446245 (10Ottomata) [22:12:05] 06Data-Engineering, 06Data-Engineering-Icebox, 06Product-Analytics, 10Wmfdata-Python: Decide whether and how to consolidate Wmfdata-Python and Refinery's Python modules - https://phabricator.wikimedia.org/T293700#10446247 (10Ottomata) [22:12:09] 14Analytics-Kanban, 06Data-Engineering, 06Data-Engineering-Icebox, 06Product-Analytics, 10Wmfdata-Python: wmfdata.mariadb relies on analytics-mysql being available - https://phabricator.wikimedia.org/T292479#10446248 (10Ottomata) [22:12:13] 06Data-Engineering, 06Data-Engineering-Icebox, 06Product-Analytics, 10Wmfdata-Python: Update all run functions to allow specifying date and index columns - https://phabricator.wikimedia.org/T273208#10446250 (10Ottomata) [22:12:17] 06Data-Engineering, 06Data-Engineering-Icebox, 06Product-Analytics, 10Wmfdata-Python: Add utility functions for converting between various time formats - https://phabricator.wikimedia.org/T273209#10446249 (10Ottomata) [22:12:21] 06Data-Engineering, 06Data-Engineering-Icebox, 06Product-Analytics, 10Wmfdata-Python: Update all Wmfdata-Python run functions to have consistent API - https://phabricator.wikimedia.org/T273197#10446251 (10Ottomata) [22:12:26] 06Data-Engineering, 06Data-Engineering-Icebox, 06Product-Analytics, 10Wmfdata-Python: Support importing a Parquet file into HDFS using wmfdata-python - https://phabricator.wikimedia.org/T273196#10446252 (10Ottomata) [22:12:32] 06Data-Engineering, 06Data-Engineering-Icebox, 06Product-Analytics, 10Wmfdata-Python: wmfdata should display more progress information and metadata when running a query - https://phabricator.wikimedia.org/T259808#10446254 (10Ottomata) [22:12:36] 06Data-Engineering, 06Data-Engineering-Icebox, 10Data-Engineering-Wikistats: "Page views by edition of Wikipedia" for each country - https://phabricator.wikimedia.org/T257071#10446253 (10Ottomata) [22:12:40] 06Data-Engineering, 06Data-Engineering-Icebox, 06Product-Analytics, 10Wmfdata-Python: Code toggle should remove standard error and center all output - https://phabricator.wikimedia.org/T247442#10446256 (10Ottomata) [22:12:44] 06Data-Engineering, 06Data-Engineering-Icebox, 10Data-Engineering-Wikistats: [Wikistats] The permanent link is broken - https://phabricator.wikimedia.org/T245445#10446255 (10Ottomata) [22:12:48] 06Data-Engineering, 06Data-Engineering-Icebox, 10Data-Engineering-Wikistats: Add "Top used photos" metric - https://phabricator.wikimedia.org/T220485#10446257 (10Ottomata) [22:12:52] 14Analytics, 06Data-Engineering, 06Data-Engineering-Icebox, 10Pageviews-API: Filter top pages by namespace/category - https://phabricator.wikimedia.org/T182975#10446259 (10Ottomata) [22:12:56] 06Data-Engineering, 06Data-Engineering-Icebox, 10Data-Engineering-Wikistats: Render Wikistats graphs server-side, so that they can be embedded on-wikis - https://phabricator.wikimedia.org/T178016#10446260 (10Ottomata) [22:13:00] 14Analytics, 06Data-Engineering, 06Data-Engineering-Icebox, 10MediaWiki-Action-API, and 2 others: API Analytics - page views by country - https://phabricator.wikimedia.org/T213221#10446258 (10Ottomata) [22:13:06] 06Data-Engineering, 06Data-Engineering-Icebox, 10Data-Engineering-Jupyter, 06Product-Analytics: Functionality to share & view notebooks - https://phabricator.wikimedia.org/T156934#10446261 (10Ottomata) [22:13:10] 14Analytics, 06Data-Engineering, 06Data-Engineering-Icebox, 10Pageviews-API: Adding top counts for wiki projects (ex: WikiProject:Medicine) to pageview API - https://phabricator.wikimedia.org/T141010#10446263 (10Ottomata) [22:13:14] 06Data-Engineering, 06Data-Engineering-Icebox, 10Data-Engineering-Wikistats: Determine total number of external links in all Wikipedias - https://phabricator.wikimedia.org/T137984#10446264 (10Ottomata) [22:13:18] 14Analytics, 06Data-Engineering, 06Data-Engineering-Icebox, 10Pageviews-API: Yearly endpoint for the /pageviews/top API - https://phabricator.wikimedia.org/T154381#10446262 (10Ottomata) [22:13:26] 06Data-Engineering, 06Data-Engineering-Icebox, 10Data-Engineering-Wikistats: Views/hr column in WikiStats should consider an average on several months - https://phabricator.wikimedia.org/T37194#10446268 (10Ottomata) [22:13:30] 06Data-Engineering, 06Data-Engineering-Icebox, 10Data-Engineering-Wikistats: add talk pages count to project statistics - https://phabricator.wikimedia.org/T71742#10446267 (10Ottomata) [22:13:34] 06Data-Engineering, 06Data-Engineering-Icebox, 10Data-Engineering-Wikistats: One column header in browsers per country report only contains '---' - https://phabricator.wikimedia.org/T73127#10446265 (10Ottomata) [22:13:38] 06Data-Engineering, 06Data-Engineering-Icebox, 10Data-Engineering-Wikistats: for all namespaces show page count without redirects - https://phabricator.wikimedia.org/T71743#10446266 (10Ottomata) [22:26:39] 06Data-Engineering, 06Experimentation Lab, 06Web-Team: WebClientError events have version in unexpected format - https://phabricator.wikimedia.org/T383275#10446328 (10Jdlrobson) p:05Triage→03Medium [23:42:59] 06Data-Engineering-Icebox-DEPRECATED, 10Observability-Logging: eventgate-analytics-external logs field explosion - https://phabricator.wikimedia.org/T333729#10446503 (10colewhite) I'm unable to tell if the number of fields within `response_body` has increased or decreased, but the field [[ https://grafana-rw.w...