[00:12:27] 10Analytics-Canonical-Data, 06Movement-Insights: Provide ISO 639 language codes in canonical wiki dataset - https://phabricator.wikimedia.org/T346855#10782536 (10nshahquinn-wmf) [00:21:42] 10Analytics-Canonical-Data, 06Movement-Insights, 07Epic: Add language and incubating wikis data to canonical data - https://phabricator.wikimedia.org/T388201#10782540 (10nshahquinn-wmf) [00:33:04] 10Analytics-Canonical-Data, 06Movement-Insights: Provide ISO 639 language codes in canonical wiki dataset - https://phabricator.wikimedia.org/T346855#10782557 (10nshahquinn-wmf) [00:56:54] 10Analytics-Canonical-Data, 06Movement-Insights: Add Iceberg version of canonical data tables - https://phabricator.wikimedia.org/T388291#10782572 (10nshahquinn-wmf) [00:58:05] 10Analytics-Canonical-Data, 06Movement-Insights: Provide ISO 639 language codes in canonical wiki dataset - https://phabricator.wikimedia.org/T346855#10782573 (10nshahquinn-wmf) [00:58:58] 10Analytics-Canonical-Data, 06Movement-Insights: Provide ISO 639 language codes in canonical wiki dataset - https://phabricator.wikimedia.org/T346855#10782574 (10nshahquinn-wmf) [01:04:16] 06Data-Engineering, 06Data-Engineering-Radar, 10MediaWiki-Blocks, 10Multiblocks, and 7 others: Race condition in DatabaseBlockStore::acquireTarget() - https://phabricator.wikimedia.org/T389028#10782575 (10tstarling) [01:09:17] 10Analytics-Canonical-Data, 06Movement-Insights: Provide ISO 639 language codes in canonical wiki dataset - https://phabricator.wikimedia.org/T346855#10782577 (10nshahquinn-wmf) [01:24:31] 10Analytics-Canonical-Data, 06Movement-Insights: Create a canonical dataset for incubating wikis - https://phabricator.wikimedia.org/T393075 (10nshahquinn-wmf) 03NEW [01:24:44] 10Analytics-Canonical-Data, 06Movement-Insights: Create a canonical dataset for incubating wikis - https://phabricator.wikimedia.org/T393075#10782599 (10nshahquinn-wmf) p:05Triage→03Medium [01:34:40] 10Analytics-Canonical-Data, 06Movement-Insights, 07Epic: Add Glottolog fields to canonical language dataset - https://phabricator.wikimedia.org/T393076 (10nshahquinn-wmf) 03NEW [01:34:50] 10Analytics-Canonical-Data, 06Movement-Insights, 07Epic: Add Glottolog fields to canonical language dataset - https://phabricator.wikimedia.org/T393076#10782627 (10nshahquinn-wmf) p:05Triage→03Low [01:35:06] 10Analytics-Canonical-Data, 06Movement-Insights: Add Glottolog fields to canonical language dataset - https://phabricator.wikimedia.org/T393076#10782628 (10nshahquinn-wmf) [01:35:52] 10Analytics-Canonical-Data, 06Movement-Insights: Add Glottolog fields to canonical language dataset - https://phabricator.wikimedia.org/T393076#10782629 (10nshahquinn-wmf) [01:35:53] 10Analytics-Canonical-Data, 06Movement-Insights: Create a first version of the canonical language dataset - https://phabricator.wikimedia.org/T392951#10782630 (10nshahquinn-wmf) [01:41:01] 10Analytics-Canonical-Data, 06Movement-Insights, 07Epic: Add language and incubating wikis data to canonical data - https://phabricator.wikimedia.org/T388201#10782631 (10nshahquinn-wmf) [01:43:59] 10Analytics-Canonical-Data, 06Movement-Insights: Create a canonical dataset for incubating wikis - https://phabricator.wikimedia.org/T393075#10782640 (10nshahquinn-wmf) [01:44:10] 10Analytics-Canonical-Data, 06Movement-Insights: Create a canonical dataset for incubating wikis - https://phabricator.wikimedia.org/T393075#10782643 (10nshahquinn-wmf) a:05nshahquinn-wmf→03None [01:44:49] 10Analytics-Canonical-Data, 06Movement-Insights: Create a first version of the canonical language dataset - https://phabricator.wikimedia.org/T392951#10782644 (10nshahquinn-wmf) p:05Low→03Medium a:05nshahquinn-wmf→03None [01:45:06] 10Analytics-Canonical-Data, 06Movement-Insights: Add Glottolog fields to canonical language dataset - https://phabricator.wikimedia.org/T393076#10782647 (10nshahquinn-wmf) a:05nshahquinn-wmf→03None [01:45:18] 10Analytics-Canonical-Data, 06Movement-Insights, 07Epic: Add language and incubating wikis data to canonical data - https://phabricator.wikimedia.org/T388201#10782648 (10nshahquinn-wmf) a:05nshahquinn-wmf→03None [01:47:06] 10Analytics-Canonical-Data, 06Movement-Insights: Provide ISO 639 language codes in canonical wiki dataset - https://phabricator.wikimedia.org/T346855#10782650 (10nshahquinn-wmf) p:05Low→03Medium [01:48:39] 10Analytics-Canonical-Data, 06Movement-Insights, 07Epic: Add language and incubating wikis data to canonical data - https://phabricator.wikimedia.org/T388201#10782653 (10nshahquinn-wmf) a:03nshahquinn-wmf [14:12:55] 06Data-Engineering, 06SRE, 10superset.wikimedia.org: Frequent filter timeouts in superset UI - https://phabricator.wikimedia.org/T393097 (10hnowlan) 03NEW [15:45:48] 10Data-Engineering (Q4 2025 April 1st - June 30th), 10Experimentation Lab (Experiment Platform Sprint 5), 13Patch-For-Review: FY 24-25 SDS 2.4.9 CDN Synthetic Beacon: EventGate & Varnish: update to receive events from beacon event v2 - https://phabricator.wikimedia.org/T391959#10783615 (10Milimetric) [15:49:21] 06Data-Engineering, 10Data-Platform-SRE (2025-04-12 - 2025-05-02), 10Sustainability (Incident Followup): airflow: Restrict the rights for airflow deployers to destroy postgresql clusters - https://phabricator.wikimedia.org/T391348#10783631 (10BTullis) [15:55:56] 10Data-Engineering (Q4 2025 April 1st - June 30th), 10Experimentation Lab (Experiment Platform Sprint 6), 13Patch-For-Review: FY 24-25 SDS 2.4.9 CDN Synthetic Beacon: EventGate & Varnish: update to receive events from beacon event v2 - https://phabricator.wikimedia.org/T391959#10783653 (10Milimetric) [16:43:07] 10Data-Engineering (Q4 2025 April 1st - June 30th), 10DPE-Mediawiki-Content: Monthly reconcile pipeline not triggering - https://phabricator.wikimedia.org/T393108 (10xcollazo) 03NEW [17:38:05] 10Data-Engineering (Q4 2025 April 1st - June 30th), 10DPE-Mediawiki-Content, 13Patch-For-Review: Monthly reconcile pipeline not triggering - https://phabricator.wikimedia.org/T393108#10784094 (10xcollazo) [17:56:23] 06Data-Engineering: Update airflow-dags wmf_airflow_common library rename analytics to main - https://phabricator.wikimedia.org/T393111 (10amastilovic) 03NEW [18:19:23] 10Data-Engineering (Q4 2025 April 1st - June 30th): Unify Airflow's datasets.yaml config files across instances - https://phabricator.wikimedia.org/T383931#10784161 (10Ahoelzl) [20:36:14] 10Data-Engineering (Q4 2025 April 1st - June 30th), 10Experimentation Lab (Experiment Platform Sprint 6), 13Patch-For-Review: FY 24-25 SDS 2.4.9 CDN Synthetic Beacon: EventGate & Varnish: update to receive events from beacon event v2 - https://phabricator.wikimedia.org/T391959#10784514 (10dr0ptp4kt) [20:39:47] 10Data-Engineering (Q4 2025 April 1st - June 30th), 10Experimentation Lab (Experiment Platform Sprint 6), 13Patch-For-Review: FY 24-25 SDS 2.4.9 CDN Synthetic Beacon: EventGate & Varnish: update to receive events from beacon event v2 - https://phabricator.wikimedia.org/T391959#10784517 (10dr0ptp4kt) @tchin I... [21:01:40] hi! how's it going, all? [21:01:42] I'm writing to ask for a not-so-small bit of help, if anyone has a bit of space and is interested! I've submitted a paper for the upcoming WikiWorkshop, and would like to update some of the data to be presented, but I currently don't have access to the analytics servers. If anyone feels like helping pull the data, that'd be amazing. Also no worries if not. It'd probably be about 2-3 [21:01:44] hours of work, all told. [21:02:40] This is the event I'll present at: https://meta.wikimedia.org/wiki/Wiki_Workshop_2025 [21:03:39] The presentation will be a summary of the Wikidata metrics I worked on, described in the full report here: https://upload.wikimedia.org/wikipedia/commons/b/b8/Statement_Signals_Measuring_Wikidata_Usage_on_Other_Wikis.pdf [21:04:21] The plot I'm hoping to update is on page 38. It's all based on public data, but the existing code to query it runs on the internal data lake. [21:04:49] Many thanks in advance and apologies for the bother!!! [21:06:02] a-team ^ (hope it's ok to ping like this, thanks again in advance in any case!) [22:00:36] FIRING: MediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag: ... [22:00:36] High Kafka consumer lag for mw_content_history_reconcile_enrich in eqiad - TODO - https://grafana.wikimedia.org/d/K9x0c4aVk/flink-app?orgId=1&var-datasource=eqiad%20prometheus/k8s-dse&var-namespace=mw-content-history-reconcile-enrich&var-helm_release=production&var-operator_name=All&var-flink_job_name=mw_content_history_reconcile_enrich - https://alerts.wikimedia.org/?q=alertname%3DMediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag [22:10:36] RESOLVED: MediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag: ... [22:10:36] High Kafka consumer lag for mw_content_history_reconcile_enrich in eqiad - TODO - https://grafana.wikimedia.org/d/K9x0c4aVk/flink-app?orgId=1&var-datasource=eqiad%20prometheus/k8s-dse&var-namespace=mw-content-history-reconcile-enrich&var-helm_release=production&var-operator_name=All&var-flink_job_name=mw_content_history_reconcile_enrich - https://alerts.wikimedia.org/?q=alertname%3DMediawikiContentHistoryReconcileEnrichHighKafkaConsumerLag