[00:48:48] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10MediaWiki-Page-derived-data, 07OKR-Work: Global Editor Metrics - Data Pipeline - https://phabricator.wikimedia.org/T405039#11411631 (10Ahoelzl) **Revised: Daily source dataset decision** Further investigations showed that `mediawiki_content_hist... [06:13:01] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Drop rc_type from recentchanges in wmf production - https://phabricator.wikimedia.org/T410531#11411825 (10Marostegui) [06:17:16] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Drop rc_type from recentchanges in wmf production - https://phabricator.wikimedia.org/T410531#11411828 (10Marostegui) [06:57:32] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Drop rc_type from recentchanges in wmf production - https://phabricator.wikimedia.org/T410531#11411885 (10Marostegui) [08:08:14] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Drop rc_type from recentchanges in wmf production - https://phabricator.wikimedia.org/T410531#11411959 (10Marostegui) [08:14:02] 06Data-Engineering, 10DPE-Mediawiki-Content: When wikis cannot be exported due to SiteInfo, don't fail them - https://phabricator.wikimedia.org/T408819#11411980 (10brouberol) I'm going to experiment with something akin to `lang=python from airflow.providers.common.sql.operators.sql import SQLExecuteQueryOpera... [08:14:06] 06Data-Engineering, 10DPE-Mediawiki-Content: When wikis cannot be exported due to SiteInfo, don't fail them - https://phabricator.wikimedia.org/T408819#11411981 (10brouberol) a:03brouberol [08:14:11] 06Data-Engineering, 10DPE-Mediawiki-Content, 06Data-Platform-SRE (2025.11.07 - 2025.11.28): When wikis cannot be exported due to SiteInfo, don't fail them - https://phabricator.wikimedia.org/T408819#11411983 (10brouberol) [08:14:14] 06Data-Engineering, 10DPE-Mediawiki-Content, 06Data-Platform-SRE (2025.11.07 - 2025.11.28): When wikis cannot be exported due to SiteInfo, don't fail them - https://phabricator.wikimedia.org/T408819#11411984 (10brouberol) 05Open→03In progress [09:09:19] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Drop ar_sha1 from archive table in wmf production - https://phabricator.wikimedia.org/T411163 (10Zabe) 03NEW [09:11:35] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Drop rev_sha1 from revision table in wmf production - https://phabricator.wikimedia.org/T411164 (10Zabe) 03NEW [09:14:31] 06Data-Engineering, 06Data-Persistence, 06DBA, 10MediaWiki-Core-Revision-backend, and 5 others: Rethink rev_sha1 field - https://phabricator.wikimedia.org/T389026#11412118 (10Zabe) [09:14:32] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Drop rev_sha1 from revision table in wmf production - https://phabricator.wikimedia.org/T411164#11412119 (10Zabe) [09:14:34] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Drop ar_sha1 from archive table in wmf production - https://phabricator.wikimedia.org/T411163#11412120 (10Zabe) [09:16:24] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Drop ar_sha1 from archive table in wmf production - https://phabricator.wikimedia.org/T411163#11412128 (10Marostegui) a:03Marostegui [09:16:53] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Drop rev_sha1 from revision table in wmf production - https://phabricator.wikimedia.org/T411164#11412133 (10Marostegui) a:03Marostegui [09:20:40] 06Data-Engineering, 06Data-Persistence, 06DBA, 10MediaWiki-Core-Revision-backend, and 5 others: Rethink rev_sha1 field - https://phabricator.wikimedia.org/T389026#11412134 (10Zabe) 05Open→03Resolved [10:09:12] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th): Implement a new pipeline and table with reconciled historical revision data - https://phabricator.wikimedia.org/T410688#11412244 (10JAllemandou) I have verified this morning: We had [[ https://airflow.wikimedia.org/dags/mw_revision_merge_events_to_mw_r... [10:35:32] 06Data-Engineering, 06DBA, 13Patch-For-Review, 07Schema-change-in-production: Drop rev_sha1 from revision table in wmf production - https://phabricator.wikimedia.org/T411164#11412339 (10Marostegui) p:05Triage→03Medium [10:36:09] 06Data-Engineering, 06DBA, 13Patch-For-Review, 07Schema-change-in-production: Drop rev_sha1 from revision table in wmf production - https://phabricator.wikimedia.org/T411164#11412342 (10Marostegui) [10:36:31] 06Data-Engineering, 06DBA, 13Patch-For-Review, 07Schema-change-in-production: Drop ar_sha1 from archive table in wmf production - https://phabricator.wikimedia.org/T411163#11412344 (10Marostegui) p:05Triage→03Medium [10:39:36] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 06Data-Persistence: Provision Global Editor Metrics tables & endpoints - https://phabricator.wikimedia.org/T410962#11412353 (10mforns) Thank you @Eevans! [10:40:23] 06Data-Engineering, 06DBA, 13Patch-For-Review, 07Schema-change-in-production: Drop ar_sha1 from archive table in wmf production - https://phabricator.wikimedia.org/T411163#11412355 (10Marostegui) @JAllemandou @Ahoelzl for awareness [10:40:34] 06Data-Engineering, 06DBA, 13Patch-For-Review, 07Schema-change-in-production: Drop rev_sha1 from revision table in wmf production - https://phabricator.wikimedia.org/T411164#11412357 (10Marostegui) @JAllemandou @Ahoelzl for awareness [11:26:19] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Drop rc_type from recentchanges in wmf production - https://phabricator.wikimedia.org/T410531#11412456 (10Marostegui) [11:42:48] 06Data-Engineering, 10Dumps-Generation, 07IPv6: Some Core Platform clusters have inconsistent AAAA DNS records for the primary IPv6 of the hosts - https://phabricator.wikimedia.org/T312556#11412497 (10ayounsi) 05Open→03Resolved a:03ayounsi As far as I know this is all solved now. At least according... [13:06:06] 06Data-Engineering, 06DBA, 13Patch-For-Review, 07Schema-change-in-production: Drop rev_sha1 from revision table in wmf production - https://phabricator.wikimedia.org/T411164#11412775 (10Marostegui) [13:06:12] 06Data-Engineering, 06DBA, 13Patch-For-Review, 07Schema-change-in-production: Drop ar_sha1 from archive table in wmf production - https://phabricator.wikimedia.org/T411163#11412776 (10Marostegui) [18:29:23] (03PS1) 10Mforns: Add JA3N User-Agent queries [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1212214 (https://phabricator.wikimedia.org/T409584) [18:35:45] 06Data-Engineering (Q2 FY25/26 October 1st - December 31th), 10Data-Engineering-Roadmap, 07Epic, 07OKR-Work, 13Patch-For-Review: Productionize JA3N-UA table to improve bot detection - https://phabricator.wikimedia.org/T409584#11414007 (10mforns)