[00:14:59] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10Event-Platform, 13Patch-For-Review: HTML Enrichment - Tuning & Backfilling configuration - https://phabricator.wikimedia.org/T421216#11788909 (10Ottomata) > the job restarted. It is now slowly catching back up. Well it isn't catching back up now. But... [00:23:19] (03CR) 10Ottomata: "IIUC:" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1267966 (https://phabricator.wikimedia.org/T413362) (owner: 10Zabe) [08:17:00] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 06Traffic: Surge in webrequest validation check - https://phabricator.wikimedia.org/T422030#11789124 (10Vgutierrez) >>! In T422030#11778885, @Fabfur wrote: > This is most probably due to a deprecation in haproxy configuration directives https://www.haproxy... [08:53:00] 06Data-Engineering (Q3 FY25/26 January 1st - March 31th), 06collaboration-services, 10Dumps-Generation, 10Phabricator, and 4 others: Should we remove the Phabricator dump? - https://phabricator.wikimedia.org/T417824#11789171 (10A_smart_kitten) Noting for the record that {T422327} was filed yesterday [09:05:39] PROBLEM - statsv Varnishkafka log producer on cp2045 is CRITICAL: PROCS CRITICAL: 3 processes with args /usr/bin/varnishkafka -S /etc/varnishkafka/statsv.conf https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka [09:06:39] RECOVERY - statsv Varnishkafka log producer on cp2045 is OK: PROCS OK: 1 process with args /usr/bin/varnishkafka -S /etc/varnishkafka/statsv.conf https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka [14:32:17] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 13Patch-For-Review: Monthly reconcile continues to emit a really large amount of events after user_id changes - https://phabricator.wikimedia.org/T419055#11789873 (10xcollazo) Ok confirming this particular issue seems to be solved now. Note how overall inc... [14:52:51] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10Dumps-Generation: when analyzing a Wikifunctions dump, parent_id in page creation revisions is sometimes 0 and sometimes None - https://phabricator.wikimedia.org/T420974#11789929 (10xcollazo) I concur that this looks like a bug. In the source of truth d... [15:02:19] 06Data-Engineering (Q3 FY25/26 January 1st - March 31th), 06collaboration-services, 10Dumps-Generation, 10Phabricator, and 4 others: Should we remove the Phabricator dump? - https://phabricator.wikimedia.org/T417824#11789956 (10Dzahn) This ticket was supposed to become public so that we have something... [15:22:11] 06Data-Engineering (Q3 FY25/26 January 1st - March 31th), 06collaboration-services, 10Dumps-Generation, 10Phabricator, and 5 others: Should we remove the Phabricator dump? - https://phabricator.wikimedia.org/T417824#11790093 (10Dzahn) [16:35:17] !log Test Kitchen edge-unique experiments (poll 76972) - adds: logged-out-retention-round7; removes: none; fields: none - xLab/MPIC/TK tips at https://w.wiki/FwuD [16:35:19] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [16:35:38] !log Test Kitchen edge-unique experiments (poll 76973) - adds: logged-out-retention-round8; removes: none; fields: none - xLab/MPIC/TK tips at https://w.wiki/FwuD [16:35:39] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [16:46:45] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st): Backfill newly productionized edit types dataset - https://phabricator.wikimedia.org/T421919#11790424 (10AKhatun_WMF) [16:46:47] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 07OKR-Work (WE1 FY2025-26): WE1.5.3 Productize Data for Monthly Active Moderator Actions - https://phabricator.wikimedia.org/T410940#11790425 (10AKhatun_WMF) [16:49:44] 06Data-Engineering, 10Event-Platform: Profile SimpleEditType to identify inefficiencies in mwedittype - https://phabricator.wikimedia.org/T421412#11790432 (10AKhatun_WMF) [16:56:44] 06Data-Engineering, 10Event-Platform: Profile SimpleEditType to identify inefficiencies in mwedittype - https://phabricator.wikimedia.org/T421412#11790469 (10AKhatun_WMF) To assess the need to profile mwedittypes library, we need some details on who is using or wants to use StructuredEditTypes. @Isaac, @fkaeli... [17:53:26] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st): Improve the quality of Sqoop error logging - https://phabricator.wikimedia.org/T422412 (10amastilovic) 03NEW [18:31:31] 06Data-Engineering, 10Event-Platform: Profile SimpleEditType to identify inefficiencies in mwedittype - https://phabricator.wikimedia.org/T421412#11790862 (10Isaac) At this point, I think the key things re: Structured to keep in mind: * At this point, we don't have a Product OKR requirement that depends on Str... [18:32:02] !log Test Kitchen edge-unique experiments (poll 77318) - adds: none; removes: logged-out-retention-round7; fields: none - xLab/MPIC/TK tips at https://w.wiki/FwuD [18:32:03] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [18:32:22] !log Test Kitchen edge-unique experiments (poll 77319) - adds: none; removes: logged-out-retention-round8; fields: none - xLab/MPIC/TK tips at https://w.wiki/FwuD [18:32:23] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [18:47:35] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 10DPE-Mediawiki-Content: MediaWiki Content History alerts too much for minor reconcile issues - https://phabricator.wikimedia.org/T395139#11790903 (10xcollazo) 05Open→03Invalid Boldly closing this as out of date. Other tickets like T419055 have bet... [18:51:52] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 13Patch-For-Review: Sunset in-pipeline metrics computation for the MW Content Pipeline - https://phabricator.wikimedia.org/T401010#11790914 (10xcollazo) 05Open→03In progress a:03xcollazo [19:08:48] 06Data-Engineering (Q3 FY25/26 January 1st - March 31th), 06collaboration-services, 10Dumps-Generation, 10Phabricator, and 4 others: Should we remove the Phabricator dump? - https://phabricator.wikimedia.org/T417824#11790952 (10sbassett) >>! In T417824#11789956, @Dzahn wrote: > This ticket was supposed... [19:27:29] (03PS1) 10Aleksandar Mastilovic: Implement more verbose error logging of Sqoop [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1268268 (https://phabricator.wikimedia.org/T422412) [20:22:37] 06Data-Engineering (Q4 FS25/26 April 1st - June 30st), 13Patch-For-Review: Sunset in-pipeline metrics computation for the MW Content Pipeline - https://phabricator.wikimedia.org/T401010#11791131 (10xcollazo) [23:00:33] 06Data-Engineering (Q3 FY25/26 January 1st - March 31th), 06collaboration-services, 10Dumps-Generation, 10Phabricator, and 4 others: Should we remove the Phabricator dump? - https://phabricator.wikimedia.org/T417824#11791663 (10Dzahn) Thank you, yes, my bad. [23:48:26] (03PS2) 10Zabe: querypage: MostCategories: Include all content namespaces [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1267966 (https://phabricator.wikimedia.org/T413362) [23:49:02] (03CR) 10Zabe: "Thanks! I tried to correctly join the table. Please review carefully. :)" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1267966 (https://phabricator.wikimedia.org/T413362) (owner: 10Zabe)