[01:48:00] <wikibugs>	 (03CR) 10Ottomata: [C:03+1] Add useragent to eventlogging legacy fragement eventcapsule [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1075636 (https://phabricator.wikimedia.org/T356762) (owner: 10Aqu)
[01:48:29] <wikibugs>	 (03CR) 10Ottomata: "Looks great!  You'll have to materialize each of the new versions too :)" [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1075637 (https://phabricator.wikimedia.org/T356762) (owner: 10Aqu)
[01:48:55] <wikibugs>	 (03CR) 10Ottomata: "Oh sorry, you say that in the comment.  Sure!" [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1075637 (https://phabricator.wikimedia.org/T356762) (owner: 10Aqu)
[01:49:35] <wikibugs>	 (03CR) 10Ottomata: [C:03+1] "Pre +1ing after you merge the previous patch and then materialize the versions here." [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1075637 (https://phabricator.wikimedia.org/T356762) (owner: 10Aqu)
[08:58:35] <wikibugs>	 10Data-Engineering (Q1 2024 July 1st - September 30th): Handle Late-Arrived Events from Gobblin into Airflow triggered Refine - https://phabricator.wikimedia.org/T370665#10178563 (10JAllemandou) Exploration on specific datasets:  * `mediawiki_page_content_change_v1`--> No timestamp-late-events, only gobblin/kafk...
[10:22:13] <wikibugs>	 (03CR) 10Aqu: [C:03+2] Add useragent to eventlogging legacy fragement eventcapsule [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1075636 (https://phabricator.wikimedia.org/T356762) (owner: 10Aqu)
[10:25:45] <wikibugs>	 (03PS3) 10Aqu: Add useragent to eventlogging legacy fragement eventcapsule [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1075636 (https://phabricator.wikimedia.org/T356762)
[10:27:22] <wikibugs>	 (03CR) 10Aqu: [V:03+2] Add useragent to eventlogging legacy fragement eventcapsule [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1075636 (https://phabricator.wikimedia.org/T356762) (owner: 10Aqu)
[10:41:02] <wikibugs>	 (03PS2) 10Aqu: Add useragent to analytics/legacy events [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1075637 (https://phabricator.wikimedia.org/T356762)
[10:42:27] <wikibugs>	 (03CR) 10Aqu: [V:03+2 C:03+2] "New versions materialized. Merging." [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1075637 (https://phabricator.wikimedia.org/T356762) (owner: 10Aqu)
[10:47:22] <wikibugs>	 (03PS7) 10DCausse: Add /mediawiki/wikibase/entity/rdf_change/2.0.0 [schemas/event/primary] - 10https://gerrit.wikimedia.org/r/594098 (https://phabricator.wikimedia.org/T374918)
[11:13:09] <wikibugs>	 (03PS8) 10DCausse: Add /mediawiki/wikibase/entity/rdf_change/2.0.0 [schemas/event/primary] - 10https://gerrit.wikimedia.org/r/594098 (https://phabricator.wikimedia.org/T374918)
[12:14:46] <wikibugs>	 06Data-Engineering, 10[DEPRECATED] wdwb-tech, 10Citoid, 06Content-Transform-Team, and 9 others: Migrate node-based services in production to node18 - https://phabricator.wikimedia.org/T349118#10179095 (10Mvolz)
[12:44:34] <wikibugs>	 06Data-Engineering, 06Data Products, 06Movement-Insights: Keep canonical_data.wikis updated - https://phabricator.wikimedia.org/T241741#10179265 (10Milimetric)
[13:11:29] <wikibugs>	 06Data-Engineering, 06Data Products, 10MediaWiki-extensions-EventLogging, 10Metrics Platform, 07Technical-Debt: Migrate EventLogging to use DefaultEventSubmitter - https://phabricator.wikimedia.org/T375749 (10phuedx) 03NEW
[13:12:22] <wikibugs>	 (03Abandoned) 10Máté Szabó: ipinfo_interaction: Add event_ip_data_source [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1075329 (https://phabricator.wikimedia.org/T356105) (owner: 10Máté Szabó)
[13:40:15] <wikibugs>	 06Data-Engineering, 10Data-Services, 06SRE, 06Trust and Safety Product Team, and 3 others: Hide the value of gb_address column in public replicas if gb_autoblock_parent_id is not null - https://phabricator.wikimedia.org/T371486#10179581 (10ops-monitoring-bot) Cookbook cookbooks.sre.wikireplicas.update-view...
[13:45:22] <wikibugs>	 06Data-Engineering, 10Data-Services, 06SRE, 06Trust and Safety Product Team, and 3 others: Hide the value of gb_address column in public replicas if gb_autoblock_parent_id is not null - https://phabricator.wikimedia.org/T371486#10179597 (10ops-monitoring-bot) Cookbook cookbooks.sre.wikireplicas.update-view...
[13:50:13] <wikibugs>	 06Data-Engineering, 10Data-Services, 06SRE, 06Trust and Safety Product Team, and 3 others: Hide the value of gb_address column in public replicas if gb_autoblock_parent_id is not null - https://phabricator.wikimedia.org/T371486#10179621 (10ops-monitoring-bot) Cookbook cookbooks.sre.wikireplicas.update-view...
[14:04:12] <wikibugs>	 06Data-Engineering, 10Data-Services, 06SRE, 06Trust and Safety Product Team, and 3 others: Hide the value of gb_address column in public replicas if gb_autoblock_parent_id is not null - https://phabricator.wikimedia.org/T371486#10179700 (10ops-monitoring-bot) Cookbook cookbooks.sre.wikireplicas.update-view...
[14:12:02] <wikibugs>	 06Data-Engineering, 10Data-Services, 06SRE, 06Trust and Safety Product Team, and 3 others: Hide the value of gb_address column in public replicas if gb_autoblock_parent_id is not null - https://phabricator.wikimedia.org/T371486#10179747 (10ops-monitoring-bot) Cookbook cookbooks.sre.wikireplicas.update-view...
[14:13:58] <wikibugs>	 14Analytics: Measure Community Backlog. - https://phabricator.wikimedia.org/T155497#10179751 (10Milimetric) Looking at some of the links now, the various community backlogs appear to have been fixed and updated.  It would be fascinating to see how they were fixed and see how we can support that work instead...
[14:14:17] <wikibugs>	 06Data-Engineering, 10Data-Services, 06SRE, 06Trust and Safety Product Team, and 3 others: Hide the value of gb_address column in public replicas if gb_autoblock_parent_id is not null - https://phabricator.wikimedia.org/T371486#10179759 (10ops-monitoring-bot) Cookbook cookbooks.sre.wikireplicas.update-view...
[14:15:46] <wikibugs>	 06Data-Engineering, 10Data-Services, 06SRE, 06Trust and Safety Product Team, and 3 others: Hide the value of gb_address column in public replicas if gb_autoblock_parent_id is not null - https://phabricator.wikimedia.org/T371486#10179767 (10fnegri) The cookbook is failing for a bunch of different reasons th...
[14:17:01] <wikibugs>	 06Data-Engineering, 10Data-Services, 06SRE, 06Trust and Safety Product Team, and 3 others: Hide the value of gb_address column in public replicas if gb_autoblock_parent_id is not null - https://phabricator.wikimedia.org/T371486#10179781 (10Dreamy_Jazz) >>! In T371486#10179767, @fnegri wrote: > The cookbook...
[14:33:02] <wikibugs>	 06Data-Engineering, 10Data-Services, 06SRE, 06Trust and Safety Product Team, and 2 others: Hide the value of gb_address column in public replicas if gb_autoblock_parent_id is not null - https://phabricator.wikimedia.org/T371486#10179872 (10ops-monitoring-bot) Cookbook cookbooks.sre.wikireplicas.update-view...
[14:41:54] <wikibugs>	 06Data-Engineering, 10Data-Services, 06SRE, 06Trust and Safety Product Team, and 2 others: Hide the value of gb_address column in public replicas if gb_autoblock_parent_id is not null - https://phabricator.wikimedia.org/T371486#10179905 (10ops-monitoring-bot) Cookbook cookbooks.sre.wikireplicas.update-view...
[15:23:02] <wikibugs>	 06Data-Engineering, 10Data-Services, 06SRE, 06Trust and Safety Product Team, and 2 others: Hide the value of gb_address column in public replicas if gb_autoblock_parent_id is not null - https://phabricator.wikimedia.org/T371486#10180139 (10ops-monitoring-bot) Cookbook cookbooks.sre.wikireplicas.update-view...
[15:32:13] <wikibugs>	 06Data-Engineering, 10Data-Services, 06SRE, 06Trust and Safety Product Team, and 2 others: Hide the value of gb_address column in public replicas if gb_autoblock_parent_id is not null - https://phabricator.wikimedia.org/T371486#10180195 (10ops-monitoring-bot) Cookbook cookbooks.sre.wikireplicas.update-view...
[15:38:35] <wikibugs>	 06Data-Engineering, 10Data-Services, 06SRE, 06Trust and Safety Product Team, and 2 others: Hide the value of gb_address column in public replicas if gb_autoblock_parent_id is not null - https://phabricator.wikimedia.org/T371486#10180226 (10ops-monitoring-bot) Cookbook cookbooks.sre.wikireplicas.update-view...
[15:40:05] <wikibugs>	 06Data-Engineering, 10Data-Services, 06SRE, 06Trust and Safety Product Team, and 2 others: Hide the value of gb_address column in public replicas if gb_autoblock_parent_id is not null - https://phabricator.wikimedia.org/T371486#10180243 (10ops-monitoring-bot) Cookbook cookbooks.sre.wikireplicas.update-view...
[16:32:00] <wikibugs>	 06Data-Engineering, 10Dumps 2.0, 10Event-Platform: [SPIKE] how can we support Spark producer/consumers in Event Platform - https://phabricator.wikimedia.org/T374341#10180500 (10xcollazo) Some notes: * At least on dumps, we are not using Spark Structured Stream. Its just and old `DataFrame`.   >>! In T374341#...
[16:32:56] <wikibugs>	 06Data-Engineering, 10Data-Services, 06SRE, 06Trust and Safety Product Team, and 2 others: Hide the value of gb_address column in public replicas if gb_autoblock_parent_id is not null - https://phabricator.wikimedia.org/T371486#10180512 (10ops-monitoring-bot) Cookbook cookbooks.sre.wikireplicas.update-view...
[16:34:17] <wikibugs>	 06Data-Engineering, 10Data-Services, 06SRE, 06Trust and Safety Product Team, and 2 others: Hide the value of gb_address column in public replicas if gb_autoblock_parent_id is not null - https://phabricator.wikimedia.org/T371486#10180514 (10ops-monitoring-bot) Cookbook cookbooks.sre.wikireplicas.update-view...
[16:50:55] <wikibugs>	 06Data-Engineering, 10Data-Services, 06SRE, 06Trust and Safety Product Team, and 3 others: Hide the value of gb_address column in public replicas if gb_autoblock_parent_id is not null - https://phabricator.wikimedia.org/T371486#10180544 (10fnegri) 05Open→03Resolved p:05Triage→03High a:05Dreamy...
[16:57:56] <wikibugs>	 06Data-Engineering, 06Data Products, 06DBA, 07Schema-change: Please drop globalblocks table from labswiki - https://phabricator.wikimedia.org/T375783 (10taavi) 03NEW
[16:59:34] <wikibugs>	 06Data-Engineering, 06Data Products, 06DBA, 10wikitech.wikimedia.org, 07Schema-change: Please drop globalblocks table from labswiki - https://phabricator.wikimedia.org/T375783#10180620 (10taavi)
[17:02:51] <wikibugs>	 10Data-Engineering (Q1 2024 July 1st - September 30th), 10Dumps 2.0 (Kanban Board): Implement Airflow Dataset class for RestExternalTaskSensor - https://phabricator.wikimedia.org/T372647#10180635 (10xcollazo) Seems like the proposed mechanism is closely related to an existing Airflow feature: https://airflow.a...
[17:08:43] <wikibugs>	 06Data-Engineering, 06Data Products, 06DBA, 10wikitech.wikimedia.org, 07Schema-change: Please drop globalblocks table from labswiki - https://phabricator.wikimedia.org/T375783#10180677 (10fnegri)
[17:12:13] <wikibugs>	 06Data-Engineering, 10Data-Services, 06SRE, 06Trust and Safety Product Team, and 3 others: Hide the value of gb_address column in public replicas if gb_autoblock_parent_id is not null - https://phabricator.wikimedia.org/T371486#10180670 (10fnegri) > However, I checked and the globalblocks table in the...
[17:24:57] <wikibugs>	 10Data-Engineering (Q1 2024 July 1st - September 30th), 10Dumps 2.0 (Kanban Board): Implement Airflow Dataset class for RestExternalTaskSensor - https://phabricator.wikimedia.org/T372647#10180737 (10Ottomata) IIRC @mforns considered Airflow datasets when originally implementing our Datasets library, and decide...
[17:38:54] <wikibugs>	 10Data-Engineering (Q1 2024 July 1st - September 30th): Handle Late-Arrived Events from Gobblin into Airflow triggered Refine - https://phabricator.wikimedia.org/T370665#10180792 (10Ottomata) > resource_purge Good catch.  We should ask SRE team, I think ServiceOps.   > meta.dt is set to the revision timestamp Al...
[17:48:06] <wikibugs>	 06Data-Engineering, 10Dumps 2.0, 10Event-Platform: [SPIKE] how can we support Spark producer/consumers in Event Platform - https://phabricator.wikimedia.org/T374341#10180821 (10Ottomata) +1! let's bikeshed params if we decide to do this!  We did precisely this kind of thing for the flink integration:  - http...
[17:57:19] <wikibugs>	 06Data-Engineering, 10Event-Platform, 10Web Team Essential Work 2024 (Migrate to new Event Platform), 10Web-Team-Backlog (FY2024-25 Q2 Sprint 1): Deprecate use of desktop- and mobilewebuiactions in Event Platform - https://phabricator.wikimedia.org/T368678#10180849 (10ovasileva) For deletion: 2 points For...
[17:57:41] <wikibugs>	 06Data-Engineering, 10Event-Platform, 10Web Team Essential Work 2024 (Migrate to new Event Platform), 10Web-Team-Backlog (FY2024-25 Q2 Sprint 1): Deprecate use of desktop- and mobilewebuiactions in Event Platform - https://phabricator.wikimedia.org/T368678#10180848 (10KSarabia-WMF) @jwang and I discussed t...
[18:00:48] <wikibugs>	 06Data-Engineering, 06Data Products, 10Dumps 2.0, 06Movement-Insights: Keep canonical_data.wikis updated - https://phabricator.wikimedia.org/T241741#10180874 (10xcollazo)
[20:25:58] <wikibugs>	 10Data-Engineering (Q1 2024 July 1st - September 30th), 10Dumps 2.0 (Kanban Board): Implement Airflow Dataset class for RestExternalTaskSensor - https://phabricator.wikimedia.org/T372647#10181162 (10mforns) @Ottomata I think we decided against it, precisely because we were aiming to use the Hive metastore and...
[20:29:20] <wikibugs>	 10Data-Engineering (Q1 2024 July 1st - September 30th), 10Dumps 2.0 (Kanban Board): Implement Airflow Dataset class for RestExternalTaskSensor - https://phabricator.wikimedia.org/T372647#10181170 (10Ottomata) Riiighhhht! Hm.
[20:30:40] <wikibugs>	 10Data-Engineering (Q1 2024 July 1st - September 30th), 10Dumps 2.0 (Kanban Board): Implement Airflow Dataset class for RestExternalTaskSensor - https://phabricator.wikimedia.org/T372647#10181172 (10Ottomata) It might be worth waiting until investing in Airflow management of this though.  https://cwiki.apache....
[22:18:03] <wikibugs>	 10Data-Engineering (Q1 2024 July 1st - September 30th), 10Dumps 2.0 (Kanban Board): Implement Airflow Dataset class for RestExternalTaskSensor - https://phabricator.wikimedia.org/T372647#10181664 (10amastilovic) Things are not settled for sure. The version of Airflow we use already supports the notion of `Data...