[04:43:09] 06Data-Engineering, 10Data Pipelines, 10Data-Catalog: Ingest a test hive database into datahub - https://phabricator.wikimedia.org/T372899#10080023 (10tchin) I created the database `sandbox` and `sandbox_iceberg` and also created an `interlanguage_navigation` table in `sandbox`: `lang=bash tchin@an-launcher... [07:06:38] 06Data-Engineering, 06Data Products, 06DBA, 07Schema-change-in-production: Cleanup revision table schema - https://phabricator.wikimedia.org/T367856#10080139 (10Marostegui) [09:35:03] 06Data-Engineering, 10[DEPRECATED] wdwb-tech, 10Citoid, 06Content-Transform-Team, and 9 others: Migrate node-based services in production to node18 - https://phabricator.wikimedia.org/T349118#10080434 (10Mvolz) [09:35:15] !log roll-restarting zookeeper analytics cluster for T371874 [09:35:17] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [09:39:59] 06Data-Engineering, 10[DEPRECATED] wdwb-tech, 10Citoid, 06Content-Transform-Team, and 9 others: Migrate node-based services in production to node18 - https://phabricator.wikimedia.org/T349118#10080424 (10Mvolz) FYI Citoid upgrade is blocked by dependency on service-runner: https://github.com/wikimedia/serv... [09:40:00] 06Data-Engineering, 10[DEPRECATED] wdwb-tech, 10Citoid, 06Content-Transform-Team, and 9 others: Migrate node-based services in production to node18 - https://phabricator.wikimedia.org/T349118#10080435 (10Mvolz) [09:58:08] 06Data-Engineering, 06Traffic, 13Patch-For-Review: Install benthos on single esams host to check performances under higher load - https://phabricator.wikimedia.org/T365968#10080661 (10Fabfur) 05Open→03Declined Superseded by T370668 [09:59:06] 06Data-Engineering, 10Observability-Logging, 06Traffic, 13Patch-For-Review: Install new Benthos instance on cp hosts - https://phabricator.wikimedia.org/T358109#10080656 (10Fabfur) 05In progress→03Declined Superseded by T370668 [10:00:57] 06Data-Engineering, 10Observability-Logging, 06Traffic, 13Patch-For-Review: Benthos loses messages when under high load - https://phabricator.wikimedia.org/T364379#10080666 (10Fabfur) 05Open→03Declined Superseded by T370668 [10:00:59] 06Data-Engineering, 10Observability-Logging, 06Traffic, 13Patch-For-Review: Better Benthos performances - https://phabricator.wikimedia.org/T360454#10080671 (10Fabfur) 05Open→03Declined Superseded by T370668 [10:01:13] 06Data-Engineering, 06Traffic: Upgrade Benthos package on cp hosts - https://phabricator.wikimedia.org/T366031#10080698 (10Fabfur) 05Open→03Declined Superseded by T370668 [10:01:17] 06Data-Engineering, 10Observability-Logging, 06Traffic: Check statsv and eventlogging VarnishKafka instances - https://phabricator.wikimedia.org/T359178#10080682 (10Fabfur) 05Open→03Declined Superseded by T370668 [10:02:07] 06Data-Engineering, 10Observability-Logging, 06Traffic: Umbrella task for Benthos parsing error - https://phabricator.wikimedia.org/T365441#10080693 (10Fabfur) 05Open→03Declined Superseded by T370668 [10:02:27] 06Data-Engineering, 06Data Products, 10Observability-Logging, 06Traffic, 13Patch-For-Review: HAProxy log format doesn't support "invalid" request path - https://phabricator.wikimedia.org/T365117#10080687 (10Fabfur) 05Open→03Declined Superseded by T370668 [11:07:55] !log roll-restarting druid-public cluster for T371874 [11:07:57] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [11:43:40] 06Data-Engineering, 10CirrusSearch, 06Data Products, 10MediaWiki-extensions-EventLogging, and 2 others: Error: Call to a member function getPageAsLinkTarget() on null - https://phabricator.wikimedia.org/T368543#10080935 (10Aklapper) Still an issue in `1.43.0-wmf.19` in the logs [11:58:29] 06Data-Engineering, 06Data Products, 06Data-Platform, 06DBA, 07Schema-change-in-production: Change page.page_links_updated to fixed-length timestamp in wmf wikis - https://phabricator.wikimedia.org/T371742#10080980 (10Ladsgroup) In case it's not clear. This change is just in data type and underlying data... [12:07:32] !log roll-restarting druid-analytics cluster for T371874 [12:07:34] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [12:17:30] !log reimaging cephosd1005 for T372783 [12:17:32] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [12:17:32] T372783: Verify that cephosd* server reimages work without adversely affecting cluster availability - https://phabricator.wikimedia.org/T372783 [12:32:53] 06Data-Engineering, 10CheckUser, 06Data Products, 06DBA, 07Schema-change-in-production: Remove cuc_actiontext, cuc_only_for_read_old, and cuc_private from cu_changes on WMF wikis - https://phabricator.wikimedia.org/T370903#10081083 (10Ladsgroup) I'm about to start this schema change everywhere. [12:38:02] 06Data-Engineering, 10CheckUser, 06Data Products, 06DBA, 07Schema-change-in-production: Remove cuc_actiontext, cuc_only_for_read_old, and cuc_private from cu_changes on WMF wikis - https://phabricator.wikimedia.org/T370903#10081098 (10Marostegui) >>! In T370903#10081083, @Ladsgroup wrote: > I'm about to... [12:38:44] 06Data-Engineering, 10CheckUser, 06Data Products, 06DBA, 07Schema-change-in-production: Remove cuc_actiontext, cuc_only_for_read_old, and cuc_private from cu_changes on WMF wikis - https://phabricator.wikimedia.org/T370903#10081110 (10Ladsgroup) yeah, It'll take a while before it gets to s8 [13:23:43] 06Data-Engineering, 06Data-Platform-SRE, 10Observability-Alerting: Explore the use of Airflow notifiers for more flexible DAG failure handling - https://phabricator.wikimedia.org/T343234#10081265 (10Ottomata) Cool! Just came across this task, but I think this would have been quite helpful during my recent o... [13:25:38] 06Data-Engineering, 06Data Products, 06Data-Platform, 06DBA, and 2 others: Change page.page_links_updated to fixed-length timestamp in wmf wikis - https://phabricator.wikimedia.org/T371742#10081268 (10Ottomata) Okay, I highly doubt those rare cases will have an effect on data lake based pipelines. If the... [13:25:56] 06Data-Engineering, 10[DEPRECATED] wdwb-tech, 10Citoid, 06Content-Transform-Team, and 9 others: Migrate node-based services in production to node18 - https://phabricator.wikimedia.org/T349118#10081253 (10Ottomata) FYI, [[ https://gitlab.wikimedia.org/tchin/service-utils/-/tree/main?ref_type=heads | service... [14:18:44] 06Data-Engineering, 10Data Pipelines, 10Data-Catalog, 13Patch-For-Review: Ingest a test hive database into datahub - https://phabricator.wikimedia.org/T372899#10081540 (10xcollazo) Just passing by to say this is looking *really* cool. [14:35:22] 06Data-Engineering, 10Data Pipelines, 10Data-Catalog, 13Patch-For-Review: Ingest a test hive database into datahub - https://phabricator.wikimedia.org/T372899#10081650 (10brouberol) seconded! [14:53:56] 06Data-Engineering, 06SRE, 10SRE-Access-Requests: Requesting access to for ifeatu_nnaobi_wmde - https://phabricator.wikimedia.org/T371796#10081764 (10jhathaway) [14:56:36] 06Data-Engineering, 06SRE, 10SRE-Access-Requests: Requesting access to for ifeatu_nnaobi_wmde - https://phabricator.wikimedia.org/T371796#10081767 (10jhathaway) [15:44:22] 10Data-Engineering (Q1 2024 July 1st - September 30th), 06Product-Analytics, 07Epic, 13Patch-For-Review: [SPIKE] Experiment with approaches for a incremental updates of MediaWiki data in the Data Lake - https://phabricator.wikimedia.org/T370354#10081986 (10Ahoelzl) [15:44:25] 10Data-Engineering (Q1 2024 July 1st - September 30th), 06Product-Analytics, 07Epic, 13Patch-For-Review: [SPIKE] Experiment with approaches for a incremental updates of MediaWiki data in the Data Lake - https://phabricator.wikimedia.org/T370354#10081987 (10Ahoelzl) a:03Ottomata [15:55:33] (03CR) 10Ottomata: "Patchset 39 summary:" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1016808 (https://phabricator.wikimedia.org/T356762) (owner: 10Aqu) [16:00:06] (03CR) 10CI reject: [V:04-1] Refactor Refine to be triggered by Airflow [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1016808 (https://phabricator.wikimedia.org/T356762) (owner: 10Aqu) [16:37:14] 06Data-Engineering, 06SRE, 10SRE-Access-Requests, 13Patch-For-Review: Requesting access to for ifeatu_nnaobi_wmde - https://phabricator.wikimedia.org/T371796#10082154 (10jhathaway) 05Open→03Resolved merged [16:48:07] 06Data-Engineering, 10CheckUser, 06Data Products, 06DBA, and 2 others: Remove cuc_actiontext, cuc_only_for_read_old, and cuc_private from cu_changes on WMF wikis - https://phabricator.wikimedia.org/T370903#10082256 (10Ladsgroup) [16:52:30] 06Data-Engineering, 06Data Products, 06Data-Platform, 06DBA, and 2 others: Change page.page_links_updated to fixed-length timestamp in wmf wikis - https://phabricator.wikimedia.org/T371742#10082294 (10Ladsgroup) [16:58:13] (03PS40) 10Ottomata: Refactor Refine to be triggered by Airflow [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1016808 (https://phabricator.wikimedia.org/T356762) (owner: 10Aqu) [17:02:12] (03CR) 10Ottomata: "Patch 40:" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1016808 (https://phabricator.wikimedia.org/T356762) (owner: 10Aqu) [17:06:15] (03CR) 10CI reject: [V:04-1] Refactor Refine to be triggered by Airflow [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1016808 (https://phabricator.wikimedia.org/T356762) (owner: 10Aqu) [17:08:43] (03PS2) 10Aleksandar Mastilovic: Put the whole backfill command to be run in alert email body [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1064071 [17:09:30] (03CR) 10Aleksandar Mastilovic: Put the whole backfill command to be run in alert email body (031 comment) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1064071 (owner: 10Aleksandar Mastilovic) [17:12:02] (03PS41) 10Ottomata: Refactor Refine to be triggered by Airflow [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1016808 (https://phabricator.wikimedia.org/T356762) (owner: 10Aqu) [17:18:38] (03CR) 10CI reject: [V:04-1] Refactor Refine to be triggered by Airflow [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1016808 (https://phabricator.wikimedia.org/T356762) (owner: 10Aqu) [17:48:44] (03PS1) 10David Martin: Change wikifunctions_ui to mediawiki_product_metrics_wikifunctions_ui on the sanitization allowlist [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1064435 (https://phabricator.wikimedia.org/T372986) [18:21:41] (03CR) 10Ottomata: Refactor Refine to be triggered by Airflow (031 comment) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1016808 (https://phabricator.wikimedia.org/T356762) (owner: 10Aqu) [18:23:21] (03PS1) 10David Martin: Add mediawiki.product_metrics.wikilambda_api data stream to the sanitization allowlist [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1064438 (https://phabricator.wikimedia.org/T372987) [18:33:07] (03CR) 10Ottomata: [C:03+2] Put the whole backfill command to be run in alert email body [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1064071 (owner: 10Aleksandar Mastilovic) [18:33:15] (03CR) 10Ottomata: [V:03+2 C:03+2] Put the whole backfill command to be run in alert email body [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1064071 (owner: 10Aleksandar Mastilovic) [21:42:10] (03PS42) 10Ottomata: Refactor Refine to be triggered by Airflow [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1016808 (https://phabricator.wikimedia.org/T356762) (owner: 10Aqu) [21:42:30] (03CR) 10Ottomata: Refactor Refine to be triggered by Airflow (031 comment) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1016808 (https://phabricator.wikimedia.org/T356762) (owner: 10Aqu) [21:46:27] (03CR) 10CI reject: [V:04-1] Refactor Refine to be triggered by Airflow [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1016808 (https://phabricator.wikimedia.org/T356762) (owner: 10Aqu) [21:47:46] (03CR) 10Ottomata: "Patchset 42:" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1016808 (https://phabricator.wikimedia.org/T356762) (owner: 10Aqu) [21:48:17] (03CR) 10Ottomata: "I resolve the TBD in patchset 42. See summary there." [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1016808 (https://phabricator.wikimedia.org/T356762) (owner: 10Aqu)