[06:28:16] (03PS2) 10Joal: Add 7 new projects to the sqoop list [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1073214 (https://phabricator.wikimedia.org/T368788) [06:29:06] 10Data-Engineering (Q1 2024 July 1st - September 30th), 06Data-Platform, 13Patch-For-Review: 8 new wikis missing from mediawiki_history - https://phabricator.wikimedia.org/T368788#10151545 (10JAllemandou) >>! In T368788#10150295, @CMyrick-WMF wrote: >>>! In T368788#10148863, @JAllemandou wrote: >> Patch sent... [07:20:13] PROBLEM - eventlogging Varnishkafka log producer on cp3072 is CRITICAL: PROCS CRITICAL: 2 processes with args /usr/bin/varnishkafka -S /etc/varnishkafka/eventlogging.conf https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka [07:21:13] RECOVERY - eventlogging Varnishkafka log producer on cp3072 is OK: PROCS OK: 1 process with args /usr/bin/varnishkafka -S /etc/varnishkafka/eventlogging.conf https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka [09:50:42] 06Data-Engineering, 06Data Products, 10MediaWiki-extensions-EventLogging, 10Temporary accounts: Prepare EventLogging for temp accounts - https://phabricator.wikimedia.org/T374812#10152216 (10kostajh) @phuedx Thanks for doing that! [10:58:21] (03CR) 10David Martin: Add mediawiki.product_metrics.wikilambda_api data stream to the sanitization allowlist (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1064438 (https://phabricator.wikimedia.org/T372987) (owner: 10David Martin) [11:47:37] 06Data-Engineering, 10Data-Services, 10GlobalBlocking, 06Stewards-and-global-tools, and 3 others: Hide the value of gbw_address in the public replicas if the associated globalblocks table row has gb_autoblock_parent_id as not null - https://phabricator.wikimedia.org/T374855#10152646 (10Dreamy_Jazz) 05... [12:14:32] 06Data-Engineering, 06Data-Platform, 06Product-Analytics, 10Temporary accounts: Ensure performer attributes in schemas clarify if the user is a temporary account - https://phabricator.wikimedia.org/T374940 (10kostajh) 03NEW [12:15:10] 06Data-Engineering, 06Data-Platform, 06Product-Analytics, 10Temporary accounts: Ensure performer attributes in schemas clarify if the user is a temporary account - https://phabricator.wikimedia.org/T374940#10152770 (10kostajh) [12:24:19] 06Data-Engineering, 10Data-Services, 10GlobalBlocking, 06Stewards-and-global-tools, and 3 others: Hide the value of gbw_address in the public replicas if the associated globalblocks table row has gb_autoblock_parent_id as not null - https://phabricator.wikimedia.org/T374855#10152817 (10Dreamy_Jazz) [12:24:21] 06Data-Engineering, 10Data-Services, 06Trust and Safety Product Team, 13Patch-For-Review, and 2 others: Hide the value of gb_address column in public replicas if gb_autoblock_parent_id is not null - https://phabricator.wikimedia.org/T371486#10152818 (10Dreamy_Jazz) [12:35:41] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Drop deprecated abuse filter fields on wmf wikis - https://phabricator.wikimedia.org/T367781#10152906 (10ABran-WMF) [12:51:11] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Drop deprecated abuse filter fields on wmf wikis - https://phabricator.wikimedia.org/T367781#10152984 (10ABran-WMF) [13:08:12] (03PS48) 10Aqu: Refactor Refine to be triggered by Airflow [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1016808 (https://phabricator.wikimedia.org/T356762) [13:09:02] (03CR) 10Aqu: "I've just rebase it on master branch." [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1016808 (https://phabricator.wikimedia.org/T356762) (owner: 10Aqu) [13:22:17] !log rename kafka-stretch to an-worker1176 T353788 [13:22:21] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [13:22:22] T353788: Add kafka-stretch100[1-2] to the hadoop cluster - https://phabricator.wikimedia.org/T353788 [13:34:39] !log rename kafka-stretch1002 to an-worker1177 T353788 [13:34:46] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [13:34:46] T353788: Add kafka-stretch100[1-2] to the hadoop cluster - https://phabricator.wikimedia.org/T353788 [13:35:19] 06Data-Engineering, 10Data-Services, 06SRE, 06Trust and Safety Product Team, and 3 others: Hide the value of gb_address column in public replicas if gb_autoblock_parent_id is not null - https://phabricator.wikimedia.org/T371486#10153174 (10Dreamy_Jazz) [14:31:14] (03CR) 10Aqu: [C:03+2] Refactor Refine to be triggered by Airflow [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1016808 (https://phabricator.wikimedia.org/T356762) (owner: 10Aqu) [14:41:15] (03Merged) 10jenkins-bot: Refactor Refine to be triggered by Airflow [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1016808 (https://phabricator.wikimedia.org/T356762) (owner: 10Aqu) [15:46:59] 06Data-Engineering, 06Data-Persistence, 06MediaWiki-Engineering, 10Temporary accounts, and 2 others: Define MediaWiki user types - https://phabricator.wikimedia.org/T336176#10153881 (10pmiazga) [15:58:41] !log upgrading the presto cluster to version 0.288.1 for T371720 [15:58:45] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [15:58:46] T371720: Bump Presto to latest pickup Iceberg fixes and VIEWs support - https://phabricator.wikimedia.org/T371720 [17:01:31] 06Data-Engineering, 10Cloud-VPS, 10Data-Services, 06SRE, and 4 others: Hide the value of gb_address column in public replicas if gb_autoblock_parent_id is not null - https://phabricator.wikimedia.org/T371486#10154270 (10fnegri) [17:02:15] 06Data-Engineering, 10Data-Services, 06SRE, 06Trust and Safety Product Team, and 3 others: Hide the value of gb_address column in public replicas if gb_autoblock_parent_id is not null - https://phabricator.wikimedia.org/T371486#10154274 (10fnegri) [17:17:41] Starting build #17 for job analytics-refinery-maven-release [17:37:00] Project analytics-refinery-maven-release build #17: 09SUCCESS in 19 min: https://integration.wikimedia.org/ci/job/analytics-refinery-maven-release/17/ [18:01:55] Starting build #15 for job analytics-refinery-update-jars [18:04:07] (03PS1) 10Maven-release-user: Add refinery-source jars for v0.2.50 to artifacts [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1073499 [18:04:07] Project analytics-refinery-update-jars build #15: 09SUCCESS in 2 min 12 sec: https://integration.wikimedia.org/ci/job/analytics-refinery-update-jars/15/ [19:39:31] 10Data-Engineering (Q1 2024 July 1st - September 30th), 06Data-Platform-SRE: Obtain SRE resources needed to test the HDFS synchronizer service - https://phabricator.wikimedia.org/T371994#10154893 (10amastilovic) [19:59:54] 10Data-Engineering (Q1 2024 July 1st - September 30th), 10Event-Platform: [NEEDS GROOMING] We should improve the code health of gobblin-wmf - https://phabricator.wikimedia.org/T370368#10154971 (10Gehel) [20:54:00] (03PS1) 10Gerrit maintenance bot: Add rsk.wikipedia to pageview allowlist [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1073555 (https://phabricator.wikimedia.org/T375017) [20:56:22] (03PS1) 10Gerrit maintenance bot: Add mad.wiktionary to pageview allowlist [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1073557 (https://phabricator.wikimedia.org/T375024)