[07:36:44] 10Quarry, 10PAWS: PR usually not posting to phabricator - https://phabricator.wikimedia.org/T373134#10120246 (10Jelto) >>! In T373134#10101244, @rook wrote: > May be caused by T362401 Yes this is right, we are rate-limiting cloud providers heavily (which includes Azure) because of abuse and scraping we've had... [09:00:28] 06Data-Engineering, 10Cassandra, 10Data Pipelines, 10Data-Platform-SRE (2024.08.17 - 2024.09.06), 13Patch-For-Review: Create puppet defined type for adding/updating/deleting secrets or other small files on HDFS - https://phabricator.wikimedia.org/T323692#10120430 (10BTullis) >>! In T323692#10118595, @Ott... [09:01:08] (03CR) 10Phuedx: [C:03+2] Adding a new 'experiments' fragment to collect data about which experiments is a subject enrolled in [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1067306 (https://phabricator.wikimedia.org/T368326) (owner: 10Santiago Faci) [09:01:40] (03Merged) 10jenkins-bot: Adding a new 'experiments' fragment to collect data about which experiments is a subject enrolled in [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1067306 (https://phabricator.wikimedia.org/T368326) (owner: 10Santiago Faci) [09:23:22] (03CR) 10Phuedx: [C:03+2] Update Metrics Platform common fragment to include instrument name identifier. [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1066880 (https://phabricator.wikimedia.org/T366802) (owner: 10Clare Ming) [09:23:29] (03CR) 10CI reject: [V:04-1] Update Metrics Platform common fragment to include instrument name identifier. [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1066880 (https://phabricator.wikimedia.org/T366802) (owner: 10Clare Ming) [11:17:38] (03CR) 10Michael Große: [C:03+2] "+2 per Nettrom" [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1059254 (https://phabricator.wikimedia.org/T335716) (owner: 10Sergio Gimeno) [11:18:06] (03Merged) 10jenkins-bot: docs(image_suggestion_interaction): fix doc message [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1059254 (https://phabricator.wikimedia.org/T335716) (owner: 10Sergio Gimeno) [11:36:30] 06Data-Engineering, 06Data-Platform, 06DBA, 07Schema-change-in-production: Change page.page_links_updated to fixed-length timestamp in wmf wikis - https://phabricator.wikimedia.org/T371742#10120984 (10Ladsgroup) [11:36:38] 06Data-Engineering, 10CheckUser, 06Data Products, 06DBA, 07Schema-change-in-production: Remove cuc_actiontext, cuc_only_for_read_old, and cuc_private from cu_changes on WMF wikis - https://phabricator.wikimedia.org/T370903#10120985 (10Ladsgroup) [11:46:01] 06Data-Engineering, 06serviceops-radar, 10Event-Platform: Improve eventgates health check/readiness probe - https://phabricator.wikimedia.org/T373192#10121013 (10JMeybohm) 05Open→03Resolved a:03JMeybohm Updated and deployed all eventgates to use the simple readinessProbe while keeping the test endp... [13:37:47] 06Data-Engineering, 06Discovery-Search: Datahub - ingest Hive discovery database - https://phabricator.wikimedia.org/T374118 (10Ottomata) 03NEW [15:14:50] 06Data-Engineering, 10Cassandra, 10Data Pipelines, 10Data-Platform-SRE (2024.08.17 - 2024.09.06), 13Patch-For-Review: Create puppet defined type for adding/updating/deleting secrets or other small files on HDFS - https://phabricator.wikimedia.org/T323692#10121975 (10Ottomata) Got it, okay! Could we add s... [16:21:20] 10Data-Engineering (Q1 2024 July 1st - September 30th), 06Java-Scala-Standardization, 10Data-Platform-SRE (2024.08.17 - 2024.09.06), 13Patch-For-Review: Migrate wmf-jvm-parent-pom and supporting components to the Maven group on Gitlab - https://phabricator.wikimedia.org/T369901#10122230 (10amastilovic) [16:53:08] 10Data-Engineering (Q1 2024 July 1st - September 30th), 06Discovery-Search, 06Java-Scala-Standardization, 10Data-Platform-SRE (2024.08.17 - 2024.09.06), 13Patch-For-Review: Update parent pom to disable fetching dependencies from Archiva and use Gitlab in... - https://phabricator.wikimedia.org/T367404#10122345 [17:27:09] 07Analytics-Data-Problem, 06Design-System-Team, 06MW-Interfaces-Team, 07JavaScript, 10Web-Team-Backlog (Needs Prioritization (Tech)): Send Api-User-Agent header from MediaWiki client-side code - https://phabricator.wikimedia.org/T373874#10122529 (10Jdlrobson) [17:58:16] PROBLEM - eventlogging Varnishkafka log producer on cp3068 is CRITICAL: PROCS CRITICAL: 3 processes with args /usr/bin/varnishkafka -S /etc/varnishkafka/eventlogging.conf https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka [17:59:18] RECOVERY - eventlogging Varnishkafka log producer on cp3068 is OK: PROCS OK: 1 process with args /usr/bin/varnishkafka -S /etc/varnishkafka/eventlogging.conf https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka [18:44:21] (03PS1) 10Mforns: Add metrics platform schema for web translation workflows [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1071017 (https://phabricator.wikimedia.org/T369687) [19:10:03] 06Data-Engineering, 10Data Products (Data Products Sprint 19): Add wikitech (labswiki) to the sqoop list - https://phabricator.wikimedia.org/T217792#10122951 (10VirginiaPoundstone) [20:24:50] 07Analytics-Data-Problem, 06Design-System-Team, 06MW-Interfaces-Team, 07JavaScript, 10Web-Team-Backlog (Needs Prioritization (Tech)): Send Api-User-Agent header from MediaWiki client-side code - https://phabricator.wikimedia.org/T373874#10123148 (10Jdlrobson) @daniel - I assume you are referring to mw.Ap... [20:36:52] 07Analytics-Data-Problem, 06Design-System-Team, 06MW-Interfaces-Team, 07JavaScript, 10Web-Team-Backlog (Needs Prioritization (Tech)): Send Api-User-Agent header from MediaWiki client-side code - https://phabricator.wikimedia.org/T373874#10123167 (10daniel) >>! In T373874#10123148, @Jdlrobson wrote: > @da... [23:09:54] 06Data-Engineering, 06Data-Platform, 06serviceops, 06SRE: DegradedArray email alerts for aqs1013 and aqs1014 are firing since April 18 - https://phabricator.wikimedia.org/T373490#10123659 (10andrea.denisse) [23:39:25] 06Data-Engineering: [SPIKE] Learn and document how to use Flink-CDC from MediaWiki MariaDB locally - https://phabricator.wikimedia.org/T373144#10123840 (10NoZeroDay) @Ottomata Many thanks for the detailed feedback, Andrew - this is quite useful. I'll be shortly making some updates to the docker compose to better...