[07:05:04] 06Data-Engineering, 06Data Products, 06DBA, 07Schema-change-in-production: Drop gb_by from globalblocks table - https://phabricator.wikimedia.org/T370394#9997590 (10ABran-WMF) p:05Triage→03Low a:03ABran-WMF [09:15:00] 06Data-Engineering, 10[DEPRECATED] wdwb-tech, 10Citoid, 06Content-Transform-Team, and 9 others: Migrate node-based services in production to node18 - https://phabricator.wikimedia.org/T349118#9997733 (10Tchanders) [09:16:56] 06Data-Engineering, 10[DEPRECATED] wdwb-tech, 10Citoid, 06Content-Transform-Team, and 9 others: Migrate node-based services in production to node18 - https://phabricator.wikimedia.org/T349118#9997744 (10JayCano) [09:20:30] 06Data-Engineering, 10[DEPRECATED] wdwb-tech, 10Citoid, 06Content-Transform-Team, and 9 others: Migrate node-based services in production to node18 - https://phabricator.wikimedia.org/T349118#9997736 (10Tchanders) [09:46:51] 06Data-Engineering, 06Data-Platform-SRE: an-launcher1002 /srv filling up mostly because of logs from dynamic mapped Airflow tasks - https://phabricator.wikimedia.org/T370437#9997902 (10Gehel) p:05Triage→03High [10:52:20] 06Data-Engineering, 10CirrusSearch, 03Discovery-Search (Current work), 10MW-1.43-notes (1.43.0-wmf.15; 2024-07-23), 13Patch-For-Review: [Search Update Pipeline] Source streams for private wikis - https://phabricator.wikimedia.org/T346046#9998083 (10gmodena) >>! In T346046#9992635, @Ottomata wrote: > Coup... [12:52:52] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Drop deprecated abuse filter fields on wmf wikis - https://phabricator.wikimedia.org/T367781#9998351 (10ABran-WMF) [13:02:08] (03CR) 10Bearloga: Implement new way to aggregate browser statistics (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1049281 (https://phabricator.wikimedia.org/T342267) (owner: 10Milimetric) [13:22:36] 06Data-Engineering, 10CirrusSearch, 03Discovery-Search (Current work), 10MW-1.43-notes (1.43.0-wmf.15; 2024-07-23), 13Patch-For-Review: [Search Update Pipeline] Source streams for private wikis - https://phabricator.wikimedia.org/T346046#9998441 (10Ottomata) > This refactoring is moving complexity from E... [13:31:58] 06Data-Engineering, 10Event-Platform: Simplify EventBus code by deprecating EventBusFactory - https://phabricator.wikimedia.org/T370524 (10Ottomata) 03NEW [13:32:19] 06Data-Engineering, 10Event-Platform: Simplify EventBus code by deprecating EventBusFactory - https://phabricator.wikimedia.org/T370524#9998474 (10Ottomata) Deprecating EventBusBus factory may be a lot of work. Parking this ticket for now. [13:34:13] 06Data-Engineering, 10Event-Platform: Simplify EventBus code by deprecating EventBusFactory - https://phabricator.wikimedia.org/T370524#9998475 (10Ottomata) [13:34:29] 06Data-Engineering, 10Event-Platform: Simplify EventBus code by deprecating EventBusFactory - https://phabricator.wikimedia.org/T370524#9998481 (10Ottomata) [13:35:27] 06Data-Engineering, 10CirrusSearch, 03Discovery-Search (Current work), 10MW-1.43-notes (1.43.0-wmf.15; 2024-07-23), 13Patch-For-Review: [Search Update Pipeline] Source streams for private wikis - https://phabricator.wikimedia.org/T346046#9998492 (10Ottomata) @EBernhardson thanks for picking up the practi... [13:36:13] 06Data-Engineering, 10CirrusSearch, 03Discovery-Search (Current work), 10MW-1.43-notes (1.43.0-wmf.15; 2024-07-23), 13Patch-For-Review: [Search Update Pipeline] Source streams for private wikis - https://phabricator.wikimedia.org/T346046#9998479 (10Ottomata) Done: {T370524} [13:41:16] 10Data-Engineering (Q1 2024 July 1st - September 30th), 06Data-Platform, 10Event-Platform, 10MW-1.43-notes (1.43.0-wmf.15; 2024-07-23), 07Wikimedia-production-error: PHP Warning: Invalid argument supplied for foreach() in EventBus.php - https://phabricator.wikimedia.org/T370428#9998509 (10Ottomata) [13:41:21] 10Data-Engineering (Q1 2024 July 1st - September 30th), 06Data-Platform, 10Event-Platform, 10MW-1.43-notes (1.43.0-wmf.15; 2024-07-23), 07Wikimedia-production-error: PHP Warning: Invalid argument supplied for foreach() in EventBus.php - https://phabricator.wikimedia.org/T370428#9998511 (10Ottomata) a:03... [13:47:22] 07Analytics-Data-Problem, 06Data-Platform, 06Movement-Insights: Unique devices per country spikes on wikifunctions - https://phabricator.wikimedia.org/T364872#9998514 (10mpopov) @Mayakp.wiki: Special:GlobalUsage comes from [[ https://www.mediawiki.org/wiki/Extension:GlobalUsage | Extension:GlobalUsage ]] (#g... [13:48:47] 07Analytics-Data-Problem, 06Data-Platform, 06Movement-Insights: Unique devices per country spikes on wikifunctions - https://phabricator.wikimedia.org/T364872#9998524 (10mpopov) It also means there's nobody to ask to fix the behavior. I believe this requires engineering help from DPE. [14:05:01] 06Data-Engineering, 07Epic: [Epic] Migrate Data Platform Engineering maintained git repos to GitLab - https://phabricator.wikimedia.org/T368927#9998561 (10Ottomata) [14:21:43] 07Analytics-Data-Problem, 06Data-Platform, 06Movement-Insights: Unique devices per country spikes on wikifunctions - https://phabricator.wikimedia.org/T364872#9998611 (10mpopov) `sql select normalized_host.project_class, ip, count(1) as view_count from pageview_actor where year = 2024 and month = 6 and day... [15:45:10] 07Analytics-Data-Problem, 06Abstract Wikipedia team, 06Data-Platform, 06Movement-Insights: Unique devices per country spikes on wikifunctions - https://phabricator.wikimedia.org/T364872#9998889 (10Jdforrester-WMF) >>! In T364872#9998611, @mpopov wrote: > There are…a lot of "pageviews" coming from just 2 IP... [15:47:16] 06Data-Engineering, 06Product-Analytics, 07Epic: [SPIKE] Experiment with approaches for a incremental updates of MediaWiki data in the Data Lake - https://phabricator.wikimedia.org/T370354#9998905 (10Ottomata) [15:48:47] (03PS4) 10Milimetric: Implement new way to aggregate browser statistics [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1049281 (https://phabricator.wikimedia.org/T342267) [15:48:56] (03CR) 10Milimetric: Implement new way to aggregate browser statistics (032 comments) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1049281 (https://phabricator.wikimedia.org/T342267) (owner: 10Milimetric) [15:59:17] (03CR) 10Milimetric: "Note: I was going to do something like this:" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1049281 (https://phabricator.wikimedia.org/T342267) (owner: 10Milimetric) [16:00:46] 06Data-Engineering, 06Product-Analytics, 07Epic: [SPIKE] Experiment with approaches for a incremental updates of MediaWiki data in the Data Lake - https://phabricator.wikimedia.org/T370354#9998948 (10Ottomata) [16:28:19] (03PS5) 10Milimetric: Implement new way to aggregate browser statistics [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1049281 (https://phabricator.wikimedia.org/T342267) [16:29:13] 07Analytics-Data-Problem, 06Data-Engineering, 10Data-Engineering-Dashiki, 10Data Products (Data Products Sprint 16), and 2 others: Investigate surprising "10% Other" portion of Analytics Browsers report - https://phabricator.wikimedia.org/T342267#9998985 (10Milimetric) ok, moving to ready to deploy. I'm g... [16:51:09] (03PS1) 10Milimetric: Fix typo in allowlist [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1055473 [16:51:29] (03CR) 10Milimetric: [V:03+2 C:03+2] Fix typo in allowlist [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1055473 (owner: 10Milimetric) [17:14:12] 10Data-Engineering (Q1 2024 July 1st - September 30th), 10Event-Platform, 13Patch-For-Review: Migrate Data Engineering NodeJS library repos to GitLab - https://phabricator.wikimedia.org/T366611#9999121 (10Snwachukwu) [17:25:18] 10Data-Engineering (Q1 2024 July 1st - September 30th), 10Event-Platform, 13Patch-For-Review: Migrate Data Engineering NodeJS library repos to GitLab - https://phabricator.wikimedia.org/T366611#9999204 (10Snwachukwu) [18:51:15] (03CR) 10Ottomata: "This is looking good! Some more comments for you! We are getting there! <3" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1016808 (https://phabricator.wikimedia.org/T356762) (owner: 10Aqu) [19:02:15] 06Data-Engineering, 06Product-Analytics, 07Epic: [SPIKE] Experiment with approaches for a incremental updates of MediaWiki data in the Data Lake - https://phabricator.wikimedia.org/T370354#9999396 (10Ottomata) [21:19:04] FIRING: GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job event_default ingested an unexpected number of records for a Kafka topic partition. ... [21:19:08] - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=event_default&var-kafka_topic=eqiad.mediawiki.cirrussearch.page_rerender.v1&viewPanel=4 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected [22:19:03] RESOLVED: GobblinKafkaRecordsExtractedNotEqualRecordsExpected: Gobblin job event_default ingested an unexpected number of records for a Kafka topic partition. ... [22:19:04] - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Gobblin - https://grafana.wikimedia.org/d/pAQaJwEnk/gobblin?orgId=1&var-gobblin_job_name=event_default&var-kafka_topic=eqiad.mediawiki.cirrussearch.page_rerender.v1&viewPanel=4 - https://alerts.wikimedia.org/?q=alertname%3DGobblinKafkaRecordsExtractedNotEqualRecordsExpected