[09:13:10] 10Analytics, 10Metrics-Platform, 10Product-Analytics: Schema repository structure, naming - https://phabricator.wikimedia.org/T269936 (10Aklapper) a:05jlinehan→03None Removing inactive assignee from this open task. (Please update assignees on open tasks after offboarding. Thanks.) [09:13:14] 10Analytics, 10Metrics-Platform, 10Performance-Team, 10Product-Analytics, 10MW-1.35-notes (1.35.0-wmf.21; 2020-02-25): Switch mw.user.sessionId back to session-cookie persistence - https://phabricator.wikimedia.org/T223931 (10Aklapper) a:05jlinehan→03None Removing inactive assignee from this open tas... [09:13:29] 10Analytics, 10Data-Engineering, 10Event-Platform, 10Metrics-Platform: Client-side error logging should use Elastic Common Schema (ECS) fields when possible - https://phabricator.wikimedia.org/T267602 (10Aklapper) a:05jlinehan→03None Removing inactive assignee from this open task. (Please update assign... [09:13:33] 10Analytics, 10Data-Engineering, 10Event-Platform, 10Product-Infrastructure-Team-Backlog, 10Epic: Event Platform Client Libraries - https://phabricator.wikimedia.org/T228175 (10Aklapper) a:05jlinehan→03None Removing inactive assignee from this open task. (Please update assignees on open tasks after o... [09:13:41] 10Data-Engineering, 10Event-Platform, 10Metrics-Platform, 10Goal: BUOD-KR1-Q3: Require that all new schema/instruments are created with the MEP system - https://phabricator.wikimedia.org/T259157 (10Aklapper) a:05jlinehan→03None Removing inactive assignee from this open task. (Please update assignees on... [09:14:13] 10Analytics-Radar, 10Data-Engineering, 10MediaWiki-extensions-EventLogging, 10Epic: Review and evolve client environment around EventLogging - https://phabricator.wikimedia.org/T240462 (10Aklapper) a:05jlinehan→03None Removing inactive assignee from this open task. (Please update assignees on open task... [09:14:22] 10Analytics-Radar, 10Instrument-ClientError, 10Observability-Logging, 10Wikimedia-Logstash, and 3 others: Documentation of client side error logging capabilities on mediawiki - https://phabricator.wikimedia.org/T248884 (10Aklapper) a:05jlinehan→03None Removing inactive assignee from this open task. (Pl... [09:36:27] 10Data-Engineering-Kanban, 10Airflow, 10Data Engineering Planning (Sprint 01): [Airflow] Refactor HDFSArchiveOperator to run in Skein - https://phabricator.wikimedia.org/T310542 (10JArguello-WMF) 05Open→03Resolved [09:36:40] 10Data-Engineering-Kanban, 10Data-Engineering-Radar, 10Event-Platform, 10Generated Data Platform, 10Data Engineering Planning (Sprint 01): Add better support for using Event Platform streams with the Flink DataStream API - https://phabricator.wikimedia.org/T310302 (10JArguello-WMF) 05Open→03Resolved [09:36:42] 10Data-Engineering, 10Data-Engineering-Kanban, 10Event-Platform, 10Generated Data Platform, 10Patch-For-Review: [Shared Event Platform] Ability to use Event Platform streams in Flink without boilerplate - https://phabricator.wikimedia.org/T308356 (10JArguello-WMF) [09:36:51] 10Data-Engineering-Kanban, 10Data Engineering Planning (Sprint 01): Analyze officewiki requests - https://phabricator.wikimedia.org/T306136 (10JArguello-WMF) 05Open→03Resolved [09:36:58] 10Data-Engineering-Kanban, 10Data Engineering Planning (Sprint 01), 10Patch-For-Review: Upgrade to latest PrestoDB and enable iceberg support - https://phabricator.wikimedia.org/T311525 (10JArguello-WMF) 05Open→03Resolved [09:37:06] 10Data-Engineering-Kanban, 10Airflow, 10Data Engineering Planning (Sprint 01): Update and add copies of projectview hql script to analytics/refinery/hql path - https://phabricator.wikimedia.org/T309023 (10JArguello-WMF) 05Open→03Resolved [09:37:08] 10Data-Engineering-Kanban, 10Airflow, 10Data Engineering Planning (Sprint 01): Migrate the projectview jobs - https://phabricator.wikimedia.org/T305844 (10JArguello-WMF) [09:37:17] 10Data-Engineering-Kanban, 10Generated Data Platform, 10Data Engineering Planning (Sprint 01), 10Patch-For-Review: [Shared Event Platform] - Research Flink Changelog semantics to inform POC MW schema design - https://phabricator.wikimedia.org/T310082 (10JArguello-WMF) 05Open→03Resolved [09:37:26] 10Data-Engineering-Kanban, 10Data-Catalog, 10Data Engineering Planning (Sprint 01): Connect MVP to Hive metastore [Mile Stone 4] - https://phabricator.wikimedia.org/T299897 (10JArguello-WMF) 05Open→03Resolved [09:37:28] 10Data-Engineering, 10Data-Catalog, 10Epic: Data Catalog MVP - https://phabricator.wikimedia.org/T299910 (10JArguello-WMF) [09:39:39] 10Data-Engineering, 10Data-Engineering-Kanban, 10Airflow, 10Epic: Spark 3 Migration - https://phabricator.wikimedia.org/T309993 (10JArguello-WMF) [09:39:41] 10Data-Engineering, 10Airflow: [Airflow] Add DAG subfolder name to error email's subject - https://phabricator.wikimedia.org/T300054 (10JArguello-WMF) 05Open→03Resolved a:03JArguello-WMF [09:40:21] 10Data-Engineering, 10Airflow: SparkSubmitOperator should make it easier to use conda dist envs - https://phabricator.wikimedia.org/T307937 (10JArguello-WMF) 05Open→03Resolved [09:42:13] 10Data-Engineering, 10Equity-Landscape: UDF to calculate the average of two column values - https://phabricator.wikimedia.org/T313709 (10ntsako) [09:59:07] 10Data-Engineering-Kanban, 10Airflow, 10Data Engineering Planning: Investigate why airflow sensor tasks fail without sending errors - https://phabricator.wikimedia.org/T311976 (10EChetty) [10:26:01] 10Analytics, 10Voice & Tone: Rename geoeditors_blacklist_country - https://phabricator.wikimedia.org/T259804 (10JArguello-WMF) 05Declined→03Open I'm terribly sorry, I'm new at this phabricator. I'm reopening and adding more questions to measure the effort. Please, everyone, accept my apologies. [10:30:03] 10Analytics, 10Voice & Tone: Rename geoeditors_blacklist_country - https://phabricator.wikimedia.org/T259804 (10JArguello-WMF) Hi @Isaac I am a PM working on the OKR "removing the non-inclusive language". we have taken parent task T254646 as a guide of what should be changed. I'm trying to use T-shirt sizes t... [10:55:13] 10Data-Engineering, 10Equity-Landscape: UDF to calculate the average of two or more column values - https://phabricator.wikimedia.org/T313709 (10ntsako) [13:17:42] 10Data-Engineering: analytics-platform-eng admins should be able to restart airflow platform-eng systemctl services - https://phabricator.wikimedia.org/T313727 (10mfossati) [13:50:22] 10Data-Engineering: Use inclusive language in code for private analytics infrastructure - https://phabricator.wikimedia.org/T280268 (10JArguello-WMF) Hi @Milimetric ! I'm trying to measure the effort and steps required for each subtask in T254646: Reconsidering how we name things. The idea is to invite folks a... [14:06:28] 10Data-Engineering-Kanban, 10Event-Platform, 10Wikidata, 10Wikidata-Campsite, and 4 others: Migrate WikibaseTermboxInteraction EventLogging Schema to new EventPlatform thingy - https://phabricator.wikimedia.org/T290303 (10EChetty) [14:06:53] 10Analytics-Kanban, 10Data-Engineering-Kanban, 10Data Engineering Planning (Sprint 02), 10Patch-For-Review: Add logic to purging scripts that requires admin action if it's about to delete a lot of data - https://phabricator.wikimedia.org/T270433 (10EChetty) [14:09:20] 10Data-Engineering-Kanban, 10Airflow, 10Data Engineering Planning (Sprint 02): Create cassandra loading HQL files from their oozie definition - https://phabricator.wikimedia.org/T311507 (10EChetty) [14:10:46] 10Data-Engineering-Kanban, 10Data Engineering Planning, 10Patch-For-Review: Build and install spark3 assembly - https://phabricator.wikimedia.org/T310578 (10EChetty) [14:11:51] 10Data-Engineering-Kanban, 10Data Engineering Planning (Sprint 02): Create conda-base-env with last pyspark - https://phabricator.wikimedia.org/T309227 (10EChetty) [14:14:35] 10Data-Engineering-Kanban, 10Airflow, 10Data Engineering Planning (Sprint 02): Migrate the projectview jobs - https://phabricator.wikimedia.org/T305844 (10EChetty) [14:34:27] 10Data-Engineering-Kanban, 10Airflow, 10Data Engineering Planning: Investigate why airflow sensor tasks fail without sending errors - https://phabricator.wikimedia.org/T311976 (10EChetty) Possible solutions: - Upgrade Airflow - Not enough disk space - Clear some disk space on the machines? Needs to be inve... [15:09:02] 10Data-Engineering-Kanban, 10Data Engineering Planning: Update ua-parser library for traffic data - https://phabricator.wikimedia.org/T306829 (10EChetty) [15:09:24] 10Data-Engineering-Kanban, 10Data Engineering Planning (Sprint 02): Update ua-parser library for traffic data - https://phabricator.wikimedia.org/T306829 (10EChetty) [15:10:49] 10Data-Engineering-Kanban, 10Data Engineering Planning (Sprint 02): Update ua-parser library for traffic data - https://phabricator.wikimedia.org/T306829 (10EChetty) Please perform a dif on the output of this Lib to compare the old data to the new data [16:09:36] 10Analytics, 10Metrics-Platform, 10Product-Analytics: Schema repository structure, naming - https://phabricator.wikimedia.org/T269936 (10Mayakp.wiki) a:03phuedx [18:24:44] 10Analytics, 10Analytics-Wikistats, 10Data-Engineering: "Pages to date" not loading with "daily" metric - https://phabricator.wikimedia.org/T312717 (10EChetty) [18:24:51] 10Data-Engineering, 10Event-Platform, 10Technical-Debt: Migrate usage of Database::select to SelectQueryBuilder in EventBus - https://phabricator.wikimedia.org/T312354 (10EChetty) [18:25:21] 10Data-Engineering, 10Platform Engineering: Modify HiveToDruid Job - https://phabricator.wikimedia.org/T302514 (10EChetty) [18:38:21] 10Data-Engineering: Check home/HDFS leftovers of aniketars - https://phabricator.wikimedia.org/T312514 (10mforns) Hi @Miriam! These are the files that belonged to Aniket Bharti, please can you confirm whether they should be deleted, or moved them to another location? Thank you! ` ====== stat1004 ====== total 0... [19:48:32] 10Analytics, 10Metrics-Platform, 10Performance-Team, 10Product-Analytics, 10MW-1.35-notes (1.35.0-wmf.21; 2020-02-25): Switch mw.user.sessionId back to session-cookie persistence - https://phabricator.wikimedia.org/T223931 (10Krinkle) 05Open→03Resolved a:03Krinkle [20:54:26] PROBLEM - MegaRAID on an-worker1082 is CRITICAL: CRITICAL: 13 LD(s) must have write cache policy WriteBack, currently using: WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough https://wikitech.wikimedia.org/wiki/MegaCli%23Monitoring [21:51:54] RECOVERY - MegaRAID on an-worker1082 is OK: OK: optimal, 13 logical, 14 physical, WriteBack policy https://wikitech.wikimedia.org/wiki/MegaCli%23Monitoring