[00:18:45] 06Data-Engineering, 10Dumps-Generation, 06MediaWiki-Platform-Team, 06serviceops: Migrate WMF production from PHP 7.4 to PHP 8.1 - https://phabricator.wikimedia.org/T319432#10465079 (10Scott_French) [00:25:53] 10Data-Engineering (Q2 2024 October 1st - December 31th), 10CheckUser, 06DBA, 06Trust and Safety Product Team, 07Schema-change-in-production: Remove cuc_actiontext, cuc_only_for_read_old, and cuc_private from cu_changes on WMF wikis - https://phabricator.wikimedia.org/T370903#10465085 (10Ladsgroup) [09:34:31] 06Data-Engineering, 10Add-Link, 10GrowthExperiments-NewcomerTasks, 10Growth-Team (Current Sprint), 07Schema-change: Make growthexperiments_link_recommendations.gelr_data nullable in GrowthExperiments - https://phabricator.wikimedia.org/T383864 (10Urbanecm_WMF) 03NEW [09:37:08] 06Data-Engineering, 10Add-Link, 10GrowthExperiments-NewcomerTasks, 10Growth-Team (Current Sprint), and 2 others: Make growthexperiments_link_recommendations.gelr_data nullable in GrowthExperiments - https://phabricator.wikimedia.org/T383864#10465743 (10Urbanecm_WMF) p:05Triage→03High [11:12:42] 06Data-Engineering: Fix skein/spark memory unit missfit - https://phabricator.wikimedia.org/T383589#10466000 (10gmodena) We can repro this issue in [[ https://airflow-search.wikimedia.org/dags/mjolnir_weekly/grid?execution_date=2025-01-03+18%3A42%3A00.449096%2B00%3A00&dag_run_id=scheduled__2025-01-03T18%3A42%3A0... [11:30:59] 06Data-Engineering, 10Dumps-Generation, 06MediaWiki-Platform-Team, 06serviceops: Migrate WMF production from PHP 7.4 to PHP 8.1 - https://phabricator.wikimedia.org/T319432#10466051 (10jijiki) [11:43:45] 06Data-Engineering, 06Data-Platform-SRE, 10Dumps-Generation: WE 5.4 KR - Hypothesis 5.4.6 - Q3 FY24/25 - Validate Dumps 1.0 compatibility with PHP 8.1 - https://phabricator.wikimedia.org/T382484#10466077 (10BTullis) I have made progress on this by circumventing the failure path, but I don't know whether this... [11:56:05] 06Data-Engineering, 06Data-Platform-SRE, 10Dumps-Generation: WE 5.4 KR - Hypothesis 5.4.6 - Q3 FY24/25 - Validate Dumps 1.0 compatibility with PHP 8.1 - https://phabricator.wikimedia.org/T382484#10466106 (10BTullis) I have reached out on the #mediawiki-engineering-teams Slack channel, to ask for help in unde... [12:30:17] 06Data-Engineering, 10Add-Link, 10GrowthExperiments-NewcomerTasks, 10Growth-Team (Current Sprint), and 2 others: Make growthexperiments_link_recommendations.gelr_data nullable in GrowthExperiments - https://phabricator.wikimedia.org/T383864#10466235 (10Ladsgroup) Before making the field nullable please con... [13:00:17] 06Data-Engineering, 10Add-Link, 10GrowthExperiments-NewcomerTasks, 10Growth-Team (Current Sprint), and 2 others: Make growthexperiments_link_recommendations.gelr_data nullable in GrowthExperiments - https://phabricator.wikimedia.org/T383864#10466321 (10Michael) >>! In T383864#10466235, @Ladsgroup wrote: >... [13:00:18] 06Data-Engineering, 06Data-Engineering-Radar, 10CampaignEvents, 06Data-Persistence, and 5 others: Add "event_is_test_event" field to "campaign_events" table - https://phabricator.wikimedia.org/T381759#10466322 (10Ladsgroup) Thanks for the investigation. I also hope after Flow's undeploy we can start testin... [13:10:02] 06Data-Engineering, 10Add-Link, 10GrowthExperiments-NewcomerTasks, 10Growth-Team (Current Sprint), and 2 others: Make growthexperiments_link_recommendations.gelr_data nullable in GrowthExperiments - https://phabricator.wikimedia.org/T383864#10466348 (10Ladsgroup) Basically the official recommendation is th... [13:46:25] 06Data-Engineering, 10Add-Link, 10GrowthExperiments-NewcomerTasks, 10Growth-Team (Current Sprint), and 2 others: Make growthexperiments_link_recommendations.gelr_data nullable in GrowthExperiments - https://phabricator.wikimedia.org/T383864#10466498 (10Urbanecm_WMF) >>! In T383864#10466235, @Ladsgroup wrot... [14:08:51] 06Data-Engineering, 10Dumps-Generation, 06MediaWiki-Platform-Team, 06serviceops: Migrate WMF production from PHP 7.4 to PHP 8.1 - https://phabricator.wikimedia.org/T319432#10466633 (10Jdforrester-WMF) [14:53:54] 06Data-Engineering: Fix skein/spark memory unit missfit - https://phabricator.wikimedia.org/T383589#10466855 (10gmodena) a:03gmodena [15:27:13] PROBLEM - Check if active EventStreams endpoint is delivering messages. on alert1002 is CRITICAL: CRITICAL: No EventStreams message was consumed from https://stream.wikimedia.org/v2/stream/recentchange within 10 seconds. https://wikitech.wikimedia.org/wiki/Event_Platform/EventStreams/Administration [15:57:16] RECOVERY - Check if active EventStreams endpoint is delivering messages. on alert1002 is OK: OK: An EventStreams message was consumed from https://stream.wikimedia.org/v2/stream/recentchange within 10 seconds. https://wikitech.wikimedia.org/wiki/Event_Platform/EventStreams/Administration [15:59:52] (03CR) 10Mforns: [C:03+2] "LGTM!" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1092890 (https://phabricator.wikimedia.org/T379768) (owner: 10Snwachukwu) [16:09:51] (03CR) 10Mforns: [C:03+2] "LGTM!" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1109039 (https://phabricator.wikimedia.org/T373785) (owner: 10KCVelaga) [17:03:06] 10Data-Engineering (Q2 2024 October 1st - December 31th): Identify Internal Users of MediaWiki Wikitext Tables - https://phabricator.wikimedia.org/T383743#10467554 (10Ahoelzl) [17:09:08] 06Data-Engineering: Fix skein/spark memory unit missfit - https://phabricator.wikimedia.org/T383589#10467584 (10Ottomata) <3 thank you! [18:43:31] 10Data-Engineering (Q2 2024 October 1st - December 31th), 10Dumps 2.0 (Kanban Board): Calculate rough HDFS storage requirements for wmf_content.mediawiki_content_history_v1 - https://phabricator.wikimedia.org/T383816#10467835 (10Ahoelzl) [18:49:11] 10Data-Engineering (Q2 2024 October 1st - December 31th), 10Dumps 2.0 (Kanban Board): Calculate rough HDFS storage requirements for wmf_content.mediawiki_content_history_v1 - https://phabricator.wikimedia.org/T383816#10467841 (10xcollazo) [18:49:23] 10Data-Engineering (Q2 2024 October 1st - December 31th), 10Dumps 2.0 (Kanban Board): Calculate rough HDFS storage requirements for wmf_content.mediawiki_content_history_v1 - https://phabricator.wikimedia.org/T383816#10467843 (10xcollazo) [18:51:41] 10Data-Engineering (Q2 2024 October 1st - December 31th): Analyze Dumps Usage Through Apache Logs - https://phabricator.wikimedia.org/T383175#10467850 (10VirginiaPoundstone) [20:15:35] 06Data-Engineering, 10MediaWiki-extensions-EventLogging, 10Event-Platform, 13Patch-For-Review: Decommission EventLogging backend components by migrating to MEP - https://phabricator.wikimedia.org/T238230#10468213 (10Ottomata) [20:17:29] 06Data-Engineering, 10MediaWiki-extensions-EventLogging, 10Event-Platform, 13Patch-For-Review: Decommission EventLogging backend components by migrating to MEP - https://phabricator.wikimedia.org/T238230#10468234 (10Ottomata) After discussing with Timo I decided to edit all pages in the Schema namespace on... [20:17:51] 06Data-Engineering, 10MediaWiki-extensions-EventLogging, 10Event-Platform, 13Patch-For-Review: Decommission EventLogging backend components by migrating to MEP - https://phabricator.wikimedia.org/T238230#10468237 (10Ottomata) WE ARE DONE HERE! [20:30:11] 10Data-Engineering (Q2 2024 October 1st - December 31th), 10Dumps 2.0 (Kanban Board): Implement Airflow Dataset class for RestExternalTaskSensor - https://phabricator.wikimedia.org/T372647#10468303 (10amastilovic) >>! In T372647#10449505, @Ottomata wrote: > Q, is this resolved? > > I think the stuff in t... [21:04:24] 06Data-Engineering, 06MediaWiki-Engineering, 10MediaWiki-General, 07Wikimedia-production-error: PHP Unknown error: EventLoggingLegacyConverter: Failed proxying legacy EventLogging event query string to WMF Event Platform JSON: UnexpectedValueException: TemplateDat... - https://phabricator.wikimedia.org/T383939 [21:05:23] 06Data-Engineering, 06MediaWiki-Engineering, 10MediaWiki-General, 07Wikimedia-production-error: PHP Unknown error: EventLoggingLegacyConverter: Failed proxying legacy EventLogging event query string to WMF Event Platform JSON: UnexpectedValueException: Te... - https://phabricator.wikimedia.org/T383939#10468477 [21:19:05] 10Data-Engineering (Q2 2024 October 1st - December 31th), 10Dumps 2.0 (Kanban Board): Implement Airflow Dataset class for RestExternalTaskSensor - https://phabricator.wikimedia.org/T372647#10468518 (10Ottomata) Perfect, thank you! [21:19:39] 06Data-Engineering: Unify Airflow's datasets.yaml config files across instances - https://phabricator.wikimedia.org/T383931#10468521 (10Ottomata) [21:19:55] 06Data-Engineering: Unify Airflow's datasets.yaml config files across instances - https://phabricator.wikimedia.org/T383931#10468523 (10Ottomata) [21:19:58] 10Data-Engineering (Q2 2024 October 1st - December 31th), 10Dumps 2.0 (Kanban Board): Implement Airflow Dataset class for RestExternalTaskSensor - https://phabricator.wikimedia.org/T372647#10468524 (10Ottomata) [21:20:13] 10Data-Engineering (Q2 2024 October 1st - December 31th), 10Dumps 2.0 (Kanban Board): Implement Airflow Dataset class for RestExternalTaskSensor - https://phabricator.wikimedia.org/T372647#10468525 (10Ottomata) [21:26:36] 06Data-Engineering, 10MediaWiki-extensions-WikimediaEvents: Owners phpunit test does not work with subfolders - https://phabricator.wikimedia.org/T352472#10468532 (10Jdlrobson) @phuedx we hit this again during https://gerrit.wikimedia.org/r/c/mediawiki/extensions/WikimediaEvents/+/1087253 The more we use gener... [21:28:16] 06Data-Engineering, 06MediaWiki-Engineering, 10MediaWiki-General, 07Wikimedia-production-error: PHP Unknown error: EventLoggingLegacyConverter: Failed proxying legacy EventLogging event query string to WMF Event Platform JSON: UnexpectedValueException: Te... - https://phabricator.wikimedia.org/T383939#10468536 [22:50:02] 14Analytics, 10Product-Analytics (Kanban): Make an Analytics Data Lake table to provide meta info about wikis - https://phabricator.wikimedia.org/T184576#10468781 (10nshahquinn-wmf) [23:55:41] 10Data-Engineering (Q2 2024 October 1st - December 31th): Gitlab CI/CD Component for Blunderbuss - https://phabricator.wikimedia.org/T382348#10468950 (10amastilovic) >>! In T382348#10416529, @BTullis wrote: > While this is a good basis, I would prefer to see some kind of additional authentication layer on top of...