[06:43:28] 06Data-Engineering, 06SRE, 10SRE-Access-Requests, 13Patch-For-Review: Requesting access to analytics-privatedata-users for Cynthia Makonyango WMDE - https://phabricator.wikimedia.org/T371689#10044069 (10SLyngshede-WMF) [06:44:22] 06Data-Engineering, 06SRE, 10SRE-Access-Requests, 13Patch-For-Review: Requesting access to analytics-privatedata-users for Cynthia Makonyango WMDE - https://phabricator.wikimedia.org/T371689#10044067 (10SLyngshede-WMF) p:05Triage→03Medium [06:45:24] 06Data-Engineering, 06SRE, 10SRE-Access-Requests, 13Patch-For-Review: Requesting access to analytics-privatedata-users for Joely Rooke WMDE - https://phabricator.wikimedia.org/T371584#10044074 (10SLyngshede-WMF) [06:46:07] 06Data-Engineering, 06SRE, 10SRE-Access-Requests, 13Patch-For-Review: Requesting access to analytics-privatedata-users for Joely Rooke WMDE - https://phabricator.wikimedia.org/T371584#10044075 (10SLyngshede-WMF) [06:46:13] 06Data-Engineering, 06SRE, 10SRE-Access-Requests, 13Patch-For-Review: Requesting access to analytics-privatedata-users for Joely Rooke WMDE - https://phabricator.wikimedia.org/T371584#10044076 (10SLyngshede-WMF) [06:51:24] 06Data-Engineering, 06SRE, 10SRE-Access-Requests, 13Patch-For-Review: Requesting access to analytics-privatedata-users for Cynthia Makonyango WMDE - https://phabricator.wikimedia.org/T371689#10044097 (10SLyngshede-WMF) 05Open→03Resolved [06:56:12] 06Data-Engineering, 06SRE, 10SRE-Access-Requests, 13Patch-For-Review: Requesting access to analytics-privatedata-users for Joely Rooke WMDE - https://phabricator.wikimedia.org/T371584#10044100 (10SLyngshede-WMF) 05Open→03Resolved p:05Triage→03Medium [07:49:05] hey folks! [07:49:21] Not sure if this is the right place, but I'd need to discuss https://gerrit.wikimedia.org/r/c/generated-data-platform/datasets/image-suggestions/+/1058588 for image-suggestions [07:49:31] basically a rebuild of golang+os, and rollout [08:24:14] elukey: I don't have +2 rights on that repo either. It looks like hnowlan and urandom do, plus whenever I have worked near image-suggestions I have tagged cormacparle and/or mfossati. [08:30:57] ack thanks! [09:11:34] +2'd! [09:13:55] <3 [09:38:16] (03PS34) 10Aqu: Refactor Refine to be triggerd by Airflow [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1016808 (https://phabricator.wikimedia.org/T356762) [09:40:07] (03PS35) 10Aqu: Refactor Refine to be triggerd by Airflow [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1016808 (https://phabricator.wikimedia.org/T356762) [09:40:45] 06Data-Engineering, 06Data Products, 06DBA, 07Schema-change-in-production: Cleanup revision table schema - https://phabricator.wikimedia.org/T367856#10044432 (10fnegri) > s1 (takes around 26h) It's taking much more than that on db1154 (sanitarium host): {F57113237} [10:02:39] (03CR) 10Sergio Gimeno: docs(image_suggestion_interaction): fix doc message (031 comment) [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1059254 (https://phabricator.wikimedia.org/T335716) (owner: 10Sergio Gimeno) [10:05:47] !log disable puppet on an-test-client1002 to test new airflow version T365449 [10:05:50] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [10:05:50] T365449: Upgrade Airflow to 2.9.3 - https://phabricator.wikimedia.org/T365449 [10:33:22] 06Data-Engineering, 06collaboration-services, 10Data Pipelines, 10Data-Platform-SRE (2024.07.29 - 2024.08.16), and 2 others: Upgrade Airflow to 2.9.3 - https://phabricator.wikimedia.org/T365449#10044599 (10Stevemunene) Deployed the new version on the test cluster, with ` sudo dpkg -i airflow-2.9.3-py3.10-... [12:30:01] 10Data-Engineering (Q1 2024 July 1st - September 30th), 10Dumps 2.0 (Kanban Board), 10Event-Platform, 10MW-1.43-notes (1.43.0-wmf.15; 2024-07-23): [Event Platform] Instrument EventBus with prometheus MW Statslib - https://phabricator.wikimedia.org/T363587#10044823 (10Ottomata) I wonder if wiki_id would be... [12:31:06] 10Data-Engineering (Q1 2024 July 1st - September 30th), 10Dumps 2.0 (Kanban Board), 10Event-Platform, 10MW-1.43-notes (1.43.0-wmf.15; 2024-07-23): [Event Platform] Instrument EventBus with prometheus MW Statslib - https://phabricator.wikimedia.org/T363587#10044827 (10Ottomata) send() function call and also... [13:11:40] (03CR) 10Aqu: Refactor Refine to be triggerd by Airflow (035 comments) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1016808 (https://phabricator.wikimedia.org/T356762) (owner: 10Aqu) [13:25:38] 06Data-Engineering, 10Data Products (Data Products Sprint 17), 13Patch-For-Review: No longer use removed cuc_actiontext column in analytics/refinery - https://phabricator.wikimedia.org/T371099#10044972 (10Dreamy_Jazz) Review is being provided by another team, so removing our sprint tag. [13:50:50] 06Data-Engineering: Requesting Kerberos access for ifrahkhanyaree - https://phabricator.wikimedia.org/T371894 (10Ifrahkhanyaree_WMDE) 03NEW [14:10:57] (03CR) 10Ottomata: Refactor Refine to be triggerd by Airflow (031 comment) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1016808 (https://phabricator.wikimedia.org/T356762) (owner: 10Aqu) [16:03:29] 10Data-Engineering (Q1 2024 July 1st - September 30th), 10Dumps 2.0 (Kanban Board), 10Event-Platform, 10MW-1.43-notes (1.43.0-wmf.15; 2024-07-23): [Event Platform] Instrument EventBus with prometheus MW Statslib - https://phabricator.wikimedia.org/T363587#10045748 (10Ottomata) @gmodena I've rearranged and... [16:06:33] 10Data-Engineering (Q1 2024 July 1st - September 30th), 10Dumps 2.0 (Kanban Board), 10Event-Platform, 10MW-1.43-notes (1.43.0-wmf.15; 2024-07-23): [Event Platform] Instrument EventBus with prometheus MW Statslib - https://phabricator.wikimedia.org/T363587#10045771 (10Ottomata) [17:25:45] 06Data-Engineering, 06Product-Analytics, 10Wmfdata-Python: Update all Wmfdata-Python run functions to have consistent API - https://phabricator.wikimedia.org/T273197#10046192 (10nshahquinn-wmf) [17:26:40] 06Data-Engineering, 06Product-Analytics, 10Wmfdata-Python: Update all Wmfdata-Python run functions to have consistent API - https://phabricator.wikimedia.org/T273197#10046195 (10nshahquinn-wmf) [17:26:45] 06Data-Engineering, 06Data-Platform-SRE: Requesting Kerberos access for ifrahkhanyaree - https://phabricator.wikimedia.org/T371894#10046197 (10Ottomata) [17:50:50] 10Data-Engineering (Q1 2024 July 1st - September 30th), 10Observability-Tracing: service-utils helper for trace header propagation - https://phabricator.wikimedia.org/T371120#10046284 (10CDanis) [18:16:45] 10Data-Engineering (Q1 2024 July 1st - September 30th), 10Dumps 2.0 (Kanban Board), 10Event-Platform, 10MW-1.43-notes (1.43.0-wmf.15; 2024-07-23), 13Patch-For-Review: [Event Platform] Instrument EventBus with prometheus MW Statslib - https://phabricator.wikimedia.org/T363587#10046394 (10Ottomata) FYI {T3... [19:43:15] ottomata: as a completely random guess, i was thinking to roll-restart eventgate-main again? It seems the itermittent job dropping started at the same time i restarted eventgate-main for the private wikis config [19:56:03] woth a try ebernhardson [19:56:07] can't make things worse [19:56:11] sorry i haven't had time to look into that yet! [20:19:21] ran the restart, will give it a few hours. If no problems in a few hours it suggests some problem there [20:46:47] 06Data-Engineering, 10Add-Link, 10CirrusSearch, 06Growth-Team, and 5 others: revalidateLinkRecommendations.php fails periodically with JobQueueError: Could not enqueue jobs - https://phabricator.wikimedia.org/T371767#10046750 (10EBernhardson) >>! In T371767#10043613, @EBernhardson wrote: > Perhaps one nota...