[03:30:01] RECOVERY - Check systemd state on stat1007 is OK: OK - running: The system is fully operational https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state [03:37:03] PROBLEM - Check systemd state on stat1007 is CRITICAL: CRITICAL - degraded: The following units failed: search-drop-query-clicks.service https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state [06:58:07] (03PS1) 10Nmaphophe: Revert "Added ArrayAvgUDF to calculate the average two columns by using an array struct." [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/824436 [07:20:53] (03Restored) 10Nmaphophe: Added ArrayAvgUDF to calculate the average two columns by using an array struct. It also ignores nulls [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/824242 (owner: 10Nmaphophe) [07:21:10] (03PS2) 10Nmaphophe: Added ArrayAvgUDF. [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/824242 [07:21:12] (03PS1) 10Nmaphophe: Added ArrayAvgUDF [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/824680 [07:21:19] (03CR) 10CI reject: [V: 04-1] Added ArrayAvgUDF. [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/824242 (owner: 10Nmaphophe) [07:21:21] (03CR) 10CI reject: [V: 04-1] Added ArrayAvgUDF [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/824680 (owner: 10Nmaphophe) [07:21:48] (03Abandoned) 10Nmaphophe: Added ArrayAvgUDF [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/824680 (owner: 10Nmaphophe) [07:22:24] (03CR) 10Nmaphophe: [C: 03+2] Revert "Added ArrayAvgUDF to calculate the average two columns by using an array struct." [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/824436 (owner: 10Nmaphophe) [07:22:59] (03Abandoned) 10Nmaphophe: Revert "Added ArrayAvgUDF to calculate the average two columns by using an array struct." [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/824436 (owner: 10Nmaphophe) [07:23:04] (03Restored) 10Nmaphophe: Revert "Added ArrayAvgUDF to calculate the average two columns by using an array struct." [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/824436 (owner: 10Nmaphophe) [07:33:20] (03PS1) 10Nmaphophe: Added ArrayAvgUDF [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/824683 [07:34:11] (03Abandoned) 10Nmaphophe: Revert "Added ArrayAvgUDF to calculate the average two columns by using an array struct." [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/824436 (owner: 10Nmaphophe) [08:45:14] !log restarted archiva to pick up new JRE [08:45:15] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [09:43:02] 10Data-Engineering, 10Data Pipelines (Sprint 00), 10Patch-For-Review: Install spark3 in analytics clusters - https://phabricator.wikimedia.org/T295072 (10Antoine_Quhen) Pinned at: - numpy=1.23.1 - pandas=1.4.3 - pyarrow=8.0.0 [11:47:30] (03CR) 10David Caro: mypy: [Do Not Merge] make strict (031 comment) [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/824430 (owner: 10RhinosF1) [12:07:35] 10Quarry, 10Documentation-Review-Board, 10Key docs update 2021-22: Quarry docs - https://phabricator.wikimedia.org/T307011 (10KBach) [12:41:19] (03CR) 10Vivian Rook: [C: 03+1] "Looks great! I'll merge on Monday" [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/824438 (owner: 10RhinosF1) [12:46:52] \o/ [12:46:57] I'm back to irc :) [12:50:31] yay! [13:17:53] 10Quarry, 10Documentation-Review-Board, 10Key docs update 2021-22: Quarry docs - https://phabricator.wikimedia.org/T307011 (10KBach) [13:25:05] 10Quarry, 10Documentation-Review-Board, 10Key docs update 2021-22: Quarry docs - https://phabricator.wikimedia.org/T307011 (10KBach) Made minor changes to improve the flow of content, consistency, and clarity. Also reviewed the criteria listed in task description. >>! In T307011#8029288, @Aklapper wrote: >... [13:46:44] 10Quarry, 10Documentation-Review-Board, 10Key docs update 2021-22: Quarry docs - https://phabricator.wikimedia.org/T307011 (10KBach) >>! In T307011#7989966, @Aklapper wrote: > * Question: Listing page schemas from 2014 in linked https://quarry.wmcloud.org/query/585 and `enwiki_p` DB tables from 2016 in https... [13:47:05] o/ [13:47:47] welcome back jo! [13:56:29] Hi milimetric :) [14:09:42] 10Analytics-Kanban, 10Data-Engineering, 10Event-Platform Value Stream, 10MediaWiki-extensions-EventLogging, and 3 others: Modern Event Platform - https://phabricator.wikimedia.org/T185233 (10Ottomata) 05Resolved→03Open [14:10:51] 10Analytics-Kanban, 10Data-Engineering, 10Event-Platform Value Stream, 10MediaWiki-extensions-EventLogging, and 3 others: Modern Event Platform - https://phabricator.wikimedia.org/T185233 (10Ottomata) Reopening as parent task of Event Platform specific work in the #event-platform_value_stream. Work relate... [14:16:13] btullis, jbond, any chance we can push https://gerrit.wikimedia.org/r/c/operations/puppet/+/824527 out the door today so I can mess with the dumps servers over the weekend? Lots of multi-hour rsyncs in my future :) [14:18:17] (maybe you are both already gone for the day, in which case nevermind!) [14:19:17] andrewbogott: You could manually make `/etc/systemd/system/systemd-timesyncd.service.d/override.conf` while the discussion is ongoing on the patch. [14:19:28] true! [14:19:33] https://www.irccloud.com/pastebin/o2VfdZS6/ [14:20:55] I think that dcaro and jbond weren't 100% through with testing other alternative solutions, but just creating this file and doing a `systemctl daemon-reload` should fix puppet for now for you. [14:21:38] andrewbogott: as btullis mentioned i would prefer to leave it open while investigating other solutions. i have been looking around today and there are various bugs etc but i havn;t managed to get a better solution [14:21:54] moritz is back on monday who may also have some insight on this [14:22:01] ok! If there's more research to do then I'm fine with waiting. [14:22:39] 10Analytics-Kanban, 10Data-Engineering, 10Event-Platform Value Stream, 10MediaWiki-extensions-EventLogging, and 3 others: Modern Event Platform - https://phabricator.wikimedia.org/T185233 (10Ottomata) [14:23:03] 10Analytics, 10Data-Engineering, 10Event-Platform Value Stream, 10Goal: Event Platform: Stream Connectors - https://phabricator.wikimedia.org/T214430 (10Ottomata) [14:23:35] 10Analytics, 10Data-Engineering, 10Event-Platform Value Stream, 10Goal: Event Platform: Stream Connectors - https://phabricator.wikimedia.org/T214430 (10Ottomata) 05Declined→03Open [14:24:55] 10Data-Engineering, 10Data-Engineering-Kanban, 10Event-Platform Value Stream, 10Generated Data Platform, 10Patch-For-Review: [Shared Event Platform] Ability to use Event Platform streams in Flink without boilerplate - https://phabricator.wikimedia.org/T308356 (10Ottomata) [14:24:59] 10Data-Engineering-Kanban, 10Data-Engineering-Radar, 10Event-Platform Value Stream (Sprint 00), 10Patch-For-Review: Flink output support for Event Platform events - https://phabricator.wikimedia.org/T310218 (10Ottomata) [14:27:56] 10Analytics-Kanban, 10Data-Engineering, 10Event-Platform Value Stream, 10MediaWiki-extensions-EventLogging, and 3 others: Modern Event Platform - https://phabricator.wikimedia.org/T185233 (10Ottomata) a:05odimitrijevic→03None [14:28:07] 10Analytics, 10Data-Engineering, 10Event-Platform Value Stream, 10Goal: Event Platform: Stream Connectors - https://phabricator.wikimedia.org/T214430 (10Ottomata) [14:28:11] 10Data-Engineering, 10Epic, 10Event-Platform Value Stream (Sprint 00): Integrate Image Suggestions Feedback with Cassandra - https://phabricator.wikimedia.org/T306627 (10Ottomata) [14:29:52] 10Analytics, 10Data-Engineering, 10Event-Platform Value Stream, 10Goal: Event Platform: Stream Connectors - https://phabricator.wikimedia.org/T214430 (10Ottomata) {T306627} is being used to drive this task, specifically with using Flink to connect streams to Cassandra. We hope to use the work there to mak... [14:47:19] 10Data-Engineering, 10Event-Platform Value Stream: Remove materialized .json files from event schema repositories - https://phabricator.wikimedia.org/T315674 (10Ottomata) [14:48:06] 10Data-Engineering, 10Event-Platform Value Stream: Remove materialized .json files from event schema repositories - https://phabricator.wikimedia.org/T315674 (10Ottomata) I'll wait until the week of Sept 5 2022 before moving forward on this. If you have objections, please comment before then. :) [15:43:39] (03PS1) 10MNeisler: content_translation_event: Add new event_source for new section entrypoints [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/824762 (https://phabricator.wikimedia.org/T287403) [15:45:40] (03CR) 10CI reject: [V: 04-1] content_translation_event: Add new event_source for new section entrypoints [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/824762 (https://phabricator.wikimedia.org/T287403) (owner: 10MNeisler) [15:56:05] 10Data-Engineering, 10Event-Platform Value Stream: Remove materialized .json files from event schema repositories - https://phabricator.wikimedia.org/T315674 (10DLynch) For raw compatibility purposes, JSON is inherently valid YAML, so arguably the most-convenient direction to go in would be to keep just the ma... [16:08:47] (03PS2) 10MNeisler: content_translation_event: Add new event_source for new section entrypoints [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/824762 (https://phabricator.wikimedia.org/T287403) [16:09:59] (03PS3) 10MNeisler: content_translation_event: Add new event_source for new section entrypoints [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/824762 (https://phabricator.wikimedia.org/T287403) [16:30:50] hola joal! :] would you have some time today for uniques troubleshooting? 😬 [17:02:26] 10Data-Engineering, 10Event-Platform Value Stream: Remove materialized .json files from event schema repositories - https://phabricator.wikimedia.org/T315674 (10EChetty) >>! In T315674#8169488, @DLynch wrote: > For raw compatibility purposes, JSON is inherently valid YAML, so arguably the most-convenient direc... [17:14:13] Hi mforns - Would you be ok to wait for monday? [17:14:24] of course, joal! [17:14:27] mforns: it's the last evening having my mum at home :) [17:14:43] Thanks a lot mforns <3 [17:14:50] of course, go enjoy! :] [17:15:18] I have seen your messages from yesterday, and I have been thinking about a reason for the difference - No good answer in my head yet :) [17:34:05] I have also spent most of today trying stuff to discover why there's the difference, but no luck [17:46:31] 10Data-Engineering, 10Event-Platform Value Stream: Remove materialized .json files from event schema repositories - https://phabricator.wikimedia.org/T315674 (10Ottomata) > For raw compatibility purposes, JSON is inherently valid YAML That's true, but I find the JSON harder to read, link to, and edit. We def... [18:23:36] 10Data-Engineering, 10Event-Platform Value Stream: Remove materialized .json files from event schema repositories - https://phabricator.wikimedia.org/T315674 (10mpopov) > That's true, but I find the JSON harder to read, link to, and edit. We def use JSON for data serialization, but for schemas, I prefer the Y... [18:34:43] 10Data-Engineering, 10Event-Platform Value Stream (Sprint 00), 10Patch-For-Review: Design Schema for page state and page state with content (enriched) streams - https://phabricator.wikimedia.org/T308017 (10Ottomata) On our design meeting this past Wednesday, we talked about how to model revision content_slot... [21:18:45] 10Data-Engineering, 10Event-Platform Value Stream: Remove materialized .json files from event schema repositories - https://phabricator.wikimedia.org/T315674 (10kzimmerman) Would this change impact existing pipelines or code? I'm wondering, for instance, if the json files are accessed programmatically and whet... [21:25:36] 10Data-Engineering, 10Data-Engineering-Kanban, 10Event-Platform Value Stream, 10Generated Data Platform: Evaluate Kafka Stretch cluster potential, and if possible, request hardware ASAP - https://phabricator.wikimedia.org/T307944 (10Papaul)