[07:17:32] (03CR) 10Joal: [C:03+1] "LGTM! Can be merged with parent patch" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1034558 (https://phabricator.wikimedia.org/T365197) (owner: 10Gehel) [09:10:28] 10Data-Engineering (Q4 2024 April 1st - June 30th): [Datasets Config][Spike] Understand and document the details and conflicts between Datasets Config, Refine refactor, Dynamic EventStreamConfig, and Metrics Platform Instrumentation Configurator - https://phabricator.wikimedia.org/T361853#9824725 (10phuedx) >>!... [09:33:03] (03PS14) 10Gehel: fix(*DatabaseReader): avoid null pointer exception when reading MaxMind [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1032562 (https://phabricator.wikimedia.org/T365197) [09:33:03] (03PS4) 10Gehel: style(maxmind): fix checkstyle violations for MaxMind package. [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1034558 (https://phabricator.wikimedia.org/T365197) [09:33:37] (03CR) 10Joal: [C:03+2] "Merging!" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1032562 (https://phabricator.wikimedia.org/T365197) (owner: 10Gehel) [09:47:37] !log reimaging stat1008 to bullseye [09:47:39] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [09:50:50] (03Merged) 10jenkins-bot: fix(*DatabaseReader): avoid null pointer exception when reading MaxMind [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1032562 (https://phabricator.wikimedia.org/T365197) (owner: 10Gehel) [10:00:06] (03CR) 10Joal: [C:03+2] "Merging!" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1034558 (https://phabricator.wikimedia.org/T365197) (owner: 10Gehel) [10:03:52] (03CR) 10Joal: [C:03+2] "Merging!" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1032020 (https://phabricator.wikimedia.org/T364045) (owner: 10Joal) [10:05:33] (03CR) 10Joal: [V:03+2 C:03+2] "Merging" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1032018 (https://phabricator.wikimedia.org/T364045) (owner: 10Joal) [10:06:19] (03PS2) 10Joal: Add wikidatawiki grouped-wikis file [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1031897 (https://phabricator.wikimedia.org/T364045) [10:06:32] (03CR) 10Joal: [V:03+2 C:03+2] "Merging!" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1031897 (https://phabricator.wikimedia.org/T364045) (owner: 10Joal) [10:17:20] (03Merged) 10jenkins-bot: style(maxmind): fix checkstyle violations for MaxMind package. [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1034558 (https://phabricator.wikimedia.org/T365197) (owner: 10Gehel) [10:20:49] (03Merged) 10jenkins-bot: Update MediawikiXMLDumpsConverter [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1032020 (https://phabricator.wikimedia.org/T364045) (owner: 10Joal) [11:19:23] 06Data-Engineering, 10Event-Platform, 07Wikimedia-production-error: [Event Platform] Error: Call to a member function exists() on null (via EventBus PageChangeEventSerializer) - https://phabricator.wikimedia.org/T346355#9825117 (10Aklapper) Still an issue in 1.43.0-wmf.6: ==== Error ==== * service.version:... [11:21:56] (03CR) 10Gmodena: Add table lock release mechanism for Hive-Metastore (033 comments) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1034851 (https://phabricator.wikimedia.org/T365563) (owner: 10Aqu) [11:23:24] 06Data-Engineering, 10Dumps-Generation, 06SRE, 10Data-Platform-SRE (2024.05.06 - 2024.05.26): Migrate Dumps Snapshot hosts from Buster to Bullseye - https://phabricator.wikimedia.org/T325228#9825127 (10BTullis) [11:40:24] 06Data-Engineering, 10MediaWiki-Core-Snapshots, 10Temporary accounts: Provide attrribute to indicate that user is temporary account in exported content - https://phabricator.wikimedia.org/T365693 (10kostajh) 03NEW [12:19:55] \o/ [12:19:59] stat1008 is back :) [12:20:03] thank you btullis :) [12:20:51] You're welcome. Sorry it took a bit longer than expected. [12:28:40] (03PS1) 10Gehel: chore: remove leftover from refinery-cassandra [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1035406 [12:29:11] joal: minor cleanup of a left over pom.xml file: https://gerrit.wikimedia.org/r/c/analytics/refinery/source/+/1035406 [12:30:31] gehel: thank you for this - this module was supposedly removed, but the folder stayed and I kept without notocing [12:30:48] (03CR) 10Joal: [C:03+2] "Merging!" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1035406 (owner: 10Gehel) [12:46:37] !log Deleting airflow variable for canary_event_hourly job to update artifact to latest version [12:46:39] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [12:47:52] (03Merged) 10jenkins-bot: chore: remove leftover from refinery-cassandra [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1035406 (owner: 10Gehel) [13:30:54] 10Data-Engineering (Q4 2024 April 1st - June 30th): [Datasets Config][Spike] Understand and document the details and conflicts between Datasets Config, Refine refactor, Dynamic EventStreamConfig, and Metrics Platform Instrumentation Configurator - https://phabricator.wikimedia.org/T361853#9825680 (10Ottomata) >... [13:37:36] 10Quarry, 10Cloud-VPS: [bug] Lot of queries stuck in queued state for hours and days - https://phabricator.wikimedia.org/T365136#9825723 (10Oudedutchman) @SD0001 I see the pull-request https://github.com/toolforge/quarry/pull/42 which addresses this, but is it really enough to fix the problem? [13:49:24] btullis: o/ [13:49:33] I definitely need a meeting with you for the ceph chart :D [13:49:42] I did the first pass on the initial import, sorry for the lag [13:49:57] I left a couple of notes for the priviledged containers, but the chart looks good in my opinion [13:50:13] I tried to read the phab task but it is very complex, also because I know nothing about ceph [14:06:37] (03CR) 10Santiago Faci: [C:03+1] "Looks good!" [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1019138 (https://phabricator.wikimedia.org/T356228) (owner: 10David Martin) [14:08:36] elukey: Great, many thanks. Let's meet when convenient. [14:24:04] 06Data-Engineering, 10Observability-Logging, 06Traffic: Switch HAProxy/Benthos to rfc5424 - https://phabricator.wikimedia.org/T365718 (10Fabfur) 03NEW [14:31:06] btullis: next week when you have 30 mins it would be great, do you want me to send the invite? [15:00:49] I only have next Tuesday morning next week. I'm on leave apart from that. Does that work for you? [15:02:27] I could also do tomorrow, if you prefer. [15:18:38] ah snap I work only in the afternoon :( tomorrow could be good if you are ok! [15:26:16] Yes, any time at all tomorrow. Whatever is good for you. We can make it a chilled type of meeting, suitable for a Friday :-) [15:28:43] 10Data-Engineering (Q4 2024 April 1st - June 30th), 10Event-Platform, 07Spike: [SPIKE] Can we express Event Platform configs in Datasets Config? - https://phabricator.wikimedia.org/T361017#9826234 (10Ottomata) ^ related: {T348963} [16:29:10] btullis: ack let's ping each other tomorrow, if we have time we meet :) [17:27:56] 06Data-Engineering, 10Data Products (Data Products Sprint 13), 10Web-Team-Backlog (FY2023-24 Q4 Sprint 5): Follow-Up Ticket for QA: Validate Sample Rate Adjustments - https://phabricator.wikimedia.org/T365489#9826884 (10ovasileva) p:05Triage→03Medium [17:28:04] 06Data-Engineering, 10Data Products (Data Products Sprint 13), 10Web-Team-Backlog (FY2023-24 Q4 Sprint 5): Follow-Up Ticket for QA: Validate Sample Rate Adjustments - https://phabricator.wikimedia.org/T365489#9826886 (10ovasileva) p:05Medium→03High [17:36:32] 06Data-Engineering, 10Data Products (Data Products Sprint 13), 10Web-Team-Backlog (FY2023-24 Q4 Sprint 5): Follow-Up Ticket for QA: Validate Sample Rate Adjustments - https://phabricator.wikimedia.org/T365489#9826946 (10SToyofuku-WMF) [19:05:35] 06Data-Engineering, 10MediaWiki-General, 10Event-Platform, 10MediaWiki-Platform-Team (Radar), 13Patch-For-Review: Create legacy EventLogging proxy HTTP intake (for MediaWikiPingback) endpoint to EventGate - https://phabricator.wikimedia.org/T353817#9827265 (10Krinkle) @Ottomata I've confirmed the same ju... [19:10:33] 06Data-Engineering, 06Data-Platform, 06Movement-Insights: Add the global registration date to mediawiki_history - https://phabricator.wikimedia.org/T363775#9827293 (10nshahquinn-wmf) Potentially this could be done alongside T365648. [19:55:27] 06Data-Engineering, 10MediaWiki-General, 10Event-Platform, 10MediaWiki-Platform-Team (Radar), 13Patch-For-Review: Create legacy EventLogging proxy HTTP intake (for MediaWikiPingback) endpoint to EventGate - https://phabricator.wikimedia.org/T353817#9827441 (10Ottomata) > I suggest creating a copy of the...