[09:47:15] (03CR) 10David Caro: [C: 03+1] "LGTM" [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/791606 (https://phabricator.wikimedia.org/T290874) (owner: 10Vivian Rook) [10:20:42] (03CR) 10David Caro: [C: 03+1] drop unneeded done function [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/791415 (https://phabricator.wikimedia.org/T308269) (owner: 10Vivian Rook) [10:22:31] (03CR) 10David Caro: [C: 03+1] "This or https://gerrit.wikimedia.org/r/c/analytics/quarry/web/+/788438 would be good yes, probably the linked patch might be nicer (will u" [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/791415 (https://phabricator.wikimedia.org/T308269) (owner: 10Vivian Rook) [10:22:56] (03CR) 10David Caro: [C: 03+1] "Hmpf... hit enter xd" [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/791415 (https://phabricator.wikimedia.org/T308269) (owner: 10Vivian Rook) [10:24:04] (03CR) 10David Caro: [C: 03+1] "There's another patch doing something similar:" [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/788438 (https://phabricator.wikimedia.org/T307297) (owner: 10Razzi) [10:58:12] (03PS8) 10Joal: [WIP] Update to spark-3 and scala-2.12 [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/656897 [11:31:17] (03PS5) 10NOkafor: Updated the get Cassandra password function to; [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/790651 (https://phabricator.wikimedia.org/T306895) [11:32:12] (03PS9) 10Joal: [WIP] Update to spark-3 and scala-2.12 [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/656897 [11:56:19] 10Analytics, 10Data-Engineering, 10Event-Platform, 10Metrics-Platform: jsonschema-tools tests should fail if schema $id does not match title or path - https://phabricator.wikimedia.org/T300404 (10NOkafor-WMF) a:03NOkafor-WMF [12:13:35] 10Data-Engineering, 10Data-Engineering-Kanban: RAID battery malfunction in an-worker1081 - https://phabricator.wikimedia.org/T308267 (10BTullis) I shut down the host to cycle the power on the RAID controller card. Now booting the server again. [12:16:32] 10Data-Engineering, 10Data-Engineering-Kanban: RAID battery malfunction in an-worker1081 - https://phabricator.wikimedia.org/T308267 (10BTullis) The following message was displayed on boot. {F35145123,width=75%} However it did proceed past this message and has now booted. [12:28:12] 10Data-Engineering, 10Data-Engineering-Kanban: RAID battery malfunction in an-worker1081 - https://phabricator.wikimedia.org/T308267 (10BTullis) Even after a power cycle it is still not charging so I can't think of any other course of action other than to seek a replacement. ` btullis@an-worker1081:~$ sudo meg... [12:35:16] 10Data-Engineering, 10Data-Engineering-Kanban: RAID battery malfunction in an-worker1081 - https://phabricator.wikimedia.org/T308267 (10BTullis) I have created a sub-task and assigned it to #ops-eqiad In the meantime I'll move this ticket to paused and the worker will continue to run with reduced performance. [12:37:34] 10Data-Engineering, 10Data-Engineering-Kanban, 10Data-Catalog, 10Patch-For-Review: Configure LDAP authentication for the DataHub frontend - https://phabricator.wikimedia.org/T301462 (10BTullis) I've updated the LDAP authentication so that it now correctly filters based on `wmf` or `nda` group membership. [12:40:36] 10Data-Engineering-Kanban, 10Data-Catalog, 10Patch-For-Review: User Experience: Authentication - https://phabricator.wikimedia.org/T307711 (10BTullis) I am merging [[https://gerrit.wikimedia.org/r/c/operations/deployment-charts/+/791061|this patch]] which retains the use of `uid` as the primary identifier, b... [13:05:36] (03CR) 10Snwachukwu: Create HQL scripts to generate Wikidata's ArticlePlaceholder and Reliability metrics. (036 comments) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/791394 (https://phabricator.wikimedia.org/T300021) (owner: 10Snwachukwu) [13:27:21] 10Data-Engineering, 10Event-Platform, 10Generated Data Platform: [Shared Event Platform] Ability to use Event Platform streams in Flink without boilerplate - https://phabricator.wikimedia.org/T308356 (10Ottomata) [13:29:49] (03CR) 10Ottomata: [C: 03+1] "Not following all the specific changes, but +1 from me when ready!" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/656897 (owner: 10Joal) [14:01:15] 10Data-Engineering, 10Data-Engineering-Kanban, 10Superset, 10Product-Analytics (Kanban): Error when updating dashboard - https://phabricator.wikimedia.org/T308441 (10razzi) [14:04:43] 10Data-Engineering-Kanban, 10Data-Catalog: User Experience: Authentication - https://phabricator.wikimedia.org/T307711 (10BTullis) I added some more information to https://wikitech.wikimedia.org/wiki/Analytics/Systems/DataHub#Accessing_DataHub which explains clearly which username must be used for DataHub and... [14:09:35] 10Data-Engineering, 10SRE: an-worker1081 MEGARAID write cache policy alerting - https://phabricator.wikimedia.org/T308442 (10RhinosF1) [14:09:45] (03CR) 10Razzi: [V: 03+2 C: 03+2] Upgrade to upstream version 1.35.0 [analytics/turnilo/deploy] - 10https://gerrit.wikimedia.org/r/777881 (https://phabricator.wikimedia.org/T301990) (owner: 10Razzi) [14:11:16] (03PS1) 10Milimetric: Add datahub metadata ingestion CLI as a conda env [analytics/refinery] - 10https://gerrit.wikimedia.org/r/792215 (https://phabricator.wikimedia.org/T307714) [14:11:52] a-team: please check ^ [14:12:30] RhinosF1: Check the patch milimetric uploaded? Or something else? [14:12:37] 10Data-Engineering, 10SRE: an-worker1081 MEGARAID write cache policy alerting - https://phabricator.wikimedia.org/T308442 (10BTullis) Sorry, I've already been working on this in {T308267} but I must have allowed the acknowledgement to lapse. I will close this as a duplicate, but add a downtime on that service... [14:12:42] razzi: the task I filed [14:12:43] the MEGARAID write cache, I think razzi [14:12:52] Oh I see [14:13:13] 10Data-Engineering, 10Data-Engineering-Kanban: RAID battery malfunction in an-worker1081 - https://phabricator.wikimedia.org/T308267 (10BTullis) [14:13:27] 10Data-Engineering, 10SRE: an-worker1081 MEGARAID write cache policy alerting - https://phabricator.wikimedia.org/T308442 (10BTullis) [14:14:29] btullis: please make sure alerts actually acknowledge / downtime. I think in this case you might need a sticky acknowledge or something as it's flapping. [14:15:28] RhinosF1: Yes, sorry about that. I have added a month of downtime and added a persistent ackowledgement now. [14:15:37] btullis: thank you! [14:16:02] * btullis RhinosF1: A pleasure. Apologies for the noise. [14:16:23] No worries [14:18:29] btullis: I managed to set off hundreds of alerts once on another projects icinga [14:18:42] I can't say much about noise [14:25:02] (03CR) 10Vivian Rook: [C: 03+1] "I agree, this one is nicer. I'll abandon mine in lieu of this one." [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/788438 (https://phabricator.wikimedia.org/T307297) (owner: 10Razzi) [14:25:21] (03Abandoned) 10Vivian Rook: drop unneeded done function [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/791415 (https://phabricator.wikimedia.org/T308269) (owner: 10Vivian Rook) [14:25:57] (03CR) 10Vivian Rook: [C: 03+2] Truncate text to 80 characters on quarry history links [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/791758 (https://phabricator.wikimedia.org/T306343) (owner: 10Jiyu) [14:26:35] (03CR) 10Vivian Rook: [C: 03+2] history.html: show a 'blank query' link [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/791779 (https://phabricator.wikimedia.org/T306342) (owner: 10Jiyu) [14:29:35] (03Merged) 10jenkins-bot: Truncate text to 80 characters on quarry history links [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/791758 (https://phabricator.wikimedia.org/T306343) (owner: 10Jiyu) [14:29:41] (03CR) 10jerkins-bot: [V: 04-1] history.html: show a 'blank query' link [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/791779 (https://phabricator.wikimedia.org/T306342) (owner: 10Jiyu) [14:35:45] 10Quarry, 10good first task: Truncate text on quarry history links - https://phabricator.wikimedia.org/T306343 (10rook) 05Open→03Resolved [14:38:54] (03PS10) 10Joal: Update to spark-3 and scala-2.12 [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/656897 [14:45:15] (03PS2) 10Vivian Rook: history.html: show a 'blank query' link [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/791779 (https://phabricator.wikimedia.org/T306342) (owner: 10Jiyu) [14:52:50] ottomata: Heya - would you have a minute to talk spark3 and how we define defaults in Airflow? [15:04:58] sure! [15:05:07] bc is busy, want to do slack huddle? [15:05:30] I'm listening to mforns ottomata - will ping after [15:05:34] oh okay [15:05:37] Thanks :) [15:10:59] (03CR) 10Vivian Rook: [C: 03+2] history.html: show a 'blank query' link [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/791779 (https://phabricator.wikimedia.org/T306342) (owner: 10Jiyu) [15:14:41] (03Merged) 10jenkins-bot: history.html: show a 'blank query' link [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/791779 (https://phabricator.wikimedia.org/T306342) (owner: 10Jiyu) [15:15:20] 10Data-Engineering, 10Event-Platform: [BUG] jsonschema-tools materializes fields in yaml in a different order than in json files - https://phabricator.wikimedia.org/T308450 (10Ottomata) [15:15:52] 10Data-Engineering, 10Event-Platform: [BUG] jsonschema-tools materializes fields in yaml in a different order than in json files - https://phabricator.wikimedia.org/T308450 (10Ottomata) Alternatively, we could drop support for materializing yaml versioned files. [15:17:36] 10Quarry, 10Patch-For-Review, 10good first task: History shows blank for blank queries - https://phabricator.wikimedia.org/T306342 (10rook) 05Open→03Resolved [15:20:54] (03CR) 10Vivian Rook: [C: 03+2] "Looks good. Thanks for the commit!" [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/752034 (owner: 10EpicPupper) [15:24:56] (03Merged) 10jenkins-bot: add link to database names [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/752034 (owner: 10EpicPupper) [15:43:03] (03CR) 10Vivian Rook: [C: 03+2] Remember recent queries filter last used by a user. [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/176506 (https://phabricator.wikimedia.org/T76084) (owner: 10Rtnpro) [15:47:23] (03Merged) 10jenkins-bot: Remember recent queries filter last used by a user. [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/176506 (https://phabricator.wikimedia.org/T76084) (owner: 10Rtnpro) [15:49:02] 10Quarry, 10Patch-Needs-Improvement: Remember filters: "All queries", "Published queries", etc. chosen by user in recent queries page - https://phabricator.wikimedia.org/T76084 (10rook) 05Open→03Resolved [15:52:19] 10Data-Engineering, 10Equity-Landscape: New databases user "gdi" for Equity Landscape - https://phabricator.wikimedia.org/T308453 (10ntsako) [16:01:54] 10Data-Engineering, 10Equity-Landscape: New HDFS user "gdi" for Equity Landscape - https://phabricator.wikimedia.org/T308453 (10ntsako) [16:13:27] 10Data-Engineering, 10Data-Engineering-Kanban, 10Superset, 10Product-Analytics (Kanban): Error when updating dashboard - https://phabricator.wikimedia.org/T308441 (10razzi) I downloaded the whole dashboard as json, edited the json to make the name have "TEST COPY", scp'd it to the superset host, and loaded... [17:06:19] (03PS4) 10Vivian Rook: Use vars.qrun_id when stopping query [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/788438 (https://phabricator.wikimedia.org/T307297) (owner: 10Razzi) [17:28:02] (03CR) 10Vivian Rook: [C: 03+2] Use vars.qrun_id when stopping query [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/788438 (https://phabricator.wikimedia.org/T307297) (owner: 10Razzi) [17:31:52] (03Merged) 10jenkins-bot: Use vars.qrun_id when stopping query [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/788438 (https://phabricator.wikimedia.org/T307297) (owner: 10Razzi) [17:34:47] 10Quarry: Quarry code cleanup - https://phabricator.wikimedia.org/T308269 (10rook) 05Open→03Resolved [17:35:53] 10Data-Engineering, 10Equity-Landscape: New HDFS user "gdi" for Equity Landscape - https://phabricator.wikimedia.org/T308453 (10ntsako) [18:04:21] (03PS2) 10Clare Ming: Add is-anon, is-bot properties to schema [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/791422 (https://phabricator.wikimedia.org/T307381) [19:56:44] (03PS1) 10Jiyu: query.py: Make quarry history descending [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/792277 (https://phabricator.wikimedia.org/T306340) [19:58:05] 10Quarry, 10Patch-For-Review, 10good first task: Make quarry history descending - https://phabricator.wikimedia.org/T306340 (10Abstract09) a:03Abstract09 [19:59:03] (03CR) 10Vivian Rook: [C: 03+1] "Looks good! I'll merge tomorrow. Thanks!" [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/792277 (https://phabricator.wikimedia.org/T306340) (owner: 10Jiyu) [19:59:05] (03CR) 10Jiyu: "Thank you!" [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/792277 (https://phabricator.wikimedia.org/T306340) (owner: 10Jiyu) [20:00:34] (03CR) 10jerkins-bot: [V: 04-1] query.py: Make quarry history descending [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/792277 (https://phabricator.wikimedia.org/T306340) (owner: 10Jiyu) [20:00:40] (03CR) 10Jiyu: query.py: Make quarry history descending (031 comment) [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/792277 (https://phabricator.wikimedia.org/T306340) (owner: 10Jiyu) [20:04:25] (03CR) 10Vivian Rook: "Oh wait, I was took quick to comment. Looks like jenkins needs to be made happy first. Seems like the problem is:" [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/792277 (https://phabricator.wikimedia.org/T306340) (owner: 10Jiyu) [20:28:19] 10Quarry: Quarry, unable to run tests following the README.md - https://phabricator.wikimedia.org/T308493 (10Abstract09) [20:30:20] (03CR) 10RhinosF1: query.py: Make quarry history descending (031 comment) [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/792277 (https://phabricator.wikimedia.org/T306340) (owner: 10Jiyu) [20:42:50] 10Quarry: Quarry, unable to run tests following the README.md - https://phabricator.wikimedia.org/T308493 (10Aklapper) This doesn't sound like an issue in Quarry itself to me, but an issue with the local Docker setup? I do not think that the Quarry documentation should cover Docker Troubleshooting unrelated to Q... [20:45:06] (03PS2) 10Jiyu: query.py: Make quarry history descending [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/792277 (https://phabricator.wikimedia.org/T306340) [20:48:23] (03CR) 10Jiyu: query.py: Make quarry history descending (031 comment) [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/792277 (https://phabricator.wikimedia.org/T306340) (owner: 10Jiyu) [20:59:18] 10Quarry: Quarry, unable to run tests following the README.md - https://phabricator.wikimedia.org/T308493 (10RhinosF1) @Aklapper: @VRook confirmed they could reproduce via email too. [21:05:31] (03CR) 10Vivian Rook: [C: 03+1] "No need to apologize 😊" [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/792277 (https://phabricator.wikimedia.org/T306340) (owner: 10Jiyu) [21:08:09] 10Quarry: Quarry, unable to run tests following the README.md - https://phabricator.wikimedia.org/T308493 (10bd808) > py.error.EACCES: [Permission denied]: mkdir('/app/.tox/log',) This sounds a lot like {T295318} [21:20:24] (03CR) 10RhinosF1: [C: 03+1] query.py: Make quarry history descending (031 comment) [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/792277 (https://phabricator.wikimedia.org/T306340) (owner: 10Jiyu)