[07:12:30] well, the JNL file made it to archive.org, its just doing some of its internal processing now, which i guess could take some time for such a big file. [07:13:26] It took 16 hours over the s3 curl api archive.org provides, vs the 4 hours to upload to Google Cloud s3 api via s3cmd [09:12:11] sending it to cloudflare R2 now also [10:58:51] lunch [13:52:59] inflatador: reminder to update https://docs.google.com/document/d/1xp-dxXTDuAY0M8aGyQ8BU5PjnHQe-Ubz1CMM1-hmxOo/edit before our meeting [14:12:12] ryankemper: ^ as well, if you wake up too early :) [14:43:12] gehel ACK, working on it now [14:43:20] inflatador: thx [15:16:09] \o [15:18:10] ebernhardson https://phabricator.wikimedia.org/T344617 might explain it? [16:21:29] inflatador: maybe, unsure. It looks like image suggestions wasn't generated by upstream (i let them know) so it's stalled, looking at the wdqs reconciliation now [16:22:17] annoyingly the update to airflow has moved some buttons around and i'm not sure what to click to get the reconcile upstuck...we limit it to 1 dagrun at a time. I'm not finding how to cancel the current dagrun so it goes back to try and run the previous one (there used to be a button) [16:22:27] s/upstuck/unstuck/ [16:23:08] * ebernhardson does the dumbest thing...and sets the new run to failed so it can run the previous one [16:25:54] reconcile fails because something is dumb: WikibaseApiError(code=badinteger, info=Invalid value "ain_Page" for integer parameter "pageids".) [16:26:30] * ebernhardson is somewhat impressed we managed to stuff a string into an integer place with java. Must be some jankery :P [16:33:52] workout, back in ~40 [16:36:59] * ebernhardson is sad to see we pass around the page ids as Set[String] [16:38:43] oh, it's because the ids are all supposed to be Q12345. So thats why Main_Page turned into ain_Page [16:39:23] * ebernhardson wonders about some sort of case class that id's get parsed into on ingestion that separates the Q and the 12345, and validates near the place the data was ingested [17:25:36] * ebernhardson finds that entity id's as strings is pervasive...wonder if the refactor is worthwhile [17:30:39] ebernhardson: go for it ! Strong Typing FTW [17:52:03] meh, fun. Turns out scala 2.11 doesn't include interoperability between java.util.function and scala.FunctionN. [17:53:56] It's raining, hooray! Might just get below 37ºC/100ºF for the first time in weeks [17:58:10] lunch, back in time for pairing [18:40:47] * ebernhardson finds the repeating theme that chrome+intellij+maven needs too much memory :P