[01:59:27] 10Analytics: Use inclusive language - https://phabricator.wikimedia.org/T280268 (10Samwilson) Is this a duplicate of T254646 (or one of its subtasks)? [02:35:14] (03CR) 10Andrew Bogott: [C: 04-2] Added test_webhelpers.py (031 comment) [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/710604 (owner: 10Andrew Bogott) [07:02:37] 10Analytics, 10Analytics-Kanban, 10Prod-Kubernetes, 10SRE, and 2 others: Move eventgate services to use TLS only - https://phabricator.wikimedia.org/T255871 (10JMeybohm) @Ottomata that looks unrelated to your chance (but related to yours @Jelto ). We will take a look! [08:28:15] hnowlan: Good morning - I could do with a quick help for the new AQS cluster if you have a minute :) [08:44:51] 10Analytics: Fill holes in pageview-complete dumps using pageview-count-raw - https://phabricator.wikimedia.org/T290060 (10JAllemandou) [08:58:05] (03CR) 10David Caro: Use yaml.safe_load suppress deprecation notices (031 comment) [analytics/quarry/web] (buster) - 10https://gerrit.wikimedia.org/r/715622 (owner: 10Andrew Bogott) [09:03:03] joal: sure! what's up? [09:04:00] hnowlan: the config deployed is pretty old and references a too old druid datasource - could we redeploy a new config? [10:00:45] (03PS1) 10Ladsgroup: Introduce script to get stats on edits having certain tags [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/715710 (https://phabricator.wikimedia.org/T236893) [10:01:02] (03CR) 10David Caro: app.py: move flask creation into create_app() (032 comments) [analytics/quarry/web] (buster) - 10https://gerrit.wikimedia.org/r/715621 (owner: 10Andrew Bogott) [10:02:39] (03CR) 10David Caro: app.py: move flask creation into create_app() (031 comment) [analytics/quarry/web] (buster) - 10https://gerrit.wikimedia.org/r/715621 (owner: 10Andrew Bogott) [10:07:49] hnowlan: I assume the non-change of config is due to puppet not being enable on the hosts [10:09:41] joal: sorry, was afk for a bit - is this the aqs config? [10:09:57] yessir [10:10:22] I think that's because the new hosts aren't in the scap config, let's have a look [10:10:49] hnowlan: IIRC the config is managed by puppet [10:14:36] ahh okay - just in case it causes unrelated issues in future the new aqs hosts are missing from the scap config [10:14:41] * hnowlan makes a note [10:16:17] hnowlan: ack - maked sense (I would have guessed that for now :_ [10:17:49] looks like it was the differing roles https://gerrit.wikimedia.org/r/c/operations/puppet/+/715712 [10:19:44] I added my +1 hnowlan - thanks a lot for finding this - Would you mind merging? [10:20:05] I think it also requires an AQS restart after merge :S [10:22:44] heh, grand [10:27:12] gonna roll-restart aqs-next in that case [10:30:51] !log sudo cookbook sre.aqs.roll-restart aqs-next [10:30:54] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [10:31:04] oh wait no that doesn't work [10:38:10] done :) [11:11:47] hnowlan: I confirm it has worked :) Thanks a lot! [11:14:21] no worries! [11:30:56] (03PS1) 10GoranSMilovanovic: WMDEData 0.1.0 re-export pipe [analytics/wmde/WD/WikidataAnalytics] - 10https://gerrit.wikimedia.org/r/715720 [11:31:08] (03CR) 10GoranSMilovanovic: [V: 03+2 C: 03+2] WMDEData 0.1.0 re-export pipe [analytics/wmde/WD/WikidataAnalytics] - 10https://gerrit.wikimedia.org/r/715720 (owner: 10GoranSMilovanovic) [11:45:05] 10Analytics-Kanban, 10Reading Epics (Analytics): Check AQS with cassandra (serving + data) - https://phabricator.wikimedia.org/T290068 (10JAllemandou) [11:45:24] 10Analytics-Kanban, 10Reading Epics (Analytics): Check AQS with cassandra (serving + data) - https://phabricator.wikimedia.org/T290068 (10JAllemandou) a:03JAllemandou [11:45:39] 10Analytics-Kanban, 10Reading Epics (Analytics): Check AQS with cassandra (serving + data) - https://phabricator.wikimedia.org/T290068 (10JAllemandou) [11:46:04] 10Analytics, 10Analytics-Kanban: Check AQS with cassandra (serving + data) - https://phabricator.wikimedia.org/T290068 (10JAllemandou) [13:05:38] 10Analytics, 10Analytics-Kanban, 10Prod-Kubernetes, 10SRE, and 2 others: Move eventgate services to use TLS only - https://phabricator.wikimedia.org/T255871 (10JMeybohm) >>! In T255871#7320889, @JMeybohm wrote: > @Ottomata that looks unrelated to your chance (but related to yours @Jelto ). We will take a l... [13:31:02] (03CR) 10Ottomata: build: Document simpler alternative contribution flow (031 comment) [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/714875 (owner: 10Krinkle) [13:34:44] 10Analytics, 10Event-Platform: Users should run explicit commands to materialize schema versions, rather than using magic git hooks - https://phabricator.wikimedia.org/T290074 (10Ottomata) [13:34:59] (03PS4) 10Ottomata: build: Document simpler alternative contribution flow [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/714875 (https://phabricator.wikimedia.org/T290074) (owner: 10Krinkle) [13:36:34] 10Analytics, 10Event-Platform, 10Patch-For-Review: Users should run explicit commands to materialize schema versions, rather than using magic git hooks - https://phabricator.wikimedia.org/T290074 (10Ottomata) [[ https://gerrit.wikimedia.org/r/c/schemas/event/secondary/+/714875 | @Krinkle's patch ]] does the... [13:40:16] 10Analytics, 10Analytics-Kanban, 10Prod-Kubernetes, 10SRE, and 2 others: Move eventgate services to use TLS only - https://phabricator.wikimedia.org/T255871 (10Ottomata) Great! Proceeding... [13:53:02] 10Analytics, 10Analytics-Kanban: Check AQS with cassandra (serving + data) - https://phabricator.wikimedia.org/T290068 (10JAllemandou) [13:53:52] (03CR) 10Michael DiPietro: "How is this run?" [analytics/quarry/web] (buster) - 10https://gerrit.wikimedia.org/r/715608 (owner: 10Andrew Bogott) [14:08:55] (03CR) 10Andrew Bogott: Use yaml.safe_load suppress deprecation notices (031 comment) [analytics/quarry/web] (buster) - 10https://gerrit.wikimedia.org/r/715622 (owner: 10Andrew Bogott) [14:10:55] (03CR) 10Tobias Andersson: Introduce script to get stats on edits having certain tags (031 comment) [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/715710 (https://phabricator.wikimedia.org/T236893) (owner: 10Ladsgroup) [14:22:29] 10Analytics, 10DBA, 10Infrastructure-Foundations, 10SRE, and 3 others: Switch buffer re-partition - Eqiad Row D - https://phabricator.wikimedia.org/T286069 (10Ottomata) I just tried to run puppet on an-coord1001 but got: ` Notice: Skipping run of Puppet configuration client; administratively disabled (Rea... [14:23:26] 10Analytics, 10DBA, 10Infrastructure-Foundations, 10SRE, and 3 others: Switch buffer re-partition - Eqiad Row D - https://phabricator.wikimedia.org/T286069 (10RhinosF1) Puppet is under maintenance [14:23:39] ottomata: ^ [14:23:40] 10Analytics, 10DBA, 10Infrastructure-Foundations, 10SRE, and 3 others: Switch buffer re-partition - Eqiad Row D - https://phabricator.wikimedia.org/T286069 (10Ottomata) Oh, sorry @jbond is doing some maintenance and referenced the wrong phab ticket. Ignore ^ [14:23:56] RhinosF1: ya sorry, wrong phab ticket in puppet disable message confused me [14:24:39] ottomata: it was in SAL & mentioned in -sre [14:25:10] sorry about that ottomata should be back again within the next 10mins assuming nothing gose wrong, if not ill fix the message ( RhinosF1 some had the right ticket others didn;t) [14:26:10] np at all, just saw the message and thought that it was left accidentally disabled since that ticket was in progress [14:33:19] (03CR) 10Andrew Bogott: app.py: move flask creation into create_app() (031 comment) [analytics/quarry/web] (buster) - 10https://gerrit.wikimedia.org/r/715621 (owner: 10Andrew Bogott) [14:33:57] gehel: o/ [14:34:13] trying to understand what I should do in https://gerrit.wikimedia.org/r/c/wikimedia-event-utilities/+/699277 [14:34:45] i get that i can now rely on the defaults for the shade plugin [14:34:55] but it looks like i should be using assemly with jar? [14:35:02] not totally sure how do that [14:35:07] is that also in discovery parent pom? [14:36:02] * gehel is context switching... [14:36:40] (03PS2) 10Ladsgroup: Introduce script to get stats on edits having certain tags [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/715710 (https://phabricator.wikimedia.org/T236893) [14:36:52] (03CR) 10Ladsgroup: Introduce script to get stats on edits having certain tags (031 comment) [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/715710 (https://phabricator.wikimedia.org/T236893) (owner: 10Ladsgroup) [14:37:52] ottomata: to use the shade plugin, you just need to add: [14:37:55] [14:37:55] org.apache.maven.plugins [14:37:55] maven-shade-plugin [14:37:55] [14:38:08] right ,but to use assembly and jar-with-dependencies as recommended? [14:38:12] https://github.com/wikimedia/wikimedia-discovery-discovery-parent-pom#jar-with-dependencies--ueberjar [14:38:13] no need to specify version or configuration [14:38:29] i see https://maven.apache.org/plugins/maven-assembly-plugin/descriptor-refs.html#jar-with-dependencies [14:38:33] where do I add that xml? [14:39:10] oh ho [14:39:10] v [14:39:11] https://maven.apache.org/plugins/maven-assembly-plugin/plugin-info.html [14:39:13] i think i get it [14:39:34] ok and [14:39:36] looking more [14:39:39] https://maven.apache.org/plugins/maven-assembly-plugin/usage.html [14:39:50] maven-assembly-plugin< is already in discovery parent pom pluginManagement [14:39:58] so i just need to add it to my poms plugins and configure? [14:40:16] yep, and `jar-with-dependencies` is a standard descriptor, so you can just reference it [14:40:53] ok hm but [14:40:57] where does https://maven.apache.org/plugins/maven-assembly-plugin/descriptor-refs.html#jar-with-dependencies [14:41:40] you don't need it, it's one of the provided assembly descriptors [14:41:50] you just need to reference it [14:42:09] ohhh ok [14:42:41] add this to your plugin section: [14:42:43] https://www.irccloud.com/pastebin/bV5sJpsB/ [14:42:58] that **should** be enough [14:43:36] no need for groupId? [14:43:54] adding `org.apache.maven` would be nice (it's the default groupId, so not technically required, but since that default can be overridden, better to specify it [14:45:04] ok trying [14:46:52] you might want to upgrade to parent pom 1.55 at some point as well [14:48:20] now is as good as ever :) [14:48:54] gehel: ok so with just your recommended config, i don't see any assembly jar after mvn package [14:49:05] ;i added the stuff recommended in https://maven.apache.org/plugins/maven-assembly-plugin/usage.html [14:49:12] and i get [14:49:12] Failed to create assembly: Error creating assembly archive jar-with-dependencies: archive cannot be empty [14:49:51] Oh, it probably needs to be activated only on submodules that actually create jars [14:50:00] oh! in their poms ok [14:50:12] so same thing in both places? [14:50:52] You can keep the overall configuration in the section of the parent pom, and just activate that plugin for each submodule [14:50:58] ah ok [14:51:03] OH [14:52:40] is the `apiaction` dataset no longer populated? [14:53:09] Or am I doing something wrong? looking for entries this month for wikidatawiki i see nothing [14:53:33] ottomata: etiquette dictates that after writing "OH" you need to provide some context and not leave me hanging [14:53:48] addshore: can ou give me more on that dataset? [14:53:50] addshore: hmm, not 100% sure i recall, but you prob ably want mediawiki_api_request ? [14:54:05] gehel: ha sorry it was an OH understanding but am trying and am hanging on myself... [14:54:06] ottomata: aaaah, maybe that is indeed where I should be looking now! [14:54:20] ok gehel i thinkk i got it! [14:54:35] gehel: joal do we think that the name [14:54:40] jar-with-dependencies.jar [14:54:41] (03CR) 10Tobias Andersson: [C: 03+1] "Looks like what we want." [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/715710 (https://phabricator.wikimedia.org/T236893) (owner: 10Ladsgroup) [14:54:46] is a good convention for this? [14:54:57] maybe just -assembly.jar would be better? [14:55:07] hm [14:55:16] https://wikitech.wikimedia.org/wiki/Analytics/Data_Lake/Traffic/mediawiki_api_request that looks right! [14:55:24] there are various ways of naming the same in systems [14:55:31] yeah, shaded, uber, etc. [14:55:34] yup [14:55:43] -fat ? [14:55:45] is uber a generic name for assembly and shaded? [14:56:07] I think it is - uber == fat for me, meaning it contains the whole stuff [14:56:26] and in that case -uber is better than -fat :) [14:57:24] is it worth bering explicit and using -assembly for assembly and -shaded for shaded? [14:57:29] there is a subtle difference, right? [14:59:17] ottomata: assembly and shaded are different - and for instance sbt or gradle use different terms IIRC [14:59:33] we should force using one we like :) [14:59:39] right, but is it better to be explicit when naming the artifact? [14:59:47] in this case it is assembly. [14:59:49] I think it is [14:59:58] ok [14:59:58] ok, i'll go with just -assembly.jar then [15:00:22] and we'll use -shaded in the other case [15:01:25] jar-with-dependencies is the default from the assembly plugin. I think you should have good reasons to not go with the default! [15:01:35] The usual least surprise principle [15:01:53] hm true [15:01:58] -assembly is very generic, everything is an assembly [15:02:09] ok, i will leave default then. [15:03:35] gehel: https://gerrit.wikimedia.org/r/c/wikimedia-event-utilities/+/699277 [15:03:42] perhaps we should put that default config in discovery parent pom too? [15:05:29] 10Analytics, 10Analytics-Kanban, 10Prod-Kubernetes, 10SRE, and 2 others: Move eventgate services to use TLS only - https://phabricator.wikimedia.org/T255871 (10Ottomata) [15:07:48] We use the assembly plugin with other descriptors, overriding the descriptorRef would be a pain. We could have the execution configuration in the parent pom. [15:08:18] hmmm ok if it is a pain let's leave it out [15:16:19] ottomata: LGTM. I would +2, but I don't have rights [15:16:39] merged, thanks for your help! [15:17:03] and now, need to do the opposite for refinery! [15:24:56] heheh indeed! [15:24:59] actually since i'm here.... [15:25:01] on it... [15:25:47] (03CR) 10Ladsgroup: Introduce script to get stats on edits having certain tags (032 comments) [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/715710 (https://phabricator.wikimedia.org/T236893) (owner: 10Ladsgroup) [15:27:43] i'm going to try a new patch, since things ahve changed in parent pom since. also...maybe we can use assembly instead [15:42:33] joal: do we have a case where we need uber jars for anything other than refinery job? [15:43:10] ottomata: not sure what refinery-job means - we need refinery-job to be uber, as well as refinery-hiveb [15:43:25] i mean the refinery-job java project [15:43:39] right now i think all artifacts for all projects are shaded jars [15:43:45] e.g. refinery-cassandra has all deps [15:43:55] as does refinery-tools, etc. [15:43:58] oh i guess tools we need [15:44:03] ok so maybe hive, job and toolls we need uber jars for? [15:44:08] well it needs them - the only 2 ones that are not shaded are refinery-core and refinery-spark [15:44:12] ohhh [15:44:28] great ok. [15:48:25] (03PS1) 10Ottomata: Create assembly jar-with-dependencies [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/715753 (https://phabricator.wikimedia.org/T217967) [15:48:46] ottomata: why assembly instead of shaded? [15:49:08] gehel: and dcausse say its simpler and recommended [15:49:18] i just compared the artifacts each created for refinery-job [15:49:19] and they are the same [15:49:55] hi ottomata :] I wonder why the alert for refine_sanitize triggered, since you merged the fix yesterday? I see in the alert, that the monitor job is still checking 3 days, but it should check 2. Maybe it needs to be restarted? [15:49:57] ok - they are different, and I would have expected to have some diffs, but we can try [15:50:36] 10Analytics, 10Discovery-Search, 10Patch-For-Review: Publish both shaded and unshaded artifacts from analytics refinery - https://phabricator.wikimedia.org/T217967 (10Ottomata) I compared the assembly vs shaded jars created for refinery-job. ` jar -tvf refinery-job/target/refinery-job-0.1.17-SNAPSHOT.jar |... [15:50:39] https://phabricator.wikimedia.org/T217967#7322131 [15:50:42] joal: ^ [15:50:54] i think they are different mostly if you configure them to be different [15:50:57] shaded has more power? [15:51:36] shaded can contain multiple versions of the same package - this is important when those multiple versions handle class-renames [15:51:51] mforns: it runs as a systemdtimer [15:51:58] i looked at configs on an-launcher, they lok right it hink [15:52:18] assembly explodes the dependencies into classes in folder, leading to multiple versions conflict [15:52:26] joal: i'm fine with using shaded, i'm just going witih whaterver folks tell me [15:52:39] should we use shaded and just rename the artifacts accordinly? [15:52:54] I have no problem neither ottomata - I'm wondering if it'll break or not is all :) [15:53:03] gehel: ^ whatcha think? [15:58:10] (03CR) 10Tobias Andersson: [C: 03+1] Introduce script to get stats on edits having certain tags (031 comment) [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/715710 (https://phabricator.wikimedia.org/T236893) (owner: 10Ladsgroup) [15:59:17] ottomata: if I remember, refinery is using shaded jars at the moment? It is also a mess of conflicting dependencies, so I would not change anything. [15:59:30] assembly forces you to better manage you dependency conflicts (compile vs provided deps) and it's why I'd suggest starting new project with the assembly plugin instead of the shade plugin [15:59:51] +1 to what dcausse said! [16:00:17] if the project already exists all what Guillaume said :) [16:02:28] makes sense folks - thanks a lot :) [16:02:31] ok great iwll use shaded [16:07:08] 10Analytics, 10Analytics-Kanban, 10Data-Engineering, 10Data-Engineering-Kanban: Wikistats should allow more than one project - https://phabricator.wikimedia.org/T283254 (10Milimetric) p:05High→03Medium a:03Milimetric [16:07:29] 10Analytics, 10Analytics-Kanban, 10Data-Engineering, 10Data-Engineering-Kanban, 10Patch-For-Review: Expand Wikiselector to allow more than one wiki - https://phabricator.wikimedia.org/T285050 (10Milimetric) p:05High→03Medium a:03Milimetric [16:07:44] 10Analytics-Kanban, 10Data-Engineering, 10Privacy Engineering, 10Privacy, and 2 others: Add check to make sure deny-list countries aren't being passed through AQS - https://phabricator.wikimedia.org/T289279 (10Milimetric) a:03JAllemandou [16:26:29] 10Analytics: Fix `wmf.editors_daily` data deletion - https://phabricator.wikimedia.org/T290093 (10JAllemandou) [16:26:34] milimetric: --^ [16:39:36] (03CR) 10Andrew Bogott: app.py: move flask creation into create_app() (031 comment) [analytics/quarry/web] (buster) - 10https://gerrit.wikimedia.org/r/715621 (owner: 10Andrew Bogott) [17:10:37] 10Analytics, 10Product-Analytics (Kanban): [REQUEST] Investigate decrease in New Registered Users - https://phabricator.wikimedia.org/T289799 (10ldelench_wmf) a:03Iflorez [17:34:19] joal: what's your schedule today? :] [17:35:04] mforns: I was about to say: I already worked my day - Is it ok if I let you deploy, and I'll manage the restarts tomorrow, and we can then sync on the QA script? [17:38:01] of course joal :] I'll deploy without oozie loading restarts [17:38:17] hm - I don't get it mforns [17:38:43] you'll deploy, and don't do restarts is that right? [17:56:13] yes, exactly [18:00:02] (03PS4) 10Ottomata: Publish both shaded and unshaded artifacts. [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/495141 (https://phabricator.wikimedia.org/T217967) (owner: 10Gehel) [18:00:49] (03Abandoned) 10Ottomata: Create assembly jar-with-dependencies [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/715753 (https://phabricator.wikimedia.org/T217967) (owner: 10Ottomata) [18:01:22] (03Abandoned) 10Ottomata: Publish both shaded and unshaded artifacts. [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/495475 (https://phabricator.wikimedia.org/T217967) (owner: 10Gehel) [18:02:35] (03PS5) 10Ottomata: Publish both shaded and unshaded artifacts. [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/495141 (https://phabricator.wikimedia.org/T217967) (owner: 10Gehel) [18:07:48] ottomata: I went ahead and approved https://phabricator.wikimedia.org/T289257 https://phabricator.wikimedia.org/T289258 and https://phabricator.wikimedia.org/T289259 [18:08:13] great thanks olja [18:08:25] maybe you can comment on https://gerrit.wikimedia.org/r/c/operations/puppet/+/715259 [18:28:22] (03CR) 10Ottomata: Publish both shaded and unshaded artifacts. (031 comment) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/495141 (https://phabricator.wikimedia.org/T217967) (owner: 10Gehel) [18:34:41] (03CR) 10Ottomata: "Hm, not sure if this is working yet..." [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/495141 (https://phabricator.wikimedia.org/T217967) (owner: 10Gehel) [19:02:26] (03CR) 10Gehel: "Looks mostly good. Minor comment inline." [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/495141 (https://phabricator.wikimedia.org/T217967) (owner: 10Gehel) [19:15:09] 10Analytics, 10Beta-Cluster-Infrastructure, 10Beta-Cluster-reproducible, 10User-Urbanecm: 502, connect failed for intake-analytics.wikimedia.beta.wmflabs.org - https://phabricator.wikimedia.org/T289029 (10AlexisJazz) >>! In T289029#7319883, @Urbanecm wrote: > So, I tried to just reboot that host, and...the... [20:40:11] (03CR) 10Mforns: [C: 03+2] Load cassandra3 from spark [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/686629 (https://phabricator.wikimedia.org/T280649) (owner: 10Milimetric) [20:42:22] 10Analytics, 10Inuka-Team, 10Product-Analytics: Superset timeouts for KaiOS dashboard - https://phabricator.wikimedia.org/T277320 (10nshahquinn-wmf) I've been debugging some of these Superset issues with Analytics Engineering, but @AMuigai and I decided to deprioritize this in favor of T289740. [20:48:23] (03Merged) 10jenkins-bot: Load cassandra3 from spark [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/686629 (https://phabricator.wikimedia.org/T280649) (owner: 10Milimetric) [21:02:27] (03PS1) 10Mforns: Update changelog.md for v0.1.17 [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/715795 [21:03:38] (03CR) 10Mforns: [V: 03+2 C: 03+2] Update changelog.md for v0.1.17 [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/715795 (owner: 10Mforns) [21:06:37] (03CR) 10Andrew Bogott: app.py: move flask creation into create_app() (032 comments) [analytics/quarry/web] (buster) - 10https://gerrit.wikimedia.org/r/715621 (owner: 10Andrew Bogott) [21:10:58] 10Analytics, 10Readers-Web-Backlog, 10Patch-For-Review, 10Product-Analytics (Kanban): Add UniversalLanguageSelector to the allowlist - https://phabricator.wikimedia.org/T287256 (10LGoto) [21:11:07] (03PS2) 10Andrew Bogott: app.py: remove redundant main definition [analytics/quarry/web] (buster) - 10https://gerrit.wikimedia.org/r/715619 [21:11:13] (03PS2) 10Andrew Bogott: app.py: process with black in anticipation of a huge reformat [analytics/quarry/web] (buster) - 10https://gerrit.wikimedia.org/r/715620 [21:11:19] (03PS3) 10Andrew Bogott: Use yaml.safe_load to avoid deprecation notices [analytics/quarry/web] (buster) - 10https://gerrit.wikimedia.org/r/715622 [21:11:25] (03PS2) 10Andrew Bogott: Move flask creation into create_app() factory, move routes into blueprints [analytics/quarry/web] (buster) - 10https://gerrit.wikimedia.org/r/715621 [21:33:29] (03PS1) 10Andrew Bogott: Remove 'beta' from branding [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/715796 [21:55:51] Starting build #94 for job analytics-refinery-maven-release-docker [22:08:11] Project analytics-refinery-maven-release-docker build #94: 09SUCCESS in 12 min: https://integration.wikimedia.org/ci/job/analytics-refinery-maven-release-docker/94/ [22:26:44] Starting build #52 for job analytics-refinery-update-jars-docker [22:27:11] (03PS1) 10Maven-release-user: Add refinery-source jars for v0.1.17 to artifacts [analytics/refinery] - 10https://gerrit.wikimedia.org/r/715803 [22:27:11] Project analytics-refinery-update-jars-docker build #52: 09SUCCESS in 28 sec: https://integration.wikimedia.org/ci/job/analytics-refinery-update-jars-docker/52/ [22:27:24] !log Deployed refinery-source using jenkins [22:27:27] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [22:27:41] (03CR) 10Mforns: [V: 03+2 C: 03+2] Add cassandra3 to oozie loading jobs [analytics/refinery] - 10https://gerrit.wikimedia.org/r/706605 (https://phabricator.wikimedia.org/T280649) (owner: 10Joal) [22:31:50] (03CR) 10Mforns: [V: 03+2 C: 03+2] Add refinery-source jars for v0.1.17 to artifacts [analytics/refinery] - 10https://gerrit.wikimedia.org/r/715803 (owner: 10Maven-release-user) [22:38:25] (03PS1) 10Mforns: Bump up jar version for Cassandra3 loading jobs [analytics/refinery] - 10https://gerrit.wikimedia.org/r/715826 (https://phabricator.wikimedia.org/T280649) [22:39:26] (03CR) 10Mforns: [V: 03+2 C: 03+2] Bump up jar version for Cassandra3 loading jobs [analytics/refinery] - 10https://gerrit.wikimedia.org/r/715826 (https://phabricator.wikimedia.org/T280649) (owner: 10Mforns) [22:41:42] !log starting deployment of refinery (regular weekly train v0.1.17) [22:41:45] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [23:23:20] (03PS1) 10Bstorm: local dev: set up a really basic wikireplica-ish container [analytics/quarry/web] (buster) - 10https://gerrit.wikimedia.org/r/715828 (https://phabricator.wikimedia.org/T287902) [23:25:23] !log finished deployment of refinery (regular weekly train v0.1.17) successfully, only an-test-coord1001.eqiad.wmnet failed [23:25:25] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [23:25:31] (03CR) 10Bstorm: "I know it's silly to be fussy about it, but the wikireplicas run mariadb 10.4, so that's why I used that version." [analytics/quarry/web] (buster) - 10https://gerrit.wikimedia.org/r/715828 (https://phabricator.wikimedia.org/T287902) (owner: 10Bstorm)