[01:36:54] PROBLEM - Check unit status of monitor_refine_event on an-launcher1002 is CRITICAL: CRITICAL: Status of the systemd unit monitor_refine_event https://wikitech.wikimedia.org/wiki/Analytics/Systems/Managing_systemd_timers [04:59:30] 10Analytics, 10Analytics-Kanban, 10Product-Analytics, 10SRE, and 2 others: Requesting access to analytics-privatedata-users for schoenbaechler - https://phabricator.wikimedia.org/T283190 (10Marostegui) 05Open→03Stalled [05:12:43] 10Analytics-Radar, 10SRE, 10SRE-Access-Requests: Requesting access to production shell for BUmeh - https://phabricator.wikimedia.org/T283648 (10Marostegui) 05Open→03Resolved Patch merged. User added to nda ldap group. Kerberos principal created. Please test the access in about 1-2h to make sure puppet h... [06:29:42] 10Analytics, 10Analytics-Kanban, 10WMDE-TechWish, 10Patch-For-Review: Deployment access request for some analytics repos - https://phabricator.wikimedia.org/T274880 (10elukey) @awight logs should be available at `/tmp/reportupdater-logs` on HDFS, Can you check if everything looks as expected? [06:52:59] 10Analytics, 10Analytics-Kanban, 10WMDE-TechWish, 10Patch-For-Review: Deployment access request for some analytics repos - https://phabricator.wikimedia.org/T274880 (10awight) >>! In T274880#7125011, @elukey wrote: > @awight logs should be available at `/tmp/reportupdater-logs` on HDFS, Can you check if ev... [06:57:50] Good morning team [06:58:12] bonjour bonjour [06:58:16] Morning :) [07:02:54] 10Analytics: Reportupdater should stop running a job after some fixed number of failures - https://phabricator.wikimedia.org/T284037 (10awight) [08:04:38] 10Analytics-Kanban, 10Better Use Of Data, 10Product-Analytics, 10Tracking-Neverending: Superset Updates - https://phabricator.wikimedia.org/T211706 (10elukey) a:05elukey→03None [08:05:16] 10Analytics-Clusters, 10Analytics-Kanban, 10Technical-blog-posts: Story idea for Blog: Migration of the Analytics Hadoop infrastructure to Apache Bigtop - https://phabricator.wikimedia.org/T277133 (10elukey) 05Open→03Resolved [08:05:41] 10Analytics-Clusters, 10Analytics-Kanban, 10Patch-For-Review: Review the Yarn Capacity scheduler and see if we can move to it - https://phabricator.wikimedia.org/T277062 (10elukey) 05Open→03Resolved [08:07:33] 10Analytics-Clusters: Enforce authentication for Druid datasources - https://phabricator.wikimedia.org/T255545 (10elukey) a:05elukey→03None [08:07:53] 10Analytics-Clusters: Enforce authentication for Kafka Jumbo Topics - https://phabricator.wikimedia.org/T255543 (10elukey) a:05elukey→03None [08:08:11] 10Analytics, 10Analytics-Kanban: Yarn NM stopping due to failures while creating native threads - https://phabricator.wikimedia.org/T281792 (10elukey) 05Open→03Resolved No re-occurrences, closing! [08:08:21] 10Analytics-Clusters, 10Patch-For-Review: Decommisison the Hadoop backup cluster and add the worker nodes to the main Hadoop cluster - https://phabricator.wikimedia.org/T274795 (10elukey) a:05elukey→03None [08:08:33] 10Analytics: Add Authentication/Encryption to Kafka Jumbo's clients - https://phabricator.wikimedia.org/T250146 (10elukey) a:05elukey→03None [08:08:54] 10Analytics, 10Cassandra: Cassandra3 migration for Analytics AQS - https://phabricator.wikimedia.org/T249755 (10elukey) a:05elukey→03None [08:10:00] 10Analytics, 10CAS-SSO, 10Patch-For-Review, 10User-Elukey: Secure Hue/Superset/Turnilo/Yarn/Piwik with CAS (and possibly 2FA) - https://phabricator.wikimedia.org/T159584 (10elukey) 05Open→03Resolved All the UIs are now behind CAS, and we opened T280691 to enforce 2FA properly. [08:10:41] 10Analytics, 10User-Elukey: Investigate Hadoop HDFS ACLs - https://phabricator.wikimedia.org/T246755 (10elukey) a:05elukey→03None [08:11:19] 10Analytics, 10Research-Backlog, 10SRE, 10WMF-Legal, 10User-Elukey: Enable layered data-access and sharing for a new form of collaboration - https://phabricator.wikimedia.org/T245833 (10elukey) [08:11:22] 10Analytics, 10User-Elukey: Investigate Hadoop HDFS ACLs - https://phabricator.wikimedia.org/T246755 (10elukey) 05Open→03Declined Declining for the moment since up to now there was no use case for them. [08:11:35] 10Analytics, 10Analytics-SWAP, 10Product-Analytics, 10User-Elukey: pip not accessible in new SWAP virtual environments - https://phabricator.wikimedia.org/T247752 (10elukey) a:05elukey→03None [08:11:59] 10Analytics-Clusters, 10Patch-For-Review: Kerberos credential cache location - https://phabricator.wikimedia.org/T255262 (10elukey) a:05elukey→03None [08:13:44] 10Analytics, 10Analytics-Kanban: Analytics Ops Technical Debt - https://phabricator.wikimedia.org/T240437 (10elukey) [08:13:53] 10Analytics-Clusters: Reduce manual kinit frequency on stat100x hosts - https://phabricator.wikimedia.org/T268985 (10elukey) a:05elukey→03None [08:14:19] 10Analytics-Clusters, 10Patch-For-Review: Kerberos credential cache location - https://phabricator.wikimedia.org/T255262 (10elukey) 05Open→03Declined For a lot of reasons, this was more complicated than expected, and a lot of clients had problems with it. We solved the main issue that brought us to this, n... [08:14:21] 10Analytics: Add authentication and encryption to Druid Analytics clients - https://phabricator.wikimedia.org/T250484 (10elukey) a:05elukey→03None [08:19:41] 10Analytics-Radar, 10SRE, 10ops-eqiad: Try to move some new analytics worker nodes to different racks - https://phabricator.wikimedia.org/T276239 (10elukey) Thanks! Remaining step is to move an-worker1139 to A7, pending https://phabricator.wikimedia.org/T280203 [08:21:07] 10Analytics-Clusters, 10Patch-For-Review: Decommisison the Hadoop backup cluster and add the worker nodes to the main Hadoop cluster - https://phabricator.wikimedia.org/T274795 (10elukey) [08:21:21] ahem I did some cleanup, sorry for the spam :D [08:21:24] 10Analytics-Clusters, 10Analytics-Kanban, 10Patch-For-Review: Add 6 worker nodes to the HDFS Namenode config of the Analytics Hadoop cluster - https://phabricator.wikimedia.org/T275767 (10elukey) 05Stalled→03Open @razzi @Ottomata this task can move on in theory, the DCops team moved an-worker1029 to a di... [08:56:06] 10Analytics-Clusters, 10User-MoritzMuehlenhoff: Reduce manual kinit frequency on stat100x hosts - https://phabricator.wikimedia.org/T268985 (10MoritzMuehlenhoff) [09:24:44] hey joal - I'm kinda working on non-analytics stuff atm, but do you need anything from me on next steps for the new AQS cluster or are we just going to move to the spark connector as a next steP? [09:31:36] Hi hnowlan - I have not made progress on the issue - I might find some time to do more investigations but not now, so the plan is to wait for Dan [09:32:08] ack, sounds good! [11:28:24] 10Analytics-Clusters, 10Analytics-Kanban, 10DBA, 10Patch-For-Review: dbstore1004 85% disk space used. - https://phabricator.wikimedia.org/T283125 (10Marostegui) @razzi do you have an ETA on when do you will resume this work? Thanks! (host is 87% now) [11:40:38] cervisiarius: Hi - For question 4) from yesterday: https://wikitech.wikimedia.org/wiki/Analytics/Systems/Anaconda#R_supp [12:34:24] 10Analytics, 10Analytics-Kanban: Requesting Kerberos password for bumeh-ctr - https://phabricator.wikimedia.org/T283710 (10Ottomata) 05Open→03Resolved Kerberos added in {T283648} [12:38:06] 10Analytics, 10Analytics-SWAP, 10Product-Analytics, 10User-Elukey: pip not accessible in new SWAP virtual environments - https://phabricator.wikimedia.org/T247752 (10Ottomata) 05Open→03Resolved a:03Ottomata A lot has changed since this was filed, going to resolve. If this is still a problem please r... [12:39:54] 10Analytics-Radar, 10SRE, 10ops-eqiad: Try to move some new analytics worker nodes to different racks - https://phabricator.wikimedia.org/T276239 (10Ottomata) @elukey @Cmjohnson to plan our work for T275767, do we have an ETA for the move of an-worker1139 to A7? [13:11:38] 10Analytics-Radar, 10SRE, 10ops-eqiad: Try to move some new analytics worker nodes to different racks - https://phabricator.wikimedia.org/T276239 (10elukey) @Ottomata it depends on T280203, but I think that we can move 5 out of 6 nodes right now and then wait the last one when A7 will be freed by old nodes :) [13:12:44] 10Analytics-Radar, 10SRE, 10ops-eqiad: Try to move some new analytics worker nodes to different racks - https://phabricator.wikimedia.org/T276239 (10Ottomata) Right, but if that A7 move will happen in the next couple of weeks, we might just wait. If it will happen in many months from now, then I agree let's... [13:13:36] ottomata: o/ [13:13:48] I think that it may take a bit before service ops decom all those ndoes [13:14:35] elukey: aye makes sense, which is why I was asking :) so ...probably more than a couplel of weeks eh? [13:23:44] elukey: am thinking about airflow web auth got a sec? [13:23:55] looks like no good CAS authentication built in [13:23:59] there is LDAP [13:24:09] but, we don't really need per user authentication for now [13:24:29] perhaps, we can just use CAS auth somehow, and then always log in as the service user? [13:24:40] or make enable 'public' access and give it admin? [13:25:19] i guess that's not great either way, because any CAS authenticated user could sign into and manage anyone's airflow instance [13:26:05] (going to read in a bit, meeting sorry) [13:26:16] np! [13:27:14] hi allll! [13:27:23] helllo mforns ! [13:27:34] :] [13:27:52] mforns: FYI airflow-analytics is running on an-test-coord1001 [13:27:52] :) [13:28:02] uouououooooo! [13:28:05] thinnking of making the dags folder be /srv/deployment/analytics/refinery/dags [13:28:41] hm... not /srv/deployment/analytics/refinery/airflow/dags ? [13:29:27] I believe there are other things that relate to airflow that are not dags no? like plugins? Don't remember exactly... It's where you define your operators [13:29:45] mforns: sure [13:29:53] that's good! [13:29:59] was just meaning in refinery [13:30:28] oh, ok! yes, I that makes sense to me [13:36:01] 10Analytics, 10Analytics-Wikistats, 10Voice & Tone, 10good first task: Wikistats Bug - easy to understand language for pageviews - https://phabricator.wikimedia.org/T263973 (10Aklapper) [13:37:40] 10Analytics, 10Analytics-Kanban, 10WMDE-TechWish: Deployment access request for some analytics repos - https://phabricator.wikimedia.org/T274880 (10mforns) Awesome, thanks @awight! [13:41:41] a-team, anyone available for a quick brainbounce on a detail of the deletion script? [13:42:21] sure mforns [13:42:33] :] thanks joal, batcave? [13:42:35] yu [13:43:16] (03PS1) 10Ottomata: Add airflow/dags/hello_world.py [analytics/refinery] - 10https://gerrit.wikimedia.org/r/697600 (https://phabricator.wikimedia.org/T272973) [13:44:44] (03CR) 10Ottomata: [V: 03+2 C: 03+2] Add airflow/dags/hello_world.py [analytics/refinery] - 10https://gerrit.wikimedia.org/r/697600 (https://phabricator.wikimedia.org/T272973) (owner: 10Ottomata) [13:53:25] ottomata: if we do separate stacks for users I'd start with a simple ssh tunnel, leaving the UI unauthenticated (only for people in localhost basically) [13:57:22] then we can refine later on (my 2c, it seems easier to start with than full CAS auth etc..) [14:03:16] gone for kids [14:18:48] elukey: right, but i think i have to create a user then [14:18:51] agree it is easier [14:18:59] but that means we have to distribute a pass to those users [14:19:07] or hm, maybe i can make the public access admin [14:20:44] yeah exactly [14:20:53] like the search people do IIRC [14:21:21] they don't have any user/pass in front of the webserver, only available in localhost [14:42:49] elukey: hi! :] one question, please: some deletion jobs scheduled in data_purge.pp have a systemd timer interval like '*-*-* 00/04:15:00'. I checked and what this does is execute the script every day at: 04:15, 08:15, 12:15, 16:15 and 20:15. Is that expected or should it be '*-*-* 04:15:00' just to run it once? [14:43:53] 10Analytics-Radar: Reportupdater output can be corrupted by hive logging - https://phabricator.wikimedia.org/T275757 (10awight) @elukey I'm seeing this in reportupdater logs, probably a bad sign: > Jun 1 06:29:17 an-launcher1002 reportupdater-codemirror[20213]: log4j:ERROR No output stream or file set for the... [14:44:17] mforns: o/ I don't recall the timers but maybe we wanted to run them every 4h? [14:44:49] elukey: aha, that would make sense, but then why the 15? [14:45:31] oh, to not run simultaneously with other scripts! [14:46:03] joal: I didn't 100% follow last week but I thought you all deployed and restarted the cassandra jobs, but I just saw monthly uniques failed. Lemme know if that's intended or if I should look into it [14:46:23] hi milimetric :] [14:46:27] hi :) [14:48:20] 10Analytics: Reportupdater SQL jobs failing with Python error - https://phabricator.wikimedia.org/T284074 (10awight) [14:48:34] mforns: yeah I think it was to avoid timers running every 4hrs to run at the same time [14:48:49] elukey: thanks, makes sense [14:50:51] milimetric: do you know if the (empty) directories in hdfs:///wmf/data/raw/webrequest/ other than webrequest_upload and webrquest_text (i.e. webrequest_bits or webrequest_mobile) are to have data in the future? [14:51:55] mforns: I have no idea... and I can't remember now if those were old sources that we moved away from, but I do remember there was a lot more than just text/upload when I started. Maybe those are the old ones and they're left after we deleted all their subfolders. [14:52:41] milimetric: makes sense, not critical really, just trying to parametrize correctly the deletion script [14:54:36] mforns: yeah, I think any folders that are needed in the future are usually created right before those jobs are launched. But I could see how maybe if you deploy and create a folder like that for a monthly job (or even yearly) they could stay empty for a while. [14:55:04] aha [15:07:24] 10Analytics, 10Analytics-Kanban, 10Product-Analytics: Request to delete test_gsc_* datasets from Druid (& Superset/Turnilo) - https://phabricator.wikimedia.org/T283536 (10mpopov) Thank you @JAllemandou! [15:09:08] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review: Generalize the current Airflow puppet/scap code to deploy a dedicated Analytics instance - https://phabricator.wikimedia.org/T272973 (10Ottomata) a:05razzi→03Ottomata [15:22:18] a-team: I don't see anything in the train etherpad, so parking the train for now. I'm happy to deploy later this week if stuff comes up [15:29:48] elukey: o/ just found https://gerrit.wikimedia.org/r/c/operations/puppet/+/554354 as an answer to my q to manuel here: https://phabricator.wikimedia.org/T272973#7119427 [15:29:56] however, he says we should probably set that on the db1108 back up replica too! [15:30:41] but, it looks like all the multi instance replicas use the same mysql .cfg file? [15:31:07] Can I ask a special 1-off request, to copy the reportupdater output file for the codemirror job over to my homedir on stat1004? I'm trying to debug T284074 and running out of ideas. [15:31:07] T284074: Reportupdater SQL jobs failing with Python error - https://phabricator.wikimedia.org/T284074 [15:32:07] ottomata: ah interesting didn't know it, but we can change the db1108 config [15:32:23] there should be a way to pass a different config template [15:33:27] OH yes actually there is custom conf [15:33:31] ok sorry, there is a default base [15:33:36] but i thikn we can enable it for the one instance [15:33:37] looking [15:36:46] (03CR) 10Mholloway: "Perhaps this change merits a minor-version bump? Otherwise this LGTM." [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/696584 (https://phabricator.wikimedia.org/T278942) (owner: 10Neil P. Quinn-WMF) [15:38:06] ottomata: speaking of db1108, we should rebuild the analytics instance with ROW replication [15:38:12] (there is a task about it) [15:38:29] aye [15:38:31] we can probably just shutdown, copy from an-coord1002, and restart [15:38:56] I am not going to interfere with the team but use me as resource in case needed :D [15:39:36] (I can work as analytics/de minion on demand :) [15:40:59] 10Analytics: Kerberos identity for jdl - https://phabricator.wikimedia.org/T284081 (10jlinehan) [16:03:04] milimetric: standup? [16:06:59] 10Analytics, 10Analytics-Kanban, 10WMDE-Analytics-Engineering, 10WMDE-New-Editors-Banner-Campaigns: Drop old WMDEBanner events from Hive - https://phabricator.wikimedia.org/T281300 (10Ottomata) 05Open→03Resolved [16:07:07] 10Analytics, 10Analytics-Kanban, 10Event-Platform, 10Patch-For-Review: produce_canary_events job should not fail if a schema is missing examples - https://phabricator.wikimedia.org/T270138 (10Ottomata) 05Open→03Resolved [16:07:49] 10Analytics, 10Analytics-Kanban, 10Product-Analytics: Request to delete test_gsc_* datasets from Druid (& Superset/Turnilo) - https://phabricator.wikimedia.org/T283536 (10JAllemandou) 05Open→03Resolved [16:08:19] 10Analytics: Reportupdater SQL jobs failing with Python error - https://phabricator.wikimedia.org/T284074 (10awight) For `row[0]` to be `None`, I think there would have to be corrupted data either coming from the query, or in the output file already. The only way I was able to reproduce a matching error was to... [16:08:34] 10Analytics-Kanban: Request for Kerberos password for kzimmerman - https://phabricator.wikimedia.org/T283386 (10Ottomata) 05Open→03Resolved [16:26:05] ah ottomata I found out the other day that bigtop provides a 'hive-jdbc' deb package (not in our filter list of course) that is very handy for our mysql-connector issue [16:26:38] we should test it, if it works (and I think it does) we could just remove the forward port to wikimedia-buster + the symlink for hive [16:26:56] (oozie might need the forward port too but we'll deprecate it soon :D) [16:27:06] oh! [16:27:08] cool FYI ragesoss ^ [16:27:08] oops [16:27:12] razzi: ^ [16:27:18] (sorry for accidental ping rage ross) [16:27:34] (np. hi!) [16:27:53] I can open a task for it, I think that we should just test it on hadoop test [16:27:58] and see how it goes [16:51:47] (03CR) 10Neil P. Quinn-WMF: [C: 03+2] "> Patch Set 1:" [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/696584 (https://phabricator.wikimedia.org/T278942) (owner: 10Neil P. Quinn-WMF) [16:52:55] (03Merged) 10jenkins-bot: Allow anonymous users in ContentTranslation schema [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/696584 (https://phabricator.wikimedia.org/T278942) (owner: 10Neil P. Quinn-WMF) [17:04:46] a-team FYI airflow-analytics-test is up and running in test cluster [17:04:47] https://wikitech.wikimedia.org/wiki/Analytics/Systems/Airflow#analytics-test [17:04:56] would love help actually testing things like hdfs, hive, spark, etc. [17:06:39] ottomata: there is a failed unit on the test coord (cleanup logs) [17:06:48] looking [17:07:15] there is also a node manager in unhealthy state since days ago [17:07:29] razzi: --^ [17:07:44] hm ok I'll look into that elukey [17:07:52] ack :) [17:09:35] elukey: i just reset failed and i think its gone [17:09:42] i had ensured absent one and then created a new one via puppet [17:09:48] super [17:09:57] i wonder if ensure => absent on a timer requires manual intervention to reset-failed? [17:11:59] it may require one in theory if the unit is already failed [17:12:10] (I think it stays failed even if you remove stuff) [17:12:50] ahh yes ok it is failing, even the new one [17:12:50] cool [17:13:26] will fix [17:14:46] super nice to see airflow running in test! [17:16:32] https://phabricator.wikimedia.org/T283856 is interesting (brought up in the #search chan) [17:39:01] 10Analytics: Kerberos identity for phuedx - https://phabricator.wikimedia.org/T284096 (10phuedx) [17:51:28] (03CR) 10Jdlrobson: [C: 04-1] universalLanguageSelector: Add skin and skinVersion properties (031 comment) [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/695350 (owner: 10Phuedx) [18:12:15] milimetric: heya- do you wish to talk about gobblin before I leave, or tomorrow? [18:12:50] joal: oops, sorry forgot, yes, in 1 min [18:13:45] omw cave [18:35:10] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review: Generalize the current Airflow puppet/scap code to deploy a dedicated Analytics instance - https://phabricator.wikimedia.org/T272973 (10Ottomata) FYI {T283856} is a bug we will likely encounter in Airflow 2, whatever fix happens there should be applied her... [18:35:43] thanks luca! [18:36:05] razzi: o/ could you create an-airflow1002 ganeti sometime soon? [18:36:37] ottomata: sure thing, let me get that started now [18:36:42] oooo thank yoU! [18:47:41] also razzi looking for review of https://gerrit.wikimedia.org/r/c/operations/debs/airflow/+/693222, we can go over together if you like [18:48:37] ottomata: for sure, let's go over that this afternoon [18:48:43] ok [18:48:53] for the vm creation form, it's asking for "Cloud VPS Project Tested", have you been using cloud vps? [18:49:03] maybe we can do the puppet module too, if you haven't seen it yet (already merged because luca reviewed) [18:49:07] (03PS2) 10Phuedx: universalLanguageSelector: Add skin and skinVersion properties [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/695350 [18:49:13] hm, yes at first sure [18:49:15] analytics project [18:49:33] yeah yeah [18:52:26] (03CR) 10Jdlrobson: [C: 03+2] universalLanguageSelector: Add skin and skinVersion properties [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/695350 (owner: 10Phuedx) [18:53:18] (03Merged) 10jenkins-bot: universalLanguageSelector: Add skin and skinVersion properties [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/695350 (owner: 10Phuedx) [18:58:34] 10Analytics, 10Better Use Of Data, 10Metrics-Platform, 10Performance-Team, and 3 others: Switch mw.user.sessionId back to session-cookie persistence - https://phabricator.wikimedia.org/T223931 (10kzimmerman) @DAbad @jlinehan this came across my team's radar again as we were going through our backlog, and... [19:05:12] ottomata: does https://phabricator.wikimedia.org/T284104 look good for the an-airflow1002 vm? I think we talked about 16gb memory at some point; an-airflow1001 has 8gb and room to spare [19:05:43] razzi: i forget, can we increase later? [19:06:02] ottomata: I don't think so, but we can recreate [19:06:23] hmmmmm actually... why aren't we just doing this on an-launcher1002? [19:06:25] ping elukey ^ ? [19:07:18] for other teams, a VM would make sense...perhaps for us an-launcher1002 will do just fine? [19:10:28] I could see an-launcher1002 working for us [19:21:40] 10Analytics-Radar, 10SRE, 10ops-eqiad: Try to move some new analytics worker nodes to different racks - https://phabricator.wikimedia.org/T276239 (10Cmjohnson) @Ottomata I cannot say for sure, I am getting new MW servers online. That will allow the current MW servers in A7 to be decomm'd and removed. I thin... [19:25:27] 10Analytics-Clusters, 10Analytics-Kanban, 10DBA, 10Patch-For-Review: dbstore1004 85% disk space used. - https://phabricator.wikimedia.org/T283125 (10razzi) @Marostegui I'll reimage db1183 today, should be set for you to work on it tomorrow. [19:38:00] razzi: i think it makes more sense to use an-launcher1002, sorry for the false-request. i asked before thikning about it [19:38:06] i'll comment and close the task you just made [20:04:57] razzi: am in bc whenever you ready [20:58:28] 10Quarry, 10Cloud-Services: Quarry links to IRC are broken - https://phabricator.wikimedia.org/T283773 (10Aklapper) [21:06:09] (03PS1) 10Aklapper: Error pages: Update IRC links from Freenode to Libera Chat [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/697665 (https://phabricator.wikimedia.org/T283773) [22:09:03] 10Analytics, 10Analytics-Kanban, 10Product-Analytics, 10SRE, and 2 others: Requesting access to analytics-privatedata-users for schoenbaechler - https://phabricator.wikimedia.org/T283190 (10colewhite) a:05Marostegui→03schoenbaechler [22:09:31] 10Analytics, 10SRE, 10SRE-Access-Requests: Requesting access to production analytics data and cluster for htriedman - https://phabricator.wikimedia.org/T283368 (10colewhite) [22:29:20] 10Analytics, 10SRE, 10SRE-Access-Requests: Requesting access to SUPERSET for CMADEO - https://phabricator.wikimedia.org/T284109 (10colewhite) [22:34:15] 10Analytics, 10SRE, 10SRE-Access-Requests, 10Patch-For-Review: Requesting access to SUPERSET for CMADEO - https://phabricator.wikimedia.org/T284109 (10colewhite) p:05Triage→03Medium a:03colewhite Hi @cmadeo! We'll need a note of approval from your manager and @Ottomata for inclusion to analytics-pri... [22:38:32] (03CR) 10Ladsgroup: [C: 03+2] Error pages: Update IRC links from Freenode to Libera Chat [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/697665 (https://phabricator.wikimedia.org/T283773) (owner: 10Aklapper) [22:41:11] (03Merged) 10jenkins-bot: Error pages: Update IRC links from Freenode to Libera Chat [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/697665 (https://phabricator.wikimedia.org/T283773) (owner: 10Aklapper) [22:43:13] 10Quarry, 10Cloud-Services, 10Patch-For-Review: Quarry links to IRC are broken - https://phabricator.wikimedia.org/T283773 (10Ladsgroup) I don't have rights to deploy. Probably people in WMCS would have it. [22:52:03] 10Quarry, 10Cloud-Services, 10Patch-For-Review: Quarry links to IRC are broken - https://phabricator.wikimedia.org/T283773 (10Aklapper) a:03Aklapper (Thanks for the merge!) [22:55:46] 10Analytics, 10LDAP-Access-Requests, 10SRE, 10Patch-For-Review: Grant Access to Superset/Turnilo for Kgordon - https://phabricator.wikimedia.org/T283057 (10colewhite) [22:56:52] 10Analytics, 10LDAP-Access-Requests, 10SRE, 10Patch-For-Review: Grant Access to Superset/Turnilo for Kgordon - https://phabricator.wikimedia.org/T283057 (10colewhite) Hi @Kgordon! We just need approval from @Ottomata for Turnilo/Superset (https://wikitech.wikimedia.org/wiki/Analytics/Data_access#Dashboar... [23:13:41] (03PS1) 10GoranSMilovanovic: T277564 [analytics/wmde/WD/WikidataAnalytics] - 10https://gerrit.wikimedia.org/r/697686 [23:13:56] (03CR) 10GoranSMilovanovic: [V: 03+2 C: 03+2] T277564 [analytics/wmde/WD/WikidataAnalytics] - 10https://gerrit.wikimedia.org/r/697686 (owner: 10GoranSMilovanovic) [23:40:09] 10Analytics-Radar, 10Article-Recommendation: Generate article recommendations in Hadoop for use in production - https://phabricator.wikimedia.org/T210844 (10Aklapper) @bmansurov: Could you please answer the last comment? Thanks in advance! [23:41:48] (03PS1) 10GoranSMilovanovic: T282668 [analytics/wmde/WD/WikidataAnalytics] - 10https://gerrit.wikimedia.org/r/697690 [23:41:57] (03CR) 10GoranSMilovanovic: [V: 03+2 C: 03+2] T282668 [analytics/wmde/WD/WikidataAnalytics] - 10https://gerrit.wikimedia.org/r/697690 (owner: 10GoranSMilovanovic)