[04:36:46] 10Analytics-Clusters, 10Analytics-Kanban, 10DBA, 10Patch-For-Review: dbstore1004 85% disk space used. - https://phabricator.wikimedia.org/T283125 (10Marostegui) 05Open→03Resolved Thanks! [05:14:04] 10Analytics, 10Analytics-Wikistats: Top edited pages list on enwiktionary contains nonexistent pages with titles made up of question marks - https://phabricator.wikimedia.org/T284623 (10TTO) [13:29:17] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10Better Use Of Data, and 4 others: Determine which remaining legacy EventLogging schemas need to be migrated or decommissioned - https://phabricator.wikimedia.org/T282131 (10Ottomata) [13:32:30] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10Better Use Of Data, and 5 others: Migrate legacy metawiki schemas to Event Platform - https://phabricator.wikimedia.org/T259163 (10Ottomata) [13:33:08] (03PS3) 10Ottomata: Add LandingPageImpression schema to analytics/legacy [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/691095 (https://phabricator.wikimedia.org/T282855) (owner: 10Awight) [13:33:34] hi teamm! [13:33:40] hello! [13:38:31] (03CR) 10Ottomata: [C: 03+2] Add LandingPageImpression schema to analytics/legacy [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/691095 (https://phabricator.wikimedia.org/T282855) (owner: 10Awight) [13:39:05] (03Merged) 10jenkins-bot: Add LandingPageImpression schema to analytics/legacy [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/691095 (https://phabricator.wikimedia.org/T282855) (owner: 10Awight) [13:43:56] 10Analytics, 10Analytics-Kanban, 10Event-Platform, 10Patch-For-Review: LandingPageImpression Event Platform Migration - https://phabricator.wikimedia.org/T282855 (10awight) [13:45:34] 10Analytics, 10Analytics-Kanban, 10Event-Platform, 10Patch-For-Review: LandingPageImpression Event Platform Migration - https://phabricator.wikimedia.org/T282855 (10awight) I've copied the checklist from the parent task. I don't have permissions to do the next steps, (4) and (5), so leaving to #analytics.... [13:50:25] ottomata: does this look OK? If so, I will add it to today's backport window https://gerrit.wikimedia.org/r/c/operations/mediawiki-config/+/698811 [13:51:44] mforns: ! i got one for you too! [13:51:44] https://gerrit.wikimedia.org/r/c/operations/mediawiki-config/+/698993 [13:52:23] LGTM, mforns i'm in there so i can do some config deploys for ya [13:52:27] and avoid window [13:52:57] your change looks good as well, ok, sounds good to me! [13:53:30] ok, let's do yours first, yours is just test wiki (the one i'm doing is only active on donatewiki i think, i'm just going to send a test event from mwdebug1001 from there) [13:53:35] if you're up to, I can prepare the deployment of WMDEBanner* to all wikis, and we can do one after the other [13:53:41] ok [13:53:54] ok, then [14:00:01] mforns: deployed that [14:00:04] testwiki [14:00:11] i'm going to do mine in between and test on mwdebug [14:00:14] ok, kafkacatting [14:01:23] generating events on testwiki [14:06:14] hahah mforns my browser is adblocking my test posts [14:06:32] !! I also can not get any event through.,.. [14:09:37] ok, I got one from WMDEBannerEvents, seems to work, testing the other ones [14:10:26] ottomata: yes, got all of them, seem fine [14:11:09] ok [14:11:10] great [14:11:16] something is wrong with mine...havne't fully deployed yet so its ok [14:11:24] prepping the next patch [14:14:13] ottomata: should I remove LandingPageImpression from 'default', then? [14:14:31] no its fine for the moment, hang on [14:14:40] k [14:16:21] OHHH DUHHHH mforns [14:16:21] haha [14:16:28] its not working because I haven't deployed the stream config [14:16:28] haha [14:16:29] ??? [14:16:36] i just pulled the patch onto mwdebug [14:16:43] aaaah :] [14:16:47] but eventgate isi getting stream config from meta [14:17:06] hm can't test like this, going to have to remove from default like you say [14:17:07] doing [14:17:10] https://gerrit.wikimedia.org/r/c/operations/mediawiki-config/+/698996 [14:17:28] oh, ottomata, should I do it in this same patch? [14:17:45] no lemme do it separately [14:20:09] interesting i can't really 'test' this on test wiki [14:20:14] or hm yes i can [14:20:18] nm yes ic an [14:20:18] ok [14:23:19] hehe [14:23:31] hm, no i can't actually... [14:23:40] errrrr [14:24:20] ah i have to now merge the default patch and pull it on mwdebug [14:24:24] then i can test on donatewiki there [14:24:38] really i just needed to deploy streamconfig first [14:24:38] aha [14:33:39] ok mforns landingpageimpression done [14:33:41] lets do yours [14:33:42] u ready? [14:33:48] ottomata: yes :] [14:34:03] k waiting for jenkins [14:35:56] ok deploying now mforns [14:36:13] ottomata: hm, those 3 schemas seem inactive... there are no events for a long time [14:37:05] ottomata: https://grafana.wikimedia.org/d/000000018/eventlogging-schema?orgId=1&var-schema=WMDEBannerEvents those are the test ones.. [14:38:05] ¯\_(ツ)_/¯ [14:38:14] ah well, great job anyway! [14:38:29] mforns: maybe its just when they run campaigns or something? [14:39:20] mforns: i'll make the puppet patch for these 4 schemas at the same time and we can merge it tomorrow [14:39:34] ottomata: ok [14:39:54] ottomata: you mean migration step 7, right? [14:40:14] yup [14:42:13] k [14:44:55] 10Analytics, 10Analytics-Kanban, 10Event-Platform, 10Patch-For-Review: LandingPageImpression Event Platform Migration - https://phabricator.wikimedia.org/T282855 (10Ottomata) [14:46:27] 10Analytics, 10Analytics-Kanban, 10Event-Platform, 10Patch-For-Review: LandingPageImpression Event Platform Migration - https://phabricator.wikimedia.org/T282855 (10Ottomata) @awight I've already done a bunch of the main migration steps, now we're just up to finalizing. I'll merge the puppet patch that d... [14:53:00] 10Analytics, 10Analytics-Kanban, 10Event-Platform, 10Patch-For-Review: LandingPageImpression Event Platform Migration - https://phabricator.wikimedia.org/T282855 (10Ottomata) a:03Ottomata [15:03:06] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10Wikimedia-Developer-Portal, 10Documentation: Clean up EventLogging Schema: pages on meta - https://phabricator.wikimedia.org/T282584 (10Ottomata) > Can I edit the Editnotice-470 page accordingly? Done. I'm going to merge this task into {T23823... [15:03:31] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10Wikimedia-Developer-Portal, 10Documentation: Clean up EventLogging Schema: pages on meta - https://phabricator.wikimedia.org/T282584 (10Ottomata) [15:03:33] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10Event-Platform, and 2 others: Decommission EventLogging backend components by migrating to MEP - https://phabricator.wikimedia.org/T238230 (10Ottomata) [15:05:02] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10Event-Platform, and 2 others: Decommission EventLogging backend components by migrating to MEP - https://phabricator.wikimedia.org/T238230 (10Ottomata) [15:05:09] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10Event-Platform, and 2 others: Decommission EventLogging backend components by migrating to MEP - https://phabricator.wikimedia.org/T238230 (10Ottomata) [15:59:27] a-team: there was nothing in the deployment-train yesterday, so I skipped the train - Anything you'd like me to dpeloy today? [15:59:40] not from me :) [16:13:47] 10Analytics, 10I18n, 10RTL: Support right-to-left languages in Wikistats - https://phabricator.wikimedia.org/T251376 (10Milimetric) :) not to toot my own horn, but for planning purposes, I do happen to be very fast at stuff like that. I could probably move off Semantic and to something like Vuetify in a wee... [16:38:23] milimetric: should we close this? https://phabricator.wikimedia.org/T274322 [16:42:48] 10Analytics-Radar, 10SRE, 10ops-eqiad: Try to move some new analytics worker nodes to different racks - https://phabricator.wikimedia.org/T276239 (10Cmjohnson) The MW are almost ready, once we can get a batch of these online, the mw servers in A7 will be able to be decommissioned [17:11:52] joal, I think your day is too full for CR deletion script, wanna do tomorrow? or now? maybe now we don't have enough time (15 mins) [17:12:13] 10Analytics, 10Event-Platform, 10Performance-Team: EditorActivation Event Platform Migration - https://phabricator.wikimedia.org/T284679 (10Ottomata) [17:12:13] now is too few I think - if ok for you tomorrow is great :) [17:12:18] mforns: --^ [17:12:32] ok, setting up for tomorrow [17:12:36] meh, tomorrow is pretty packed as well :S [17:12:50] no problem for me having it on Frida mforns - as you prefer :) [17:12:59] or tomorrow evening [17:13:13] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10Better Use Of Data, and 5 others: Migrate legacy metawiki schemas to Event Platform - https://phabricator.wikimedia.org/T259163 (10Ottomata) [17:14:24] joal: wanna do it tomorrow during grosking, if we end early, which we prob will no? [17:14:42] end of grosking [17:14:47] yessir! [17:14:54] ok, will put it in there [17:16:49] 10Analytics, 10Event-Platform, 10Performance-Team: EditorActivation Event Platform Migration - https://phabricator.wikimedia.org/T284679 (10Ottomata) @Gilles do you need client IP / geocoded data for this schema? [17:17:54] (03PS1) 10Ottomata: Add editoractivation schema to analytics/legacy [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/699051 (https://phabricator.wikimedia.org/T284679) [17:21:33] razzi: you said you were good at eslint? [17:21:43] any idea what's wrong with this? https://gerrit.wikimedia.org/r/c/699029 [17:21:49] https://integration.wikimedia.org/ci/job/mwgate-node12-docker/1341/console [17:21:57] 11:30:15 Warning: Failed to load plugin 'jsdoc' declared in '.eslintrc.json » eslint-config-wikimedia/client » ./client-es5 » ./client-common » ./common » ./jsdoc': Cannot find module 'eslint-plugin-jsdoc' [17:23:19] ottomata: yes, my bad, I thought we were bulk-closing stuff in the done column, I'll close it now [17:23:37] milimetric: i think we aren't doing that anymore, self closing after discussed in standup [17:23:38] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review: Clean up issues with jobs after Hadoop Upgrade - https://phabricator.wikimedia.org/T274322 (10Milimetric) 05Open→03Resolved [17:23:41] 10Analytics, 10Patch-For-Review: Upgrade the Analytics Hadoop cluster to Apache Bigtop - https://phabricator.wikimedia.org/T273711 (10Milimetric) [17:23:53] k, [17:23:53] 10Analytics, 10Analytics-Kanban, 10Packaging: Create a debian package for Apache Airflow - https://phabricator.wikimedia.org/T277012 (10Ottomata) 05Open→03Resolved [17:23:56] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review: Generalize the current Airflow puppet/scap code to deploy a dedicated Analytics instance - https://phabricator.wikimedia.org/T272973 (10Ottomata) [17:24:01] 10Analytics, 10Analytics-Kanban: Failures registered by drop_event on an-launcher1002 - https://phabricator.wikimedia.org/T283126 (10Ottomata) 05Open→03Resolved [17:28:05] ok a-team, no ask to dpeloy anything, train is declared cancelled this week [17:28:34] choo choo... oohc oohc [17:28:41] xDDD [17:59:14] mforns: looks like a corrupt record for WMDEBannerEvents! uh oh [17:59:25] oh man... [17:59:28] got meetings.... wwill help with that asap [17:59:35] same meeting for me [17:59:36] the data is making it into raw [17:59:41] hm [17:59:41] yeah and i have one after that too [17:59:42] :/ [21:39:42] 10Analytics, 10Patch-For-Review, 10User-razzi: hdfs dfsadmin saveNamespace fails on an-master1001 - https://phabricator.wikimedia.org/T283733 (10razzi)