[00:10:26] RECOVERY - Check unit status of drop_event on an-launcher1002 is OK: OK: Status of the systemd unit drop_event https://wikitech.wikimedia.org/wiki/Analytics/Systems/Managing_systemd_timers [01:32:24] PROBLEM - Check unit status of drop_event on an-launcher1002 is CRITICAL: CRITICAL: Status of the systemd unit drop_event https://wikitech.wikimedia.org/wiki/Analytics/Systems/Managing_systemd_timers [02:00:24] RECOVERY - Check unit status of drop-anomaly-detection on an-launcher1002 is OK: OK: Status of the systemd unit drop-anomaly-detection https://wikitech.wikimedia.org/wiki/Analytics/Systems/Managing_systemd_timers [02:14:18] PROBLEM - Check unit status of drop-anomaly-detection on an-launcher1002 is CRITICAL: CRITICAL: Status of the systemd unit drop-anomaly-detection https://wikitech.wikimedia.org/wiki/Analytics/Systems/Managing_systemd_timers [07:42:28] 10Data-Engineering, 10Data-Engineering-Operations, 10SRE, 10SRE-Access-Requests: Access request to analytics system(s) for TThoabala - https://phabricator.wikimedia.org/T315409 (10Jelto) @TThoabala access was granted. Can you please verify that you have access to the requested data/notebook? [07:51:52] 10Data-Engineering: Fix `refinery-drop-older-than` script for end-of-month/end-of-year - https://phabricator.wikimedia.org/T316746 (10JAllemandou) [07:58:42] 10Data-Engineering, 10Research, 10Epic: Add more languages to Wikipedia Clickstream - https://phabricator.wikimedia.org/T289532 (10JAllemandou) Thanks for the ping @Isaac :) Let's add that to @EChetty 's radar and see how we can prioritize. [11:53:30] 10Analytics-Kanban, 10Data-Engineering, 10Pageviews-Anomaly: Article on Carles Puigdemont has inflated pageviews in many projects - https://phabricator.wikimedia.org/T263908 (10Aklapper) [11:56:33] 10Analytics: Requesting Kerberos access for alinebruenger and siko - https://phabricator.wikimedia.org/T316766 (10Aline_Bruenger_WMDE) [11:57:02] 10Analytics-Kanban, 10Data-Engineering, 10Pageviews-Anomaly: Article on Carles Puigdemont has inflated pageviews in many projects - https://phabricator.wikimedia.org/T263908 (10OwenBlacker) @JArguello-WMF : Any chance of an update sometime soon, please? Even an update as simple as “This is on our backlog at... [12:45:46] 10Analytics, 10Analytics-Kanban, 10WikimediaMessages, 10MW-1.35-notes (1.35.0-wmf.20; 2020-02-18): Change link in wikis footer so that they point to stats.wikimedia.org - https://phabricator.wikimedia.org/T244961 (10Aklapper) [12:46:07] 10Analytics, 10Analytics-Kanban, 10WikimediaMessages, 10MW-1.35-notes (1.35.0-wmf.20; 2020-02-18): Change link in wikis footer so that they point to stats.wikimedia.org - https://phabricator.wikimedia.org/T244961 (10Aklapper) [12:46:26] 10Analytics-Wikistats, 10Data-Engineering, 10Tracking-Neverending: Increase WikiStats reports discoverability - https://phabricator.wikimedia.org/T67991 (10Aklapper) 05Open→03Resolved No open subtasks left; resolving. [12:50:15] 10Analytics-Kanban, 10Data-Engineering, 10Pageviews-Anomaly: Article on Carles Puigdemont has inflated pageviews in many projects - https://phabricator.wikimedia.org/T263908 (10Pelajanela) I started a Google doc with pageviews data and stats from more than 20 WP language versions that you can access [[ https... [13:08:48] (03PS1) 10Joal: Update cassandra hql loading file [analytics/refinery] - 10https://gerrit.wikimedia.org/r/828518 (https://phabricator.wikimedia.org/T311507) [13:35:48] 10Analytics-Kanban, 10Data-Engineering, 10Pageviews-Anomaly: Article on Carles Puigdemont has inflated pageviews in many projects - https://phabricator.wikimedia.org/T263908 (10OwenBlacker) Thank you @Pelajanela; I have added screenshots for cywiki (Welsh) [13:40:16] 10Analytics-Kanban, 10Data-Engineering, 10Pageviews-Anomaly: Article on Carles Puigdemont has inflated pageviews in many projects - https://phabricator.wikimedia.org/T263908 (10Pelajanela) >>! In T263908#8202507, @OwenBlacker wrote: > Thank you @Pelajanela; I have added screenshots for cywiki (Welsh) Thank... [14:05:59] 10Quarry, 10Patch-For-Review: "Download data -> Excel XLSX" corrupted: Cut off after invalid character - https://phabricator.wikimedia.org/T314706 (10rook) 05Open→03Resolved [14:20:00] heya joal :] thanks for looking at https://phabricator.wikimedia.org/T316592 can we pair today? [14:26:40] DE folks, I would like to start moving workloads off of the labstore100[67] servers and onto clouddumps100[12]. Unfortunately all I know about your analytics uses cases for dumps is that there are some... can I get a consult from someone who knows more? [14:58:28] Hi andrewbogott - I probably can help - Can we setup some time tomorrow maybe? [15:00:25] Hi mforns - let's pair on deleting the old data later? [15:03:20] Ah! actually I just see you've deleted that [15:03:22] sorry mforns [15:03:35] No problemo! joal :] [15:04:03] Maybe we don't need to pair, it's pretty mechanic and (hopefully) safe [15:04:17] works for me mforns - thank you for doing that [15:04:45] joal: sure! I think my calendar is fairly accurate. I'm going to the monthly staff meeting and I'm busy the hour before. [15:07:39] Invite sent andrewbogott - let me know if it doesn't fit [15:08:12] (VarnishkafkaNoMessages) firing: varnishkafka on cp6016 is not sending enough cache_text requests - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka - https://grafana.wikimedia.org/d/000000253/varnishkafka?orgId=1&var-datasource=drmrs%20prometheus/ops&var-cp_cluster=cache_text&var-instance=cp6016%3A9132&viewPanel=14 - https://alerts.wikimedia.org/?q=alertname%3DVarnishkafkaNoMessages [15:12:19] joal: lgtm! [15:13:12] (VarnishkafkaNoMessages) resolved: varnishkafka on cp6016 is not sending enough cache_text requests - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka - https://grafana.wikimedia.org/d/000000253/varnishkafka?orgId=1&var-datasource=drmrs%20prometheus/ops&var-cp_cluster=cache_text&var-instance=cp6016%3A9132&viewPanel=14 - https://alerts.wikimedia.org/?q=alertname%3DVarnishkafkaNoMessages [15:22:42] (03PS1) 10Nmaphophe: Fix Array UDFs [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/828566 [15:27:43] (03CR) 10CI reject: [V: 04-1] Fix Array UDFs [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/828566 (owner: 10Nmaphophe) [16:46:19] RECOVERY - Check unit status of drop-features-actor-hourly on an-launcher1002 is OK: OK: Status of the systemd unit drop-features-actor-hourly https://wikitech.wikimedia.org/wiki/Analytics/Systems/Managing_systemd_timers [16:52:47] RECOVERY - Check unit status of refinery-drop-pageview-actor-hourly-partitions on an-launcher1002 is OK: OK: Status of the systemd unit refinery-drop-pageview-actor-hourly-partitions https://wikitech.wikimedia.org/wiki/Analytics/Systems/Managing_systemd_timers [17:13:24] 10Data-Engineering, 10Foundational Technology Requests, 10Product-Analytics: "Source of truth" dataset for pageviews - https://phabricator.wikimedia.org/T310732 (10Mayakp.wiki) Discussed during our 1:1. We have a couple of approaches in mind - - In favor of providing a warning, on datahub or Wikitech. - Hiv... [17:34:09] (03PS2) 10Nmaphophe: Fix Array UDFs [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/828566 [18:23:14] (03PS3) 10Nmaphophe: Fix Array UDFs [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/828566 [19:41:00] 10Data-Engineering, 10Research, 10Epic: Add more languages to Wikipedia Clickstream - https://phabricator.wikimedia.org/T289532 (10Isaac) Thanks @JAllemandou ! > Let's add that to @EChetty 's radar and see how we can prioritize. @EChetty if there's anything I can do to help understand the value of this work... [19:51:44] (03PS1) 10CDanis: Add requestctl sub-field to turnilo webrequest [analytics/refinery] - 10https://gerrit.wikimedia.org/r/828633 (https://phabricator.wikimedia.org/T314578) [19:53:18] 10Data-Engineering, 10Patch-For-Review: Add the requestctl element of the x-analytics map to turnlio's webrequest_sampled_128 - https://phabricator.wikimedia.org/T314578 (10CDanis) I've written a patch, which is hopefully correct. Once merged, would it be possible to re-run the past few weeks of webrequest to... [20:17:50] RECOVERY - Check unit status of refinery-drop-eventlogging-legacy-raw-partitions on an-launcher1002 is OK: OK: Status of the systemd unit refinery-drop-eventlogging-legacy-raw-partitions https://wikitech.wikimedia.org/wiki/Analytics/Systems/Managing_systemd_timers [20:38:12] RECOVERY - Check unit status of refinery-drop-raw-netflow-event on an-launcher1002 is OK: OK: Status of the systemd unit refinery-drop-raw-netflow-event https://wikitech.wikimedia.org/wiki/Analytics/Systems/Managing_systemd_timers [20:45:15] joal: mind if I move that meeting a half hour later? [20:50:39] RECOVERY - Check unit status of refinery-drop-webrequest-refined-partitions on an-launcher1002 is OK: OK: Status of the systemd unit refinery-drop-webrequest-refined-partitions https://wikitech.wikimedia.org/wiki/Analytics/Systems/Managing_systemd_timers [20:50:39] RECOVERY - Check unit status of drop-predictions-actor_label-hourly on an-launcher1002 is OK: OK: Status of the systemd unit drop-predictions-actor_label-hourly https://wikitech.wikimedia.org/wiki/Analytics/Systems/Managing_systemd_timers [20:51:55] RECOVERY - Check unit status of drop-features-actor-rollup-hourly on an-launcher1002 is OK: OK: Status of the systemd unit drop-features-actor-rollup-hourly https://wikitech.wikimedia.org/wiki/Analytics/Systems/Managing_systemd_timers