[00:09:11] 10Analytics, 10Analytics-Kanban: Check home/HDFS leftovers of mholloway-shell - https://phabricator.wikimedia.org/T291353 (10odimitrijevic) @jlinehan @dr0ptp4kt can you please review the above and let us know if any of the data needs to be kept? [00:44:07] 10Analytics, 10Analytics-Kanban: Check home/HDFS leftovers of kaywong - https://phabricator.wikimedia.org/T291060 (10diego) @elukey I've already copied everything. Thanks for asking. [03:42:27] (03CR) 10Gergő Tisza: "I have no opinion on the patch, I just found it because gerrit mis-parsed the commit summary and that caused UI weirdness elsewhere. Sorry" [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/722964 (https://phabricator.wikimedia.org/T286000) (owner: 10Sharvaniharan) [04:30:58] 10Analytics-Radar, 10Product-Analytics (Kanban): [REQUEST] Investigate decrease in New Registered Users - https://phabricator.wikimedia.org/T289799 (10Tgr) New editors who have some amount of edits (say 10+ in total) and aren't blocked would be a good noise-free signal for human activity. I'd expect registrati... [05:05:51] PROBLEM - Hadoop NodeManager on an-worker1122 is CRITICAL: PROCS CRITICAL: 0 processes with command name java, args org.apache.hadoop.yarn.server.nodemanager.NodeManager https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Hadoop/Alerts%23Yarn_Nodemanager_process [05:31:58] RECOVERY - Hadoop NodeManager on an-worker1122 is OK: PROCS OK: 1 process with command name java, args org.apache.hadoop.yarn.server.nodemanager.NodeManager https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Hadoop/Alerts%23Yarn_Nodemanager_process [07:37:02] 10Analytics, 10Event-Platform, 10Wikibase change dispatching scripts to jobs, 10Wikimedia-JobQueue, 10Patch-For-Review: Queuing jobs is extremely slow - https://phabricator.wikimedia.org/T292048 (10dcausse) I think batching more jobs together is a good idea but in the case of cirrusSearchElasticaWrite jo... [08:14:37] 10Analytics, 10Analytics-Kanban, 10Data-Engineering: Repair and reload cassandra2 mediarequest_per_file data table - https://phabricator.wikimedia.org/T291470 (10BTullis) This final repair completed at 21:16 UTC last night. ` [2021-09-29 21:16:22,199] Repair completed successfully [2021-09-29 21:16:22,205] R... [08:18:37] 10Analytics, 10Analytics-Kanban, 10Data-Engineering: Repair and reload cassandra2 mediarequest_per_file data table - https://phabricator.wikimedia.org/T291470 (10JAllemandou) Awesome :) I assume we wish to wait for the pageview_per_article_flat data to be transferred before we snapshot/transfer this one, right? [08:30:35] 10Analytics, 10Analytics-Kanban, 10Data-Engineering: Snapshot and Reload cassandra2 pageview_per_article data table from all 12 instances - https://phabricator.wikimedia.org/T291472 (10BTullis) It has now almost completed the 11th snapshot transfer, each taking around three and a quarter hours. There is a co... [08:34:51] 10Analytics, 10Analytics-Kanban, 10Data-Engineering: Snapshot and Reload cassandra2 pageview_per_article data table from all 12 instances - https://phabricator.wikimedia.org/T291472 (10BTullis) Here is the amount of space taken up by each of the snapshots. Note again the much smaller `aqs1014:/srv/cassandra/... [08:44:50] 10Analytics, 10Analytics-Kanban, 10Data-Engineering: Snapshot and Reload cassandra2 pageview_per_article data table from all 12 instances - https://phabricator.wikimedia.org/T291472 (10BTullis) The proposed approach is to load these snapshots individually, at least to begin with, starting from the largest an... [08:46:42] 10Analytics, 10Analytics-Kanban, 10Data-Engineering: Repair and reload cassandra2 mediarequest_per_file data table - https://phabricator.wikimedia.org/T291470 (10BTullis) Yes, I think we wait until we have loaded the `pageview_per_article_flat data` snapshots from aqs1010 and aqs1011 so that we don't increas... [08:46:52] 10Analytics, 10Analytics-Kanban, 10Data-Engineering: Repair and reload cassandra2 mediarequest_per_file data table - https://phabricator.wikimedia.org/T291470 (10BTullis) [08:51:37] 10Analytics, 10Analytics-Kanban, 10Data-Engineering: Repair and reload cassandra2 mediarequest_per_file data table - https://phabricator.wikimedia.org/T291470 (10JAllemandou) Perfect! [09:02:13] btullis: heya - we have two alertd we should focus on (emails) :) [09:02:37] joal: Thanks. Checking now. [09:04:41] RefineMonitor problem report for job monitor_refine_netflow [09:04:41] Oozie: cassandra-daily-coord-local_group_default_T_mediarequest_per_file [09:04:41] But not: Data quality Azerbaijan? [09:04:52] Are those the two? [09:05:41] btullis: the data-quality ones I usually let sukhbir (security team) look at them - you chanck it nonetheless (presto dashboard), it's interesting! [09:13:51] Cool, will do. Then for the refine_netflow one I'll need to follow this kind of procedure? https://wikitech.wikimedia.org/wiki/Analytics/Systems/Refine#Rerunning_jobs [09:13:51] I'll need to launch something like: sudo -u analytics kerberos-run-command analytics /usr/local/bin/monitor_refine_netflow --ignore_errors=no --start_time='[Thu 2021-09-30 03:45:00 UTC]' --stop_time='[Thu 2021-09-30 03:45:12 UTC]' [09:15:41] Hang on, those times don't match the email. I need to emcompass 11:00 UTC [09:15:49] Yes btullis - something linke that - It's interesting that we have refine-monitor errors but no refine error :S [09:16:20] Shall we look at it in the BC? [09:16:45] yeah, let's [09:32:43] !log btullis@an-launcher1002:~$ sudo -u analytics kerberos-run-command analytics /usr/local/bin/refine_netflow --ignore_failure_flag=true --since=2021-09-28T11:00:00 --until 2021-09-28T12:00:00 [09:32:46] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [09:43:53] 10Analytics, 10Event-Platform, 10Wikibase change dispatching scripts to jobs, 10Wikimedia-JobQueue, 10Patch-For-Review: Queuing jobs is extremely slow - https://phabricator.wikimedia.org/T292048 (10Ladsgroup) >>! In T292048#7390268, @dcausse wrote: > I think batching more jobs together is a good idea but... [09:51:25] RECOVERY - Check unit status of monitor_refine_netflow on an-launcher1002 is OK: OK: Status of the systemd unit monitor_refine_netflow https://wikitech.wikimedia.org/wiki/Analytics/Systems/Managing_systemd_timers [11:07:50] (03CR) 10Michael Große: Add script to get some data out of wb_changes (031 comment) [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/723613 (https://phabricator.wikimedia.org/T291276) (owner: 10Ladsgroup) [11:11:35] PROBLEM - Check unit status of produce_canary_events on an-launcher1002 is CRITICAL: CRITICAL: Status of the systemd unit produce_canary_events https://wikitech.wikimedia.org/wiki/Analytics/Systems/Managing_systemd_timers [11:22:34] RECOVERY - Check unit status of produce_canary_events on an-launcher1002 is OK: OK: Status of the systemd unit produce_canary_events https://wikitech.wikimedia.org/wiki/Analytics/Systems/Managing_systemd_timers [11:23:03] 10Analytics-Clusters, 10Analytics-Kanban, 10Data-Engineering, 10Data-Engineering-Kanban, 10Product-Analytics: Upgrade Superset to 1.3.1 or higher - https://phabricator.wikimedia.org/T288115 (10BTullis) I've been looking into this too and I've come across something that might help, or it might be that I'm... [12:03:10] mforns: interview? [12:16:48] (03PS1) 10GoranSMilovanovic: T286277 [analytics/wmde/WD/WikidataAnalytics] - 10https://gerrit.wikimedia.org/r/724994 [12:17:46] 10Analytics-Clusters, 10Analytics-Kanban, 10Data-Engineering, 10Data-Engineering-Kanban, 10Product-Analytics: Upgrade Superset to 1.3.1 or higher - https://phabricator.wikimedia.org/T288115 (10elukey) The wheels are stored under: ` elukey@an-tool1005:~$ ls /srv/deployment/analytics/superset/deploy/artif... [12:19:24] (03CR) 10GoranSMilovanovic: [V: 03+2 C: 03+2] T286277 [analytics/wmde/WD/WikidataAnalytics] - 10https://gerrit.wikimedia.org/r/724994 (owner: 10GoranSMilovanovic) [12:25:39] 10Analytics-Clusters, 10Analytics-Kanban, 10Data-Engineering, 10Data-Engineering-Kanban, 10Product-Analytics: Upgrade Superset to 1.3.1 or higher - https://phabricator.wikimedia.org/T288115 (10BTullis) Thanks @elukey - Yes, that's where I'm looking too. What I'm searching for are the specific database d... [12:43:06] 10Analytics-Clusters, 10Analytics-Kanban, 10Data-Engineering, 10Data-Engineering-Kanban, 10Product-Analytics: Upgrade Superset to 1.3.1 or higher - https://phabricator.wikimedia.org/T288115 (10elukey) The extra `presto,mysql,druid` should only install the related dependencies, namely PyHive (for hive/pre... [13:11:00] 10Analytics, 10Event-Platform, 10Wikibase change dispatching scripts to jobs, 10Wikimedia-JobQueue, and 2 others: Queuing jobs is extremely slow - https://phabricator.wikimedia.org/T292048 (10Ottomata) EventGate's `hasty` param should only be used if you don't want acknowledgement that your events have bee... [13:18:30] 10Analytics, 10Analytics-Kanban, 10Data-Engineering, 10Data-Engineering-Kanban, 10Patch-For-Review: Test Alluxio as cache layer for Presto - https://phabricator.wikimedia.org/T266641 (10BTullis) I have instead been running the commands with: an-test-coord1001: `bash -x /usr/lib/alluxio/bin/alluxio-start... [13:20:19] 10Analytics, 10Event-Platform, 10Wikibase change dispatching scripts to jobs, 10Wikimedia-JobQueue, and 2 others: Queuing jobs is extremely slow - https://phabricator.wikimedia.org/T292048 (10dcausse) >>! In T292048#7391313, @Ottomata wrote: > EventGate's `hasty` param should only be used if you don't want... [13:21:15] 10Analytics, 10Event-Platform, 10Wikibase change dispatching scripts to jobs, 10Wikimedia-JobQueue, and 2 others: Queuing jobs is extremely slow - https://phabricator.wikimedia.org/T292048 (10Ottomata) Ah, got it. [13:44:28] 10Analytics, 10Analytics-Kanban, 10Data-Engineering, 10Data-Engineering-Kanban, 10Patch-For-Review: Test Alluxio as cache layer for Presto - https://phabricator.wikimedia.org/T266641 (10BTullis) I was able to execute the `alluxio runTests` command: ` alluxio@an-test-coord1001:/etc/alluxio/conf$ alluxio... [13:46:10] 10Analytics, 10Analytics-Kanban, 10Data-Engineering: Repair and reload all cassandra-2 data tables but the 2 big ones - https://phabricator.wikimedia.org/T291469 (10JAllemandou) [13:46:45] 10Analytics, 10Analytics-Kanban, 10Data-Engineering, 10Data-Engineering-Kanban, 10Patch-For-Review: Test Alluxio as cache layer for Presto - https://phabricator.wikimedia.org/T266641 (10BTullis) Also added the `job_master` process on the master. ` bash -x /usr/lib/alluxio/bin/alluxio-start.sh job_master... [13:46:47] 10Analytics, 10Analytics-Kanban, 10Data-Engineering: Repair and reload all cassandra-2 data tables but the 2 big ones - https://phabricator.wikimedia.org/T291469 (10JAllemandou) I checked all data of the small tables between old and new - they match :) [13:50:10] 10Analytics, 10Analytics-Kanban, 10Data-Engineering: Repair and reload all cassandra-2 data tables but the 2 big ones - https://phabricator.wikimedia.org/T291469 (10BTullis) Great! Thanks @JAllemandou . [13:53:13] 10Analytics, 10Analytics-Kanban, 10Data-Engineering: Snapshot and Reload cassandra2 pageview_per_article data table from all 12 instances - https://phabricator.wikimedia.org/T291472 (10BTullis) The transfer of all 12 snapshots has completed. I will just run the script a second time, which should be a noop an... [13:56:14] 10Analytics, 10Analytics-Kanban, 10Data-Engineering: Snapshot and Reload cassandra2 pageview_per_article data table from all 12 instances - https://phabricator.wikimedia.org/T291472 (10BTullis) Yep, that worked 24 seconds to check all 12 copies and no files transferred. Now moving on to the loading part for... [13:56:25] 10Analytics, 10Analytics-Kanban, 10Data-Engineering: Snapshot and Reload cassandra2 pageview_per_article data table from all 12 instances - https://phabricator.wikimedia.org/T291472 (10BTullis) [14:03:35] 10Analytics, 10Analytics-Kanban, 10Data-Engineering: Snapshot and Reload cassandra2 pageview_per_article data table from all 12 instances - https://phabricator.wikimedia.org/T291472 (10BTullis) Running the following script to import this snapshot: ` #!/bin/bash set -e DOMAIN='eqiad.wmnet' HOSTS=('aqs1010... [14:21:34] a-team: something is up with refinery JARs. Using `CREATE TEMPORARY FUNCTION ua as 'org.wikimedia.analytics.refinery.hive.GetUAPropertiesUDF'; USE wmf_raw;SELECT ua(cuc_agent) FROM mediawiki_private_cu_changes WHERE wiki_db = 'enwiki' LIMIT 1;` yields Exception in thread "main" java.lang.NoClassDefFoundError: org/wikimedia/analytics/refinery/core/UAParser [14:21:57] a-team: tried it with hdfs:///wmf/refinery/current/artifacts/refinery-hive.jar and /srv/deployment/analytics/refinery/artifacts/refinery-hive.jar [14:23:32] 10Analytics-Radar, 10Privacy Engineering, 10WMDE-Analytics-Engineering, 10Wikidata, 10Wikidata Analytics: Privacy Policy Review for Global South Wikidata edits and active editors datasets - https://phabricator.wikimedia.org/T291186 (10GoranSMilovanovic) @Htriedman @Manuel - Files from `/home/goransm/An... [14:28:59] bearloga: used the -shaded.jar now instead [14:29:14] https://phabricator.wikimedia.org/T217967 [14:29:43] Ah! Thank you!!! [14:29:43] actually, hm [14:29:46] Oh? [14:29:59] not sure if ther eis a refinery-hive shaded jar... [14:30:22] It worked up until like a week or two ago, so not sure what happened. [14:30:27] oh there is [14:30:36] but it is not symlinked to a non versioned file [14:30:40] we should add that probably [14:30:51] OH [14:30:52] yes there is [14:30:57] sorry i'm blind [14:30:59] /srv/deployment/analytics/refinery/artifacts/refinery-hive-shaded.jar [14:31:01] try that [14:36:30] ottomata: yup that worked, thank you! I'll update our docs to refer to -shaded [14:45:27] gr8 [14:45:29] 10Analytics, 10Data-release, 10Privacy Engineering, 10Research, 10Privacy: Apache Beam go prototype code for DP evaluation - https://phabricator.wikimedia.org/T280385 (10Htriedman) Hi everyone — I know it's been several months since this ticket has been updated, but work on implementing DP at scale in pr... [15:21:35] (03PS1) 10DLynch: EditAttemptStep: update init_timing documentation [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/725018 (https://phabricator.wikimedia.org/T290931) [15:44:40] 10Analytics, 10Analytics-Kanban, 10Data-Engineering: Snapshot and Reload cassandra2 pageview_per_article data table from all 12 instances - https://phabricator.wikimedia.org/T291472 (10BTullis) The first attempt at loading failed with an out-of-memory error. ` ----- OUTPUT of 'sstableloader -u...rticle_flat/... [16:38:07] 10Analytics-Radar, 10Privacy Engineering, 10WMDE-Analytics-Engineering, 10Wikidata, 10Wikidata Analytics: Privacy Policy Review for Global South Wikidata edits and active editors datasets - https://phabricator.wikimedia.org/T291186 (10GoranSMilovanovic) @Htriedman Please check `gs_edits_PUBLIC.csv` and... [16:53:35] (03PS1) 10GoranSMilovanovic: T291170 [analytics/wmde/WD/WikidataAdHocAnalytics] - 10https://gerrit.wikimedia.org/r/725039 [16:53:49] (03CR) 10GoranSMilovanovic: [V: 03+2 C: 03+2] T291170 [analytics/wmde/WD/WikidataAdHocAnalytics] - 10https://gerrit.wikimedia.org/r/725039 (owner: 10GoranSMilovanovic) [17:00:33] 10Analytics-Radar, 10Event-Platform: Introduce EventBusSendUpdate - https://phabricator.wikimedia.org/T292123 (10odimitrijevic) [17:02:02] 10Analytics-Radar, 10Event-Platform, 10Platform Team Workboards (MW Expedition): Decouple EventBus and EventFactory - https://phabricator.wikimedia.org/T292121 (10odimitrijevic) [17:02:57] 10Analytics-Radar, 10Privacy Engineering, 10WMDE-Analytics-Engineering, 10Wikidata, 10Wikidata Analytics: Privacy Policy Review for Global South Wikidata edits and active editors datasets - https://phabricator.wikimedia.org/T291186 (10Htriedman) @GoranSMilovanovic @Manuel Just checked the datasets that... [17:03:55] 10Analytics, 10Analytics-Kanban, 10Data-Engineering: Setup Presto UI in production - https://phabricator.wikimedia.org/T292087 (10odimitrijevic) p:05Triage→03High [17:11:54] 10Analytics-Radar, 10Privacy Engineering, 10WMDE-Analytics-Engineering, 10Wikidata, 10Wikidata Analytics: Privacy Policy Review for Global South Wikidata edits and active editors datasets - https://phabricator.wikimedia.org/T291186 (10GoranSMilovanovic) 05Open→03Resolved @Htriedman Hal, thank you ver... [17:12:23] 10Analytics-Radar, 10Data-Engineering, 10Event-Platform: Allow kafka clients to verify brokers hostnames when using SSL - https://phabricator.wikimedia.org/T291905 (10odimitrijevic) p:05Triage→03Medium [17:12:55] 10Analytics, 10Analytics-Kanban, 10Data-Engineering, 10Event-Platform, 10serviceops: Enable envoy tls proxy logging from eventgate - https://phabricator.wikimedia.org/T291856 (10odimitrijevic) p:05Triage→03High [17:13:42] 10Analytics, 10Data-Engineering, 10Event-Platform, 10Platform Engineering, 10tech-decision-forum: MediaWiki Events as Source of Truth - Decision Statement Overview - https://phabricator.wikimedia.org/T291120 (10odimitrijevic) p:05Triage→03High [17:16:05] 10Analytics-Radar, 10Data-Engineering, 10Platform Engineering, 10Wikibase change dispatching scripts to jobs, 10serviceops: Better observability/visualization for MediaWiki jobs - https://phabricator.wikimedia.org/T291620 (10odimitrijevic) [17:19:33] 10Analytics, 10Data-Engineering: Analytics-test-hadoop Spark3 package upgrade - https://phabricator.wikimedia.org/T291465 (10odimitrijevic) p:05Triage→03Medium We decided to wait for bigtop package and can proceed with testing then. [17:20:15] 10Analytics, 10Data-Engineering: Upgrade analytics-hadoop to Spark 3 + scala 2.12 - https://phabricator.wikimedia.org/T291464 (10odimitrijevic) p:05Triage→03Medium [17:21:09] 10Analytics, 10Analytics-Kanban: Standardize the stats system user uid - https://phabricator.wikimedia.org/T291384 (10odimitrijevic) p:05Triage→03High a:03Ottomata [17:35:05] elukey: how'd you learn that bigtop with spark 3 is coming out soon? [17:36:59] Oh, maybe this? https://issues.apache.org/jira/browse/BIGTOP-3471 [17:39:18] yes exactly, from the recent emails they were almost ready to cut the 3.x RC candidate, but I've seen less work over the past couple of weeks [17:39:47] aye [17:41:58] commented there asking if they had an ETA [17:41:59] ty [18:27:20] 10Analytics-Clusters, 10Analytics-Kanban, 10decommission-hardware, 10Patch-For-Review: decommission thorium.eqiad.wmnet - https://phabricator.wikimedia.org/T292075 (10ops-monitoring-bot) cookbooks.sre.hosts.decommission executed by otto@cumin1001 for hosts: `thorium.eqiad.wmnet` - thorium.eqiad.wmnet (**PA... [18:34:16] 10Analytics-Clusters, 10Analytics-Kanban, 10decommission-hardware, 10Patch-For-Review: decommission thorium.eqiad.wmnet - https://phabricator.wikimedia.org/T292075 (10Ottomata) a:05Ottomata→03Cmjohnson [18:34:22] 10Analytics-Clusters, 10Analytics-Kanban, 10decommission-hardware, 10Patch-For-Review: decommission thorium.eqiad.wmnet - https://phabricator.wikimedia.org/T292075 (10Ottomata) @Cmjohnson not sure if you are the right person to assign this to; please reassign as needed. Thanks! [18:53:21] 10Analytics-Clusters, 10decommission-hardware, 10Patch-For-Review: decommission thorium.eqiad.wmnet - https://phabricator.wikimedia.org/T292075 (10Ottomata) [19:26:13] razzi: o/ yt? [19:26:35] ottomata: yep! [19:27:05] Interview w btullis in 20 [19:27:19] oh k [19:27:25] 10Analytics, 10Analytics-Kanban, 10Data-Engineering, 10Growth-Team, and 6 others: Migrated Server-side EventLogging events recording http.client_ip as 127.0.0.1 - https://phabricator.wikimedia.org/T288853 (10Ottomata) Backport window didn't go yesterday, so I got the bugfixes out today. I'd rather wait unt... [19:27:35] i guess no time for pair eh? [19:27:56] We could pair for a minute! [19:28:09] Knock out the uid issue? [19:28:15] lets give it a go! [19:28:16] bc [19:28:21] K 1 min [19:31:17] 10Analytics, 10Analytics-Kanban: Standardize the stats system user uid - https://phabricator.wikimedia.org/T291384 (10Ottomata) stats has uid 499 on 4 hosts, and 495 and 498 on two others. Let's use 499. ` 19:30:04 [@cumin1001:/home/otto] $ sudo cumin 'R:Class = statistics::user' 'getent passwd stats' 7 host... [19:35:08] 10Analytics-Radar, 10Fundraising-Backlog, 10Product-Analytics, 10Wikipedia-iOS-App-Backlog, and 2 others: Understand impact of Apple's Relay Service - https://phabricator.wikimedia.org/T289795 (10Pelagic) > @Base: “but blocks under No open proxies policy indeed are generally for both logged in and anonymou... [19:40:55] 10Analytics-Radar, 10Fundraising-Backlog, 10Product-Analytics, 10Wikipedia-iOS-App-Backlog, and 2 others: Understand impact of Apple's Relay Service - https://phabricator.wikimedia.org/T289795 (10AntiCompositeNumber) The specific reasons for hardblocking are a bit [[https://en.wikipedia.org/wiki/Wikipedia:... [19:52:45] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review: Standardize the stats system user uid - https://phabricator.wikimedia.org/T291384 (10Ottomata) Razzi linked me to a nice change uid/gid script from Luca in https://phabricator.wikimedia.org/T231067#6851675 [19:52:52] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review: Standardize the stats system user uid - https://phabricator.wikimedia.org/T291384 (10razzi) We're gonna use the script @elukey wrote: https://phabricator.wikimedia.org/T231067#6863800 [19:54:46] !log changing stats uid and gid on an-launcher1002 and stat1005 to 499 [19:54:50] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [19:55:27] !log not changing to stats uid to 499; it already exists as a another system user [19:55:30] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [20:01:45] 10Analytics, 10Data-Engineering, 10Data-Engineering-Kanban, 10Epic: Alluxio for Improved Superset Query Performance - https://phabricator.wikimedia.org/T288252 (10wiki_willy) [20:03:02] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review: Standardize the stats system user uid - https://phabricator.wikimedia.org/T291384 (10Ottomata) Ok, holding on this for now, its late Thursday and I'm not working tomorrow; don't want to break anything. BTW, we are using uid 915, not 499 based on comment i... [21:20:19] 10Analytics, 10Analytics-EventLogging, 10QuickSurveys, 10Readers-Web-Backlog, 10WMDE-TechWish: QuickSurveys should show an error when response is blocked - https://phabricator.wikimedia.org/T256463 (10LGoto) [23:46:18] (03CR) 10Dave Pifke: [C: 03+2] Add TLS support [analytics/statsv] - 10https://gerrit.wikimedia.org/r/721044 (https://phabricator.wikimedia.org/T290131) (owner: 10Dave Pifke) [23:46:21] (03CR) 10Dave Pifke: [V: 03+2 C: 03+2] Add TLS support [analytics/statsv] - 10https://gerrit.wikimedia.org/r/721044 (https://phabricator.wikimedia.org/T290131) (owner: 10Dave Pifke)