[06:34:13] PROBLEM - Check unit status of produce_canary_events on an-launcher1002 is CRITICAL: CRITICAL: Status of the systemd unit produce_canary_events https://wikitech.wikimedia.org/wiki/Analytics/Systems/Managing_systemd_timers [06:45:03] RECOVERY - Check unit status of produce_canary_events on an-launcher1002 is OK: OK: Status of the systemd unit produce_canary_events https://wikitech.wikimedia.org/wiki/Analytics/Systems/Managing_systemd_timers [09:09:26] 10Data-Engineering, 10DBA, 10Infrastructure-Foundations, 10Puppet: Split mariadb::dbstore_multiinstance into 2 separate roles (backup sources and analytics) - https://phabricator.wikimedia.org/T296285 (10Marostegui) a:03jcrespo Assigning to Jaime to reflect current status as I believe he's working on it... [09:45:54] 10Analytics, 10Analytics-Kanban, 10Data-Engineering, 10Data-Engineering-Kanban: Snapshot and Reload cassandra2 pageview_per_article data table from all 12 instances - https://phabricator.wikimedia.org/T291472 (10BTullis) All compactions for the 11th snapshot have completed. {F34782508} Proceeding to load t... [09:47:30] 10Analytics, 10Analytics-Kanban, 10Data-Engineering, 10Data-Engineering-Kanban: Snapshot and Reload cassandra2 pageview_per_article data table from all 12 instances - https://phabricator.wikimedia.org/T291472 (10BTullis) ` ### Reloading table data in keyspace local_group_default_T_pageviews_per_article_fla... [10:34:43] (EventgateLoggingExternalLatency) firing: (2) Elevated latency for GET events on eventgate-logging-external in codfw. - https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate - https://grafana.wikimedia.org/d/ZB39Izmnz/eventgate?viewPanel=79&orgId=1&var-service=eventgate-logging-external - https://alerts.wikimedia.org [11:30:31] 10Data-Engineering, 10DBA, 10Infrastructure-Foundations, 10Puppet: Split mariadb::dbstore_multiinstance into 2 separate roles (backup sources and analytics) - https://phabricator.wikimedia.org/T296285 (10Kormat) Split the alias, have a new `db-backup-source` alias. [14:07:56] 10Analytics, 10Data-Engineering, 10Data-Engineering-Kanban: Add user accounts to LDAP group `analytics-privatedata-users` - https://phabricator.wikimedia.org/T295352 (10kai.nissen) 05Open→03Resolved Ok, thanks. Created T296633 and T296634, closing this one. [14:26:11] 10Analytics, 10Data-Engineering, 10Event-Platform, 10Platform Engineering, 10tech-decision-forum: Consistent and comprehensive event streams - Decision Statement Overview - https://phabricator.wikimedia.org/T291120 (10Ottomata) "constant"? Did you mean consistent? Also, this task is owned by the Archit... [14:28:12] 10Analytics, 10Data-Engineering, 10Event-Platform, 10Platform Engineering, 10tech-decision-forum: Consistent and comprehensive event streams - Decision Statement Overview - https://phabricator.wikimedia.org/T291120 (10Ottomata) Also, this task is explicitly about MediaWiki event streams; so we should kee... [14:30:42] 10Analytics, 10Data-Engineering, 10Event-Platform, 10Platform Engineering, 10tech-decision-forum: Consistent and comprehensive event streams - Decision Statement Overview - https://phabricator.wikimedia.org/T291120 (10awight) Of course, no problem at all to "revert" the title change :-), it was just a th... [14:34:05] 10Analytics, 10Data-Engineering, 10Event-Platform, 10Platform Engineering, 10tech-decision-forum: Consistent and comprehensive event streams - Decision Statement Overview - https://phabricator.wikimedia.org/T291120 (10Ottomata) Aye, k I'll revert for now. I'm mostly getting my 'source of truth' terminol... [14:35:00] (EventgateLoggingExternalLatency) firing: (2) Elevated latency for GET events on eventgate-logging-external in codfw. - https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate - https://grafana.wikimedia.org/d/ZB39Izmnz/eventgate?viewPanel=79&orgId=1&var-service=eventgate-logging-external - https://alerts.wikimedia.org [14:35:44] 10Analytics, 10Data-Engineering, 10Event-Platform, 10Platform Engineering, 10tech-decision-forum: MediaWiki Events as a Source of Truth - Problem Statement - https://phabricator.wikimedia.org/T291120 (10Ottomata) [15:09:00] elukey: i have lost track of the +1 are you happy for me to merge the CA change set. if so all three or just the first 2, or would uo prefer to merge [15:09:03] * jbond is happy either way [15:10:46] jbond: lemme check the last one :) [15:12:12] jbond: https://puppet-compiler.wmflabs.org/compiler1002/32712/an-worker1080.eqiad.wmnet/index.html looks weird (see the -keystore /wmf-java-cacerts bit) [15:12:24] ack looking [15:17:14] elukey: https://puppet-compiler.wmflabs.org/compiler1001/32713/an-worker1080.eqiad.wmnet/index.html [15:17:29] was missing an 's' https://gerrit.wikimedia.org/r/c/operations/puppet/+/741867/24..25/modules/sslcert/manifests/trusted_ca.pp [15:20:34] ah! [15:25:05] jbond: green light! I am going to follow the merge see how it goes on various nodes [15:26:25] ack sounds good, you happy for me to merge all three in one go then? [15:27:14] wasn't sure if you wanted to handle https://gerrit.wikimedia.org/r/c/operations/puppet/+/739463 seperatly as its introducing a different change? [15:29:06] elukey: ^^ ? [15:30:26] jbond: let's keep the rsyslog one aside for the moment, I'd like to test the rest first [15:30:36] since it is fleetwide and may impact nodes etc.. [15:31:44] elukey: ack the other two are now merged [15:32:28] jbond: testing them, thanks a ton for the work [15:32:44] no probs and let me know if there is anything elses needed [15:34:40] jbond: is the discovery cfssl ca usable for ats backends these days? context is https://gerrit.wikimedia.org/r/c/operations/puppet/+/742213 [15:36:12] majavah: yes it should work without issue, looking at the cr now [15:36:15] also I'm seeing this accross all of deployment-prep: [15:36:17] Error: Could not retrieve catalog from remote server: Error 500 on SERVER: Server Error: Evaluation Error: Error while evaluating a Method call, 'join' parameter 'arg' expects an Array value, got Struct (file: /etc/puppet/modules/sslcert/manifests/trusted_ca.pp, line: 42, column: 62) on node deployment-puppetmaster04.deployment-prep.eqiad.wmflabs [15:37:13] ah snap I didn't run pcc on deployment-prep [15:37:19] jbond: --^ [15:37:21] majavah: majavah: that relates t the change i jhust merged one sec [15:41:09] elukey: majavah: https://gerrit.wikimedia.org/r/c/operations/puppet/+/742481 [15:43:30] jbond: the other weird thing is that on cp3050 I see the error that we got with pcc [15:44:12] elukey: hmm strange give me a sec and will take a look [15:44:42] majavah: the other issue should be fixed [15:44:44] I checked prod nodes and everything is good, same thing for kafka-test100X [15:44:52] thanks, looks good now [15:44:52] (trying to restart now a broker to double check [15:47:27] elukey: for some reason the fix for the cp3050 issue ended up in the wrong ps https://gerrit.wikimedia.org/r/c/operations/puppet/+/739463/13/modules/profile/manifests/cache/kafka/webrequest.pp [15:47:31] testing a fix now https://gerrit.wikimedia.org/r/c/operations/puppet/+/742482 [15:52:27] elukey: after applying that ^^ i got the following diff on cp3050 https://phabricator.wikimedia.org/P17892 [15:53:15] jbond: perfect, going to double check varnish metrics [15:53:37] ack cheers [15:53:55] jbond: one last thing - in deployment-prep I see that /etc/ssl/certs/wmf-ca-certificates.crt is not created [15:54:19] I went on deployment-deploy01.deployment-prep.eqiad1.wikimedia.cloud and tried to remove it, puppet doesn't create it back [15:54:31] in theory their puppet master should be synced [15:55:06] 10Analytics, 10Data-Engineering, 10Event-Platform, 10Platform Engineering, 10tech-decision-forum: MediaWiki Events as a Source of Truth - Problem Statement - https://phabricator.wikimedia.org/T291120 (10akosiaris) Just to add my 2 cents, I too find the "A source of truth" terminology confusing. I am so a... [15:55:16] "P:cache::kafka::Webrequest: always include profile::cache::kafka::certificate" is the latest non-local commit on deployment-prpe [15:57:04] elukey: thats a bit of a bug which i dont think is supper easy to fix. [15:57:15] tl;dr is that if you delete /etc/ssl/localcerts/WMF_TEST_CA.pem then yuo should see the file recreated [15:57:51] ah lovely [15:58:01] this is one of the side affects of relying on cat and exec [15:58:15] yeah okok :) [15:58:27] there are probably some hacky ways to make it nicer but id say unless it causes an issue lets now worry [15:58:38] and there are some nicer ways to fix this properly in puppet 6 [15:59:06] this is unexpected [15:59:07] elukey@cp3050:~$ ls -l /etc/ssl/certs/wmf-ca-certificates.crt [15:59:07] -rw------- 1 root root 3034 Nov 22 16:20 /etc/ssl/certs/wmf-ca-certificates.crt [16:00:40] going to dig into it [16:01:26] elukey: that file is genrated using the package and /etc/ca-certificates/update.d/update-wmf-ca-certificates [16:01:38] yeah I think it needs a chmod [16:01:55] I'll file a code review [16:01:55] yes i guess the apt scripts run with a restrictive umask [16:02:04] ack thanks [16:02:13] thank you! [16:03:45] 10Analytics, 10Analytics-Kanban: Check whether mediawiki production event data is equivalent to mediawiki-history data over a month - https://phabricator.wikimedia.org/T262261 (10Milimetric) [16:03:47] 10Analytics, 10Analytics-Kanban, 10Data-Engineering-Kanban, 10Event-Platform, and 5 others: Revisions missing from mediawiki_revision_create - https://phabricator.wikimedia.org/T215001 (10Milimetric) 05Open→03Resolved [16:03:51] 10Analytics, 10DBA, 10Event-Platform, 10WMF-Architecture-Team: Consistent MediaWiki state change events | MediaWiki events as source of truth - https://phabricator.wikimedia.org/T120242 (10Milimetric) [16:15:29] 10Analytics, 10Data-Engineering, 10Event-Platform, 10Platform Engineering, 10tech-decision-forum: MediaWiki Events as a Source of Truth - Problem Statement - https://phabricator.wikimedia.org/T291120 (10Ottomata) > supports SSOT and not ASOT via messages, so it's confusing me somewhat more. I think the... [16:15:52] 10Analytics, 10Data-Engineering, 10Event-Platform, 10Platform Engineering, 10tech-decision-forum: MediaWiki Events as a Source of Truth - Problem Statement - https://phabricator.wikimedia.org/T291120 (10Ottomata) But, heard. Am willing to change title, lets discuss with TechForum folks. [16:25:58] milimetric: just merged your sqoop job [16:26:04] puppet patch [16:27:50] thanks ottomata !! [16:59:21] 10Analytics, 10Data-Engineering, 10Event-Platform, 10Platform Engineering, 10tech-decision-forum: MediaWiki Events as a Source of Truth - Problem Statement - https://phabricator.wikimedia.org/T291120 (10akosiaris) >>! In T291120#7534341, @Ottomata wrote: > But, heard. Am willing to change title, lets di... [18:35:00] (EventgateLoggingExternalLatency) firing: (2) Elevated latency for GET events on eventgate-logging-external in codfw. - https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate - https://grafana.wikimedia.org/d/ZB39Izmnz/eventgate?viewPanel=79&orgId=1&var-service=eventgate-logging-external - https://alerts.wikimedia.org [18:58:49] PROBLEM - Check if active EventStreams endpoint is delivering messages. on alert1001 is CRITICAL: CRITICAL: No EventStreams message was consumed from https://stream.wikimedia.org/v2/stream/recentchange within 10 seconds. https://wikitech.wikimedia.org/wiki/Event_Platform/EventStreams/Administration [19:06:14] hm ^ [19:06:22] looks ok to me... [19:06:44] i think there might be an unrelated networking problem [19:28:53] RECOVERY - Check if active EventStreams endpoint is delivering messages. on alert1001 is OK: OK: An EventStreams message was consumed from https://stream.wikimedia.org/v2/stream/recentchange within 10 seconds. https://wikitech.wikimedia.org/wiki/Event_Platform/EventStreams/Administration [19:41:55] 10Data-Engineering, 10Data-Engineering-Kanban, 10Epic: Run Atlas on test cluster - https://phabricator.wikimedia.org/T296670 (10razzi) [19:42:25] 10Data-Engineering, 10Data-Engineering-Kanban, 10User-razzi: Run Atlas on test cluster - https://phabricator.wikimedia.org/T296670 (10razzi) a:05razzi→03None [19:46:19] 10Data-Engineering, 10Data-Engineering-Kanban, 10User-razzi: Run Atlas on test cluster - https://phabricator.wikimedia.org/T296670 (10razzi) a:03razzi [20:12:27] 10Data-Engineering, 10Data-Engineering-Kanban, 10Epic: Finish evaluation of Data Governance Options - https://phabricator.wikimedia.org/T296672 (10Milimetric) [22:20:22] 10Data-Engineering: Review druid deep-storage making sure that old segments having been reindexed are deleted - https://phabricator.wikimedia.org/T296207 (10odimitrijevic) @JAllemandou Do you have more context to share around how the sanitization works on Druid? I take it we would want to remove the old segmen... [22:20:42] 10Data-Engineering: Review druid deep-storage making sure that old segments having been reindexed are deleted - https://phabricator.wikimedia.org/T296207 (10odimitrijevic) p:05Triage→03Medium [22:33:07] 10Analytics, 10Analytics-General-or-Unknown: MaxMind IP files needs to be automatically updated and version controlled (Pakistan Mobile Dashboard Issues) - https://phabricator.wikimedia.org/T55762 (10odimitrijevic) 05Open→03Declined [22:33:23] 10Analytics, 10Analytics-General-or-Unknown: IPv6 GeoIP databases do not automatically update - https://phabricator.wikimedia.org/T56191 (10odimitrijevic) [22:33:34] 10Analytics, 10Analytics-General-or-Unknown: Queries on page views for user agent version range - https://phabricator.wikimedia.org/T60368 (10odimitrijevic) 05Open→03Declined [22:33:52] 10Analytics, 10Analytics-General-or-Unknown: Mobile and zero graphs lack api PageViews - https://phabricator.wikimedia.org/T56782 (10odimitrijevic) 05Open→03Declined [22:34:25] 10Analytics, 10Analytics-General-or-Unknown: geowiki counts edits on any page in the main namespace, not just on countable ones - https://phabricator.wikimedia.org/T57529 (10odimitrijevic) 05Open→03Declined [22:35:00] (EventgateLoggingExternalLatency) firing: (2) Elevated latency for GET events on eventgate-logging-external in codfw. - https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate - https://grafana.wikimedia.org/d/ZB39Izmnz/eventgate?viewPanel=79&orgId=1&var-service=eventgate-logging-external - https://alerts.wikimedia.org [22:35:07] 10Analytics, 10Analytics-General-or-Unknown, 10Patch-For-Review: No current log lines in mobile-sampled-100, zero, edits stream after 2014-01-05 03:40 - https://phabricator.wikimedia.org/T61722 (10odimitrijevic) 05Open→03Declined [22:35:09] 10Analytics, 10Analytics-General-or-Unknown: Requests through ssl terminators hardly present in edits tsvs before 2014-01-14 - https://phabricator.wikimedia.org/T62314 (10odimitrijevic) 05Open→03Declined [22:35:12] 10Analytics, 10Analytics-General-or-Unknown: Requests from ssl terminators not present in sampled-1000 tsvs, and mobile-sampled-1000 tsvs - https://phabricator.wikimedia.org/T62315 (10odimitrijevic) 05Open→03Declined [22:35:27] 10Analytics, 10Analytics-General-or-Unknown: Timestamp in filename of hourly webstatscollector output refers to end of the covered period instead of its start - https://phabricator.wikimedia.org/T62957 (10odimitrijevic) 05Open→03Declined [22:35:40] 10Analytics, 10Analytics-General-or-Unknown: ~30% increase of number of lines zero tsvs between 20140218 and 20140220 file - https://phabricator.wikimedia.org/T63660 (10odimitrijevic) 05Open→03Declined [22:35:45] 10Analytics, 10Analytics-General-or-Unknown: Empty fields instead of 0 in geowiki files - https://phabricator.wikimedia.org/T64867 (10odimitrijevic) 05Open→03Declined [22:36:00] 10Analytics, 10Analytics-General-or-Unknown: Safe-guard against double counting SSL zero traffic - https://phabricator.wikimedia.org/T64980 (10odimitrijevic) 05Open→03Declined [22:36:20] 10Analytics, 10Analytics-General-or-Unknown: Icinga should notice people when /home partition on stat1002 fills up - https://phabricator.wikimedia.org/T65522 (10odimitrijevic) 05Open→03Declined [22:36:40] 10Analytics, 10Analytics-General-or-Unknown: Make sure 2013 traffic logs are gone from /a/squids/archive on stat1002 - https://phabricator.wikimedia.org/T65543 (10odimitrijevic) 05Open→03Declined [22:36:42] 10Analytics, 10Analytics-General-or-Unknown: Attempts of Hadoop tasks randomly fail "Bad connect ack with firstBadLink as $SOME_CLUSTER_IP" - https://phabricator.wikimedia.org/T65693 (10odimitrijevic) 05Open→03Declined [22:36:50] 10Analytics, 10Analytics-General-or-Unknown: convert reports to use kafka-tee output - https://phabricator.wikimedia.org/T66016 (10odimitrijevic) 05Open→03Declined [22:36:52] 10Analytics, 10Analytics-General-or-Unknown: udp2log and/or demux.py filename corruption - https://phabricator.wikimedia.org/T64082 (10odimitrijevic) [22:37:14] 10Analytics, 10Analytics-General-or-Unknown: Using puppet's active_nodes or pybal to determine mobile frontend caches - https://phabricator.wikimedia.org/T66240 (10odimitrijevic) 05Open→03Declined [22:37:20] 10Analytics, 10Analytics-General-or-Unknown: Cron that runs mobile queries is dead - https://phabricator.wikimedia.org/T68600 (10odimitrijevic) [22:37:22] 10Analytics, 10Analytics-General-or-Unknown: Files in /srv on stat1003 owned by non-existing users - https://phabricator.wikimedia.org/T66749 (10odimitrijevic) 05Open→03Declined [22:37:31] 10Analytics, 10Analytics-General-or-Unknown: Figure out account management for research cluster - https://phabricator.wikimedia.org/T67273 (10odimitrijevic) 05Open→03Declined [22:38:04] 10Analytics, 10Analytics-General-or-Unknown: Turn off default vhost on stat1001.wikimedia.org - https://phabricator.wikimedia.org/T70150 (10odimitrijevic) 05Open→03Declined [22:38:06] 10Analytics, 10Analytics-General-or-Unknown: Inventory Analytics systems for operational support - https://phabricator.wikimedia.org/T70450 (10odimitrijevic) 05Open→03Declined [22:38:11] 10Analytics, 10Analytics-General-or-Unknown: Listing oozie coordinators on stat1002 fails with type conversion error - https://phabricator.wikimedia.org/T73192 (10odimitrijevic) 05Open→03Declined [22:38:31] 10Analytics, 10Analytics-General-or-Unknown, 10Story: Story: define aggregation/anonymization strategy for long term retention of logs on 1002 that complies with privacy policy - https://phabricator.wikimedia.org/T75093 (10odimitrijevic) 05Open→03Declined [22:39:19] 10Analytics: Chart data from analytics.wikimedia.org do not fully specify macOS or Windows versions. - https://phabricator.wikimedia.org/T269722 (10odimitrijevic) [22:40:11] 10Analytics-Radar: Enable nested on-wiki config pages in mediawiki-storage - https://phabricator.wikimedia.org/T163725 (10odimitrijevic) [22:41:13] 10Analytics, 10Event-Platform: '.event.finalSlide' should be integer - https://phabricator.wikimedia.org/T289866 (10odimitrijevic) [22:41:40] 10Analytics-EventLogging, 10Analytics-Radar: Support JSON Reference specification - https://phabricator.wikimedia.org/T47878 (10odimitrijevic) 05Open→03Declined [22:41:42] 10Analytics, 10Analytics-EventLogging: Add API method for recursively expanding JSON Schema - https://phabricator.wikimedia.org/T47886 (10odimitrijevic) [22:41:44] 10Analytics, 10Analytics-EventLogging, 10Tracking-Neverending: Use draft 4 of JSON Schema specification - https://phabricator.wikimedia.org/T46809 (10odimitrijevic) [22:42:10] 10Analytics, 10Analytics-EventLogging: Enhance EventLogging Schema diffs with Extension:Diff - https://phabricator.wikimedia.org/T47865 (10odimitrijevic) 05Open→03Declined [22:42:22] 10Analytics, 10Analytics-EventLogging, 10patch-welcome: Check that schema name matches revid - https://phabricator.wikimedia.org/T48174 (10odimitrijevic) 05Open→03Declined [22:43:07] 10Analytics, 10Analytics-EventLogging: "Invalid type" error should be clearer - https://phabricator.wikimedia.org/T51913 (10odimitrijevic) 05Open→03Declined [22:46:06] 10Analytics, 10Analytics-EventLogging: log database in s1-analytics-slave has charecter set utf8, while every other database has charset binary - https://phabricator.wikimedia.org/T49368 (10odimitrijevic) 05Open→03Declined [22:46:39] 10Analytics, 10Analytics-EventLogging, 10patch-welcome: Generate alerts if theoretically impossible or unwanted logging occurs - https://phabricator.wikimedia.org/T49591 (10odimitrijevic) 05Open→03Declined [22:46:41] 10Analytics, 10Analytics-EventLogging: Special:Schemas page for showing the status and description of all schemas - https://phabricator.wikimedia.org/T53093 (10odimitrijevic) 05Open→03Declined [22:47:44] 10Analytics, 10Analytics-EventLogging: Feature request: distinguish better between test wikis and production wikis - https://phabricator.wikimedia.org/T57577 (10odimitrijevic) 05Open→03Declined [22:47:47] 10Analytics, 10Analytics-EventLogging: Remove descriptions from declareSchema call to reduce bandwidth usage - https://phabricator.wikimedia.org/T58071 (10odimitrijevic) 05Open→03Declined [22:48:04] 10Analytics, 10Analytics-EventLogging: Support declaring multiple 'schemas' inside a single RL module - https://phabricator.wikimedia.org/T58281 (10odimitrijevic) 05Open→03Declined [22:48:33] 10Analytics, 10Analytics-EventLogging: Subscriber support in JSON schemas - https://phabricator.wikimedia.org/T63076 (10odimitrijevic) 05Open→03Declined [22:48:59] 10Analytics, 10Analytics-EventLogging: Raw User-Agents get stored - https://phabricator.wikimedia.org/T64978 (10odimitrijevic) 05Open→03Declined [22:55:53] 10Analytics, 10Data-Engineering, 10Data-Engineering-Kanban, 10Event-Platform, and 4 others: Migrate WikibaseTermboxInteraction EventLogging Schema to new EventPlatform thingy - https://phabricator.wikimedia.org/T290303 (10odimitrijevic) [22:56:24] 10Analytics, 10Event-Platform: Remove StreamConfig::INTERNAL_SETTINGS logic from EventStreamConfig and do it in EventLogging client instead - https://phabricator.wikimedia.org/T286344 (10odimitrijevic) [22:57:49] 10Analytics-Radar, 10Discovery, 10Event-Platform: '.event.pageViewId' should be string, '.event.subTest' should be string, '.event.searchSessionId' should be string - https://phabricator.wikimedia.org/T286814 (10odimitrijevic) [22:59:29] 10Analytics, 10Analytics-EventLogging: Encoding on db. Non ascii chars are being enter like '???' - https://phabricator.wikimedia.org/T68123 (10odimitrijevic) 05Open→03Declined [22:59:34] 10Analytics, 10Analytics-EventLogging: Add sampling support in EventLogging - https://phabricator.wikimedia.org/T67500 (10odimitrijevic) 05Open→03Declined [23:00:47] 10Analytics-Radar, 10Platform Team Workboards (MW Expedition), 10Wikimedia-production-error: Exception: Serialization of 'Closure' is not allowed - https://phabricator.wikimedia.org/T286610 (10odimitrijevic) [23:01:05] 10Analytics, 10Analytics-EventLogging: Archive of "EventLogging Alerts" mailing list not working? - https://phabricator.wikimedia.org/T68488 (10odimitrijevic) 05Open→03Declined [23:01:33] 10Analytics, 10Analytics-EventLogging: Implement throttling strategy for events that have a too high of a throughput. - https://phabricator.wikimedia.org/T69470 (10odimitrijevic) 05Open→03Declined [23:01:53] 10Analytics, 10Analytics-EventLogging: Consumer that produces to kafka not getting current set of brokers - https://phabricator.wikimedia.org/T68526 (10odimitrijevic) 05Open→03Declined [23:03:03] 10Analytics, 10Analytics-EventLogging: Have a way to mark schemata as disabled, so valid events (e.g. from cached client code) don't get logged - https://phabricator.wikimedia.org/T142490 (10odimitrijevic) 05Open→03Declined [23:03:09] 10Analytics, 10Analytics-EventLogging, 10patch-welcome: Two tests classes on testing efSchemaValidate - https://phabricator.wikimedia.org/T67546 (10odimitrijevic) 05Open→03Declined [23:03:31] 10Analytics, 10Analytics-EventLogging: Using EventLogging and Dashboards - https://phabricator.wikimedia.org/T85280 (10odimitrijevic) 05Open→03Declined [23:03:49] 10Analytics-Radar, 10MediaWiki-ContentHandler: Allow YAML as an alternative for JSON on MediaWiki pages - https://phabricator.wikimedia.org/T237136 (10odimitrijevic) [23:04:08] 10Analytics, 10Data-Engineering, 10Event-Platform, 10Product-Analytics, 10MW-1.36-notes (1.36.0-wmf.18; 2020-11-17): Migrate legacy metawiki schemas to Event Platform - https://phabricator.wikimedia.org/T259163 (10odimitrijevic) [23:04:50] 10Analytics, 10Analytics-EventLogging: Verify that each existing table corresponds to its schema definition - https://phabricator.wikimedia.org/T91031 (10odimitrijevic) 05Open→03Declined [23:04:56] 10Analytics, 10Analytics-EventLogging, 10Story, 10patch-welcome: User clicks on link to event capsule schema while viewing a schema - https://phabricator.wikimedia.org/T74745 (10odimitrijevic) 05Open→03Declined [23:05:08] 10Analytics, 10Analytics-EventLogging: Delete teahouse directory - https://phabricator.wikimedia.org/T86071 (10odimitrijevic) 05Open→03Declined [23:05:57] 10Analytics-Radar, 10TimedMediaHandler, 10Wikimedia-Video: Record and report metrics for audio and video playback - https://phabricator.wikimedia.org/T108522 (10odimitrijevic) [23:06:14] 10Analytics-Radar, 10Event-Platform, 10TimedMediaHandler, 10Wikimedia-Video: Record and report metrics for audio and video playback - https://phabricator.wikimedia.org/T108522 (10odimitrijevic) [23:06:42] 10Analytics-EventLogging, 10Analytics-Radar, 10Russian-Sites: Add ops-reportcard dashboard with analysis that shows the http to https slowdown on russian wikipedia - https://phabricator.wikimedia.org/T87604 (10odimitrijevic) 05Open→03Declined [23:07:30] 10Analytics, 10Analytics-EventLogging: Please delete ChangesListFilters events from before 2016-09-22 - https://phabricator.wikimedia.org/T147346 (10odimitrijevic) 05Open→03Declined [23:08:26] 10Analytics-EventLogging, 10Analytics-Radar, 10Growth-Team, 10Growth-Team-Filtering, and 5 others: Multiple MediaWiki hooks are not documented on mediawiki.org - https://phabricator.wikimedia.org/T157757 (10odimitrijevic) 05Open→03Declined [23:09:12] 10Analytics-Radar, 10MediaWiki-extensions-CollaborationKit: Decide on JSON validation library - https://phabricator.wikimedia.org/T147137 (10odimitrijevic) [23:09:29] 10Analytics-EventLogging, 10Analytics-Radar: Test pushing EventLogging through the ELK stack - https://phabricator.wikimedia.org/T160679 (10odimitrijevic) 05Open→03Declined [23:13:53] 10Analytics, 10Event-Platform: Provide easy way to know the content language of a wiki about which there is an event log line - https://phabricator.wikimedia.org/T65204 (10odimitrijevic) [23:15:20] 10Analytics-Radar, 10Event-Platform: eventlogging Dockerfile doesn't work - https://phabricator.wikimedia.org/T208679 (10odimitrijevic) [23:16:17] 10Analytics-Radar, 10Event-Platform, 10CSS: Schema code samples popup appears under the JSON table - https://phabricator.wikimedia.org/T272857 (10odimitrijevic) [23:17:02] 10Analytics, 10Analytics-EventLogging: Error: Additional properties are not allowed ('clientValidated' was unexpected) - https://phabricator.wikimedia.org/T257364 (10odimitrijevic) 05Open→03Declined [23:17:29] 10Analytics, 10Analytics-EventLogging: Set up logger for EventLoggings consumer that produces to kafka - https://phabricator.wikimedia.org/T68529 (10odimitrijevic) 05Open→03Declined [23:21:02] 10Analytics-EventLogging, 10Analytics-Radar, 10Growth-Team, 10Growth-Team-Filtering, and 3 others: GuidedTour fails if EventLogging isn't installed, but doesn't explicitly require it - https://phabricator.wikimedia.org/T264145 (10odimitrijevic) 05Open→03Resolved [23:22:10] 10Analytics, 10Analytics-EventLogging: It should be possible to see the number of server-side validation errors for a schema in Grafana - https://phabricator.wikimedia.org/T206959 (10odimitrijevic) 05Open→03Declined [23:25:30] 10Analytics, 10Analytics-EventLogging, 10patch-welcome: Empty objects can pass schemas with required fields - https://phabricator.wikimedia.org/T67607 (10odimitrijevic) 05Open→03Declined [23:25:35] 10Analytics, 10Event-Platform, 10Goal: Modern Event Platform: Stream Connectors - https://phabricator.wikimedia.org/T214430 (10odimitrijevic) @Ottomata Can this be marked as resolved? [23:29:15] 10Analytics, 10Data-Engineering, 10Datasets-Webstatscollector: Add alarms for high volume of views to pages with replacement characters - https://phabricator.wikimedia.org/T117945 (10odimitrijevic)