[00:26:19] 10Data-Engineering, 10Product-Analytics, 10Wmfdata-Python: Wmfdata-Python's CSV loading cannot handle standard quoted CSV values - https://phabricator.wikimedia.org/T327983 (10nshahquinn-wmf) [01:13:41] (VarnishkafkaNoMessages) firing: varnishkafka on cp4047 is not sending enough cache_upload requests - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka - https://grafana.wikimedia.org/d/000000253/varnishkafka?orgId=1&var-datasource=ulsfo%20prometheus/ops&var-cp_cluster=cache_upload&var-instance=cp4047%3A9132&viewPanel=14 - https://alerts.wikimedia.org/?q=alertname%3DVarnishkafkaNoMessages [01:13:41] (VarnishkafkaNoMessages) firing: varnishkafka on cp4047 is not sending enough cache_upload requests - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka - https://grafana.wikimedia.org/d/000000253/varnishkafka?orgId=1&var-datasource=ulsfo%20prometheus/ops&var-cp_cluster=cache_upload&var-instance=cp4047%3A9132&viewPanel=14 - https://alerts.wikimedia.org/?q=alertname%3DVarnishkafkaNoMessages [01:18:41] (VarnishkafkaNoMessages) resolved: varnishkafka on cp4047 is not sending enough cache_upload requests - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka - https://grafana.wikimedia.org/d/000000253/varnishkafka?orgId=1&var-datasource=ulsfo%20prometheus/ops&var-cp_cluster=cache_upload&var-instance=cp4047%3A9132&viewPanel=14 - https://alerts.wikimedia.org/?q=alertname%3DVarnishkafkaNoMessages [01:18:41] (VarnishkafkaNoMessages) resolved: varnishkafka on cp4047 is not sending enough cache_upload requests - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka - https://grafana.wikimedia.org/d/000000253/varnishkafka?orgId=1&var-datasource=ulsfo%20prometheus/ops&var-cp_cluster=cache_upload&var-instance=cp4047%3A9132&viewPanel=14 - https://alerts.wikimedia.org/?q=alertname%3DVarnishkafkaNoMessages [01:20:58] PROBLEM - MegaRAID on an-worker1087 is CRITICAL: CRITICAL: 13 LD(s) must have write cache policy WriteBack, currently using: WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough https://wikitech.wikimedia.org/wiki/MegaCli%23Monitoring [02:25:26] RECOVERY - MegaRAID on an-worker1087 is OK: OK: optimal, 13 logical, 14 physical, WriteBack policy https://wikitech.wikimedia.org/wiki/MegaCli%23Monitoring [04:02:16] PROBLEM - MegaRAID on an-worker1087 is CRITICAL: CRITICAL: 13 LD(s) must have write cache policy WriteBack, currently using: WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough https://wikitech.wikimedia.org/wiki/MegaCli%23Monitoring [04:13:02] RECOVERY - MegaRAID on an-worker1087 is OK: OK: optimal, 13 logical, 14 physical, WriteBack policy https://wikitech.wikimedia.org/wiki/MegaCli%23Monitoring [04:28:06] PROBLEM - Check systemd state on an-launcher1002 is CRITICAL: CRITICAL - degraded: The following units failed: monitor_refine_event_sanitized_analytics_immediate.service https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state [04:45:18] PROBLEM - MegaRAID on an-worker1087 is CRITICAL: CRITICAL: 13 LD(s) must have write cache policy WriteBack, currently using: WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough https://wikitech.wikimedia.org/wiki/MegaCli%23Monitoring [05:28:20] RECOVERY - MegaRAID on an-worker1087 is OK: OK: optimal, 13 logical, 14 physical, WriteBack policy https://wikitech.wikimedia.org/wiki/MegaCli%23Monitoring [06:32:52] PROBLEM - MegaRAID on an-worker1087 is CRITICAL: CRITICAL: 13 LD(s) must have write cache policy WriteBack, currently using: WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough https://wikitech.wikimedia.org/wiki/MegaCli%23Monitoring [07:25:22] RECOVERY - MegaRAID on an-worker1087 is OK: OK: optimal, 13 logical, 14 physical, WriteBack policy https://wikitech.wikimedia.org/wiki/MegaCli%23Monitoring [07:39:29] 10Data-Engineering-Planning, 10Machine-Learning-Team, 10Research, 10Patch-For-Review: Proposal: deprecate the mediawiki.revision-score stream in favour of more streams like mediawiki-revision-score- - https://phabricator.wikimedia.org/T317768 (10elukey) Hi folks! Getting back to this task so everybo... [07:49:12] (03CR) 10Joal: "LGTM :) @ottomata, @dcause and @glederrey - would ou mind triple checking?" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/883118 (https://phabricator.wikimedia.org/T327072) (owner: 10Aqu) [07:49:21] (03CR) 10Joal: [C: 03+1] Remove Guava from dependency [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/883118 (https://phabricator.wikimedia.org/T327072) (owner: 10Aqu) [07:52:50] (03CR) 10Aqu: "I am currently checking the output of the new Maxmind caching mechanism by comparison on 1 hour of webrequest." [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/883118 (https://phabricator.wikimedia.org/T327072) (owner: 10Aqu) [08:52:26] 10Data-Engineering, 10DBA, 10Data-Persistence, 10Discovery-Search, and 10 others: codfw row A switches upgrade - https://phabricator.wikimedia.org/T327925 (10Marostegui) [08:59:46] 10Data-Engineering, 10Shared-Data-Infrastructure (EQ2 Kanban (Sprints 04-05)): Datahub errors in staging-codfw - https://phabricator.wikimedia.org/T327799 (10JMeybohm) >>! In T327799#8561941, @BTullis wrote: > Is this the last blocker to upgrading staging-eqiad to 1.23 @JMeybohm ? > > If so, I wonder whether... [09:01:16] PROBLEM - MegaRAID on an-worker1087 is CRITICAL: CRITICAL: 13 LD(s) must have write cache policy WriteBack, currently using: WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough https://wikitech.wikimedia.org/wiki/MegaCli%23Monitoring [09:17:39] 10Data-Engineering-Planning, 10Machine-Learning-Team, 10Research, 10Patch-For-Review: Proposal: deprecate the mediawiki.revision-score stream in favour of more streams like mediawiki-revision-score- - https://phabricator.wikimedia.org/T317768 (10dcausse) @elukey thanks for the ping! If the plan to s... [09:48:52] 10Data-Engineering, 10DBA, 10Data-Persistence, 10Discovery-Search, and 10 others: codfw row A switches upgrade - https://phabricator.wikimedia.org/T327925 (10Jelto) [10:02:00] 10Data-Engineering, 10DBA, 10Data-Persistence, 10Discovery-Search, and 10 others: codfw row A switches upgrade - https://phabricator.wikimedia.org/T327925 (10fgiunchedi) [10:04:19] RECOVERY - MegaRAID on an-worker1087 is OK: OK: optimal, 13 logical, 14 physical, WriteBack policy https://wikitech.wikimedia.org/wiki/MegaCli%23Monitoring [10:04:52] 10Data-Engineering, 10DBA, 10Data-Persistence, 10Discovery-Search, and 10 others: codfw row A switches upgrade - https://phabricator.wikimedia.org/T327925 (10MatthewVernon) [10:13:11] 10Data-Engineering, 10DBA, 10Data-Persistence, 10Discovery-Search, and 10 others: codfw row A switches upgrade - https://phabricator.wikimedia.org/T327925 (10elukey) [10:17:23] 10Data-Engineering, 10SRE-Access-Requests: Create kerberos principal for user matmarex - https://phabricator.wikimedia.org/T328116 (10BTullis) [10:18:48] 10Data-Engineering, 10DBA, 10Data-Persistence, 10Discovery-Search, and 10 others: codfw row A switches upgrade - https://phabricator.wikimedia.org/T327925 (10fgiunchedi) [10:21:22] 10Data-Engineering, 10SRE-Access-Requests: Create kerberos principal for user matmarex - https://phabricator.wikimedia.org/T328116 (10BTullis) 05Open→03Resolved I have created the principal. ` btullis@krb1001:~$ sudo manage_principals.py get matmarex get_principal: Principal does not exist while retrieving... [10:24:40] 10Data-Engineering, 10Shared-Data-Infrastructure (EQ2 Kanban (Sprints 04-05)): Datahub errors in staging-codfw - https://phabricator.wikimedia.org/T327799 (10JMeybohm) Thinking about cgroups tickled my memory and surfaced https://bugs.openjdk.org/browse/JDK-8230305?subTaskView=all Datahub is currently based on... [10:43:27] (03PS1) 10Btullis: Rebuild the datahub containers to pick up new base JDK [analytics/datahub] (wmf) - 10https://gerrit.wikimedia.org/r/884280 (https://phabricator.wikimedia.org/T327799) [10:45:32] PROBLEM - MegaRAID on an-worker1087 is CRITICAL: CRITICAL: 13 LD(s) must have write cache policy WriteBack, currently using: WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough, WriteThrough https://wikitech.wikimedia.org/wiki/MegaCli%23Monitoring [10:59:03] (03CR) 10Btullis: "This is a noop with only an update to README-WMF.md" [analytics/datahub] (wmf) - 10https://gerrit.wikimedia.org/r/884280 (https://phabricator.wikimedia.org/T327799) (owner: 10Btullis) [10:59:16] (03CR) 10Btullis: [C: 03+2] Rebuild the datahub containers to pick up new base JDK [analytics/datahub] (wmf) - 10https://gerrit.wikimedia.org/r/884280 (https://phabricator.wikimedia.org/T327799) (owner: 10Btullis) [11:03:36] !log datahub: apply on main for T327884 [11:03:39] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [11:03:39] T327884: Datahub user records are not being created after login - https://phabricator.wikimedia.org/T327884 [11:06:52] RECOVERY - MegaRAID on an-worker1087 is OK: OK: optimal, 13 logical, 14 physical, WriteBack policy https://wikitech.wikimedia.org/wiki/MegaCli%23Monitoring [11:12:41] (03Merged) 10jenkins-bot: Rebuild the datahub containers to pick up new base JDK [analytics/datahub] (wmf) - 10https://gerrit.wikimedia.org/r/884280 (https://phabricator.wikimedia.org/T327799) (owner: 10Btullis) [11:17:31] !log shut down an-worker1087 to await RAID BBU replacement [11:17:32] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [11:41:22] !log datahub helmfile apply on main for T327884 [11:41:26] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [11:41:26] T327884: Datahub user records are not being created after login - https://phabricator.wikimedia.org/T327884 [11:59:25] 10Data-Engineering, 10Patch-For-Review, 10Shared-Data-Infrastructure (EQ2 Kanban (Sprints 04-05)): Datahub errors in staging-codfw - https://phabricator.wikimedia.org/T327799 (10BTullis) Just a quick double-check that it correctly picked up the new version of java. ` btullis@marlin:~$ docker run -it --entryp... [12:00:59] (03CR) 10Thiemo Kreuz (WMDE): [C: 03+2] Update event schema for Kartographer external data [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/882631 (https://phabricator.wikimedia.org/T326637) (owner: 10Awight) [12:01:30] (03Merged) 10jenkins-bot: Update event schema for Kartographer external data [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/882631 (https://phabricator.wikimedia.org/T326637) (owner: 10Awight) [12:12:06] 10Data-Engineering-Planning, 10Shared-Data-Infrastructure, 10Epic: Install Ceph Cluster for Data Engineering - https://phabricator.wikimedia.org/T324660 (10BTullis) [12:16:26] 10Data-Engineering, 10Product-Analytics, 10Wmfdata-Python: Wmfdata-Python's CSV loading cannot handle standard quoted CSV values - https://phabricator.wikimedia.org/T327983 (10BTullis) Bringing this to the attention of @EChetty [[https://github.com/wikimedia/wmfdata-python/pull/41#issuecomment-1405689466|as... [12:40:46] 10Data-Engineering-Planning, 10Data Pipelines, 10Pageviews-Anomaly, 10Product-Analytics: Analyze possible bot traffic for frwiki article Cookie (informatique) - https://phabricator.wikimedia.org/T313114 (10ARamadan-WMF) We also recieved this from one of our users through the Android support email: Hello,... [12:44:34] 10Data-Engineering-Planning, 10Epic, 10Shared-Data-Infrastructure (EQ2 Kanban (Sprints 04-05)): Create puppet profiles for the new ceph cluster - https://phabricator.wikimedia.org/T328123 (10BTullis) [12:45:15] 10Data-Engineering-Planning, 10Epic, 10Shared-Data-Infrastructure (EQ2 Kanban (Sprints 04-05)): Create puppet profiles for the new ceph cluster - https://phabricator.wikimedia.org/T328123 (10BTullis) p:05Triage→03High [12:45:31] 10Data-Engineering-Planning, 10Shared-Data-Infrastructure, 10Epic: Install Ceph Cluster for Data Engineering - https://phabricator.wikimedia.org/T324660 (10BTullis) p:05Triage→03High [12:47:47] 10Data-Engineering-Planning, 10Epic, 10Patch-For-Review, 10Shared-Data-Infrastructure (EQ2 Kanban (Sprints 04-05)): Decide on installation details for new ceph cluster - https://phabricator.wikimedia.org/T326945 (10BTullis) Moving to paused while we work on installing the packages/services. We can continue... [12:48:07] 10Data-Engineering, 10Data-Catalog, 10Shared-Data-Infrastructure (EQ2 Kanban (Sprints 04-05)): Datahub user records are not being created after login - https://phabricator.wikimedia.org/T327884 (10Stevemunene) We implemented a change to enable OIDC provisioning and exact groups, as per a suggestion from the... [13:17:55] 10Data-Engineering-Planning, 10Data Pipelines, 10Pageviews-Anomaly, 10Security-Team, and 4 others: Analyze possible bot traffic for enwiki article Index (statistics), Index & XXX:_Return_of_Xander_Cage - https://phabricator.wikimedia.org/T328127 (10Seddon) [13:17:59] 10Data-Engineering-Planning, 10Data Pipelines, 10Pageviews-Anomaly, 10Product-Analytics, and 2 others: Analyze possible bot traffic for frwiki article Cookie (informatique) - https://phabricator.wikimedia.org/T313114 (10Seddon) [13:18:21] 10Data-Engineering, 10Research-Backlog: [Open question] Improve bot identification at scale - https://phabricator.wikimedia.org/T138207 (10Seddon) [13:18:25] 10Data-Engineering-Planning, 10Data Pipelines, 10Pageviews-Anomaly, 10Security-Team, and 4 others: Analyze possible bot traffic for enwiki article Index (statistics), Index & XXX:_Return_of_Xander_Cage - https://phabricator.wikimedia.org/T328127 (10Seddon) [13:55:06] 10Data-Engineering, 10Shared-Data-Infrastructure (EQ2 Kanban (Sprints 04-05)): Datahub errors in staging-codfw - https://phabricator.wikimedia.org/T327799 (10BTullis) This upgrade to the JRE has worked! Thanks @JMeybohm I have also verified that it is allowing user logins on the staging-codfw deployment with... [13:56:51] 10Data-Engineering, 10Shared-Data-Infrastructure (EQ2 Kanban (Sprints 04-05)): Datahub errors in staging-codfw - https://phabricator.wikimedia.org/T327799 (10BTullis) 05Open→03Resolved a:03BTullis [15:25:13] 10Data-Engineering-Planning, 10Event-Platform Value Stream (Sprint 08): Deploy to DSE k8s - https://phabricator.wikimedia.org/T325305 (10lbowmaker) [15:25:27] 10Data-Engineering-Planning, 10Event-Platform Value Stream (Sprint 08): Deploy to YARN - https://phabricator.wikimedia.org/T325304 (10lbowmaker) [15:32:12] (VarnishkafkaNoMessages) firing: varnishkafka on cp2027 is not sending enough cache_text requests - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka - https://grafana.wikimedia.org/d/000000253/varnishkafka?orgId=1&var-datasource=codfw%20prometheus/ops&var-cp_cluster=cache_text&var-instance=cp2027%3A9132&viewPanel=14 - https://alerts.wikimedia.org/?q=alertname%3DVarnishkafkaNoMessages [15:37:12] (VarnishkafkaNoMessages) resolved: varnishkafka on cp2027 is not sending enough cache_text requests - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka - https://grafana.wikimedia.org/d/000000253/varnishkafka?orgId=1&var-datasource=codfw%20prometheus/ops&var-cp_cluster=cache_text&var-instance=cp2027%3A9132&viewPanel=14 - https://alerts.wikimedia.org/?q=alertname%3DVarnishkafkaNoMessages [15:43:41] (VarnishkafkaNoMessages) firing: varnishkafka on cp4040 is not sending enough cache_text requests - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka - https://grafana.wikimedia.org/d/000000253/varnishkafka?orgId=1&var-datasource=ulsfo%20prometheus/ops&var-cp_cluster=cache_text&var-instance=cp4040%3A9132&viewPanel=14 - https://alerts.wikimedia.org/?q=alertname%3DVarnishkafkaNoMessages [15:43:42] (VarnishkafkaNoMessages) firing: varnishkafka on cp4040 is not sending enough cache_text requests - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka - https://grafana.wikimedia.org/d/000000253/varnishkafka?orgId=1&var-datasource=ulsfo%20prometheus/ops&var-cp_cluster=cache_text&var-instance=cp4040%3A9132&viewPanel=14 - https://alerts.wikimedia.org/?q=alertname%3DVarnishkafkaNoMessages [15:48:41] (VarnishkafkaNoMessages) resolved: (2) varnishkafka on cp2027 is not sending enough cache_text requests - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka - https://alerts.wikimedia.org/?q=alertname%3DVarnishkafkaNoMessages [15:48:42] (VarnishkafkaNoMessages) resolved: (2) varnishkafka on cp2027 is not sending enough cache_text requests - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka - https://alerts.wikimedia.org/?q=alertname%3DVarnishkafkaNoMessages [17:23:12] 10Data-Engineering, 10Shared-Data-Infrastructure (EQ2 Kanban (Sprints 04-05)): Some users' presto queries are no longer working in Superset : matmarex and cmyrick - https://phabricator.wikimedia.org/T328152 (10BTullis) [17:27:24] 10Data-Engineering, 10Shared-Data-Infrastructure (EQ2 Kanban (Sprints 04-05)): Some users' presto queries are no longer working in Superset : matmarex and cmyrick - https://phabricator.wikimedia.org/T328152 (10BTullis) p:05Triage→03High [17:45:40] (03PS1) 10Joal: Add hql/webrequest/actor folder and scripts [analytics/refinery] - 10https://gerrit.wikimedia.org/r/884359 (https://phabricator.wikimedia.org/T324483) [18:29:36] 10Data-Engineering-Planning, 10Machine-Learning-Team, 10Research, 10Patch-For-Review: Proposal: deprecate the mediawiki.revision-score stream in favour of more streams like mediawiki-revision-score- - https://phabricator.wikimedia.org/T317768 (10Isaac) @dcausse could you loop me in when you start on... [19:08:06] 10Data-Engineering-Planning, 10Event-Platform Value Stream, 10ci-test-error: Use a fake timer in EventBus unit test for PageChangeEventSerializerTest::testCreatePageChangeVisibilityEvent - https://phabricator.wikimedia.org/T325341 (10Umherirrender) 05Open→03Resolved a:03Ottomata >>! In T325341#8562928,... [20:03:37] 10Data-Engineering, 10Event-Platform Value Stream (Sprint 07), 10Patch-For-Review: Design Schema for page state and page state with content (enriched) streams - https://phabricator.wikimedia.org/T308017 (10JArguello-WMF) @Ottomata Do you need me to create tickets for the TO Dos mentioned above? [20:05:32] 10Data-Engineering, 10Event-Platform Value Stream (Sprint 08), 10Patch-For-Review: Design Schema for page state and page state with content (enriched) streams - https://phabricator.wikimedia.org/T308017 (10JArguello-WMF) [20:06:31] 10Data-Engineering-Planning, 10Event-Platform Value Stream (Sprint 08): Flink + Event Platform integration for writing into streams via Table API - https://phabricator.wikimedia.org/T324114 (10JArguello-WMF) [20:06:59] 10Data-Engineering-Planning, 10Event-Platform Value Stream (Sprint 08): Flink SQL queries should access Kafka topics from a Catalog - https://phabricator.wikimedia.org/T322022 (10JArguello-WMF) [20:08:11] 10Data-Engineering-Planning, 10Event-Platform Value Stream: Spark Streaming Dumps POC: Backfill content table - https://phabricator.wikimedia.org/T323641 (10JArguello-WMF) [20:08:30] 10Data-Engineering, 10Event-Platform Value Stream (Sprint 08), 10Patch-For-Review: Tests for mediawiki-stream-enrichment-python flink job via eventutilities-python - https://phabricator.wikimedia.org/T326565 (10JArguello-WMF) [20:09:01] 10Data-Engineering, 10Event-Platform Value Stream (Sprint 08): Deployment pipeline docker image of flink mediawiki stream enrichment pyhon - https://phabricator.wikimedia.org/T326731 (10JArguello-WMF) [20:12:41] 10Data-Engineering-Planning, 10Event-Platform Value Stream (Sprint 09): Spark Streaming Dumps POC: Backfill metadata table - https://phabricator.wikimedia.org/T323642 (10JArguello-WMF) [20:12:52] 10Data-Engineering-Planning, 10Event-Platform Value Stream (Sprint 09): Spark Streaming Dumps POC: Backfill content table - https://phabricator.wikimedia.org/T323641 (10JArguello-WMF) [20:13:18] 10Data-Engineering-Planning, 10Event-Platform Value Stream (Sprint 09): Spark Streaming Dumps POC: Update iceberg tables - https://phabricator.wikimedia.org/T323645 (10JArguello-WMF) [20:13:39] 10Data-Engineering, 10serviceops, 10Discovery-Search (Current work), 10Event-Platform Value Stream (Sprint 07), 10Patch-For-Review: Flink on Kubernetes Helm charts - https://phabricator.wikimedia.org/T324576 (10JArguello-WMF) 05Open→03Resolved [20:13:50] 10Data-Engineering-Planning, 10Event-Platform Value Stream: [EPIC] Flink Applications on Kubernetes - https://phabricator.wikimedia.org/T324578 (10JArguello-WMF) [20:13:58] 10Data-Engineering-Planning, 10Event-Platform Value Stream (Sprint 07), 10Patch-For-Review: Flink application and flink-kubernetes-operator production docker images - https://phabricator.wikimedia.org/T316519 (10JArguello-WMF) 05Open→03Resolved [20:14:00] 10Data-Engineering-Planning, 10Event-Platform Value Stream: [EPIC] Flink Applications on Kubernetes - https://phabricator.wikimedia.org/T324578 (10JArguello-WMF) [20:14:06] 10Data-Engineering, 10Event-Platform Value Stream (Sprint 07): Gitlab CI pipeline for Python applications should bundle Java eventutilities and runtime deps - https://phabricator.wikimedia.org/T326567 (10JArguello-WMF) 05Open→03Resolved [20:14:08] 10Data-Engineering-Planning, 10Event-Platform Value Stream: [EPIC] Streaming and event driven Python services - https://phabricator.wikimedia.org/T324689 (10JArguello-WMF) [20:14:12] 10Data-Engineering-Planning, 10Event-Platform Value Stream (Sprint 07): [SPIKE] Evaluate a pyflink version of Mediawiki Stream Enrichment - https://phabricator.wikimedia.org/T323217 (10JArguello-WMF) 05Open→03Resolved [20:14:27] 10Data-Engineering-Planning, 10Event-Platform Value Stream (Sprint 07): Deploy Mediawiki Stream Enrichment on an-launcher1002. - https://phabricator.wikimedia.org/T323914 (10JArguello-WMF) 05Open→03Resolved [20:14:37] 10Data-Engineering-Planning, 10Event-Platform Value Stream (Sprint 07): We should provide utilities for local development and unit testing of Python streaming services - https://phabricator.wikimedia.org/T324951 (10JArguello-WMF) 05Open→03Resolved [20:14:41] 10Data-Engineering-Planning, 10Event-Platform Value Stream: [EPIC] Streaming and event driven Python services - https://phabricator.wikimedia.org/T324689 (10JArguello-WMF) [20:14:49] 10Data-Engineering-Planning, 10serviceops, 10Event-Platform Value Stream (Sprint 07): k8s deployment-charts mesh module should allow use of mesh without public_port Service - https://phabricator.wikimedia.org/T326252 (10JArguello-WMF) 05Open→03Resolved [20:14:59] 10Data-Engineering, 10serviceops, 10Discovery-Search (Current work), 10Event-Platform Value Stream (Sprint 07), 10Patch-For-Review: Flink on Kubernetes Helm charts - https://phabricator.wikimedia.org/T324576 (10JArguello-WMF) [20:15:11] 10Data-Engineering-Planning, 10serviceops, 10Event-Platform Value Stream (Sprint 07): k8s deployment-charts mesh module should allow use of mesh without public_port Service - https://phabricator.wikimedia.org/T326252 (10JArguello-WMF) 05Resolved→03Open [20:15:18] 10Data-Engineering, 10serviceops, 10Discovery-Search (Current work), 10Event-Platform Value Stream (Sprint 07), 10Patch-For-Review: Flink on Kubernetes Helm charts - https://phabricator.wikimedia.org/T324576 (10JArguello-WMF) [20:16:04] 10Data-Engineering-Planning, 10Event-Platform Value Stream, 10serviceops: k8s deployment-charts mesh module should allow use of mesh without public_port Service - https://phabricator.wikimedia.org/T326252 (10JArguello-WMF)