[09:22:17] 10Data-Engineering, 10DBA: Prepare and check storage layer for blkwiki - https://phabricator.wikimedia.org/T310872 (10BTullis) 05Open→03Resolved I believe that this is complete now. ` btullis@tools-sgebastion-10:~$ sql blkwiki "select * from page limit 2" +---------+----------------+-----------------+-----... [09:32:46] 10Data-Engineering-Planning, 10serviceops, 10Discovery-Search (Current work), 10Event-Platform Value Stream (Sprint 07), 10Patch-For-Review: Flink on Kubernetes Helm charts - https://phabricator.wikimedia.org/T324576 (10JMeybohm) >>! In T324576#8517742, @Ottomata wrote: > So, I think the JobManager is no... [09:58:11] 10Data-Engineering, 10DBA, 10Data-Services: Prepare and check storage layer for pcmwiki - https://phabricator.wikimedia.org/T310879 (10BTullis) 05Open→03Resolved I believe that this is now complete. ` tullis@tools-sgebastion-10:~$ sql pcmwiki "select * from page limit 2" +---------+----------------+-----... [10:27:12] (VarnishkafkaNoMessages) firing: varnishkafka on cp3055 is not sending enough cache_upload requests - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka - https://grafana.wikimedia.org/d/000000253/varnishkafka?orgId=1&var-datasource=esams%20prometheus/ops&var-cp_cluster=cache_upload&var-instance=cp3055%3A9132&viewPanel=14 - https://alerts.wikimedia.org/?q=alertname%3DVarnishkafkaNoMessages [10:32:12] (VarnishkafkaNoMessages) resolved: varnishkafka on cp3055 is not sending enough cache_upload requests - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka - https://grafana.wikimedia.org/d/000000253/varnishkafka?orgId=1&var-datasource=esams%20prometheus/ops&var-cp_cluster=cache_upload&var-instance=cp3055%3A9132&viewPanel=14 - https://alerts.wikimedia.org/?q=alertname%3DVarnishkafkaNoMessages [14:15:59] 10Data-Engineering-Planning, 10Event-Platform Value Stream, 10Wikidata, 10Wikidata-Query-Service, 10Discovery-Search (Current work): Upgrade the WDQS streaming updater to latest flink (1.15) - https://phabricator.wikimedia.org/T289836 (10dcausse) a:03dcausse [14:58:22] 10Data-Engineering, 10Event-Platform Value Stream (Sprint 07), 10Patch-For-Review: Design Schema for page state and page state with content (enriched) streams - https://phabricator.wikimedia.org/T308017 (10Ottomata) Hm, uh oh, does our page properties assumption need changed? We said: > What is not MediaWi... [14:59:12] 10Data-Engineering, 10Event-Platform Value Stream (Sprint 07), 10Patch-For-Review: Design Schema for page state and page state with content (enriched) streams - https://phabricator.wikimedia.org/T308017 (10Ottomata) @Cparle, any thoughts about ^? [14:59:35] 10Data-Engineering, 10Event-Platform Value Stream (Sprint 07), 10Patch-For-Review: Design Schema for page state and page state with content (enriched) streams - https://phabricator.wikimedia.org/T308017 (10Ottomata) Actually, we are already going to capture revision slots in these events anyway...so if this... [15:10:34] 10Data-Engineering, 10DBA, 10Data-Services, 10cloud-services-team (Kanban): Prepare and check storage layer for guwwikiquote - https://phabricator.wikimedia.org/T321288 (10BTullis) 05Open→03Resolved I believe that this is now complete. ` btullis@tools-sgebastion-10:~$ sql guwwikiquote "select * from pa... [15:20:34] 10Data-Engineering-Planning, 10serviceops, 10Discovery-Search (Current work), 10Event-Platform Value Stream (Sprint 07), 10Patch-For-Review: Flink on Kubernetes Helm charts - https://phabricator.wikimedia.org/T324576 (10Ottomata) > Maybe the easier way out is to have the operator chart create a GlobalNet... [15:25:40] 10Data-Engineering-Planning, 10serviceops, 10Discovery-Search (Current work), 10Event-Platform Value Stream (Sprint 07), 10Patch-For-Review: Flink on Kubernetes Helm charts - https://phabricator.wikimedia.org/T324576 (10Ottomata) > Getting the NetworkPolicy right might be a bit tricky, though. That one w... [15:43:26] 10Data-Engineering-Planning, 10serviceops, 10Discovery-Search (Current work), 10Event-Platform Value Stream (Sprint 07), 10Patch-For-Review: Flink on Kubernetes Helm charts - https://phabricator.wikimedia.org/T324576 (10JMeybohm) >>! In T324576#8519921, @Ottomata wrote: >> Getting the NetworkPolicy right... [15:44:17] 10Data-Engineering, 10DBA, 10Data-Services, 10cloud-services-team (Kanban): Prepare and check storage layer for shnwikibooks - https://phabricator.wikimedia.org/T321256 (10BTullis) 05Open→03Resolved I believe that this is now complete. ` btullis@tools-sgebastion-10:~$ sql shnwikibooks "select * from pa... [16:32:15] 10Data-Engineering-Radar, 10MediaWiki-General: Update pingback MediaWiki versions to include new values - https://phabricator.wikimedia.org/T326825 (10CCicalese_WMF) [16:35:49] (03PS1) 10Cicalese: Update pingback MediaWiki versions to include new values [analytics/reportupdater-queries] - 10https://gerrit.wikimedia.org/r/879595 (https://phabricator.wikimedia.org/T326825) [16:43:33] 10Data-Engineering, 10DBA, 10Data-Services: Prepare and check storage layer for bjnwiktionary - https://phabricator.wikimedia.org/T312214 (10BTullis) 05Open→03Resolved [17:22:01] 10Data-Engineering, 10DBA, 10Data-Services, 10cloud-services-team (Kanban): Prepare and check storage layer for aswikiquote - https://phabricator.wikimedia.org/T321294 (10BTullis) 05Open→03Resolved I believe that this is now complete. ` btullis@tools-sgebastion-10:~$ sql aswikiquote "select * from page... [17:58:09] 10Data-Engineering, 10CheckUser, 10MW-1.38-notes (1.38.0-wmf.26; 2022-03-14), 10MW-1.39-notes (1.39.0-wmf.23; 2022-08-01), and 4 others: Update CheckUser for actor and comment table - https://phabricator.wikimedia.org/T233004 (10Marostegui) [21:53:41] 10Data-Engineering, 10IP Masking: Update Data Engineering-owned products that may be affected by IP Masking - https://phabricator.wikimedia.org/T326875 (10Tchanders)