[00:00:19] RECOVERY - Check systemd state on an-launcher1002 is OK: OK - running: The system is fully operational https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state [00:05:33] PROBLEM - Check systemd state on an-launcher1002 is CRITICAL: CRITICAL - degraded: The following units failed: produce_canary_events.service https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state [01:23:32] 10Data-Engineering-Planning, 10Data Pipelines, 10Pageviews-Anomaly, 10Wikipedia-iOS-App-Backlog, and 5 others: Analyze possible bot traffic for enwiki article Index (statistics), Index & XXX:_Return_of_Xander_Cage - https://phabricator.wikimedia.org/T328127 (10SNowick_WMF) Pulled pageview counts and flagge... [01:45:28] RECOVERY - Check systemd state on an-launcher1002 is OK: OK - running: The system is fully operational https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state [01:50:16] PROBLEM - Check systemd state on an-launcher1002 is CRITICAL: CRITICAL - degraded: The following units failed: produce_canary_events.service https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state [01:51:32] 10Data-Engineering-Planning, 10Shared-Data-Infrastructure: Requesting Kerberos identity for Hxi-ctr - https://phabricator.wikimedia.org/T325857 (10HXi-WMF) Thank you so much! I'm able to login now. @BTullis Really appreciate it! [02:00:10] RECOVERY - Check systemd state on an-launcher1002 is OK: OK - running: The system is fully operational https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state [02:03:14] PROBLEM - Check systemd state on an-launcher1002 is CRITICAL: CRITICAL - degraded: The following units failed: produce_canary_events.service https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state [02:15:06] RECOVERY - Check systemd state on an-launcher1002 is OK: OK - running: The system is fully operational https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state [02:19:16] PROBLEM - Check systemd state on an-launcher1002 is CRITICAL: CRITICAL - degraded: The following units failed: produce_canary_events.service https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state [02:30:12] RECOVERY - Check systemd state on an-launcher1002 is OK: OK - running: The system is fully operational https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state [02:35:22] PROBLEM - Check systemd state on an-launcher1002 is CRITICAL: CRITICAL - degraded: The following units failed: produce_canary_events.service https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state [03:00:35] RECOVERY - Check systemd state on an-launcher1002 is OK: OK - running: The system is fully operational https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state [03:04:31] PROBLEM - Check systemd state on an-launcher1002 is CRITICAL: CRITICAL - degraded: The following units failed: produce_canary_events.service https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state [03:30:13] RECOVERY - Check systemd state on an-launcher1002 is OK: OK - running: The system is fully operational https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state [03:35:23] PROBLEM - Check systemd state on an-launcher1002 is CRITICAL: CRITICAL - degraded: The following units failed: produce_canary_events.service https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state [04:15:09] RECOVERY - Check systemd state on an-launcher1002 is OK: OK - running: The system is fully operational https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state [04:20:21] PROBLEM - Check systemd state on an-launcher1002 is CRITICAL: CRITICAL - degraded: The following units failed: produce_canary_events.service https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state [05:00:13] RECOVERY - Check systemd state on an-launcher1002 is OK: OK - running: The system is fully operational https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state [05:05:25] PROBLEM - Check systemd state on an-launcher1002 is CRITICAL: CRITICAL - degraded: The following units failed: produce_canary_events.service https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state [05:45:17] RECOVERY - Check systemd state on an-launcher1002 is OK: OK - running: The system is fully operational https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state [05:50:31] PROBLEM - Check systemd state on an-launcher1002 is CRITICAL: CRITICAL - degraded: The following units failed: produce_canary_events.service https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state [06:30:33] RECOVERY - Check systemd state on an-launcher1002 is OK: OK - running: The system is fully operational https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state [06:31:10] 10Data-Engineering, 10DBA, 10Data-Services, 10cloud-services-team: Prepare and check storage layer for aswikiquote - https://phabricator.wikimedia.org/T326885 (10Marostegui) a:05Marostegui→03None `_p` database created and the grants added. This is ready for the views creation. [06:35:45] PROBLEM - Check systemd state on an-launcher1002 is CRITICAL: CRITICAL - degraded: The following units failed: produce_canary_events.service https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state [07:00:07] RECOVERY - Check systemd state on an-launcher1002 is OK: OK - running: The system is fully operational https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state [07:05:21] PROBLEM - Check systemd state on an-launcher1002 is CRITICAL: CRITICAL - degraded: The following units failed: produce_canary_events.service https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state [07:45:25] RECOVERY - Check systemd state on an-launcher1002 is OK: OK - running: The system is fully operational https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state [07:50:39] PROBLEM - Check systemd state on an-launcher1002 is CRITICAL: CRITICAL - degraded: The following units failed: produce_canary_events.service https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state [08:03:18] (DruidSegmentsUnavailable) firing: More than 10 segments have been unavailable for edits_hourly on the druid_analytics Druid cluster. - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Druid/Alerts#Druid_Segments_Unavailable - https://grafana.wikimedia.org/d/000000538/druid?refresh=1m&var-cluster=druid_analytics&panelId=49&fullscreen&orgId=1 - https://alerts.wikimedia.org/?q=alertname%3DDruidSegmentsUnavailable [08:13:18] (DruidSegmentsUnavailable) resolved: More than 10 segments have been unavailable for edits_hourly on the druid_analytics Druid cluster. - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Druid/Alerts#Druid_Segments_Unavailable - https://grafana.wikimedia.org/d/000000538/druid?refresh=1m&var-cluster=druid_analytics&panelId=49&fullscreen&orgId=1 - https://alerts.wikimedia.org/?q=alertname%3DDruidSegmentsUnavailable [08:15:09] RECOVERY - Check systemd state on an-launcher1002 is OK: OK - running: The system is fully operational https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state [08:20:25] PROBLEM - Check systemd state on an-launcher1002 is CRITICAL: CRITICAL - degraded: The following units failed: produce_canary_events.service https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state [08:26:03] !log refinery-deploy-to-hdfs run4 [08:26:04] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [08:32:31] (03CR) 10Joal: [C: 04-1] "You have removed tests that were failing for good reasons. This is not an approach that works :) I'll provide a patch solving the issue." [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/864772 (https://phabricator.wikimedia.org/T309769) (owner: 10Snwachukwu) [08:32:55] (03PS16) 10Joal: Refactor and Expand External referer classification [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/864772 (https://phabricator.wikimedia.org/T309769) (owner: 10Snwachukwu) [08:39:20] 10Data-Engineering, 10Event-Platform Value Stream: Refactor parameterization of eventutilities-python and mediawiki-event-enrichment - https://phabricator.wikimedia.org/T328478 (10dcausse) ParameterTool is nice but @pfischer has found a really nice abstraction on top of it, you define your options using a set... [08:44:23] 10Data-Engineering-Planning, 10Data Pipelines, 10Pageviews-Anomaly, 10Product-Analytics, and 2 others: Analyze possible bot traffic for frwiki article Cookie (informatique) - https://phabricator.wikimedia.org/T313114 (10ayounsi) Nice! For example we could imagine someone doing QA testing of a browser from... [08:44:36] !log Deployed refinery using scap, then deployed onto hdfs [08:44:37] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [08:51:04] 10Data-Engineering, 10Event-Platform Value Stream: Refactor parameterization of eventutilities-python and mediawiki-event-enrichment - https://phabricator.wikimedia.org/T328478 (10dcausse) >>! In T328478#8578535, @Ottomata wrote: >> From the point of view of a k8s and helm operator, are there best practices w... [08:59:18] (DruidSegmentsUnavailable) firing: More than 10 segments have been unavailable for mediawiki_history_reduced_2023_01 on the druid_public Druid cluster. - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Druid/Alerts#Druid_Segments_Unavailable - https://grafana.wikimedia.org/d/000000538/druid?refresh=1m&var-cluster=druid_public&panelId=49&fullscreen&orgId=1 - https://alerts.wikimedia.org/?q=alertname%3DDruidSegmentsUnavailable [09:00:05] RECOVERY - Check systemd state on an-launcher1002 is OK: OK - running: The system is fully operational https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state [09:05:25] PROBLEM - Check systemd state on an-launcher1002 is CRITICAL: CRITICAL - degraded: The following units failed: produce_canary_events.service https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state [09:19:18] (DruidSegmentsUnavailable) resolved: More than 10 segments have been unavailable for mediawiki_history_reduced_2023_01 on the druid_public Druid cluster. - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Druid/Alerts#Druid_Segments_Unavailable - https://grafana.wikimedia.org/d/000000538/druid?refresh=1m&var-cluster=druid_public&panelId=49&fullscreen&orgId=1 - https://alerts.wikimedia.org/?q=alertname%3DDruidSegmentsUnavailable [09:45:15] RECOVERY - Check systemd state on an-launcher1002 is OK: OK - running: The system is fully operational https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state [09:50:33] PROBLEM - Check systemd state on an-launcher1002 is CRITICAL: CRITICAL - degraded: The following units failed: produce_canary_events.service https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state [09:52:39] !log beginning a rolling reboot of all aqs servers for T326945 [09:52:41] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [09:52:41] T326945: Decide on installation details for new ceph cluster - https://phabricator.wikimedia.org/T326945 [09:56:27] !log correction: beginning a rolling reboot of all aqs servers for T325132 [09:56:29] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [10:30:02] RECOVERY - Check systemd state on an-launcher1002 is OK: OK - running: The system is fully operational https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state [10:59:54] 10Data-Engineering-Planning, 10Data Pipelines, 10Pageviews-Anomaly, 10Product-Analytics, and 2 others: Analyze possible bot traffic for frwiki article Cookie (informatique) - https://phabricator.wikimedia.org/T313114 (10PBradley-WMF) Is Google Search Console able to provide any insights here? @mpopov [11:30:12] (VarnishkafkaNoMessages) firing: varnishkafka on cp2033 is not sending enough cache_text requests - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka - https://grafana.wikimedia.org/d/000000253/varnishkafka?orgId=1&var-datasource=codfw%20prometheus/ops&var-cp_cluster=cache_text&var-instance=cp2033%3A9132&viewPanel=14 - https://alerts.wikimedia.org/?q=alertname%3DVarnishkafkaNoMessages [11:35:12] (VarnishkafkaNoMessages) resolved: varnishkafka on cp2033 is not sending enough cache_text requests - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka - https://grafana.wikimedia.org/d/000000253/varnishkafka?orgId=1&var-datasource=codfw%20prometheus/ops&var-cp_cluster=cache_text&var-instance=cp2033%3A9132&viewPanel=14 - https://alerts.wikimedia.org/?q=alertname%3DVarnishkafkaNoMessages [11:58:33] 10Data-Engineering-Planning, 10Event-Platform Value Stream (Sprint 08), 10Patch-For-Review: Tests for mediawiki-stream-enrichment-python flink job via eventutilities-python - https://phabricator.wikimedia.org/T326565 (10gmodena) This task significantly improved test coverage for `eventutilies-python`, and he... [12:18:42] 10Data-Engineering-Planning, 10Shared-Data-Infrastructure: Requesting Kerberos identity for Hxi-ctr - https://phabricator.wikimedia.org/T325857 (10BTullis) 05Open→03Resolved Great! I'm so glad to hear it Hua. [12:25:23] 10Data-Engineering-Planning, 10Superset, 10Patch-For-Review, 10Shared-Data-Infrastructure (Shared-Data-Infra Sprint 08): Error when displaying box plots in Superset - https://phabricator.wikimedia.org/T328047 (10BTullis) p:05Triage→03High [12:26:10] !log deploying the updated build of superset to production T328047 [12:26:13] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [12:26:13] T328047: Error when displaying box plots in Superset - https://phabricator.wikimedia.org/T328047 [12:27:35] (03CR) 10Btullis: [V: 03+2 C: 03+2] Build new version of superset with pinned numpy version [analytics/superset/deploy] - 10https://gerrit.wikimedia.org/r/885836 (https://phabricator.wikimedia.org/T328047) (owner: 10Btullis) [12:35:27] (03PS1) 10Mazevedo: Add MobileWikiAppiOSSessions schema to MEP [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/886029 [12:35:56] (03CR) 10CI reject: [V: 04-1] Add MobileWikiAppiOSSessions schema to MEP [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/886029 (owner: 10Mazevedo) [12:36:44] (03PS2) 10Mazevedo: Add MobileWikiAppiOSSessions schema to MEP [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/886029 (https://phabricator.wikimedia.org/T328621) [12:37:07] (03CR) 10CI reject: [V: 04-1] Add MobileWikiAppiOSSessions schema to MEP [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/886029 (https://phabricator.wikimedia.org/T328621) (owner: 10Mazevedo) [12:40:10] (03PS3) 10Mazevedo: Add MobileWikiAppiOSSessions schema to MEP [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/886029 (https://phabricator.wikimedia.org/T328621) [12:40:37] (03CR) 10CI reject: [V: 04-1] Add MobileWikiAppiOSSessions schema to MEP [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/886029 (https://phabricator.wikimedia.org/T328621) (owner: 10Mazevedo) [12:43:10] (03PS4) 10Mazevedo: Add MobileWikiAppiOSSessions schema to MEP [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/886029 (https://phabricator.wikimedia.org/T328621) [12:46:41] 10Data-Engineering, 10Equity-Landscape: Grants output metrics - https://phabricator.wikimedia.org/T306620 (10ntsako) 05In progress→03Resolved [12:46:43] 10Data-Engineering, 10Equity-Landscape: Milestone: Ingest and Transform Input Data - https://phabricator.wikimedia.org/T305475 (10ntsako) [12:46:48] 10Data-Engineering, 10Equity-Landscape: Overall Engagement output rank metric - https://phabricator.wikimedia.org/T306622 (10ntsako) 05Open→03Resolved [12:46:50] 10Data-Engineering, 10Equity-Landscape: Milestone: Ingest and Transform Input Data - https://phabricator.wikimedia.org/T305475 (10ntsako) [12:46:56] 10Data-Engineering, 10Equity-Landscape: Affiliates output rank metrics - https://phabricator.wikimedia.org/T306619 (10ntsako) 05Open→03Resolved [12:46:58] 10Data-Engineering, 10Equity-Landscape: Milestone: Ingest and Transform Input Data - https://phabricator.wikimedia.org/T305475 (10ntsako) [12:47:03] 10Data-Engineering, 10Equity-Landscape: Extract + Transformation Raw Data into Input Metrics - https://phabricator.wikimedia.org/T306625 (10ntsako) [12:47:06] 10Data-Engineering, 10Equity-Landscape: Affiliates input metric - https://phabricator.wikimedia.org/T309275 (10ntsako) 05In progress→03Resolved [12:47:12] 10Data-Engineering, 10Equity-Landscape: Extract + Transformation Raw Data into Input Metrics - https://phabricator.wikimedia.org/T306625 (10ntsako) [12:47:15] 10Data-Engineering, 10Equity-Landscape: Grants input metric - https://phabricator.wikimedia.org/T309276 (10ntsako) 05In progress→03Resolved [12:49:27] 10Data-Engineering-Planning, 10Superset, 10Shared-Data-Infrastructure (Shared-Data-Infra Sprint 08): Error when displaying box plots in Superset - https://phabricator.wikimedia.org/T328047 (10BTullis) 05Open→03Resolved a:03BTullis The graph here looks good to me now: https://superset.wikimedia.org/supe... [13:36:12] (VarnishkafkaNoMessages) firing: varnishkafka on cp1076 is not sending enough cache_upload requests - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka - https://grafana.wikimedia.org/d/000000253/varnishkafka?orgId=1&var-datasource=eqiad%20prometheus/ops&var-cp_cluster=cache_upload&var-instance=cp1076%3A9132&viewPanel=14 - https://alerts.wikimedia.org/?q=alertname%3DVarnishkafkaNoMessages [13:41:12] (VarnishkafkaNoMessages) resolved: varnishkafka on cp1076 is not sending enough cache_upload requests - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka - https://grafana.wikimedia.org/d/000000253/varnishkafka?orgId=1&var-datasource=eqiad%20prometheus/ops&var-cp_cluster=cache_upload&var-instance=cp1076%3A9132&viewPanel=14 - https://alerts.wikimedia.org/?q=alertname%3DVarnishkafkaNoMessages [13:41:49] 10Data-Engineering-Planning, 10Cassandra, 10Image-Suggestions, 10Section-Level-Image-Suggestions: Section Level Image Suggestions - Data Persistence Request - https://phabricator.wikimedia.org/T320831 (10mfossati) >>! In T320831#8571643, @Eevans wrote: >> * Do we have a Cassandra test instance that SD engi... [14:06:53] (03PS4) 10Joal: Add webrequest and pageview actor scripts [analytics/refinery] - 10https://gerrit.wikimedia.org/r/884359 (https://phabricator.wikimedia.org/T324483) [14:09:34] (03CR) 10Joal: "I removed changes to oozie by including pageview_actor that doesn't require the changes. Change have been tested and the data vetted (it a" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/884359 (https://phabricator.wikimedia.org/T324483) (owner: 10Joal) [15:04:28] 10Data-Engineering-Planning, 10Data Pipelines, 10Infrastructure-Foundations, 10Shared-Data-Infrastructure: Also intake Network Error Logging events into the Analytics Data Lake - https://phabricator.wikimedia.org/T304373 (10Ottomata) > Can I ask, what's the issue with deploying to the DSE cluster? We could... [15:13:12] (VarnishkafkaNoMessages) firing: (3) varnishkafka on cp1075 is not sending enough cache_text requests - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka - https://alerts.wikimedia.org/?q=alertname%3DVarnishkafkaNoMessages [15:15:11] 10Data-Engineering-Planning, 10Data Pipelines, 10Pageviews-Anomaly, 10Product-Analytics, and 2 others: Analyze possible bot traffic for frwiki article Cookie (informatique) - https://phabricator.wikimedia.org/T313114 (10mpopov) @PBradley-WMF: Nope. It very infrequently shows up in top 10 search results whe... [15:18:12] (VarnishkafkaNoMessages) resolved: (3) varnishkafka on cp1075 is not sending enough cache_text requests - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka - https://alerts.wikimedia.org/?q=alertname%3DVarnishkafkaNoMessages [15:33:41] (VarnishkafkaNoMessages) firing: varnishkafka on cp4038 is not sending enough cache_text requests - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka - https://grafana.wikimedia.org/d/000000253/varnishkafka?orgId=1&var-datasource=ulsfo%20prometheus/ops&var-cp_cluster=cache_text&var-instance=cp4038%3A9132&viewPanel=14 - https://alerts.wikimedia.org/?q=alertname%3DVarnishkafkaNoMessages [15:33:42] (VarnishkafkaNoMessages) firing: varnishkafka on cp4038 is not sending enough cache_text requests - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka - https://grafana.wikimedia.org/d/000000253/varnishkafka?orgId=1&var-datasource=ulsfo%20prometheus/ops&var-cp_cluster=cache_text&var-instance=cp4038%3A9132&viewPanel=14 - https://alerts.wikimedia.org/?q=alertname%3DVarnishkafkaNoMessages [15:38:42] (VarnishkafkaNoMessages) resolved: (5) varnishkafka on cp1077 is not sending enough cache_text requests - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka - https://alerts.wikimedia.org/?q=alertname%3DVarnishkafkaNoMessages [15:38:42] (VarnishkafkaNoMessages) resolved: (5) varnishkafka on cp1077 is not sending enough cache_text requests - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka - https://alerts.wikimedia.org/?q=alertname%3DVarnishkafkaNoMessages [15:49:14] 10Data-Engineering-Planning, 10Data Pipelines (Sprint 07), 10Product-Analytics (Kanban): Include EU Registered Country in the canonical country database - https://phabricator.wikimedia.org/T324995 (10mforns) Thank you @nshahquinn-wmf ! [15:56:12] (VarnishkafkaNoMessages) firing: varnishkafka on cp3054 is not sending enough cache_text requests - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka - https://grafana.wikimedia.org/d/000000253/varnishkafka?orgId=1&var-datasource=esams%20prometheus/ops&var-cp_cluster=cache_text&var-instance=cp3054%3A9132&viewPanel=14 - https://alerts.wikimedia.org/?q=alertname%3DVarnishkafkaNoMessages [15:56:12] (VarnishkafkaNoMessages) firing: (2) varnishkafka on cp1079 is not sending enough cache_text requests - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka - https://alerts.wikimedia.org/?q=alertname%3DVarnishkafkaNoMessages [15:57:27] 10Data-Engineering-Planning, 10Data Pipelines, 10Pageviews-Anomaly, 10Product-Analytics, and 2 others: Analyze possible bot traffic for frwiki article Cookie (informatique) - https://phabricator.wikimedia.org/T313114 (10PBradley-WMF) I'm wondering about the Links report - does it tell us which third party... [16:01:12] (VarnishkafkaNoMessages) resolved: (4) varnishkafka on cp1079 is not sending enough cache_text requests - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka - https://alerts.wikimedia.org/?q=alertname%3DVarnishkafkaNoMessages [16:01:12] (VarnishkafkaNoMessages) resolved: (3) varnishkafka on cp1079 is not sending enough cache_text requests - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka - https://alerts.wikimedia.org/?q=alertname%3DVarnishkafkaNoMessages [16:16:12] (VarnishkafkaNoMessages) firing: varnishkafka on cp2033 is not sending enough cache_text requests - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka - https://grafana.wikimedia.org/d/000000253/varnishkafka?orgId=1&var-datasource=codfw%20prometheus/ops&var-cp_cluster=cache_text&var-instance=cp2033%3A9132&viewPanel=14 - https://alerts.wikimedia.org/?q=alertname%3DVarnishkafkaNoMessages [16:21:12] (VarnishkafkaNoMessages) resolved: (4) varnishkafka on cp1081 is not sending enough cache_text requests - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka - https://alerts.wikimedia.org/?q=alertname%3DVarnishkafkaNoMessages [16:38:13] (VarnishkafkaNoMessages) firing: varnishkafka on cp5021 is not sending enough cache_text requests - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka - https://grafana.wikimedia.org/d/000000253/varnishkafka?orgId=1&var-datasource=eqsin%20prometheus/ops&var-cp_cluster=cache_text&var-instance=cp5021%3A9132&viewPanel=14 - https://alerts.wikimedia.org/?q=alertname%3DVarnishkafkaNoMessages [16:39:12] (VarnishkafkaNoMessages) firing: varnishkafka on cp3058 is not sending enough cache_text requests - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka - https://grafana.wikimedia.org/d/000000253/varnishkafka?orgId=1&var-datasource=esams%20prometheus/ops&var-cp_cluster=cache_text&var-instance=cp3058%3A9132&viewPanel=14 - https://alerts.wikimedia.org/?q=alertname%3DVarnishkafkaNoMessages [16:43:12] (VarnishkafkaNoMessages) resolved: (2) varnishkafka on cp3058 is not sending enough cache_text requests - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka - https://alerts.wikimedia.org/?q=alertname%3DVarnishkafkaNoMessages [16:44:12] (VarnishkafkaNoMessages) resolved: varnishkafka on cp3058 is not sending enough cache_text requests - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka - https://grafana.wikimedia.org/d/000000253/varnishkafka?orgId=1&var-datasource=esams%20prometheus/ops&var-cp_cluster=cache_text&var-instance=cp3058%3A9132&viewPanel=14 - https://alerts.wikimedia.org/?q=alertname%3DVarnishkafkaNoMessages [16:57:12] (VarnishkafkaNoMessages) firing: varnishkafka on cp2037 is not sending enough cache_text requests - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka - https://grafana.wikimedia.org/d/000000253/varnishkafka?orgId=1&var-datasource=codfw%20prometheus/ops&var-cp_cluster=cache_text&var-instance=cp2037%3A9132&viewPanel=14 - https://alerts.wikimedia.org/?q=alertname%3DVarnishkafkaNoMessages [17:02:12] (VarnishkafkaNoMessages) resolved: (3) varnishkafka on cp2037 is not sending enough cache_text requests - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka - https://alerts.wikimedia.org/?q=alertname%3DVarnishkafkaNoMessages [17:16:03] (03PS1) 10Mforns: Support snapshot partitioning in HiveToDruid and DataFrameToDruid [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/886114 (https://phabricator.wikimedia.org/T324485) [17:21:12] (VarnishkafkaNoMessages) firing: varnishkafka on cp1087 is not sending enough cache_text requests - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka - https://grafana.wikimedia.org/d/000000253/varnishkafka?orgId=1&var-datasource=eqiad%20prometheus/ops&var-cp_cluster=cache_text&var-instance=cp1087%3A9132&viewPanel=14 - https://alerts.wikimedia.org/?q=alertname%3DVarnishkafkaNoMessages [17:26:12] (VarnishkafkaNoMessages) resolved: varnishkafka on cp1087 is not sending enough cache_text requests - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka - https://grafana.wikimedia.org/d/000000253/varnishkafka?orgId=1&var-datasource=eqiad%20prometheus/ops&var-cp_cluster=cache_text&var-instance=cp1087%3A9132&viewPanel=14 - https://alerts.wikimedia.org/?q=alertname%3DVarnishkafkaNoMessages [17:29:26] (03CR) 10Ottomata: Support snapshot partitioning in HiveToDruid and DataFrameToDruid (031 comment) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/886114 (https://phabricator.wikimedia.org/T324485) (owner: 10Mforns) [17:43:12] (VarnishkafkaNoMessages) firing: varnishkafka on cp3064 is not sending enough cache_text requests - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka - https://grafana.wikimedia.org/d/000000253/varnishkafka?orgId=1&var-datasource=esams%20prometheus/ops&var-cp_cluster=cache_text&var-instance=cp3064%3A9132&viewPanel=14 - https://alerts.wikimedia.org/?q=alertname%3DVarnishkafkaNoMessages [17:48:12] (VarnishkafkaNoMessages) resolved: varnishkafka on cp3064 is not sending enough cache_text requests - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka - https://grafana.wikimedia.org/d/000000253/varnishkafka?orgId=1&var-datasource=esams%20prometheus/ops&var-cp_cluster=cache_text&var-instance=cp3064%3A9132&viewPanel=14 - https://alerts.wikimedia.org/?q=alertname%3DVarnishkafkaNoMessages [18:52:51] (03PS1) 10Mazevedo: Add MobileWikiAppiOSSettingAction scgema to MEP [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/886136 (https://phabricator.wikimedia.org/T328690) [18:54:19] (03PS2) 10Mazevedo: Add MobileWikiAppiOSSettingAction schema to MEP [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/886136 (https://phabricator.wikimedia.org/T328690) [19:20:42] (03PS1) 10Mazevedo: Add MobileWikiAppiOSLoginAction schema to MEP [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/886141 (https://phabricator.wikimedia.org/T328697) [19:21:09] (03CR) 10CI reject: [V: 04-1] Add MobileWikiAppiOSLoginAction schema to MEP [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/886141 (https://phabricator.wikimedia.org/T328697) (owner: 10Mazevedo) [19:24:05] (03PS2) 10Mazevedo: Add MobileWikiAppiOSLoginAction schema to MEP [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/886141 (https://phabricator.wikimedia.org/T328697) [19:36:21] (03CR) 10Tsevener: [C: 03+2] "Looks good, thanks!" [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/885004 (https://phabricator.wikimedia.org/T328312) (owner: 10Mazevedo) [19:40:48] (03Merged) 10jenkins-bot: Add MobileWikiAppiOSUserHistory to MEP [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/885004 (https://phabricator.wikimedia.org/T328312) (owner: 10Mazevedo) [19:52:31] 10Data-Engineering-Planning, 10Cassandra, 10Image-Suggestions, 10Section-Level-Image-Suggestions: Section Level Image Suggestions - Data Persistence Request - https://phabricator.wikimedia.org/T320831 (10Eevans) >>! In T320831#8582199, @mfossati wrote: >>>! In T320831#8571643, @Eevans wrote: >>> * Do we ha... [19:54:05] (03CR) 10Tsevener: [C: 03+2] Add iOS schema MobileWikiAppiOSSearch to MEP [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/885904 (https://phabricator.wikimedia.org/T328604) (owner: 10Mazevedo) [19:54:37] (03Merged) 10jenkins-bot: Add iOS schema MobileWikiAppiOSSearch to MEP [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/885904 (https://phabricator.wikimedia.org/T328604) (owner: 10Mazevedo) [20:03:17] (03CR) 10Tsevener: [C: 03+2] Add MobileWikiAppiOSSessions schema to MEP [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/886029 (https://phabricator.wikimedia.org/T328621) (owner: 10Mazevedo) [20:03:52] (03Merged) 10jenkins-bot: Add MobileWikiAppiOSSessions schema to MEP [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/886029 (https://phabricator.wikimedia.org/T328621) (owner: 10Mazevedo) [20:10:17] (03CR) 10Tsevener: [C: 03+2] Add MobileWikiAppiOSSettingAction schema to MEP [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/886136 (https://phabricator.wikimedia.org/T328690) (owner: 10Mazevedo) [20:10:47] (03Merged) 10jenkins-bot: Add MobileWikiAppiOSSettingAction schema to MEP [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/886136 (https://phabricator.wikimedia.org/T328690) (owner: 10Mazevedo) [20:19:15] (03CR) 10Tsevener: [C: 04-1] Add MobileWikiAppiOSLoginAction schema to MEP (031 comment) [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/886141 (https://phabricator.wikimedia.org/T328697) (owner: 10Mazevedo) [20:23:23] 10Data-Engineering-Planning, 10Data Pipelines, 10Discovery-Search (Current work), 10Patch-For-Review: Create airflow v2 instance and supporting repos for search platform - https://phabricator.wikimedia.org/T327970 (10RKemper) Just for some further context, here's a previous ticket where an airflow ganeti h... [20:31:25] 10Data-Engineering-Planning, 10Data Pipelines, 10Discovery-Search (Current work), 10Patch-For-Review: Create airflow v2 instance and supporting repos for search platform - https://phabricator.wikimedia.org/T327970 (10RKemper) And here's our request ticket for `an-airflow1005`: https://phabricator.wikimedia... [20:48:57] 10Data-Engineering, 10Event-Platform Value Stream: Refactor parameterization of eventutilities-python and mediawiki-event-enrichment - https://phabricator.wikimedia.org/T328478 (10gmodena) >>! In T328478#8578535, @Ottomata wrote: >>> In refinery-source, we have a Scala ConfigHelper that does just this. >> Woul... [20:56:34] 10Data-Engineering, 10Event-Platform Value Stream: Refactor parameterization of eventutilities-python and mediawiki-event-enrichment - https://phabricator.wikimedia.org/T328478 (10gmodena) >>! In T328478#8581389, @dcausse wrote: > I think it's important for the `flink-app` chart to have a way to pass and/or po... [21:47:44] 10Data-Engineering, 10Equity-Landscape: Population input metrics - https://phabricator.wikimedia.org/T309279 (10JAnstee_WMF) @ntsako There is one column needing renaming in the inputs file ntsako.population_data_input_metrics population_thousands should be changed to population_total