[00:20:03] <icinga-wm>	 PROBLEM - Check systemd state on an-web1001 is CRITICAL: CRITICAL - degraded: The following units failed: hardsync-published.service https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state
[00:31:57] <icinga-wm>	 RECOVERY - Check systemd state on an-web1001 is OK: OK - running: The system is fully operational https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state
[05:26:05] <wikibugs>	 10Data-Engineering, 10MediaWiki-extensions-EventLogging, 10Metrics-Platform, 10Epic, 10Patch-For-Review: [EPIC] Deprecate EventLogging::logEvent() - https://phabricator.wikimedia.org/T318263 (10phuedx)
[06:50:20] <wikibugs>	 10Data-Engineering-Kanban, 10Data Engineering Planning, 10Event-Platform Value Stream, 10Metrics-Platform, 10Patch-For-Review: Remove StreamConfig::INTERNAL_SETTINGS logic from EventStreamConfig and  do it in EventLogging client instead - https://phabricator.wikimedia.org/T286344 (10phuedx) Status update...
[06:51:05] <wikibugs>	 10Data-Engineering-Kanban, 10Data Engineering Planning, 10Event-Platform Value Stream, 10Metrics-Platform, 10Patch-For-Review: Remove StreamConfig::INTERNAL_SETTINGS logic from EventStreamConfig and  do it in EventLogging client instead - https://phabricator.wikimedia.org/T286344 (10phuedx) a:03phuedx
[07:35:15] <wikibugs>	 10Data-Engineering, 10Event-Platform Value Stream (Sprint 01), 10Patch-For-Review: Design Schema for page state and page state with content (enriched) streams - https://phabricator.wikimedia.org/T308017 (10daniel) >>! In T308017#8169868, @Ottomata wrote: > However, in the future, we'd like to support 'render...
[09:00:29] <wikibugs>	 10Analytics-Wikistats, 10Data Engineering Planning, 10Data Pipelines: Wikistats in Uzbek - https://phabricator.wikimedia.org/T314477 (10Nataev) Hi, @Milimetric! Thank you! Oʻzbekcha is the correct choice, as I've used the Latin script while translating. As for the numbers and dates, could I help translate th...
[09:03:12] <jinxer-wm>	 (VarnishkafkaNoMessages) firing: varnishkafka on cp4032 is not sending enough cache_text requests - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka - https://grafana.wikimedia.org/d/000000253/varnishkafka?orgId=1&var-datasource=ulsfo%20prometheus/ops&var-cp_cluster=cache_text&var-instance=cp4032%3A9132&viewPanel=14 - https://alerts.wikimedia.org/?q=alertname%3DVarnishkafkaNoMessages
[09:08:12] <jinxer-wm>	 (VarnishkafkaNoMessages) resolved: varnishkafka on cp4032 is not sending enough cache_text requests - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka - https://grafana.wikimedia.org/d/000000253/varnishkafka?orgId=1&var-datasource=ulsfo%20prometheus/ops&var-cp_cluster=cache_text&var-instance=cp4032%3A9132&viewPanel=14 - https://alerts.wikimedia.org/?q=alertname%3DVarnishkafkaNoMessages
[09:17:17] <wikibugs>	 10Data-Engineering, 10Data-Engineering-Kanban, 10Data Pipelines: Optimization of conda-analytics deb package - https://phabricator.wikimedia.org/T318397 (10Antoine_Quhen)
[10:38:49] <wikibugs>	 10Analytics, 10Pywikibot, 10Wikimedia-Site-requests: Provide some Pywikibot usage statistics for Python3.5 and 3.6 - https://phabricator.wikimedia.org/T312794 (10Xqt) @Urbanecm, @Legoktm: Do you have a bit time for this?
[11:16:14] <wikibugs>	 10Analytics, 10Pywikibot, 10Wikimedia-Site-requests, 10User-Urbanecm: Provide some Pywikibot usage statistics for Python3.5 and 3.6 - https://phabricator.wikimedia.org/T312794 (10Urbanecm) a:03Urbanecm >>! In T312794#8255382, @Xqt wrote: > @Urbanecm, @Legoktm: Do you have a bit time for this?  Sure thing.
[13:09:33] <wikibugs>	 10Data-Engineering, 10MediaWiki-extensions-EventLogging, 10Metrics-Platform, 10Epic, 10Patch-For-Review: [EPIC] Deprecate EventLogging::logEvent() - https://phabricator.wikimedia.org/T318263 (10phuedx)
[13:10:21] <wikibugs>	 10Data-Engineering, 10Discovery-Search: Migrate Search Airflow jobs to Airflow 3 and use shared supporting code from the data engineering Airflow - https://phabricator.wikimedia.org/T318414 (10Gehel)
[13:14:52] <wikibugs>	 (03PS17) 10Joal: Update refine to use Iceberg for event_sanitize [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/811212 (https://phabricator.wikimedia.org/T311739)
[13:30:31] <wikibugs>	 10Data-Engineering-Kanban, 10Cassandra, 10Data Engineering Planning, 10Shared-Data-Infrastructure, 10User-Eevans: Properly add aqsloader user (w/ secrets) - https://phabricator.wikimedia.org/T305600 (10Eevans)
[14:47:07] <wikibugs>	 (03CR) 10Mforns: [C: 03+2] "LGTM! Agree with 1)" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/833822 (owner: 10Xcollazo)
[14:59:30] <wikibugs>	 (03CR) 10Mforns: [V: 03+2 C: 03+2] Move remaining CREATE statements from hive/ to hql/ [analytics/refinery] - 10https://gerrit.wikimedia.org/r/833822 (owner: 10Xcollazo)
[16:31:09] <wikibugs>	 10Analytics-Radar, 10SRE, 10ops-eqiad: Try to move some new analytics worker nodes to different racks - https://phabricator.wikimedia.org/T276239 (10Jclark-ctr)
[16:36:57] <icinga-wm>	 PROBLEM - Check systemd state on an-launcher1002 is CRITICAL: CRITICAL - degraded: The following units failed: produce_canary_events.service https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state
[16:39:55] <icinga-wm>	 PROBLEM - Check unit status of produce_canary_events on an-launcher1002 is CRITICAL: CRITICAL: Status of the systemd unit produce_canary_events https://wikitech.wikimedia.org/wiki/Analytics/Systems/Managing_systemd_timers
[16:46:33] <icinga-wm>	 RECOVERY - Check systemd state on an-launcher1002 is OK: OK - running: The system is fully operational https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state
[16:51:19] <icinga-wm>	 RECOVERY - Check unit status of produce_canary_events on an-launcher1002 is OK: OK: Status of the systemd unit produce_canary_events https://wikitech.wikimedia.org/wiki/Analytics/Systems/Managing_systemd_timers
[16:55:45] <wikibugs>	 10Analytics, 10Pywikibot, 10Wikimedia-Site-requests, 10User-Urbanecm: Provide some Pywikibot usage statistics for Python3.5 and 3.6 - https://phabricator.wikimedia.org/T312794 (10Legoktm) Sorry, missed it when you initially filed the task. For the future, @xqt if you're willing to sign the [[https://wikite...
[17:12:27] <wikibugs>	 10Data-Engineering, 10API Platform, 10Platform Engineering Roadmap, 10User-Eevans: AQS 2.0: Unique Devices service - https://phabricator.wikimedia.org/T288298 (10FGoodwin)
[19:11:14] <mforns>	 !log deployed Airflow analytics for a quick fix
[19:11:16] <stashbot>	 Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log
[20:01:06] <wikibugs>	 (03CR) 10Xcollazo: "This commit just reinstates what was done on the CREATE statements on 7c5ffce." [analytics/refinery] - 10https://gerrit.wikimedia.org/r/834535 (owner: 10Xcollazo)
[20:11:33] <wikibugs>	 (03CR) 10Mforns: [C: 03+2] "LGTM!! Thanks a lot again :]" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/834535 (owner: 10Xcollazo)
[20:45:20] <wikibugs>	 10Analytics, 10Pywikibot, 10Wikimedia-Site-requests, 10User-Urbanecm: Provide some Pywikibot usage statistics for Python3.5 and 3.6 - https://phabricator.wikimedia.org/T312794 (10Urbanecm) +1 to Legoktm. I think the NDA group will be sufficient, as it empowers you to access Turnillo, where you can see comm...
[21:42:28] <wikibugs>	 10Analytics, 10Pywikibot, 10Wikimedia-Site-requests, 10User-Urbanecm: Provide some Pywikibot usage statistics for Python3.5 and 3.6 - https://phabricator.wikimedia.org/T312794 (10Urbanecm) Here you go:  | **pyth_version** | **reqs** | **%** | ----- | ----- | ----- | 3.7.3.final.0 | 804159555 | 43.49 | 3.9....
[21:45:37] <wikibugs>	 10Analytics, 10Pywikibot, 10Wikimedia-Site-requests, 10User-Urbanecm: Provide some Pywikibot usage statistics for Python3.5 and 3.6 - https://phabricator.wikimedia.org/T312794 (10Urbanecm) 05Open→03Resolved Closing this for now, as the requested numbers were generated. If you want any more details, fee...