[01:37:13] <jinxer-wm>	 (DiskSpace) firing: Disk space stat1008:9100:/srv 5.692% free - https://wikitech.wikimedia.org/wiki/Monitoring/Disk_space - https://grafana.wikimedia.org/d/000000377/host-overview?orgId=1&viewPanel=12&var-server=stat1008 - https://alerts.wikimedia.org/?q=alertname%3DDiskSpace
[03:52:27] <jinxer-wm>	 (HiveServerHeapUsage) firing: Hive Server JVM Heap usage is above 80% on an-coord1001:10100 - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Hive/Alerts#Hive_Server_Heap_Usage - https://grafana.wikimedia.org/d/000000379/hive?panelId=7&fullscreen&orgId=1&var-instance=an-coord1001:10100 - https://alerts.wikimedia.org/?q=alertname%3DHiveServerHeapUsage
[05:37:13] <jinxer-wm>	 (DiskSpace) firing: Disk space stat1008:9100:/srv 5.664% free - https://wikitech.wikimedia.org/wiki/Monitoring/Disk_space - https://grafana.wikimedia.org/d/000000377/host-overview?orgId=1&viewPanel=12&var-server=stat1008 - https://alerts.wikimedia.org/?q=alertname%3DDiskSpace
[07:22:27] <jinxer-wm>	 (HiveServerHeapUsage) resolved: Hive Server JVM Heap usage is above 80% on an-coord1001:10100 - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Hive/Alerts#Hive_Server_Heap_Usage - https://grafana.wikimedia.org/d/000000379/hive?panelId=7&fullscreen&orgId=1&var-instance=an-coord1001:10100 - https://alerts.wikimedia.org/?q=alertname%3DHiveServerHeapUsage
[09:37:13] <jinxer-wm>	 (DiskSpace) firing: Disk space stat1008:9100:/srv 5.618% free - https://wikitech.wikimedia.org/wiki/Monitoring/Disk_space - https://grafana.wikimedia.org/d/000000377/host-overview?orgId=1&viewPanel=12&var-server=stat1008 - https://alerts.wikimedia.org/?q=alertname%3DDiskSpace
[11:01:27] <jinxer-wm>	 (HiveServerHeapUsage) firing: Hive Server JVM Heap usage is above 80% on an-coord1001:10100 - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Hive/Alerts#Hive_Server_Heap_Usage - https://grafana.wikimedia.org/d/000000379/hive?panelId=7&fullscreen&orgId=1&var-instance=an-coord1001:10100 - https://alerts.wikimedia.org/?q=alertname%3DHiveServerHeapUsage
[11:24:55] <wikibugs>	 10Data-Engineering, 10Data-Engineering-Wikistats, 10I18n, 10Patch-For-Review, and 2 others: Support right-to-left languages in Wikistats - https://phabricator.wikimedia.org/T251376 (10Amire80) >>! In T251376#8866572, @gerritbot wrote: > Change 921439 had a related patch set uploaded (by Amire80; author: Ni...
[13:31:27] <jinxer-wm>	 (HiveServerHeapUsage) resolved: Hive Server JVM Heap usage is above 80% on an-coord1001:10100 - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Hive/Alerts#Hive_Server_Heap_Usage - https://grafana.wikimedia.org/d/000000379/hive?panelId=7&fullscreen&orgId=1&var-instance=an-coord1001:10100 - https://alerts.wikimedia.org/?q=alertname%3DHiveServerHeapUsage
[13:37:13] <jinxer-wm>	 (DiskSpace) firing: Disk space stat1008:9100:/srv 5.541% free - https://wikitech.wikimedia.org/wiki/Monitoring/Disk_space - https://grafana.wikimedia.org/d/000000377/host-overview?orgId=1&viewPanel=12&var-server=stat1008 - https://alerts.wikimedia.org/?q=alertname%3DDiskSpace
[15:03:29] <jinxer-wm>	 (SystemdUnitFailed) firing: produce_canary_events.service Failed on an-launcher1002:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed
[15:04:07] <icinga-wm>	 PROBLEM - Check systemd state on an-launcher1002 is CRITICAL: CRITICAL - degraded: The following units failed: produce_canary_events.service https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state
[15:16:29] <icinga-wm>	 RECOVERY - Check systemd state on an-launcher1002 is OK: OK - running: The system is fully operational https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state
[15:18:29] <jinxer-wm>	 (SystemdUnitFailed) resolved: produce_canary_events.service Failed on an-launcher1002:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed
[16:53:55] <wikibugs>	 10Data-Engineering, 10Data-release, 10Privacy Engineering, 10Research, 10Privacy: Evaluate a differentially private solution to release wikipedia's  project-title-country data - https://phabricator.wikimedia.org/T267283 (10Nuria) This data was released. Due to various technical factors, there are three d...
[17:00:26] <wikibugs>	 10Data-Engineering, 10Data-Engineering-Wikistats, 10Inuka-Team, 10Language-strategy, and 2 others: Have a way to show the most popular pages per country - https://phabricator.wikimedia.org/T207171 (10Nuria) This data was released. Due to various technical factors, there are three distinct datasets: https:/...
[17:37:13] <jinxer-wm>	 (DiskSpace) firing: Disk space stat1008:9100:/srv 5.541% free - https://wikitech.wikimedia.org/wiki/Monitoring/Disk_space - https://grafana.wikimedia.org/d/000000377/host-overview?orgId=1&viewPanel=12&var-server=stat1008 - https://alerts.wikimedia.org/?q=alertname%3DDiskSpace
[18:04:24] <wikibugs>	 10Data-Engineering, 10Data-Engineering-Wikistats, 10Inuka-Team, 10Language-strategy, and 2 others: Have a way to show the most popular pages per country - https://phabricator.wikimedia.org/T207171 (10Strainu) For the non-DataEng folks like myself, how is that data different from the API described in T20717...
[19:16:40] <wikibugs>	 10Quarry: build container on PR - https://phabricator.wikimedia.org/T316958 (10Framawiki) To understand correctly, is this docker image used anywhere yet? I guess server is still using git clone and virtualenv without any container stuff ?
[21:37:13] <jinxer-wm>	 (DiskSpace) firing: Disk space stat1008:9100:/srv 5.379% free - https://wikitech.wikimedia.org/wiki/Monitoring/Disk_space - https://grafana.wikimedia.org/d/000000377/host-overview?orgId=1&viewPanel=12&var-server=stat1008 - https://alerts.wikimedia.org/?q=alertname%3DDiskSpace
[21:40:37] <wikibugs>	 10Quarry: build container on PR - https://phabricator.wikimedia.org/T316958 (10rook) >>! In T316958#8869742, @Framawiki wrote: > To understand correctly, is this docker image used anywhere yet? I guess server is still using git clone and virtualenv without any container stuff ?  No, this is not currently used an...
[23:23:34] <wikibugs>	 10Quarry: Find somewhere else (not NFS) to store Quarry's resultsets - https://phabricator.wikimedia.org/T178520 (10Framawiki) @zhuyifei1999 any usecase in mind that need life-storage of the results? it may be a possibility to delete results after some time (ie. after 2 years). After such time links to queries s...