[00:40:50] (SystemdUnitFailed) firing: (12) refinery-sqoop-mediawiki-production-daily.service Failed on an-launcher1002:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed [01:11:51] (DiskSpace) firing: Disk space an-test-worker1001:9100:/ 5.665% free - https://wikitech.wikimedia.org/wiki/Monitoring/Disk_space - https://grafana.wikimedia.org/d/000000377/host-overview?orgId=1&viewPanel=12&var-server=an-test-worker1001 - https://alerts.wikimedia.org/?q=alertname%3DDiskSpace [04:40:50] (SystemdUnitFailed) firing: (12) refinery-sqoop-mediawiki-production-daily.service Failed on an-launcher1002:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed [05:01:24] RECOVERY - Check systemd state on an-launcher1002 is OK: OK - running: The system is fully operational https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state [05:04:26] (SystemdUnitFailed) firing: (12) refinery-sqoop-mediawiki-production-daily.service Failed on an-launcher1002:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed [05:11:51] (DiskSpace) firing: Disk space an-test-worker1001:9100:/ 5.405% free - https://wikitech.wikimedia.org/wiki/Monitoring/Disk_space - https://grafana.wikimedia.org/d/000000377/host-overview?orgId=1&viewPanel=12&var-server=an-test-worker1001 - https://alerts.wikimedia.org/?q=alertname%3DDiskSpace [07:26:48] 10Data-Engineering, 10Anti-Harassment, 10Data-Persistence, 10Temporary accounts, and 2 others: Adding user_is_temp to the user table - https://phabricator.wikimedia.org/T333223 (10kostajh) [07:58:45] 10Data-Engineering, 10Data-Platform-SRE (2024.01.22 - 2024.02.11), 10Epic: Apply our patches not yet merged upstream to the supserset codebase in our Docker image - https://phabricator.wikimedia.org/T356477 (10brouberol) [08:02:32] 10Data-Engineering, 10Data-Platform-SRE (2024.01.22 - 2024.02.11), 10Epic: Make configuration secrets available to helmfile - https://phabricator.wikimedia.org/T356480 (10brouberol) [08:04:41] 10Data-Engineering, 10Data-Platform-SRE (2024.01.22 - 2024.02.11), 10Epic: Configure ingress DNS records - https://phabricator.wikimedia.org/T356481 (10brouberol) [08:05:04] 10Data-Engineering, 10Data-Platform-SRE (2024.01.22 - 2024.02.11), 10Epic: Configure ingress internal DNS records - https://phabricator.wikimedia.org/T356481 (10brouberol) [08:06:04] 10Analytics-Radar, 10Data-Engineering-Icebox, 10Anti-Harassment, 10CheckUser, and 8 others: Deal with Google Chrome User-Agent deprecation - https://phabricator.wikimedia.org/T242825 (10kostajh) 05Open→03Resolved a:03kostajh I'm marking this resolved, as we've dealt with this in subtasks (and in {T25... [08:13:20] 10Data-Engineering, 10Data-Platform-SRE, 10Epic: Update public domain DNS records to make them point to the DSE Kubernetes ingress - https://phabricator.wikimedia.org/T356482 (10brouberol) [08:17:01] 10Data-Engineering, 10Data-Platform-SRE, 10Epic: Add entries to the puppet service catalog - https://phabricator.wikimedia.org/T356483 (10brouberol) [08:19:00] 10Data-Engineering, 10Data-Platform-SRE, 10Epic: Monitor the availability of the superset deployments - https://phabricator.wikimedia.org/T356484 (10brouberol) [08:22:28] 10Data-Engineering, 10Data-Platform-SRE, 10Epic: Create saved views for the superset deployment logs - https://phabricator.wikimedia.org/T356485 (10brouberol) [08:24:38] 10Data-Engineering, 10Data-Platform-SRE, 10Epic: Update the wikitech page with our production readiness checklist - https://phabricator.wikimedia.org/T356486 (10brouberol) [08:25:23] 10Data-Engineering, 10Data-Platform-SRE, 10Epic: Migrate the Analytics Superset instances to our DSE Kubernetes cluster - https://phabricator.wikimedia.org/T347710 (10brouberol) [08:32:58] 10Data-Engineering, 10Data-Platform-SRE (2024.01.22 - 2024.02.11), 10Epic, 10Patch-For-Review: Apply our patches not yet merged upstream to the supserset codebase in our Docker image - https://phabricator.wikimedia.org/T356477 (10CodeReviewBot) brouberol opened https://gitlab.wikimedia.org/repos/data-engin... [08:44:40] (03CR) 10Joal: [C: 03+1] "Mwarf - good finding!" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/995101 (https://phabricator.wikimedia.org/T356401) (owner: 10Gmodena) [09:05:50] (SystemdUnitFailed) firing: (11) user-runtime-dir@24065.service Failed on an-test-client1002:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed [09:11:51] (DiskSpace) firing: Disk space an-test-worker1001:9100:/ 5.362% free - https://wikitech.wikimedia.org/wiki/Monitoring/Disk_space - https://grafana.wikimedia.org/d/000000377/host-overview?orgId=1&viewPanel=12&var-server=an-test-worker1001 - https://alerts.wikimedia.org/?q=alertname%3DDiskSpace [09:41:18] 10Data-Engineering, 10Data-Platform-SRE, 10Epic: Migrate the Analytics Superset instances to our DSE Kubernetes cluster - https://phabricator.wikimedia.org/T347710 (10BTullis) [09:46:00] 10Data-Platform-SRE (2024.01.22 - 2024.02.11): Upgrade Airflow instances to Bullseye - https://phabricator.wikimedia.org/T335261 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by btullis@cumin1002 for host an-airflow1004.eqiad.wmnet with OS bullseye [09:46:32] !log reimaging an-airflow1004 to bullseye for T335261 [09:46:35] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [09:46:35] T335261: Upgrade Airflow instances to Bullseye - https://phabricator.wikimedia.org/T335261 [09:54:46] 10Data-Platform-SRE (2024.01.22 - 2024.02.11), 10Patch-For-Review: Bring an-coord100[3-4] into service - https://phabricator.wikimedia.org/T336045 (10CodeReviewBot) btullis merged https://gitlab.wikimedia.org/repos/data-engineering/conda-analytics/-/merge_requests/41 Bump wmfdata to version 2.3.0 and add depe... [09:54:51] 10Data-Platform-SRE (2024.01.22 - 2024.02.11), 10Patch-For-Review: Wmfdata should connect to Presto using the analytics-presto CNAME - https://phabricator.wikimedia.org/T345482 (10CodeReviewBot) btullis merged https://gitlab.wikimedia.org/repos/data-engineering/conda-analytics/-/merge_requests/41 Bump wmfdata... [10:08:21] 10Data-Engineering, 10Data-Platform-SRE: Find a solution for the requestctl-generator html page - https://phabricator.wikimedia.org/T356490 (10Volans) [10:08:27] 10Data-Engineering (Sprint 8): [Maintenance] Migrate Gitlab CI to blubber - https://phabricator.wikimedia.org/T356364 (10Antoine_Quhen) https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/602 Linked with: https://phabricator.wikimedia.org/T351792 [10:08:49] 10Data-Engineering (Sprint 6), 10Patch-For-Review: [Data Quality] Implement Simple Monitoring Dashboard for Airflow Jobs - https://phabricator.wikimedia.org/T349532 (10Antoine_Quhen) [10:08:53] 10Data-Engineering, 10Release-Engineering-Team, 10collaboration-services, 10GitLab (CI & Job Runners), 10Patch-For-Review: Unblock Dockerfile syntax to build images with Gitlab trusted runner - https://phabricator.wikimedia.org/T351792 (10Antoine_Quhen) 05Open→03In progress [10:09:28] 10Data-Engineering, 10Data-Platform-SRE, 10Epic: Migrate the Analytics Superset instances to our DSE Kubernetes cluster - https://phabricator.wikimedia.org/T347710 (10Volans) [10:20:47] 10Data-Platform-SRE (2024.01.22 - 2024.02.11): Upgrade Airflow instances to Bullseye - https://phabricator.wikimedia.org/T335261 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by btullis@cumin1002 for host an-airflow1004.eqiad.wmnet with OS bullseye completed: - an-airflow1004 (**PASS**) -... [10:27:33] 10Data-Platform-SRE (2024.01.22 - 2024.02.11): Upgrade Airflow instances to Bullseye - https://phabricator.wikimedia.org/T335261 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by btullis@cumin1002 for host an-airflow1002.eqiad.wmnet with OS bullseye [10:27:33] !log reimaging an-airflow10042to bullseye for T335261 [10:27:36] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [10:27:36] T335261: Upgrade Airflow instances to Bullseye - https://phabricator.wikimedia.org/T335261 [10:27:48] !log correction: reimaging an-airflow1002to bullseye for T335261 [10:27:51] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [10:29:42] 10Data-Platform-SRE (2024.01.22 - 2024.02.11): Upgrade Airflow instances to Bullseye - https://phabricator.wikimedia.org/T335261 (10BTullis) [10:42:09] 10Data-Platform-SRE (2024.01.22 - 2024.02.11), 10Patch-For-Review: Bring an-worker11[57-75] into service - https://phabricator.wikimedia.org/T353776 (10BTullis) Oh, I think I might know what is going on. We will probably have to start managing the RAID configuration with the `perccli64` command on these serve... [10:50:43] 10Data-Platform-SRE (2024.01.22 - 2024.02.11), 10Infrastructure-Foundations, 10Puppet-Core, 10SRE, and 5 others: Migrate roles to puppet7 - https://phabricator.wikimedia.org/T349619 (10MoritzMuehlenhoff) [11:08:24] 10Data-Platform-SRE (2024.01.22 - 2024.02.11): Upgrade Airflow instances to Bullseye - https://phabricator.wikimedia.org/T335261 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by btullis@cumin1002 for host an-airflow1002.eqiad.wmnet with OS bullseye completed: - an-airflow1002 (**PASS**) -... [11:22:58] 10Data-Platform-SRE (2024.01.22 - 2024.02.11), 10SRE-Access-Requests, 10Patch-For-Review: Remove production data access for former WMDE staff member goransm - https://phabricator.wikimedia.org/T356279 (10BTullis) a:05BTullis→03None It's worth noting that there is only one remaining active entry in the `c... [11:24:19] 10Data-Platform-SRE (2024.01.22 - 2024.02.11), 10Patch-For-Review: Create a helm chart for Superset - https://phabricator.wikimedia.org/T352166 (10BTullis) a:05BTullis→03brouberol Reassigning to @brouberol for now, as he is going to take over my in-progress patch for the helm chart. [11:25:27] 10Data-Platform-SRE (2024.01.22 - 2024.02.11), 10Patch-For-Review: Create helmfile deployment files for superset and superset-next - https://phabricator.wikimedia.org/T353790 (10BTullis) a:05BTullis→03brouberol Reassigning to @brouberol for now, as he is going to take over my in-progress patch for the helm... [11:27:09] 10Data-Platform-SRE (2024.01.22 - 2024.02.11): Upgrade Airflow instances to Bullseye - https://phabricator.wikimedia.org/T335261 (10BTullis) [11:28:54] 10Data-Platform-SRE (2024.01.22 - 2024.02.11): Upgrade Airflow instances to Bullseye - https://phabricator.wikimedia.org/T335261 (10BTullis) 05Open→03Resolved [11:28:57] 10Data-Platform-SRE, 10Epic: Upgrade the Data Engineering infrastructure to Debian Bullseye - https://phabricator.wikimedia.org/T288804 (10BTullis) [11:30:34] 10Data-Engineering, 10Data-Platform-SRE (2024.01.22 - 2024.02.11), 10Data Products: Migrate an-web1001 to Debian bullseye (or bookworm) - https://phabricator.wikimedia.org/T349398 (10BTullis) a:03BTullis [11:30:48] 10Data-Platform-SRE (2024.01.22 - 2024.02.11): Bring stat1010 into service with GPU from stat1005 - https://phabricator.wikimedia.org/T336040 (10BTullis) a:03BTullis [11:31:01] 10Data-Platform-SRE (2024.01.22 - 2024.02.11): Bring stat1011 into service - https://phabricator.wikimedia.org/T354526 (10BTullis) a:03BTullis [11:32:47] 10Data-Engineering, 10Data-Platform-SRE (2024.01.22 - 2024.02.11), 10Patch-For-Review: Apply our patches not yet merged upstream to the supserset codebase in our Docker image - https://phabricator.wikimedia.org/T356477 (10BTullis) [11:34:11] 10Data-Engineering, 10Data-Platform-SRE (2024.01.22 - 2024.02.11), 10Patch-For-Review: Configure ingress internal DNS records - https://phabricator.wikimedia.org/T356481 (10BTullis) [11:44:47] 10Data-Platform-SRE (2024.01.22 - 2024.02.11), 10Infrastructure-Foundations, 10Puppet-Core, 10SRE, and 5 others: Migrate roles to puppet7 - https://phabricator.wikimedia.org/T349619 (10MoritzMuehlenhoff) [13:05:51] (SystemdUnitFailed) firing: (11) user-runtime-dir@24065.service Failed on an-test-client1002:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed [13:07:05] 10Data-Platform-SRE (2024.01.22 - 2024.02.11), 10Patch-For-Review: Bring an-worker11[57-75] into service - https://phabricator.wikimedia.org/T353776 (10Stevemunene) Thanks @BTullis, updating wikitech and the cookbook once I get the right commands [13:11:51] (DiskSpace) firing: Disk space an-test-worker1001:9100:/ 5.18% free - https://wikitech.wikimedia.org/wiki/Monitoring/Disk_space - https://grafana.wikimedia.org/d/000000377/host-overview?orgId=1&viewPanel=12&var-server=an-test-worker1001 - https://alerts.wikimedia.org/?q=alertname%3DDiskSpace [14:15:33] 10Data-Engineering, 10Data-Platform-SRE (2024.01.22 - 2024.02.11), 10Patch-For-Review: Apply our patches not yet merged upstream to the supserset codebase in our Docker image - https://phabricator.wikimedia.org/T356477 (10CodeReviewBot) brouberol merged https://gitlab.wikimedia.org/repos/data-engineering/sup... [14:31:43] 10Data-Platform-SRE (2024.01.22 - 2024.02.11), 10Discovery-Search (Current work): Cirrus-streaming-updater test: validate relforge indices are correctly updated - https://phabricator.wikimedia.org/T350186 (10Gehel) 05Open→03Resolved [14:57:17] 10Data-Platform-SRE, 10SRE-Access-Requests: Remove production data access for former WMDE staff member goransm - https://phabricator.wikimedia.org/T356279 (10Gehel) [16:12:07] (03PS1) 10Bearloga: Fix order of entries in analytics allowlist [analytics/refinery] - 10https://gerrit.wikimedia.org/r/995258 [16:12:38] 10Data-Engineering, 10Data Products, 10Structured-Data-Backlog: DagProperties don't automatically update Airflow variables - https://phabricator.wikimedia.org/T348963 (10mforns) Agree with both! It is annoying that when you intentionally modify a property in your code, it is immediately overridden by the ol... [16:13:06] 10Data-Engineering, 10Cassandra, 10Structured Data Engineering, 10Structured-Data-Backlog: image suggestions DAG should not use aqsloader Cassandra role - https://phabricator.wikimedia.org/T356446 (10mfossati) See also T356400#9506834. [16:14:45] 10Data-Engineering, 10Data-Platform-SRE: Update the wikitech page with our production readiness checklist - https://phabricator.wikimedia.org/T356486 (10BTullis) [16:15:35] 10Data-Engineering (Sprint 8), 10Discovery-Search, 10Image-Suggestions: Search dag image_suggestions_weekly failed waiting for analytics_platform_eng.image_suggestions_search_index_delta/snapshot=2024-01-15 - https://phabricator.wikimedia.org/T356030 (10mfossati) @dcausse , this ticket is now unblocked. `202... [16:18:25] 10Data-Engineering (Sprint 8), 10Discovery-Search, 10Image-Suggestions: Search dag image_suggestions_weekly failed waiting for analytics_platform_eng.image_suggestions_search_index_delta/snapshot=2024-01-15 - https://phabricator.wikimedia.org/T356030 (10dcausse) @mfossati if 2024-01-22 is running it probably... [16:22:16] 10Data-Engineering, 10Anti-Harassment, 10Data-Persistence, 10Temporary accounts, and 2 others: Adding user_is_temp to the user table - https://phabricator.wikimedia.org/T333223 (10Dreamy_Jazz) [16:25:03] 10Data-Platform-SRE, 10Data-Catalog, 10Patch-For-Review: Create Airflow Pipeline for Ingesting/Updating Superset data into DataHub - https://phabricator.wikimedia.org/T309622 (10BTullis) [16:25:50] 10Data-Engineering, 10Data-Platform-SRE (2024.01.22 - 2024.02.11): Make configuration secrets available to helmfile - https://phabricator.wikimedia.org/T356480 (10BTullis) [16:29:01] 10Data-Engineering (Sprint 8), 10Discovery-Search, 10Image-Suggestions: Search dag image_suggestions_weekly failed waiting for analytics_platform_eng.image_suggestions_search_index_delta/snapshot=2024-01-15 - https://phabricator.wikimedia.org/T356030 (10mfossati) >>! In T356030#9509840, @dcausse wrote: > @mf... [16:35:40] 10Data-Engineering (Sprint 8), 10Discovery-Search, 10Image-Suggestions: Search dag image_suggestions_weekly failed waiting for analytics_platform_eng.image_suggestions_search_index_delta/snapshot=2024-01-15 - https://phabricator.wikimedia.org/T356030 (10mfossati) @dcausse please let me double-check everythin... [16:35:50] 10Data-Platform-SRE (2024.01.22 - 2024.02.11), 10Patch-For-Review: Wmfdata should connect to Presto using the analytics-presto CNAME - https://phabricator.wikimedia.org/T345482 (10BTullis) I have tested the new version 0.0.28 of conda-analytics 2.3.0 on an-test-client and the `presto.run()` function still work... [16:36:33] 10Data-Engineering, 10Data-Platform-SRE, 10Epic, 10Patch-For-Review: Migrate the Analytics Superset instances to our DSE Kubernetes cluster - https://phabricator.wikimedia.org/T347710 (10brouberol) [16:36:35] 10Data-Engineering, 10Data-Platform-SRE (2024.01.22 - 2024.02.11), 10Patch-For-Review: Apply our patches not yet merged upstream to the supserset codebase in our Docker image - https://phabricator.wikimedia.org/T356477 (10brouberol) 05Open→03Resolved Publish pipeline: https://gitlab.wikimedia.org/repos/d... [16:37:33] 10Data-Platform-SRE: Configure OIDC Authentication for Superset on K8S - https://phabricator.wikimedia.org/T353794 (10brouberol) https://stackoverflow.com/questions/67076134/apache-superset-with-okta-integration might prove useful [16:41:32] 10Data-Engineering, 10Anti-Harassment, 10Data-Persistence, 10Temporary accounts, and 2 others: Adding user_is_temp to the user table - https://phabricator.wikimedia.org/T333223 (10Ladsgroup) 05Open→03Resolved This is done I think [17:00:12] 10Data-Engineering (Sprint 8), 10Discovery-Search, 10Image-Suggestions: Search dag image_suggestions_weekly failed waiting for analytics_platform_eng.image_suggestions_search_index_delta/snapshot=2024-01-15 - https://phabricator.wikimedia.org/T356030 (10mfossati) @dcausse it turned out that the `analytics_pl... [17:05:51] (SystemdUnitFailed) firing: (11) user-runtime-dir@24065.service Failed on an-test-client1002:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed [17:10:51] (SystemdUnitFailed) firing: (11) user-runtime-dir@24065.service Failed on an-test-client1002:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed [17:11:51] (DiskSpace) firing: Disk space an-test-worker1001:9100:/ 5.047% free - https://wikitech.wikimedia.org/wiki/Monitoring/Disk_space - https://grafana.wikimedia.org/d/000000377/host-overview?orgId=1&viewPanel=12&var-server=an-test-worker1001 - https://alerts.wikimedia.org/?q=alertname%3DDiskSpace [17:28:54] 10Data-Engineering (Sprint 8), 10Discovery-Search, 10Image-Suggestions: Search dag image_suggestions_weekly failed waiting for analytics_platform_eng.image_suggestions_search_index_delta/snapshot=2024-01-15 - https://phabricator.wikimedia.org/T356030 (10dcausse) @mofossati OK resumed the dag to process `2024... [17:32:37] 10Data-Engineering, 10Data-Platform-SRE, 10Epic, 10Patch-For-Review: Migrate the Analytics Superset instances to our DSE Kubernetes cluster - https://phabricator.wikimedia.org/T347710 (10brouberol) [17:33:07] (03PS1) 10Snwachukwu: Add Dynamic Pivot job for reportupdater reports [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/995271 (https://phabricator.wikimedia.org/T354552) [17:33:16] 10Data-Engineering, 10Data-Platform-SRE: Create saved views for the superset deployment logs - https://phabricator.wikimedia.org/T356485 (10BTullis) [17:33:40] 10Data-Engineering, 10Data-Platform-SRE: Monitor the availability of the superset deployments - https://phabricator.wikimedia.org/T356484 (10BTullis) [17:33:42] 10Data-Engineering (Sprint 8), 10Discovery-Search, 10Image-Suggestions: Search dag image_suggestions_weekly failed waiting for analytics_platform_eng.image_suggestions_search_index_delta/snapshot=2024-01-15 - https://phabricator.wikimedia.org/T356030 (10dcausse) [17:34:00] (03PS2) 10Snwachukwu: [WIP] Add Dynamic Pivot job for reportupdater reports [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/995271 (https://phabricator.wikimedia.org/T354552) [17:36:43] 10Data-Engineering, 10Data-Platform-SRE: [superset k8s] Add entries to the puppet service catalog - https://phabricator.wikimedia.org/T356483 (10BTullis) [17:37:32] 10Data-Engineering, 10Data-Platform-SRE: [superset k8s] Update public domain DNS records to make them point to the DSE Kubernetes ingress - https://phabricator.wikimedia.org/T356482 (10BTullis) [17:38:00] 10Data-Engineering, 10Data-Platform-SRE: [superset k8s] Update the wikitech page with our production readiness checklist - https://phabricator.wikimedia.org/T356486 (10BTullis) [18:01:04] (03CR) 10Aqu: [C: 03+1] "Looks good for me about privacy." [analytics/refinery] - 10https://gerrit.wikimedia.org/r/995104 (https://phabricator.wikimedia.org/T356214) (owner: 10Bearloga) [18:18:55] 10Data-Engineering, 10Documentation: Clickstream dataset documentation should be extracted from Research page - https://phabricator.wikimedia.org/T356528 (10TBurmeister) [18:26:07] (03CR) 10Shay Nowick: [C: 03+1] "LGTM" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/995104 (https://phabricator.wikimedia.org/T356214) (owner: 10Bearloga) [19:27:00] 10Analytics, 10Data-Engineering, 10Data-Engineering-Wikistats: prefix symbol that modifies unit magnitude - https://phabricator.wikimedia.org/T356534 (10Gunnar.Kaestle) [20:06:26] (03CR) 10Bearloga: "@aqu Regarding some of the comments about naming of fields/columns:" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/995104 (https://phabricator.wikimedia.org/T356214) (owner: 10Bearloga) [20:43:36] (03CR) 10Aqu: [C: 03+1] "Thanks for the ref." [analytics/refinery] - 10https://gerrit.wikimedia.org/r/995104 (https://phabricator.wikimedia.org/T356214) (owner: 10Bearloga) [20:49:12] 10Data-Engineering, 10Tech-Docs-Team: Review and deprecate Analytics/Geoeditors page on Wikitech - https://phabricator.wikimedia.org/T356538 (10TBurmeister) [20:49:43] 10Data-Engineering, 10Tech-Docs-Team: Review and deprecate Analytics/Geoeditors page on Wikitech - https://phabricator.wikimedia.org/T356538 (10TBurmeister) p:05Triage→03Medium a:05TBurmeister→03None [21:08:01] 10Data-Engineering, 10Tech-Docs-Team, 10Goal: Redesign Data Platform docs on Wikitech - https://phabricator.wikimedia.org/T350911 (10TBurmeister) To help with making sense of this large corpus of docs (with many confusing page redirects), and to power future landing page design, I've created some categories... [21:10:51] (SystemdUnitFailed) firing: (10) user-runtime-dir@21734.service Failed on stat1004:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed [21:11:52] (DiskSpace) firing: Disk space an-test-worker1001:9100:/ 4.875% free - https://wikitech.wikimedia.org/wiki/Monitoring/Disk_space - https://grafana.wikimedia.org/d/000000377/host-overview?orgId=1&viewPanel=12&var-server=an-test-worker1001 - https://alerts.wikimedia.org/?q=alertname%3DDiskSpace [21:13:45] 10Data-Engineering, 10Tech-Docs-Team, 10Goal: Redesign Data Platform docs on Wikitech - https://phabricator.wikimedia.org/T350911 (10ttaylor) it occurs to me that we should broader "edits data" to "contribution data", since some kinds of contribution we would want to collect there aren't edits. otherwise lo... [22:36:10] 10Data-Engineering (Sprint 8): [Data Quality] Implement basic data quality metrics for MW history - https://phabricator.wikimedia.org/T354692 (10Ahoelzl)