[00:32:38] FIRING: ProbeDown: Service toolsbeta-test-k8s-haproxy-7:443 has failed probes (http_admin_beta_toolforge_org_ip4) - https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/k8s-haproxy - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://prometheus-alerts.wmcloud.org/?q=alertname%3DProbeDown [00:37:38] RESOLVED: ProbeDown: Service toolsbeta-test-k8s-haproxy-7:443 has failed probes (http_admin_beta_toolforge_org_ip4) - https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/k8s-haproxy - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://prometheus-alerts.wmcloud.org/?q=alertname%3DProbeDown [02:59:00] FIRING: OpenstackAPIResponse: Openstack API average response time is too high. - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/OpenstackAPIResponse - https://grafana.wikimedia.org/d/UUmLqqX4k - https://alerts.wikimedia.org/?q=alertname%3DOpenstackAPIResponse [04:32:32] (03open) 10countcount: Set rust-version (MSRV) to 1.99 [toolforge-repos/dewiki-rangeblock] - 10https://gitlab.wikimedia.org/toolforge-repos/dewiki-rangeblock/-/merge_requests/33 [04:32:34] (03open) 10countcount: Set rust-version (MSRV) to 1.99 [toolforge-repos/multiuserinfo] - 10https://gitlab.wikimedia.org/toolforge-repos/multiuserinfo/-/merge_requests/87 [04:39:00] (03open) 10countcount: Set rust-version (MSRV) to 1.99 [toolforge-repos/wiki-mail-verify] - 10https://gitlab.wikimedia.org/toolforge-repos/wiki-mail-verify/-/merge_requests/55 [04:41:31] (03open) 10countcount: Use the shared Node audit template [toolforge-repos/allblocksever] - 10https://gitlab.wikimedia.org/toolforge-repos/allblocksever/-/merge_requests/40 [04:41:35] (03open) 10countcount: Use the shared Node audit template [toolforge-repos/checkusertools] - 10https://gitlab.wikimedia.org/toolforge-repos/checkusertools/-/merge_requests/36 [04:41:40] (03open) 10countcount: Use the shared Node audit template [toolforge-repos/namehistory] - 10https://gitlab.wikimedia.org/toolforge-repos/namehistory/-/merge_requests/30 [04:41:43] (03open) 10countcount: Use the shared Node audit template [toolforge-repos/rangetree] - 10https://gitlab.wikimedia.org/toolforge-repos/rangetree/-/merge_requests/68 [04:42:05] (03open) 10countcount: Skip rust-test in audit-only pipelines [toolforge-repos/multiuserinfo] - 10https://gitlab.wikimedia.org/toolforge-repos/multiuserinfo/-/merge_requests/88 [04:42:13] (03open) 10countcount: Skip the build job in audit-only pipelines [toolforge-repos/wiki-mail-verify] - 10https://gitlab.wikimedia.org/toolforge-repos/wiki-mail-verify/-/merge_requests/56 [04:51:38] RESOLVED: ProbeDown: Service toolsbeta-test-k8s-haproxy-7:443 has failed probes (http_admin_beta_toolforge_org_ip4) - https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/k8s-haproxy - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://prometheus-alerts.wmcloud.org/?q=alertname%3DProbeDown [04:54:00] FIRING: [2x] OpenstackAPIResponse: Openstack API average response time is too high. - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/OpenstackAPIResponse - https://grafana.wikimedia.org/d/UUmLqqX4k - https://alerts.wikimedia.org/?q=alertname%3DOpenstackAPIResponse [04:57:29] (03close) 10countcount: Set rust-version (MSRV) to 1.99 [toolforge-repos/multiuserinfo] - 10https://gitlab.wikimedia.org/toolforge-repos/multiuserinfo/-/merge_requests/87 [04:57:30] (03update) 10countcount: Set rust-version (MSRV) to 1.99 [toolforge-repos/multiuserinfo] - 10https://gitlab.wikimedia.org/toolforge-repos/multiuserinfo/-/merge_requests/87 [04:57:35] (03close) 10countcount: Set rust-version (MSRV) to 1.99 [toolforge-repos/dewiki-rangeblock] - 10https://gitlab.wikimedia.org/toolforge-repos/dewiki-rangeblock/-/merge_requests/33 [04:57:37] (03update) 10countcount: Set rust-version (MSRV) to 1.99 [toolforge-repos/dewiki-rangeblock] - 10https://gitlab.wikimedia.org/toolforge-repos/dewiki-rangeblock/-/merge_requests/33 [04:57:40] (03close) 10countcount: Set rust-version (MSRV) to 1.99 [toolforge-repos/wiki-mail-verify] - 10https://gitlab.wikimedia.org/toolforge-repos/wiki-mail-verify/-/merge_requests/55 [04:57:44] (03update) 10countcount: Set rust-version (MSRV) to 1.99 [toolforge-repos/wiki-mail-verify] - 10https://gitlab.wikimedia.org/toolforge-repos/wiki-mail-verify/-/merge_requests/55 [06:02:38] FIRING: ProbeDown: Service toolsbeta-test-k8s-haproxy-7:443 has failed probes (http_admin_beta_toolforge_org_ip4) - https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/k8s-haproxy - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://prometheus-alerts.wmcloud.org/?q=alertname%3DProbeDown [06:07:38] RESOLVED: ProbeDown: Service toolsbeta-test-k8s-haproxy-7:443 has failed probes (http_admin_beta_toolforge_org_ip4) - https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/k8s-haproxy - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://prometheus-alerts.wmcloud.org/?q=alertname%3DProbeDown [06:19:00] FIRING: [3x] OpenstackAPIResponse: Openstack API average response time is too high. - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/OpenstackAPIResponse - https://grafana.wikimedia.org/d/UUmLqqX4k - https://alerts.wikimedia.org/?q=alertname%3DOpenstackAPIResponse [06:22:25] (03merge) 10countcount: Use the shared Node audit template [toolforge-repos/allblocksever] - 10https://gitlab.wikimedia.org/toolforge-repos/allblocksever/-/merge_requests/40 [06:23:02] (03merge) 10countcount: Use the shared Node audit template [toolforge-repos/checkusertools] - 10https://gitlab.wikimedia.org/toolforge-repos/checkusertools/-/merge_requests/36 [06:23:05] (03merge) 10countcount: Use the shared Node audit template [toolforge-repos/namehistory] - 10https://gitlab.wikimedia.org/toolforge-repos/namehistory/-/merge_requests/30 [06:23:09] (03merge) 10countcount: Use the shared Node audit template [toolforge-repos/rangetree] - 10https://gitlab.wikimedia.org/toolforge-repos/rangetree/-/merge_requests/68 [06:23:19] (03merge) 10countcount: Skip rust-test in audit-only pipelines [toolforge-repos/multiuserinfo] - 10https://gitlab.wikimedia.org/toolforge-repos/multiuserinfo/-/merge_requests/88 [06:23:21] (03merge) 10countcount: Skip the build job in audit-only pipelines [toolforge-repos/wiki-mail-verify] - 10https://gitlab.wikimedia.org/toolforge-repos/wiki-mail-verify/-/merge_requests/56 [06:53:38] FIRING: ProbeDown: Service toolsbeta-test-k8s-haproxy-7:443 has failed probes (http_admin_beta_toolforge_org_ip4) - https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/k8s-haproxy - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://prometheus-alerts.wmcloud.org/?q=alertname%3DProbeDown [06:58:38] RESOLVED: ProbeDown: Service toolsbeta-test-k8s-haproxy-7:443 has failed probes (http_admin_beta_toolforge_org_ip4) - https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/k8s-haproxy - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://prometheus-alerts.wmcloud.org/?q=alertname%3DProbeDown [08:28:50] 10Data-Services, 06tools-platform-team, 06DBA: Decommission clouddb1013-clouddb1020 - https://phabricator.wikimedia.org/T434048#12440534 (10Marostegui) [08:33:28] (03open) 10filippo: kubernetes: move ToolforgeKubernetesNodeNotReady to critical [repos/cloud/toolforge/alerts] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/alerts/-/merge_requests/73 (https://phabricator.wikimedia.org/T441285) [08:34:01] (03update) 10filippo: kubernetes: move ToolforgeKubernetesNodeNotReady to critical [repos/cloud/toolforge/alerts] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/alerts/-/merge_requests/73 (https://phabricator.wikimedia.org/T441285) [08:47:38] FIRING: ProbeDown: Service toolsbeta-test-k8s-haproxy-7:443 has failed probes (http_admin_beta_toolforge_org_ip4) - https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/k8s-haproxy - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://prometheus-alerts.wmcloud.org/?q=alertname%3DProbeDown [08:52:38] RESOLVED: ProbeDown: Service toolsbeta-test-k8s-haproxy-7:443 has failed probes (http_admin_beta_toolforge_org_ip4) - https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/k8s-haproxy - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://prometheus-alerts.wmcloud.org/?q=alertname%3DProbeDown [09:01:25] (03approved) 10fnegri: kubernetes: move ToolforgeKubernetesNodeNotReady to critical [repos/cloud/toolforge/alerts] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/alerts/-/merge_requests/73 (https://phabricator.wikimedia.org/T441285) (owner: 10filippo) [09:16:32] 06tools-infrastructure-team: Decom old cloudcephosd hardware - https://phabricator.wikimedia.org/T440684#12440687 (10fgiunchedi) [09:22:45] 06cloud-services-team, 10Data-Services, 06tools-platform-team: [wikireplicas] Create views for new wiki wlxwiki - https://phabricator.wikimedia.org/T441184#12440697 (10TLepage-WMF) Per [[ https://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Wiki_Replicas#Adding_a_wiki | the docs ]], this is blocked... [09:35:25] 10Data-Services, 06tools-platform-team, 06DBA: Decommission clouddb1013-clouddb1020 - https://phabricator.wikimedia.org/T434048#12440735 (10Marostegui) [09:35:33] 10Data-Services, 06tools-platform-team, 06DBA: Decommission clouddb1013-clouddb1020 - https://phabricator.wikimedia.org/T434048#12440738 (10Marostegui) [09:45:11] 10Striker, 06tools-platform-team, 07OKR-Work, 13Patch-For-Review: Draft: Measure adoption of reliability views - https://phabricator.wikimedia.org/T441328#12440768 (10aputhin) a:05Aruotes→03None Hi @Aruotes thank you for your interest. This task is not yet ready for implementation - as clearly stated b... [09:49:31] 10Toolforge, 06tools-platform-team, 13Patch-For-Review: [logs-cli,logs-api] enable following logs for tool events - https://phabricator.wikimedia.org/T438972#12440781 (10aputhin) @KSarabia-WMF I think you tagged the wrong task on your gerrit patch 😅 [09:51:48] 06cloud-services-team (Hardware), 06DC-Ops, 10ops-eqiad, 06SRE: Q3:rack/setup/install cloudcephosd105[3456] - https://phabricator.wikimedia.org/T419892#12440786 (10fgiunchedi) Update: this is currently blocked ahead of decom old cloudcephosd (T440684) and nokia switches for C8/D5 (T440305) [10:06:54] 06cloud-services-team, 10Toolforge, 06tools-platform-team: Establish an internal system or a recommended external system for monitoring user-created Toolforge web services - https://phabricator.wikimedia.org/T53434#12440843 (10fnegri) We are about to release something that is very similar to the original des... [10:19:00] FIRING: [3x] OpenstackAPIResponse: Openstack API average response time is too high. - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/OpenstackAPIResponse - https://grafana.wikimedia.org/d/UUmLqqX4k - https://alerts.wikimedia.org/?q=alertname%3DOpenstackAPIResponse [10:40:49] 10Cloud-VPS, 10Toolforge, 06tools-infrastructure-team, 13Patch-For-Review: Deploy hiddenparma application - https://phabricator.wikimedia.org/T439418#12440956 (10taavi) More TLS fun: ` (Caused by SSLError(CertificateError("hostname 'cloudinfra-etcd-1.cloudinfra.eqiad1.wikimedia.cloud' doesn't match 'svc.cl... [10:50:15] (03PS3) 10Majavah: Add dummy hiddenparma secrets [labs/private] - 10https://gerrit.wikimedia.org/r/1347598 (https://phabricator.wikimedia.org/T439418) [11:01:38] FIRING: ProbeDown: Service toolsbeta-test-k8s-haproxy-7:443 has failed probes (http_admin_beta_toolforge_org_ip4) - https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/k8s-haproxy - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://prometheus-alerts.wmcloud.org/?q=alertname%3DProbeDown [11:06:38] RESOLVED: ProbeDown: Service toolsbeta-test-k8s-haproxy-7:443 has failed probes (http_admin_beta_toolforge_org_ip4) - https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/k8s-haproxy - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://prometheus-alerts.wmcloud.org/?q=alertname%3DProbeDown [11:14:50] (03CR) 10Majavah: [V:03+2 C:03+2] Add dummy hiddenparma secrets [labs/private] - 10https://gerrit.wikimedia.org/r/1347598 (https://phabricator.wikimedia.org/T439418) (owner: 10Majavah) [11:38:03] FIRING: PuppetSyncFailure: Failed to update Puppet repository /srv/git/labs/private on instance project-proxy-puppetserver-1 in project project-proxy - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetSyncFailure [12:00:49] (03open) 10taavi: eqiad1: cloudinfra: Allow ingress to Hiddenparma service [repos/cloud/cloud-vps/tofu-infra] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/368 (https://phabricator.wikimedia.org/T439418) [12:06:12] (03update) 10taavi: eqiad1: cloudinfra: Allow ingress to Hiddenparma service [repos/cloud/cloud-vps/tofu-infra] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/368 (https://phabricator.wikimedia.org/T439418) [12:14:51] (03update) 10fnegri: First commit [repos/cloud/toolforge/replica-cnf] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/replica-cnf/-/merge_requests/1 (https://phabricator.wikimedia.org/T340754) (owner: 10dcaro) [12:18:03] RESOLVED: PuppetSyncFailure: Failed to update Puppet repository /srv/git/labs/private on instance project-proxy-puppetserver-1 in project project-proxy - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetSyncFailure [13:10:53] 10Toolforge (Quota-requests): Request increased quota for oka-bot Toolforge tool - https://phabricator.wikimedia.org/T441425 (107804j) 03NEW [13:11:55] PROBLEM - Host cloudvirt1071 is DOWN: PING CRITICAL - Packet loss = 100% [13:14:34] (03update) 10renovatebot: Update pnpm to v12.13.0 [toolforge-repos/namehistory] - 10https://gitlab.wikimedia.org/toolforge-repos/namehistory/-/merge_requests/31 [13:14:36] (03open) 10renovatebot: Update pnpm to v12.13.0 [toolforge-repos/namehistory] - 10https://gitlab.wikimedia.org/toolforge-repos/namehistory/-/merge_requests/31 [13:14:50] (03update) 10renovatebot: Update pnpm to v12.13.0 [toolforge-repos/allblocksever] - 10https://gitlab.wikimedia.org/toolforge-repos/allblocksever/-/merge_requests/41 [13:14:52] (03open) 10renovatebot: Update pnpm to v12.13.0 [toolforge-repos/allblocksever] - 10https://gitlab.wikimedia.org/toolforge-repos/allblocksever/-/merge_requests/41 [13:15:08] (03update) 10renovatebot: Update pnpm to v12.13.0 [toolforge-repos/checkusertools] - 10https://gitlab.wikimedia.org/toolforge-repos/checkusertools/-/merge_requests/37 [13:15:15] (03open) 10renovatebot: Update pnpm to v12.13.0 [toolforge-repos/checkusertools] - 10https://gitlab.wikimedia.org/toolforge-repos/checkusertools/-/merge_requests/37 [13:16:10] (03update) 10renovatebot: Update pnpm to v12.13.0 [toolforge-repos/rangetree] - 10https://gitlab.wikimedia.org/toolforge-repos/rangetree/-/merge_requests/69 [13:16:16] (03open) 10renovatebot: Update pnpm to v12.13.0 [toolforge-repos/rangetree] - 10https://gitlab.wikimedia.org/toolforge-repos/rangetree/-/merge_requests/69 [13:16:34] 06cloud-services-team, 10Cloud-VPS, 06tools-infrastructure-team, 06DC-Ops, and 2 others: cloudvirt1071 crash, again - https://phabricator.wikimedia.org/T431374#12441631 (10Jclark-ctr) I am putting the server through Dell Lifecycle Controller / ePSA hardware diagnostics for 99 consecutive test cycles to str... [13:17:09] (03update) 10renovatebot: Update pnpm to v12.13.0 [toolforge-repos/wiki-mail-verify] - 10https://gitlab.wikimedia.org/toolforge-repos/wiki-mail-verify/-/merge_requests/57 [13:17:12] (03open) 10renovatebot: Update pnpm to v12.13.0 [toolforge-repos/wiki-mail-verify] - 10https://gitlab.wikimedia.org/toolforge-repos/wiki-mail-verify/-/merge_requests/57 [13:26:38] (03open) 10mercyjae: feat:implement search by translator [toolforge-repos/wsindex] - 10https://gitlab.wikimedia.org/toolforge-repos/wsindex/-/merge_requests/6 [13:34:04] 10Toolforge, 06tools-platform-team, 07Epic, 07OKR-Work: ST5.4.2 Toolforge Alerting System - https://phabricator.wikimedia.org/T432860#12441731 (10fnegri) //Note: we are experimenting with cross-posting to Phabricator the weekly report that previously was only posted to Asana, where only few people have acc... [14:14:20] (03update) 10renovatebot: Update pnpm to v12.13.0 [toolforge-repos/namehistory] - 10https://gitlab.wikimedia.org/toolforge-repos/namehistory/-/merge_requests/31 [14:14:53] (03update) 10renovatebot: Update pnpm to v12.14.0 [toolforge-repos/namehistory] - 10https://gitlab.wikimedia.org/toolforge-repos/namehistory/-/merge_requests/31 [14:15:05] 10Tools, 10Lift-Wing, 06Machine-Learning-Team, 06Research: FactDiff: an editor worklist of conflicting dates and numbers across Wikipedia language editions (WIP, feedback welcome) - https://phabricator.wikimedia.org/T441279#12441896 (10diego) Hi @Devdoingdev! Very Interesting project! Here Diego from the... [14:15:09] (03update) 10renovatebot: Update pnpm to v12.13.0 [toolforge-repos/allblocksever] - 10https://gitlab.wikimedia.org/toolforge-repos/allblocksever/-/merge_requests/41 [14:15:14] (03update) 10renovatebot: Update pnpm to v12.14.0 [toolforge-repos/allblocksever] - 10https://gitlab.wikimedia.org/toolforge-repos/allblocksever/-/merge_requests/41 [14:15:23] (03update) 10renovatebot: Update pnpm to v12.13.0 [toolforge-repos/checkusertools] - 10https://gitlab.wikimedia.org/toolforge-repos/checkusertools/-/merge_requests/37 [14:15:27] (03update) 10renovatebot: Update pnpm to v12.14.0 [toolforge-repos/checkusertools] - 10https://gitlab.wikimedia.org/toolforge-repos/checkusertools/-/merge_requests/37 [14:16:27] (03update) 10renovatebot: Update pnpm to v12.13.0 [toolforge-repos/rangetree] - 10https://gitlab.wikimedia.org/toolforge-repos/rangetree/-/merge_requests/69 [14:16:29] (03update) 10renovatebot: Update pnpm to v12.14.0 [toolforge-repos/rangetree] - 10https://gitlab.wikimedia.org/toolforge-repos/rangetree/-/merge_requests/69 [14:17:24] (03update) 10renovatebot: Update pnpm to v12.13.0 [toolforge-repos/wiki-mail-verify] - 10https://gitlab.wikimedia.org/toolforge-repos/wiki-mail-verify/-/merge_requests/57 [14:17:27] (03update) 10renovatebot: Update pnpm to v12.14.0 [toolforge-repos/wiki-mail-verify] - 10https://gitlab.wikimedia.org/toolforge-repos/wiki-mail-verify/-/merge_requests/57 [14:43:29] 06cloud-services-team, 10Cloud-VPS, 06tools-infrastructure-team, 07Sustainability (Incident Followup): Add monitoring for backy2 openstack backups - https://phabricator.wikimedia.org/T428893#12441996 (10fgiunchedi) dashboard: https://grafana.wikimedia.org/d/wmcs-backups [15:01:13] 10Toolforge, 06tools-platform-team, 07Epic, 07OKR-Work: ST5.4.3 Implement Toolforge UI MVP - https://phabricator.wikimedia.org/T440589#12442055 (10TLepage-WMF) ### Weekly progress summary Hypothesis: > If we provide a centralized interface for Tool users and maintainers to easily access logs and monitorin... [15:17:38] FIRING: ProbeDown: Service toolsbeta-test-k8s-haproxy-7:443 has failed probes (http_admin_beta_toolforge_org_ip4) - https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/k8s-haproxy - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://prometheus-alerts.wmcloud.org/?q=alertname%3DProbeDown [15:27:38] RESOLVED: ProbeDown: Service toolsbeta-test-k8s-haproxy-7:443 has failed probes (http_admin_beta_toolforge_org_ip4) - https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/k8s-haproxy - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://prometheus-alerts.wmcloud.org/?q=alertname%3DProbeDown [15:37:38] FIRING: ProbeDown: Service toolsbeta-test-k8s-haproxy-7:443 has failed probes (http_admin_beta_toolforge_org_ip4) - https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/k8s-haproxy - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://prometheus-alerts.wmcloud.org/?q=alertname%3DProbeDown [15:42:38] RESOLVED: ProbeDown: Service toolsbeta-test-k8s-haproxy-7:443 has failed probes (http_admin_beta_toolforge_org_ip4) - https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/k8s-haproxy - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://prometheus-alerts.wmcloud.org/?q=alertname%3DProbeDown [15:45:45] 10Cloud-VPS (Debian Bullseye Deprecation), 10Beta-Cluster-Infrastructure, 06MediaWiki-Engineering, 13Patch-For-Review: Beta Cluster: Switch to PHP 8.5, includes writing Puppet changes to support PHP 8.5 on baremetal - https://phabricator.wikimedia.org/T435393#12442325 (10MLechvien-WMF) Hi @Southparkfan , t... [16:19:36] 10Striker, 06tools-platform-team, 07OKR-Work, 13Patch-For-Review: Draft: Measure adoption of reliability views - https://phabricator.wikimedia.org/T441328#12442538 (10Aruotes) Hii @aputhin Sorry for this, Im just a beginner , so kinda getting new things like this, but i want to assure you there is no use o... [16:25:13] (03CR) 10Dzahn: [C:03+2] write_config: add --wmf-only to index only Wikimedia-hosted repos [labs/codesearch] - 10https://gerrit.wikimedia.org/r/1355143 (https://phabricator.wikimedia.org/T268199) (owner: 10Dzahn) [16:27:00] (03Merged) 10jenkins-bot: write_config: add --wmf-only to index only Wikimedia-hosted repos [labs/codesearch] - 10https://gerrit.wikimedia.org/r/1355143 (https://phabricator.wikimedia.org/T268199) (owner: 10Dzahn) [16:49:36] 10Tool-athar: [Task 1] Build Meta-Wiki Member Parser & CentralAuth Sync Script - https://phabricator.wikimedia.org/T441457 (10Bonnjalal) 03NEW [16:55:41] 10Tool-athar: [Task 2] Implement Wikimedia OAuth 2.0 Login, Local Mock Bypass & Route Guards - https://phabricator.wikimedia.org/T441459 (10Bonnjalal) 03NEW [16:57:50] 10Tool-athar: [Task 3] Build SQLAlchemy Database Models, Sanitized REST APIs & CSV Exporter - https://phabricator.wikimedia.org/T441460 (10Bonnjalal) 03NEW [16:59:38] 10Tool-athar: [Task 4] Build Wikimedia Codex Master Layout, RTL Support & Project Submission Form - https://phabricator.wikimedia.org/T441461 (10Bonnjalal) 03NEW [17:01:11] 10Tool-athar: [Task 5] Build Interactive Chart.js Visualizations, Live Filters & Export View - https://phabricator.wikimedia.org/T441462 (10Bonnjalal) 03NEW [17:47:38] FIRING: ProbeDown: Service toolsbeta-test-k8s-haproxy-7:443 has failed probes (http_admin_beta_toolforge_org_ip4) - https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/k8s-haproxy - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://prometheus-alerts.wmcloud.org/?q=alertname%3DProbeDown [17:48:15] 10Cloud-VPS (Debian Bullseye Deprecation), 10Beta-Cluster-Infrastructure, 06MediaWiki-Engineering, 13Patch-For-Review: Beta Cluster: Switch to PHP 8.5, includes writing Puppet changes to support PHP 8.5 on baremetal - https://phabricator.wikimedia.org/T435393#12442942 (10Southparkfan) >>! In T435393#124423... [17:57:38] RESOLVED: ProbeDown: Service toolsbeta-test-k8s-haproxy-7:443 has failed probes (http_admin_beta_toolforge_org_ip4) - https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/k8s-haproxy - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://prometheus-alerts.wmcloud.org/?q=alertname%3DProbeDown [18:17:09] 10Tool-athar: [Task 2] Implement Wikimedia OAuth 2.0 Login, Local Mock Bypass & Route Guards - https://phabricator.wikimedia.org/T441459#12443157 (10Bonnjalal) a:03Ybouachrine20 [18:23:31] (03open) 10project_5175_bot_1dc5cd2b4a7cadb6d1af8e29974ce1a7: Yarıda kesilen sorgu cevaplarını yeniden dene [toolforge-repos/kategori] - 10https://gitlab.wikimedia.org/toolforge-repos/kategori/-/merge_requests/5 [18:23:33] (03update) 10project_5175_bot_1dc5cd2b4a7cadb6d1af8e29974ce1a7: Yarıda kesilen sorgu cevaplarını yeniden dene [toolforge-repos/kategori] - 10https://gitlab.wikimedia.org/toolforge-repos/kategori/-/merge_requests/5 [18:28:38] FIRING: ProbeDown: Service toolsbeta-test-k8s-haproxy-7:443 has failed probes (http_admin_beta_toolforge_org_ip4) - https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/k8s-haproxy - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://prometheus-alerts.wmcloud.org/?q=alertname%3DProbeDown [18:33:38] RESOLVED: ProbeDown: Service toolsbeta-test-k8s-haproxy-7:443 has failed probes (http_admin_beta_toolforge_org_ip4) - https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/k8s-haproxy - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://prometheus-alerts.wmcloud.org/?q=alertname%3DProbeDown [18:41:51] (03PS1) 10Krinkle: frontend: Create a test build to Blubber config (using PHP 8.4) [labs/codesearch] - 10https://gerrit.wikimedia.org/r/1356452 [18:42:43] (03CR) 10CI reject: [V:04-1] frontend: Create a test build to Blubber config (using PHP 8.4) [labs/codesearch] - 10https://gerrit.wikimedia.org/r/1356452 (owner: 10Krinkle) [18:46:01] (03PS2) 10Krinkle: frontend: Create a test build to Blubber config (using PHP 8.4) [labs/codesearch] - 10https://gerrit.wikimedia.org/r/1356452 [18:46:41] (03CR) 10CI reject: [V:04-1] frontend: Create a test build to Blubber config (using PHP 8.4) [labs/codesearch] - 10https://gerrit.wikimedia.org/r/1356452 (owner: 10Krinkle) [18:48:06] (03PS3) 10Krinkle: frontend: Create a test build to Blubber config using PHP 8.4 [labs/codesearch] - 10https://gerrit.wikimedia.org/r/1356452 [18:48:54] (03CR) 10CI reject: [V:04-1] frontend: Create a test build to Blubber config using PHP 8.4 [labs/codesearch] - 10https://gerrit.wikimedia.org/r/1356452 (owner: 10Krinkle) [19:00:16] (03PS4) 10Krinkle: frontend: Create a test build to Blubber config using PHP 8.4 [labs/codesearch] - 10https://gerrit.wikimedia.org/r/1356452 [19:01:02] (03CR) 10CI reject: [V:04-1] frontend: Create a test build to Blubber config using PHP 8.4 [labs/codesearch] - 10https://gerrit.wikimedia.org/r/1356452 (owner: 10Krinkle) [19:02:57] (03PS5) 10Krinkle: frontend: Create a test build to Blubber config using PHP 8.4 [labs/codesearch] - 10https://gerrit.wikimedia.org/r/1356452 [19:03:42] (03CR) 10CI reject: [V:04-1] frontend: Create a test build to Blubber config using PHP 8.4 [labs/codesearch] - 10https://gerrit.wikimedia.org/r/1356452 (owner: 10Krinkle) [19:04:51] (03PS6) 10Krinkle: frontend: Create a test build to Blubber config using PHP 8.4 [labs/codesearch] - 10https://gerrit.wikimedia.org/r/1356452 [19:05:35] (03CR) 10CI reject: [V:04-1] frontend: Create a test build to Blubber config using PHP 8.4 [labs/codesearch] - 10https://gerrit.wikimedia.org/r/1356452 (owner: 10Krinkle) [19:05:58] (03PS7) 10Krinkle: frontend: Create a test build to Blubber config using PHP 8.4 [labs/codesearch] - 10https://gerrit.wikimedia.org/r/1356452 [19:06:46] (03CR) 10CI reject: [V:04-1] frontend: Create a test build to Blubber config using PHP 8.4 [labs/codesearch] - 10https://gerrit.wikimedia.org/r/1356452 (owner: 10Krinkle) [19:09:49] (03merge) 10sadrettin: Yarıda kesilen sorgu cevaplarını yeniden dene [toolforge-repos/kategori] - 10https://gitlab.wikimedia.org/toolforge-repos/kategori/-/merge_requests/5 (owner: 10project_5175_bot_1dc5cd2b4a7cadb6d1af8e29974ce1a7) [19:11:24] (03PS8) 10Krinkle: frontend: Create a test build to Blubber config using PHP 8.4 [labs/codesearch] - 10https://gerrit.wikimedia.org/r/1356452 [19:12:16] (03CR) 10CI reject: [V:04-1] frontend: Create a test build to Blubber config using PHP 8.4 [labs/codesearch] - 10https://gerrit.wikimedia.org/r/1356452 (owner: 10Krinkle) [19:12:56] (03PS9) 10Krinkle: frontend: Create a test build to Blubber config using PHP 8.4 [labs/codesearch] - 10https://gerrit.wikimedia.org/r/1356452 [19:13:50] (03CR) 10CI reject: [V:04-1] frontend: Create a test build to Blubber config using PHP 8.4 [labs/codesearch] - 10https://gerrit.wikimedia.org/r/1356452 (owner: 10Krinkle) [19:17:41] (03PS10) 10Krinkle: frontend: Create a test build to Blubber config using PHP 8.4 [labs/codesearch] - 10https://gerrit.wikimedia.org/r/1356452 [19:18:46] (03CR) 10CI reject: [V:04-1] frontend: Create a test build to Blubber config using PHP 8.4 [labs/codesearch] - 10https://gerrit.wikimedia.org/r/1356452 (owner: 10Krinkle) [19:20:18] (03PS11) 10Krinkle: frontend: Create a test build to Blubber config using PHP 8.4 [labs/codesearch] - 10https://gerrit.wikimedia.org/r/1356452 [19:21:08] (03CR) 10CI reject: [V:04-1] frontend: Create a test build to Blubber config using PHP 8.4 [labs/codesearch] - 10https://gerrit.wikimedia.org/r/1356452 (owner: 10Krinkle) [19:31:56] (03PS12) 10Krinkle: frontend: Create a test build to Blubber config using PHP 8.4 [labs/codesearch] - 10https://gerrit.wikimedia.org/r/1356452 [19:31:56] (03PS1) 10Krinkle: frontend: Fix build on PHP 8.4 and PHP 8.5 [labs/codesearch] - 10https://gerrit.wikimedia.org/r/1356474 [19:41:51] (03PS1) 10Krinkle: frontend: Add php8.5 build to Blubber config [labs/codesearch] - 10https://gerrit.wikimedia.org/r/1356491 [20:03:54] 10Tool-wsindex, 10Wikisource Reader App (Android): Add name_native_language to People - https://phabricator.wikimedia.org/T430705#12443657 (10Saiphani02) Hi @RCodes Feel free to work on this task. We didn't want to have empty author names. You can now check for name in English and name in native language and c... [20:04:39] 10Tool-wsindex, 10Wikisource Reader App (Android): Add name_native_language to People - https://phabricator.wikimedia.org/T430705#12443659 (10Saiphani02) [20:13:46] 10Tool-wsindex, 10Wikisource Reader App (Android): Add name_native_language to People - https://phabricator.wikimedia.org/T430705#12443676 (10RCodes) a:03RCodes Thanks @Saiphani02, That makes sense. I’ll claim the task now and work on it. [20:31:56] (03CR) 10Krinkle: [C:03+2] frontend: Fix build on PHP 8.4 and PHP 8.5 [labs/codesearch] - 10https://gerrit.wikimedia.org/r/1356474 (owner: 10Krinkle) [20:32:01] (03CR) 10Krinkle: [C:03+2] frontend: Create a test build to Blubber config using PHP 8.4 [labs/codesearch] - 10https://gerrit.wikimedia.org/r/1356452 (owner: 10Krinkle) [20:33:09] (03Merged) 10jenkins-bot: frontend: Fix build on PHP 8.4 and PHP 8.5 [labs/codesearch] - 10https://gerrit.wikimedia.org/r/1356474 (owner: 10Krinkle) [20:34:11] (03Merged) 10jenkins-bot: frontend: Create a test build to Blubber config using PHP 8.4 [labs/codesearch] - 10https://gerrit.wikimedia.org/r/1356452 (owner: 10Krinkle) [20:36:32] (03PS2) 10Krinkle: frontend: Add php8.5 test to Blubber config [labs/codesearch] - 10https://gerrit.wikimedia.org/r/1356491 [20:38:36] (03PS3) 10Krinkle: frontend: Add php8.5 test to Blubber config [labs/codesearch] - 10https://gerrit.wikimedia.org/r/1356491 [20:51:39] (03PS4) 10Krinkle: frontend: Add php8.5 test to Blubber config [labs/codesearch] - 10https://gerrit.wikimedia.org/r/1356491 [20:51:40] (03PS1) 10Krinkle: frontend: Make backend a required parameter for getHoundApi() [labs/codesearch] - 10https://gerrit.wikimedia.org/r/1356522 (https://phabricator.wikimedia.org/T268199) [20:52:03] (03CR) 10Krinkle: [C:03+2] frontend: Add php8.5 test to Blubber config [labs/codesearch] - 10https://gerrit.wikimedia.org/r/1356491 (owner: 10Krinkle) [20:53:02] (03Merged) 10jenkins-bot: frontend: Add php8.5 test to Blubber config [labs/codesearch] - 10https://gerrit.wikimedia.org/r/1356491 (owner: 10Krinkle) [20:54:01] (03PS2) 10Krinkle: frontend: Make backend a required parameter for getHoundApi() [labs/codesearch] - 10https://gerrit.wikimedia.org/r/1356522 (https://phabricator.wikimedia.org/T268199) [20:56:23] (03PS3) 10Krinkle: frontend: Make backend a required parameter for getHoundApi() [labs/codesearch] - 10https://gerrit.wikimedia.org/r/1356522 (https://phabricator.wikimedia.org/T268199) [21:08:10] 10Tool-wsindex, 10Wikisource Reader App (Android), 13Patch-For-Review: Add descriptions for books where Wikipedia articles are available [API] - https://phabricator.wikimedia.org/T430400#12443949 (10Bodhisattwa) >>! In T430400#12436824, @RCodes wrote: > Hi @Bodhisattwa , @Saiphani02, @Muguro > > While waiti... [21:42:54] 10VPS-project-Wikistats, 13Patch-For-Review: Show explanation about wikistats on landing pages - https://phabricator.wikimedia.org/T186374#12444071 (10Dzahn) 05Open→03Resolved a:03Dzahn The landing page now has two lines above the table saying what wikistats is, and that it is not the Analytics Wikis... [21:48:14] 10VPS-project-Wikistats: new possible wikifarms / hives detected - check for lists - https://phabricator.wikimedia.org/T38570#12444129 (10Dzahn) ` Gone (domain no longer exists): 27 - anime-wiki.org (de, fi, en) - vinopedia.hr language wikis (de, en, fr). vinopedia.hr itself is now a regular website withou... [21:59:58] 10VPS-project-Wikistats: new possible wikifarms / hives detected - check for lists - https://phabricator.wikimedia.org/T38570#12444151 (10Dzahn) 05Open→03Resolved a:03Dzahn Revisited this old task and checked every wiki URL listed in it, about 45 in total, to see if they still exist and still run Media... [22:06:55] 10VPS-project-Wikistats: Add nynwiki to wikistats - https://phabricator.wikimedia.org/T429222#12444189 (10Dzahn) once T429189 is resolved [22:07:58] 10VPS-project-Wikistats, 07affects-Miraheze: Add wiki.gg (about 1950 wikis) to wikistats as its own table - https://phabricator.wikimedia.org/T441509 (10Dzahn) 03NEW [22:10:32] 10VPS-project-Wikistats, 07affects-Miraheze: Add wiki.gg (about 1950 wikis) to wikistats as its own table - https://phabricator.wikimedia.org/T441509#12444205 (10RhinosF1) a:03RhinosF1 I will talk to their folks [22:11:42] 10VPS-project-Wikistats: Add mlwikivoyage to wikistats - https://phabricator.wikimedia.org/T441178#12444212 (10Dzahn) 05Open→03Resolved a:03Dzahn ` dzahn@wikistats-trixie:~$ sudo mysql wikistats -e "insert into wikivoyage (prefix, lang, loclang, method, ts) select prefix, lang, loclang, 8, NOW() from w... [22:19:03] (03open) 10project_5175_bot_1dc5cd2b4a7cadb6d1af8e29974ce1a7: Onay kuyruğu ve toplu gönderim (3. adım) [toolforge-repos/kategori] - 10https://gitlab.wikimedia.org/toolforge-repos/kategori/-/merge_requests/6 [22:42:24] 10Tool-wsindex, 10Wikisource Reader App (Android), 13Patch-For-Review: Add descriptions for books where Wikipedia articles are available [API] - https://phabricator.wikimedia.org/T430400#12444258 (10RCodes) Thanks @Bodhisattwa, got it! I'll keep it as it is.