[02:42:38] <wikibugs>	 10Cloud-VPS (Quota-requests), 06Moderator-Tools-Team, 10Wikilink-Tool: Request to increase object storage capacity - Wikilink project - https://phabricator.wikimedia.org/T392870#10784861 (10Scardenasmolinar)
[02:42:58] <wikibugs>	 10Cloud-VPS (Quota-requests), 06Moderator-Tools-Team, 10Wikilink-Tool: Request to increase object storage capacity - Wikilink project - https://phabricator.wikimedia.org/T392870#10784862 (10Scardenasmolinar) I have updated the task description for the approximate amount we would need.
[02:44:44] <wikibugs>	 10Cloud-VPS (Quota-requests), 06Moderator-Tools-Team, 10Wikilink-Tool: Request to increase object storage capacity - Wikilink project - https://phabricator.wikimedia.org/T392870#10784863 (10Scardenasmolinar)
[02:44:57] <wikibugs>	 10Cloud-VPS (Quota-requests), 06Moderator-Tools-Team, 10Wikilink-Tool: Request to increase object storage capacity - Wikilink project - https://phabricator.wikimedia.org/T392870#10784864 (10Scardenasmolinar)
[03:14:00] <wikibugs>	 (03CR) 10Abijeet Patro: [V:03+2] Localisation updates from https://translatewiki.net. [labs/tools/weapon-of-mass-description] - 10https://gerrit.wikimedia.org/r/1140495 (owner: 10L10n-bot)
[06:54:28] <wmcs-alerts>	 FIRING: PuppetAgentNoResources: No Puppet resources found on instance toolsbeta-test-k8s-etcd-25 on project toolsbeta   - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources
[06:58:28] <wmcs-alerts>	 FIRING: [4x] PuppetAgentNoResources: No Puppet resources found on instance tools-k8s-control-7 on project tools   - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources
[06:59:28] <wmcs-alerts>	 FIRING: [9x] PuppetAgentNoResources: No Puppet resources found on instance toolsbeta-acme-chief-2 on project toolsbeta   - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources
[07:03:28] <wmcs-alerts>	 FIRING: [28x] PuppetAgentNoResources: No Puppet resources found on instance tools-acme-chief-4 on project tools   - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources
[07:04:28] <wmcs-alerts>	 FIRING: [17x] PuppetAgentNoResources: No Puppet resources found on instance toolsbeta-acme-chief-2 on project toolsbeta   - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources
[07:08:28] <wmcs-alerts>	 FIRING: PuppetAgentNoResources: No Puppet resources found on instance cvn-apache10 on project cvn   - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources
[07:08:28] <wmcs-alerts>	 FIRING: PuppetAgentNoResources: No Puppet resources found on instance etcd-discovery-1 on project cloudinfra   - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources
[07:08:28] <wmcs-alerts>	 FIRING: [48x] PuppetAgentNoResources: No Puppet resources found on instance tools-acme-chief-4 on project tools   - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources
[07:09:28] <wmcs-alerts>	 FIRING: [23x] PuppetAgentNoResources: No Puppet resources found on instance toolsbeta-acme-chief-2 on project toolsbeta   - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources
[07:09:28] <wmcs-alerts>	 FIRING: PuppetAgentNoResources: No Puppet resources found on instance metricsinfra-puppetserver-1 on project metricsinfra   - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources
[07:10:28] <wmcs-alerts>	 FIRING: PuppetAgentNoResources: No Puppet resources found on instance bastion on project paws   - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources
[07:11:28] <wmcs-alerts>	 FIRING: PuppetAgentNoResources: No Puppet resources found on instance quarry-bastion on project quarry   - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources
[07:12:50] <wmcs-alerts>	 FIRING: ProbeDown: Service tools-static-15:80 has failed probes (http_tools_static_wmflabs_org_ip4) - https://wikitech.wikimedia.org/wiki/Runbook#tools-static-15:80 - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://prometheus-alerts.wmcloud.org/?q=alertname%3DProbeDown
[07:13:28] <wmcs-alerts>	 FIRING: [64x] PuppetAgentNoResources: No Puppet resources found on instance tools-acme-chief-4 on project tools   - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources
[07:14:28] <wmcs-alerts>	 FIRING: PuppetAgentNoResources: No Puppet resources found on instance project-proxy-puppetserver-1 on project project-proxy   - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources
[07:14:28] <wmcs-alerts>	 FIRING: [27x] PuppetAgentNoResources: No Puppet resources found on instance toolsbeta-acme-chief-2 on project toolsbeta   - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources
[07:15:50] <wikibugs>	 10Tool-techcontribs: I break the tool :( - https://phabricator.wikimedia.org/T384554#10785033 (10Chlod) 05Open→03Resolved a:03Chlod Timeout for both Gerrit and Phabricator data fetching has been bumped to 600 seconds. You do not break the tool anymore! :D
[07:17:50] <wmcs-alerts>	 RESOLVED: ProbeDown: Service tools-static-15:80 has failed probes (http_tools_static_wmflabs_org_ip4) - https://wikitech.wikimedia.org/wiki/Runbook#tools-static-15:80 - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://prometheus-alerts.wmcloud.org/?q=alertname%3DProbeDown
[07:18:28] <wmcs-alerts>	 FIRING: [79x] PuppetAgentNoResources: No Puppet resources found on instance tools-acme-chief-4 on project tools   - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources
[07:19:28] <wmcs-alerts>	 FIRING: [33x] PuppetAgentNoResources: No Puppet resources found on instance toolsbeta-acme-chief-2 on project toolsbeta   - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources
[07:20:28] <wmcs-alerts>	 FIRING: [2x] PuppetAgentNoResources: No Puppet resources found on instance bastion on project paws   - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources
[07:23:16] <wikibugs>	 (03update) 10aborrero: Importing tools dns resources [repos/cloud/toolforge/tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/tofu-provisioning/-/merge_requests/13 (https://phabricator.wikimedia.org/T390056) (owner: 10chuckonwumelu)
[07:23:28] <wmcs-alerts>	 FIRING: [79x] PuppetAgentNoResources: No Puppet resources found on instance tools-acme-chief-4 on project tools   - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources
[07:23:28] <wmcs-alerts>	 RESOLVED: PuppetAgentNoResources: No Puppet resources found on instance cvn-apache10 on project cvn   - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources
[07:23:28] <wmcs-alerts>	 RESOLVED: PuppetAgentNoResources: No Puppet resources found on instance etcd-discovery-1 on project cloudinfra   - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources
[07:23:54] <wikibugs>	 (03approved) 10aborrero: Importing tools dns resources [repos/cloud/toolforge/tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/tofu-provisioning/-/merge_requests/13 (https://phabricator.wikimedia.org/T390056) (owner: 10chuckonwumelu)
[07:24:28] <wmcs-alerts>	 FIRING: [36x] PuppetAgentNoResources: No Puppet resources found on instance toolsbeta-acme-chief-2 on project toolsbeta   - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources
[07:25:28] <wmcs-alerts>	 FIRING: [2x] PuppetAgentNoResources: No Puppet resources found on instance bastion on project paws   - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources
[07:26:28] <wmcs-alerts>	 RESOLVED: PuppetAgentNoResources: No Puppet resources found on instance quarry-bastion on project quarry   - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources
[07:28:28] <wmcs-alerts>	 FIRING: [79x] PuppetAgentNoResources: No Puppet resources found on instance tools-acme-chief-4 on project tools   - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources
[07:29:28] <wmcs-alerts>	 FIRING: [34x] PuppetAgentNoResources: No Puppet resources found on instance toolsbeta-acme-chief-2 on project toolsbeta   - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources
[07:29:28] <wmcs-alerts>	 FIRING: [2x] PuppetAgentNoResources: No Puppet resources found on instance project-proxy-puppetserver-1 on project project-proxy   - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources
[07:29:28] <wmcs-alerts>	 RESOLVED: PuppetAgentNoResources: No Puppet resources found on instance metricsinfra-puppetserver-1 on project metricsinfra   - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources
[07:33:28] <wmcs-alerts>	 RESOLVED: [73x] PuppetAgentNoResources: No Puppet resources found on instance tools-acme-chief-4 on project tools   - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources
[07:34:28] <wmcs-alerts>	 FIRING: [3x] PuppetAgentNoResources: No Puppet resources found on instance project-proxy-puppetserver-1 on project project-proxy   - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources
[07:34:28] <wmcs-alerts>	 FIRING: [26x] PuppetAgentNoResources: No Puppet resources found on instance toolsbeta-bastion-6 on project toolsbeta   - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources
[07:35:28] <wmcs-alerts>	 RESOLVED: [2x] PuppetAgentNoResources: No Puppet resources found on instance bastion on project paws   - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources
[07:39:28] <wmcs-alerts>	 RESOLVED: [19x] PuppetAgentNoResources: No Puppet resources found on instance toolsbeta-cumin-1 on project toolsbeta   - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources
[07:40:23] <wikibugs>	 06Toolforge-standards-committee, 06WMF-NDA-Requests: Volunteer NDA for JJMC89 - https://phabricator.wikimedia.org/T375041#10785112 (10MoritzMuehlenhoff) 05Open→03Resolved a:03MoritzMuehlenhoff Thanks! I'm readding @JJMC89 to the WMF-NDA Phabricator project. For the tracking sheet, this is probably co...
[07:44:28] <wmcs-alerts>	 FIRING: [3x] PuppetAgentNoResources: No Puppet resources found on instance project-proxy-puppetserver-1 on project project-proxy   - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources
[07:47:43] <wikibugs>	 06cloud-services-team, 10Toolforge, 10ChangeProp, 06collaboration-services, and 10 others: Figure out a plan to move forward with regarding Redis License changes - https://phabricator.wikimedia.org/T360596#10785130 (10hashar) Redis is now available under the AGPLv3. That was announced by their CEO at https...
[07:49:28] <wmcs-alerts>	 RESOLVED: [2x] PuppetAgentNoResources: No Puppet resources found on instance proxy-5 on project project-proxy   - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources
[08:05:42] <wikibugs>	 06cloud-services-team, 10Toolforge, 10ChangeProp, 06collaboration-services, and 10 others: Figure out a plan to move forward with regarding Redis License changes - https://phabricator.wikimedia.org/T360596#10785204 (10akosiaris) >>! In T360596#10785130, @hashar wrote: > Redis is now available under the AGP...
[08:14:28] <wmcs-alerts>	 FIRING: PuppetAgentNoResources: No Puppet resources found on instance paws-nfs-1 on project paws   - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources
[08:32:10] <wikibugs>	 (03open) 10eliza189: Eliza data update [toolforge-repos/miss-search] (linkhere_branch) - 10https://gitlab.wikimedia.org/toolforge-repos/miss-search/-/merge_requests/3
[08:42:17] <wikibugs>	 10Tool-wosretbot, 06Toolforge-standards-committee: Adoption request for wosretbot - https://phabricator.wikimedia.org/T392781#10785259 (10Tkarcher) Sorry for necro-posting, but I don't want to open a new task for this quick adoption-related question: I also requested access to https://gitlab.wikimedia.org/...
[08:43:42] <wikibugs>	 10Tool-paulina, 03Wikimedia-Hackathon-2025: Write down user stories for Paulina's most common use cases - https://phabricator.wikimedia.org/T388571#10785273 (10Piracalamina)
[08:52:41] <wikibugs>	 10Tool-gawa, 03Wikimedia-Hackathon-2025: [Documentation] Mise à jour de la documentation de l'outil GAWA - https://phabricator.wikimedia.org/T393148#10785321 (10paulwiki)
[08:59:15] <wikibugs>	 10Tool-paulina, 03Wikimedia-Hackathon-2025: Allow for users to search an author without a search term, just using filters - https://phabricator.wikimedia.org/T393153 (10Piracalamina) 03NEW
[09:04:13] <wikibugs>	 10Tool-paulina, 03Wikimedia-Hackathon-2025: Allow for users to search an author without a search term, just using filters - https://phabricator.wikimedia.org/T393153#10785400 (10Piracalamina)
[09:05:04] <wikibugs>	 10Tool-paulina, 03Wikimedia-Hackathon-2025: Allow for users to search an author without a search term, just using filters - https://phabricator.wikimedia.org/T393153#10785415 (10Piracalamina)
[09:14:38] <wikibugs>	 10Tool-paulina: Taxonomía de áreas creativas - https://phabricator.wikimedia.org/T393157 (10marfossatti) 03NEW
[09:21:22] <wikibugs>	 10Tool-paulina: Taxonomía de áreas creativas - https://phabricator.wikimedia.org/T393157#10785481 (10marfossatti)
[09:21:37] <wikibugs>	 10Tool-inteGraality: pywikibot.exceptions.ServerError: HTTPSConnectionPool(host='query.wikidata.org', port=443): Read timed out. (read timeout=45) - https://phabricator.wikimedia.org/T384882#10785483 (10JeanFred) 05Open→03Resolved a:03JeanFred I’ll scope this to the problematic uncaught exception ; wit...
[09:49:23] <wikibugs>	 10Tool-gawa, 03Wikimedia-Hackathon-2025: [Code Contribution] Hébergement de l'outil GAWA sur Tooforge - https://phabricator.wikimedia.org/T393162 (10paulwiki) 03NEW
[09:57:13] <wikibugs>	 (03update) 10eliza189: Eliza data update [toolforge-repos/miss-search] (linkhere_branch) - 10https://gitlab.wikimedia.org/toolforge-repos/miss-search/-/merge_requests/3
[10:57:25] <wikibugs>	 10Tool-inteGraality: Support for 'mul' in integraality - https://phabricator.wikimedia.org/T393166#10785679 (10JeanFred)
[10:57:46] <wikibugs>	 10Tool-inteGraality: Support for 'mul' in integraality - https://phabricator.wikimedia.org/T393166#10785680 (10JeanFred)
[11:03:29] <wikibugs>	 10Tool-inteGraality: Support for 'mul' in integraality - https://phabricator.wikimedia.org/T393166#10785686 (10JeanFred)
[11:03:29] <wikibugs>	 10Tool-inteGraality: Re-evaluate the grouping-link behaviour - https://phabricator.wikimedia.org/T237276#10785687 (10JeanFred)
[11:23:28] <wikibugs>	 10Tool-wosretbot, 06Toolforge-standards-committee: Adoption request for wosretbot - https://phabricator.wikimedia.org/T392781#10785698 (10bd808) >>! In T392781#10785259, @Tkarcher wrote: > Sorry for necro-posting, but I don't want to open a new task for this quick adoption-related question: I also requeste...
[11:24:58] <wikibugs>	 10cloud-services-team (FY2024/2025-Q3-Q4), 06DC-Ops, 10ops-eqiad, 06SRE: Temperature Inlet Temp issue on clouddumps1001:9290 - https://phabricator.wikimedia.org/T383723#10785702 (10fnegri) 05Open→03Resolved Thanks @Jclark-ctr, looking good:  {F59619503}  I'll mark this as Resolved, and let you know...
[11:48:58] <wikibugs>	 06cloud-services-team, 10Toolforge: push-to-deploy: optionally log deployments to SAL automatically - https://phabricator.wikimedia.org/T393169 (10LucasWerkmeister) 03NEW
[11:52:03] <wikibugs>	 06cloud-services-team, 10Toolforge: push-to-deploy: optionally log deployments to SAL automatically - https://phabricator.wikimedia.org/T393169#10785784 (10LucasWerkmeister)
[11:52:10] <wikibugs>	 10Cloud Services Proposals, 10cloud-services-team (FY2024/2025-Q3-Q4), 10Toolforge, 05Cloud-Services-Origin-Team, and 3 others: [Epic,builds-api,components-api,webservice,jobs-api] Make Toolforge a proper platform as a service with push-to-deploy and build... - https://phabricator.wikimedia.org/T194332#10785785
[11:57:54] <wikibugs>	 10Tool-translatetagger, 03Wikimedia-Hackathon-2025: Create Gadget to Simplify Workflow for Adding Translation Tag - https://phabricator.wikimedia.org/T393170#10785804 (10Gopavasanth)
[12:08:35] <wikibugs>	 10Tool-inteGraality: Missing a space in the query - https://phabricator.wikimedia.org/T391523#10785847 (10Soylacarli) Hi! It was happening with all of my 5 dashboards (you can found them [[ https://www.wikidata.org/wiki/User:Soylacarli | here ]]). Although I notice that it is already fixed, so maybe we can close...
[12:15:22] <wikibugs>	 10Tool-translatetagger, 03Wikimedia-Hackathon-2025: Create Gadget to Simplify Workflow for Adding Translation Tag - https://phabricator.wikimedia.org/T393170#10785858 (10Gopavasanth) Enabled CORS on the app side  Commit: https://github.com/indictechcom/translatable-wikitext-converter/commit/08fdb482dd4e1ef027c...
[12:52:55] <wikibugs>	 06cloud-services-team, 10Cloud-VPS, 06Infrastructure-Foundations, 07Puppet: Puppet removed "nameserver" line from /etc/resolv.conf - https://phabricator.wikimedia.org/T379927#10785955 (10Andrew) 05Open→03Resolved I'm satisfied that https://gerrit.wikimedia.org/r/c/operations/puppet/+/1091249 is an...
[13:23:50] <wmcs-alerts>	 FIRING: ProbeDown: Service tools-static-15:80 has failed probes (http_tools_static_wmflabs_org_ip4) - https://wikitech.wikimedia.org/wiki/Runbook#tools-static-15:80 - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://prometheus-alerts.wmcloud.org/?q=alertname%3DProbeDown
[13:28:50] <wmcs-alerts>	 RESOLVED: ProbeDown: Service tools-static-15:80 has failed probes (http_tools_static_wmflabs_org_ip4) - https://wikitech.wikimedia.org/wiki/Runbook#tools-static-15:80 - https://grafana.wikimedia.org/d/O0nHhdhnz/network-probes-overview?var-job=probes/custom&var-module=All - https://prometheus-alerts.wmcloud.org/?q=alertname%3DProbeDown
[13:43:52] <wikibugs>	 10Tool-techcontribs, 03Wikimedia-Hackathon-2025: I break the tool :( - https://phabricator.wikimedia.org/T384554#10786114 (10Chlod)
[13:56:03] <wikibugs>	 (03open) 10piracalamina: Resolve T393153 - Search for an author without a search term [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/3
[14:30:51] <wikibugs>	 06cloud-services-team, 10Toolforge, 03Wikimedia-Hackathon-2025: [Session] Introducing and exploring Toolforge UI with prospective users - https://phabricator.wikimedia.org/T383149#10786231 (10Sarai-WMF)
[14:35:13] <wikibugs>	 10Tool-gawa, 03Wikimedia-Hackathon-2025: [Code Contribution] Amélioration des interfaces de l'outil GAWA - https://phabricator.wikimedia.org/T393184 (10paulwiki) 03NEW
[14:48:13] <wikibugs>	 (03open) 10davidcoronel: Searchbox for country dropdown select filter [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/4
[14:55:50] <wikibugs>	 (03open) 10bd808: Make php and apache work [toolforge-repos/gitlab-content] - 10https://gitlab.wikimedia.org/toolforge-repos/gitlab-content/-/merge_requests/1
[14:57:18] <wikibugs>	 (03merge) 10bd808: Make php and apache work [toolforge-repos/gitlab-content] - 10https://gitlab.wikimedia.org/toolforge-repos/gitlab-content/-/merge_requests/1
[15:02:38] <wikibugs>	 (03PS1) 10Herron: add dummy group for pcc [labs/private] - 10https://gerrit.wikimedia.org/r/1140727
[15:03:29] <wikibugs>	 (03CR) 10Herron: [V:03+2 C:03+2] add dummy group for pcc [labs/private] - 10https://gerrit.wikimedia.org/r/1140727 (owner: 10Herron)
[15:04:28] <wmcs-alerts>	 RESOLVED: PuppetAgentNoResources: No Puppet resources found on instance paws-nfs-1 on project paws   - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources
[15:23:29] <wikibugs>	 (03update) 10davidcoronel: Searchbox for country dropdown select filter [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/4
[15:24:24] <wikibugs>	 (03update) 10davidcoronel: Searchbox for country dropdown select filter [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/4
[15:24:36] <wikibugs>	 10cloud-services-team (Hardware), 06DC-Ops, 10ops-codfw, 06SRE, 13Patch-For-Review: Q4:rack/setup/install cloudcontrol2010-dev - https://phabricator.wikimedia.org/T393102#10786440 (10Andrew) a:05Andrew→03None I believe this host has a raid controller. Assuming that's correct, I'd like a raid10 combin...
[15:26:14] <wikibugs>	 10Tool-techcontribs, 03Wikimedia-Hackathon-2025: Add reporting on SAL entries - https://phabricator.wikimedia.org/T384113#10786445 (10Chlod) 05Open→03In progress a:03Chlod
[15:27:36] <wikibugs>	 (03update) 10piracalamina: Resolve T393153 - Search for an author without a search term [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/3
[15:30:57] <wikibugs>	 (03update) 10davidcoronel: Searchbox for country dropdown select filter [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/4
[15:31:48] <wikibugs>	 (03update) 10davidcoronel: Searchbox for country dropdown select filter [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/4
[15:33:43] <wikibugs>	 (03update) 10davidcoronel: Searchbox for country dropdown select filter [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/4
[15:35:42] <wikibugs>	 (03merge) 10pepepiton: Searchbox for country dropdown select filter [toolforge-repos/paulina] - 10https://gitlab.wikimedia.org/toolforge-repos/paulina/-/merge_requests/4 (owner: 10davidcoronel)
[16:00:09] <wikibugs>	 06cloud-services-team, 06DC-Ops, 10decommission-hardware, 10ops-codfw, 06SRE: decommission cloudlb2001-dev.codfw.wmnet - https://phabricator.wikimedia.org/T392686#10786598 (10Andrew) + @cmooney because I bet he can fix this in 5 seconds
[16:01:36] <wikibugs>	 (03open) 10andrew: toolsbeta: add toolsbeta.org zone and a record pointing to the bastion [repos/cloud/cloud-vps/tofu-infra] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/226 (https://phabricator.wikimedia.org/T362253)
[16:02:19] <wikibugs>	 (03update) 10andrew: toolsbeta: add toolsbeta.org zone and a record pointing to the bastion [repos/cloud/cloud-vps/tofu-infra] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/226 (https://phabricator.wikimedia.org/T362253)
[16:09:15] <wikibugs>	 06cloud-services-team, 10decommission-hardware: decommission cloudcephosd100[1-3] - https://phabricator.wikimedia.org/T393196 (10Andrew) 03NEW
[16:14:06] <logmsgbot_cloud>	 !log andrew@cloudcumin1001 admin START - Cookbook wmcs.ceph.osd.depool_and_destroy
[16:14:09] <logmsgbot_cloud>	 !log andrew@cloudcumin1001 admin END (FAIL) - Cookbook wmcs.ceph.osd.depool_and_destroy (exit_code=99)
[16:14:20] <logmsgbot_cloud>	 !log andrew@cloudcumin1001 admin START - Cookbook wmcs.ceph.osd.depool_and_destroy (T393196)
[16:14:25] <stashbot>	 T393196: decommission cloudcephosd100[1-3] - https://phabricator.wikimedia.org/T393196
[16:17:21] <logmsgbot_cloud>	 andrew@cloudcumin1001 depool_and_destroy (PID 1581806) is awaiting input
[16:20:08] <logmsgbot_cloud>	 !log andrew@cloudcumin1001 admin END (ERROR) - Cookbook wmcs.ceph.osd.depool_and_destroy (exit_code=97) (T393196)
[16:20:15] <stashbot>	 T393196: decommission cloudcephosd100[1-3] - https://phabricator.wikimedia.org/T393196
[16:20:22] <logmsgbot_cloud>	 !log andrew@cloudcumin1001 admin START - Cookbook wmcs.ceph.osd.depool_and_destroy (T393196)
[18:31:47] <wikibugs>	 10Toolforge (Quota-requests): Elasticsearch credential request for techcontribs - https://phabricator.wikimedia.org/T393209 (10Chlod) 03NEW
[18:31:56] <wikibugs>	 10Tool-techcontribs, 10Toolforge (Quota-requests): Elasticsearch credential request for techcontribs - https://phabricator.wikimedia.org/T393209#10787065 (10Chlod)
[18:36:55] <wikibugs>	 10Tool-techcontribs, 10Toolforge (Quota-requests): Elasticsearch credential request for techcontribs - https://phabricator.wikimedia.org/T393209#10787074 (10taavi) 05Open→03Resolved Done.
[18:55:20] <logmsgbot_cloud>	 !log andrew@cloudcumin1001 admin END (PASS) - Cookbook wmcs.ceph.osd.depool_and_destroy (exit_code=0) (T393196)
[18:55:27] <stashbot>	 T393196: decommission cloudcephosd100[1-3] - https://phabricator.wikimedia.org/T393196
[18:55:48] <logmsgbot_cloud>	 !log andrew@cloudcumin1001 admin START - Cookbook wmcs.ceph.osd.depool_and_destroy (T393196)
[18:57:39] <wikibugs>	 10Cloud-VPS (Quota-requests), 06Moderator-Tools-Team, 10Wikilink-Tool: Request to increase object storage capacity - Wikilink project - https://phabricator.wikimedia.org/T392870#10787110 (10Scardenasmolinar) Update: We uploaded most of our historical data, and it seems we have run out of storage. We have hit...
[18:59:21] <wikibugs>	 06cloud-services-team, 10Cloud-VPS: Enable use of web proxy for wikipeoplestats.org domain - https://phabricator.wikimedia.org/T390800#10787116 (10Andrew) a:05Andrew→03None I'm not sure why I claimed this. Probably in error.
[19:00:12] <wikibugs>	 06cloud-services-team, 10Cloud-VPS, 07Epic: Wind down use of project ID and project name equivalency in OpenStack - https://phabricator.wikimedia.org/T274268#10787119 (10Andrew) 05Open→03Resolved I think this is done, although I have definitely thought that before.
[19:01:34] <wikibugs>	 06cloud-services-team, 10Cloud-VPS, 10VPS-Project-wikicommunityhealth: [cinder] Volume failing to attach/detach - https://phabricator.wikimedia.org/T392089#10787125 (10Andrew) Hi folks! I imagine you're done with your data rescue... can we now delete volumes and close this ticket?
[20:44:42] <wikibugs>	 (03close) 10aborrero: toolsbeta: add toolsbeta.org zone and a record pointing to the bastion [repos/cloud/cloud-vps/tofu-infra] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/226 (https://phabricator.wikimedia.org/T362253) (owner: 10andrew)
[20:54:43] <wikibugs>	 (03open) 10aborrero: resources: clarify where the actual infra is defined for a few projects [repos/cloud/cloud-vps/tofu-infra] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/227
[21:02:01] <wikibugs>	 (03merge) 10aborrero: resources: clarify where the actual infra is defined for a few projects [repos/cloud/cloud-vps/tofu-infra] - 10https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/227
[21:51:13] <logmsgbot_cloud>	 !log andrew@cloudcumin1001 admin END (PASS) - Cookbook wmcs.ceph.osd.depool_and_destroy (exit_code=0) (T393196)
[21:51:20] <stashbot>	 T393196: decommission cloudcephosd100[1-3] - https://phabricator.wikimedia.org/T393196
[22:22:33] <wikibugs>	 10Tool-refill: In the edit summary of the reFill tool, link to the page describing reFill - https://phabricator.wikimedia.org/T393222 (10Prototyperspective) 03NEW
[22:25:10] <wikibugs>	 10Tool-wikicordo: Filter for "ready to be closed" DRs (older than 7 days) - https://phabricator.wikimedia.org/T393223 (10Josve05a) 03NEW
[22:39:36] <wikibugs>	 10Tools: kmlexport tool returning 403 Forbidden error - https://phabricator.wikimedia.org/T390009#10787567 (10DB111) 05Open→03Resolved a:03DB111 >>! In T390009#10676691, @bd808 wrote: > Adding a body to the 403 response that says anything about why an authorization block is being applied might be helpf...
[23:04:20] <wikibugs>	 (03open) 10andrew: toolsbeta: add toolsbeta.org zone and a record pointing to the bastion [repos/cloud/toolforge/tofu-provisioning] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/tofu-provisioning/-/merge_requests/14 (https://phabricator.wikimedia.org/T362253)
[23:04:41] <logmsgbot_cloud>	 !log andrew@cloudcumin1001 admin START - Cookbook wmcs.ceph.osd.depool_and_destroy (T393196)
[23:04:50] <stashbot>	 T393196: decommission cloudcephosd100[1-3] - https://phabricator.wikimedia.org/T393196
[23:43:07] <wikibugs>	 06cloud-services-team, 10Cloud-VPS, 10VPS-Project-wikicommunityhealth: [cinder] Volume failing to attach/detach - https://phabricator.wikimedia.org/T392089#10787645 (10CristianCantoro) Hi @Andrew,  >>! In T392089#10787125, @Andrew wrote: > Hi folks! I imagine you're done with your data rescue... can we now d...