[01:11:56] (ToolsGridQueueProblem) firing: Grid queue webgrid-generic@tools-sgewebgen-10-2.tools.eqiad1.wikimedia.cloud is in state E - https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolsGridQueueProblem - https://prometheus-alerts.wmcloud.org/?q=alertname%3DToolsGridQueueProblem [01:24:44] 10Toolforge Jobs framework, 10Kubernetes: Allow Toolforge scheduled jobs to have a maximum runtime - https://phabricator.wikimedia.org/T306391 (10bd808) `lang=irc [01:06] < legoktm> bd808: I think gitlab-account-approval is stuck? [01:06] < legoktm> the container has been running for 24h [01:06] < bd80... [01:31:26] 10Toolforge Jobs framework: toolforge-jobs job emails should have information on why events happened - https://phabricator.wikimedia.org/T306310 (10bd808) I don't know for sure that Kubernetes has all of the answers that @valhallasw is hoping for here, but one new thing that we could add to the email is the last... [01:38:43] 10Toolforge Jobs framework: Add health check support to toolforge-jobs - https://phabricator.wikimedia.org/T348512 (10bd808) [01:38:45] 10Toolforge Jobs framework: Toolforge jobs: consider having a way for jobs to report their liveness status to kubernetes - https://phabricator.wikimedia.org/T335592 (10bd808) [01:38:51] 10Toolforge Jobs framework: Toolforge jobs: consider having a way for jobs to report their liveness status to kubernetes - https://phabricator.wikimedia.org/T335592 (10bd808) [01:45:34] 10Toolforge Jobs framework: Run webservices via the jobs framework - https://phabricator.wikimedia.org/T348755 (10bd808) [01:45:57] 10Toolforge Jobs framework, 10Epic: Run webservices via the jobs framework - https://phabricator.wikimedia.org/T348755 (10bd808) [01:47:23] 10Toolforge Jobs framework: Make it possible to start/restart jobs from other k8s jobs - https://phabricator.wikimedia.org/T315729 (10bd808) [01:52:27] 10Toolforge Jobs framework, 10cloud-services-team: Is it possible to run webservice restart in toolforge-jobs? - https://phabricator.wikimedia.org/T322483 (10bd808) {T246540} is probably what really needs fixing rather than the bandaid of making it more possible for folks to invent their own liveness monitorin... [01:57:01] 10Toolforge Jobs framework: toolforge-jobs – wikihistory needs a container with both php7 and mono - https://phabricator.wikimedia.org/T305780 (10bd808) [01:57:08] 10Grid-Engine-to-K8s-Migration: Migrate wikihistory from Toolforge GridEngine to Toolforge Kubernetes - https://phabricator.wikimedia.org/T320157 (10bd808) [02:07:26] 10Toolforge Jobs framework, 10Kubernetes, 10User-bd808: Job getting killed on k8s - https://phabricator.wikimedia.org/T299121 (10bd808) 05Open→03Resolved a:03bd808 >>! In T299121#7633057, @So9q wrote: > I'm curious how this killing of processes are governed. The only thing that will make the system ki... [02:24:25] 10Toolforge, 10cloud-services-team: Do something to Toolforge tools with no non-blocked maintainers - https://phabricator.wikimedia.org/T320342 (10bd808) I updated P35381 to exclude tools that are currently disabled pending deletion (https://disabled-tools.toolforge.org/). I have now disabled all of the legiti... [04:16:56] (ToolsGridQueueProblem) firing: Grid queue webgrid-generic@tools-sgewebgen-10-2.tools.eqiad1.wikimedia.cloud is in state E - https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolsGridQueueProblem - https://prometheus-alerts.wmcloud.org/?q=alertname%3DToolsGridQueueProblem [06:58:19] (HAProxyBackendUnavailable) firing: HAProxy service neutron-api_backend backend cloudcontrol1005.private.eqiad.wikimedia.cloud is down - https://wikitech.wikimedia.org/wiki/HAProxy - TODO - https://alerts.wikimedia.org/?q=alertname%3DHAProxyBackendUnavailable [07:03:19] (HAProxyBackendUnavailable) resolved: HAProxy service neutron-api_backend backend cloudcontrol1005.private.eqiad.wikimedia.cloud is down - https://wikitech.wikimedia.org/wiki/HAProxy - TODO - https://alerts.wikimedia.org/?q=alertname%3DHAProxyBackendUnavailable [07:21:56] (ToolsGridQueueProblem) firing: Grid queue webgrid-generic@tools-sgewebgen-10-2.tools.eqiad1.wikimedia.cloud is in state E - https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolsGridQueueProblem - https://prometheus-alerts.wmcloud.org/?q=alertname%3DToolsGridQueueProblem [09:11:11] 10Toolforge (Toolforge iteration 02): [bulids-builder] upgrade builder to lastest with >=2.6.1 buildpacks - https://phabricator.wikimedia.org/T354330 (10dcaro) a:03dcaro [09:11:17] 10Tool-hitaden, 10Toolforge Build Service: [buildservice,nodejs] nodejs buildpack does not take envvars into account - https://phabricator.wikimedia.org/T353557 (10dcaro) [09:11:54] 10Toolforge (Toolforge iteration 02): [bulids-builder] upgrade builder to lastest with >=2.6.1 buildpacks - https://phabricator.wikimedia.org/T354330 (10dcaro) 05Open→03In progress [09:25:43] 10Toolforge (Toolforge iteration 02), 10Patch-For-Review: [buildservice] Feature request - Indicate when long envvars are cutoff when listing - https://phabricator.wikimedia.org/T353287 (10CodeReviewBot) sstefanova merged https://gitlab.wikimedia.org/repos/cloud/toolforge/envvars-cli/-/merge_requests/19 list:... [09:28:25] 10Toolforge (Toolforge iteration 02), 10Patch-For-Review: [buildservice] Feature request - Indicate when long envvars are cutoff when listing - https://phabricator.wikimedia.org/T353287 (10Slst2020) Final implementation: ` toolsbeta.tf-test@bullseye:~/envvars-cli$ toolforge envvars list --help Usage: toolforg... [09:34:29] 10Toolforge: [dev] Investigate lima-vm as an alternative to Vagrant for lima-kilo - https://phabricator.wikimedia.org/T354406 (10Slst2020) [09:35:35] 10Toolforge (Toolforge iteration 02): [dev] Investigate lima-vm as an alternative to Vagrant for lima-kilo - https://phabricator.wikimedia.org/T354406 (10Slst2020) [10:20:19] (HAProxyBackendUnavailable) firing: HAProxy service neutron-api_backend backend cloudcontrol1006.private.eqiad.wikimedia.cloud is down - https://wikitech.wikimedia.org/wiki/HAProxy - TODO - https://alerts.wikimedia.org/?q=alertname%3DHAProxyBackendUnavailable [10:25:19] (HAProxyBackendUnavailable) resolved: HAProxy service neutron-api_backend backend cloudcontrol1006.private.eqiad.wikimedia.cloud is down - https://wikitech.wikimedia.org/wiki/HAProxy - TODO - https://alerts.wikimedia.org/?q=alertname%3DHAProxyBackendUnavailable [10:26:56] (ToolsGridQueueProblem) firing: Grid queue webgrid-generic@tools-sgewebgen-10-2.tools.eqiad1.wikimedia.cloud is in state E - https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolsGridQueueProblem - https://prometheus-alerts.wmcloud.org/?q=alertname%3DToolsGridQueueProblem [10:29:00] !log fnegri@cloudcumin1001 tools START - Cookbook wmcs.toolforge.grid.cleanup_queue_errors [10:29:03] !log fnegri@cloudcumin1001 tools END (PASS) - Cookbook wmcs.toolforge.grid.cleanup_queue_errors (exit_code=0) [10:31:25] 10Toolforge (Toolforge iteration 02), 10Patch-For-Review: [bulids-builder] upgrade builder to lastest with >=2.6.1 buildpacks - https://phabricator.wikimedia.org/T354330 (10CodeReviewBot) dcaro opened https://gitlab.wikimedia.org/repos/cloud/toolforge/builds-builder/-/merge_requests/25 inect_buildpacks.sh: do... [10:31:56] (ToolsGridQueueProblem) resolved: Grid queue webgrid-generic@tools-sgewebgen-10-2.tools.eqiad1.wikimedia.cloud is in state E - https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolsGridQueueProblem - https://prometheus-alerts.wmcloud.org/?q=alertname%3DToolsGridQueueProblem [11:00:51] !log fnegri@cloudcumin1001 openvas START - Cookbook wmcs.vps.add_user_to_project for user 'khurd' in role 'member' (T354192) [11:00:55] T354192: Request creation of OpenVAS VPS project - https://phabricator.wikimedia.org/T354192 [11:01:35] !log fnegri@cloudcumin1001 openvas END (PASS) - Cookbook wmcs.vps.add_user_to_project (exit_code=0) for user 'khurd' in role 'member' (T354192) [11:02:47] 10Toolforge (Toolforge iteration 02), 10Patch-For-Review: [bulids-builder] upgrade builder to lastest with >=2.6.1 buildpacks - https://phabricator.wikimedia.org/T354330 (10CodeReviewBot) dcaro merged https://gitlab.wikimedia.org/repos/cloud/toolforge/builds-builder/-/merge_requests/25 inect_buildpacks.sh: do... [11:02:56] 10Cloud-VPS (Quota-requests): Quota increase request for project 'monitoring' - https://phabricator.wikimedia.org/T354412 (10fgiunchedi) [11:04:10] 10Toolforge (Toolforge iteration 02), 10Patch-For-Review: [bulids-builder] upgrade builder to lastest with >=2.6.1 buildpacks - https://phabricator.wikimedia.org/T354330 (10CodeReviewBot) project_1317_bot_df3177307bed93c3f34e421e26c86e38 opened https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deplo... [11:06:02] 10Cloud-VPS (Project-requests): Request creation of OpenVAS VPS project - https://phabricator.wikimedia.org/T354192 (10fnegri) 05In progress→03Resolved @KHurd-WMF done, you should be able to access the project now. Welcome to Cloud VPS, and please make sure to subscribe to the [cloud-announce](https://lists... [11:11:52] !log toolsbeta dcaro@urcuchillay START - Cookbook wmcs.toolforge.k8s.component.deploy for component builds-builder [11:11:52] !log toolsbeta dcaro@urcuchillay END (FAIL) - Cookbook wmcs.toolforge.k8s.component.deploy (exit_code=99) for component builds-builder [11:11:55] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Toolsbeta/SAL [11:11:57] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Toolsbeta/SAL [11:49:57] !log toolsbeta dcaro@urcuchillay START - Cookbook wmcs.toolforge.k8s.component.deploy for component builds-builder [11:50:00] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Toolsbeta/SAL [11:50:33] !log toolsbeta dcaro@urcuchillay END (PASS) - Cookbook wmcs.toolforge.k8s.component.deploy (exit_code=0) for component builds-builder [11:50:35] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Toolsbeta/SAL [11:55:23] !log tools dcaro@urcuchillay START - Cookbook wmcs.toolforge.k8s.component.deploy for component builds-builder [11:55:26] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [11:56:04] !log tools dcaro@urcuchillay END (PASS) - Cookbook wmcs.toolforge.k8s.component.deploy (exit_code=0) for component builds-builder [11:56:06] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [11:59:00] 10Toolforge (Toolforge iteration 02), 10Patch-For-Review: [bulids-builder] upgrade builder to lastest with >=2.6.1 buildpacks - https://phabricator.wikimedia.org/T354330 (10CodeReviewBot) dcaro merged https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/162 builds-builder: bump... [13:00:59] 10Toolforge (Toolforge iteration 02): [buildservice] Feature request - Indicate when long envvars are cutoff when listing - https://phabricator.wikimedia.org/T353287 (10dcaro) It seems to be truncating all of them no? ` VAR1 val1... ` [13:02:39] 10Toolforge (Toolforge iteration 02): [buildservice] Feature request - Indicate when long envvars are cutoff when listing - https://phabricator.wikimedia.org/T353287 (10dcaro) Yep, here's the issue: https://gitlab.wikimedia.org/repos/cloud/toolforge/envvars-cli/-/merge_requests/19#note_65221 [13:17:47] 10Tool-hitaden, 10Toolforge Build Service: [buildservice,nodejs] nodejs buildpack does not take envvars into account - https://phabricator.wikimedia.org/T353557 (10dcaro) [13:18:04] 10Toolforge (Toolforge iteration 02): [builds-builder] Clojure support was dropped from the builder image - https://phabricator.wikimedia.org/T354252 (10dcaro) a:03dcaro [13:18:07] 10Toolforge (Toolforge iteration 02): [builds-builder] Clojure support was dropped from the builder image - https://phabricator.wikimedia.org/T354252 (10dcaro) 05Open→03In progress [13:18:20] 10Toolforge (Toolforge iteration 02): [bulids-builder] upgrade builder to lastest with >=2.6.1 buildpacks - https://phabricator.wikimedia.org/T354330 (10dcaro) 05In progress→03Resolved [13:27:15] 10Tool-hitaden, 10Toolforge Build Service: [buildservice,nodejs] nodejs buildpack does not take envvars into account - https://phabricator.wikimedia.org/T353557 (10dcaro) @Lofhi pnpm should be available now (the one here https://github.com/heroku/buildpacks-nodejs/blob/main/buildpacks/nodejs-pnpm-install/READM... [13:35:19] 10Toolforge Build Service, 10cloud-services-team: tools-harbor-1.tools.eqiad1.wikimedia.cloud overloaded - https://phabricator.wikimedia.org/T354151 (10dcaro) I think this might be the same as T354176 ? [13:37:08] 10Toolforge (Toolforge iteration 02), 10cloud-services-team (FY2023/2024-Q1-Q2), 10User-dcaro: [harbor] Redis using all available memory - https://phabricator.wikimedia.org/T354176 (10dcaro) Still going down slowly, but now it also goes up from time to time: {F41651533} [13:38:16] 10Toolforge (Toolforge iteration 02), 10Patch-For-Review: [buildservice] Feature request - Indicate when long envvars are cutoff when listing - https://phabricator.wikimedia.org/T353287 (10CodeReviewBot) sstefanova opened https://gitlab.wikimedia.org/repos/cloud/toolforge/envvars-cli/-/merge_requests/20 list:... [13:38:26] 10Toolforge (Toolforge iteration 02), 10Patch-For-Review: [buildservice] Feature request - Indicate when long envvars are cutoff when listing - https://phabricator.wikimedia.org/T353287 (10CodeReviewBot) sstefanova merged https://gitlab.wikimedia.org/repos/cloud/toolforge/envvars-cli/-/merge_requests/20 list:... [13:39:54] 10Toolforge Build Service: apt buildpack (Aptfile support): not installing dependencies of packages already present on the build image - https://phabricator.wikimedia.org/T353847 (10dcaro) I don't find a better-maintained replacement for the apt buildpack, and there's no alternative on the paketo world either :/... [13:58:02] 10Toolforge (Toolforge iteration 02): [builds-builder] Clojure support was dropped from the builder image - https://phabricator.wikimedia.org/T354252 (10dcaro) [13:58:04] 10Toolforge: [build-serviece,clojure] Current supported heroku builder does not yet include clojure support - https://phabricator.wikimedia.org/T353575 (10dcaro) [13:58:13] 10Toolforge: [build-serviece,clojure] Current supported heroku builder does not yet include clojure support - https://phabricator.wikimedia.org/T353575 (10dcaro) Of course I created a new task after the holidays :faceplam: [14:16:06] 10Toolforge, 10Patch-For-Review: [build-serviece,clojure] Current supported heroku builder does not yet include clojure support - https://phabricator.wikimedia.org/T353575 (10CodeReviewBot) dcaro opened https://gitlab.wikimedia.org/repos/cloud/toolforge/builds-builder/-/merge_requests/26 inject_buildpacks: ad... [14:35:35] 10Toolforge (Toolforge iteration 02), 10Patch-For-Review: [builds-builder] move buildpacks under their own namespace in gitlab - https://phabricator.wikimedia.org/T354349 (10CodeReviewBot) dcaro merged https://gitlab.wikimedia.org/repos/cloud/toolforge/builds-builder/-/merge_requests/23 buildpacks: use the ne... [14:37:13] 10Toolforge (Toolforge iteration 02), 10Patch-For-Review: [builds-builder] move buildpacks under their own namespace in gitlab - https://phabricator.wikimedia.org/T354349 (10CodeReviewBot) project_1317_bot_df3177307bed93c3f34e421e26c86e38 opened https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-depl... [14:37:59] 10Toolforge (Toolforge iteration 02), 10Patch-For-Review: [build-serviece,clojure] Current supported heroku builder does not yet include clojure support - https://phabricator.wikimedia.org/T353575 (10dcaro) [14:38:15] 10Toolforge (Toolforge iteration 02): [builds-builder] Clojure support was dropped from the builder image - https://phabricator.wikimedia.org/T354252 (10dcaro) 05duplicate→03Resolved [14:38:18] 10Toolforge (Toolforge iteration 02), 10Patch-For-Review: [build-serviece,clojure] Current supported heroku builder does not yet include clojure support - https://phabricator.wikimedia.org/T353575 (10dcaro) a:03dcaro [14:38:22] 10Toolforge (Toolforge iteration 02), 10Patch-For-Review: [build-serviece,clojure] Current supported heroku builder does not yet include clojure support - https://phabricator.wikimedia.org/T353575 (10dcaro) 05Open→03In progress [14:42:13] !log toolsbeta dcaro@urcuchillay START - Cookbook wmcs.toolforge.k8s.component.deploy for component builds-builder [14:42:16] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Toolsbeta/SAL [14:42:48] !log toolsbeta dcaro@urcuchillay END (PASS) - Cookbook wmcs.toolforge.k8s.component.deploy (exit_code=0) for component builds-builder [14:42:50] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Toolsbeta/SAL [14:48:43] 10cloud-services-team, 10sre-alert-triage: Alert in need of triage: ExporterUnavailable - https://phabricator.wikimedia.org/T354421 (10LSobanski) [14:55:12] !log tools dcaro@urcuchillay START - Cookbook wmcs.toolforge.k8s.component.deploy for component builds-builder [14:55:15] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [14:55:48] !log tools dcaro@urcuchillay END (PASS) - Cookbook wmcs.toolforge.k8s.component.deploy (exit_code=0) for component builds-builder [14:55:50] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [14:58:17] 10Toolforge (Toolforge iteration 02), 10Patch-For-Review: [builds-builder] move buildpacks under their own namespace in gitlab - https://phabricator.wikimedia.org/T354349 (10CodeReviewBot) dcaro merged https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/163 builds-builder: bum... [14:59:36] 10Tool-Global-user-contributions, 10Stewards-and-global-tools, 10Temporary accounts, 10XTools, and 2 others: [Design] Comparative review - https://phabricator.wikimedia.org/T349907 (10KColeman-WMF) [14:59:47] 10Toolforge (Toolforge iteration 02), 10Patch-For-Review: [builds-builder] move buildpacks under their own namespace in gitlab - https://phabricator.wikimedia.org/T354349 (10dcaro) 05In progress→03Resolved [15:07:50] (03PS6) 10FNegri: Parse user@host in wm-bot2 messages [labs/tools/stashbot] - 10https://gerrit.wikimedia.org/r/958439 (https://phabricator.wikimedia.org/T346631) [15:08:23] (03CR) 10CI reject: [V: 04-1] Parse user@host in wm-bot2 messages [labs/tools/stashbot] - 10https://gerrit.wikimedia.org/r/958439 (https://phabricator.wikimedia.org/T346631) (owner: 10FNegri) [15:13:57] (03CR) 10FNegri: Parse user@host in wm-bot2 messages (033 comments) [labs/tools/stashbot] - 10https://gerrit.wikimedia.org/r/958439 (https://phabricator.wikimedia.org/T346631) (owner: 10FNegri) [15:15:42] (03PS7) 10FNegri: Parse user@host in wm-bot2 messages [labs/tools/stashbot] - 10https://gerrit.wikimedia.org/r/958439 (https://phabricator.wikimedia.org/T346631) [15:18:05] (03PS8) 10FNegri: Parse user@host in wm-bot2 messages [labs/tools/stashbot] - 10https://gerrit.wikimedia.org/r/958439 (https://phabricator.wikimedia.org/T346631) [15:36:03] (InstanceDown) firing: Project toolsbeta instance toolsbeta-bastion-6 is down - https://prometheus-alerts.wmcloud.org/?q=alertname%3DInstanceDown [16:51:57] 10cloud-services-team: Support OpenStack projects where project name != project id - https://phabricator.wikimedia.org/T343158 (10Andrew) [17:12:05] 10Toolforge, 10cloud-services-team (FY2023/2024-Q1-Q2): toolsbeta-bastion-6 crashes often - https://phabricator.wikimedia.org/T354430 (10fnegri) [17:13:23] 10Toolforge, 10cloud-services-team (FY2023/2024-Q1-Q2): toolsbeta-bastion-6 often becomes unreachable - https://phabricator.wikimedia.org/T354430 (10fnegri) [17:27:24] 10Toolforge, 10cloud-services-team (FY2023/2024-Q1-Q2): wmcs-wheel-of-misfortune kills system processes - https://phabricator.wikimedia.org/T354430 (10fnegri) 05Open→03In progress p:05Triage→03Medium a:03fnegri [17:32:31] 10Toolforge, 10cloud-services-team (FY2023/2024-Q1-Q2): wmcs-wheel-of-misfortune kills system processes - https://phabricator.wikimedia.org/T354430 (10bd808) [17:36:03] (InstanceDown) resolved: Project toolsbeta instance toolsbeta-bastion-6 is down - https://prometheus-alerts.wmcloud.org/?q=alertname%3DInstanceDown [17:57:03] 10Toolforge, 10cloud-services-team (FY2023/2024-Q1-Q2), 10Patch-For-Review: wmcs-wheel-of-misfortune kills system processes - https://phabricator.wikimedia.org/T354430 (10fnegri) The script does not kill processes if they are owned by users with UID < 500. This was ok in previous Debian version, but in Bookw... [18:00:08] 10cloud-services-team: Support OpenStack projects where project name != project id - https://phabricator.wikimedia.org/T343158 (10Andrew) [18:08:10] 10Toolforge, 10cloud-services-team (FY2023/2024-Q1-Q2), 10Patch-For-Review: wmcs-wheel-of-misfortune kills system processes - https://phabricator.wikimedia.org/T354430 (10fnegri) @bd808 found that we do have some users in the 500 to 999 range, e.g.: ` root@tools-sgebastion-10:~# id 500 uid=500(brion) gid=50... [18:20:49] 10Toolforge, 10cloud-services-team (FY2023/2024-Q1-Q2), 10Patch-For-Review: wmcs-wheel-of-misfortune kills system processes - https://phabricator.wikimedia.org/T354430 (10fnegri) https://phabricator.wikimedia.org/P54529 [18:33:41] 10superset.wmcloud.org: Superset to tofu - https://phabricator.wikimedia.org/T354444 (10rook) [18:40:34] (03PS1) 10Andrew Bogott: enc.py: rename project_name arg to project_id [cloud/wmcs-cookbooks] - 10https://gerrit.wikimedia.org/r/988047 (https://phabricator.wikimedia.org/T343158) [18:49:52] (03PS2) 10Andrew Bogott: enc.py: rename project_name arg to project_id [cloud/wmcs-cookbooks] - 10https://gerrit.wikimedia.org/r/988047 (https://phabricator.wikimedia.org/T343158) [19:08:35] (03PS2) 10Reedy: Update channel config for #mediawiki-parsoid [labs/tools/wikibugs2] - 10https://gerrit.wikimedia.org/r/987992 [19:31:01] (03PS5) 10Eevans: restbase: add missing keys & certs, remove obsolete [labs/private] - 10https://gerrit.wikimedia.org/r/981601 (https://phabricator.wikimedia.org/T352468) [19:32:19] (03CR) 10Eevans: [V: 03+2 C: 03+2] restbase: add missing keys & certs, remove obsolete [labs/private] - 10https://gerrit.wikimedia.org/r/981601 (https://phabricator.wikimedia.org/T352468) (owner: 10Eevans) [20:44:31] 10Cloud-VPS, 10cloud-services-team, 10PostgreSQL: Consider removing Postgres support from Trove - https://phabricator.wikimedia.org/T353018 (10Andrew) I've finally investigated this a bit. There aren't built-in facilities to associate a datastore with a list of projects; it's all or nothing. That said, it i... [20:50:24] (03CR) 10BryanDavis: [C: 03+2] Parse user@host in wm-bot2 messages [labs/tools/stashbot] - 10https://gerrit.wikimedia.org/r/958439 (https://phabricator.wikimedia.org/T346631) (owner: 10FNegri) [20:51:17] (03Merged) 10jenkins-bot: Parse user@host in wm-bot2 messages [labs/tools/stashbot] - 10https://gerrit.wikimedia.org/r/958439 (https://phabricator.wikimedia.org/T346631) (owner: 10FNegri) [20:54:43] (03PS1) 10Dzahn: secret: delete fake keys for hosts in Tampa(!) [labs/private] - 10https://gerrit.wikimedia.org/r/988084 [20:57:22] (03PS1) 10Dzahn: secret: remove passwords and fake key for ganglia [labs/private] - 10https://gerrit.wikimedia.org/r/988085 [21:28:05] 10Cloud-VPS (Quota-requests), 10cloud-services-team: Quota increase request for project 'monitoring' - https://phabricator.wikimedia.org/T354412 (10bd808) +1 [21:28:10] 10Cloud-VPS (Quota-requests), 10cloud-services-team: Quota increase request for project 'monitoring' - https://phabricator.wikimedia.org/T354412 (10bd808) [21:41:10] (03PS2) 10Dzahn: secret: delete fake keys for hosts in Tampa(!) [labs/private] - 10https://gerrit.wikimedia.org/r/988084 [21:42:59] (03PS2) 10Dzahn: secret: remove passwords and fake key for ganglia [labs/private] - 10https://gerrit.wikimedia.org/r/988085 (https://phabricator.wikimedia.org/T253555) [21:46:54] (03PS3) 10Dzahn: secret: remove passwords and fake key for ganglia [labs/private] - 10https://gerrit.wikimedia.org/r/988085 (https://phabricator.wikimedia.org/T253555) [21:52:57] (03PS3) 10Dzahn: secret: delete fake keys for hosts in Tampa(!) [labs/private] - 10https://gerrit.wikimedia.org/r/988084 (https://phabricator.wikimedia.org/T84536) [21:54:17] 10VPS-project-Wikistats, 10User-RhinosF1: Wikistats is using a malformed user agent - https://phabricator.wikimedia.org/T354101 (10Dzahn) [22:14:59] (03CR) 10JHathaway: [C: 03+1] secret: delete fake keys for hosts in Tampa(!) [labs/private] - 10https://gerrit.wikimedia.org/r/988084 (https://phabricator.wikimedia.org/T84536) (owner: 10Dzahn)