[06:00:44] 10Continuous-Integration-Infrastructure (Zuul upgrade): Enable Zuul OpenTelemetry tracing - https://phabricator.wikimedia.org/T430900 (10hashar) 03NEW [07:08:15] 10Continuous-Integration-Infrastructure (Zuul upgrade), 06collaboration-services, 10observability: Enable Zuul OpenTelemetry tracing - https://phabricator.wikimedia.org/T430900#12078985 (10ABran-WMF) [08:24:52] 10Continuous-Integration-Infrastructure (Zuul upgrade), 06cloud-services-team, 06collaboration-services, 10Data-Services, 13Patch-For-Review: Zuul executor can not reach WMCS OpenStack API - https://phabricator.wikimedia.org/T430479#12079302 (10hashar) The Zuul executor refers to the list of no proxy dom... [12:10:58] 10Continuous-Integration-Infrastructure (Zuul upgrade), 06cloud-services-team, 06collaboration-services, 10Data-Services: Zuul executor can not reach WMCS OpenStack API - https://phabricator.wikimedia.org/T430479#12080271 (10hashar) The ansible playbook can now reach out the WMCS OpenStack API. There is an... [13:49:02] 10Continuous-Integration-Infrastructure (Zuul upgrade), 06cloud-services-team, 10Horizon, 10Openstack-Magnum, 06tools-infrastructure-team: Can't retrieve Magnum cluster certificate and config via Horizon - https://phabricator.wikimedia.org/T430680#12080892 (10hashar) **SUCCESS*** thank you @Andrew... [13:51:01] 10Continuous-Integration-Infrastructure (Zuul upgrade), 06cloud-services-team, 06collaboration-services, 10Data-Services: Zuul executor can not reach WMCS OpenStack API - https://phabricator.wikimedia.org/T430479#12080912 (10hashar) The Cloud Config file is stored in https://gerrit.wikimedia.org/g/integrat... [14:22:54] 10Continuous-Integration-Infrastructure (Zuul upgrade), 06cloud-services-team, 06collaboration-services, 10Data-Services: Zuul executor can not reach WMCS OpenStack API - https://phabricator.wikimedia.org/T430479#12081131 (10hashar) For comparison with an application credential for the `zuul` project I hav... [16:41:03] 10Continuous-Integration-Infrastructure (Zuul upgrade): zuul-client encrypt fails to retrieve public key - https://phabricator.wikimedia.org/T431003 (10hashar) 03NEW [16:46:52] 10Continuous-Integration-Infrastructure (Zuul upgrade): zuul-client encrypt fails to retrieve public key - https://phabricator.wikimedia.org/T431003#12082130 (10hashar) [16:46:57] 10Continuous-Integration-Infrastructure (Zuul upgrade), 06cloud-services-team, 06collaboration-services, 10Data-Services: Zuul executor can not reach WMCS OpenStack API - https://phabricator.wikimedia.org/T430479#12082129 (10hashar) [16:50:26] 10Continuous-Integration-Infrastructure (Zuul upgrade): zuul-client encrypt fails to retrieve public key - https://phabricator.wikimedia.org/T431003#12082161 (10Dzahn) Is that curl command generated by zuul-client or something else or is that just you testing? Where does "curl -X 'GET' \ 'https://zuul.wikimed... [16:53:41] 10Continuous-Integration-Infrastructure (Zuul upgrade): zuul-client encrypt fails to retrieve public key - https://phabricator.wikimedia.org/T431003#12082172 (10Dzahn) a claim is made that: //'"This happens to prevent directory traversal attacks. Apache evaluates the URL and intercepts it before your proxy rules... [16:54:20] 10Continuous-Integration-Infrastructure (Zuul upgrade): zuul-client encrypt fails to retrieve public key - https://phabricator.wikimedia.org/T431003#12082173 (10Dzahn) We might want `AllowEncodedSlashes On` in httpd config if we want to allow them. [17:52:22] 10Continuous-Integration-Infrastructure (Zuul upgrade), 13Patch-For-Review: zuul-client encrypt fails to retrieve public key - https://phabricator.wikimedia.org/T431003#12082433 (10Dzahn) I tested this. When allowing encoded slashes using "On" there is still a 404 but now it does not come from Apache httpd any... [17:53:57] 10Continuous-Integration-Infrastructure (Zuul upgrade), 13Patch-For-Review: zuul-client encrypt fails to retrieve public key - https://phabricator.wikimedia.org/T431003#12082436 (10Dzahn) When we use `AllowEncodedSlashes NoDecode` to ensure it also does not try to decode them and just pass them on to zuul, it... [18:08:22] 10Continuous-Integration-Infrastructure (Zuul upgrade), 13Patch-For-Review: zuul-client encrypt fails to retrieve public key - https://phabricator.wikimedia.org/T431003#12082488 (10Dzahn) @hashar fixed! ` [zuul1001:~] $ curl -X 'GET' \ 'https://zuul.wikimedia.org/api/tenant/wikimedia/key/integration%2Fconf... [18:09:18] 10Continuous-Integration-Infrastructure (Zuul upgrade), 06collaboration-services, 13Patch-For-Review: zuul-client encrypt fails to retrieve public key - https://phabricator.wikimedia.org/T431003#12082490 (10Dzahn) [18:09:37] 10Continuous-Integration-Infrastructure (Zuul upgrade), 06collaboration-services, 13Patch-For-Review: zuul-client encrypt fails to retrieve public key - https://phabricator.wikimedia.org/T431003#12082505 (10Dzahn) a:03Dzahn