[00:13:10] 10Gerrit, 10Release-Engineering-Team, 10SRE, 10serviceops-collab, 10Patch-For-Review: gerrit1003 service implementation task - https://phabricator.wikimedia.org/T326368 (10Dzahn) 05In progress→03Resolved Service is implemeted on gerrit1003. It is now the production server behind gerrit.wikimedia.org... [03:24:23] Yippee, build fixed! [03:24:23] Project mwcore-phpunit-coverage-master build #2856: 09FIXED in 24 min: https://integration.wikimedia.org/ci/job/mwcore-phpunit-coverage-master/2856/ [08:59:39] 10Release-Engineering-Team (Priority Backlog 📥), 10Patch-For-Review, 10Release, 10Train Deployments: 1.41.0-wmf.8 deployment blockers - https://phabricator.wikimedia.org/T330214 (10hashar) [09:02:49] 10Release-Engineering-Team (Radar), 10serviceops-collab, 10serviceops-radar: give releng access to logs to debug buildkit-to-wmf-registry publishing - https://phabricator.wikimedia.org/T322579 (10eoghan) 05Open→03In progress a:03eoghan [09:03:25] 10Release-Engineering-Team (Priority Backlog 📥), 10Patch-For-Review, 10Release, 10Train Deployments: 1.41.0-wmf.8 deployment blockers - https://phabricator.wikimedia.org/T330214 (10hashar) T336504 got fixed and I have backported the fix to 1.41.0-wmf.8. I will update the wikis. I have poked the Village Pum... [11:17:42] 10Continuous-Integration-Infrastructure, 10Infrastructure-Foundations, 10puppet-compiler: PCC: unable to run dnsquery:a() for some domains - https://phabricator.wikimedia.org/T336566 (10aborrero) [11:19:48] cc jbond ^^^ I gave up trying to provide a fallback value for `dnsquery:a` and therefore declare is a bug in PCC :-P [11:22:17] arturo: ack ill take a look [11:22:41] fyi i have added the fix to the lookup function now [11:23:11] awesome! [11:35:12] 10Continuous-Integration-Infrastructure, 10Infrastructure-Foundations, 10puppet-compiler: PCC: unable to run dnsquery:a() for some domains - https://phabricator.wikimedia.org/T336566 (10aborrero) p:05Triage→03Medium [11:38:01] 10Continuous-Integration-Infrastructure, 10Infrastructure-Foundations, 10puppet-compiler: PCC: unable to run dnsquery:a() for some domains - https://phabricator.wikimedia.org/T336566 (10jbond) > We have a puppet manifest that runs dnsquery::a() that fails in PCC for the domain private.codfw.wikimedia.cloud.... [11:40:15] 10Continuous-Integration-Infrastructure, 10Infrastructure-Foundations, 10puppet-compiler: PCC: unable to run dnsquery:a() for some domains - https://phabricator.wikimedia.org/T336566 (10jbond) in fact i get SERVFAIL for the wikimedia.cloud domain ` jbond@cloudinfra-internal-puppetmaster-01:~$ dig soa wikime... [11:40:28] 10Continuous-Integration-Infrastructure, 10Infrastructure-Foundations, 10puppet-compiler: PCC: unable to run dnsquery:a() for some domains - https://phabricator.wikimedia.org/T336566 (10aborrero) [11:45:58] 10Continuous-Integration-Infrastructure, 10Infrastructure-Foundations, 10puppet-compiler: PCC: unable to run dnsquery:a() for some domains - https://phabricator.wikimedia.org/T336566 (10aborrero) Yes, sorry for the noise, there is nothing wrong with PCC and it may be the Openstack Designate setup: `lang=she... [11:49:45] so, nothing to do with PCC after all [13:06:44] 10Release-Engineering-Team (Priority Backlog 📥), 10Patch-For-Review, 10Release, 10Train Deployments: 1.41.0-wmf.8 deployment blockers - https://phabricator.wikimedia.org/T330214 (10hashar) 05Open→03Resolved Looks like it is all fine as far as server side error logs are concerned. [13:21:51] 10GitLab (Auth & Access), 10Release-Engineering-Team: Requesting GitLab non-external access/account unlock for USER[S] - https://phabricator.wikimedia.org/T336578 (10Mvolz) [14:49:02] (03PS1) 10Ilias Sarantopoulos: inference-services: add bloom pipelines [integration/config] - 10https://gerrit.wikimedia.org/r/919347 (https://phabricator.wikimedia.org/T333861) [14:50:45] (03CR) 10CI reject: [V: 04-1] inference-services: add bloom pipelines [integration/config] - 10https://gerrit.wikimedia.org/r/919347 (https://phabricator.wikimedia.org/T333861) (owner: 10Ilias Sarantopoulos) [14:59:37] 10GitLab (Auth & Access), 10Release-Engineering-Team: Requesting GitLab non-external access/account unlock for USER[S] - https://phabricator.wikimedia.org/T336578 (10taavi) 05Declined→03Open [15:16:19] 10GitLab (Auth & Access), 10Release-Engineering-Team: Requesting GitLab non-external access/account unlock for Mvolz - https://phabricator.wikimedia.org/T336578 (10Mvolz) [15:46:29] 10Release-Engineering-Team (Radar), 10serviceops-collab, 10serviceops-radar, 10Patch-For-Review: give releng access to logs to debug buildkit-to-wmf-registry publishing - https://phabricator.wikimedia.org/T322579 (10eoghan) @dduvall I put up some changes to move the nginx (`/var/log/nginx/{error,access}.lo... [15:49:59] (03PS2) 10Hashar: inference-services: add bloom pipelines [integration/config] - 10https://gerrit.wikimedia.org/r/919347 (https://phabricator.wikimedia.org/T333861) (owner: 10Ilias Sarantopoulos) [15:50:49] (03CR) 10Hashar: [C: 03+2] "CI failed cause the commit message had `Bug:` after `Change-Id:`, I have amended." [integration/config] - 10https://gerrit.wikimedia.org/r/919347 (https://phabricator.wikimedia.org/T333861) (owner: 10Ilias Sarantopoulos) [15:52:11] (03Merged) 10jenkins-bot: inference-services: add bloom pipelines [integration/config] - 10https://gerrit.wikimedia.org/r/919347 (https://phabricator.wikimedia.org/T333861) (owner: 10Ilias Sarantopoulos) [15:52:41] !log Reloaded Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/919347/ | T333861 [15:52:43] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [15:52:44] T333861: Host open source LLM (bloom, etc.) on Lift Wing - https://phabricator.wikimedia.org/T333861 [15:53:04] (03CR) 10Hashar: [C: 03+2] "Deployed :)" [integration/config] - 10https://gerrit.wikimedia.org/r/919347 (https://phabricator.wikimedia.org/T333861) (owner: 10Ilias Sarantopoulos) [16:26:23] 10GitLab (Auth & Access), 10Release-Engineering-Team: Requesting GitLab non-external access/account unlock for Mvolz - https://phabricator.wikimedia.org/T336578 (10brennen) 05Open→03Resolved [17:09:10] 10Release-Engineering-Team, 10SRE, 10ci-test-error: tox-docker CI test doesn't pick up overrides for pylint - https://phabricator.wikimedia.org/T281347 (10Dzahn) [18:11:16] 10GitLab (Auth & Access), 10Release-Engineering-Team: Requesting GitLab non-external access/account unlock for Mvolz - https://phabricator.wikimedia.org/T336578 (10Mvolz) Thanks! I also need to move a repository into mediawiki/services ... I've requested permissions via the button to access the services group,... [21:26:28] 10GitLab (Auth & Access), 10Release-Engineering-Team: Requesting GitLab non-external access/account unlock for Mvolz - https://phabricator.wikimedia.org/T336578 (10brennen) Granted access there - keep in mind it's early days on that namespace and things might get shuffled around a bit! [21:27:12] 10Gerrit, 10Release-Engineering-Team, 10SRE, 10serviceops-collab, 10Patch-For-Review: gerrit1003 service implementation task - https://phabricator.wikimedia.org/T326368 (10Dzahn)