[07:57:42] hi, is there anybody around I can chat to about access to kubernetes (staging) clusters from contint and release hosts? [08:02:46] 10GitLab (Infrastructure), 10serviceops-collab, 10Patch-For-Review: Let's Encrypt certificate expiration notice for domain gitlab.devtools.wmcloud.org - https://phabricator.wikimedia.org/T335161 (10Jelto) 05Open→03Resolved I deployed the change to the test instance. Duplicate timer is masked: ` Thu 2023... [08:22:23] 10GitLab (Infrastructure), 10serviceops-collab: Define future design of GitLab backups - https://phabricator.wikimedia.org/T330172 (10Jelto) [08:30:33] 10GitLab (Infrastructure), 10serviceops-collab: Define future design of GitLab backups - https://phabricator.wikimedia.org/T330172 (10Jelto) 05Open→03Resolved I'm closing this task as all design and research has happened. Implementation has also happened with installation of additional disks. I also update... [08:38:56] 10Phabricator: Remove "Deadline" task subtype - https://phabricator.wikimedia.org/T335395 (10Aklapper) p:05Triage→03Low [09:50:45] 10Phabricator (Upstream), 10Upstream: Deleting a file server-side results in exception: Unknown edge constant "26"! at PhabricatorEdgeType.php:214 - https://phabricator.wikimedia.org/T318547 (10Aklapper) [09:51:11] 10Phabricator (Upstream), 10Upstream: Deleting a file server-side results in exception: Unknown edge constant "26"! at PhabricatorEdgeType.php:214 - https://phabricator.wikimedia.org/T318547 (10Aklapper) p:05Triage→03Low [11:35:24] 10Phabricator: Remove "Deadline" task subtype - https://phabricator.wikimedia.org/T335395 (10Krinkle) Sounds good to me. I'm not aware of a downside (happy to learn otherwise), and this seems likely to help make things feel less complex. [11:59:18] 10Release-Engineering-Team (Priority Backlog 📥), 10MW-on-K8s, 10SRE, 10serviceops, 10Patch-For-Review: Automated validation of mediawiki-multiversion images - https://phabricator.wikimedia.org/T288629 (10JMeybohm) While refactoring kubernetes puppet code I came across the fact that we place credentials t... [15:32:50] 10Deployments, 10Release-Engineering-Team, 10serviceops, 10Patch-For-Review, 10Performance-Team (Radar): MediaWiki deploy servers should not be mediawiki installation targets - https://phabricator.wikimedia.org/T329857 (10dancy) 05Open→03Resolved [15:40:06] 10Phabricator, 10Design-Systems-Team: Task is in two board columns simultaneously - https://phabricator.wikimedia.org/T335422 (10ldelench_wmf) [15:48:18] 10Phabricator, 10Design-Systems-Team: Task is in two board columns simultaneously - https://phabricator.wikimedia.org/T335422 (10Aklapper) > Can you help us understand if this is a bug or user error? Thanks. This is a bug. Please try dragging the task from the "wrong" column to the correct column. [15:53:16] 10Phabricator, 10Design-Systems-Team: Task is in two board columns simultaneously - https://phabricator.wikimedia.org/T335422 (10Dzahn) Hi, so first I could confirm this, I saw the ticket in 2 columns, then I tried moving it from one to the other and now the issue seems fixed. I only see it once. Can you conf... [15:56:11] 10Phabricator, 10Design-Systems-Team: Task is in two board columns simultaneously - https://phabricator.wikimedia.org/T335422 (10Dzahn) We had maintenance on aphlict on Monday (T333452) and switched to new servers. It seems at least possibility that this was related since aphlict would take care of realtime up... [15:56:22] 10Phabricator, 10Design-Systems-Team, 10serviceops-collab: Task is in two board columns simultaneously - https://phabricator.wikimedia.org/T335422 (10Dzahn) [15:58:20] 10Phabricator, 10Release-Engineering-Team, 10serviceops-collab, 10User-brennen: Replace existing aphlict1001 with puppet-managed bullseye host - https://phabricator.wikimedia.org/T333452 (10Dzahn) I'm not sure but it's possible there was some minor fallout here, manifesting as one task being in 2 columns o... [16:15:56] 10Project-Admins: Requests for addition to the #acl*Project-Admins group (in comments) - https://phabricator.wikimedia.org/T706 (10Ipr1) Hi, I am Ipr1 (Ilkka Prusi) and work at Wikimedia Finland. I would like to get subproject creation right for project WMFI which is Wikimedia Finland's umbrella project in Phabr... [16:20:52] 10Phabricator, 10Design-Systems-Team, 10serviceops-collab: Task is in two board columns simultaneously - https://phabricator.wikimedia.org/T335422 (10Aklapper) I've seen this before. This is a bug in Phabricator code and unrelated to aphlict maintenance. See e.g. T160715#3111557. [16:25:23] 10Phabricator, 10Design-Systems-Team, 10serviceops-collab: Task is in two board columns simultaneously - https://phabricator.wikimedia.org/T335422 (10Dzahn) ah, thanks @Aklapper [16:25:45] 10Phabricator, 10Release-Engineering-Team, 10serviceops-collab, 10User-brennen: Replace existing aphlict1001 with puppet-managed bullseye host - https://phabricator.wikimedia.org/T333452 (10Dzahn) nevermind, per T335422#8808231 it's an unrelated bug [16:48:26] 10Phabricator, 10Design-Systems-Team, 10serviceops-collab: Task is in two board columns simultaneously - https://phabricator.wikimedia.org/T335422 (10ldelench_wmf) 05Open→03Resolved a:03ldelench_wmf Got it, thank you @Aklapper @Dzahn ! @CCiufo-WMF if this happens again we just need to drag the task fr... [16:48:58] (03CR) 10Jforrester: [C: 03+2] Zuul: Add Kevin Wilke to CI allow list [integration/config] - 10https://gerrit.wikimedia.org/r/911930 (owner: 10Kevin Wilke) [16:50:25] (03Merged) 10jenkins-bot: Zuul: Add Kevin Wilke to CI allow list [integration/config] - 10https://gerrit.wikimedia.org/r/911930 (owner: 10Kevin Wilke) [16:51:48] !log Zuul: Add Kevin Wilke to CI allow list [16:51:49] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [17:40:29] 10Phabricator, 10Design-Systems-Team, 10serviceops-collab: Task is in two board columns simultaneously - https://phabricator.wikimedia.org/T335422 (10CCiufo-WMF) Sounds good, thanks all for looking into this :) [17:56:44] 10Release-Engineering-Team (Deployment Training Requests): Deployment training request for allanjeremy.thisdot - https://phabricator.wikimedia.org/T332313 (10thcipriani) p:05Triage→03Medium 👋 @allanjeremy.thisdot sorry I missed this request. I went ahead and added you to the training on 2023-04-27 (tomorrow... [17:58:03] 10Release-Engineering-Team (Deployment Training Requests): Deployment training request for Sergio Gimeno - https://phabricator.wikimedia.org/T320722 (10thcipriani) Looks like I failed to check in on this: did you make it @Sgs ? How'd it go? [18:50:54] 10Phabricator: One Phabricator task displayed in two workboard columns simultaneously - https://phabricator.wikimedia.org/T335443 (10Aklapper) [18:51:35] 10Phabricator, 10Design-Systems-Team, 10serviceops-collab: Task is in two board columns simultaneously - https://phabricator.wikimedia.org/T335422 (10Aklapper) FYI I created T335443 for potential investigation of the root cause. [19:02:10] 10Phabricator: One Phabricator task displayed in two workboard columns simultaneously - https://phabricator.wikimedia.org/T335443 (10Aklapper) Affected `T140289` has the same pattern: * debt moved this task from `This Quarter` to `Up Next` (non-standard column) on the `Discovery-Search` board. * debt edited proj... [19:28:53] 10GitLab (Project Migration), 10Release-Engineering-Team (Priority Backlog 📥), 10API Platform, 10Anti-Harassment, and 19 others: Migrate PipelineLib repos to GitLab - https://phabricator.wikimedia.org/T332953 (10BPirkle) The old image suggestions api ([[ https://gerrit.wikimedia.org/g/mediawiki/services/im... [19:37:05] 10Release-Engineering-Team (Priority Backlog 📥), 10MW-on-K8s, 10SRE, 10serviceops: Automated validation of mediawiki-multiversion images - https://phabricator.wikimedia.org/T288629 (10dancy) >>! In T288629#8807158, @JMeybohm wrote: > I don't see helm defaults being installed to releases or ci nodes since t... [20:51:08] 10Release-Engineering-Team (Priority Backlog 📥), 10Patch-For-Review, 10Release, 10Train Deployments: 1.41.0-wmf.6 deployment blockers - https://phabricator.wikimedia.org/T330212 (10Jdlrobson) [20:51:40] 10Release-Engineering-Team (Priority Backlog 📥), 10Patch-For-Review, 10Release, 10Train Deployments: 1.41.0-wmf.6 deployment blockers - https://phabricator.wikimedia.org/T330212 (10Jdlrobson) The fix for T335451 should be applied before rolling the train out further. [21:53:35] 10Release-Engineering-Team (Priority Backlog 📥), 10Patch-For-Review, 10Release, 10Train Deployments: 1.41.0-wmf.6 deployment blockers - https://phabricator.wikimedia.org/T330212 (10Jdlrobson) Hey @jnuche https://gerrit.wikimedia.org/r/c/mediawiki/extensions/MobileFrontend/+/912379 will need to be merged wi...