[07:02:43] 06serviceops, 06collaboration-services, 06Infrastructure-Foundations, 10Puppet-Core, and 4 others: Migrate roles to puppet7 - https://phabricator.wikimedia.org/T349619#9678629 (10MoritzMuehlenhoff) [08:15:06] 06serviceops, 06collaboration-services, 06Infrastructure-Foundations, 10Puppet-Core, and 4 others: Migrate roles to puppet7 - https://phabricator.wikimedia.org/T349619#9678829 (10MoritzMuehlenhoff) [09:16:34] 06serviceops: 14Fail k8s config template render for api-gateway if some critical values are not defined - 14https://phabricator.wikimedia.org/T264095#9679138 (10hnowlan) 05Open→03Declined [09:21:58] 06serviceops: 14API Gateway needs a dual logging solution - 14https://phabricator.wikimedia.org/T296288#9679153 (10hnowlan) 05Open→03Declined [09:28:48] 06serviceops: [API Gateway] Get insight into proxy time for Envoy - https://phabricator.wikimedia.org/T297222#9679193 (10hnowlan) [09:29:17] 06serviceops: 14[API Gateway] Redefine response time using proxy model - 14https://phabricator.wikimedia.org/T277584#9679194 (10hnowlan) 05Open→03Declined 14Declined in favour of T297222  [09:31:41] 06serviceops, 10RESTBase Sunsetting: 14REST-Gateway: Requirements for gateway response headers vs service/app layer response headers - 14https://phabricator.wikimedia.org/T336836#9679205 (10hnowlan) 05Open→03Resolved a:03hnowlan [12:44:23] 06serviceops, 06collaboration-services, 06Infrastructure-Foundations, 10Puppet-Core, and 4 others: Migrate roles to puppet7 - https://phabricator.wikimedia.org/T349619#9679513 (10MoritzMuehlenhoff) [12:51:11] 06serviceops, 10ChangeProp, 06Content-Transform-Team, 10Lift-Wing, and 5 others: Selectively disable changeprop functionality that is no longer used - https://phabricator.wikimedia.org/T361483#9679703 (10elukey) Hello! There `ores_cache` job should be defined but disabled in the running config, we don't u... [12:52:05] 06serviceops, 10ChangeProp, 06collaboration-services, 10GitLab, and 9 others: Figure out a plan to move forward with regarding Redis License changes - https://phabricator.wikimedia.org/T360596#9679718 (10jijiki) >>! In T360596#9676049, @akosiaris wrote: > > My 2, operationally minded, cents says to wait fo... [13:11:45] 06serviceops, 10ChangeProp, 06Content-Transform-Team, 10Lift-Wing, and 5 others: Selectively disable changeprop functionality that is no longer used - https://phabricator.wikimedia.org/T361483#9680024 (10akosiaris) >>! In T361483#9679703, @elukey wrote: > Hello! > > There `ores_cache` job should be define... [13:22:50] 06serviceops, 10ChangeProp, 06Content-Transform-Team, 10Lift-Wing, and 5 others: Selectively disable changeprop functionality that is no longer used - https://phabricator.wikimedia.org/T361483#9680093 (10elukey) >>! In T361483#9680024, @akosiaris wrote: >>>! In T361483#9679703, @elukey wrote: >> Hello! >>... [14:56:08] folks if anybody has time today/tomorrow I'd need a brainbounce for https://gerrit.wikimedia.org/r/c/operations/docker-images/production-images/+/1015530, not 100% sure if the approach is ok [14:56:18] better, I'd like to make sure that people are ok with it :D [14:58:51] the hack works nicely with our model servers images running pytorch [15:21:23] urandom: I am planning to deploy some changes on restbase. Should I send this too: https://gerrit.wikimedia.org/r/c/mediawiki/services/restbase/deploy/+/1015537 ? [15:21:32] cc hnowlan [15:22:11] nemo-yiannis: it probably doesn't matter, but why not? [15:23:57] by "doesn't matter" I mean, they are still up and so the deploy would succeed (at least for the next few hours), but they're depooled so don't need your changes [15:24:37] deploy would repool them (i think) [15:24:42] either way scap is failing [15:24:47] but let's go ahead and merge r1015537...oh right [15:24:57] please don't repool them, yes, let's merge [16:22:30] This is merged for quite some time now but it doesn't show up on deployment server: https://gerrit.wikimedia.org/r/plugins/gitiles/operations/deployment-charts/+/6359a1173b6e6a9b04249925c0300e0236eba796 [16:23:21] Did something change? I remember that patches were pulled automatically [16:31:06] nemo-yiannis: there was an uncommitted change in the mobileapps dir that was blocking the pull [16:31:11] should fix in the next few minutes [16:32:33] Ok, thanks. I also some uncommitted changes under ml-services [16:32:39] nemo-yiannis: this fix will be needed before deploying to staging though https://gerrit.wikimedia.org/r/c/operations/deployment-charts/+/1016395 [16:33:06] the ml-services change shouldn't block the pull unless there's been changes to that ptah [16:33:16] ah ok, got it [16:41:26] i think there is a missing chart version bump too [16:44:45] For which change? [16:45:27] no its not needed, but the cassandra stuff don't show up in the diff maybe already deployed [16:48:04] nvm its missing the config part on PCS to enable caching for that specific cassandra details [16:54:35] so it's not actually using the configured cassandra stuff? [16:55:05] there are 2 sections in the config, one for cassandra and one for app caching [16:55:18] we merged the cassandra stuff but i never added the other sections to enable caching [16:59:53] ahh [17:19:16] 06serviceops, 13Patch-For-Review: etcdmirror does not recover from a cleared waitIndex - https://phabricator.wikimedia.org/T358636#9681586 (10Scott_French) Following up on the `/test` key (T358636#9589274) present in eqiad: * I can find no references to it (e.g., as probe or something) in operations/puppet. *... [17:58:19] 06serviceops, 10[DEPRECATED] wdwb-tech, 10Citoid, 06Content-Transform-Team-WIP, and 11 others: Migrate node-based services in production to node18 - https://phabricator.wikimedia.org/T349118#9681758 (10Mvolz)