[06:25:24] 06serviceops, 06Community-Tech, 10MinT, 10Community Wishlist (Translations): Caching service request for MinT - https://phabricator.wikimedia.org/T370755#10990393 (10Nikerabbit) [08:09:47] 06serviceops, 07sre-alert-triage: Alert in need of triage: OsmSynchronisationLag (instance maps-test2001:9100) - https://phabricator.wikimedia.org/T399158 (10LSobanski) 03NEW [08:31:57] 06serviceops: httpbb bookworm support - https://phabricator.wikimedia.org/T393711#10990909 (10MoritzMuehlenhoff) 05Open→03Resolved a:03MoritzMuehlenhoff httpbb was built for Bookworm [08:49:48] mutante: isn't config.yaml being absented? That's what I see https://github.com/wikimedia/operations-puppet/blob/production/modules/docker_registry/manifests/init.pp#L36. Where do you see that content => to_yaml(deep_merge) ? [08:50:44] but, yes, otherwise the service shipped by the debian package has been now disabled. [09:19:46] 06serviceops, 10Page Content Service, 10Content-Transform-Team (Work In Progress): mobileapps is comparatively slower to handle changeprop events - https://phabricator.wikimedia.org/T397750#10991058 (10Jgiannelos) I did some analysis on the backlog: From a sample of 10M events backlogged: Here are the top 1... [09:40:54] akosiaris: it's weird, the service was failed, but it's correctly not-found inactive dead [09:41:05] i'm not sure what happened [09:42:36] systemctl reset-failed fixed it I guess? [09:43:29] yeah [09:44:46] yeah, that's the standard behavior of systemd, expected. [09:44:58] should have thought of running reset-failed after I merged [09:45:18] but... I thought I did [09:45:20] it still keeps around the failure state of a unit even if it no longer exists [09:45:36] when I merged the absent [09:45:42] ok, then that's weird [09:45:58] well the stopped/enabled => false [09:46:26] but I apparently didn't in codfw for some reason? idk [09:47:06] yeah I apparently didn't [09:47:09] mistery solved [11:19:38] 06serviceops, 10Maps, 07sre-alert-triage: Alert in need of triage: OsmSynchronisationLag (instance maps-test2001:9100) - https://phabricator.wikimedia.org/T399158#10991406 (10Clement_Goubert) This is on a `maps-test` server, maybe alert severity should be brought down. Anyhow, tagging #maps project for follo... [14:40:13] 06serviceops, 06Security-Team, 10FY2024-25 WE4.2.3 CAPTCHA evaluation framework (WE4.2 hCaptcha account creation trial), 07Security: hCaptcha proxy logging - https://phabricator.wikimedia.org/T399211 (10hnowlan) 03NEW [14:58:46] 06serviceops, 06Security-Team, 10FY2024-25 WE4.2.3 CAPTCHA evaluation framework (WE4.2 hCaptcha account creation trial), 07Security: hCaptcha proxy logging - https://phabricator.wikimedia.org/T399211#10992510 (10Dreamy_Jazz) We will need to be careful because hCaptcha enterprise data cannot be logged to lo... [15:27:16] akosiaris: probably I was looking at the local git repo in an outdated state :/ [15:27:29] but mystery solved, sounds all good [15:28:18] ack