[07:28:10] <taavi>	 the tools-nfs puppet failure is from gitlab maintenance
[08:45:48] <taavi>	 looking for reviews: https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/887 & https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/888
[08:48:32] <dcaro>	 +1d
[09:41:55] <dhinus>	 there's a toolsdb replicationlag alert, looking
[09:44:31] <dhinus>	 classic big update on a table without appropriate indexes
[09:44:44] <dhinus>	 I'll raise a task and ping the tool maintainer
[09:51:09] <dcaro>	 thanks!
[10:15:23] <dhinus>	 T400796
[10:15:23] <stashbot>	 T400796: [toolsdb] ToolsToolsDBReplicationLagIsTooHigh - 2025-07-30 - https://phabricator.wikimedia.org/T400796
[10:15:38] <dhinus>	 mostly fixed
[10:15:54] <dhinus>	 I need to clean up one thing, I'll do it later
[10:17:30] <dhinus>	 hmm no, it's stuck again on the same table
[10:22:42] <dhinus>	 looks like there were many queries on the same table, and each one is getting stuck
[10:22:53] <dhinus>	 I will fix it properly after lunch
[14:02:12] <topranks>	 sorry joining meeting in 2 mins