[10:51:23] * dcaro going for lunch + some personal stuff [13:41:02] dcaro: i'm still intrigued by the notable build time difference in lima vs vagrant. what do you make of this? https://github.com/blancadesal/parselog/blob/main/data/lima-slow-steps.csv https://github.com/blancadesal/parselog/blob/main/data/vagrant-slow-steps.csv [13:41:58] what is it? [13:42:38] buildservice build logs sorted by time delta, slowest one first [13:43:04] delta with respect to the start of the build? [13:43:38] no, just how long the step took [13:43:48] maybe delta is not the best name for it [13:44:03] so it's the time from the previous log to showing that log? or from showing that log to the start of the next? [13:44:45] (I'm guessing the former, but might be wrong) [13:44:59] from the previous log, yes [13:45:28] do you have the previous log too? some seem to be the first log of the step (that would include creating the container, that might include pulling the image) [13:46:03] do you mean you'd like a grouping of the steps? [13:46:36] just knowing the previos step would be enough, to see what actually ran during that delta [13:47:30] having the full log with the deltas would also give that info though [13:47:39] (sorted by timestamp) [13:48:06] to me it seems like there's some issue on lima each time there's a "unsuccessful cred copy: ".docker" from "/tekton/creds" to "/tekton/home":..." [13:48:20] that happens also on vagrant [13:48:44] it just seems to take less time between the previous step, to that message [13:48:46] doesn't seem to slow it down though? [13:49:29] have I been interpreting timestamp deltas wrong? [13:49:46] no, but you have to check what's happening between the previous log and that log [13:50:08] we know that in between them there's a delay, but we are not sure what is happening [13:51:00] have I been interpreting timestamp deltas wrong? > I think I have, they are shifted forward by 1. https://raw.githubusercontent.com/blancadesal/parselog/main/data/voutput.csv [13:51:15] `echo "first log"; sleep 100; echo "second log"` does not mean that the second `echo` is slow, just that stuff happened between the first echo and the second that was slow [13:51:51] that might be also xd, but yes, we would need both logs (current and previous) to check what happened in between [13:52:47] it seems from that file that you are not taking into account that the steps get setup in parallel, so the logs are intertwined in time [13:53:07] I sorted them according to timestamp, then did deltas [13:53:39] only taking into account the ids? [13:54:01] the ids are added after sorting [13:54:18] (also, the steps wait for the others to finish if needed, as in, all the containers get created in parallel, then the steps wait for each other) [15:45:41] i'm looking to correlate some toolforge.org web access and if i understand the https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin#Webserver_statistics and https://phabricator.wikimedia.org/T178963 i'd need to shell into tools-proxy-05.tools.eqiad1.wikimedia.cloud and tools-proxy-06.tools.eqiad1.wikimedia.cloud . do i have that right? what would be the best way for me to gain that access? [15:46:17] i was thinking about whether i should be filing a phabricator task or be putting in for a puppet posix role thing or something else...if i should ask on another channel LMK! [15:55:58] dr0ptp4kt: you would need to be a maintainer of the 'admin' tool to do that. the process is outlined at https://wikitech.wikimedia.org/wiki/Help:Access_policies, although not all of that applies to you since it's primarly written with volunteers in mind and not non-WMCS foundation staff [15:58:46] i guess you should file a phab task with your use case, just to make sure what you're looking for isn't already available via https://toolviews.toolforge.org/ or similar [15:59:39] dr0ptp4kt: I'd support adding you to that group as long as you accept the spider-man rule. Otherwise I'm ok acting as your remote hands if it's not hours and hours of poking around. [16:00:13] spider-man rule? [16:01:35] https://en.wikipedia.org/wiki/With_great_power_comes_great_responsibility [16:02:16] :) - thanks, will circle back / around / er...i mean, scale the side of a building...a little later [17:29:58] * dcaro off