[06:35:35] <elukey>	 sigh for Nvidia
[06:35:40] <elukey>	 good morning :)
[06:39:40] <elukey>	 just to double check, I've ran the following:
[06:39:41] <elukey>	 elukey@cumin1001:~$ httpbb --hosts=ores.svc.codfw.wmnet --https_port=443 test_ores.yaml 
[06:39:44] <elukey>	 Sending to ores.svc.codfw.wmnet...
[06:39:46] <elukey>	 PASS: 124 requests sent to ores.svc.codfw.wmnet. All assertions passed.
[06:39:51] <elukey>	 nothing weird registered
[06:42:28] <elukey>	 starting the ores1001 reimage
[07:47:24] <elukey>	 ores1001 pooled and back in service
[08:00:43] <elukey>	 I wanted to do ores1002 (already filed a gerrit change) but gerrit is not working for me, still trying to understand why
[08:05:26] <elukey>	 I'll take a break then :)
[08:05:53] <elukey>	 (Tobias: if you want to start from 1003 please go ahead, I'll try to finish 1002 as soon as gerrit is back for me)
[08:35:51] <klausman>	 \o 
[08:35:58] <klausman>	 And yes, will start 2003 in a moment
[08:37:24] <klausman>	 1003*
[08:43:26] <klausman>	 elukey: how about we earmark teh odd ones for me, and the even-numbered ones for you. This way we'll do at most two in parallel, and won't step on each other's changes.
[08:43:58] <klausman>	 And if either of us runs out of machines to do, we can re-coordinate
[08:47:55] <elukey>	 sure!
[08:50:27] <elukey>	 klausman: in the meantime that I figure why gerrit fails at me, do you mind to merge https://gerrit.wikimedia.org/r/791299
[08:50:30] <elukey>	  ?
[08:50:55] <klausman>	 done&done
[08:51:01] <klausman>	 What kind of error do you get?
[08:51:04] <elukey>	 obrigado
[08:51:15] <klausman>	 Also: should I also do the puppet-merge or will you handle that?
[08:51:50] <elukey>	 already done thanks! it is just the gerrit UI, no idea what's happening
[08:52:27] <klausman>	 Maybe ditch cookies and cache? I know we recently got a new version with changed UI details.
[08:52:43] <elukey>	 yep I was about to do that, seems the likely issue
[08:55:07] <elukey>	 seems not the issue, I also tried with Chrome
[08:55:09] <elukey>	 super weird
[08:55:49] <moritzm>	 elukey: wrt gerrit trouble did you maybe update to openssh 9 via some dist-upgrade? to work with 9 you also need git-review 2.3.1
[08:56:52] <elukey>	 moritzm: nope I have 8, but git review etc.. all works, it is the UI that fails me, it doesn't load
[08:57:13] <klausman>	 moritzm: I have openssh 9 and git-review 2.2.0 and have had no troubles
[08:58:19] <moritzm>	 ah! the combination of openssh 9 and 2.2.0 broke for me
[09:00:54] <klausman>	 inb4 it breaks at the next maximally-inconvenient moment for me :D
[09:25:59] <elukey>	 and now gerrit is back for me, bah
[09:37:18] <klausman>	 1003 is back, taking a look at logs etc
[09:38:08] <klausman>	 Looking good, pooling it.
[09:59:12] <elukey>	 1002 pooled as well
[10:04:57] <klausman>	 Going for Lunch, will do 1005 after that
[10:05:18] <elukey>	 going afk as well
[10:25:49] <wikibugs>	 10Machine-Learning-Team, 10Add-Link, 10Growth-Team, 10incubator.wikimedia.org: Integrate the model training and the deployment of "Add a link" to new Wikipedias exiting the Incubator - https://phabricator.wikimedia.org/T308146 (10kostajh) Is there a precedent for process around this? Does something similar...
[10:38:40] <wikibugs>	 10Machine-Learning-Team, 10Add-Link, 10Growth-Team, 10incubator.wikimedia.org: Integrate the model training and the deployment of "Add a link" to new Wikipedias exiting the Incubator - https://phabricator.wikimedia.org/T308146 (10Tgr) Seems hard to train a link model for a wiki with near-zero content.
[10:40:08] <wikibugs>	 10Machine-Learning-Team, 10Add-Link, 10Growth-Team, 10incubator.wikimedia.org: Integrate the model training and the deployment of "Add a link" to new Wikipedias exiting the Incubator - https://phabricator.wikimedia.org/T308146 (10Tgr) >>! In T308146#7923975, @kostajh wrote: > Is there a precedent for proce...
[10:40:50] <wikibugs>	 10Machine-Learning-Team, 10Add-Link, 10Growth-Team, 10incubator.wikimedia.org: Integrate the model training and the deployment of "Add a link" to new Wikipedias exiting the Incubator - https://phabricator.wikimedia.org/T308146 (10kostajh) >>! In T308146#7924056, @Tgr wrote: > Seems hard to train a link mod...
[12:13:18] <elukey>	 started the reimage of ores1004
[12:16:14] <klausman>	 1005 is done, but not pooled yet
[13:23:58] <klausman>	 1005 and 1007 now done & pooled
[14:04:44] <chrisalbon>	 M orning all
[14:04:51] <chrisalbon>	 I'm in an all day virtual off-site today
[14:06:23] <klausman>	 Have fun!
[14:31:07] <klausman>	 1009 done and serving
[14:31:27] <klausman>	 elukey: I can do 1008 if you want
[14:40:57] <elukey>	 klausman: please go ahead :)
[14:41:05] <klausman>	 alrighty
[15:39:47] <klausman>	 1008 done and serving again
[15:40:56] <klausman>	 elukey: I think that only leaves 1006?
[17:31:53] <klausman>	 elukey: and I think we're done! Not sure about the current state of 1004, so I'm not touching it
[17:32:32] * klausman is heading off for some grilled sausages and beer, see y'all tomorrow
[17:54:32] <elukey>	 klausman: 1004 done as well, nice work!
[17:55:00] <klausman>	 I think there is still some cleanup to be done (e.g. the v4-specific code), but we should be good for now