[07:22:54] !log deployment-prep: reindexing all wikis to opensearch2 (T425585, T427196) [07:22:56] dcausse: Unknown project "deployment-prep:" [07:22:57] T425585: Write lightweight OCI-image-based Puppet plans for beta cluster - https://phabricator.wikimedia.org/T425585 [07:22:57] T427196: [beta-cluster] Fetching task suggestions failed: cirrussearch-backend-error - https://phabricator.wikimedia.org/T427196 [07:23:03] !log deployment-prep reindexing all wikis to opensearch2 (T425585, T427196) [07:23:08] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Deployment-prep/SAL [08:55:04] is access to wayback machine web.archive.org is blocked from toolforge? [09:09:20] not from toolforge side I think [09:10:29] I can curl from the bastion [09:11:00] i am trying to implement archiving from my bot but https://pastebin.com/r100C7Cy [09:11:41] is the issue from my side of config. although i checked it from my local machine it worked there [09:12:07] this fails though [09:12:13] https://www.irccloud.com/pastebin/FTWLgj77/ [09:13:22] R1F4T: can you open a phabricator task to follow up? [09:14:35] i am not quite familiar with phabricator :/ [09:14:49] okok, I can do for you, give me a bit [09:22:42] it's working now, might be just one or some workers having issues [09:26:18] R1F4T: created T429577, you can subscribe to get updates if you want [09:26:19] T429577: [infa] unable to access web.archive.org from within pods - https://phabricator.wikimedia.org/T429577 [09:26:53] subscribed [09:27:21] R1F4T: do you mind if I use your job to debug it? (will not delete it or anything, but will need you not to restart it while I'm debugging) [09:27:48] oh, I see the job does not exist anymore [09:27:51] nm [09:27:58] yeah i just deleted t [09:28:08] i will start it again [09:28:14] okok xd, if it happens again, can you ping me so I can debug? [09:28:20] (it seems to be only sometimes) [09:28:36] ok [09:28:39] sure [09:31:31] okok, found one node with issues, that might be enough, looking [09:51:13] I just remembered that during the bot's early phases, it would fail to connect to https://pressinform.gov.bd/ (the site it scrapes images from) right after creating a new job. Back then, I would just close everything, and the issue would usually resolve itself within half a day to a day. [09:58:58] I have to relocate, I'll be back in ~20min, R1F4T can you write in the task if you see any new issues while I'm away? [09:59:21] ok [18:08:40] Hello Cloud VPS folks! It's my understanding (and prior experience) that if I create a VM instance in the deployment-prep project, I can eventually ssh into it. However, yesterday and today I've tried creating several instances and I cannot ssh in unless I set up an ssh keypair during the launch process. I'm stuck! [18:26:51] horizon seems down [18:28:58] mutante: wfm [18:32:50] volans: hmm, interesting. I get a "Something went wrong". let me try to change other things [18:33:55] Horizon working for me too. [18:34:12] works in chromium, does not in Firefox? odd.. testing some more [18:34:25] thanks [18:36:58] works when I do new private window.. ok.. still never saw this one before [18:39:52] !log devtools - created instance releases-trixie T429636 [18:39:55] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Devtools/SAL [18:39:55] T429636: create test instance for releases-jenkins - https://phabricator.wikimedia.org/T429636 [19:20:37] mutante, I've had that before, was a misbehaving extension [19:21:10] specifically a user-agent switcher in my case [20:19:14] !log lucaswerkmeister@tools-bastion-15 tools.ranker deployed e4a593851b (l10n updates: sk) [20:19:17] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.ranker/SAL [20:20:18] !log lucaswerkmeister@tools-bastion-15 tools.lexeme-forms deployed 279d1068c2 (l10n updates: ar) [20:20:20] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.lexeme-forms/SAL [21:24:50] AntiComposite: interesti/win 5 [21:25:00] :) oops, thanks