[09:32:38] taavi: when the ovs migration finishes for deployment-prep, can you put it's DB back to read-write? [09:38:56] !log deployment-prep set deployment-db11 as writable after reboot [09:38:58] RhinosF1: [09:38:59] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Deployment-prep/SAL [09:40:19] taavi: ty :) [11:41:34] Hi Cloud team, over the past few days, I've gotten talk page messages saying that the webservice for cluebotng keeps falling over. I have been doing toolforge webservice stop / toolforge webservice start to get it back going but https://cluebotng.toolforge.org/ still ends up going 'not currently responding', any ideas what might be going on? [11:45:58] Typical I come in and ask in the middle of a netsplit... I'll re-post my message for those who have just re-joined :) [11:45:59] Hi Cloud team, over the past few days, I've gotten talk page messages saying that the webservice for cluebotng keeps falling over. I have been doing toolforge webservice stop / toolforge webservice start to get it back going but https://cluebotng.toolforge.org/ still ends up going 'not currently responding', any ideas what might be going on? [14:51:20] I made a patch for this https://gitlab.wikimedia.org/toolforge-repos/bridgebot/-/merge_requests/6 (re @lucaswerkmeister: I think that’s the right configuration, but you should file a task anyway) [14:51:36] Who will review this patch? [17:22:14] !log dwl migrating to ovs, will cause a bit of downtime [17:22:15] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Dwl/SAL [18:44:41] @GergesShamon can you add me to the Telegram group you wanted to bridge to? [19:05:35] !log lucaswerkmeister@tools-bastion-13 tools.lexeme-forms deployed 8530f5f235 (l10n updates: eo, fa, kaa, lb) [19:05:37] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.lexeme-forms/SAL [19:33:16] !log quarry rebuilt magnum cluster using g4/ovs flavors [19:33:18] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Quarry/SAL [20:46:01] !log paws rebuilt magnum cluster using g4/ovs flavors [20:46:03] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Paws/SAL [21:09:59] I sent you a link (re @lucaswerkmeister: @GergesShamon can you add me to the Telegram group you wanted to bridge to?) [22:32:15] Hey all, I'm planning on migrating cloudelastic to a new LB config on Thursday at 1400 UTC (ref T367511 ) . Expecting up to an hour of downtime. Do I need to hit any mailing lists to let people know? [22:32:15] T367511: Migrate Cloudelastic load balancing to IPIP encapsulation (LVS) - https://phabricator.wikimedia.org/T367511 [22:40:03] inflatador: are your users mostly cloud-vps users? or toolforge users? [22:40:40] andrewbogott I believe toolforge users? It's a sanitized version of Elastic indices, similar to clouddb [22:40:58] probably cloud-announce then [22:41:28] If you send something to cloud-announce@lists.wikimedia.org I can figure out about getting it actually forwarded to the list [22:41:47] andrewbogott will do, thanks [22:53:46] ok, I think I released the message