[13:03:45] Hi, when I try to connect to any of the replica databases from the bastions with "sql xxwiki", I get "ERROR 2013 (HY000): Lost connection to MySQL server at 'handshake: reading initial communication packet', system error: 11", is this known? [13:06:38] Let's try the other way... [13:06:47] !help Hi, when I try to connect to any of the replica databases from the bastions with "sql xxwiki", I get "ERROR 2013 (HY000): Lost connection to MySQL server at 'handshake: reading initial communication packet', system error: 11", is this known? [13:06:47] If you don't get a response in 15-30 minutes, please create a phabricator task -- https://phabricator.wikimedia.org/maniphest/task/edit/form/1/?projects=wmcs-kanban [13:09:17] I was about to ask the same. My tool got disconnected from commonswiki.analytics.db.svc.wikimedia.cloud at 12:37:28 and can't connect since. I don't see any db maintenance planned today on s4? [13:20:19] looks like dbproxy1018 just went down. I can't do anything to that, but I've at least pinged those who can [13:29:20] Thanks, taavi, let's wait then [14:38:12] jem: try now? [14:39:56] repal is up again [14:40:00] replag* [14:43:42] is anyone around to confirm whether or not db connections are working now? don-vip? taavi? [14:44:44] andrewbogott: works for me [14:44:54] ok, thanks for checking [14:51:04] works for me too. Thank you guys [15:03:51] taavi: if I revert that proxy change are you around to retest? [15:04:03] andrewbogott: yes [15:09:18] taavi: reverted [15:09:41] seems to work [15:10:26] great, thank you! [15:20:57] !log tools.cdnjs rolled ~/cdnjs-index back to fe85853af5, the changes for T342519 aren’t properly working yet [15:21:02] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cdnjs/SAL [15:22:14] !log tools.cdnjs kubectl delete job.batch/update-index-28183937 # job for T342519 is running too long, abort – next cronjob schedule should use the old code again [15:22:16] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.cdnjs/SAL [15:58:42] andrewbogott: I was away, sorry... and it's working now, thanks :)