[07:40:07] <eoghan>	 Where would I find ACLs for the database hosts? Want to let lists2001 connect to m5, it's timing out at the moment (and I assume is due to ACLs/firewall rules somewhere. 
[07:41:13] <taavi>	 eoghan: profile::mariadb::ferm_lists
[07:41:20] <eoghan>	 Aha, ty.
[09:01:07] <eoghan>	 How difficult would it be to either get a read-only user for the lists db on m5, or to get a copy of the db that I could point the new list hosts to? What I'm trying to avoid is if there's a schema change in the new version that would stop the old host from working. Working through the changelog to see if there's a change, but just wondering about alternatives. 
[09:07:37] <jynus>	 eoghan: not very, if the right request is done answering these questions: https://wikitech.wikimedia.org/wiki/MariaDB/request_new_database
[09:07:59] <jynus>	 you can just skip the ones about storage or availability, as it is not a new db
[09:08:16] <jynus>	 A phab ticket, I mean
[09:24:41] <eoghan>	 ty, will do now
[09:42:23] <jynus>	 db2176 is lagging
[09:42:39] <jynus>	 replication stopped
[09:46:12] <arnaudb>	 oh
[09:46:19] <jynus>	 I am going to depool it
[09:46:25] <arnaudb>	 thanks
[09:46:26] <jynus>	 unless you are, arnaudb ?
[09:46:27] <arnaudb>	 will check the node
[09:46:42] <arnaudb>	 I'll do it jynus don't worry
[09:46:51] <jynus>	 not touching it, then
[09:53:49] <arnaudb>	 I'll downtime the server for the weekend as something shady is going on there, marostegui there's been a calltrace in `sudo journalctl -fln300 -u mariadb.service` that I think you might want to take a look at. Host is on mariadb 10.6 / deb 12
[09:54:45] <jynus>	 oh
[09:55:03] <jynus>	 let me check its primary, just in case
[09:55:19] <arnaudb>	 sure!
[09:56:05] <marostegui>	 arnaudb: can you create a task?
[09:56:24] <jynus>	 all good there, no stalls or weird semisync issues
[09:56:31] <arnaudb>	 great
[09:56:35] <arnaudb>	 marostegui: yep!
[10:02:08] <arnaudb>	 T365793 opened!
[10:02:08] <stashbot>	 T365793: db2176 crash - https://phabricator.wikimedia.org/T365793
[10:14:49] <marostegui>	 arnaudb: do you have time to clone it or should I?
[10:15:05] <arnaudb>	 you want me to wipe the host? I can do it
[10:15:15] <marostegui>	 yeah, a full reclone (no need to reimage)
[10:15:18] <arnaudb>	 ack
[10:15:26] <marostegui>	 thanks :*
[10:16:52] <marostegui>	 Amir1: how's the pagelink thing going? maybe we should start with https://phabricator.wikimedia.org/T364069
[10:18:41] <Amir1>	 It's a bit complicated. In several sections it's all done except dc masters
[10:19:04] <Amir1>	 S5, s6, s4, s3, s7
[10:19:16] <Amir1>	 The rest are waiting for stuff before anything 
[10:19:45] <Amir1>	 marostegui: also I really want to optimize templatelinks in s4 at least. Can it be batched?
[10:21:12] <Amir1>	 Stupid question db2176: was it data corruption or software issue?
[10:29:37] <marostegui>	 Amir1: It looks just a corruption with an innodb crash
[10:30:14] <Amir1>	 Ah okay 
[10:30:17] <Amir1>	 Thanks
[10:30:23] <jynus>	 let me know if you want a backup recovery
[10:34:20] <marostegui>	 Amir1: ok, we can start with the replicas 
[10:34:49] <marostegui>	 jynus: I think we will not be needing it now, but up to arnaudb how he wants to reclone it
[10:34:52] <marostegui>	 I don't have any strong preference
[10:36:04] <arnaudb>	 host is currently being cloned so lets see how it goes from here maybe 
[12:12:34] <marostegui>	 Amir1: https://phabricator.wikimedia.org/T364069#9829190
[12:12:45] <Amir1>	 thanks!
[12:13:01] <Amir1>	 let me know if I can help on anything
[12:13:09] <marostegui>	 thanks will do
[15:31:24] <justinl>	 Hi all. I posted a question yesterday about upgrading from MySQL 5.7 to 8. Did anyone see that and have any feedback on the recommendation I got from AWS Aurora support? FWIW, I just tried their recommendation and got the error that NO_AUTO_CREATE_USER is not valid, so I need to follow up on that.
[15:32:24] <Reedy>	 This channel probably isn't the right question for this, as that is not related to WMF deployments...
[15:34:06] <justinl>	 Ah, my apologies. Any recommendations as to a better place to ask?
[15:37:35] <justinl>	 I was just hoping to get feedback on this from MW database experts.
[15:59:18] <Amir1>	 the mediawiki discord server maybe?
[16:01:52] <justinl>	 Ok, thanks, I appreciate the suggestion.