[04:45:20] Good morning: https://blogs.oracle.com/mysql/post/introducing-javascript-support-in-mysql [04:45:59] Make sure to turn your caps lock on [04:46:02] https://usercontent.irccloud-cdn.com/file/8GC4mmhf/grafik.png [06:14:11] I have acked the restbase hosts alerts about puppet [07:33:59] (PuppetFailure) firing: Puppet has failed on ms-be2068:9100 - https://puppetboard.wikimedia.org/nodes?status=failed - https://grafana.wikimedia.org/d/yOxVDGvWk/puppet - https://alerts.wikimedia.org/?q=alertname%3DPuppetFailure [08:18:53] disk sadness [08:19:26] (sdh has failed) [10:55:46] FYI, I'm currently recovering a snapshot of s1 from dbprov1001 to dbstore1008 using transfer.py for T351921 [10:55:47] T351921: Bring dbstore1008 into service to replace dbstore1003 - https://phabricator.wikimedia.org/T351921 [11:35:01] looks like the dead disk started to go back in early December(!), details in T354180 [11:35:02] T354180: Disk (sdh) failed in ms-be2068 - https://phabricator.wikimedia.org/T354180 [12:17:09] Emperor: that feels like it should have been detected [13:01:45] marostegui: With regard to provisioning dbstore1008, would you prefer to take care of updating zarcillo yourself (https://wikitech.wikimedia.org/wiki/MariaDB/Provisioning_a_host#Add_it_to_zarcillo_DB) or would you prefer that I do it? [13:02:30] btullis: I can do that if you let me know on which rack the host is [13:04:03] marostegui: Thanks. It's E2. I'm planning to provision all three sections (s1,s5,s7) on this host today, if possible. [13:04:20] Ok, I'll update zarcillo for those three [13:05:31] I was wondering if you think it worthwhile to upgrade to mariadb 10.6 at the same time as doing this migration? I see that dbstore1005 has been upgraded, but dbstore1003 hadn't. [13:05:39] (and thanks) [13:05:46] Probably yes, even migrating to bookworm [13:10:44] done, zarcillo udpated [13:10:46] updated [13:10:52] Oh, OK. Will do. Any guidance on the mariadb upgrade procedure, other than setting `mariadb::package: 'wmf-mariadb106'`? [13:11:47] btullis: if you do the reimage to bookworm, nothing to be done. If you want just upgrade to 10,6, after merging that puppet change you need to remove the wmf-mariadb104 package, run puppet, start mariadb, run mysql_upgrade, start mariadb [13:11:49] that would be it [13:12:12] the last bit was meant to be, start replication [13:13:17] OK, thanks. I'll see how I get on.