[08:05:16] <wm-bot>	 !log tools.prosesize <legoktm> Updated from c29bbf9 to f5c74cb
[08:05:18] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.prosesize/SAL
[08:23:41] <wm-bot>	 !log tools.rfa-voting-history <legoktm> Updated from f56acfe to 19c8b7a
[08:23:43] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.rfa-voting-history/SAL
[10:16:35] <dhinus>	 heads up that in one hour (11:15 UTC) I will stop ToolsDB for approximately 2 mins (T329970)
[10:16:35] <stashbot>	 T329970: [toolsdb] set up tools-db-1 to replicate from clouddb1001 - https://phabricator.wikimedia.org/T329970
[10:21:22] <arturo>	 👍
[10:35:56] <wm-bot>	 !log tools.quickcategories <lucaswerkmeister> set EXPECTED_DATABASE_ERROR for upcoming ToolsDB downtime
[10:35:58] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.quickcategories/SAL
[11:16:29] <dhinus>	 !log clouddb-services stopping mariadb on clouddb1001 for about 2 minutes (T329970)
[11:16:31] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Clouddb-services/SAL
[11:16:31] <stashbot>	 T329970: [toolsdb] set up tools-db-1 to replicate from clouddb1001 - https://phabricator.wikimedia.org/T329970
[11:23:27] <dhinus>	 !log clouddb-services mariadb on clouddb1001 is running again
[11:23:29] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Clouddb-services/SAL
[11:24:08] <taavi>	 !log tools redeploy volume-admission with helm and cert-manager certificates T329530 T292238
[11:24:08] <dhinus>	 apologies it was a bit longer than 2 mins, obviously I forgot one potential problem (stuck queries that I had to kill manually)
[11:24:13] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL
[11:24:13] <stashbot>	 T292238: Figure out certificate generation for admission webhooks before we lose the certificates/v1beta1 - https://phabricator.wikimedia.org/T292238
[11:24:13] <stashbot>	 T329530: Convert all Toolforge custom components to standardized Helm based deployment - https://phabricator.wikimedia.org/T329530
[16:07:46] <dhinus>	 unfortunately I have to repeat the toolsdb downtime, expect another 5 minutes of unavailability at 17:00 UTC (one hour from now)
[16:08:01] <dhinus>	 more details at T329970
[16:08:02] <stashbot>	 T329970: [toolsdb] set up tools-db-1 to replicate from clouddb1001 - https://phabricator.wikimedia.org/T329970
[17:07:20] <dhinus>	 !log clouddb-services stopping mariadb on clouddb1001 for about 5 minutes (T329970)
[17:07:23] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Clouddb-services/SAL
[17:07:23] <stashbot>	 T329970: [toolsdb] set up tools-db-1 to replicate from clouddb1001 - https://phabricator.wikimedia.org/T329970
[17:11:23] <dhinus>	 !log clouddb-services mariadb on clouddb1001 is running again
[17:11:24] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Clouddb-services/SAL
[20:19:01] <taavi>	 !log clouddb-services manually start prometheus-mysql-exporter on clouddb1001
[20:19:02] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Clouddb-services/SAL
[21:08:43] <Rook>	 !log paws upgrade openrefine to 3.7.0 adc41fc9ce208197589adae938bbc8374ae80c5b T329835
[21:08:46] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Paws/SAL
[21:08:46] <stashbot>	 T329835: upgrade OpenRefine to 3.7.0 - https://phabricator.wikimedia.org/T329835
[23:26:03] <wm-bot>	 !log tools.quickcategories <lucaswerkmeister> deployed 613fd8d548 (disable querytime mechanism by default: wrote much data for little gain)
[23:26:04] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.quickcategories/SAL
[23:28:58] <wm-bot>	 !log tools.quickcategories <lucaswerkmeister> optimized querytime table (~tools.quickcategories/purge-querytime)
[23:28:58] <wm-bot>	 !log tools.quickcategories <lucaswerkmeister> START - purge querytime rows older than 30 days, in batches of 1000 sleeping for 1s between batches (~tools.quickcategories/purge-querytime)
[23:28:59] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.quickcategories/SAL
[23:29:00] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.quickcategories/SAL