[02:38:24] <andrewbogott>	 !log tools rebooted tools-sgeweblight-10-16,  T337806
[02:38:28] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL
[02:38:28] <stashbot>	 T337806: mysterious oom issues on VMs - https://phabricator.wikimedia.org/T337806
[06:31:51] <wm-bot>	 !log tools.bridgebot <lucaswerkmeister> Double IRC messages to other bridges
[06:31:53] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.bridgebot/SAL
[09:35:26] <taavi>	 !log tools.urbanecmbot bump quotas per T337183
[09:35:28] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.urbanecmbot/SAL
[09:35:28] <stashbot>	 T337183: Request increased quota for urbanecmbot Toolforge tool - https://phabricator.wikimedia.org/T337183
[10:06:04] <dcaro>	 taavi: hahah, I was checking to update that quota at the same time xd, did not see the phabricator comment pop up (had the tab open already
[10:06:04] <dcaro>	 )
[10:07:44] <taavi>	 :P
[10:10:38] <musikanimal>	 hi! has anyone at WMCS had a look at https://phabricator.wikimedia.org/T337734 yet? I see all sections are now supposed to be running normally, but we're apparently missing indexes because nearly all queries i.e. on revision_userindex will time out
[10:13:06] <arturo>	 musikanimal: could you please write in that ticket why you see the index as needed? 
[10:14:15] <musikanimal>	 sure... I don't know what the indexes were (they don't show up with EXPLAN or SHOW TABLE). But all of those _userindex and _logindex views are crucial for external tools
[10:14:50] <musikanimal>	 the views are there, but apparently don't actually have the indexes
[10:15:00] <arturo>	 makes sense
[10:27:44] <musikanimal>	 T337446 is nearly done, but most tools are still unusable as anything user-related is going to rely on those indexes. I'm going to update the warnings on my tools to point to T337734, so you may see more folks asking for updates -- hope that's okay!
[10:27:44] <stashbot>	 T337446: Rebuild sanitarium hosts - https://phabricator.wikimedia.org/T337446
[10:27:45] <stashbot>	 T337734: Investigate if maintain-replica-indexes is still needed - https://phabricator.wikimedia.org/T337734
[10:28:29] <arturo>	 musikanimal: thanks!
[11:26:18] * dcaro back
[14:05:57] <wm-bot>	 !log tools.stewardbots <anticomposite> SULWatcher/manage.sh restart # All SULWatchers disconnected
[14:05:59] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.stewardbots/SAL
[20:28:07] <wm-bot>	 !log tools.lexeme-forms <lucaswerkmeister> deployed 1ec8c72304 (Russian adjectivse: remove compound lexical categories)
[20:28:10] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.lexeme-forms/SAL
[20:31:31] <mdaniels5757>	 Hi! Could someone with access please run "ldap cn=IVORK memberOf | grep cn=tools. | sort" (stolen from Bryan Davis on phab) to see which tools they own? They just exercised their right to vanish (https://meta.wikimedia.org/w/index.php?title=Special:Log&logid=52379788), and either me or someone else should adopt their tools.
[20:32:48] <bd808>	 mdaniels5757: https://ldap.toolforge.org/user/ivork
[20:33:10] <mdaniels5757>	 I did not know that existed! Thanks!
[20:33:13] <bd808>	 the "service groups" are the tools