[00:14:37] <roy649_>	 taavi I'm still getting the "fatal error: newosproc" message even with:
[00:14:50] <roy649_>	 GOPROCS=1 kubectl logs --tail=10 indexer-tasks-job-4z895
[00:30:26] <bd808>	 roy649_: do you have multiple shell sessions open? The limits are per user, not per session so running screen, tmux, or multiple ssh sessions to the bastion at the same time all eat up available procs.
[00:31:10] <roy649_>	 hmmm
[00:31:30] <roy649_>	 yes, I have two windows into the bastion.
[00:31:35] <roy649_>	 and one of them is running tmux.
[00:32:06] <roy649_>	 is that really considered excessive?
[00:38:24] <bd808>	 I'm not judging you roy649_, just telling you how the limits work -- https://wikitech.wikimedia.org/wiki/Help:Toolforge/Kubernetes#%22failed_to_create_new_OS_thread%22_from_kubectl
[00:41:53] <roy649_>	 That's cool, I appreciate the help.
[03:43:06] <roy649_>	 Just a heads up, I've started inserting data into elasticsearch.svc.tools.eqiad1.wikimedia.cloud:80.  It looks like this first batch is about 10% done and will probably be running for a bunch more hours.
[03:43:41] <roy649_>	 The indexer is running on indexer-tasks-job-tshs4 
[03:45:09] <roy649_>	 Heh.  I was about to say, "If this is being disruptive, feel free to shut the pod down", but I see it just did that all by itself due to some uncaught exception :-(
[08:34:02] <taavi>	 !log tools sign puppet certificate for tools-sgeexec-10-4
[08:34:04] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL
[10:49:46] <arturo>	 !log admin made cloudmetrics1001/1002 primary/backup respectively (T299744, T297814, T300011)
[10:49:51] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL
[10:49:52] <stashbot>	 T300011: missing graphite data - https://phabricator.wikimedia.org/T300011
[10:49:52] <stashbot>	 T297814: cloudmetrics1003 seizes up under load - https://phabricator.wikimedia.org/T297814
[10:49:52] <stashbot>	 T299744: cloudmetrics1004 potential hardware problem - https://phabricator.wikimedia.org/T299744
[11:44:39] <arturo>	 !log tools rebooting buster exec nodes
[11:44:42] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL
[11:45:36] <wm-bot>	 !log toolsbeta reconfiguring the grid by using grid-configurator - cookbook ran by arturo@nostromo
[11:45:37] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Toolsbeta/SAL
[11:50:47] <wm-bot>	 !log tools reconfiguring the grid by using grid-configurator - cookbook ran by arturo@nostromo
[11:50:50] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL
[14:30:24] <mdipietro>	 !paws deploying 93d33c44a876fda8928719353ac0d5cf75651fd7 PR122
[14:30:40] <mdipietro>	 !log paws deployed 93d33c44a876fda8928719353ac0d5cf75651fd7 PR122
[14:30:41] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Paws/SAL
[17:35:39] <taavi>	 !log bastion create bastion-eqiad1-03 and 04 (bullseye) to replace existing stretch ones (01, 02)
[17:35:41] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Bastion/SAL
[17:38:49] <taavi>	 !log bastion shutdown bastion-restricted-eqiad1-01 (unused, restricted.bastion.wmcloud.org is bastion-restricted-eqiad1-02)
[17:38:50] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Bastion/SAL