[02:25:09] !log admin Safe rebooting 'cloudvirt1021.eqiad.wmnet'. - cookbook ran by andrew@buster [02:25:09] !log admin Draining 'cloudvirt1021.eqiad.wmnet'. - cookbook ran by andrew@buster [02:25:11] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [02:25:12] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [02:28:06] !log admin Set cloudvirt 'cloudvirt1021.eqiad.wmnet' maintenance. - cookbook ran by andrew@buster [02:28:07] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [03:04:20] !log admin reset and recreated the rabbitmq cluster in eqiad1 to get around some broken queues. [03:04:22] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [10:30:53] !log ores deleted calbon-test.ores VM T308102 [10:30:55] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Ores/SAL [10:30:55] T308102: Delete Cloud VPS projects ores and ores-staging - https://phabricator.wikimedia.org/T308102 [13:37:49] it appears quarry queries are not coming through, not sure if just me. [13:38:12] I've tried a couple different simple queries at https://quarry.wmcloud.org/query/63759, but nothing comes through [13:38:18] stop query yields an Internal Server ERror [13:44:38] !log paws update pwb version and pin jupyterlab version ef3e38c671e20fad6b8297dfb20a14a913a8dda5 [13:44:40] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Paws/SAL [13:44:55] Krinkle: I'll have a look [13:51:42] Krinkle: https://phabricator.wikimedia.org/T308131 for notes [17:45:24] Thx [19:56:28] !log tools.integraality Deploy 43f07d2, da1f2ef, 6ab7547, 5f6b20a, 0df2121 [19:56:30] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.integraality/SAL [22:50:26] !log tools.scholia-analytics kubectl delete deployment.apps/nginx-app [22:50:28] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.scholia-analytics/SAL [22:52:15] !log tools.scholia-analytics kubectl delete deployment.apps/scholia-analytics2 [22:52:16] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.scholia-analytics/SAL [22:52:26] !log tools.scholia-analytics kubectl delete deployment.apps/scholia-analytics3 [22:52:28] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.scholia-analytics/SAL [22:52:34] !log tools.scholia-analytics kubectl delete deployment.apps/scholia-analytics4 [22:52:36] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.scholia-analytics/SAL [22:54:52] !log tools.scholia-analytics webservice stop [22:54:53] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.scholia-analytics/SAL [22:58:53] !log tools.scholiaanalytics kubectl delete deployment.apps/nginx [22:58:55] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.scholiaanalytics/SAL [22:59:11] !log tools.scholiaanalytics kubectl delete deployment.apps/scholia-analytics [22:59:12] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.scholiaanalytics/SAL [22:59:26] !log tools.scholiaanalytics kubectl delete deployment.apps/scholiaanalytics [22:59:31] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.scholiaanalytics/SAL [23:56:36] !log tools.jarbot Increased count/cronjobs.batch quota from 50 to 60 [23:56:38] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.jarbot/SAL