[05:35:11] https://isin.toolforge.org is offline - 504 Gateway Time-out [07:34:07] Ginger4242, forced the pod to run in a different worker, seems to be working now, will reboot that k8s worker [08:44:59] !log admin hardcode `185.15.56.161 openstack.eqiad1.wikimediacloud.org` in /etc/hosts in cloudcontrol1005 for T346441 [08:45:03] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [08:45:04] T346441: openstack eqiad1: verify new control plane works with cloudlb - https://phabricator.wikimedia.org/T346441 [10:40:51] !log templatetransclusioncheck restarted stuck pod (webservice stop+start) T346126 [10:40:53] dhinus: Unknown project "templatetransclusioncheck" [10:40:53] dhinus: Did you mean to say "tools.templatetransclusioncheck" instead? [10:40:53] T346126: Some of my tools (eg wikidata-todo) just start throwing 504 errors - https://phabricator.wikimedia.org/T346126 [10:41:08] !log tools restarted stuck pod (webservice stop+start) T346126 [10:41:10] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [10:43:55] !log tools.templatetransclusioncheck restarted stuck pod (webservice stop+start) T346126 [10:43:58] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.templatetransclusioncheck/SAL [11:40:52] !log admin decomission cloudservices1005 T346042 in preparation for re-racking [11:40:56] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [11:40:57] T346042: cloudservices1005: move to new setup - https://phabricator.wikimedia.org/T346042 [11:53:39] !log admin update designate urls in Keystone to point to openstack-next, until cloudlb is serving the main openstack address T346042 [11:53:44] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [11:53:44] T346042: cloudservices1005: move to new setup - https://phabricator.wikimedia.org/T346042 [16:11:13] !log tools.wikiloves Deploy ea0a61c and dedd577 (T231796) [16:11:16] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.wikiloves/SAL [23:24:18] AntiComposite: when deploying the fileprotectionsync/KrinkleBot changes, you'll also be deploying the ptwiki config change. That should (hopefully) end up creating https://commons.wikimedia.org/wiki/Commons:Auto-protected_files/wikipedia/pt [23:24:38] alright