[08:05:46] !log cloudinfra [codfw1dev] start mariadb.service on cloudinfra-db-01 [08:05:47] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Cloudinfra/SAL [11:54:17] !log toolsbeta powering off toolsbeta-test-k8s-etcd-22 (T334644) [11:54:20] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Toolsbeta/SAL [11:54:21] T334644: Move cloudsw2-d5-eqiad servers to cloudsw1-d5-eqiad - https://phabricator.wikimedia.org/T334644 [11:58:11] everything looks ok :) [12:00:03] !log tools powering off tools-k8s-etcd-18 (T334644) [12:00:06] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [12:00:06] T334644: Move cloudsw2-d5-eqiad servers to cloudsw1-d5-eqiad - https://phabricator.wikimedia.org/T334644 [14:00:28] !log tools restarting the tools-sgegrid-master node due to nfs hiccup [14:00:30] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [14:07:17] !log tools restarting the tools-sgeexec-10-17 node due to nfs hiccup [14:07:19] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [14:16:25] !log tools restart tools-sgeweblight-10-17.tools.eqiad1.wikimedia.cloud due to nfs hiccup [14:16:27] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [14:32:43] TheresNoTime: did not read full backscroll, but maybe https://phabricator.wikimedia.org/T331399 is of interest? [14:33:52] interesting.. I found the `page-links-change` stream to be pretty good though [14:55:07] * TheresNoTime is the wrong person to think about designing a "better" table for logging link additions... [14:57:05] Python to get link additions from eventstreams, get the base domain name, resolve the domain to an IP, etc. — yup, can do — make a schema to hold that which doesn't rely on autoincrementing primary keys and keys on random fields, *nah* [15:12:14] TheresNoTime: beetstra might have ideas [15:30:43] -.- [16:45:24] !log admin updated the bullseye image with https://cloud.debian.org/images/cloud/bullseye/20230601-1398/debian-11-genericcloud-amd64-20230601-1398.tar.xz [16:45:26] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [16:49:04] !log tools.add-text Set limits.cpu 16, limits.memory 24G T337718 [16:49:07] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.add-text/SAL [16:49:07] T337718: Request increased quota for add-text Toolforge tool - https://phabricator.wikimedia.org/T337718 [16:56:45] !log admin deleting all Stretch base images from glance [16:56:48] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [18:30:42] !log tools.quickstatements $ kubectl delete po quickstatements-6cf6cf9f5c-js47j (T338488) [18:30:46] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.quickstatements/SAL [19:12:10] cloud-ish, but I'm out of my depth in figuring out why beta is upset — T338495 [19:12:10] T338495: beta-scap-sync-world failure — SSL peer certificate or SSH remote key was not OK - https://phabricator.wikimedia.org/T338495 [19:23:21] !log tools.iabot webservice restart T338497 [19:23:24] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.iabot/SAL [20:21:37] !log tools Rebuilding container images (T337897) [20:21:40] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [20:21:40] T337897: Uwsgi webservices have strange routing behavior when tool name and first component of route path are exact matches - https://phabricator.wikimedia.org/T337897 [22:45:45] !log tools.toolviews Restart after updating to bb42ab4 and setting limits of cpu=1, mem=2G (T338055) [22:45:48] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.toolviews/SAL