[01:16:00] https://www.irccloud.com/pastebin/oW4ydgQ7/ [01:16:47] Done: [01:16:47] * major refactor to all jobs-load PRs [01:16:47] * https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-cli/-/merge_requests/44 [01:16:47] * https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/93 [01:16:47] Working-on: [01:16:47] * more work on https://phabricator.wikimedia.org/T359650 (save business models in DB) [08:00:02] Cteam: welcome to today 🦄! Don’t forget to post your update in thread. [08:00:02] Feel free to include: [08:00:02] 1. 🕫 Anything you'd like to share about your work [08:00:02] 2. ☏ Anything you'd like to get help with [08:00:02] 3. ⚠ Anything you're currently blocked on [08:00:02] (this message is from a toolforge job under the admin project) [12:44:08] Done: [12:44:08] * [lima-kilo] Add some docs on how to use the ingress (`curl http://.local:30002` essentially, but there's the port needed) [12:44:08] * [toolforge,services] fixed the mount of the volume, the data was there :) (in a different subtree than this version of aptrepo expects though) [12:44:08] Doing: [12:44:08] * [jobs-api] remove auth patches got to rebase https://gitlab.wikimedia.org/repos/cloud/toolforge/jobs-api/-/merge_requests/106 [12:44:09] * [ceph,disks] will try to pull one of the old drives, but have to instrument beforehand to measure latency [12:44:09] * [toolforge,clis] standardize all the user agents (https://phabricator.wikimedia.org/T370393) (deployed envvars already) [12:44:10] * [toolforge,harbor] finish up today's incident document/report [12:44:10] * [toolforge,replica_cnf] we missed renaming one of the urls passed, it failed to create new account [12:44:11] * [toolforge,imagemagick] trying to get a workaround the size limitations as it will take time for the upstream changes to reach the ubuntu+buildpack [12:44:11] Blockers (reviews needed for the first two): [12:44:12] * [webservice] patch to allow running on containers ready for review https://gitlab.wikimedia.org/repos/cloud/toolforge/tools-webservice/-/merge_requests/49 [12:44:12] * [ceph] added runbook to wait for the cluster to rebalance, ready for review https://gerrit.wikimedia.org/r/c/cloud/wmcs-cookbooks/+/1054510 [12:44:13] * [codesearch] Adding our gitlab repos to the search engine, waiting for review https://gerrit.wikimedia.org/r/c/labs/codesearch/+/1053538 [13:16:29] Done: [13:16:29] * [toolforge,api-docs] removed all the bits that pulled js/icons from external sources, now there's no external resources on api-docs.toolforge.org [16:19:18] Done (yesterday): [16:19:20] * responded to a ToolsDB page, and fixed the mysql-exporter on tools-db-3 [16:19:22] * investigated an alert about wikitech-static (the disk was full) [16:19:24] * continued the investigation on T367778 clouddb replag [16:19:26] Done (today): [16:19:28] * responded to the harbor outage [16:19:30] * continued the investigation on T367778 clouddb replag [16:19:32] * checked the status of T370760 toolsdb replag, estimated time to completion