[11:46:46] * klausman lunch [11:54:00] FIRING: [2x] ErrorBudgetBurn: - https://alerts.wikimedia.org/?q=alertname%3DErrorBudgetBurn [12:52:27] 06Machine-Learning-Team, 06Data-Platform-SRE, 06Infrastructure-Foundations, 06serviceops, 13Patch-For-Review: Migrate the ownership of Docker images in production-images repo to mailing lists - https://phabricator.wikimedia.org/T373526#10102566 (10elukey) >>! In T373526#10100630, @akosiaris wrote: > I se... [13:25:46] 06Machine-Learning-Team, 06DC-Ops, 10ops-eqiad, 06SRE, 13Patch-For-Review: Q1:rack/setup/install ml-serve1009-1011 (3x), ml-lab1001-1002 (2x), dse-k8s-worker1009 (1x) - https://phabricator.wikimedia.org/T372432#10102699 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by jclark@cum... [13:25:56] 06Machine-Learning-Team, 06DC-Ops, 10ops-eqiad, 06SRE, 13Patch-For-Review: Q1:rack/setup/install ml-serve1009-1011 (3x), ml-lab1001-1002 (2x), dse-k8s-worker1009 (1x) - https://phabricator.wikimedia.org/T372432#10102700 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by jclark@cum... [13:30:05] 06Machine-Learning-Team, 06DC-Ops, 10ops-eqiad, 06SRE, 13Patch-For-Review: Q1:rack/setup/install ml-serve1009-1011 (3x), ml-lab1001-1002 (2x), dse-k8s-worker1009 (1x) - https://phabricator.wikimedia.org/T372432#10102702 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by jclark@cum... [13:37:20] 06Machine-Learning-Team, 06DC-Ops, 10ops-eqiad, 06SRE, 13Patch-For-Review: Q1:rack/setup/install ml-serve1009-1011 (3x), ml-lab1001-1002 (2x), dse-k8s-worker1009 (1x) - https://phabricator.wikimedia.org/T372432#10102716 (10Jclark-ctr) a:05klausman→03Jclark-ctr [13:52:19] 06Machine-Learning-Team, 06DC-Ops, 10ops-eqiad, 06SRE, 13Patch-For-Review: Q1:rack/setup/install ml-serve1009-1011 (3x), ml-lab1001-1002 (2x), dse-k8s-worker1009 (1x) - https://phabricator.wikimedia.org/T372432#10102797 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by jclark@cumin10... [13:53:18] 06Machine-Learning-Team, 06DC-Ops, 10ops-eqiad, 06SRE, 13Patch-For-Review: Q1:rack/setup/install ml-serve1009-1011 (3x), ml-lab1001-1002 (2x), dse-k8s-worker1009 (1x) - https://phabricator.wikimedia.org/T372432#10102799 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by jclark@cum... [13:54:51] 06Machine-Learning-Team, 06DC-Ops, 10ops-eqiad, 06SRE, 13Patch-For-Review: Q1:rack/setup/install ml-serve1009-1011 (3x), ml-lab1001-1002 (2x), dse-k8s-worker1009 (1x) - https://phabricator.wikimedia.org/T372432#10102804 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by jclark@cumin10... [13:55:07] 06Machine-Learning-Team, 06DC-Ops, 10ops-eqiad, 06SRE, 13Patch-For-Review: Q1:rack/setup/install ml-serve1009-1011 (3x), ml-lab1001-1002 (2x), dse-k8s-worker1009 (1x) - https://phabricator.wikimedia.org/T372432#10102805 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by jclark@cum... [14:09:50] klausman: will you join the ml:research meeting now? [14:16:25] oops, got distracted by ML labs machines, be there in a sec [14:16:47] ML lab machines! [14:36:09] 06Machine-Learning-Team, 06DC-Ops, 10ops-eqiad, 06SRE, 13Patch-For-Review: Q1:rack/setup/install ml-serve1009-1011 (3x), ml-lab1001-1002 (2x), dse-k8s-worker1009 (1x) - https://phabricator.wikimedia.org/T372432#10103062 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by jclark@cumin10... [14:39:02] 06Machine-Learning-Team, 06DC-Ops, 10ops-eqiad, 06SRE, 13Patch-For-Review: Q1:rack/setup/install ml-serve1009-1011 (3x), ml-lab1001-1002 (2x), dse-k8s-worker1009 (1x) - https://phabricator.wikimedia.org/T372432#10103064 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by jclark@cumin10... [14:40:59] 06Machine-Learning-Team, 06DC-Ops, 10ops-eqiad, 06SRE, 13Patch-For-Review: Q1:rack/setup/install ml-serve1009-1011 (3x), ml-lab1001-1002 (2x), dse-k8s-worker1009 (1x) - https://phabricator.wikimedia.org/T372432#10103085 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by jclark@cumin10... [14:42:18] 06Machine-Learning-Team, 06DC-Ops, 10ops-eqiad, 06SRE, 13Patch-For-Review: Q1:rack/setup/install ml-serve1009-1011 (3x), ml-lab1001-1002 (2x), dse-k8s-worker1009 (1x) - https://phabricator.wikimedia.org/T372432#10103087 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by jclark@cum... [15:07:33] 06Machine-Learning-Team, 06DC-Ops, 10ops-eqiad, 06SRE, 13Patch-For-Review: Q1:rack/setup/install ml-serve1009-1011 (3x), ml-lab1001-1002 (2x), dse-k8s-worker1009 (1x) - https://phabricator.wikimedia.org/T372432#10103167 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by jclark@cum... [15:16:53] 06Machine-Learning-Team, 06DC-Ops, 10ops-eqiad, 06SRE, 13Patch-For-Review: Q1:rack/setup/install ml-serve1009-1011 (3x), ml-lab1001-1002 (2x), dse-k8s-worker1009 (1x) - https://phabricator.wikimedia.org/T372432#10103206 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by jclark@cumin10... [16:04:11] 06Machine-Learning-Team, 06DC-Ops, 10ops-eqiad, 06SRE, 13Patch-For-Review: Q1:rack/setup/install ml-serve1009-1011 (3x), ml-lab1001-1002 (2x), dse-k8s-worker1009 (1x) - https://phabricator.wikimedia.org/T372432#10103469 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by jclark@cumin10... [16:45:07] 06Machine-Learning-Team, 10MW-1.43-notes (1.43.0-wmf.20; 2024-08-27), 13Patch-For-Review, 10Structured-Data-Backlog (Current Work): [S] Update the logo detection service request to call the production endpoint - https://phabricator.wikimedia.org/T370762#10103635 (10matthiasmullie) 05Open→03Resolved... [20:42:07] 06Machine-Learning-Team, 06DC-Ops, 10ops-eqiad, 06SRE, 13Patch-For-Review: Q1:rack/setup/install ml-serve1009-1011 (3x), ml-lab1001-1002 (2x), dse-k8s-worker1009 (1x) - https://phabricator.wikimedia.org/T372432#10104390 (10Jclark-ctr) [20:55:37] 06Machine-Learning-Team, 06DC-Ops, 10ops-eqiad, 06SRE, 13Patch-For-Review: Q1:rack/setup/install ml-serve1009-1011 (3x), ml-lab1001-1002 (2x), dse-k8s-worker1009 (1x) - https://phabricator.wikimedia.org/T372432#10104431 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by jclark@cum... [21:03:15] 06Machine-Learning-Team, 06DC-Ops, 10ops-eqiad, 06SRE, 13Patch-For-Review: Q1:rack/setup/install ml-serve1009-1011 (3x), ml-lab1001-1002 (2x), dse-k8s-worker1009 (1x) - https://phabricator.wikimedia.org/T372432#10104446 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by jclark@cum... [21:45:19] 06Machine-Learning-Team, 06DC-Ops, 10ops-eqiad, 06SRE, 13Patch-For-Review: Q1:rack/setup/install ml-serve1009-1011 (3x), ml-lab1001-1002 (2x), dse-k8s-worker1009 (1x) - https://phabricator.wikimedia.org/T372432#10104639 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by jclark@cumin10... [21:53:47] 06Machine-Learning-Team, 06DC-Ops, 10ops-eqiad, 06SRE, 13Patch-For-Review: Q1:rack/setup/install ml-serve1009-1011 (3x), ml-lab1001-1002 (2x), dse-k8s-worker1009 (1x) - https://phabricator.wikimedia.org/T372432#10104652 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by jclark@cumin10... [21:54:25] 06Machine-Learning-Team, 06DC-Ops, 10ops-eqiad, 06SRE, 13Patch-For-Review: Q1:rack/setup/install ml-serve1009-1011 (3x), ml-lab1001-1002 (2x), dse-k8s-worker1009 (1x) - https://phabricator.wikimedia.org/T372432#10104653 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by jclark@cum... [22:45:05] 06Machine-Learning-Team, 06DC-Ops, 10ops-eqiad, 06SRE, 13Patch-For-Review: Q1:rack/setup/install ml-serve1009-1011 (3x), ml-lab1001-1002 (2x), dse-k8s-worker1009 (1x) - https://phabricator.wikimedia.org/T372432#10104712 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by jclark@cumin10... [22:45:21] 06Machine-Learning-Team, 06DC-Ops, 10ops-eqiad, 06SRE, 13Patch-For-Review: Q1:rack/setup/install ml-serve1009-1011 (3x), ml-lab1001-1002 (2x), dse-k8s-worker1009 (1x) - https://phabricator.wikimedia.org/T372432#10104713 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by jclark@cum... [23:33:31] 06Machine-Learning-Team, 06DC-Ops, 10ops-eqiad, 06SRE, 13Patch-For-Review: Q1:rack/setup/install ml-serve1009-1011 (3x), ml-lab1001-1002 (2x), dse-k8s-worker1009 (1x) - https://phabricator.wikimedia.org/T372432#10104867 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by jclark@cumin10...