[09:21:22] 06serviceops, 10WMDE-TechWish-Maintenance, 07Epic, 10Maps (Kartotherian), 13Patch-For-Review: Move Kartotherian to Kubernetes - https://phabricator.wikimedia.org/T216826#10013919 (10jijiki) @elukey happy to help with reviews etc, given I worked with the team on tegola, which is part of this stack:) [09:55:58] 06serviceops, 10Citoid, 10VisualEditor, 10VisualEditor-MediaWiki-References, and 2 others: Register Citoid as a "friendly bot" (or alternatively verified bot) with Cloudflare - https://phabricator.wikimedia.org/T370118#10013997 (10zoe) Generally Citoid will make a couple of requests to resolve redirects an... [10:02:51] 06serviceops, 06DC-Ops, 10ops-eqiad, 10Prod-Kubernetes, 06SRE: hw troubleshooting: Management and main interfaces down for kubernetes1051.eqiad.wmnet - https://phabricator.wikimedia.org/T369011#10014019 (10Clement_Goubert) 05Open→03Resolved Host BGP re-enabled, back in `Active` status and uncordo... [10:09:58] 06serviceops: operations/docker-images/production-images contains references to non-existent image python3 - https://phabricator.wikimedia.org/T336682#10014067 (10elukey) Quickly checked the current status since I'd like to drop the `python3` image from the registry. The `python3` image runs Debian 9, but `mwadd... [10:19:37] 06serviceops: operations/docker-images/production-images contains references to non-existent image python3 - https://phabricator.wikimedia.org/T336682#10014100 (10Clement_Goubert) sgtm [10:22:05] best comment ever --^ [10:22:34] * claime got bunnied [10:23:15] 06serviceops: operations/docker-images/production-images contains references to non-existent image python3 - https://phabricator.wikimedia.org/T336682#10014102 (10elukey) 05Open→03Resolved a:03elukey Dropped, thanks all! [12:22:27] 06serviceops, 06DC-Ops, 10ops-eqiad, 10Prod-Kubernetes, 06SRE: hw troubleshooting: Management and main interfaces down for kubernetes1051.eqiad.wmnet - https://phabricator.wikimedia.org/T369011#10014356 (10cmooney) >>! In T369011#10014019, @Clement_Goubert wrote: > Host BGP re-enabled, back in `Activ... [12:23:15] 06serviceops, 06DC-Ops, 10ops-eqiad, 10Prod-Kubernetes, 06SRE: hw troubleshooting: Management and main interfaces down for kubernetes1051.eqiad.wmnet - https://phabricator.wikimedia.org/T369011#10014360 (10Clement_Goubert) >>! In T369011#10014356, @cmooney wrote: >>>! In T369011#10014019, @Clement_Go... [13:32:56] 06serviceops, 06DC-Ops, 10ops-eqiad, 10Prod-Kubernetes, 06SRE: hw troubleshooting: Management and main interfaces down for kubernetes1051.eqiad.wmnet - https://phabricator.wikimedia.org/T369011#10014672 (10ops-monitoring-bot) Host rebooted by cgoubert@cumin1002 with reason: Missed kernel upgrade [13:38:47] 06serviceops, 10Citoid, 10VisualEditor, 10VisualEditor-MediaWiki-References, and 2 others: Register Citoid as a "friendly bot" (or alternatively verified bot) with Cloudflare - https://phabricator.wikimedia.org/T370118#10014738 (10akosiaris) OK, I 've group them into 1, named it `Wikimedia Citation Bot`, s... [13:42:16] 06serviceops, 10Citoid, 10VisualEditor, 10VisualEditor-MediaWiki-References, and 2 others: Register Citoid as a "friendly bot" (or alternatively verified bot) with Cloudflare - https://phabricator.wikimedia.org/T370118#10014742 (10akosiaris) p:05Triage→03Low Switching to low as all we can do now is wait. [14:41:11] 06serviceops, 13Patch-For-Review: deploy1003 implementation tracking - https://phabricator.wikimedia.org/T364417#10015018 (10akosiaris) Move to this server from deploy1002 scheduled for Monday 2024-07-29 09:00 UTC [14:59:19] 06serviceops: operations/docker-images/production-images contains references to non-existent image python3 - https://phabricator.wikimedia.org/T336682#10015124 (10hashar) 05Resolved→03Open >>! In T336682#10014067, @elukey wrote: > Quickly checked the current status since I'd like to drop the `python3` image... [16:07:25] 06serviceops, 10LPL Essential, 10MinT, 10Community Wishlist (Translations), 10Community-Tech (Ezo Red Fox (July 29 - Aug 9, 2024)): Caching service request for MinT - https://phabricator.wikimedia.org/T370755#10015440 (10JWheeler-WMF) [16:15:03] 06serviceops, 10Charts, 10Shellbox, 06SRE: Figure out how a shellbox instance for the Chart extension would work - https://phabricator.wikimedia.org/T370739#10015493 (10sbassett) @aude service-template-node is indeed quite dated and fairly unmaintained. And it would be difficult to recommend it for new pr... [16:25:21] 06serviceops, 10MW-on-K8s, 13Patch-For-Review: Move servers from the appserver/api cluster to kubernetes - https://phabricator.wikimedia.org/T351074#10015554 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.rename started by swfrench@cumin1002 from mw1364 to wikikube-worker1032 completed: - mw1364 (**PASS... [16:31:04] 06serviceops, 10MW-on-K8s: Move servers from the appserver/api cluster to kubernetes - https://phabricator.wikimedia.org/T351074#10015583 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by swfrench@cumin1002 for host wikikube-worker1032.eqiad.wmnet with OS bullseye [17:08:47] 06serviceops, 10MW-on-K8s: Move servers from the appserver/api cluster to kubernetes - https://phabricator.wikimedia.org/T351074#10015686 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by swfrench@cumin1002 for host wikikube-worker1032.eqiad.wmnet with OS bullseye completed: - wikikube-wor... [17:11:26] 06serviceops, 06DC-Ops, 10ops-eqiad, 10Prod-Kubernetes, 07Kubernetes: Relabel eqiad kubernetes nodes - https://phabricator.wikimedia.org/T371045 (10Scott_French) 03NEW [23:10:29] 06serviceops, 10Citoid, 10VisualEditor, 10VisualEditor-MediaWiki-References, and 2 others: Register Citoid as a "friendly bot" (or alternatively verified bot) with Cloudflare - https://phabricator.wikimedia.org/T370118#10016683 (10Novem_Linguae) There's only 18 bots on the list at https://radar.cloudflare....