[09:31:56] 06serviceops, 06MediaWiki-Platform-Team: Migrate "startupregistrystats" maintenance script to k8s-mw-cron (mediawiki-platform-team) - https://phabricator.wikimedia.org/T388540#10779589 (10fgiunchedi) Thank you for the heads up @andrea.denisse, please see https://phabricator.wikimedia.org/T228380#10774463 f... [10:35:44] 06serviceops, 10Observability-Metrics, 10SRE Observability (FY2024/2025-Q4): Repeated library panels in Grafana showing only after refresh, not on first load - https://phabricator.wikimedia.org/T384831#10779755 (10jijiki) Pretty Neat! Thank you! [10:47:30] 06serviceops, 10MediaWiki-Special-pages, 13Patch-For-Review: Migrate updatequerypages/update_special_pages/initsitestats jobs to mw-cron - https://phabricator.wikimedia.org/T388534#10779800 (10hnowlan) [11:23:09] 06serviceops, 10MediaWiki-Special-pages, 13Patch-For-Review: Migrate updatequerypages/update_special_pages/initsitestats jobs to mw-cron - https://phabricator.wikimedia.org/T388534#10779884 (10hnowlan) Thank you for the criticality updates! With the resolution of T392441 it seems like the deadendpages jobs a... [11:27:39] 06serviceops, 06collaboration-services, 06Data-Platform-SRE, 10Prod-Kubernetes, and 2 others: Fix alternatives entries in helm and kubernetes-client packages - https://phabricator.wikimedia.org/T387548#10779900 (10Jelto) With the new versions of `helm311` and `helm317` this should be fixed now. I tested th... [14:10:38] 06serviceops, 10MW-on-K8s, 06Trust and Safety Product Team, 10MediaModeration (MediaModeration 2.1), 13Patch-For-Review: Migrate MediaModeration jobs to mw-cron - https://phabricator.wikimedia.org/T385799#10780497 (10hnowlan) hourlyScan is running in Kubernetes at the moment - output makes it look like i... [14:13:43] 06serviceops, 10MW-on-K8s, 06Trust and Safety Product Team, 10MediaModeration (MediaModeration 2.1), 13Patch-For-Review: Migrate MediaModeration jobs to mw-cron - https://phabricator.wikimedia.org/T385799#10780509 (10hnowlan) [14:14:04] 06serviceops, 10MediaWiki-Special-pages, 13Patch-For-Review: Migrate updatequerypages/update_special_pages/initsitestats jobs to mw-cron - https://phabricator.wikimedia.org/T388534#10780510 (10hnowlan) [14:31:44] 06serviceops, 06DC-Ops, 10ops-codfw: Q4:rack/setup/install build2003.codfw.wmnet - https://phabricator.wikimedia.org/T393015 (10RobH) 03NEW [14:32:15] 06serviceops, 06DC-Ops, 10ops-codfw: Q4:rack/setup/install build2003.codfw.wmnet - https://phabricator.wikimedia.org/T393015#10780630 (10RobH) [14:37:04] 06serviceops, 10MW-on-K8s, 06Trust and Safety Product Team, 10MediaModeration (MediaModeration 2.1): Migrate MediaModeration jobs to mw-cron - https://phabricator.wikimedia.org/T385799#10780652 (10Dreamy_Jazz) >>! In T385799#10780497, @hnowlan wrote: > hourlyScan is running in Kubernetes at the moment - ou... [15:42:29] 06serviceops, 10MediaWiki-Page-derived-data: Migrate MediaWiki-Page-derived-data jobs to mw-cron - https://phabricator.wikimedia.org/T388530#10780910 (10hashar) Hi, I am pretty sure nobody knows about those jobs anymore. The cronjobs were added to Puppet by @dzahn back in 2012 with https://gerrit.wikimedia.or... [16:52:15] 06serviceops, 10MediaWiki-Page-derived-data: Migrate MediaWiki-Page-derived-data jobs to mw-cron - https://phabricator.wikimedia.org/T388530#10781326 (10Dzahn) >>! In T388530#10780909, @hashar wrote: > Hi, I am pretty sure nobody knows about those jobs anymore. > > The cronjobs were added to Puppet by @dzahn... [18:53:34] 06serviceops, 06Commons, 10Shellbox, 10TimedMediaHandler-Transcode, and 2 others: Videos intermittently failing to transcode with error "Exception: Shellbox server returned status code 503" - https://phabricator.wikimedia.org/T385365#10781789 (10Krinkle) >>! In T385365#10522173, @hnowlan wrote: > Unfortuna... [19:22:13] 06serviceops, 06collaboration-services, 06Infrastructure-Foundations, 06SRE, 10SRE-tools: Create a cookbook to automate gerrit's switchover - https://phabricator.wikimedia.org/T260666#10781850 (10ABran-WMF) [20:10:01] 06serviceops, 10MediaWiki-Page-derived-data: Migrate MediaWiki-Page-derived-data jobs to mw-cron - https://phabricator.wikimedia.org/T388530#10781947 (10Peachey88) //Note: Any BZ tasks you can add +2000 to get the phab task {T18112}// [20:43:45] 06serviceops, 06DC-Ops, 10ops-codfw: Q4:rack/setup/install (4) aux-k8 in codfw - https://phabricator.wikimedia.org/T393053 (10RobH) 03NEW [20:45:37] 06serviceops, 06DC-Ops, 10ops-codfw: Q4:rack/setup/install (4) aux-k8 in codfw - https://phabricator.wikimedia.org/T393053#10782038 (10RobH) a:03akosiaris Alex, We didn't get racking details on the ordering task T392715, so we need to get them from you before the hosts arrive. Please populate the task de... [20:45:40] 06serviceops, 06DC-Ops, 10ops-codfw: Q4:rack/setup/install (4) aux-k8 in codfw - https://phabricator.wikimedia.org/T393053#10782042 (10RobH) [20:52:29] 06serviceops, 06DC-Ops, 10ops-eqiad: Q4:rack/setup/install (4) aux-k8 in ops-eqiad - https://phabricator.wikimedia.org/T393053#10782066 (10RobH) [20:53:15] 06serviceops, 06DC-Ops, 10ops-codfw: Q4:rack/setup/install (4) aux-k8 in ops-codfw - https://phabricator.wikimedia.org/T393054 (10RobH) 03NEW [20:53:19] 06serviceops, 06DC-Ops, 10ops-codfw: Q4:rack/setup/install (4) aux-k8 in ops-codfw - https://phabricator.wikimedia.org/T393054#10782084 (10RobH) [20:53:57] 06serviceops, 06DC-Ops, 10ops-codfw: Q4:rack/setup/install (4) aux-k8 in ops-codfw - https://phabricator.wikimedia.org/T393054#10782085 (10RobH) a:03akosiaris Alex, We didn't get racking details on the ordering task T392714, so we need to get them from you before the hosts arrive. Please populate the tas...