[00:01:32] 06serviceops, 10Language-Technical Support, 06SRE, 10Wikimedia-Site-requests: Raise limit of $wgMaxArticleSize for Hebrew Wikisource - https://phabricator.wikimedia.org/T275319#9814750 (10Vladis13) >>! In T275319#9814384, @cscott wrote: > This discussion risks going in circles. As I wrote previously in T27... [05:08:17] 06serviceops, 10MediaWiki-extensions-General, 10MediaWiki-Internationalization, 10Wikimedia Foundation Governance Wiki (foundation.wikimedia.org), and 2 others: Update footer links to direct to proper locations on Foundation Governance Wiki - https://phabricator.wikimedia.org/T331680#9815041 (10Pppery) [08:41:27] 06serviceops, 10MW-on-K8s, 10Observability-Metrics, 13Patch-For-Review, 10SRE Observability (FY2023/2024-Q4): Create a per-release deployment of statsd-exporter for mw-on-k8s - https://phabricator.wikimedia.org/T365265#9815590 (10JMeybohm) I might be missing something obvious here, but I've two questions... [09:22:41] 06serviceops, 10Language-Technical Support, 06SRE, 10Wikimedia-Site-requests: Raise limit of $wgMaxArticleSize for Hebrew Wikisource - https://phabricator.wikimedia.org/T275319#9815721 (10Ladsgroup) Honestly, I think this should be declined as this is a [[https://en.wikipedia.org/wiki/XY_problem|x/y proble... [09:27:22] 06serviceops, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Migrate wikikube control planes to hardware nodes - https://phabricator.wikimedia.org/T353464#9815740 (10hnowlan) [09:30:40] 06serviceops: Sunset onhost memcached on mediawiki servers and puppet - https://phabricator.wikimedia.org/T345740#9815760 (10jijiki) 05Open→03Resolved [09:46:25] 06serviceops, 06DC-Ops, 10ops-eqiad, 06SRE: Q4:rack/setup/install kafka-main100[6789] and kafka-main1010 - https://phabricator.wikimedia.org/T363212#9815821 (10akosiaris) I 've managed to fix some issues I had with my partman recipe and after some unsuccessful reimages I have succeeded in the following: -... [09:50:48] 06serviceops, 06DC-Ops, 10ops-codfw, 06SRE: Q4:rack/setup/install kafka-main200[6789] & kafka-main2010 - https://phabricator.wikimedia.org/T363209#9815839 (10akosiaris) As an update, I had to reimage these servers as I had messed up the original recipe. [09:59:00] 06serviceops, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Migrate wikikube control planes to hardware nodes - https://phabricator.wikimedia.org/T353464#9815900 (10ops-monitoring-bot) cookbooks.sre.hosts.decommission executed by hnowlan@cumin1002 for hosts: `mw[2331,2361,2391].codfw.wmnet,mw[1372,1... [11:48:13] 06serviceops, 06SRE, 10Data Products (Data Products Sprint 13), 13Patch-For-Review, 07Service-deployment-requests: Commons Impact Metrics AQS 2.0 Deployment to Staging and Production - https://phabricator.wikimedia.org/T361835#9816231 (10mforns) Hi @Scott_French, We've had to do some refactoring of the w... [12:32:53] effie: I'm seeing "Function lookup() did not find a value for the name 'profile::openstack::eqiad1::cloudweb::memcached_user'" on cloudweb2002-dev. are you on that already or should I take a look? [12:33:25] and same for 'profile::idp::memcached::memcached_user' on cloudinfra-idp-1.cloudinfra.eqiad1.wikimedia.cloud [12:34:08] it seems like I forgot to add the key somewhere [13:02:27] 06serviceops, 10Language-Technical Support, 06SRE, 10Wikimedia-Site-requests: Raise limit of $wgMaxArticleSize for Hebrew Wikisource - https://phabricator.wikimedia.org/T275319#9816439 (10Tgr) Multi-page rendering wasn't implemented in the new PDF renderer because, well, PDF renderer memory requirements al... [13:17:25] 06serviceops: Upgrade memcache and memcached gutter pools to Bookworm - https://phabricator.wikimedia.org/T352891#9816480 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by jiji@cumin1002 for host mc-gp2003.codfw.wmnet with OS bookworm [13:30:42] 06serviceops, 06DC-Ops, 10ops-eqiad, 06SRE: Q4:rack/setup/install kafka-main100[6789] and kafka-main1010 - https://phabricator.wikimedia.org/T363212#9816500 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by jclark@cumin1002 for host kafka-main1009.eqiad.wmnet with OS bullseye [13:40:55] 06serviceops, 06Data-Persistence: Sessionstore's discovery TLS cert will expire before end of May 2024 - https://phabricator.wikimedia.org/T363996#9816535 (10Eevans) >>! In T363996#9794048, @hnowlan wrote: > Steps that I see: > - Renewing the existing cergen cert to give us breathing room just in case. We're... [13:55:03] 06serviceops, 06Data-Persistence: Sessionstore's discovery TLS cert will expire before end of May 2024 - https://phabricator.wikimedia.org/T363996#9816577 (10elukey) @Eevans IIUC that is the private key, it gets rendered in /etc/helmfile-defaults/private/main_services/sessionstore on deploy1002 and eventually... [13:56:08] 06serviceops: Upgrade memcache and memcached gutter pools to Bookworm - https://phabricator.wikimedia.org/T352891#9816584 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by jiji@cumin1002 for host mc-gp2003.codfw.wmnet with OS bookworm completed: - mc-gp2003 (**PASS**) - Downtimed on Icinga... [13:57:58] 06serviceops, 06Data-Persistence: Sessionstore's discovery TLS cert will expire before end of May 2024 - https://phabricator.wikimedia.org/T363996#9816587 (10elukey) >>! In T363996#9794048, @hnowlan wrote: > Steps that I see: > - Renewing the existing cergen cert to give us breathing room just in case. We're... [14:04:39] 06serviceops, 10MW-on-K8s, 06Traffic: Allow choosing datacentre in XWD - https://phabricator.wikimedia.org/T365478 (10jijiki) 03NEW [14:05:07] 06serviceops, 10MW-on-K8s, 06Traffic: XWD: Allow choosing datacentre in k8s-mwdebug - https://phabricator.wikimedia.org/T365478#9816613 (10jijiki) [14:05:30] 06serviceops, 10Prod-Kubernetes, 10Data-Platform-SRE (2024.05.06 - 2024.05.26), 07Kubernetes, 13Patch-For-Review: Allow to address Kubernetes API servers from NetworkPolicy - https://phabricator.wikimedia.org/T287491#9816624 (10klausman) [14:16:54] 06serviceops: Upgrade memcache and memcached gutter pools to Bookworm - https://phabricator.wikimedia.org/T352891#9816661 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by jiji@cumin1002 for host mc2055.codfw.wmnet with OS bookworm [14:33:18] 06serviceops, 10MW-on-K8s, 06Traffic: XWD: Allow choosing datacentre in k8s-mwdebug - https://phabricator.wikimedia.org/T365478#9816834 (10akosiaris) Suggestion LGTM, it will be helpful [14:33:50] 06serviceops, 06Machine-Learning-Team, 07Kubernetes: Allow Kubernetes workers to be deployed on Bookworm - https://phabricator.wikimedia.org/T365253#9816857 (10calbon) [14:33:59] 06serviceops, 06Machine-Learning-Team, 07Kubernetes: Allow Kubernetes workers to be deployed on Bookworm - https://phabricator.wikimedia.org/T365253#9816852 (10calbon) a:03elukey [14:48:49] 06serviceops, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Migrate wikikube control planes to hardware nodes - https://phabricator.wikimedia.org/T353464#9816973 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by hnowlan@cumin1002 for host wikikube-ctrl1001.eqiad.wmnet with O... [14:51:15] 06serviceops, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Migrate wikikube control planes to hardware nodes - https://phabricator.wikimedia.org/T353464#9816999 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by hnowlan@cumin1002 for host wikikube-ctrl1002.eqiad.wmnet with O... [14:51:19] 06serviceops, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Migrate wikikube control planes to hardware nodes - https://phabricator.wikimedia.org/T353464#9817000 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by hnowlan@cumin1002 for host wikikube-ctrl1003.eqiad.wmnet with O... [14:55:00] 06serviceops: Upgrade memcache and memcached gutter pools to Bookworm - https://phabricator.wikimedia.org/T352891#9817035 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by jiji@cumin1002 for host mc2055.codfw.wmnet with OS bookworm completed: - mc2055 (**PASS**) - Downtimed on Icinga/Alert... [14:58:48] 06serviceops, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Migrate wikikube control planes to hardware nodes - https://phabricator.wikimedia.org/T353464#9817086 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by hnowlan@cumin1002 for host wikikube-ctrl1001.eqiad.wmnet with OS bu... [14:59:08] 06serviceops, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Migrate wikikube control planes to hardware nodes - https://phabricator.wikimedia.org/T353464#9817088 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by hnowlan@cumin1002 for host wikikube-ctrl1001.eqiad.wmnet with O... [15:02:58] 06serviceops, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Migrate wikikube control planes to hardware nodes - https://phabricator.wikimedia.org/T353464#9817113 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by hnowlan@cumin1002 for host wikikube-ctrl1001.eqiad.wmnet with OS bu... [15:03:23] 06serviceops, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Migrate wikikube control planes to hardware nodes - https://phabricator.wikimedia.org/T353464#9817117 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by hnowlan@cumin1002 for host wikikube-ctrl1001.eqiad.wmnet with O... [15:10:49] 06serviceops, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Migrate wikikube control planes to hardware nodes - https://phabricator.wikimedia.org/T353464#9817195 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by hnowlan@cumin1002 for host wikikube-ctrl1001.eqiad.wmnet with OS bu... [15:10:54] 06serviceops, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Migrate wikikube control planes to hardware nodes - https://phabricator.wikimedia.org/T353464#9817196 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by hnowlan@cumin1002 for host wikikube-ctrl1003.eqiad.wmnet with OS bu... [15:11:04] 06serviceops, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Migrate wikikube control planes to hardware nodes - https://phabricator.wikimedia.org/T353464#9817197 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by hnowlan@cumin1002 for host wikikube-ctrl2003.codfw.wmnet with O... [15:11:07] 06serviceops, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Migrate wikikube control planes to hardware nodes - https://phabricator.wikimedia.org/T353464#9817198 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by hnowlan@cumin1002 for host wikikube-ctrl1002.eqiad.wmnet with OS bu... [15:15:35] 06serviceops, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Migrate wikikube control planes to hardware nodes - https://phabricator.wikimedia.org/T353464#9817245 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by hnowlan@cumin1002 for host wikikube-ctrl2001.codfw.wmnet with O... [15:33:24] 06serviceops, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Migrate wikikube control planes to hardware nodes - https://phabricator.wikimedia.org/T353464#9817399 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by hnowlan@cumin1002 for host wikikube-ctrl2002.codfw.wmnet with O... [15:34:44] 06serviceops, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Migrate wikikube control planes to hardware nodes - https://phabricator.wikimedia.org/T353464#9817417 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by hnowlan@cumin1002 for host wikikube-ctrl2003.codfw.wmnet with O... [15:52:19] 06serviceops, 07Kubernetes, 13Patch-For-Review: Fix rendering issue in modules.app.job when cronjobs are enabled and private values are defined - https://phabricator.wikimedia.org/T362954#9817459 (10Gehel) a:05brouberol→03None Removing DPE SRE from this. Decision on what to do needs to be taken outside o... [15:54:28] 06serviceops, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Migrate wikikube control planes to hardware nodes - https://phabricator.wikimedia.org/T353464#9817494 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by hnowlan@cumin1002 for host wikikube-ctrl2002.codfw.wmnet with OS bu... [15:54:44] 06serviceops, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Migrate wikikube control planes to hardware nodes - https://phabricator.wikimedia.org/T353464#9817503 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by hnowlan@cumin1002 for host wikikube-ctrl2001.codfw.wmnet with O... [15:56:06] 06serviceops, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Migrate wikikube control planes to hardware nodes - https://phabricator.wikimedia.org/T353464#9817529 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by hnowlan@cumin1002 for host wikikube-ctrl2002.codfw.wmnet with O... [15:56:32] 06serviceops, 06DC-Ops, 10Prod-Kubernetes, 07Kubernetes: update idrac firmware on wikicube-ctrl1001 - https://phabricator.wikimedia.org/T365499 (10RobH) 03NEW [15:57:49] 06serviceops, 06DC-Ops, 10Prod-Kubernetes, 07Kubernetes: update idrac firmware on wikikube-ctrl1001 - https://phabricator.wikimedia.org/T365499#9817555 (10RobH) a:05JMeybohm→03Papaul Papaul, My SSH/HTTPS Tunnel proxy addon is broken and I've yet to get it working properly again. Are you able to pull... [15:58:01] 06serviceops, 06DC-Ops, 10Prod-Kubernetes, 07Kubernetes: update idrac firmware on wikikube-ctrl1001 - https://phabricator.wikimedia.org/T365499#9817559 (10RobH) [16:05:03] 06serviceops, 06collaboration-services, 06Infrastructure-Foundations, 10Puppet-Core, and 5 others: Migrate roles to puppet7 - https://phabricator.wikimedia.org/T349619#9817621 (10MoritzMuehlenhoff) [16:17:18] 06serviceops, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Migrate wikikube control planes to hardware nodes - https://phabricator.wikimedia.org/T353464#9817708 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by hnowlan@cumin1002 for host wikikube-ctrl2002.codfw.wmnet with OS bu... [16:19:07] 06serviceops, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Migrate wikikube control planes to hardware nodes - https://phabricator.wikimedia.org/T353464#9817712 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by hnowlan@cumin1002 for host wikikube-ctrl2002.codfw.wmnet with O... [16:20:09] 06serviceops: Upgrade memcache and memcached gutter pools to Bookworm - https://phabricator.wikimedia.org/T352891#9817718 (10jijiki) [16:23:58] 06serviceops, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Migrate wikikube control planes to hardware nodes - https://phabricator.wikimedia.org/T353464#9817754 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by hnowlan@cumin1002 for host wikikube-ctrl1002.eqiad.wmnet with O... [16:31:06] 06serviceops, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Migrate wikikube control planes to hardware nodes - https://phabricator.wikimedia.org/T353464#9817801 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by hnowlan@cumin1002 for host wikikube-ctrl1001.eqiad.wmnet with O... [16:31:08] 06serviceops, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Migrate wikikube control planes to hardware nodes - https://phabricator.wikimedia.org/T353464#9817802 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by hnowlan@cumin1002 for host wikikube-ctrl1003.eqiad.wmnet with O... [16:34:20] 06serviceops, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Migrate wikikube control planes to hardware nodes - https://phabricator.wikimedia.org/T353464#9817813 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by hnowlan@cumin1002 for host wikikube-ctrl2001.codfw.wmnet with OS bu... [16:36:12] 06serviceops, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Migrate wikikube control planes to hardware nodes - https://phabricator.wikimedia.org/T353464#9817816 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by hnowlan@cumin1002 for host wikikube-ctrl2003.codfw.wmnet with OS bu... [16:40:14] 06serviceops, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Migrate wikikube control planes to hardware nodes - https://phabricator.wikimedia.org/T353464#9817825 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by hnowlan@cumin1002 for host wikikube-ctrl2002.codfw.wmnet with OS bu... [16:40:35] 06serviceops, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Migrate wikikube control planes to hardware nodes - https://phabricator.wikimedia.org/T353464#9817827 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by hnowlan@cumin1002 for host wikikube-ctrl2002.codfw.wmnet with O... [16:43:51] 06serviceops, 10MW-on-K8s, 06SRE, 06Traffic, and 2 others: Rename X-Wikimedia-Debug k8s-experimental option - https://phabricator.wikimedia.org/T362662#9817838 (10Jdforrester-WMF) [16:43:55] 06serviceops, 10MW-on-K8s, 06SRE, 06Traffic, and 2 others: Rename X-Wikimedia-Debug k8s-experimental option - https://phabricator.wikimedia.org/T362662#9817839 (10Jdforrester-WMF) a:03Jdforrester-WMF [16:44:03] 06serviceops, 10MW-on-K8s, 06SRE, 06Traffic, and 2 others: Rename X-Wikimedia-Debug k8s-experimental option - https://phabricator.wikimedia.org/T362662#9817841 (10Jdforrester-WMF) 05Open→03In progress [16:46:45] 06serviceops, 10MW-on-K8s, 06Quality-and-Test-Engineering-Team, 06SRE: Move testwiki over to mw-on-k8s - https://phabricator.wikimedia.org/T355534#9817845 (10Jdforrester-WMF) I guess that we should now do this, regardless of people's thoughts back in January as to what metric we should use; we've now passe... [17:09:22] 06serviceops, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Migrate wikikube control planes to hardware nodes - https://phabricator.wikimedia.org/T353464#9817933 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by hnowlan@cumin1002 for host wikikube-ctrl2002.codfw.wmnet with OS bu... [17:09:36] 06serviceops, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Migrate wikikube control planes to hardware nodes - https://phabricator.wikimedia.org/T353464#9817935 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by hnowlan@cumin1002 for host wikikube-ctrl2002.codfw.wmnet with O... [17:23:38] 06serviceops, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Migrate wikikube control planes to hardware nodes - https://phabricator.wikimedia.org/T353464#9818033 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by hnowlan@cumin1002 for host wikikube-ctrl1001.eqiad.wmnet with OS bu... [17:24:52] 06serviceops, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Migrate wikikube control planes to hardware nodes - https://phabricator.wikimedia.org/T353464#9818047 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by hnowlan@cumin1002 for host wikikube-ctrl2002.codfw.wmnet with OS bu... [17:25:15] 06serviceops, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Migrate wikikube control planes to hardware nodes - https://phabricator.wikimedia.org/T353464#9818057 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by hnowlan@cumin1002 for host wikikube-ctrl2002.codfw.wmnet with O... [18:01:29] 06serviceops, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Migrate wikikube control planes to hardware nodes - https://phabricator.wikimedia.org/T353464#9818330 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by hnowlan@cumin1002 for host wikikube-ctrl1002.eqiad.wmnet with OS bu... [18:03:10] 06serviceops, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Migrate wikikube control planes to hardware nodes - https://phabricator.wikimedia.org/T353464#9818335 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by hnowlan@cumin1002 for host wikikube-ctrl2002.codfw.wmnet with OS bu... [18:04:55] 06serviceops, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Migrate wikikube control planes to hardware nodes - https://phabricator.wikimedia.org/T353464#9818339 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by hnowlan@cumin1002 for host wikikube-ctrl1001.eqiad.wmnet with O... [18:14:42] 06serviceops, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Migrate wikikube control planes to hardware nodes - https://phabricator.wikimedia.org/T353464#9818391 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by hnowlan@cumin1002 for host wikikube-ctrl1003.eqiad.wmnet with OS bu... [18:24:39] 06serviceops, 06SRE, 10Data Products (Data Products Sprint 13), 13Patch-For-Review, 07Service-deployment-requests: Commons Impact Metrics AQS 2.0 Deployment to Staging and Production - https://phabricator.wikimedia.org/T361835#9818433 (10Scott_French) Great, thanks for letting me know, @mforns. [18:32:25] 06serviceops, 06SRE, 10Data Products (Data Products Sprint 13), 13Patch-For-Review, 07Service-deployment-requests: Commons Impact Metrics AQS 2.0 Deployment to Staging and Production - https://phabricator.wikimedia.org/T361835#9818458 (10Scott_French) [18:39:23] 06serviceops, 10Prod-Kubernetes, 07Kubernetes, 13Patch-For-Review: Migrate wikikube control planes to hardware nodes - https://phabricator.wikimedia.org/T353464#9818487 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by hnowlan@cumin1002 for host wikikube-ctrl1001.eqiad.wmnet with OS bu... [19:58:06] 06serviceops, 06DC-Ops, 10Prod-Kubernetes, 07Kubernetes: update idrac firmware on wikikube-ctrl1001 - https://phabricator.wikimedia.org/T365499#9818794 (10Papaul) Ok Will work on it. [20:04:27] 06serviceops, 10Language-Technical Support, 06SRE, 10Wikimedia-Site-requests: Raise limit of $wgMaxArticleSize for Hebrew Wikisource - https://phabricator.wikimedia.org/T275319#9818815 (10Fuzzy) I've compiled a table detailing some of the largest legislative texts found on Hebrew Wikisource. Before drawing... [21:08:55] 06serviceops, 10Language-Technical Support, 06SRE, 10Wikimedia-Site-requests: Raise limit of $wgMaxArticleSize for Hebrew Wikisource - https://phabricator.wikimedia.org/T275319#9819103 (10cscott) @Fuzzy you may be interested in {T254522}, which will eventually replace the limits in the legacy parser. Appr... [21:13:03] 06serviceops, 06DC-Ops, 10Prod-Kubernetes, 07Kubernetes: update idrac firmware on wikikube-ctrl1001 - https://phabricator.wikimedia.org/T365499#9819110 (10Papaul) a:05Papaul→03RobH complete [21:33:02] 06serviceops, 10Language-Technical Support, 06SRE, 10Wikimedia-Site-requests: Raise limit of $wgMaxArticleSize for Hebrew Wikisource - https://phabricator.wikimedia.org/T275319#9819156 (10neriah) Agree with @Fuzzy's suggestion above. >>! In T275319#9813641, @Fuzzy wrote: > However, I suggested a straightfo... [22:17:26] 06serviceops, 10Language-Technical Support, 06SRE, 10Wikimedia-Site-requests: Raise limit of $wgMaxArticleSize for Hebrew Wikisource - https://phabricator.wikimedia.org/T275319#9819230 (10Fuzzy) >>! In T275319#9819103, @cscott wrote: > [...] Appropriate metrics are not easy to find, because ideally they mu...