[01:05:18] 10serviceops, 10DC-Ops, 10SRE, 10ops-codfw, 10Kubernetes: (Need By: TBD) rack/setup/install kubernetes20[19|2(012)] - https://phabricator.wikimedia.org/T299470 (10Papaul) [06:59:35] 10serviceops, 10DC-Ops, 10SRE, 10ops-codfw, 10Kubernetes: (Need By: TBD) rack/setup/install kubernetes20[19|2(012)] - https://phabricator.wikimedia.org/T299470 (10elukey) [07:00:47] 10serviceops, 10DC-Ops, 10SRE, 10ops-codfw, 10Kubernetes: (Need By: TBD) rack/setup/install kubernetes20[19|2(012)] - https://phabricator.wikimedia.org/T299470 (10elukey) @papaul we are moving all the kubernetes hosts to Bullseye, I modified the task's description with this info + partitioning. Thanks! [08:20:53] hello folks, kubestage2001 seems good [08:21:11] I deleted some pods running on 2002 to force their scheduling on 2001, all good afaics [09:31:31] elukey: nice work! Sorry, I totally forgot about dragonfly :/ [09:31:51] I did roll restart a bunch of stuff to put more load on kubestage2001 now [10:24:14] 10serviceops, 10Performance-Team (Radar): Migrate WMF Production from PHP 7.2 to PHP 7.4 - https://phabricator.wikimedia.org/T271736 (10kostajh) >>! In T271736#7371074, @Joe wrote: > We've talked about this in the serviceops meeting, and we agreed that we will take on upgrading to php 7.4 next quarter, but onl... [10:57:45] 10serviceops, 10Performance-Team (Radar): Migrate WMF production from PHP 7.2 to PHP 7.4 - https://phabricator.wikimedia.org/T271736 (10Krinkle) [11:02:25] elukey: kubestage2001 metrics seem solid! I'd say we can continue with kubestage1004 anytime. service deployments don't happen to staging-codfw usually - not really expecting anything, but ofc. there could be something hiding [16:42:28] 10serviceops, 10Scap: Set scap minimum version to 3.7 - https://phabricator.wikimedia.org/T302086 (10dancy) [16:43:21] 10serviceops, 10Scap: Set scap minimum version to 3.7 - https://phabricator.wikimedia.org/T302086 (10dancy) @JMeybohm or @Jelto, can you use cumin to run "python3 -V" on production hosts that have scap installed? [16:43:50] 10serviceops, 10Release-Engineering-Team, 10Scap: Set scap minimum version to 3.7 - https://phabricator.wikimedia.org/T302086 (10dancy) [16:53:37] 10serviceops, 10Release-Engineering-Team, 10Scap: Set scap minimum version to 3.7 - https://phabricator.wikimedia.org/T302086 (10MoritzMuehlenhoff) There's still quite a few Stretch systems with scap in production: ` ===== NODE GROUP ===== (46) aqs[1004-1009].eqiad.wmnet,doc1001.eqiad.wmnet,ores[2001-2009]... [16:55:12] 10serviceops, 10Release-Engineering-Team, 10Scap: Set scap minimum version to 3.7 - https://phabricator.wikimedia.org/T302086 (10dancy) Thanks @MoritzMuehlenhoff. Can you point me to an existing "upgrade Stretch hosts" task that I can hang this one off of? [17:01:55] 10serviceops, 10Release-Engineering-Team, 10Scap: Set scap minimum version to 3.7 - https://phabricator.wikimedia.org/T302086 (10MoritzMuehlenhoff) >>! In T302086#7721573, @dancy wrote: > Thanks @MoritzMuehlenhoff. Can you point me to an existing "upgrade Stretch hosts" task that I can hang this one off of?... [17:02:52] 10serviceops, 10Release-Engineering-Team, 10Scap: Set scap minimum version to 3.7 - https://phabricator.wikimedia.org/T302086 (10dancy) [19:04:29] 10serviceops, 10Release-Engineering-Team, 10Scap: Set scap minimum version to 3.7 - https://phabricator.wikimedia.org/T302086 (10Majavah) [19:04:42] 10serviceops, 10Release-Engineering-Team, 10Scap: Set scap minimum version to 3.7 - https://phabricator.wikimedia.org/T302086 (10Majavah) [23:13:34] 10serviceops, 10Product-Infrastructure-Team-Backlog, 10SRE, 10Maps (Geoshapes), and 2 others: New Service Request geoshapes - https://phabricator.wikimedia.org/T274388 (10MSantos) @akosiaris and @jijiki how can we move forward with this? For context: - [[ https://gerrit.wikimedia.org/r/plugins/gitiles/op... [23:36:44] 10serviceops, 10DC-Ops, 10SRE, 10ops-codfw, 10Kubernetes: (Need By: TBD) rack/setup/install kubernetes20[19|2(012)] - https://phabricator.wikimedia.org/T299470 (10Papaul) Thanks [23:47:52] 10serviceops, 10DC-Ops, 10SRE, 10ops-codfw, and 2 others: (Need By: TBD) rack/setup/install kubernetes20[19|2(012)] - https://phabricator.wikimedia.org/T299470 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by pt1979@cumin2002 for host kubernetes2019.codfw.wmnet with OS bullseye