[09:54:44] 10serviceops, 10MW-on-K8s, 10SRE: Evaluate nginx-controller as an Ingress - https://phabricator.wikimedia.org/T286197 (10Joe) 05Open→03Resolved p:05Triage→03Medium a:03Joe We went with istio-ingress after some evaluation which wasn't reported here. [09:54:50] 10serviceops, 10MW-on-K8s, 10SRE: Create a gateway in kubernetes for the execution of our "lambdas" - https://phabricator.wikimedia.org/T261277 (10Joe) [10:26:06] FYI, mwdebug2001 is depooled, but seems like an oversight, nothing in SAL etc. going to repool it for consistency's sake [10:50:33] 10serviceops, 10Release-Engineering-Team, 10Scap: Deploy Scap version 4.2.2 - https://phabricator.wikimedia.org/T300392 (10Jelto) p:05Triage→03Medium a:03Jelto [12:22:25] 10serviceops, 10Prod-Kubernetes, 10Kubernetes: Migrate from command line flags to config files for kubernetes components - https://phabricator.wikimedia.org/T300499 (10JMeybohm) [12:33:51] 10serviceops, 10Prod-Kubernetes, 10Kubernetes: Kubernetes services with externalTrafficPolicy: Local don't work - https://phabricator.wikimedia.org/T300500 (10JMeybohm) p:05Triage→03Medium [12:35:15] 10serviceops, 10Prod-Kubernetes, 10Kubernetes: Kubernetes services with externalTrafficPolicy: Local don't work - https://phabricator.wikimedia.org/T300500 (10JMeybohm) [13:10:22] 10serviceops, 10Beta-Cluster-Infrastructure, 10SRE, 10Wikidata, and 2 others: Run mediawiki::maintenance scripts in Beta Cluster - https://phabricator.wikimedia.org/T125976 (10Ladsgroup) [13:43:00] 10serviceops, 10Observability-Metrics, 10Performance-Team (Radar): Enable mediawiki appserver metrics for jobrunner hosts - https://phabricator.wikimedia.org/T293943 (10lmata) [13:43:19] 10serviceops, 10Observability-Metrics, 10SRE, 10Patch-For-Review: Strongswan Icinga check: do not report issues about depooled hosts - https://phabricator.wikimedia.org/T148976 (10lmata) [13:48:07] 10serviceops, 10Icinga, 10Observability-Alerting, 10SRE, and 2 others: incident 20170323-wikibase did not trigger Icinga paging - https://phabricator.wikimedia.org/T161528 (10lmata) [14:37:58] hi all, is this the right place for kubernetes deployments / helmfile deployment-charts questions? :) [15:06:58] (resolved, see -operations) [15:14:19] 10serviceops, 10Release-Engineering-Team, 10Scap: Deploy Scap version 4.2.2 - https://phabricator.wikimedia.org/T300392 (10hnowlan) [15:14:22] 10serviceops, 10Release-Engineering-Team, 10Scap: Deploy Scap version 4.2.1 - https://phabricator.wikimedia.org/T300058 (10hnowlan) [18:54:21] 10serviceops, 10Performance-Team, 10SRE, 10Traffic: Decide on details of progressive Multi-DC roll out - https://phabricator.wikimedia.org/T279664 (10Krinkle) a:05Krinkle→03None [20:02:43] 10serviceops: create bullseye VM for Etherpad upgrade - https://phabricator.wikimedia.org/T300568 (10Dzahn) [20:03:07] 10serviceops, 10Wikimedia-Etherpad: create bullseye VM for Etherpad upgrade - https://phabricator.wikimedia.org/T300568 (10Dzahn) 05Open→03In progress p:05Triage→03Medium [20:05:45] 10serviceops, 10Wikimedia-Etherpad: create bullseye VM for Etherpad upgrade - https://phabricator.wikimedia.org/T300568 (10Dzahn) [20:12:43] 10serviceops, 10Wikimedia-Etherpad: create bullseye VM for Etherpad upgrade - https://phabricator.wikimedia.org/T300568 (10Dzahn) [20:40:33] 10serviceops, 10Wikimedia-Etherpad: create bullseye VM for Etherpad upgrade - https://phabricator.wikimedia.org/T300568 (10Dzahn) ` dzahn@cumin1001:~$ sudo cookbook sre.ganeti.makevm --vcpus 1 --memory 1 --disk 15 --network private eqiad_C etherpad1003 Ready to create Ganeti VM etherpad1003.eqiad.wmnet in the... [20:41:49] 10serviceops, 10SRE, 10Wikimedia-Etherpad, 10vm-requests: create bullseye VM for Etherpad upgrade - https://phabricator.wikimedia.org/T300568 (10Dzahn) [21:12:17] 10serviceops, 10SRE, 10Patch-For-Review: Remove mediawiki::packages::fonts from non thumbor servers - https://phabricator.wikimedia.org/T294378 (10Dzahn) @Joe The one package I was talking about is "ttf-bitstream-vera" which gets installed when you remove "fonts-dejacu-core*" and since I did "--purge fonts*"... [21:23:52] 10serviceops, 10SRE, 10Wikimedia-Etherpad, 10vm-requests, 10Patch-For-Review: create bullseye VM for Etherpad upgrade (and upgrade it:) - https://phabricator.wikimedia.org/T300568 (10Dzahn) [21:25:34] 10serviceops, 10SRE, 10Wikimedia-Etherpad, 10vm-requests, 10Patch-For-Review: create bullseye VM for Etherpad upgrade (and upgrade it:) - https://phabricator.wikimedia.org/T300568 (10Dzahn) a:05Dzahn→03None [21:28:11] 10serviceops, 10SRE, 10Wikimedia-Etherpad, 10vm-requests, 10Patch-For-Review: create bullseye VM for Etherpad upgrade (and upgrade it:) - https://phabricator.wikimedia.org/T300568 (10Dzahn) [21:35:16] 10serviceops, 10SRE, 10Wikimedia-Etherpad, 10vm-requests: create bullseye VM for Etherpad upgrade (and upgrade it:) - https://phabricator.wikimedia.org/T300568 (10Dzahn) [21:41:43] 10serviceops, 10SRE, 10Wikimedia-Etherpad, 10vm-requests: create bullseye VM for Etherpad upgrade (and upgrade it:) - https://phabricator.wikimedia.org/T300568 (10Dzahn) @akosiaris Looking at the old ticket when we upgraded to buster, I don't want to repeat the mistake and run Etherpad on 2 servers at a... [22:33:59] 10serviceops, 10Prod-Kubernetes, 10Kubernetes: Run helm test after deploy - https://phabricator.wikimedia.org/T276949 (10dduvall) >>! In T276949#7659528, @Jelto wrote: > I implemented this annotation change while removing deprecated `helm2` annotations in https://gerrit.wikimedia.org/r/757877. This change do...