[01:41:57] 10serviceops, 10Release-Engineering-Team, 10Scap: Deploy Scap version 4.3.1 - https://phabricator.wikimedia.org/T301307 (10dancy) [08:01:55] good morning folks [08:02:06] I filed a proposal for k8s bullseye apt components: https://gerrit.wikimedia.org/r/c/operations/puppet/+/761275 [08:02:21] (basically moving away from the -future suffix gradually, lemme know your thoughts) [08:58:09] left a comment already, LGTM [09:12:15] thanks!! [09:12:51] akosiaris: I was wondering with Janis what's best to do for calico/k8s go-based packages - is it ok to copy them over to wikimedia-bullseye, or do we prefer to rebuild? [09:13:54] 10serviceops, 10Release-Engineering-Team, 10Scap: Deploy Scap version 4.3.1 - https://phabricator.wikimedia.org/T301307 (10Jelto) 05Open→03In progress p:05Triage→03High a:03Jelto [09:17:19] elukey: copy them over I guess? A) reprepro won't allow you to upload the exact same version of the package to a different distribution B) copying over should work, golang are statically compiled anyway [09:19:10] akosiaris: I always forget about A) yes, the packages would need something like +deb11u1 or similar [09:20:27] yeah, that would make the git repo maintainership more complicated if we want to properly support multiple versions of the distribution [09:21:54] it's probably not worth it I 'd say [09:24:37] I opt for copy as well [09:32:14] ack then I'll build only the rsyslog package (since it needs mmkubernetes etc..) [10:28:36] 10serviceops, 10Release-Engineering-Team, 10Scap: Deploy Scap version 4.3.1 - https://phabricator.wikimedia.org/T301307 (10Jelto) scap was updated to `4.3.1` on canary machines (`A:mw-canary or A:parsoid-canary or A:mw-jobrunner-canary or A:restbase-canary`) and test were ok. I'll proceed with all other mac... [11:41:19] 10serviceops, 10SRE, 10GitLab (Infrastructure): gitlab: enable IPv6 for https - https://phabricator.wikimedia.org/T300816 (10Jelto) 05In progress→03Resolved `gitlab.wikimedia.org` and `gitlab-replica.wikimedia.org` can be reached over IPv6 now! ` $ curl -s -I -6 https://gitlab.wikimedia.org/explore | gr... [11:48:16] <_joe_> copy works as long as the build was done with CGO=0 IIRC [11:48:32] <_joe_> and ofc if you don't have c bindings [11:48:58] <_joe_> anyways, you'll know as soon as you try to run it :) [11:53:35] <_joe_> elukey: I had quite a few comments on that patch [11:53:46] <_joe_> but well, I agree with the general direction [11:53:58] <_joe_> and mine was more a comment on that $packages_from_future variable [11:54:06] <_joe_> we should just get rid of it? [12:42:00] _joe_ yes yes for sure, I just wanted to start with a first pass that could unblock testing [12:42:14] Janis added a similar comment [12:44:38] anything else that you wanted to comment/fix? [13:12:49] <_joe_> nah just that [13:16:31] perfect, I am going to rebuild bullseye's rsyslog with the mmkubernetes stuff and upload it to the component [13:16:45] will try to copy calico and k8s packages as well [13:16:57] and then I'll do a first clean up if it is easy [13:18:44] <_joe_> daje [13:43:19] 10serviceops, 10Prod-Kubernetes, 10Pybal, 10Kubernetes, 10Patch-For-Review: Have PyBal monitor Istio-Ingressgateway health - https://phabricator.wikimedia.org/T301137 (10JMeybohm) [13:55:05] 10serviceops, 10Release-Engineering-Team, 10Scap: Deploy Scap version 4.3.1 - https://phabricator.wikimedia.org/T301307 (10Jelto) 05In progress→03Resolved scap `4.3.1` is deployed on all machines. I'm closing this task. [14:26:46] 10serviceops, 10Prod-Kubernetes, 10Pybal, 10Kubernetes, 10Patch-For-Review: Have PyBal monitor Istio-Ingressgateway health - https://phabricator.wikimedia.org/T301137 (10JMeybohm) [14:27:07] 10serviceops, 10Prod-Kubernetes, 10Pybal, 10Kubernetes, 10Patch-For-Review: Have PyBal monitor Istio-Ingressgateway health - https://phabricator.wikimedia.org/T301137 (10JMeybohm) [14:28:03] 10serviceops, 10Prod-Kubernetes, 10Pybal, 10Kubernetes, 10Patch-For-Review: Have PyBal monitor Istio-Ingressgateway health - https://phabricator.wikimedia.org/T301137 (10JMeybohm) [14:35:57] 10serviceops, 10Prod-Kubernetes, 10Pybal, 10Kubernetes, 10Patch-For-Review: Have PyBal monitor Istio-Ingressgateway health - https://phabricator.wikimedia.org/T301137 (10JMeybohm) [15:37:52] 10serviceops, 10Data-Persistence (Consultation), 10MediaWiki-Parser, 10Parsoid (Tracking): CAPEX for ParserCache for Parsoid - https://phabricator.wikimedia.org/T263587 (10Pchelolo) 05Open→03Resolved a:03Pchelolo ParserCache has been expanded under a separate project. This ticket is obsolete. [16:29:01] 10serviceops, 10Release-Engineering-Team, 10Scap: Deploy Scap version 4.3.1 - https://phabricator.wikimedia.org/T301307 (10dancy) Thanks @Jelto ! [17:00:36] 10serviceops, 10SRE, 10GitLab (Infrastructure): gitlab: enable IPv6 for https - https://phabricator.wikimedia.org/T300816 (10Dzahn) confirmed working: ` nmap -6 gitlab.wikimedia.org -p 443 .. PORT STATE SERVICE 443/tcp open https ` and also A+ now on https://www.ssllabs.com/ssltest/analyze.html?d=git... [17:19:16] 10serviceops, 10Prod-Kubernetes, 10Pybal, 10Kubernetes: Have PyBal monitor Istio-Ingressgateway health - https://phabricator.wikimedia.org/T301137 (10JMeybohm) 05Open→03Declined [17:19:20] 10serviceops, 10Prod-Kubernetes, 10Kubernetes, 10Patch-For-Review: Implement POC for istio ingress - https://phabricator.wikimedia.org/T290966 (10JMeybohm) [17:55:47] 10serviceops, 10MW-on-K8s, 10SRE, 10Release-Engineering-Team (Done by Feb 23🔥): Make scap deploy to kubernetes together with the legacy systems - https://phabricator.wikimedia.org/T299648 (10thcipriani) [17:56:35] 10serviceops, 10MW-on-K8s, 10SRE, 10Release-Engineering-Team (Done by Feb 23🔥): Make scap deploy to kubernetes together with the legacy systems - https://phabricator.wikimedia.org/T299648 (10thcipriani) [17:59:55] 10serviceops, 10MW-on-K8s, 10Release-Engineering-Team (Done by Feb 23🔥): Build MediaWiki images for kubernetes on the deployment servers - https://phabricator.wikimedia.org/T297673 (10thcipriani) [19:52:27] 10serviceops, 10Deployments, 10Patch-For-Review, 10Release-Engineering-Team (Radar), and 2 others: Remove provisioning for 'mwscript', 'foreachwikiindblist' etc from deployment host - https://phabricator.wikimedia.org/T253822 (10dancy) [20:16:56] 10serviceops, 10DC-Ops, 10SRE, 10ops-eqiad: Q3:(Need By: TBD) rack/setup/install parse100[01-24] - https://phabricator.wikimedia.org/T299573 (10Jclark-ctr) [22:26:36] 10serviceops, 10SRE, 10observability: basic prometheus monitoring for PoolCounter - https://phabricator.wikimedia.org/T237407 (10RLazarus) 05Open→03Resolved [22:51:30] I spent most of my day trying to get etherpad-lite package to build.. and I finally got it work. It was soooo frustrating though. And I blame upstream. [22:52:29] Guess what the fix was? untar the upstream orig.tarball and run "dos2unix" on 2 files that had CRLF in them... fix that so they are LF and match with our own repo... before it would always break because "unexpected upstream changes" ... and that is because somebody touched those files with Windows or whatever [22:52:40] oh no [22:53:25] so first I tried to make upstream tarball and our repo match by actually adding the CRLF in our repo in Gerrit.. so I would not have to "hack" the orig tarball [22:53:51] that led me to a rabbit hole about stopping git from autoconverting CRLF.. it did not listen to my config [22:54:14] and I still could not get to upload that as a change to Gerrit after fixing autoconversions.. [22:54:30] anyways.. then I decided to fix the other part and now I get a .deb :) [22:55:06] what a mess, glad you got there [23:38:25] Now I have the .deb and .changes but I can't import it in apt1001. File "pool/main/e/etherpad-lite/etherpad-lite_1.8.16.orig.tar.gz" is already registered with different checksums! [23:38:29] :/ [23:46:31] used "reprepro removesrc" to delete existing source package, manually uploaded my fixed orig.tar.gz, imported. simulated install on etherpad1003 works :) yay.