[08:12:49] 10serviceops, 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Yak Shaving 🐃🪒): contint1001 and contint2001 need a newer version of Docker installed - https://phabricator.wikimedia.org/T300682 (10MoritzMuehlenhoff) >>! In T300682#7715571, @dduvall wrote: > @Muehlenhoff for some reason, it... [08:26:17] 10serviceops: PHP Notice: Constant PHP_VERSION already defined in /var/www/php-monitoring/lib.php on line 4 - https://phabricator.wikimedia.org/T301945 (10hashar) [08:37:39] 10serviceops, 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Yak Shaving 🐃🪒): contint1001 and contint2001 need a newer version of Docker installed - https://phabricator.wikimedia.org/T300682 (10MoritzMuehlenhoff) These have now been imported: ` jmm@gin:~$ curl -s https://apt.wikimedia... [11:39:48] hi all i created a PS in december after a DDoS from a cloud provider where it was request that we have some genral rate limits on cloud provideres. i have created a very genral patch for that https://gerrit.wikimedia.org/r/c/operations/puppet/+/740818 which just needs someone to comment on what reasnable limits would be. [11:40:21] this may be a question for traffic but i think it could equally be answered by someone here :) [12:48:54] 10serviceops, 10GitLab (Infrastructure), 10Patch-For-Review: Migrate gitlab-test instance to puppet - https://phabricator.wikimedia.org/T297411 (10Jelto) [12:54:18] 10serviceops, 10GitLab (Infrastructure), 10Patch-For-Review: Migrate gitlab-test instance to puppet - https://phabricator.wikimedia.org/T297411 (10Jelto) p:05Medium→03Low I cleaned up the old `gitlab-ansible-test` instance together with floating IP and disk. I also added some docs in https://wikitech.wik... [12:54:42] 10serviceops, 10GitLab (Infrastructure), 10Patch-For-Review: Migrate gitlab-test instance to puppet - https://phabricator.wikimedia.org/T297411 (10Jelto) [15:52:17] we are ready to reimage kubestage1003 with overlay :) [16:09:58] kubestage2001 :-) [16:10:06] elukey: +1ed the patches [16:12:12] ack! [16:12:15] so my plan is [16:12:26] 1) merge the change for partman and run puppet on install servers [16:12:32] 2) disable puppet on kubestage2001 [16:12:37] 3) merge the other change for overlay [16:12:48] 4) kick off the reimage cookbook with the --depool option [16:12:57] does it make sense? [16:13:13] sounds good [16:13:43] ah and before 4) drain of course [16:15:43] not totally needed for staging-codf, but fine as well [16:21:28] reimage started [16:33:40] 10serviceops, 10Machine-Learning-Team (Active Tasks), 10Patch-For-Review: Move Docker settings for kubernetes workers to overlay fs - https://phabricator.wikimedia.org/T300744 (10JMeybohm) >>! In T300744#7710619, @elukey wrote: > * I see the following warnings on Bullseye nodes when starting Docker: > ` > Fe... [17:05:29] of course we are missing the dragonfly packages :D [17:16:44] kubestage2001 up and running with bullseye and overlay :) [17:21:29] all the service pods are on 2002 though, due to the drain + uncordon [17:50:01] 10serviceops, 10Machine-Learning-Team (Active Tasks), 10Patch-For-Review: Move Docker settings for kubernetes workers to overlay fs - https://phabricator.wikimedia.org/T300744 (10elukey) kubestage2001 is up and running with Bullseye and overlay. I had to copy the dragonfly packages to Bullseye, and add https... [21:14:12] 10serviceops, 10DC-Ops, 10SRE, 10ops-codfw, 10Kubernetes: (Need By: TBD) rack/setup/install kubernetes20[19|2(012)] - https://phabricator.wikimedia.org/T299470 (10Papaul)