[05:30:01] 10Phabricator: Create a phabricator blog for Language team - https://phabricator.wikimedia.org/T306329 (10Peachey88) [05:44:32] 10Phabricator: Create a phabricator blog for Language team - https://phabricator.wikimedia.org/T306329 (10Arrbee) Additional access request for: @MNeisler, @EChukwukere-WMF, @Wangombe, and @UOzurumba [08:01:47] Project beta-scap-sync-world build #47818: 04FAILURE in 7 min 7 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/47818/ [08:08:57] Yippee, build fixed! [08:08:57] Project beta-scap-sync-world build #47819: 09FIXED in 4 min 13 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/47819/ [11:21:40] 10Phabricator, 10Project-Admins, 10Data-Persistence (Consultation), 10Developer Productivity: Fold Phab tags for optimizer-bug and Slow-DB-Query tag under Wikimedia-database-issue - https://phabricator.wikimedia.org/T305639 (10Marostegui) [12:18:45] 10Continuous-Integration-Config, 10Toolhub, 10Documentation, 10User-Slst2020: Publish docs on doc.wikimedia.org - https://phabricator.wikimedia.org/T305914 (10Slst2020) @hashar, would you be able to help us figure out the next steps? [14:02:32] 10Release-Engineering-Team (Next), 10Structured Data Engineering, 10Structured-Data-Backlog (Current Work), 10Wiki-Setup (Delete / Redirect): Close and delete TestCommons from production - https://phabricator.wikimedia.org/T213295 (10Ameisenigel) @Jdforrester-WMF Is this wiki still needed? [14:04:23] 10Release-Engineering-Team (Next), 10Structured Data Engineering, 10Structured-Data-Backlog (Current Work), 10Wiki-Setup (Delete / Redirect): Close and delete TestCommons from production - https://phabricator.wikimedia.org/T213295 (10Jdforrester-WMF) >>! In T213295#7860977, @Ameisenigel wrote: > @Jdforrest... [15:23:59] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Seen), 10Cloud-VPS (Debian Stretch Deprecation), 10Patch-For-Review: Move all Wikimedia CI (WMCS integration project) instances from stretch to buster/bullseye - https://phabricator.wikimedia.org/T252071 (10Jdforrester-WMF) [15:24:32] 10Continuous-Integration-Config, 10Release-Engineering-Team, 10Cloud-VPS (Debian Stretch Deprecation): Cloud VPS "integration" project Stretch deprecation - https://phabricator.wikimedia.org/T306078 (10Jdforrester-WMF) [15:25:27] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Seen), 10Cloud-VPS (Debian Stretch Deprecation), 10Patch-For-Review: Move all Wikimedia CI (WMCS integration project) instances from stretch to buster/bullseye - https://phabricator.wikimedia.org/T252071 (10Jdforrester-WMF) @hashar, it lo... [15:33:02] !log Shutting off deployment-wdqs01 from the Beta Cluster project per T306054; it's apparently unused, so this shouldn't break anything. [15:33:04] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [15:33:05] T306054: Upgrade deployment-wdqs01 host to Buster - https://phabricator.wikimedia.org/T306054 [16:02:35] 10Phabricator, 10Project-Admins, 10Release-Engineering-Team (Radar), 10Security-Team, 10Security: Move the #acl_security_volunteer policy outside of #acl_security - https://phabricator.wikimedia.org/T305890 (10sbassett) 05Open→03In progress [16:03:07] 10Phabricator, 10Project-Admins, 10Release-Engineering-Team (Radar), 10Security-Team, and 2 others: Move the #acl_security_volunteer policy outside of #acl_security - https://phabricator.wikimedia.org/T305890 (10sbassett) [16:30:26] 10Release-Engineering-Team (Next), 10Structured Data Engineering, 10Structured-Data-Backlog (Current Work), 10Wiki-Setup (Delete / Redirect): Close and delete TestCommons from production - https://phabricator.wikimedia.org/T213295 (10Ameisenigel) @CBogen Could you answer this question? [16:38:36] 10Phabricator: Create a phabricator blog for Language team - https://phabricator.wikimedia.org/T306329 (10brennen) 05Open→03In progress a:03brennen [16:48:57] !log phabricator: adding self to acl*blog-admins [16:48:58] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [16:49:52] !log phabricator: created phame blog https://phabricator.wikimedia.org/phame/blog/view/22/ for T306329 [16:49:54] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [16:49:55] T306329: Create a phabricator blog for Language team - https://phabricator.wikimedia.org/T306329 [16:51:44] 10Phabricator: Create a phabricator blog for Language team - https://phabricator.wikimedia.org/T306329 (10brennen) Created the above; I used a list of all individual users in the policy since I didn't find an existing ACL for the language team, but possibly one should be added? [17:12:40] 10MediaWiki-Releasing, 10Security: Release MediaWiki 1.35.6/1.36.4/1.37.2 - https://phabricator.wikimedia.org/T297829 (10MacFan4000) I think this can be closed? The mentioned versions have been released at this point. [17:15:08] 10GitLab (CI & Job Runners), 10Security Team AppSec, 10Security-Team, 10Security, 10user-sbassett: Support conda environments with a new gitlab appsec ci template - https://phabricator.wikimedia.org/T305732 (10sbassett) I need to review the [[ https://ossindex.sonatype.org/tos | OSSI TOS ]] with WMF Lega... [18:09:32] 10GitLab (Infrastructure), 10DC-Ops, 10SRE, 10ops-eqiad, 10serviceops: Q3:(Need By: TBD) rack/setup/install gitlab100[3|4] and gitlab-runner100[2|3|4] - https://phabricator.wikimedia.org/T301177 (10Jclark-ctr) Name Rack U Port Cableid gitlab1003... [18:16:27] 10GitLab (Infrastructure), 10DC-Ops, 10SRE, 10ops-eqiad, 10serviceops: Q3:(Need By: TBD) rack/setup/install gitlab100[3|4] and gitlab-runner100[2|3|4] - https://phabricator.wikimedia.org/T301177 (10Jclark-ctr) [18:20:07] 10GitLab (Infrastructure), 10DC-Ops, 10SRE, 10ops-eqiad, 10serviceops: Q3:(Need By: TBD) rack/setup/install gitlab100[3|4] and gitlab-runner100[2|3|4] - https://phabricator.wikimedia.org/T301177 (10Jclark-ctr) a:05Jclark-ctr→03Cmjohnson [18:21:54] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Seen), 10Cloud-VPS (Debian Stretch Deprecation), 10Patch-For-Review: Move all Wikimedia CI (WMCS integration project) instances from stretch to buster/bullseye - https://phabricator.wikimedia.org/T252071 (10Aklapper) [18:46:03] 10Release-Engineering-Team (🌱 Spring Cleaning — April 2022), 10dev-images, 10mwcli, 10Patch-For-Review: Apache docker image strips Authorization header - https://phabricator.wikimedia.org/T305143 (10brennen) 05Open→03Resolved [18:49:23] 10Release-Engineering-Team (Next), 10Structured Data Engineering, 10Structured-Data-Backlog (Current Work), 10Wiki-Setup (Delete / Redirect): Close and delete TestCommons from production - https://phabricator.wikimedia.org/T213295 (10Dzahn) added @CBogen to https://phabricator.wikimedia.org/project/profile... [18:51:14] 10GitLab (Infrastructure), 10DC-Ops, 10SRE, 10ops-eqiad, 10serviceops: Q3:(Need By: TBD) rack/setup/install gitlab100[3|4] and gitlab-runner100[2|3|4] - https://phabricator.wikimedia.org/T301177 (10Dzahn) It's sufficient if you put the "insetup" role on this and hand it over to us. Let us apply the actua... [19:03:21] 10GitLab (Administration, Settings & Policy), 10Horizon, 10SRE, 10wikitech.wikimedia.org, 10Security: Take some pointers from GitHub security updates - https://phabricator.wikimedia.org/T304231 (10brennen) [19:03:28] 10GitLab (Administration, Settings & Policy), 10cloud-services-team (Kanban): gitlab: consider enabling docker container registry - https://phabricator.wikimedia.org/T304845 (10brennen) [19:11:59] 10GitLab (Infrastructure), 10serviceops, 10Patch-For-Review: Migrate gitlab-test instance to puppet - https://phabricator.wikimedia.org/T297411 (10Dzahn) running puppet after it came back showed: ` Notice: /Stage[main]/Profile::Gitlab/Interface::Alias[gitlab service IP]/Interface::Ip[gitlab service IP ipv6... [19:13:09] 10GitLab (CI & Job Runners), 10serviceops: upgrade gitlab-runners to bullseye - https://phabricator.wikimedia.org/T297659 (10Dzahn) @Jelto All the (non-protected) prod runners are upgraded. Now I was just wondering about the 2 protected runners. They are paused. Should I try upgrading those as well? [19:27:09] !log gitlab runners: deleting a number of stale runners with no contacts in > 2 months which are most likely no longer extant [19:27:10] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [21:31:48] PROBLEM - puppet last run on contint1001 is CRITICAL: CRITICAL: Puppet has been disabled for 604828 seconds, message: reason not specified, last run 7 days ago with 0 failures https://wikitech.wikimedia.org/wiki/Monitoring/puppet_checkpuppetrun [21:40:32] hashar: ^ this is an issue. after 7 days it will drop oout of puppet DB [21:40:43] which will come with new issues [22:15:34] 10Continuous-Integration-Infrastructure, 10MinervaNeue, 10Vector, 10Accessibility, and 3 others: Add automated accessibility tests in CI to generate accessibility benchmarks for Skins - https://phabricator.wikimedia.org/T301184 (10Jdlrobson) a:05bwang→03None [22:23:40] 22:23 < mutante> !log contint1001 - re-enabling puppet that was disabled a week ago. to prevent more issues when it falls out of puppet DB, hopefully there wasn't a hard reason for this [22:24:06] good. I saw no changes [22:28:03] RECOVERY - puppet last run on contint1001 is OK: OK: Puppet is currently enabled, last run 4 minutes ago with 0 failures https://wikitech.wikimedia.org/wiki/Monitoring/puppet_checkpuppetrun [23:20:18] hrm, hash.ar is out today for the holiday. I don't recall him mentioning disabling puppet there, though. [23:42:01] thcipriani: I figured that holiday part.. which made me just risk it and do it.. re-enabled it [23:42:11] and nothing happened. so that's all good now [23:42:56] and it prevented that host from falling out of puppet DB which would have probably happened soon [23:51:59] thanks <3