[06:20:59] PROBLEM - Check systemd state on doc1002 is CRITICAL: CRITICAL - degraded: The following units failed: rsync-doc-doc1003.eqiad.wmnet.service,rsync-doc-doc2001.codfw.wmnet.service,rsync-doc-doc2002.codfw.wmnet.service https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state [07:18:20] RECOVERY - Check systemd state on doc1002 is OK: OK - running: The system is fully operational https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state [08:22:20] (03PS1) 10Hslater: Add 'BlueSpiceSmartList' as dependency to 'BlueSpiceSMWConnector' [integration/config] - 10https://gerrit.wikimedia.org/r/922058 [08:49:58] (03CR) 10Hashar: [C: 03+2] Add 'BlueSpiceSmartList' as dependency to 'BlueSpiceSMWConnector' [integration/config] - 10https://gerrit.wikimedia.org/r/922058 (owner: 10Hslater) [08:51:10] (03Merged) 10jenkins-bot: Add 'BlueSpiceSmartList' as dependency to 'BlueSpiceSMWConnector' [integration/config] - 10https://gerrit.wikimedia.org/r/922058 (owner: 10Hslater) [08:53:03] (03CR) 10Hashar: [C: 03+2] "deployed" [integration/config] - 10https://gerrit.wikimedia.org/r/922058 (owner: 10Hslater) [09:17:03] 10GitLab (Project Migration), 10Release-Engineering-Team (They Live 🕶️🧟), 10serviceops-collab, 10Patch-For-Review: Provide mechanism to publish to doc.wikimedia.org from GitLab CI - https://phabricator.wikimedia.org/T336168 (10CodeReviewBot) jnuche opened https://gitlab.wikimedia.org/repos/releng/gitlab-tr... [09:17:18] 10GitLab (Project Migration), 10Release-Engineering-Team (They Live 🕶️🧟), 10serviceops-collab, 10Patch-For-Review: Provide mechanism to publish to doc.wikimedia.org from GitLab CI - https://phabricator.wikimedia.org/T336168 (10CodeReviewBot) jnuche merged https://gitlab.wikimedia.org/repos/releng/gitlab-tr... [10:33:07] 10Gerrit: Remove unused Gerrit groups - https://phabricator.wikimedia.org/T337225 (10WMDE-leszek) [11:56:12] 10Gerrit, 10Gerrit-Privilege-Requests: Remove unused Gerrit groups - https://phabricator.wikimedia.org/T337225 (10hashar) Gerrit does not offer the possibility to delete groups, it is not implemented. The way we have been working around it is to rename the group with a `unused-` prefix and some time adjusting... [12:01:41] Gerrit 3.8.0 is out :] [12:01:47] https://www.gerritcodereview.com/3.8.html#380 [12:04:15] 10Gerrit, 10Gerrit-Privilege-Requests: Remove unused Gerrit groups - https://phabricator.wikimedia.org/T337225 (10WMDE-leszek) oh, thanks. We've been seeming "unusing" groups. I should have listed e.g. [[https://gerrit.wikimedia.org/r/admin/groups/c216c66175658b4743b8c5dc1fc2675fbad9877b | wmde-unused-1]] as w... [12:04:28] 10Gerrit, 10Gerrit-Privilege-Requests: Remove unused Gerrit groups - https://phabricator.wikimedia.org/T337225 (10WMDE-leszek) 05Open→03Invalid [12:07:51] 10Project-Admins: Create a #openstack-magnum - https://phabricator.wikimedia.org/T336941 (10rook) [12:10:31] 10Project-Admins: Create a #openstack-magnum - https://phabricator.wikimedia.org/T336941 (10rook) [12:13:12] 10Project-Admins: Create project tag for wmcs-superset - https://phabricator.wikimedia.org/T337024 (10rook) [12:14:13] 10Project-Admins: Create a #wmcs-superset tag - https://phabricator.wikimedia.org/T336940 (10rook) [12:14:15] 10Project-Admins: Create project tag for wmcs-superset - https://phabricator.wikimedia.org/T337024 (10rook) [12:50:09] 10Continuous-Integration-Config, 10Release-Engineering-Team (Doing), 10BlueSpice, 10Patch-For-Review: BlueSpice related tests fails on gate-and-submit-1.31 in quibble-composer tests - https://phabricator.wikimedia.org/T235807 (10Hslater) I noticed that this task was previously declined, but I wanted to bri... [13:47:49] 10Beta-Cluster-Infrastructure, 10Puppet: puppetmaster config in deployment-prep may be inadvertently breaking store,logstash reports? - https://phabricator.wikimedia.org/T218175 (10joanna_borun) [13:50:15] 10Beta-Cluster-Infrastructure, 10Product-Infrastructure-Team-Backlog-Deprecated, 10VPS-Projects, 10Puppet: Puppet failures on deployment-docker-changeprop01, deployment-docker-cpjobqueue01, deployment-push-notifications01, deployment-docker-mobileapps01, and deploy... - https://phabricator.wikimedia.org/T259812 [15:03:59] (03CR) 10Hashar: "In last patch I have added a test to raise coverage." [software/gerrit] (deploy/wmf/stable-3.5) - 10https://gerrit.wikimedia.org/r/920708 (https://phabricator.wikimedia.org/T214068) (owner: 10Hashar) [15:22:17] 10Continuous-Integration-Infrastructure, 10serviceops-collab, 10Patch-For-Review: Migrate doc hosts to Bullseye - https://phabricator.wikimedia.org/T319477 (10Dzahn) a:05andrea.denisse→03eoghan [15:25:49] 10Beta-Cluster-Infrastructure, 10Product-Infrastructure-Team-Backlog-Deprecated, 10VPS-Projects, 10Puppet: Puppet failures on deployment-docker-changeprop01, deployment-docker-cpjobqueue01, deployment-push-notifications01, deployment-docker-mobileapps01, and deploy... - https://phabricator.wikimedia.org/T259812 [16:24:43] 10Release-Engineering-Team (They Live 🕶️🧟), 10Release, 10Train Deployments: 1.41.0-wmf.10 deployment blockers - https://phabricator.wikimedia.org/T330216 (10thcipriani) p:05Triage→03Medium a:03demon [16:29:06] thanks for the deployment calendar update TheresNoTime <3 [16:30:45] (I have no idea how you got it working and I'm sorry you had to figure it out) [16:40:07] 10Release-Engineering-Team (Onboarding 🚀), 10Scap, 10SRE Observability, 10Patch-For-Review: Remove trusty-specific hacks from logstash_checker.py - https://phabricator.wikimedia.org/T216380 (10jbond) [17:36:00] 10Release-Engineering-Team: Give @aklapper access to Drydock (Phabricator application) - https://phabricator.wikimedia.org/T336908 (10thcipriani) Looks like it's admins and members of #release-engineering-team {F37029239} This likely dates from when we were moving to differential and briefly used this for tes... [17:40:45] thcipriani: I ended up having to rewrite a bit of it to get around the train task not being assigned, hopefully it was helpful though [18:06:59] 10GitLab (Project Migration), 10Release-Engineering-Team: Create new GitLab project group: wikimedia-france - https://phabricator.wikimedia.org/T336830 (10brennen) 05Open→03Resolved a:03brennen Created: https://gitlab.wikimedia.org/repos/wikimedia-france You've been invited as an owner, and should be ab... [20:02:31] TheresNoTime: congratulations on now owning the `make-deployment-calendar` code! [20:02:37] s/owning/fixing/ [20:02:46] lolno [20:03:09] E_TOO_LATE_LAST_TOUCHED [20:03:36] iirc it also assumes you run with UTC-7 for some reason [20:03:58] else you have some nice side effects such as: [20:04:25] - the whole logici is off by one day and bails out when it is not yet midnight in UTC-7 [20:05:05] - off by one hours when daylight saving time adjustements are different between the UTC-7 timezone and my local timezone (CEST) [20:05:36] the easy fix was to change my local timezone and "travel" in time :D [20:05:48] beside that, it is working reasonably well [20:34:55] 10Beta-Cluster-Infrastructure: Reset password of User:Diskdance on Beta Cluster - https://phabricator.wikimedia.org/T337172 (10TheresNoTime) a:03TheresNoTime [20:40:14] 10Continuous-Integration-Config, 10MediaWiki-Core-Tests, 10phan-taint-check-plugin: Enable seccheck for MW core - https://phabricator.wikimedia.org/T231311 (10matmarex) [20:41:38] 10Beta-Cluster-Infrastructure: Reset password of User:Diskdance on Beta Cluster - https://phabricator.wikimedia.org/T337172 (10TheresNoTime) 05Open→03Stalled Contacting off-wiki via a confirmed account to verify request :) [21:49:27] 10Release-Engineering-Team (Onboarding 🚀), 10Scap, 10SRE Observability, 10serviceops-collab: Remove trusty-specific hacks from logstash_checker.py - https://phabricator.wikimedia.org/T216380 (10Dzahn) [21:49:35] 10Release-Engineering-Team (Onboarding 🚀), 10Scap, 10SRE Observability, 10serviceops-collab: Remove trusty-specific hacks from logstash_checker.py - https://phabricator.wikimedia.org/T216380 (10Dzahn) 05Open→03Resolved a:03Dzahn [22:02:40] 10Release-Engineering-Team (They Live 🕶️🧟), 10serviceops-collab, 10Patch-For-Review: upgrade gerrit servers to bullseye - https://phabricator.wikimedia.org/T334521 (10Dzahn) mailed wikitech-l https://lists.wikimedia.org/hyperkitty/list/wikitech-l@lists.wikimedia.org/thread/YEFV4HTYA6CV7Q7OHZQMRZBLK3KAFNUA/