[01:11:54] PROBLEM - PHD should be supervising processes on phab1001 is CRITICAL: PROCS CRITICAL: 2 processes with UID = 497 (phd) https://wikitech.wikimedia.org/wiki/Phabricator [01:14:22] RECOVERY - PHD should be supervising processes on phab1001 is OK: PROCS OK: 5 processes with UID = 497 (phd) https://wikitech.wikimedia.org/wiki/Phabricator [01:25:48] 10Project-Admins: Create project tag for Grid-Engine-to-K8s-Migration - https://phabricator.wikimedia.org/T317006 (10komla) [02:18:04] PROBLEM - PHD should be supervising processes on phab1001 is CRITICAL: PROCS CRITICAL: 2 processes with UID = 497 (phd) https://wikitech.wikimedia.org/wiki/Phabricator [02:20:32] RECOVERY - PHD should be supervising processes on phab1001 is OK: PROCS OK: 5 processes with UID = 497 (phd) https://wikitech.wikimedia.org/wiki/Phabricator [04:13:32] PROBLEM - PHD should be supervising processes on phab1001 is CRITICAL: PROCS CRITICAL: 2 processes with UID = 497 (phd) https://wikitech.wikimedia.org/wiki/Phabricator [04:18:28] RECOVERY - PHD should be supervising processes on phab1001 is OK: PROCS OK: 8 processes with UID = 497 (phd) https://wikitech.wikimedia.org/wiki/Phabricator [04:49:59] 10Project-Admins: Create project tag for Grid-Engine-to-K8s-Migration - https://phabricator.wikimedia.org/T317006 (10Aklapper) 05Open→03Resolved a:03Aklapper @komla: This sounds like a goal to be called finished at some point, so per https://www.mediawiki.org/wiki/Phabricator/Creating_and_renaming_projects... [07:43:42] 10Continuous-Integration-Infrastructure, 10ci-test-error: Something seems to be wrong with jenkins-bot - https://phabricator.wikimedia.org/T316934 (10hashar) [07:57:28] 10Continuous-Integration-Infrastructure, 10ci-test-error: Something seems to be wrong with jenkins-bot - https://phabricator.wikimedia.org/T316934 (10hashar) The jobs run on the WMCS instance as user `jenkins-deploy` and somehow were not able to create the `cache` and `log` directories in the workspace at `/sr... [07:57:39] 10Continuous-Integration-Infrastructure, 10ci-test-error: Something seems to be wrong with jenkins-bot - https://phabricator.wikimedia.org/T316934 (10hashar) [07:57:54] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Doing), 10ci-test-error: Various CI jobs failing after "mkdir: cannot create directory ‘log’: Permission denied" - https://phabricator.wikimedia.org/T282893 (10hashar) [07:58:44] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Doing), 10ci-test-error: Various CI jobs failing after "mkdir: cannot create directory ‘log’: Permission denied" - https://phabricator.wikimedia.org/T282893 (10hashar) [08:53:11] (03CR) 10Jaime Nuche: [C: 03+1] "LGTM, I'll leave it to Ahmon to give the +2 if he's happy with the resolution of this comments." [tools/scap] - 10https://gerrit.wikimedia.org/r/828075 (https://phabricator.wikimedia.org/T315531) (owner: 10Jeena Huneidi) [10:03:42] (Queue (Jenkins jobs + Zuul functions) alert) firing: Queue (Jenkins jobs + Zuul functions) alert - https://alerts.wikimedia.org/?q=alertname%3DQueue+%28Jenkins+jobs+%2B+Zuul+functions%29+alert [10:08:42] (Queue (Jenkins jobs + Zuul functions) alert) firing: (2) Queue (Jenkins jobs + Zuul functions) alert - https://alerts.wikimedia.org/?q=alertname%3DQueue+%28Jenkins+jobs+%2B+Zuul+functions%29+alert [10:17:01] 10GitLab (Infrastructure), 10Data-Persistence-Backup, 10serviceops, 10serviceops-collab, and 2 others: Backups for GitLab - https://phabricator.wikimedia.org/T274463 (10Jelto) @Dzahn thanks for merging the partman change and reimaging `gitlab2003`! #### Backup keep time reduction In the last GitLab IC me... [10:28:42] (Queue (Jenkins jobs + Zuul functions) alert) resolved: Queue (Jenkins jobs + Zuul functions) alert - https://alerts.wikimedia.org/?q=alertname%3DQueue+%28Jenkins+jobs+%2B+Zuul+functions%29+alert [10:34:41] 10Beta-Cluster-Infrastructure, 10serviceops: Serve beta cluster via PHP 7.4 by default - https://phabricator.wikimedia.org/T306042 (10Joe) 05In progress→03Resolved [10:48:41] 10Beta-Cluster-Infrastructure, 10serviceops: Serve beta cluster via PHP 7.4 by default - https://phabricator.wikimedia.org/T306042 (10Joe) As of now, deployment-prep is using php 7.4 only. We can cleanup later and remove php 7.2 completely. [11:17:50] (03PS5) 10Kosta Harlan: zuul: Run non-voting phpbench job for MW core patches [integration/config] - 10https://gerrit.wikimedia.org/r/813194 (https://phabricator.wikimedia.org/T291549) [11:17:58] (03CR) 10Kosta Harlan: zuul: Run non-voting phpbench job for MW core patches (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/813194 (https://phabricator.wikimedia.org/T291549) (owner: 10Kosta Harlan) [11:28:31] (03PS1) 10Jaime Nuche: Release 4.16.0-1 [tools/scap] - 10https://gerrit.wikimedia.org/r/829806 [11:33:32] (03CR) 10Jaime Nuche: [C: 03+2] Release 4.16.0-1 [tools/scap] - 10https://gerrit.wikimedia.org/r/829806 (owner: 10Jaime Nuche) [11:38:25] (03Merged) 10jenkins-bot: Release 4.16.0-1 [tools/scap] - 10https://gerrit.wikimedia.org/r/829806 (owner: 10Jaime Nuche) [15:05:43] (03PS1) 10Jaime Nuche: k8s: push support images to Minikube registry on env startup [tools/train-dev] - 10https://gerrit.wikimedia.org/r/829825 [15:27:13] 10Release-Engineering-Team (Bonus Level 🕹️), 10Scap, 10Discovery-Search: wikimedia/discovery/analytics: replace git-fat with git-lfs - https://phabricator.wikimedia.org/T316877 (10Gehel) The Search Platform team will be just watching, I don't think we need to do additional work on this. But ping us if needed! [17:09:23] (03CR) 10Hashar: Json schema from Gerrit Java event classes (036 comments) [software/gerrit/plugins/events-wikimedia] - 10https://gerrit.wikimedia.org/r/814725 (https://phabricator.wikimedia.org/T304947) (owner: 10Hashar) [17:09:31] (03PS4) 10Hashar: Json schema from Gerrit Java event classes [software/gerrit/plugins/events-wikimedia] - 10https://gerrit.wikimedia.org/r/814725 (https://phabricator.wikimedia.org/T304947) [17:16:37] (03CR) 10Hashar: "Instead of having all the java classes in the same directory, I have split them in:" [software/gerrit/plugins/events-wikimedia] - 10https://gerrit.wikimedia.org/r/814725 (https://phabricator.wikimedia.org/T304947) (owner: 10Hashar) [17:17:43] (03CR) 10Hashar: "The coverage report yields:" [software/gerrit/plugins/events-wikimedia] - 10https://gerrit.wikimedia.org/r/814725 (https://phabricator.wikimedia.org/T304947) (owner: 10Hashar) [20:38:43] 10Project-Admins: Create project tag for Grid-Engine-to-K8s-Migration - https://phabricator.wikimedia.org/T317006 (10komla) Thanks! [20:49:10] (03PS8) 10Hashar: Send events to Wikimedia EventGate [software/gerrit/plugins/events-wikimedia] - 10https://gerrit.wikimedia.org/r/814807 [22:40:25] 10Project-Admins: Create project tag for - https://phabricator.wikimedia.org/T317066 (10Skizzerz) [22:40:39] 10Project-Admins: Create project tag for OurWorldInData - https://phabricator.wikimedia.org/T317066 (10Skizzerz)