[00:50:28] (03CR) 10Jdlrobson: [C: 03+1] jjb: Delete selenium-daily-beta-MobileFrontend [integration/config] - 10https://gerrit.wikimedia.org/r/860076 (https://phabricator.wikimedia.org/T280652) (owner: 10Zfilipin) [08:00:56] 10Continuous-Integration-Infrastructure, 10Quibble, 10Developer Productivity: Provide early feedback when a patch has job failures - https://phabricator.wikimedia.org/T323750 (10kostajh) [08:29:15] 10Continuous-Integration-Infrastructure, 10Quibble, 10Developer Productivity: Provide early feedback when a patch has job failures - https://phabricator.wikimedia.org/T323750 (10hashar) Ideally Zuul would report immediately when it knows that a change is not going to pass. As you found out that is T248531 wh... [08:53:12] 10Gerrit, 10Sustainability (Incident Followup): Investigate Gerrit h2 cache being way too large - https://phabricator.wikimedia.org/T323754 (10hashar) [08:53:53] 10Gerrit, 10Sustainability (Incident Followup): Investigate Gerrit h2 cache being way too large - https://phabricator.wikimedia.org/T323754 (10hashar) [09:45:44] 10Continuous-Integration-Infrastructure, 10PHP 8.2 support: Create PHP 8.2 CI images and jobs for early testing - https://phabricator.wikimedia.org/T314093 (10Reedy) According to https://www.php.net/archive/2022.php#2022-11-10-1 > The next release will be the seventh release candidate (RC 7), planned for Nov... [11:32:39] 10Continuous-Integration-Config, 10Codex, 10Design-Systems-Team (Design-Systems-Sprint), 10Patch-For-Review: docs: Consider making the latest release branch the default for the live docs site - https://phabricator.wikimedia.org/T311097 (10bmartinezcalvo) >>! In T311097#8413129, @AnneT wrote: > @bmartinezca... [11:50:26] 10Gerrit, 10Sustainability (Incident Followup): Investigate Gerrit h2 cache being way too large - https://phabricator.wikimedia.org/T323754 (10hashar) I did a few wrong things: * using `h2-1.3.176-ijar.jar` which I think only has the interfaces not the actual code * The jdbc URL `jdbc:h2:git_file_diff.h2.db`... [12:10:51] 10Gerrit, 10Sustainability (Incident Followup): Investigate Gerrit h2 cache being way too large - https://phabricator.wikimedia.org/T323754 (10hashar) And to get a SQL prompt: ` java -cp h2-1.3.176.jar org.h2.tools.Shell -url 'jdbc:h2:file:./git_file_diff;IFEXISTS=TRUE' ` There are 127709 entries. In the SQL... [12:12:51] (03CR) 10Zfilipin: [C: 03+2] jjb: Delete selenium-daily-beta-MobileFrontend [integration/config] - 10https://gerrit.wikimedia.org/r/860076 (https://phabricator.wikimedia.org/T280652) (owner: 10Zfilipin) [12:13:41] (03CR) 10Zfilipin: [C: 03+2] "I have deleted selenium-daily-beta-MobileFrontend Jenkins job. It was failing because MobileFrontend no longer has any Selenium tests." [integration/config] - 10https://gerrit.wikimedia.org/r/860076 (https://phabricator.wikimedia.org/T280652) (owner: 10Zfilipin) [12:14:58] (03Merged) 10jenkins-bot: jjb: Delete selenium-daily-beta-MobileFrontend [integration/config] - 10https://gerrit.wikimedia.org/r/860076 (https://phabricator.wikimedia.org/T280652) (owner: 10Zfilipin) [12:27:00] 10Gerrit, 10Sustainability (Incident Followup): Investigate Gerrit h2 cache being way too large - https://phabricator.wikimedia.org/T323754 (10hashar) > `maxCompactTime` > Database setting MAX_COMPACT_TIME (default: 200). Which is milliseconds. The setting can be passed to the H2 jdbc URL, probably with somet... [13:44:58] 10Project-Admins: Make subproject #Instrument-ClientError a top-level project - https://phabricator.wikimedia.org/T313640 (10Aklapper) a:03Aklapper [13:53:35] 10GitLab, 10Toolforge: Add potential next step for Toolforge error "No GitLab accounts found for tool maintainers." - https://phabricator.wikimedia.org/T323767 (10RPI2026F1) [13:56:44] 10Project-Admins: Make subproject #Instrument-ClientError a top-level project - https://phabricator.wikimedia.org/T313640 (10Aklapper) 05Open→03Resolved * Renamed and archived old subproject with archived parent to #DoNotUse---Instrument-ClientError in https://phabricator.wikimedia.org/project/edit/5018/ * C... [14:01:37] 10Project-Admins, 10Abstract Wikipedia team, 10WikiLambda: Rename "WikiLambda" and "WikiLambda Front-End" Phabricator tags to reflect the new project name: WikiFunction - https://phabricator.wikimedia.org/T323759 (10Aklapper) [14:26:02] 10GitLab, 10Tool-admin: Toolsadmin unable to deal with deleted tool repository - https://phabricator.wikimedia.org/T323768 (10RPI2026F1) [14:26:33] 10GitLab, 10Tool-admin: Toolsadmin unable to deal with deleted tool repository - https://phabricator.wikimedia.org/T323768 (10RPI2026F1) [14:39:26] 10GitLab, 10Striker: Toolsadmin unable to deal with deleted tool repository - https://phabricator.wikimedia.org/T323768 (10RPI2026F1) [14:41:43] (Queue (Jenkins jobs + Zuul functions) alert) firing: Queue (Jenkins jobs + Zuul functions) alert - https://alerts.wikimedia.org/?q=alertname%3DQueue+%28Jenkins+jobs+%2B+Zuul+functions%29+alert [14:53:40] PROBLEM - Work requests waiting in Zuul Gearman server on contint2001 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [400.0] https://www.mediawiki.org/wiki/Continuous_integration/Zuul https://grafana.wikimedia.org/d/000000322/zuul-gearman?orgId=1&viewPanel=10 [15:02:26] 10GitLab (CI & Job Runners), 10Release-Engineering-Team, 10serviceops-collab: Define access to external resources for GitLab CI Runners - https://phabricator.wikimedia.org/T320730 (10MatthewVernon) I think policy is now that Trusted runners only use internal images; would it be possible therefore to start ma... [18:41:58] (Queue (Jenkins jobs + Zuul functions) alert) firing: Queue (Jenkins jobs + Zuul functions) alert - https://alerts.wikimedia.org/?q=alertname%3DQueue+%28Jenkins+jobs+%2B+Zuul+functions%29+alert [20:30:23] 10GitLab, 10Striker: Add potential next step for Toolforge error "No GitLab accounts found for tool maintainers." - https://phabricator.wikimedia.org/T323767 (10JJMC89) [20:42:49] 10Gerrit, 10Release-Engineering-Team (GitLab III: GitLab in LA 🪃), 10SRE-OnFire, 10serviceops-collab, and 2 others: gerrit1001 running out of space on / - https://phabricator.wikimedia.org/T323262 (10hashar) [20:44:11] 10Gerrit: Investigate changes having a wrong server id - https://phabricator.wikimedia.org/T323259 (10hashar) [20:46:43] (Queue (Jenkins jobs + Zuul functions) alert) firing: (2) Queue (Jenkins jobs + Zuul functions) alert - https://alerts.wikimedia.org/?q=alertname%3DQueue+%28Jenkins+jobs+%2B+Zuul+functions%29+alert [20:49:16] 10Gerrit: Investigate changes having a wrong server id - https://phabricator.wikimedia.org/T323259 (10hashar) We have `gerrit.serverId` set to `e9e9afe9-4712-486d-8885-f54b72dd1951` since December 2016 commit 15bc9b80a7a91c54567d3fb63442ac13c955e603. [21:02:49] RECOVERY - Work requests waiting in Zuul Gearman server on contint2001 is OK: OK: Less than 100.00% above the threshold [200.0] https://www.mediawiki.org/wiki/Continuous_integration/Zuul https://grafana.wikimedia.org/d/000000322/zuul-gearman?orgId=1&viewPanel=10 [21:06:43] (Queue (Jenkins jobs + Zuul functions) alert) resolved: Queue (Jenkins jobs + Zuul functions) alert - https://alerts.wikimedia.org/?q=alertname%3DQueue+%28Jenkins+jobs+%2B+Zuul+functions%29+alert