[00:00:36] (DatasourceError) firing: Queue (Jenkins jobs + Zuul functions) alert - https://grafana.wikimedia.org/alerting/grafana/iS0FSjJ4z/view - https://wikitech.wikimedia.org/wiki/Monitoring/DatasourceError - https://alerts.wikimedia.org/?q=alertname%3DDatasourceError [00:10:36] (DatasourceError) resolved: Queue (Jenkins jobs + Zuul functions) alert - https://grafana.wikimedia.org/alerting/grafana/iS0FSjJ4z/view - https://wikitech.wikimedia.org/wiki/Monitoring/DatasourceError - https://alerts.wikimedia.org/?q=alertname%3DDatasourceError [03:09:09] (03PS1) 10BCornwall: Archive operations/software/varnish/libvmod-netmapper [integration/config] - 10https://gerrit.wikimedia.org/r/979438 (https://phabricator.wikimedia.org/T347623) [03:14:34] 10GitLab (Project Migration), 10Traffic, 10Patch-For-Review: Migrate Traffic repositories from Gerrit to Gitlab - https://phabricator.wikimedia.org/T347623 (10BCornwall) [03:20:35] 10GitLab (Project Migration), 10Traffic, 10Patch-For-Review: Migrate Traffic repositories from Gerrit to Gitlab - https://phabricator.wikimedia.org/T347623 (10BCornwall) [12:08:03] Hi releng, can someone carry out https://phabricator.wikimedia.org/T352569 if possible? Just seen on mailing list [12:08:11] * HolidayRhino can't make patch as no laptop [12:08:21] Will also post to -sre [14:02:28] (03PS1) 10Func: Revert "Zuul: [mediawiki/extensions/Variables] Use extension-broken" [integration/config] - 10https://gerrit.wikimedia.org/r/979221 [14:04:17] (03PS2) 10Func: Revert "Zuul: [mediawiki/extensions/Variables] Use extension-broken" [integration/config] - 10https://gerrit.wikimedia.org/r/979221 [14:31:32] (03CR) 10MGChecker: [C: 03+1] "As maintainer of Variables, I support to get the CI back on track." [integration/config] - 10https://gerrit.wikimedia.org/r/979221 (owner: 10Func) [15:01:44] 10Release-Engineering-Team (Yak Shaving 🐃🪒), 10User-brennen: A tool for quickly answering what groups an extension is deployed to - https://phabricator.wikimedia.org/T296050 (10bd808) [15:04:49] 10Release-Engineering-Team (Yak Shaving 🐃🪒), 10User-brennen: A tool for quickly answering what groups an extension is deployed to - https://phabricator.wikimedia.org/T296050 (10bd808) >>! In T296050#9376454, @brennen wrote: > It could use some actual UI and knowledge of groups. [[https://versions.toolforge.or... [15:38:48] _j.oe_ said they can help with the emergency deploy in future [15:39:38] Not in future [15:39:40] Above for Monday [15:39:50] I was doing 2 things at once [15:40:00] But above will be sorted in time :) [15:40:12] * HolidayRhino goes back to his holiday [18:28:24] 10GitLab (Account Approval), 10Release-Engineering-Team: Requesting GitLab account activation for Automatik - https://phabricator.wikimedia.org/T352498 (10Automatik) @Peachey88 reason for access is that I own a tool that runs on toolforge (tool name: botomatik), and would like to push my code to a remote git r... [20:04:36] (Queue (Jenkins jobs + Zuul functions) alert) firing: - https://alerts.wikimedia.org/?q=alertname%3DQueue+%28Jenkins+jobs+%2B+Zuul+functions%29+alert [20:14:35] PROBLEM - Work requests waiting in Zuul Gearman server on contint2002 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [400.0] https://www.mediawiki.org/wiki/Continuous_integration/Zuul https://grafana.wikimedia.org/d/000000322/zuul-gearman?orgId=1&viewPanel=10 [20:24:36] (Queue (Jenkins jobs + Zuul functions) alert) resolved: - https://alerts.wikimedia.org/?q=alertname%3DQueue+%28Jenkins+jobs+%2B+Zuul+functions%29+alert [21:19:31] RECOVERY - Work requests waiting in Zuul Gearman server on contint2002 is OK: OK: Less than 100.00% above the threshold [200.0] https://www.mediawiki.org/wiki/Continuous_integration/Zuul https://grafana.wikimedia.org/d/000000322/zuul-gearman?orgId=1&viewPanel=10 [21:29:34] (Queue (Jenkins jobs + Zuul functions) alert) firing: - https://alerts.wikimedia.org/?q=alertname%3DQueue+%28Jenkins+jobs+%2B+Zuul+functions%29+alert [21:40:05] PROBLEM - Work requests waiting in Zuul Gearman server on contint2002 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [400.0] https://www.mediawiki.org/wiki/Continuous_integration/Zuul https://grafana.wikimedia.org/d/000000322/zuul-gearman?orgId=1&viewPanel=10 [21:49:34] (Queue (Jenkins jobs + Zuul functions) alert) resolved: - https://alerts.wikimedia.org/?q=alertname%3DQueue+%28Jenkins+jobs+%2B+Zuul+functions%29+alert [23:17:21] RECOVERY - Work requests waiting in Zuul Gearman server on contint2002 is OK: OK: Less than 100.00% above the threshold [200.0] https://www.mediawiki.org/wiki/Continuous_integration/Zuul https://grafana.wikimedia.org/d/000000322/zuul-gearman?orgId=1&viewPanel=10