[00:41:05] PROBLEM - SSH on contint1001.mgmt is CRITICAL: CRITICAL - Socket timeout after 10 seconds https://wikitech.wikimedia.org/wiki/Dc-operations/Hardware_Troubleshooting_Runbook [01:04:02] 10Project-Admins, 10Data-Engineering: Archive Analytics tag - https://phabricator.wikimedia.org/T298671 (10odimitrijevic) [01:05:20] 10Project-Admins, 10Data-Engineering: Archive Analytics tag - https://phabricator.wikimedia.org/T298671 (10odimitrijevic) FTR I migrated all the tickets that are still relevant even for historical reasons to Data-Engineering board. Here is a broad approach taken: * I left Wikistats on the analytics board wit... [01:42:05] RECOVERY - SSH on contint1001.mgmt is OK: SSH OK - OpenSSH_6.6 (protocol 2.0) https://wikitech.wikimedia.org/wiki/Dc-operations/Hardware_Troubleshooting_Runbook [05:26:58] 10Project-Admins: Create Data-Catalog Project Tag - https://phabricator.wikimedia.org/T299116 (10odimitrijevic) [06:21:37] 10Project-Admins, 10User-Kizule: Create Data-Catalog Project Tag - https://phabricator.wikimedia.org/T299116 (10Kizule) a:03Kizule Doing this right now... [06:25:49] 10Project-Admins, 10User-Kizule: Create Data-Catalog Project Tag - https://phabricator.wikimedia.org/T299116 (10Kizule) 05Open→03Resolved Requested public project #data-catalog has been created: https://phabricator.wikimedia.org/project/view/5697/ Interested people are welcome to join the project as {icon... [09:13:02] (03PS1) 10QChris: Allow “Gerrit Managers” to import history [skins/Cavendish] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/753683 [09:13:04] (03CR) 10QChris: [V: 03+2 C: 03+2] Allow “Gerrit Managers” to import history [skins/Cavendish] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/753683 (owner: 10QChris) [09:34:35] (03PS1) 10QChris: Import done. Revoke import grants [skins/Cavendish] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/753685 [09:34:37] (03CR) 10QChris: [V: 03+2 C: 03+2] Import done. Revoke import grants [skins/Cavendish] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/753685 (owner: 10QChris) [09:52:45] 10Beta-Cluster-Infrastructure, 10Kubernetes: Job getting killed on k8s - https://phabricator.wikimedia.org/T299121 (10So9q) [09:59:00] 10Beta-Cluster-Infrastructure, 10Kubernetes: Job getting killed on k8s - https://phabricator.wikimedia.org/T299121 (10So9q) [10:11:20] 10Project-Admins, 10User-Kizule: Create Data-Catalog Project Tag - https://phabricator.wikimedia.org/T299116 (10Aklapper) Thanks, Kizule! [10:14:53] !log cancelled stuck deployment-prep jobs on jenkins [10:14:54] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [10:17:50] taavi: that one is a deadlock somehwer ein the java code :-\ [10:25:33] 10Continuous-Integration-Infrastructure, 10Jenkins, 10SecTeam-Processed, 10Security: 2022-01-12 Jenkins security advisory pre-announcement - https://phabricator.wikimedia.org/T298691 (10hashar) 05Resolved→03Open Actually the migration has to be applied! [10:28:06] i am going to apply the Jenkins migration for the 'master' to 'built-in' naming [10:42:31] !log Applied Jenkins built-in node migration to CI Jenkins (`master` > `built-in` renaming) # T298691 [10:42:33] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [10:42:34] T298691: 2022-01-12 Jenkins security advisory pre-announcement - https://phabricator.wikimedia.org/T298691 [10:52:02] !log Restarting Jenkins CI for plugins update [10:52:03] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [10:53:07] 10Continuous-Integration-Infrastructure, 10Jenkins, 10SecTeam-Processed, 10Security: 2022-01-12 Jenkins security advisory pre-announcement - https://phabricator.wikimedia.org/T298691 (10hashar) 05Open→03Resolved [11:16:30] (03PS2) 10Hashar: jjb: normalize usage of docker run --workdir [integration/config] - 10https://gerrit.wikimedia.org/r/753457 [11:16:32] (03PS2) 10Hashar: jjb: add 'workdir' to Jinja2 docker macro [integration/config] - 10https://gerrit.wikimedia.org/r/753458 [11:27:51] 10Release-Engineering-Team, 10Scap, 10serviceops: Deploy Scap version 4.1.1 - https://phabricator.wikimedia.org/T298986 (10Joe) 05Open→03Resolved [11:27:54] !log Updating Jenkins job to normalize usage of `docker run --workdir` https://gerrit.wikimedia.org/r/c/integration/config/+/753457 [11:27:55] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [11:28:09] (03CR) 10Hashar: [C: 03+2] jjb: normalize usage of docker run --workdir [integration/config] - 10https://gerrit.wikimedia.org/r/753457 (owner: 10Hashar) [11:28:23] (03CR) 10Hashar: [C: 03+2] jjb: add 'workdir' to Jinja2 docker macro [integration/config] - 10https://gerrit.wikimedia.org/r/753458 (owner: 10Hashar) [11:30:11] (03Merged) 10jenkins-bot: jjb: normalize usage of docker run --workdir [integration/config] - 10https://gerrit.wikimedia.org/r/753457 (owner: 10Hashar) [11:30:14] (03Merged) 10jenkins-bot: jjb: add 'workdir' to Jinja2 docker macro [integration/config] - 10https://gerrit.wikimedia.org/r/753458 (owner: 10Hashar) [11:38:36] (03CR) 10Awight: Wrapper to pretty-print parallel job progress (031 comment) [integration/quibble] - 10https://gerrit.wikimedia.org/r/693458 (owner: 10Awight) [12:44:30] 10Beta-Cluster-Infrastructure, 10Kubernetes: Job getting killed on k8s - https://phabricator.wikimedia.org/T299121 (10So9q) During writing of the output the process was killed. Evidence is here of partial write of the output file: {F34916976} [12:45:43] 10Beta-Cluster-Infrastructure, 10Kubernetes: Job getting killed on k8s - https://phabricator.wikimedia.org/T299121 (10So9q) [13:13:33] (03PS10) 10Awight: Wrapper to pretty-print parallel job progress [integration/quibble] - 10https://gerrit.wikimedia.org/r/693458 [13:18:43] (03PS11) 10Awight: Wrapper to pretty-print parallel job progress [integration/quibble] - 10https://gerrit.wikimedia.org/r/693458 [13:19:04] (03PS12) 10Awight: Wrapper to pretty-print parallel job progress [integration/quibble] - 10https://gerrit.wikimedia.org/r/693458 [13:26:19] (03PS13) 10Awight: Wrapper to pretty-print parallel job progress [integration/quibble] - 10https://gerrit.wikimedia.org/r/693458 [13:30:33] (03CR) 10jerkins-bot: [V: 04-1] Wrapper to pretty-print parallel job progress [integration/quibble] - 10https://gerrit.wikimedia.org/r/693458 (owner: 10Awight) [13:35:08] (03PS14) 10Awight: Wrapper to pretty-print parallel job progress [integration/quibble] - 10https://gerrit.wikimedia.org/r/693458 [13:35:11] (03PS47) 10Awight: Parallelism as a command object [integration/quibble] - 10https://gerrit.wikimedia.org/r/587885 (https://phabricator.wikimedia.org/T235449) [13:38:11] (03CR) 10jerkins-bot: [V: 04-1] Parallelism as a command object [integration/quibble] - 10https://gerrit.wikimedia.org/r/587885 (https://phabricator.wikimedia.org/T235449) (owner: 10Awight) [13:38:21] (03CR) 10jerkins-bot: [V: 04-1] Wrapper to pretty-print parallel job progress [integration/quibble] - 10https://gerrit.wikimedia.org/r/693458 (owner: 10Awight) [13:45:21] (03PS15) 10Awight: Wrapper to pretty-print parallel job progress [integration/quibble] - 10https://gerrit.wikimedia.org/r/693458 [13:45:24] (03PS48) 10Awight: Parallelism as a command object [integration/quibble] - 10https://gerrit.wikimedia.org/r/587885 (https://phabricator.wikimedia.org/T235449) [13:45:27] (03PS16) 10Awight: Split extension and skin npm and composer tests [integration/quibble] - 10https://gerrit.wikimedia.org/r/587888 [13:48:30] (03CR) 10jerkins-bot: [V: 04-1] Wrapper to pretty-print parallel job progress [integration/quibble] - 10https://gerrit.wikimedia.org/r/693458 (owner: 10Awight) [13:48:44] (03CR) 10jerkins-bot: [V: 04-1] Parallelism as a command object [integration/quibble] - 10https://gerrit.wikimedia.org/r/587885 (https://phabricator.wikimedia.org/T235449) (owner: 10Awight) [13:48:50] (03CR) 10jerkins-bot: [V: 04-1] Split extension and skin npm and composer tests [integration/quibble] - 10https://gerrit.wikimedia.org/r/587888 (owner: 10Awight) [13:51:25] (03PS16) 10Awight: Wrapper to pretty-print parallel job progress [integration/quibble] - 10https://gerrit.wikimedia.org/r/693458 [13:51:28] (03PS49) 10Awight: Parallelism as a command object [integration/quibble] - 10https://gerrit.wikimedia.org/r/587885 (https://phabricator.wikimedia.org/T235449) [13:51:31] (03PS17) 10Awight: Split extension and skin npm and composer tests [integration/quibble] - 10https://gerrit.wikimedia.org/r/587888 [14:25:23] (03CR) 10Hashar: [C: 03+2] Wrapper to pretty-print parallel job progress [integration/quibble] - 10https://gerrit.wikimedia.org/r/693458 (owner: 10Awight) [14:41:28] (03Merged) 10jenkins-bot: Wrapper to pretty-print parallel job progress [integration/quibble] - 10https://gerrit.wikimedia.org/r/693458 (owner: 10Awight) [15:02:42] 10Continuous-Integration-Config, 10Release-Engineering-Team (Next), 10Wikibase (3rd party installations), 10Wikidata, and 3 others: Move some Wikibase selenium tests to a standalone job - https://phabricator.wikimedia.org/T287582 (10hashar) >>! In T287582#7368381, @Addshore wrote: > I have a suspicion that... [15:37:49] (03CR) 1020after4: [C: 03+1] "You can regard my +1 as a +2. If you feel this is ready to land then go for it." [tools/scap] - 10https://gerrit.wikimedia.org/r/753177 (owner: 10Ahmon Dancy) [15:40:56] (03CR) 10Ahmon Dancy: [C: 03+2] scap/git.py: Replace get_disclosable_head with git merge-base HEAD origin (032 comments) [tools/scap] - 10https://gerrit.wikimedia.org/r/753177 (owner: 10Ahmon Dancy) [15:41:39] (03Merged) 10jenkins-bot: scap/git.py: Replace get_disclosable_head with git merge-base HEAD origin [tools/scap] - 10https://gerrit.wikimedia.org/r/753177 (owner: 10Ahmon Dancy) [15:42:12] (03CR) 1020after4: [C: 03+2] Make scap prep re-runnable [tools/scap] - 10https://gerrit.wikimedia.org/r/752189 (owner: 10Ahmon Dancy) [15:42:25] 10Release-Engineering-Team, 10Scap, 10serviceops: Deploy Scap version 4.1.1 - https://phabricator.wikimedia.org/T298986 (10dancy) Thanks @Joe! [15:42:32] (03CR) 1020after4: [C: 03+2] scap prep auto [tools/scap] - 10https://gerrit.wikimedia.org/r/753103 (owner: 10Ahmon Dancy) [15:42:53] (03Merged) 10jenkins-bot: Make scap prep re-runnable [tools/scap] - 10https://gerrit.wikimedia.org/r/752189 (owner: 10Ahmon Dancy) [15:44:58] (03Merged) 10jenkins-bot: scap prep auto [tools/scap] - 10https://gerrit.wikimedia.org/r/753103 (owner: 10Ahmon Dancy) [15:52:41] !log Update scap to 4.1.1-1+0~20220113154506.135~1.gbp523480 on deployment-deploy03 [15:52:42] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [16:14:15] (03PS10) 10Hashar: jjb: Provide 'client' and 'repo' Wikibase selenium jobs [integration/config] - 10https://gerrit.wikimedia.org/r/676107 (https://phabricator.wikimedia.org/T287582) [16:27:24] !log testing scap prep auto on deployment-deploy03 [16:27:26] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [16:29:09] Project beta-update-databases-eqiad build #55991: 04FAILURE in 9 min 8 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/55991/ [16:30:00] ^^ That was me. [16:43:46] I have troubles reaching gerrit, is it known, or is it just me and I should file a proper report? [16:46:11] Project beta-code-update-eqiad build #376129: 04FAILURE in 3.8 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/376129/ [16:46:35] ^^ Also me. [16:46:42] gerrit.. checking [16:46:57] Daimona: is working ok for me. [16:50:40] 10Continuous-Integration-Config, 10Release-Engineering-Team (Next), 10Wikibase (3rd party installations), 10Wikidata, and 3 others: Move some Wikibase selenium tests to a standalone job - https://phabricator.wikimedia.org/T287582 (10hashar) I got the `repo` variant passing by adding a few extensions as dep... [16:51:53] Oh good to know, thanks [16:55:13] (03PS1) 10Ahmon Dancy: beta-code-update-eqiad: Use scap prep auto [integration/config] - 10https://gerrit.wikimedia.org/r/753782 [16:56:12] (03PS2) 10Ahmon Dancy: beta-code-update-eqiad: Use scap prep auto [integration/config] - 10https://gerrit.wikimedia.org/r/753782 [17:10:07] Yippee, build fixed! [17:10:07] Project beta-code-update-eqiad build #376130: 09FIXED in 1 min 41 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/376130/ [17:20:29] (03CR) 10Ahmon Dancy: [C: 04-1] beta-code-update-eqiad: Use scap prep auto [integration/config] - 10https://gerrit.wikimedia.org/r/753782 (owner: 10Ahmon Dancy) [17:22:20] (03PS3) 10Ahmon Dancy: beta-code-update-eqiad: Use scap prep auto [integration/config] - 10https://gerrit.wikimedia.org/r/753782 [17:34:50] (03CR) 10Ahmon Dancy: [C: 03+1] beta-code-update-eqiad: Use scap prep auto [integration/config] - 10https://gerrit.wikimedia.org/r/753782 (owner: 10Ahmon Dancy) [17:34:57] (03CR) 10Ahmon Dancy: [C: 03+2] beta-code-update-eqiad: Use scap prep auto [integration/config] - 10https://gerrit.wikimedia.org/r/753782 (owner: 10Ahmon Dancy) [17:36:59] Project beta-code-update-eqiad build #376134: 04FAILURE in 4.4 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/376134/ [17:37:04] (03Merged) 10jenkins-bot: beta-code-update-eqiad: Use scap prep auto [integration/config] - 10https://gerrit.wikimedia.org/r/753782 (owner: 10Ahmon Dancy) [17:37:28] Yippee, build fixed! [17:37:29] Project beta-code-update-eqiad build #376135: 09FIXED in 2.9 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/376135/ [17:48:05] (03PS1) 10Ahmon Dancy: Remove beta-mediawiki-config-update-eqiad job [integration/config] - 10https://gerrit.wikimedia.org/r/753792 [17:51:27] (03CR) 10Ahmon Dancy: [C: 03+2] Remove beta-mediawiki-config-update-eqiad job [integration/config] - 10https://gerrit.wikimedia.org/r/753792 (owner: 10Ahmon Dancy) [17:53:21] (03Merged) 10jenkins-bot: Remove beta-mediawiki-config-update-eqiad job [integration/config] - 10https://gerrit.wikimedia.org/r/753792 (owner: 10Ahmon Dancy) [17:54:34] !log Reloading Zuul to deploy https://gerrit.wikimedia.org/r/753792 [17:54:35] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [18:01:23] !Log Updating scap to 4.1.1-1+0~20220113154506.135~1.gbp523480 on all beta hosts [18:02:57] !log Updating scap to 4.1.1-1+0~20220113154506.135~1.gbp523480 on all beta hosts [18:02:58] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [18:07:25] Yippee, build fixed! [18:07:25] Project beta-update-databases-eqiad build #55992: 09FIXED in 9 min 19 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/55992/ [18:18:19] 10Release-Engineering-Team (Next), 10Patch-For-Review, 10Release, 10Train Deployments: 1.38.0-wmf.17 deployment blockers - https://phabricator.wikimedia.org/T293958 (10mmodell) [18:39:52] (03PS11) 10Hashar: jjb: Provide 'client' and 'repo' Wikibase selenium jobs [integration/config] - 10https://gerrit.wikimedia.org/r/676107 (https://phabricator.wikimedia.org/T287582) [19:38:36] 10Project-Admins, 10User-Kizule: Create Data-Catalog Project Tag - https://phabricator.wikimedia.org/T299116 (10odimitrijevic) Wonderful! Thanks so much! [19:46:55] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team: Replace most of beta::autoupdater with scap prep auto - https://phabricator.wikimedia.org/T299163 (10dancy) [20:13:02] (03PS12) 10Hashar: Use standalone jobs for Wikibase Selenium tests [integration/config] - 10https://gerrit.wikimedia.org/r/676107 (https://phabricator.wikimedia.org/T287582) [20:25:53] 10Release-Engineering-Team (Next), 10Patch-For-Review, 10Release, 10Train Deployments: 1.38.0-wmf.17 deployment blockers - https://phabricator.wikimedia.org/T293958 (10dduvall) [20:31:46] 10Continuous-Integration-Config, 10Release-Engineering-Team (Next), 10Wikibase (3rd party installations), 10Wikidata, and 3 others: Move some Wikibase selenium tests to a standalone job - https://phabricator.wikimedia.org/T287582 (10hashar) I have found the issue! I have created the Selenium jobs after th... [20:52:32] 10Release-Engineering-Team (Seen), 10serviceops: contint hardware refresh - https://phabricator.wikimedia.org/T294276 (10hashar) [20:52:37] 10Continuous-Integration-Infrastructure, 10DC-Ops, 10SRE, 10netops, 10ops-codfw: DRAC firmware upgrades codfw (was: Flapping codfw management alarm ( contint2001.mgmt/SSH is CRITICAL ))) - https://phabricator.wikimedia.org/T283582 (10hashar) [20:53:12] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Radar), 10SRE, 10ops-codfw, 10serviceops-radar: contint2001.mgmt disappeared from Icinga - https://phabricator.wikimedia.org/T298861 (10hashar) 05Open→03Stalled I am marking this one stalled since that was to investigate why the hos... [20:58:01] 10Release-Engineering-Team (Seen), 10serviceops: contint hardware refresh - https://phabricator.wikimedia.org/T294276 (10Dzahn) There is now the new procurement ticket T299081 @hashar also see my comment about OS version on T299081#7620086 [20:58:07] 10Continuous-Integration-Infrastructure, 10DC-Ops, 10SRE, 10netops, 10ops-codfw: DRAC firmware upgrades codfw (was: Flapping codfw management alarm ( contint2001.mgmt/SSH is CRITICAL ))) - https://phabricator.wikimedia.org/T283582 (10hashar) @Papaul wrote: > The IDRAC on this server needs reset. Please c... [20:58:23] 10Release-Engineering-Team (Seen), 10serviceops: contint hardware refresh - https://phabricator.wikimedia.org/T294276 (10Dzahn) So there will be contint2002 (which could or could not make this contint2001.mgmt debugging moot). There is also the question whether that has anything to do with an OS version upgrad... [20:59:15] 10Release-Engineering-Team (Seen), 10serviceops: contint hardware refresh - https://phabricator.wikimedia.org/T294276 (10Dzahn) [20:59:53] 10Gerrit, 10SRE, 10serviceops: replacement for gerrit2001 - https://phabricator.wikimedia.org/T243027 (10Dzahn) [21:00:44] 10Gerrit, 10SRE, 10serviceops: replacement for gerrit2001 - https://phabricator.wikimedia.org/T243027 (10Dzahn) There is now the new procurement ticket T299081 [21:37:28] 10Continuous-Integration-Infrastructure, 10Quibble, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (2020-10-01 to 2020-12-31 (Q2)), and 2 others: Terminating MySQL takes several minutes in (Wikibase?) CI jobs - https://phabricator.wikimedia.org/T265615 (10hashar) @awigh... [22:05:32] (03PS1) 10Ahmon Dancy: Add mediawiki/extensions.git to mirrored repos list [tools/train-dev] - 10https://gerrit.wikimedia.org/r/753825 [22:11:19] (03CR) 10Ahmon Dancy: [C: 03+2] Add mediawiki/extensions.git to mirrored repos list [tools/train-dev] - 10https://gerrit.wikimedia.org/r/753825 (owner: 10Ahmon Dancy) [22:12:05] (03Merged) 10jenkins-bot: Add mediawiki/extensions.git to mirrored repos list [tools/train-dev] - 10https://gerrit.wikimedia.org/r/753825 (owner: 10Ahmon Dancy) [22:27:34] (03PS1) 10Ahmon Dancy: Add mediawiki/skins.git to mirror repos list [tools/train-dev] - 10https://gerrit.wikimedia.org/r/753847 [22:33:17] (03PS1) 10Ahmon Dancy: git.info(): Use origin branch, not just "origin" to find head_sha1 [tools/scap] - 10https://gerrit.wikimedia.org/r/753848 [22:35:52] (03CR) 10jerkins-bot: [V: 04-1] git.info(): Use origin branch, not just "origin" to find head_sha1 [tools/scap] - 10https://gerrit.wikimedia.org/r/753848 (owner: 10Ahmon Dancy) [22:51:07] (03PS2) 10Ahmon Dancy: git.info(): Use origin branch, not just "origin" to find head_sha1 [tools/scap] - 10https://gerrit.wikimedia.org/r/753848 [22:52:04] (03PS1) 10Ahmon Dancy: Improve error reporting for bad configuration setting syntax [tools/scap] - 10https://gerrit.wikimedia.org/r/753852 [22:52:25] (03PS1) 10Ahmon Dancy: scap prep: pass -Dstage_dir to scap apply patches [tools/scap] - 10https://gerrit.wikimedia.org/r/753853 [22:54:02] (03CR) 10Ahmon Dancy: [C: 03+2] git.info(): Use origin branch, not just "origin" to find head_sha1 [tools/scap] - 10https://gerrit.wikimedia.org/r/753848 (owner: 10Ahmon Dancy) [22:54:08] (03CR) 10Ahmon Dancy: [C: 03+2] Add mediawiki/skins.git to mirror repos list [tools/train-dev] - 10https://gerrit.wikimedia.org/r/753847 (owner: 10Ahmon Dancy) [22:54:53] (03Merged) 10jenkins-bot: git.info(): Use origin branch, not just "origin" to find head_sha1 [tools/scap] - 10https://gerrit.wikimedia.org/r/753848 (owner: 10Ahmon Dancy) [22:54:58] (03Merged) 10jenkins-bot: Add mediawiki/skins.git to mirror repos list [tools/train-dev] - 10https://gerrit.wikimedia.org/r/753847 (owner: 10Ahmon Dancy) [22:55:17] (03CR) 10Ahmon Dancy: [C: 03+2] Improve error reporting for bad configuration setting syntax [tools/scap] - 10https://gerrit.wikimedia.org/r/753852 (owner: 10Ahmon Dancy) [22:55:24] (03CR) 10Ahmon Dancy: [C: 03+2] scap prep: pass -Dstage_dir to scap apply patches [tools/scap] - 10https://gerrit.wikimedia.org/r/753853 (owner: 10Ahmon Dancy) [22:55:59] (03Merged) 10jenkins-bot: Improve error reporting for bad configuration setting syntax [tools/scap] - 10https://gerrit.wikimedia.org/r/753852 (owner: 10Ahmon Dancy) [22:56:04] (03Merged) 10jenkins-bot: scap prep: pass -Dstage_dir to scap apply patches [tools/scap] - 10https://gerrit.wikimedia.org/r/753853 (owner: 10Ahmon Dancy) [23:03:03] (03PS1) 10Ahmon Dancy: scap prep auto: handle master branch specially [tools/scap] - 10https://gerrit.wikimedia.org/r/753854 [23:03:59] (03CR) 10Ahmon Dancy: [C: 04-1] scap prep auto: handle master branch specially [tools/scap] - 10https://gerrit.wikimedia.org/r/753854 (owner: 10Ahmon Dancy) [23:07:30] (03CR) 10jerkins-bot: [V: 04-1] scap prep auto: handle master branch specially [tools/scap] - 10https://gerrit.wikimedia.org/r/753854 (owner: 10Ahmon Dancy) [23:10:19] (03PS2) 10Ahmon Dancy: scap prep auto: handle master branch specially [tools/scap] - 10https://gerrit.wikimedia.org/r/753854 [23:11:59] (03CR) 10Ahmon Dancy: [C: 03+2] scap prep auto: handle master branch specially [tools/scap] - 10https://gerrit.wikimedia.org/r/753854 (owner: 10Ahmon Dancy) [23:13:16] (03Merged) 10jenkins-bot: scap prep auto: handle master branch specially [tools/scap] - 10https://gerrit.wikimedia.org/r/753854 (owner: 10Ahmon Dancy) [23:44:51] Project beta-code-update-eqiad build #376181: 04FAILURE in 3 min 9 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/376181/ [23:46:42] (03PS1) 10Ahmon Dancy: Fix scap prep: pass -Dstage_dir to scap apply patches [tools/scap] - 10https://gerrit.wikimedia.org/r/753859 [23:46:43] Project beta-code-update-eqiad build #376182: 04STILL FAILING in 1 min 51 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/376182/ [23:46:55] ^ That's me. [23:47:05] (03CR) 10Ahmon Dancy: [C: 03+2] Fix scap prep: pass -Dstage_dir to scap apply patches [tools/scap] - 10https://gerrit.wikimedia.org/r/753859 (owner: 10Ahmon Dancy) [23:49:20] (03Merged) 10jenkins-bot: Fix scap prep: pass -Dstage_dir to scap apply patches [tools/scap] - 10https://gerrit.wikimedia.org/r/753859 (owner: 10Ahmon Dancy) [23:54:11] Yippee, build fixed! [23:54:12] Project beta-code-update-eqiad build #376183: 09FIXED in 1 min 48 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/376183/