[02:50:58] PROBLEM - PHD should be supervising processes on phab1001 is CRITICAL: PROCS CRITICAL: 2 processes with UID = 497 (phd) https://wikitech.wikimedia.org/wiki/Phabricator [02:53:22] RECOVERY - PHD should be supervising processes on phab1001 is OK: PROCS OK: 6 processes with UID = 497 (phd) https://wikitech.wikimedia.org/wiki/Phabricator [06:04:36] 10Release-Engineering-Team, 10GrowthExperiments, 10Performance-Team, 10Growth-Team (Current Sprint), 10Performance Issue: GrowthExperiments Special:Homepage: investigate performance regression since September 6 2022 - https://phabricator.wikimedia.org/T317187 (10kostajh) a:03kostajh [07:47:26] 10GitLab (Project Migration), 10Release-Engineering-Team: Create new GitLab project group: Community Resources Team - https://phabricator.wikimedia.org/T313593 (10Osnard) 05Open→03Resolved a:03Osnard Apparently this has been handled differently. The code now lives here https://gitlab.wikimedia.org/toolfo... [08:06:07] PROBLEM - DPKG on contint2001 is CRITICAL: DPKG CRITICAL dpkg reports broken packages https://wikitech.wikimedia.org/wiki/Monitoring/dpkg [08:07:16] ^ I am fixing it [08:09:42] (03CR) 10Jforrester: [C: 03+2] Zuul: [mediawiki/extensions/Realnames] Enable quibble composer jobs [integration/config] - 10https://gerrit.wikimedia.org/r/831208 (owner: 10Zoranzoki21) [08:13:30] (03Merged) 10jenkins-bot: Zuul: [mediawiki/extensions/Realnames] Enable quibble composer jobs [integration/config] - 10https://gerrit.wikimedia.org/r/831208 (owner: 10Zoranzoki21) [08:14:01] 10Continuous-Integration-Infrastructure, 10Jenkins, 10Release-Engineering-Team: Upgrade Jenkins to latest LTS 2.361.1 - https://phabricator.wikimedia.org/T317418 (10hashar) I have upgraded all the Jenkins from 2.346.1 to 2.346.3. There is a bit of madness due to upstream systemd unit conflicting with our P... [08:14:04] !log Zuul: [mediawiki/extensions/Realnames] Enable quibble composer jobs [08:14:05] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [08:20:33] umh. this week's deployment calendar seems to be missing? [08:22:45] taavi: that just means its a free for all, and just deploy anytime (jks) *runs away from everyone* [08:24:59] Yeah, the bot didn't post for some reason. [08:26:15] I'll see if I can manually deploy. [08:36:18] RECOVERY - DPKG on contint2001 is OK: All packages OK https://wikitech.wikimedia.org/wiki/Monitoring/dpkg [08:52:45] hashar: Can you run the deployment calendar script? [08:58:23] 10GitLab (CI & Job Runners), 10Release-Engineering-Team (Priority Backlog đŸ“Ĩ), 10Patch-For-Review, 10User-brennen: Deploy buildkitd to trusted GitLab runners - https://phabricator.wikimedia.org/T308271 (10Jelto) Thanks @dduvall for testing the Trusted Runner buildkitd setup! >>! In T308271#8225621, @dduval... [10:10:32] 10Release-Engineering-Team (Priority Backlog đŸ“Ĩ), 10Release, 10Train Deployments: 1.40.0-wmf.1 deployment blockers - https://phabricator.wikimedia.org/T314190 (10Michael) [10:15:22] 10Release-Engineering-Team (Priority Backlog đŸ“Ĩ), 10Release, 10Train Deployments: 1.40.0-wmf.1 deployment blockers - https://phabricator.wikimedia.org/T314190 (10Michael) I added T317520 as a potential blocker. Currently on Beta-Wikidata, there is an internal error on items that have a Score statement (for ex... [10:15:32] James_F: I will try :) [10:16:58] hashar: ❤ī¸ [10:19:08] hmm [10:19:14] surprise the script worked on the first try [10:20:04] James_F: https://wikitech.wikimedia.org/wiki/Deployments#Week_of_September_12 [10:20:09] I haven't checked whether the output is valid [10:21:01] it got the train dpeloyers right so I think it is all good [10:21:18] thcipriani: I have generated the Deployments calendar for this week and manually copy pasted the wikitext to the page [10:54:05] Thanks! [11:00:34] 10GitLab: Not able to login GitLab with Wikimedia Dev Account - https://phabricator.wikimedia.org/T317218 (10hashar) For tracking purposes, the issue is similar with Gerrit which expects unique email addresses T270233 [11:37:10] 10Release-Engineering-Team, 10GrowthExperiments, 10Performance-Team, 10Growth-Team (Current Sprint), 10Performance Issue: GrowthExperiments Special:Homepage: investigate performance regression since September 6 2022 - https://phabricator.wikimedia.org/T317187 (10kostajh) Here's how the last week looks:... [12:42:57] 10Phabricator, 10Developer-Advocacy (Jul-Sep 2022), 10Documentation: Update documentation about use of Priority field values to cover the reality - https://phabricator.wikimedia.org/T317533 (10Aklapper) p:05Triage→03Low [12:44:25] 10Phabricator, 10Developer-Advocacy (Jul-Sep 2022), 10Documentation: Update documentation about use of Priority field values to cover the reality - https://phabricator.wikimedia.org/T317533 (10Aklapper) 05Open→03Resolved https://www.mediawiki.org/w/index.php?title=Phabricator%2FProject_management&type=re... [12:46:36] 10GitLab (CI & Job Runners), 10Release-Engineering-Team (Priority Backlog đŸ“Ĩ), 10Patch-For-Review, 10User-brennen: Deploy buildkitd to trusted GitLab runners - https://phabricator.wikimedia.org/T308271 (10thcipriani) >>! In T308271#8228210, @Jelto wrote: >>>! In T308271#8225621, @dduvall wrote: >> @jelto, w... [15:00:05] 10Beta-Cluster-Infrastructure, 10MediaWiki-extensions-Phonos, 10Community-Tech (CommTech-Sprint-33): Phonos links to unroutable domain/URL for the MP3 file - https://phabricator.wikimedia.org/T317417 (10JMcLeod_WMF) [15:11:34] (03PS1) 10Ahmon Dancy: Release 4.18.0-1 [tools/scap] - 10https://gerrit.wikimedia.org/r/831593 [15:11:36] (03CR) 10Ahmon Dancy: [C: 03+2] Release 4.18.0-1 [tools/scap] - 10https://gerrit.wikimedia.org/r/831593 (owner: 10Ahmon Dancy) [15:16:57] (03Merged) 10jenkins-bot: Release 4.18.0-1 [tools/scap] - 10https://gerrit.wikimedia.org/r/831593 (owner: 10Ahmon Dancy) [15:18:42] (03CR) 10Ahmon Dancy: [C: 03+2] scap backport: Make internal methods "private" [tools/scap] - 10https://gerrit.wikimedia.org/r/831145 (owner: 10Jeena Huneidi) [15:22:47] (03Merged) 10jenkins-bot: scap backport: Make internal methods "private" [tools/scap] - 10https://gerrit.wikimedia.org/r/831145 (owner: 10Jeena Huneidi) [15:27:33] (03CR) 10Ahmon Dancy: Support checks running before a stage (033 comments) [tools/scap] - 10https://gerrit.wikimedia.org/r/831152 (owner: 10Hashar) [16:03:17] (03CR) 10Hashar: "I am not sure it is the best semantic to express running before a stage. I have considered a "before" and make it mutually excluding with " [tools/scap] - 10https://gerrit.wikimedia.org/r/831152 (owner: 10Hashar) [16:31:05] 10Release-Engineering-Team (Priority Backlog đŸ“Ĩ), 10Release, 10Train Deployments: 1.40.0-wmf.1 deployment blockers - https://phabricator.wikimedia.org/T314190 (10Lucas_Werkmeister_WMDE) [16:34:11] 10GitLab (CI & Job Runners), 10Release-Engineering-Team (Priority Backlog đŸ“Ĩ), 10Patch-For-Review, 10User-brennen: Deploy buildkitd to trusted GitLab runners - https://phabricator.wikimedia.org/T308271 (10Dzahn) We think it's better to maintain an explicit allow_list instead of opening it up to everything,... [17:19:11] 10GitLab (CI & Job Runners), 10Release-Engineering-Team (Priority Backlog đŸ“Ĩ), 10Patch-For-Review, 10User-brennen: Deploy buildkitd to trusted GitLab runners - https://phabricator.wikimedia.org/T308271 (10dduvall) >>! In T308271#8228210, @Jelto wrote: > Thanks @dduvall for testing the Trusted Runner buildki... [17:59:14] (03CR) 10Ahmon Dancy: Replace Lock with TimeoutLock (033 comments) [tools/scap] - 10https://gerrit.wikimedia.org/r/828075 (https://phabricator.wikimedia.org/T315531) (owner: 10Jeena Huneidi) [18:01:45] 10Phabricator, 10Release-Engineering-Team (Bonus Level 🕹ī¸), 10serviceops, 10serviceops-collab, 10Patch-For-Review: Deprecate git-ssh service on phabricator.wikimedia.org - https://phabricator.wikimedia.org/T296022 (10thcipriani) [18:01:55] 10Phabricator, 10Release-Engineering-Team (Bonus Level 🕹ī¸), 10serviceops, 10serviceops-collab: Email tool maintainers about git-ssh deprecation on phabricator - https://phabricator.wikimedia.org/T313359 (10thcipriani) 05Open→03Invalid Emailing all tool maintainers about diffusion seems a little moot gi... [18:08:34] We're having issues deploying wqds, looks like we're missing some kubernetes libs in scap? https://www.irccloud.com/pastebin/0FzbSq7I/ [18:09:17] 10Phabricator, 10Release-Engineering-Team (Bonus Level 🕹ī¸), 10serviceops, 10serviceops-collab: Email tool maintainers about git-ssh deprecation on phabricator - https://phabricator.wikimedia.org/T313359 (10Dzahn) Yea, true. I think it did. the few users that were not striker repos but were still using svn... [18:10:46] 10Phabricator, 10Release-Engineering-Team (Bonus Level 🕹ī¸), 10serviceops, 10serviceops-collab: Email tool maintainers about git-ssh deprecation on phabricator - https://phabricator.wikimedia.org/T313359 (10Dzahn) There is still T308061 about subversion repos, fwiw. [18:11:09] ryankemper mentioned we have some newly-deployed wdqs hosts, is there a scap config we need to update maybe? [18:12:28] inflatador: Taking a look [18:14:13] inflatador: Please try again [18:14:23] dancy cool, will do [18:17:00] inflatador: Is wdqs1014.eqiad.wmnet different from the other 20 targets (e.g,. in debian distribution or something)?> [18:19:27] 10Phabricator-Bot-Requests: Bot for toolforge github notifications - https://phabricator.wikimedia.org/T317564 (10rook) [18:19:59] inflatador: hieradata/common/scap/dsh.yaml [18:20:28] there is a combination of "what it gets from conftool" and directly listed hosts [18:20:35] dancy not that I know of...it was deployed at the same time as 1015 and 1016 [18:20:50] dancy: wdqs1014-1016 were somewhat recently added to the fleet, so it looks like scap wasn't aware of them, but the new scap version you just deployed seems to have fixed things dancy [18:21:00] mutante ah, thanks for the path. We were just speculating on where scap looks [18:21:20] so yeah presumably the from-conftool logic in scap/dsh.yaml requires a new scap version when new hosts get added so that the list gets updated or something [18:21:20] so the conftool part means it depends on their pool status [18:21:25] if they are "no" then they are in scap [18:21:29] if they are "invalid" then not [18:21:44] and then for whatever reason there are 2 hosts listed directly [18:22:17] inflatador: The symbol that the error message is complaining about is related to recently-added scap code, which is why rollback fixed the problem. [18:22:17] mutante: those two listed directly are because they're part of `wdqs-test`which is not behind lvs [18:22:30] ryankemper: gotcha, aha [18:22:38] are all thoses you expect to be here, in this screen? [18:22:39] https://config-master.wikimedia.org/pybal/eqiad/wdqs [18:22:45] those hosts [18:22:56] Yup that list looks correct [18:22:59] ok [18:23:43] they also nee to have the "scap::target" puppet class applied but presumably that happens automatically from an include in the role [18:24:20] Interesting, I guess we need to verify that our new hosts are getting that class [18:24:24] base on what dancy says this is unrelated though [18:24:45] 10Release-Engineering-Team, 10Scap: scap deploy problem on wdqs1014.eqiad.wmnet - https://phabricator.wikimedia.org/T317567 (10dancy) [18:24:46] yeah just a bit weird that scap didn't break when we rolled out to the canary but did break on wdqs1014 which happens to be a new host [18:25:01] naively I'd have thought it'd have broken on all or none [18:25:08] different distro version possible? [18:25:10] (the canary is wdqs1003 btw) [18:26:09] All the wdqs hosts are on buster, so I don't think it'd be the OS [18:26:15] ryankemper: 1003 does not seem to be in the scap group [18:27:17] hmm you have 2 groups, 1003 is "wdqs-internal" [18:27:21] but the other hosts are "wdqs" [18:27:38] mutante: Can you tell me what version of Python is installed on wdqs1014.eqiad.wmnet ? [18:28:19] I'm seeing 2.7.16 via `python -v` [18:28:27] python3 3.7.3-1 [18:28:29] about about `python3 -v` [18:28:34] python2.7 2.7.16-2+deb10u1 [18:28:42] thx [18:28:43] python-six 1.12.0-1 all Python 2 and 3 compatibility library (Python 2 interface) [18:28:46] :p [18:29:22] hmm.. `distutils.util` is supposed to be built-in. [18:30:18] Next test needed: `python3 -m distutils.util` [18:30:31] (should exit w/o error) [18:30:42] did the python3 -V on wdqs* via cumin. all 26 hosts are 3.7.3 [18:30:45] dancy: `/usr/bin/python3: No module named distutils.util` [18:30:53] huh [18:31:05] And I can confirm that on the hosts the deploy worked on (ex: wdqs1003, wdqs2007), it does exit w/o error [18:31:35] maybe it's not built-in [18:31:56] python3-distutils - distutils package for Python 3.x [18:32:16] new hosts (1014-16) are missing that pkg I bet [18:32:21] dancy: they're missing `python3-distutils/oldstable,now 3.7.3-1 all [installed,auto-removable]` [18:32:22] seems like a debian decision not to include it in the core package [18:32:22] (4) wdqs[2009-2012].codfw.wmnet [18:32:25] ----- OUTPUT of 'dpkg -L python3-distutils' ----- [18:32:25] thx mutante.. [18:32:28] dpkg-query: package 'python3-distutils' is not installed [18:32:32] oops, too many cooks :D [18:32:51] 16 hosts have it. 4 do not [18:32:56] ok.. that's the core of the mystery. I'll see what we need to do to deal w/ that on our side [18:33:03] Thanks everyone! [18:33:33] maybe dependencies changed [18:33:36] thanks for the help [18:33:47] +1 , thanks y'all for being responsive [18:33:56] and it used to get pullen in automatically from another package [18:35:32] inflatador: Can I hit you up in about 15-20 minutes for re-testing? [18:36:49] the package name does not appear anywhere in the repo. This seems to indicate some other package used to pull it in but now that does not happen anymore. ensure_package(['python3-distutils']) should fix it [18:38:10] dancy sure, whenever [18:38:18] Thanks. Working on a fix now [18:46:27] 10Phabricator-Bot-Requests: Bot for toolforge github notifications - https://phabricator.wikimedia.org/T317564 (10rook) [18:46:40] 10Phabricator-Bot-Requests: Bot for toolforge github notifications - https://phabricator.wikimedia.org/T317564 (10rook) [18:47:02] 10Phabricator-Bot-Requests: Bot for toolforge github notifications - https://phabricator.wikimedia.org/T317564 (10rook) [18:48:32] 10Release-Engineering-Team, 10Scap: scap deploy problem on wdqs1014.eqiad.wmnet - https://phabricator.wikimedia.org/T317567 (10dancy) [19:01:20] (03PS1) 10Ahmon Dancy: Remove dependency on distutils.util [tools/scap] - 10https://gerrit.wikimedia.org/r/831611 (https://phabricator.wikimedia.org/T317567) [19:02:53] (03PS2) 10Ahmon Dancy: Remove dependency on distutils.util [tools/scap] - 10https://gerrit.wikimedia.org/r/831611 (https://phabricator.wikimedia.org/T317567) [19:07:07] (03CR) 10Ahmon Dancy: [C: 03+2] Remove dependency on distutils.util [tools/scap] - 10https://gerrit.wikimedia.org/r/831611 (https://phabricator.wikimedia.org/T317567) (owner: 10Ahmon Dancy) [19:11:33] (03Merged) 10jenkins-bot: Remove dependency on distutils.util [tools/scap] - 10https://gerrit.wikimedia.org/r/831611 (https://phabricator.wikimedia.org/T317567) (owner: 10Ahmon Dancy) [19:14:30] (03PS1) 10Ahmon Dancy: Release 4.19.0-1 [tools/scap] - 10https://gerrit.wikimedia.org/r/831613 [19:14:32] (03CR) 10Ahmon Dancy: [C: 03+2] Release 4.19.0-1 [tools/scap] - 10https://gerrit.wikimedia.org/r/831613 (owner: 10Ahmon Dancy) [19:16:26] 10Release-Engineering-Team, 10Scap, 10Patch-For-Review: scap deploy problem on wdqs1014.eqiad.wmnet - https://phabricator.wikimedia.org/T317567 (10dancy) a:03dancy [19:17:32] (03Merged) 10jenkins-bot: Release 4.19.0-1 [tools/scap] - 10https://gerrit.wikimedia.org/r/831613 (owner: 10Ahmon Dancy) [19:20:37] inflatador: Ready for re-retest [19:21:12] I expect it to be successful so I'm going to step out for a break. I'll check on status in about 30 mins [19:23:47] dancy ACK, trying now [19:27:17] 10GitLab (CI & Job Runners), 10Release-Engineering-Team (Priority Backlog đŸ“Ĩ), 10Patch-For-Review, 10User-brennen: Deploy buildkitd to trusted GitLab runners - https://phabricator.wikimedia.org/T308271 (10thcipriani) >>! In T308271#8229736, @dduvall wrote: >>>! In T308271#8229560, @Dzahn wrote: >> We think... [19:28:56] dancy looks like it worked. No errors on 1014-16 even though they don't have the distutils.util lib [19:31:24] 10Release-Engineering-Team (Blocking 🧱), 10Data Pipelines (Sprint 01): Increase maximum artifacts size on Gitlab Registry to accommodate files >1GB - https://phabricator.wikimedia.org/T317555 (10thcipriani) [19:35:03] dancy: nice fix! [19:35:38] removing the dependency altogether I mean :) [19:49:08] 👍 [19:58:50] yea, that's a nice way :) [20:38:32] !log (for lack of a better place) added Cyberpower678 to acl*userdisable. has enough clue, fairly active and trusted. [20:38:32] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [20:48:42] now that the striker repos have moved.. [20:48:50] I guess I can just shut down git-ssh on prod phab [20:49:00] and nobody should complain [20:49:13] the few other cases had already been mailed in the past [20:55:48] 10Release-Engineering-Team (Priority Backlog đŸ“Ĩ), 10Release, 10Train Deployments: 1.40.0-wmf.1 deployment blockers - https://phabricator.wikimedia.org/T314190 (10Jdlrobson) Potentially risky change: We've made a small change to the backend that impacts all mobile views. It should result in improved performan... [21:02:15] 10Phabricator, 10Release-Engineering-Team (Bonus Level 🕹ī¸), 10serviceops, 10serviceops-collab: Email tool maintainers about git-ssh deprecation on phabricator - https://phabricator.wikimedia.org/T313359 (10Dzahn) @thcipriani I think it also means I can just shutdown git-ssh and it should not affect anyone.... [21:06:29] 10Phabricator, 10Release-Engineering-Team (Bonus Level 🕹ī¸), 10serviceops, 10serviceops-collab: Email tool maintainers about git-ssh deprecation on phabricator - https://phabricator.wikimedia.org/T313359 (10thcipriani) >>! In T313359#8230507, @Dzahn wrote: > @thcipriani I think it also means I can just shut... [21:39:04] 10Release-Engineering-Team, 10Scap: scap deploy problem on wdqs1014.eqiad.wmnet - https://phabricator.wikimedia.org/T317567 (10dancy) 05Open→03Resolved [21:48:58] 10Phabricator-Bot-Requests: phab-ban should tell you you're not authorized before requesting a ban - https://phabricator.wikimedia.org/T317584 (10Platonides) [21:49:16] 10Phabricator-Bot-Requests, 10User-bd808: phab-ban should tell you you're not authorized before requesting a ban - https://phabricator.wikimedia.org/T317584 (10Platonides) a:03bd808 [21:58:30] 10Release-Engineering-Team (Blocking 🧱), 10Data Pipelines (Sprint 01): Increase maximum artifacts size on Gitlab Registry to accommodate files >1GB - https://phabricator.wikimedia.org/T317555 (10thcipriani) > The current artifact size exceeds the soft limit of 1GB. > https://gitlab.wikimedia.org/repos/data-eng... [22:01:10] (03PS1) 10Ahmon Dancy: Remove references to refreshMessageBlobs.php [tools/scap] - 10https://gerrit.wikimedia.org/r/831628 (https://phabricator.wikimedia.org/T314947) [22:13:27] 10Phabricator-Bot-Requests, 10User-bd808: phab-ban should tell you you're not authorized before requesting a ban - https://phabricator.wikimedia.org/T317584 (10Dzahn) The list of users allowed to ban users can be found at https://phabricator.wikimedia.org/project/members/3442/ Is it also an access request to... [22:14:47] 10Phabricator, 10Release-Engineering-Team (Bonus Level 🕹ī¸), 10serviceops, 10serviceops-collab, 10Patch-For-Review: Deprecate git-ssh service on phabricator.wikimedia.org - https://phabricator.wikimedia.org/T296022 (10Dzahn) [22:15:04] 10Phabricator, 10Release-Engineering-Team (Bonus Level 🕹ī¸), 10serviceops, 10serviceops-collab, 10Patch-For-Review: Deprecate git-ssh service on phabricator.wikimedia.org - https://phabricator.wikimedia.org/T296022 (10Dzahn) [22:15:33] 10Phabricator, 10Release-Engineering-Team (Bonus Level 🕹ī¸), 10serviceops, 10serviceops-collab, 10Patch-For-Review: Deprecate git-ssh service on phabricator.wikimedia.org - https://phabricator.wikimedia.org/T296022 (10Dzahn) also T313359#8230507 [22:15:53] !log Updating development images on contint primary for https://gitlab.wikimedia.org/repos/releng/dev-images/-/merge_requests/19 [22:15:54] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [22:17:00] 10Phabricator, 10Release-Engineering-Team (Bonus Level 🕹ī¸), 10serviceops, 10serviceops-collab, 10Patch-For-Review: Deprecate git-ssh service on phabricator.wikimedia.org - https://phabricator.wikimedia.org/T296022 (10Dzahn) striker repos have been migrated:) (Thanks @bd808!) Hmm. now..I still notice th... [22:18:40] bd808: boldy clicking "deactivate repository" on Phabricator if the repo name starts with "tool-*" (deactivate, not delete) [22:18:56] sees tool-ranker f.e. [22:19:44] "Observation and mirroring will cease, and pushing and pulling will be disabled. You can reactivate the repository later." [22:22:12] (03PS1) 10Dduvall: docs: Describe SCAP_REVS_DIR, SCAP_CURRENT_REV_DIR, SCAP_DONE_REV_DIR [tools/scap] - 10https://gerrit.wikimedia.org/r/831630 [22:25:49] well.. actually some are in a weird state. they show up in "active repos" filter but if you manage them it's like they were deactivated already and you only delete [22:26:48] and now it's fixed.. "query overheated" ok [22:29:27] aha.. a special case was able to edit their own ACL for the repo so admins cant deactivate it :p [22:30:13] since it does not have any commits.. I'll have to use the big hammer [22:36:43] mutante - hrm, a bit of discussion about this in #wikimedia-gitlab the other day, but i think we want to retain tool repos that are mirrors of the gitlab ones? [22:38:28] > brennen, thcipriani: I am now wondering if Striker should setup a Diffusion mirror for each gitlab repo it creates. This happened as a side effect for the repos I just migrated so there will be a feature gap growing for each new repo going forward. Github gives a much better (IMO) code browser than gitiles, but It can be really nice to be able to link to a git hash in [22:38:31] Phabricator. Thoughts? [22:38:44] ehm,the point was to stop using Phabricator for repos [22:39:40] we can link to git hashes in Gerrit [22:39:44] tried it [22:41:23] there were only a handful of active tool repos and none of them had commits [22:41:47] so it doesn't look like there are mirrors [22:42:15] and I did not deactivate anything that had a commit [22:44:14] there are 2 special cases that made themselves "undeactivatable" and "undeletable" by editing the ACLs in such a way that I can't even change it [22:45:09] I realize those are unrelated points.. it's just because I am looking at the list of "active repos" and what is left there [22:45:23] ack - i also may be misunderstanding something here, just thought i'd mention that earlier discussion. [22:46:47] brennen: here's the thing. I am only filtering for repos "hosted on phabricator", but when Bryan does mirrors those are repos but not "hosted on" [22:47:35] so there is that definition what "using phab for repos" means.. but I only look at those where phab is the source [22:48:12] gotcha [22:50:45] yeah, this is the thing in the phab remarkup parser that links things like "abc123" (without the quotes) to the relevant commit message [22:51:27] so not repos "hosted on phabricator" but repos mirrored there for that purpose [22:51:35] the purpose of magic remarkup. [22:54:54] among remaining repos: [22:54:56] rSCAPEXT SCAP Extension Framework [22:54:57] :) [22:55:18] https://phabricator.wikimedia.org/source/scap-ext/ [22:55:42] doesn't look like scap3, does it [22:56:24] thcipriani: ACK.. so we do still have a couple MW extension repos that have commits and are not deactivated yet [22:56:41] I can try to get the list.. then maybe we use the email after all [22:57:33] https://phabricator.wikimedia.org/source/phab-extensions/ [22:59:02] talking to Andre about the "undeletable" ones, might use the "destroy" scripts [23:00:23] keep running into "Query Overheated" though right now [23:09:34] (03CR) 10Dzahn: "thanks for this!" [tools/scap] - 10https://gerrit.wikimedia.org/r/831630 (owner: 10Dduvall)