[04:23:57] (03PS1) 10Hslater: Add new extension Checklists [integration/config] - 10https://gerrit.wikimedia.org/r/969524 [04:38:29] (03PS1) 10Hslater: Add new extension DateTimeTools [integration/config] - 10https://gerrit.wikimedia.org/r/969526 [05:09:39] (03PS1) 10Hslater: Add new extension EnhancedStandardUIs [integration/config] - 10https://gerrit.wikimedia.org/r/969530 [06:41:28] 10Phabricator, 10Release-Engineering-Team (Priority Backlog 📥), 10Patch-For-Review, 10User-brennen: Work out how to bring in new Phabricator translations again - https://phabricator.wikimedia.org/T318763 (10Nikerabbit) We have a little bit of fuzzy matching logic, but processing thousands of changes at a t... [08:47:48] 10Release-Engineering-Team, 10Wikibase Product Platform Team WPP (Sprint 5), 10ci-test-error (WMF-deployed Build Failure): Wikibase CI is broken - https://phabricator.wikimedia.org/T348243 (10Jakob_WMDE) @hashar this error keeps coming back :/ ` 08:26:09 npm ERR! code FETCH_ERROR 08:26:09 npm ERR! errno FET... [08:58:27] (03CR) 10Hashar: Add new extension Checklists (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/969524 (owner: 10Hslater) [08:59:16] Hi! We have this MR to setup CI for a new lib my team is working on: https://gitlab.wikimedia.org/repos/content-transform/nodejs-cassandra-storage/-/merge_requests/3. Since gitlab CI is fairly new for us can somebody from releng review it? [09:00:43] (03PS2) 10Hashar: Add VisualEditor as dependency to Checklists [integration/config] - 10https://gerrit.wikimedia.org/r/969524 (owner: 10Hslater) [09:00:45] (03PS2) 10Hashar: Add VisualEditor as dependency to DateTimeTools [integration/config] - 10https://gerrit.wikimedia.org/r/969526 (owner: 10Hslater) [09:00:47] (03PS2) 10Hashar: Add OOJSPlus as depdendency to EnhancedStandardUIs [integration/config] - 10https://gerrit.wikimedia.org/r/969530 (owner: 10Hslater) [09:01:44] (03CR) 10Hashar: [C: 03+2] Add VisualEditor as dependency to Checklists [integration/config] - 10https://gerrit.wikimedia.org/r/969524 (owner: 10Hslater) [09:01:44] (03CR) 10Hashar: [C: 03+2] Add VisualEditor as dependency to DateTimeTools [integration/config] - 10https://gerrit.wikimedia.org/r/969526 (owner: 10Hslater) [09:02:01] (03CR) 10Hashar: [C: 03+2] Add OOJSPlus as depdendency to EnhancedStandardUIs [integration/config] - 10https://gerrit.wikimedia.org/r/969530 (owner: 10Hslater) [09:02:16] (03CR) 10Hashar: [C: 03+2] Zuul: [mediawiki/extensions/PDFEmbed] Add basic CI [integration/config] - 10https://gerrit.wikimedia.org/r/969427 (owner: 10Zoranzoki21) [09:02:30] (03CR) 10Hashar: [C: 03+2] Zuul: Archive the OnlineStatus extension [integration/config] - 10https://gerrit.wikimedia.org/r/969477 (https://phabricator.wikimedia.org/T349956) (owner: 10Zoranzoki21) [09:03:45] (03Merged) 10jenkins-bot: Add VisualEditor as dependency to Checklists [integration/config] - 10https://gerrit.wikimedia.org/r/969524 (owner: 10Hslater) [09:03:47] (03Merged) 10jenkins-bot: Add VisualEditor as dependency to DateTimeTools [integration/config] - 10https://gerrit.wikimedia.org/r/969526 (owner: 10Hslater) [09:03:49] (03Merged) 10jenkins-bot: Add OOJSPlus as depdendency to EnhancedStandardUIs [integration/config] - 10https://gerrit.wikimedia.org/r/969530 (owner: 10Hslater) [09:03:59] (03Merged) 10jenkins-bot: Zuul: [mediawiki/extensions/PDFEmbed] Add basic CI [integration/config] - 10https://gerrit.wikimedia.org/r/969427 (owner: 10Zoranzoki21) [09:04:08] (03Merged) 10jenkins-bot: Zuul: Archive the OnlineStatus extension [integration/config] - 10https://gerrit.wikimedia.org/r/969477 (https://phabricator.wikimedia.org/T349956) (owner: 10Zoranzoki21) [09:46:06] (03CR) 10Hashar: [V: 03+2 C: 03+2] "That got applied to test/gerrit-ping via https://gerrit.wikimedia.org/r/c/test/gerrit-ping/+/931873" [All-Projects] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/919831 (https://phabricator.wikimedia.org/T336660) (owner: 10Hashar) [09:46:33] (03CR) 10Hashar: [V: 03+2 C: 03+2] Do not carry Verified score on no change (032 comments) [All-Projects] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/919831 (https://phabricator.wikimedia.org/T336660) (owner: 10Hashar) [09:47:12] (03PS1) 10Hashar: Revert "Set label["Verified"].copyAllScoresIfNoChange = false" [test/gerrit-ping] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/969362 [09:47:43] (03PS2) 10Hashar: Revert "Set label["Verified"].copyAllScoresIfNoChange = false" [test/gerrit-ping] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/969362 (https://phabricator.wikimedia.org/T336660) [09:47:58] (03CR) 10Hashar: [V: 03+2 C: 03+2] Revert "Set label["Verified"].copyAllScoresIfNoChange = false" [test/gerrit-ping] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/969362 (https://phabricator.wikimedia.org/T336660) (owner: 10Hashar) [09:50:58] 10Continuous-Integration-Config, 10Gerrit, 10Patch-For-Review, 10Upstream: mwext-phpunit-coverage-patch-docker votes, gets overridden - https://phabricator.wikimedia.org/T336660 (10hashar) 05Open→03Resolved @jbond reported last week the issue occurred on https://gerrit.wikimedia.org/r/c/operations/pupp... [09:55:06] 10Release-Engineering-Team (Social Piranhas 🐟), 10Quibble: Quibble support for repositories cloned with canonical name (no clonemapper) - https://phabricator.wikimedia.org/T349741 (10hashar) [10:17:24] 10GitLab (Misc), 10Release-Engineering-Team (Priority Backlog 📥): Investigate and document stacked merge requests - https://phabricator.wikimedia.org/T300819 (10kostajh) One thing that gerritlab doesn't solve is the ability to +2 a patch without it merging into the next one in the stack. e.g. in gerrit, one ca... [10:33:34] 10Phabricator (Upstream), 10I18n, 10Upstream: Many i18n strings in Phabricator i18n contain trailing whitespace ("\n" at the end) - https://phabricator.wikimedia.org/T272562 (10Aklapper) [10:53:37] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team, 10Incident-Reporting-System, 10Trust and Safety Tools Team Backlog, 10ci-test-error (WMF-deployed Build Failure): invalid json response body at https://registry.npmjs.org/vue reason: Invalid res... - https://phabricator.wikimedia.org/T349986 [11:18:39] !log integration-castor05: clearing corrupted npm cache: `sudo rm -fR /srv/castor/castor-mw-ext-and-skins/master/mwgate-node16-docker` # T349986 [11:18:42] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [11:18:43] T349986: invalid json response body at https://registry.npmjs.org/vue reason: Invalid response body while trying to fetch https://registry.npmjs.org/vue: ENOENT: no such file or directory - https://phabricator.wikimedia.org/T349986 [11:19:48] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team, 10Incident-Reporting-System, 10Trust and Safety Tools Team Backlog, and 2 others: invalid json response body at https://registry.npmjs.org/vue reason: Invalid response body while trying to fetch h... - https://phabricator.wikimedia.org/T349986 [11:22:55] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team, 10Incident-Reporting-System, 10Trust and Safety Tools Team Backlog, and 2 others: invalid json response body at https://registry.npmjs.org/vue reason: Invalid response body while trying to fetch h... - https://phabricator.wikimedia.org/T349986 [11:49:25] 10Release-Engineering-Team, 10Wikibase Product Platform Team WPP (Sprint 5), 10ci-test-error (WMF-deployed Build Failure): Wikibase CI is broken - https://phabricator.wikimedia.org/T348243 (10Lucas_Werkmeister_WMDE) (I think this latest instance was fixed in T349986.) [12:00:53] 10WikimediaDebug, 10MediaWiki-Platform-Team, 10Observability-Tracing, 10MW-1.41-notes (1.41.0-wmf.27; 2023-09-19): Add support for request tracing to WikimediaDebug browser extension - https://phabricator.wikimedia.org/T340573 (10pmiazga) Let me move this to "Blocked/waiting" on the Platform Team Board. We... [12:25:29] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team, 10Incident-Reporting-System, 10Trust and Safety Tools Team Backlog, and 2 others: invalid json response body at https://registry.npmjs.org/vue reason: Invalid response body while trying to fetch h... - https://phabricator.wikimedia.org/T349986 [14:56:59] 10GitLab (CI & Job Runners), 10mwbot-rs: mwbot-rs large cache usage on Gitlab CI - https://phabricator.wikimedia.org/T333663 (10dancy) >>! In T333663#9017232, @Legoktm wrote: >>>! In T333663#8748152, @Legoktm wrote: >> I'm putting in the above as a stop-gap for the disk space issue, but after thinking about it... [15:20:30] 10Gitlab-Application-Security-Pipeline, 10Patch-For-Review, 10SecTeam-Processed, 10Security, 10user-sbassett: Improve related gitlab test repository - https://phabricator.wikimedia.org/T348788 (10CodeReviewBot) mmartorana merged https://gitlab.wikimedia.org/repos/security/ci-cd-testing-gitlab-ci-security... [15:45:44] 10Release-Engineering-Team, 10Wikibase Product Platform Team WPP (Sprint 5), 10ci-test-error (WMF-deployed Build Failure): Wikibase CI is broken - https://phabricator.wikimedia.org/T348243 (10Jakob_WMDE) 05Resolved→03Open @hashar thanks for fixing this earlier. Unfortunately it looks like the error is ba... [16:32:49] * kostajh Seeing some intermittent MySQL connection errors on phabricator.wikimedia.org [17:04:06] kostajh: has been raised in both #wikimedia-sre and #wikimedia-data-persistence [17:21:59] 10Release-Engineering-Team, 10Security-Team: Notify MediaWiki security tasks as soon as an uploaded patch fails to apply - https://phabricator.wikimedia.org/T350065 (10thcipriani) [18:11:34] 10Release-Engineering-Team, 10Security-Team: Ensure no security patches is an error condition for MediaWiki deploys - https://phabricator.wikimedia.org/T350070 (10thcipriani) [18:38:45] 10Phabricator: PhutilAggregateException: #2006: MySQL server has gone away - https://phabricator.wikimedia.org/T349961 (10AlexisJazz) Taking a shot in the dark: maybe in [[https://phabricator.wikimedia.org/phame/post/view/307/from_phabricator_to_phorge/|the transition from Phabricator to Phorge]] (or some other... [18:44:42] 10Continuous-Integration-Infrastructure, 10translatewiki.net: L10n-bot should not force-merge / override Jenkins (breaks the build) - https://phabricator.wikimedia.org/T91707 (10matmarex) L10n-bot just broke the build today D: https://gerrit.wikimedia.org/r/c/mediawiki/core/+/969820 [18:45:17] 10Phabricator: PhutilAggregateException: #2006: MySQL server has gone away - https://phabricator.wikimedia.org/T349961 (10thcipriani) Thanks for the task! Doubtful it's Phorge since nothing has changed there recently and really it's just one big server serving everyone. Either something's up with mysql or there... [18:56:57] 10Continuous-Integration-Infrastructure, 10translatewiki.net: L10n-bot should not force-merge / override Jenkins (breaks the build) - https://phabricator.wikimedia.org/T91707 (10Nikerabbit) This scenario is supposed to be impossible: https://translatewiki.net/wiki/Repository_management#Message_group_synchroniz... [19:46:08] 10Phabricator: PhutilAggregateException: #2006: MySQL server has gone away - https://phabricator.wikimedia.org/T349961 (10thcipriani) 05Open→03Resolved a:03RLazarus Added a requestctl rule to block some aggressive/expensive crawling that accounted for about ⅓ of our daily traffic and > ½ our traffic over t... [20:01:36] thcipriani: anyone for UTC late? [20:23:31] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team, 10Incident-Reporting-System, 10Trust and Safety Tools Team Backlog, and 2 others: invalid json response body at https://registry.npmjs.org/vue reason: Invalid response body while trying to fetch h... - https://phabricator.wikimedia.org/T349986 [20:27:09] !log Ran jforrester@integration-castor05:~$ sudo rm -fR /srv/castor/castor-mw-ext-and-skins/master/mwext-node16-rundoc-docker to clean out corrupted cache [20:27:11] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [20:29:22] !log Ran `sudo rm -fR /srv/castor/castor-mw-ext-and-skins/master/mwgate-node16-docker/` on integration-castor05 too for T349986 [20:29:25] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [20:29:25] T349986: invalid json response body at https://registry.npmjs.org/vue reason: Invalid response body while trying to fetch https://registry.npmjs.org/vue: ENOENT: no such file or directory - https://phabricator.wikimedia.org/T349986 [20:30:05] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team, 10Incident-Reporting-System, 10Trust and Safety Tools Team Backlog, and 2 others: invalid json response body at https://registry.npmjs.org/vue reason: Invalid response body while trying to fetch h... - https://phabricator.wikimedia.org/T349986 [20:52:21] 10GitLab, 10Release-Engineering-Team (Social Piranhas 🐟): Create development environment for hacking on Zuul/GitLab - https://phabricator.wikimedia.org/T349923 (10dduvall) 05Open→03Resolved The development environment now includes a GitLab runner and is generally working. [20:52:24] 10GitLab (Misc), 10Release-Engineering-Team (Priority Backlog 📥): Investigate and document "Depends-On" in GitLab - https://phabricator.wikimedia.org/T349872 (10dduvall) [22:26:52] Whee, train task time. [22:27:29] 10Release-Engineering-Team (Priority Backlog 📥), 10Release, 10Train Deployments: 1.42.0-wmf.4 deployment blockers - https://phabricator.wikimedia.org/T350080 (10thcipriani) p:05Triage→03Medium a:03jnuche [22:27:57] 10Release-Engineering-Team (Priority Backlog 📥), 10Release, 10Train Deployments: 1.42.0-wmf.5 deployment blockers - https://phabricator.wikimedia.org/T350081 (10thcipriani) p:05Triage→03Medium a:03jeena