[00:25:11] Project beta-code-update-eqiad build #484434: 04FAILURE in 2 min 11 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/484434/ [00:31:43] 10Release-Engineering-Team (Now this 🫠), 10Scap, 10MW-on-K8s, 10SRE, and 2 others: Scap should check errors coming from mw-on-k8s canaries during deployments - https://phabricator.wikimedia.org/T357402#9565937 (10CodeReviewBot) thcipriani merged https://gitlab.wikimedia.org/repos/releng/scap/-/merge_reques... [00:35:20] Yippee, build fixed! [00:35:20] Project beta-code-update-eqiad build #484435: 09FIXED in 2 min 20 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/484435/ [07:36:44] 10Release-Engineering-Team (Priority Backlog πŸ“₯), 10Release, 10Train Deployments: 1.42.0-wmf.12 deployment blockers - https://phabricator.wikimedia.org/T350088#9566394 (10Nikerabbit) [08:56:18] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Priority Backlog πŸ“₯), 10SRE, 10Patch-For-Review: The python-build images regenerate wheels even when matching ones are already available - https://phabricator.wikimedia.org/T259611#9566586 (10hashar) That has been solved by setting PIP_FIN... [09:03:38] 10Gerrit, 10Upstream: Allow for group admins to create project repositories inside a parent project - https://phabricator.wikimedia.org/T38937#9566625 (10QChris) Nice! But in addition to plain project creation in our Gerrit, we also do the following tasks that are not covered by the plugin: * create a corresp... [09:55:54] 10Release-Engineering-Team, 10collaboration-services: No email received for latest train presync - https://phabricator.wikimedia.org/T358009#9566723 (10jnuche) The email finally arrived in my inbox today at 02:27 UTC +1. Maybe this was a one-time hiccup on the Google side. I'm gonna keep an eye on this, if we... [10:18:25] 10Release-Engineering-Team, 10collaboration-services: No email received for latest train presync - https://phabricator.wikimedia.org/T358009#9566811 (10Peachey88) There was a issue with mailman, lego did their magic earlier today and cleared the blacklog, see the backlog on irc in `#-tech` which may explain th... [10:25:08] 10Release-Engineering-Team, 10collaboration-services: No email received for latest train presync - https://phabricator.wikimedia.org/T358009#9566836 (10jnuche) 05Openβ†’03Resolved a:03jnuche @Peachey88 thanks for the update. More details of the incident at T358020. Closing this task [10:36:07] 10Release-Engineering-Team (Radar), 10Tech-Docs-Team, 10Documentation: Improve deployment pipeline documentation structure - https://phabricator.wikimedia.org/T352264#9566902 (10KBach) Structure change proposals are WIP, going through preliminary rounds of reviews and improvements: * https://www.mediawiki.or... [10:37:40] 10Release-Engineering-Team (Radar), 10Tech-Docs-Team, 10Documentation: Deployment pipeline (GitLab/Kokkuri/Blubber) documentation improvements - https://phabricator.wikimedia.org/T342317#9566908 (10KBach) [10:38:12] 10Release-Engineering-Team, 10Tech-Docs-Team, 10Documentation: Review supporting deployment pipeline documentation - https://phabricator.wikimedia.org/T352262#9566906 (10KBach) 05Openβ†’03In progress a:03KBach [10:41:10] 10Release-Engineering-Team, 10Tech-Docs-Team, 10Documentation: Review supporting deployment pipeline documentation - https://phabricator.wikimedia.org/T352262#9566920 (10KBach) [10:47:38] 10Release-Engineering-Team (Now this 🫠), 10Scap, 10MW-on-K8s, 10SRE, 10serviceops: Find a way to address canary releases directly - https://phabricator.wikimedia.org/T358117#9566949 (10Clement_Goubert) We've talked this over, and while doing swagger checks made sense when there were just a few canaries o... [13:08:00] 10Release-Engineering-Team (Seen), 10MW-on-K8s, 10SRE, 10Traffic, and 2 others: Migrate internal traffic to k8s - https://phabricator.wikimedia.org/T333120#9567484 (10Clement_Goubert) [13:47:51] do folks know of a way to get gerrit notification emails when a patch goes to an extension, without being autoadded as a reviewer? I'm interested in tracking changes to one but I don't have the requisite background to review those changes [13:48:48] I dunno if the reviewbot has some secret capability like this [13:51:47] I think you can do that in https://gerrit.wikimedia.org/r/settings/#Notifications? https://tmp.lucaswerkmeister.de/gerrit-notifications.png [13:55:05] 10Beta-Cluster-Infrastructure, 10MediaWiki-Platform-Team: Set up some beta cluster wikis with different registrable domain - https://phabricator.wikimedia.org/T355281#9567675 (10taavi) >>! In T355281#9564701, @pmiazga wrote: > @taavi - quick question - do you think we should keep the `.beta` part in the URL?... [14:24:50] oh that's grand, thank you very much! [14:48:53] 10Continuous-Integration-Config, 10Release-Engineering-Team (Now this 🫠), 10Language-Team (Language-2024-January-March), 10Patch-For-Review, 10affects-translatewiki.net: jenkins.job=mediawiki-i18n-check-docker fails: couldnot lock config file .gitconfig: ... - https://phabricator.wikimedia.org/T331098#9567894 [14:58:57] (03PS1) 10Hashar: jjb: fix mediawiki-i18n-check-docker empty error [integration/config] - 10https://gerrit.wikimedia.org/r/1005774 (https://phabricator.wikimedia.org/T331098) [15:03:01] (03PS2) 10Hashar: jjb: fix mediawiki-i18n-check-docker empty error [integration/config] - 10https://gerrit.wikimedia.org/r/1005774 (https://phabricator.wikimedia.org/T331098) [15:03:05] (03PS2) 10Hashar: jjb: enhance mediawiki-i18n-check job [integration/config] - 10https://gerrit.wikimedia.org/r/1005049 (https://phabricator.wikimedia.org/T331098) [15:07:01] 10Continuous-Integration-Config, 10Release-Engineering-Team (Now this 🫠), 10Language-Team (Language-2024-January-March), 10Patch-For-Review, 10affects-translatewiki.net: jenkins.job=mediawiki-i18n-check-docker fails: couldnot lock config file .gitconfig: ... - https://phabricator.wikimedia.org/T331098#9568019 [15:09:00] (03CR) 10Hashar: [C: 03+2] jjb: fix mediawiki-i18n-check-docker empty error [integration/config] - 10https://gerrit.wikimedia.org/r/1005774 (https://phabricator.wikimedia.org/T331098) (owner: 10Hashar) [15:09:04] (03CR) 10Hashar: [C: 03+2] jjb: enhance mediawiki-i18n-check job [integration/config] - 10https://gerrit.wikimedia.org/r/1005049 (https://phabricator.wikimedia.org/T331098) (owner: 10Hashar) [15:09:33] (03PS1) 10Pwangai: Zuul: [mediawiki/extensions/ContactPage] Enable Sonar Codehealth [integration/config] - 10https://gerrit.wikimedia.org/r/1005778 (https://phabricator.wikimedia.org/T321837) [15:10:40] (03Merged) 10jenkins-bot: jjb: fix mediawiki-i18n-check-docker empty error [integration/config] - 10https://gerrit.wikimedia.org/r/1005774 (https://phabricator.wikimedia.org/T331098) (owner: 10Hashar) [15:10:44] (03Merged) 10jenkins-bot: jjb: enhance mediawiki-i18n-check job [integration/config] - 10https://gerrit.wikimedia.org/r/1005049 (https://phabricator.wikimedia.org/T331098) (owner: 10Hashar) [15:11:07] 10Release-Engineering-Team (Seen), 10Content-Transform-Team, 10MW-on-K8s, 10SRE, and 3 others: Create parsoid mediawiki deployment and migrate parsoid-php.discovery.wmnet traffic to it - https://phabricator.wikimedia.org/T357392#9568026 (10akosiaris) [15:11:17] (03PS1) 10Pwangai: Zuul: [mediawiki/extensions/Disambiguator] Enable Sonar Codehealth [integration/config] - 10https://gerrit.wikimedia.org/r/1005781 (https://phabricator.wikimedia.org/T321837) [15:12:05] (03PS1) 10Pwangai: Zuul: [mediawiki/extensions/ReadingLists] Enable Sonar Codehealth [integration/config] - 10https://gerrit.wikimedia.org/r/1005782 (https://phabricator.wikimedia.org/T321837) [15:13:14] 10Continuous-Integration-Config, 10Release-Engineering-Team (Now this 🫠), 10Language-Team (Language-2024-January-March), 10Patch-For-Review, 10affects-translatewiki.net: jenkins.job=mediawiki-i18n-check-docker fails: couldnot lock config file .gitconfig: ... - https://phabricator.wikimedia.org/T331098#9568041 [15:13:19] (03PS1) 10Pwangai: Zuul: [mediawiki/extensions/FlaggedRevs] Enable Sonar Codehealth [integration/config] - 10https://gerrit.wikimedia.org/r/1005783 (https://phabricator.wikimedia.org/T321837) [15:14:20] (03CR) 10Hashar: [C: 03+2] Zuul: [mediawiki/extensions/ContactPage] Enable Sonar Codehealth [integration/config] - 10https://gerrit.wikimedia.org/r/1005778 (https://phabricator.wikimedia.org/T321837) (owner: 10Pwangai) [15:14:24] (03CR) 10Hashar: [C: 03+2] Zuul: [mediawiki/extensions/Disambiguator] Enable Sonar Codehealth [integration/config] - 10https://gerrit.wikimedia.org/r/1005781 (https://phabricator.wikimedia.org/T321837) (owner: 10Pwangai) [15:14:27] (03CR) 10Hashar: [C: 03+2] Zuul: [mediawiki/extensions/FlaggedRevs] Enable Sonar Codehealth [integration/config] - 10https://gerrit.wikimedia.org/r/1005783 (https://phabricator.wikimedia.org/T321837) (owner: 10Pwangai) [15:14:31] (03CR) 10Hashar: [C: 03+2] Zuul: [mediawiki/extensions/ReadingLists] Enable Sonar Codehealth [integration/config] - 10https://gerrit.wikimedia.org/r/1005782 (https://phabricator.wikimedia.org/T321837) (owner: 10Pwangai) [15:14:41] 10GitLab (CI & Job Runners), 10Data-Engineering, 10Performance Issue: Improve speed of Gitlab CI - https://phabricator.wikimedia.org/T311111#9568057 (10Antoine_Quhen) 05Openβ†’03Resolved a:03Antoine_Quhen Done. The last version was done with Blubber: * https://gitlab.wikimedia.org/repos/data-engineering/... [15:17:27] (03Merged) 10jenkins-bot: Zuul: [mediawiki/extensions/ContactPage] Enable Sonar Codehealth [integration/config] - 10https://gerrit.wikimedia.org/r/1005778 (https://phabricator.wikimedia.org/T321837) (owner: 10Pwangai) [15:17:36] (03Merged) 10jenkins-bot: Zuul: [mediawiki/extensions/Disambiguator] Enable Sonar Codehealth [integration/config] - 10https://gerrit.wikimedia.org/r/1005781 (https://phabricator.wikimedia.org/T321837) (owner: 10Pwangai) [15:17:38] (03Merged) 10jenkins-bot: Zuul: [mediawiki/extensions/FlaggedRevs] Enable Sonar Codehealth [integration/config] - 10https://gerrit.wikimedia.org/r/1005783 (https://phabricator.wikimedia.org/T321837) (owner: 10Pwangai) [15:17:53] (03Merged) 10jenkins-bot: Zuul: [mediawiki/extensions/ReadingLists] Enable Sonar Codehealth [integration/config] - 10https://gerrit.wikimedia.org/r/1005782 (https://phabricator.wikimedia.org/T321837) (owner: 10Pwangai) [15:36:48] 10GitLab: GitLab header logo blocks top portion of page - https://phabricator.wikimedia.org/T358234#9568169 (10stwalkerster) [15:52:04] 10Beta-Cluster-Infrastructure, 10Math, 10Mathoid: Cannot create a new wiki on beta cluster - https://phabricator.wikimedia.org/T358236#9568255 (10pmiazga) [15:53:40] 10Beta-Cluster-Infrastructure, 10MediaWiki-Platform-Team: Set up some beta cluster wikis with different registrable domain - https://phabricator.wikimedia.org/T355281#9568280 (10pmiazga) Cannot move forward due to Mathoid/BetaCluster problem - https://phabricator.wikimedia.org/T358236 - the AddWiki script fail... [15:57:51] 10Beta-Cluster-Infrastructure, 10Math, 10Mathoid: Cannot create a new wiki on beta cluster - https://phabricator.wikimedia.org/T358236#9568306 (10pmiazga) As a quick solution, I think we could bring the SQL files that were removed in https://gerrit.wikimedia.org/r/c/mediawiki/extensions/Math/+/975432 [15:59:01] 10Continuous-Integration-Infrastructure, 10vm-requests: Ganeti VM for contint migration - https://phabricator.wikimedia.org/T358237#9568310 (10hashar) [15:59:30] 10Continuous-Integration-Infrastructure, 10vm-requests: Ganeti VM for contint migration - https://phabricator.wikimedia.org/T358237#9568326 (10hashar) [15:59:34] 10Release-Engineering-Team (Radar), 10collaboration-services: upgrade contint servers to bullseye - https://phabricator.wikimedia.org/T334517#9568327 (10hashar) [16:07:31] 10Beta-Cluster-Infrastructure, 10Math, 10Mathoid: Cannot create a new wiki on beta cluster - https://phabricator.wikimedia.org/T358236#9568389 (10pmiazga) Another suggestion from @matmarex is to update the AddWiki script - after reading T349442 looks like those SQL files were removed intentionally. I'll up... [16:08:07] 10Beta-Cluster-Infrastructure, 10Math, 10Mathoid, 10MediaWiki-Platform-Team: Cannot create a new wiki on beta cluster - https://phabricator.wikimedia.org/T358236#9568396 (10pmiazga) 05Openβ†’03In progress p:05Triageβ†’03High a:03pmiazga [16:10:27] 10Beta-Cluster-Infrastructure, 10Math, 10Mathoid, 10MediaWiki-Platform-Team: Cannot create a new wiki on beta cluster - https://phabricator.wikimedia.org/T358236#9568412 (10Physikerwelt) >>! In T358236#9568389, @pmiazga wrote: > Another suggestion from @matmarex is to update the AddWiki script - after read... [16:11:37] 10Beta-Cluster-Infrastructure, 10Math, 10Mathoid, 10MediaWiki-Platform-Team: Cannot create a new wiki on beta cluster - https://phabricator.wikimedia.org/T358236#9568419 (10Physikerwelt) See https://phabricator.wikimedia.org/T355050 for the removal in production. [16:13:35] 10Beta-Cluster-Infrastructure, 10Math, 10Mathoid, 10MediaWiki-Platform-Team, 10Patch-For-Review: Cannot create a new wiki on beta cluster - https://phabricator.wikimedia.org/T358236#9568432 (10pmiazga) @Physikerwelt thanks for joining the conversation. I quickly created the ticket so I don't forget and s... [16:15:57] !log gitlab-cloud-runners upgraded to v16.7.1 [16:15:59] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [16:35:59] !log Reloaded Zuul to enable Sonar Codehealth on ContactPage, Disambiguator, FlaggedRevs and ReadingLists # T321837 [16:36:02] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [16:36:02] T321837: Repositories integrated into Codehealth Pipeline (Production) - https://phabricator.wikimedia.org/T321837 [16:52:56] 10Release-Engineering-Team (Now this 🫠), 10Scap, 10Patch-For-Review: Improve scap canary check messages - https://phabricator.wikimedia.org/T142342#9568693 (10dancy) [16:52:59] 10Release-Engineering-Team (Now this 🫠), 10Scap, 10Patch-For-Review: Improve scap canary check messages - https://phabricator.wikimedia.org/T142342#9568688 (10dancy) Latest canary phase output: ` 16:47:26 Started sync-check-canaries 16:47:46 sync-canaries: 100% (in-flight: 0; ok: 4; fail: 0; left: 0) 16:47:4... [16:56:42] 10Release-Engineering-Team (Now this 🫠), 10Scap, 10MW-on-K8s, 10SRE, 10serviceops: Scap should check errors coming from mw-on-k8s canaries during deployments - https://phabricator.wikimedia.org/T357402#9568746 (10dancy) 05Openβ†’03Resolved [16:56:48] 10Release-Engineering-Team (Seen), 10MW-on-K8s, 10SRE, 10Traffic, 10serviceops: Serve production traffic via Kubernetes - https://phabricator.wikimedia.org/T290536#9568747 (10dancy) [16:57:28] 10Release-Engineering-Team (Now this 🫠), 10Scap, 10Patch-For-Review: Improve scap canary check messages - https://phabricator.wikimedia.org/T142342#9568738 (10dancy) 05Openβ†’03Resolved a:03dancy Scap's messages have been updated according to the suggestions made in this ticket (mostly as a side effect o... [17:12:52] 10GitLab, 10Release-Engineering-Team: GitLab header logo blocks top portion of page - https://phabricator.wikimedia.org/T358234#9568856 (10brennen) Definitely a regression. I expect we just need to resize a custom logo file, will poke at it. [17:16:45] 10Gerrit, 10Release-Engineering-Team: Gerrit "Checks" permalink to Zuul also matches other changes - https://phabricator.wikimedia.org/T358253#9568873 (10Krinkle) [17:21:20] Hello. I need a bit of help - I need to remove a database from beta cluster mariadb instance and I’m little bit lost on how to do it [17:22:39] Context - there was a bug in `addwiki` script which caused script to fail. Now I have a partially created database, and re-running script fails with error that table site_identifiers already exists [17:22:58] drop database `...`; ? [17:23:57] 10GitLab (Upstream pit of despair πŸ•³οΈ), 10Release-Engineering-Team, 10Upstream: GitLab header logo blocks top portion of page - https://phabricator.wikimedia.org/T358234#9568973 (10brennen) [17:24:02] Yeah, but I’m bit lost how to mysql to that instance - and I don’t to want to login to a wrong db :) [17:24:39] That’s why I want to double check with someone that I’m doing the right thing [17:25:46] From what I see β€œThe database hosts for MediaWiki are deployment-db05 or deployment-db06.” [17:25:51] https://wikitech.wikimedia.org/wiki/Nova_Resource:Deployment-prep/Overview [17:26:03] So I assume I need to go to deployment-db05 and check the db there [17:26:25] I would guess the easiest thing (and maybe the only way to get drop rights) is to ssh to the db instance (deployment-db09, deployment-db11, deployment-db12, deployment-db13 per https://openstack-browser.toolforge.org/project/deployment-prep), then `sudo su -`, then `mysql` [17:27:31] https://wikitech.wikimedia.org/wiki/Nova_Resource:Deployment-prep/Overview is nearly always out of date for instance names [17:30:36] Ok, I cannot login to db09, but I’m on db-11 and I see my test2wiki db there [17:30:44] So I assume I can safely drop it? [17:34:41] 10Beta-Cluster-Infrastructure, 10Math, 10Mathoid, 10MediaWiki-Platform-Team: Cannot create a new wiki on beta cluster - https://phabricator.wikimedia.org/T358236#9569045 (10pmiazga) After updating the Add Wiki script - I was able to run the script - but it kept failing due to partially created DB. Previous... [17:35:36] 10GitLab (Integrations), 10Phabricator, 10Release-Engineering-Team (Priority Backlog πŸ“₯), 10collaboration-services: Get GitLab to render `T{\d}+` in MR overviews, comments, etc. as links to Phabricator - https://phabricator.wikimedia.org/T337570#9569055 (10dduvall) >>! In T337570#9453166, @Jelto wrote: > I'... [17:35:43] 10GitLab (Upstream pit of despair πŸ•³οΈ), 10Release-Engineering-Team, 10Patch-For-Review, 10Upstream: GitLab header logo blocks top portion of page - https://phabricator.wikimedia.org/T358234#9569053 (10CodeReviewBot) brennen opened https://gitlab.wikimedia.org/repos/releng/gitlab-settings/-/merge_requests/57... [17:38:46] 10GitLab (Upstream pit of despair πŸ•³οΈ), 10Release-Engineering-Team, 10Patch-For-Review, 10Upstream: GitLab header logo blocks top portion of page - https://phabricator.wikimedia.org/T358234#9569075 (10eoghan) @brennen Good catch. I didn't spot this in our replica/test instance because I was logged in. Perha... [17:40:05] pmiazga: you can't break what is already broken. -- ancient beta cluster wisdom [17:43:54] 10Beta-Cluster-Infrastructure, 10Math, 10Mathoid, 10MediaWiki-Platform-Team: Cannot create a new wiki on beta cluster - https://phabricator.wikimedia.org/T358236#9569120 (10pmiazga) For tracking purposes - the Linter extension had the SQL files moved recently (see https://phabricator.wikimedia.org/T353922,... [17:44:04] 10Beta-Cluster-Infrastructure, 10Math, 10Mathoid, 10MediaWiki-Platform-Team: Cannot create a new wiki on beta cluster - https://phabricator.wikimedia.org/T358236#9569124 (10Urbanecm_WMF) >>! In T358236#9569045, @pmiazga wrote: > After updating the Add Wiki script - I was able to run the script - but it kep... [17:45:35] 10GitLab (Upstream pit of despair πŸ•³οΈ), 10Release-Engineering-Team, 10Patch-For-Review, 10Upstream: GitLab header logo blocks top portion of page - https://phabricator.wikimedia.org/T358234#9569141 (10brennen) 05Openβ†’03Resolved a:03brennen Seems fixed with a resized SVG. Could be reported upstream, bu... [17:48:03] 10Beta-Cluster-Infrastructure, 10Math, 10Mathoid, 10MediaWiki-Platform-Team: Cannot create a new wiki on beta cluster - https://phabricator.wikimedia.org/T358236#9569162 (10bd808) >>! In T358236#9569045, @pmiazga wrote: > Now it fails on another extension. > > ` > pmiazga@deployment-deploy03:~$ mwscript e... [17:49:21] 10Beta-Cluster-Infrastructure, 10Math, 10Mathoid, 10MediaWiki-Platform-Team: Cannot create a new wiki on beta cluster - https://phabricator.wikimedia.org/T358236#9569174 (10pmiazga) @bd808 in Linter script was moved to `sql/mysql` folder to match how we have it in other extensions [17:50:11] 10Beta-Cluster-Infrastructure, 10Math, 10Mathoid, 10MediaWiki-Platform-Team: Cannot create a new wiki on beta cluster - https://phabricator.wikimedia.org/T358236#9569176 (10pmiazga) @Urbanecm_WMF thanks for the point - that's helpful. I checked the `addWiki` script for all remaining SQL files and looks lik... [18:03:21] 10Continuous-Integration-Infrastructure, 10SRE, 10vm-requests: Ganeti VM for contint migration - https://phabricator.wikimedia.org/T358237#9569250 (10MoritzMuehlenhoff) What do you want to use as the host name, something like zuul1001? [18:05:00] Project beta-update-databases-eqiad build #74103: 15ABORTED in 45 min: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/74103/ [18:18:38] 10Beta-Cluster-Infrastructure, 10Math, 10Mathoid, 10MediaWiki-Platform-Team, and 2 others: Cannot create a new wiki on beta cluster - https://phabricator.wikimedia.org/T358236#9569319 (10pmiazga) After all fixes now script still fails, but this time on something new - which I think may be a result of runni... [18:20:04] 10GitLab (Integrations), 10Phabricator, 10Release-Engineering-Team (Priority Backlog πŸ“₯), 10collaboration-services: Get GitLab to render `T{\d}+` in MR overviews, comments, etc. as links to Phabricator - https://phabricator.wikimedia.org/T337570#9569324 (10bd808) >>! In T337570#9569055, @dduvall wrote: >>>!... [18:40:11] 10Deployments, 10Release-Engineering-Team (Now this 🫠), 10Patch-For-Review: handle logstash timeouts separately from spikes in errors reported by logstash - https://phabricator.wikimedia.org/T144033#9569399 (10CodeReviewBot) dancy opened https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/221 Ha... [18:41:44] 10Deployments, 10Release-Engineering-Team (Now this 🫠), 10Patch-For-Review: handle logstash timeouts separately from spikes in errors reported by logstash - https://phabricator.wikimedia.org/T144033#9569411 (10dancy) [19:05:00] Project beta-update-databases-eqiad build #74104: 15ABORTED in 45 min: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/74104/ [19:27:19] 10GitLab (Integrations), 10Phabricator, 10Release-Engineering-Team (Priority Backlog πŸ“₯), 10collaboration-services: Get GitLab to render `T{\d}+` in MR overviews, comments, etc. as links to Phabricator - https://phabricator.wikimedia.org/T337570#9569590 (10dduvall) >>! In T337570#9569324, @bd808 wrote: > Th... [19:33:44] 10Phabricator, 10LDAP-Access-Requests, 10SRE, 10SRE-Access-Requests, 10Patch-For-Review: Migrate dev user accounts for bvibber - https://phabricator.wikimedia.org/T358044#9569601 (10bvibber) >>! In T358044#9562210, @Bugreporter wrote: >>Too late now, but Phabricator accounts are easy enough to rename and... [19:35:34] 10Phabricator, 10LDAP-Access-Requests, 10SRE, 10SRE-Access-Requests, 10Patch-For-Review: Migrate dev user accounts for bvibber - https://phabricator.wikimedia.org/T358044#9569603 (10bvibber) >>! In T358044#9562598, @MoritzMuehlenhoff wrote: > @bvibber Renaming the user name for SSH access will leave file... [19:47:54] 10Phabricator, 10LDAP-Access-Requests, 10SRE, 10SRE-Access-Requests, 10Patch-For-Review: Migrate dev user accounts for bvibber - https://phabricator.wikimedia.org/T358044#9569624 (10bvibber) Gerrit lets me connect but won't let me push updates to a patchset: ` % git review remote: remote: Processing ch... [19:53:04] 10Phabricator, 10LDAP-Access-Requests, 10SRE, 10SRE-Access-Requests, 10Patch-For-Review: Migrate dev user accounts for bvibber - https://phabricator.wikimedia.org/T358044#9569661 (10taavi) Only members of https://gerrit.wikimedia.org/r/admin/groups/2021f25e7515187a81d51f8fe14dd6f25617cce0 can amend chang... [19:53:35] 10Phabricator, 10LDAP-Access-Requests, 10SRE, 10SRE-Access-Requests, 10Patch-For-Review: Migrate dev user accounts for bvibber - https://phabricator.wikimedia.org/T358044#9569668 (10bvibber) Thx! [20:05:00] Project beta-update-databases-eqiad build #74105: 15ABORTED in 45 min: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/74105/ [20:05:11] 10Beta-Cluster-Infrastructure, 10MediaWiki-Platform-Team, 10MW-1.42-notes (1.42.0-wmf.20; 2024-02-27): Cannot create a new wiki on beta cluster - https://phabricator.wikimedia.org/T358236#9569727 (10Physikerwelt) [20:31:48] 10Deployments, 10Release-Engineering-Team (Now this 🫠), 10Patch-For-Review: handle logstash timeouts separately from spikes in errors reported by logstash - https://phabricator.wikimedia.org/T144033#9569935 (10dancy) a:03dancy [20:36:29] 10Phabricator, 10LDAP-Access-Requests, 10SRE, 10SRE-Access-Requests, 10Patch-For-Review: Migrate dev user accounts for bvibber - https://phabricator.wikimedia.org/T358044#9569964 (10Peachey88) >>! In T358044#9569601, @bvibber wrote: > That's probably the way to go then, if it'll keep assignments intact w... [20:52:08] 10Release-Engineering-Team (Now this 🫠), 10Scap, 10Patch-For-Review: handle logstash timeouts separately from spikes in errors reported by logstash - https://phabricator.wikimedia.org/T144033#9570012 (10dancy) [20:54:38] 10Release-Engineering-Team (Now this 🫠), 10Scap, 10MW-on-K8s, 10SRE, 10serviceops: Find a way to address canary releases directly - https://phabricator.wikimedia.org/T358117#9570020 (10thcipriani) >>! In T358117#9566949, @Clement_Goubert wrote: > We've talked this over, and while doing swagger checks mad... [21:05:00] Project beta-update-databases-eqiad build #74106: 15ABORTED in 45 min: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/74106/ [22:05:00] Project beta-update-databases-eqiad build #74107: 15ABORTED in 45 min: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/74107/ [22:08:37] 10Project-Admins, 10Movement-Insights: Create project tags for Movement Insights teams - https://phabricator.wikimedia.org/T356553#9570298 (10MBinder_WMF) I can look into this now, having seen https://www.mediawiki.org/wiki/Topic:Xzn7ek8vz5fr6h6z :) [22:12:09] 10Project-Admins, 10Movement-Insights: Create project tags for Movement Insights teams - https://phabricator.wikimedia.org/T356553#9570301 (10MBinder_WMF) 05Openβ†’03Resolved a:03MBinder_WMF Created https://phabricator.wikimedia.org/project/view/7008/ for #canonical-data and https://phabricator.wikimedia.o... [22:16:39] 10Project-Admins, 10Movement-Insights: Create project tags for Movement Insights teams - https://phabricator.wikimedia.org/T356553#9570336 (10nshahquinn-wmf) Thank you, Max! [23:05:00] Project beta-update-databases-eqiad build #74108: 15ABORTED in 45 min: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/74108/ [23:11:02] 10Release-Engineering-Team (Now this 🫠), 10Release, 10Train Deployments: 1.42.0-wmf.19 deployment blockers - https://phabricator.wikimedia.org/T354437#9570528 (10thcipriani) 05Openβ†’03Resolved [23:11:50] 10Release-Engineering-Team (Now this 🫠), 10Release, 10Train Deployments: 1.42.0-wmf.20 deployment blockers - https://phabricator.wikimedia.org/T354438#9570529 (10thcipriani) p:05Triageβ†’03Medium a:03dduvall [23:12:21] 10Release-Engineering-Team (Now this 🫠), 10Release, 10Train Deployments: 1.42.0-wmf.21 deployment blockers - https://phabricator.wikimedia.org/T354439#9570535 (10thcipriani) p:05Triageβ†’03Medium a:03jnuche [23:12:56] 10Release-Engineering-Team (Priority Backlog πŸ“₯), 10Release, 10Train Deployments: 1.42.0-wmf.22 deployment blockers - https://phabricator.wikimedia.org/T354440#9570540 (10thcipriani) p:05Triageβ†’03Medium a:03hashar [23:36:28] 10Release-Engineering-Team (Now this 🫠), 10Scap, 10Patch-For-Review: handle logstash timeouts separately from spikes in errors reported by logstash - https://phabricator.wikimedia.org/T144033#9570619 (10CodeReviewBot) dancy merged https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/221 Handle lo... [23:44:50] (03PS1) 10Subramanya Sastry: Stop suppressing edit section links + hide cdx-info-chip divs [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/1005855