[00:00:11] 10Release-Engineering-Team (Priority Backlog 📥), 05Release, 05Train Deployments: 1.42.0-wmf.26 deployment blockers - https://phabricator.wikimedia.org/T360158#9699396 (10SecurityPatchBot) [00:22:25] 10Diffusion, 10Phabricator, 13Patch-For-Review: Enable git repo creation in Diffusion again - https://phabricator.wikimedia.org/T355644#9699411 (10DannyS712) [01:58:55] 10MediaWiki-Releasing, 05MW-1.42-release, 13Patch-For-Review: Branch REL1_42 for MediaWiki and all extensions and skins - https://phabricator.wikimedia.org/T359839#9699494 (10Jdforrester-WMF) a:03Jdforrester-WMF [01:59:00] 10MediaWiki-Releasing, 05MW-1.42-release, 13Patch-For-Review: Add REL1_42 to ExtensionDistributor as the development snapshot - https://phabricator.wikimedia.org/T359844#9699495 (10Jdforrester-WMF) a:03Jdforrester-WMF [01:59:14] 10MediaWiki-Releasing, 05MW-1.42-release: Add REL1_42 to on-wiki documentation as the development snapshot - https://phabricator.wikimedia.org/T359845#9699496 (10Jdforrester-WMF) a:03Jdforrester-WMF [02:13:42] (03CR) 10Hashar: [C:03+2] Zuul: Add Brent Laabs (labster) to the trusted users list [integration/config] - 10https://gerrit.wikimedia.org/r/1017939 (owner: 10Labster) [02:15:16] (03Merged) 10jenkins-bot: Zuul: Add Brent Laabs (labster) to the trusted users list [integration/config] - 10https://gerrit.wikimedia.org/r/1017939 (owner: 10Labster) [02:15:51] (03CR) 10Hashar: [C:03+2] "Deploy" [integration/config] - 10https://gerrit.wikimedia.org/r/1017939 (owner: 10Labster) [02:15:55] * hashar whistles [02:39:21] 10MediaWiki-Releasing, 05MW-1.42-release, 13Patch-For-Review: 14Branch REL1_42 for MediaWiki and all extensions and skins - 14https://phabricator.wikimedia.org/T359839#9699561 (10Jdforrester-WMF) 05Open→03Resolved [02:43:27] 10MediaWiki-Releasing, 05MW-1.42-release: 14Add REL1_42 to on-wiki documentation as the development snapshot - 14https://phabricator.wikimedia.org/T359845#9699566 (10Jdforrester-WMF) 05Open→03Resolved [03:02:24] 10Beta-Cluster-Infrastructure, 06Moderator-Tools-Team, 10PageTriage, 07Chinese-Sites, 07Wikimedia-production-error: PHP Notice: Undefined index: afc_state - https://phabricator.wikimedia.org/T323647#9699602 (10Shizhao) [07:49:47] 10Beta-Cluster-Infrastructure, 06Moderator-Tools-Team, 10PageTriage, 07Chinese-Sites, 07Wikimedia-production-error: 14PHP Notice: Undefined index: afc_state - 14https://phabricator.wikimedia.org/T323647#9699866 (10Reedy) 05Open→03Invalid 14>>! In T323647#8415869, @TheresNoTime wrote: >>>! In T32... [08:54:44] 10Phabricator, 10Release-Engineering-Team (Seen), 10SRE-swift-storage, 07git-lfs: 14Connect Phabricator to swift for storage of git-lfs and file uploads. - 14https://phabricator.wikimedia.org/T182085#9700011 (10hashar) 14> There was maybe a suggestion of using it for files uploaded to phab? Ideally m... [09:10:24] 10Continuous-Integration-Infrastructure, 07ci-test-error, 07Composer: Increase in "Failed to connect to github.com port 443: Connection timed out" in CI - https://phabricator.wikimedia.org/T362095#9700040 (10hashar) We run composer update,install,require with `--prefer-dist` and thus I don't see why composer... [09:20:16] 10Continuous-Integration-Infrastructure, 07ci-test-error, 07Composer: Increase in "Failed to connect to github.com port 443: Connection timed out" in CI - https://phabricator.wikimedia.org/T362095#9700064 (10Reedy) I wonder if these are related: https://www.githubstatus.com/incidents/syg5c6b5ls76 and https:... [09:21:13] 10Phabricator, 10wikimedia.biterg.io: Closed tickets in Bugzilla migrated without a closing date - https://phabricator.wikimedia.org/T107254#9700060 (10LSobanski) Got it. In this case I'll just untag Collab. [09:30:19] 10Continuous-Integration-Infrastructure, 07ci-test-error, 07Composer: Increase in "Failed to connect to github.com port 443: Connection timed out" in CI - https://phabricator.wikimedia.org/T362095#9700076 (10Reedy) Of course, the other question... Do we not have some sort composer caching? It's definitely a... [09:46:09] 10Continuous-Integration-Infrastructure, 07ci-test-error, 07Composer: Increase in "Failed to connect to github.com port 443: Connection timed out" in CI - https://phabricator.wikimedia.org/T362095#9700089 (10hashar) There should be some kind of cache yes. The CI image/jobs have `XDG_CACHE_HOME` set and it is... [10:23:04] 10Phabricator, 10wikimedia.biterg.io: Closed tickets in Bugzilla migrated without a closing date - https://phabricator.wikimedia.org/T107254#9700206 (10Aklapper) To summarize: Would need to perform 57008 times the following steps: * take the $PhabID * subtract 2000 from the $PhabID to get the $BzID * pull http... [10:47:45] 10GitLab, 06collaboration-services: gitlab: enforce 2fa for admins - https://phabricator.wikimedia.org/T361277#9700308 (10Aklapper) yes please because [data](https://security.googleblog.com/2019/05/new-research-how-effective-is-basic.html) [11:36:11] 10Phabricator, 10wikimedia.biterg.io: Closed tickets in Bugzilla migrated without a closing date - https://phabricator.wikimedia.org/T107254#9700462 (10hashar) Note: we have dump of Bugzilla data at https://dumps.wikimedia.org/other/bugzilla/ , as static html file and a database dump (without emails) [11:42:18] 10Release-Engineering-Team (Priority Backlog 📥), 10Scap, 13Patch-For-Review: backport is showing confusing prompt under certain conditions - https://phabricator.wikimedia.org/T360291#9700476 (10jnuche) Noting here that after analyzing the issue with @dancy and @jeena. there's a few extra situations in backpo... [11:55:23] 10GitLab (CI & Job Runners), 06collaboration-services, 13Patch-For-Review: Create a special-purpose Trusted Runner with Dockerfile frontend - https://phabricator.wikimedia.org/T357612#9700496 (10Jelto) I've done some more research regarding self-building the `dockerfile-frontend` image. I compared the upstre... [12:13:27] 06Release-Engineering-Team, 10Scap, 06serviceops, 13Patch-For-Review, 10Sustainability (Incident Followup): scap should check if it is running within a tmux/screen - https://phabricator.wikimedia.org/T361724#9700571 (10CodeReviewBot) jiji closed https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requ... [12:24:54] 06Release-Engineering-Team, 10Scap, 06serviceops, 13Patch-For-Review, 10Sustainability (Incident Followup): scap should check if it is running within a tmux/screen - https://phabricator.wikimedia.org/T361724#9700626 (10CodeReviewBot) jiji opened https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requ... [12:31:47] 10GitLab (CI & Job Runners), 06collaboration-services, 13Patch-For-Review: Create a special-purpose Trusted Runner with Dockerfile frontend - https://phabricator.wikimedia.org/T357612#9700644 (10CodeReviewBot) jelto opened https://gitlab.wikimedia.org/repos/releng/buildkit/-/merge_requests/60 fix BUILD_VARI... [12:34:19] 10GitLab (CI & Job Runners), 06collaboration-services, 13Patch-For-Review: Create a special-purpose Trusted Runner with Dockerfile frontend - https://phabricator.wikimedia.org/T357612#9700656 (10CodeReviewBot) jelto merged https://gitlab.wikimedia.org/repos/releng/buildkit/-/merge_requests/60 fix BUILD_VARI... [12:48:04] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team: Rebuild integration-cumin to get rid of Debian Buster - https://phabricator.wikimedia.org/T360784#9700697 (10MoritzMuehlenhoff) >>! In T360784#9661505, @hashar wrote: > @joanna_borun I am mostly likely going to need assistance from people kno... [13:01:28] 10Continuous-Integration-Infrastructure, 07Jenkins, 07Upstream: Jenkins collapsible section plugin no more shows table of content - https://phabricator.wikimedia.org/T362048#9700754 (10hashar) I have a fix #upstream https://github.com/jenkinsci/collapsing-console-sections-plugin/pull/26 {F45356563} [13:02:40] 10MediaWiki-Releasing, 05MW-1.42-release, 13Patch-For-Review: 14Add REL1_42 to ExtensionDistributor as the development snapshot - 14https://phabricator.wikimedia.org/T359844#9700760 (10Jdforrester-WMF) 05Open→03Resolved [13:03:03] 10GitLab (CI & Job Runners), 06collaboration-services, 13Patch-For-Review: Create a special-purpose Trusted Runner with Dockerfile frontend - https://phabricator.wikimedia.org/T357612#9700764 (10Jelto) Rebuild of `docker-registry.wikimedia.org/repos/releng/buildkit/dockerfile-frontend` was successful, see [p... [13:03:27] 10MediaWiki-Releasing, 10MediaWiki-Vendor, 05MW-1.42-release, 13Patch-For-Review: 14Prune /vendor for REL1_42 - 14https://phabricator.wikimedia.org/T359840#9700769 (10Jdforrester-WMF) 05Open→03Resolved a:03Reedy [13:08:17] 06Release-Engineering-Team, 10Scap, 06serviceops, 13Patch-For-Review, 10Sustainability (Incident Followup): scap should check if it is running within a tmux/screen - https://phabricator.wikimedia.org/T361724#9700787 (10jijiki) >>! In T361724#9690204, @dancy wrote: > There is a tmux/screen check for `scap... [13:12:33] 10GitLab (CI & Job Runners), 06collaboration-services, 13Patch-For-Review: Create a special-purpose Trusted Runner with Dockerfile frontend - https://phabricator.wikimedia.org/T357612#9700803 (10CodeReviewBot) jelto opened https://gitlab.wikimedia.org/repos/releng/buildkit/-/merge_requests/61 update dockerf... [13:24:40] (03PS1) 10Zfilipin: Revert "Revert "jjb: Create selenium-daily-beta-CampaignEvents"" [integration/config] - 10https://gerrit.wikimedia.org/r/1018220 (https://phabricator.wikimedia.org/T354713) [13:25:54] (03PS2) 10Jforrester: jjb: Recreate selenium-daily-beta-CampaignEvents [integration/config] - 10https://gerrit.wikimedia.org/r/1018220 (https://phabricator.wikimedia.org/T354713) (owner: 10Zfilipin) [13:26:03] (03PS3) 10Zfilipin: Revert "Revert "jjb: Create selenium-daily-beta-CampaignEvents"" [integration/config] - 10https://gerrit.wikimedia.org/r/1018220 (https://phabricator.wikimedia.org/T354713) [13:26:51] * James_F edit-wars with Zeljko [13:27:06] (03PS4) 10Jforrester: jjb: Recreate selenium-daily-beta-CampaignEvents [integration/config] - 10https://gerrit.wikimedia.org/r/1018220 (https://phabricator.wikimedia.org/T354713) (owner: 10Zfilipin) [13:27:27] (03CR) 10Jforrester: [C:03+1] jjb: Recreate selenium-daily-beta-CampaignEvents [integration/config] - 10https://gerrit.wikimedia.org/r/1018220 (https://phabricator.wikimedia.org/T354713) (owner: 10Zfilipin) [13:35:43] 10Continuous-Integration-Infrastructure, 07Jenkins, 07Upstream: Adopt Collapsible Console Section Jenkins plugin - https://phabricator.wikimedia.org/T362086#9700903 (10hashar) [13:36:57] 10Continuous-Integration-Infrastructure, 07Jenkins, 07Upstream: 14Adopt Collapsible Console Section Jenkins plugin - 14https://phabricator.wikimedia.org/T362086#9700904 (10hashar) 05Open→03Resolved a:03hashar 14I have been added as a developer by #upstream https://github.com/jenkins-infra/reposito... [14:10:56] (03CR) 10Zfilipin: [C:03+2] jjb: Recreate selenium-daily-beta-CampaignEvents [integration/config] - 10https://gerrit.wikimedia.org/r/1018220 (https://phabricator.wikimedia.org/T354713) (owner: 10Zfilipin) [14:12:35] (03Merged) 10jenkins-bot: jjb: Recreate selenium-daily-beta-CampaignEvents [integration/config] - 10https://gerrit.wikimedia.org/r/1018220 (https://phabricator.wikimedia.org/T354713) (owner: 10Zfilipin) [14:14:27] (03CR) 10Zfilipin: [C:03+2] "selenium-daily-beta-CampaignEvents deployed." [integration/config] - 10https://gerrit.wikimedia.org/r/1018220 (https://phabricator.wikimedia.org/T354713) (owner: 10Zfilipin) [14:38:25] (03PS1) 10Pwangai: Zuul: [mediawiki/extensions/Cognate] Enable Sonar Codehealth [integration/config] - 10https://gerrit.wikimedia.org/r/1018278 (https://phabricator.wikimedia.org/T321837) [14:39:36] (03PS1) 10Pwangai: Zuul: [mediawiki/extensions/EventBus] Enable Sonar Codehealth [integration/config] - 10https://gerrit.wikimedia.org/r/1018279 (https://phabricator.wikimedia.org/T321837) [14:40:43] (03PS1) 10Pwangai: Zuul: [mediawiki/extensions/Graph] Enable Sonar Codehealth [integration/config] - 10https://gerrit.wikimedia.org/r/1018280 (https://phabricator.wikimedia.org/T321837) [14:41:40] (03PS1) 10Pwangai: Zuul: [mediawiki/extensions/intersection] Enable Sonar Codehealth [integration/config] - 10https://gerrit.wikimedia.org/r/1018281 (https://phabricator.wikimedia.org/T321837) [15:20:53] 10GitLab (Integrations), 10Release-Engineering-Team (Priority Backlog 📥), 10Wikibugs: Connect WikiBugs IRC bot to Wikimedia GitLab - https://phabricator.wikimedia.org/T288381#9701478 (10dancy) @bd808 I read over your proposal and all of the ideas sound reasonable. The code behind gitlab-webhooks is pretty s... [16:19:09] 10Release-Engineering-Team (Now this 🫠), 10Scap, 10MediaWiki-libs-Mime, 10MediaWiki-Platform-Team (Radar), and 2 others: Get rid of the /srv/mediawiki/php symbolic link - https://phabricator.wikimedia.org/T359643#9701787 (10CodeReviewBot) dancy merged https://gitlab.wikimedia.org/repos/releng/train-dev/-/m... [16:23:40] (03PS1) 10Jgiannelos: Fix MW API authentication errors: [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/1018315 [16:28:07] (03CR) 10Jgiannelos: "I've tested it locally and it looks OK. In our instances we should add a way to read the access token. Something like that should work fin" [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/1018315 (owner: 10Jgiannelos) [16:30:24] (03PS2) 10Jgiannelos: Fix MW API authentication errors [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/1018315 [16:30:52] (03PS3) 10Jgiannelos: Fix MW API IP blocking issues [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/1018315 [16:56:57] (03CR) 10Subramanya Sastry: [C:03+1] "I assume you tested this on parsing-qa-02 and it works?" [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/1018315 (owner: 10Jgiannelos) [17:03:59] (03CR) 10Jgiannelos: "I tested this locally with `./bin/gen.visual_diff.js` but using the config from parsing-qa-02." [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/1018315 (owner: 10Jgiannelos) [17:32:14] (03CR) 10Subramanya Sastry: [C:03+2] Fix MW API IP blocking issues [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/1018315 (owner: 10Jgiannelos) [17:32:52] (03Merged) 10jenkins-bot: Fix MW API IP blocking issues [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/1018315 (owner: 10Jgiannelos) [18:04:56] Every wonder if wikibugs is completely stuck? https://wikibugs.toolforge.org/ and https://wikibugs.toolforge.org/metrics try to give some answers to those questions now. :) [18:41:40] <3 [19:40:03] bd808: that is great thank you: [19:40:41] and that metrics looks oddly similar to Prometheus [19:41:00] which I guess means something will end up being collected and exposed on grafana.wmcloud.org [19:47:09] hashar: it is exactly a Prometheus client and yes I hope to see T362012 happen as one of the many neat possibilities now that Toolforge doesn't have to try and make grid engine things work the same as kubernetes things. [19:47:09] T362012: [webservice] Allow configuration of Promethus scraping of a specific webservice endpoint for publication in grafana.wmcloud.org - https://phabricator.wikimedia.org/T362012 [19:50:07] 10Release-Engineering-Team (Now this 🫠), 10Scap, 10MediaWiki-libs-Mime, 10MediaWiki-Platform-Team (Radar), and 2 others: Get rid of the /srv/mediawiki/php symbolic link - https://phabricator.wikimedia.org/T359643#9702307 (10Krinkle) @dancy Are you proposing a redirect in general, or only for appservers? (I... [19:58:53] dancy: thanks for the feedback on the gitlab wikibugs task. It sounds like you'd be ok with an MR that made gitlab-webhooks more friendly to my use case. I can start working in that direction. I should be able to borrow a pile of things from the work I've been doing on wikibugs. [20:01:48] basically it would be swapping flask for quart (the ASGI library made by the same guy that makes flask), adding a server-sent events push of the data that comes in from gitlab, and setting things up to run from a build service managed container (needed to run ASGI) [20:14:24] Have at it! [20:25:05] 10Release-Engineering-Team (Now this 🫠), 10Scap, 10MediaWiki-libs-Mime, 10MediaWiki-Platform-Team (Radar), and 2 others: Get rid of the /srv/mediawiki/php symbolic link - https://phabricator.wikimedia.org/T359643#9702384 (10dancy) >>! In T359643#9702307, @Krinkle wrote: > @dancy Are you proposing a redirec... [20:29:41] 10Release-Engineering-Team (Now this 🫠), 10Scap, 10MediaWiki-libs-Mime, 10MediaWiki-Platform-Team (Radar), and 2 others: Get rid of the /srv/mediawiki/php symbolic link - https://phabricator.wikimedia.org/T359643#9702396 (10Krinkle) I understand the redirect is limited to mediawiki.org, but by redirecting,... [20:31:36] 10Release-Engineering-Team (Now this 🫠), 10Scap, 10MediaWiki-libs-Mime, 10MediaWiki-Platform-Team (Radar), and 2 others: Get rid of the /srv/mediawiki/php symbolic link - https://phabricator.wikimedia.org/T359643#9702400 (10dancy) Thanks for the clarification. In that case I will keep experimenting. I may... [20:33:11] 10Phabricator, 10wikimedia.biterg.io: Closed tickets in Bugzilla migrated without a closing date - https://phabricator.wikimedia.org/T107254#9702401 (10Dzahn) https://gitlab.wikimedia.org/repos/sre/miscweb/bugzilla @Aklapper git clone https://gitlab.wikimedia.org/repos/sre/miscweb/bugzilla.git cd html-compr... [23:13:30] 10GitLab (Integrations), 10Release-Engineering-Team (Priority Backlog 📥), 10Wikibugs: Connect WikiBugs IRC bot to Wikimedia GitLab - https://phabricator.wikimedia.org/T288381#9702700 (10bd808) 05Open→03In progress a:03bd808 I talked with @dancy on irc and have decided to try this variant: > * Implemen...