[00:04:10] <wikibugs>	 (03open) 10addbot: Bump docker-registry.wikimedia.org/wikimedia/mediawiki-libs-shellbox image group to 2024-11-18-152217 [repos/releng/cli] - 10https://gitlab.wikimedia.org/repos/releng/cli/-/merge_requests/588
[00:04:26] <wikibugs>	 (03open) 10addbot: Bump postgres from 13.15 to 13.17 [repos/releng/cli] - 10https://gitlab.wikimedia.org/repos/releng/cli/-/merge_requests/589
[01:05:42] <wikibugs>	 10Beta-Cluster-Infrastructure, 10Citoid: Update citoid service on beta - https://phabricator.wikimedia.org/T380165#10342616 (10thcipriani) These services run in docker managed by systemd on the host:  https://gerrit.wikimedia.org/r/plugins/gitiles/cloud/instance-puppet/+/master/deployment-prep/deployment-docke...
[10:09:14] <hashar>	 !log gerrit: manually `close-connection` some idling/obsolete SSH connections
[10:09:16] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL
[10:20:39] <wikibugs>	 (03approved) 10lwatson: spiderpig api: Add job history pagination support [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/581 (owner: 10dancy)
[10:28:25] <wikibugs>	 (03open) 10oblivian: Update projects.json adding vopsbot so we can use the deb upload pipeline [repos/releng/gitlab-trusted-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-trusted-runner/-/merge_requests/101
[10:32:59] <wikibugs>	 (03update) 10oblivian: Update projects.json adding vopsbot so we can use the deb upload pipeline [repos/releng/gitlab-trusted-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-trusted-runner/-/merge_requests/101
[10:33:57] <_joe_>	 hi! Can I get a merge of ^^
[10:37:49] <_joe_>	 hashar: can you help with ^? I'd really like to make the process work and I need to use trusted runners
[10:39:38] <hashar>	 _joe_: sorry I don't know anything about the gitlab runners / trusted ones. Maybe jelto can help?
[10:40:27] <_joe_>	 hashar: the repo is under /releng/ and I don't have merge rights, else I would've just pushed the change
[10:40:29] <wikibugs>	 (03approved) 10jelto: Update projects.json adding vopsbot so we can use the deb upload pipeline [repos/releng/gitlab-trusted-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-trusted-runner/-/merge_requests/101 (owner: 10oblivian)
[10:40:43] <_joe_>	 jelto: <3
[10:40:46] <hashar>	 :-]
[10:40:49] <jelto>	 I can merge it, looks good to me. one sec
[10:41:03] <hashar>	 and maybe you should be granted access to the Gitlab Trusted Runner project?
[10:41:10] <wikibugs>	 (03merge) 10jelto: Update projects.json adding vopsbot so we can use the deb upload pipeline [repos/releng/gitlab-trusted-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-trusted-runner/-/merge_requests/101 (owner: 10oblivian)
[10:41:23] <_joe_>	 thanks
[10:43:35] <jelto>	 change merged and deployed
[10:54:04] <kostajh>	 hashar: I think https://gerrit.wikimedia.org/r/c/integration/config/+/1087458 is ready to go
[10:54:17] <kostajh>	 or ready for your review, at least :)
[11:00:48] <hashar>	 kostajh: ahhh yeah there was that series by codders which felt off (adding a new image + some hack in zuul parameters function)
[11:01:03] <hashar>	 I will chekc
[11:01:25] <hashar>	 but the timed: @daily means it is triggered by Jenkins and would thus not have parameters injected
[11:07:33] <codders>	 right. despite being `wmf-quibble-`
[11:07:57] <codders>	 the other patchset, per your suggestion, would have provided those variables. Should we go back to that?
[11:10:29] <codders>	 (specifically https://gerrit.wikimedia.org/r/c/integration/config/+/1087458/5 and https://gerrit.wikimedia.org/r/c/integration/config/+/1088284 and https://gerrit.wikimedia.org/r/c/integration/config/+/1087442 )
[11:19:19] <wikibugs>	 10GitLab (Pipeline Services Migration🐤), 10Citoid, 06Editing-team, 10Projects-Cleanup: Archive Zotero gerrit repo as it's been replaced with gitlab - https://phabricator.wikimedia.org/T380259#10343331 (10Mvolz)
[11:19:25] <wikibugs>	 10GitLab (Pipeline Services Migration🐤), 10Citoid, 06Editing-team, 10Projects-Cleanup: Archive Zotero gerrit repo as it's been replaced with gitlab - https://phabricator.wikimedia.org/T380259#10343333 (10Mvolz)
[11:37:23] <wikibugs>	 10GitLab (Pipeline Services Migration🐤), 10Citoid, 06Editing-team, 10Projects-Cleanup: Archive Zotero gerrit repo as it's been replaced with gitlab - https://phabricator.wikimedia.org/T380259#10343396 (10Mvolz)
[11:45:30] <kostajh>	 hashar: so, what do you propose for injecting the parameters?
[11:47:16] <wikibugs>	 (03PS1) 10Mvolz: Remove zotero pipeline for archival [integration/config] - 10https://gerrit.wikimedia.org/r/1093879 (https://phabricator.wikimedia.org/T380259)
[12:20:02] <wmf-insecte>	 maintenance-disconnect-full-disks build 651451 integration-agent-docker-1049 (/: 26%, /srv: 96%, /var/lib/docker: 37%): OFFLINE due to disk space
[12:25:02] <wmf-insecte>	 maintenance-disconnect-full-disks build 651452 integration-agent-docker-1049 (/: 26%, /srv: 23%, /var/lib/docker: 35%): RECOVERY disk space OK
[13:18:21] <wikibugs>	 (03PS1) 10Arthur taylor: Enable PHPUnit parallel testing for mediawiki/core [integration/config] - 10https://gerrit.wikimedia.org/r/1093909 (https://phabricator.wikimedia.org/T379712)
[13:28:58] <wikibugs>	 (03CR) 10Kosta Harlan: Enable PHPUnit parallel testing for mediawiki/core (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/1093909 (https://phabricator.wikimedia.org/T379712) (owner: 10Arthur taylor)
[13:30:46] <wikibugs>	 (03PS2) 10Arthur taylor: Enable PHPUnit parallel testing for mediawiki/core [integration/config] - 10https://gerrit.wikimedia.org/r/1093909 (https://phabricator.wikimedia.org/T379712)
[13:30:59] <wikibugs>	 (03CR) 10Arthur taylor: Enable PHPUnit parallel testing for mediawiki/core (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/1093909 (https://phabricator.wikimedia.org/T379712) (owner: 10Arthur taylor)
[13:31:40] <wikibugs>	 (03CR) 10Kosta Harlan: [C:03+1] Enable PHPUnit parallel testing for mediawiki/core [integration/config] - 10https://gerrit.wikimedia.org/r/1093909 (https://phabricator.wikimedia.org/T379712) (owner: 10Arthur taylor)
[14:30:04] <wikibugs>	 10Release-Engineering-Team (Priority Backlog 📥), 05Release, 05Train Deployments: 1.44.0-wmf.4 deployment blockers - https://phabricator.wikimedia.org/T375663#10344066 (10SBisson) FYI {T380471}
[14:54:00] <wikibugs>	 06Release-Engineering-Team, 06Data Products, 06Data-Platform-SRE, 10Dumps-Generation, and 3 others: Migrate current-generation dumps to run from our containerized images - https://phabricator.wikimedia.org/T352650#10344155 (10BTullis) We have now created a cephfs file system for dumps. ` btullis@cephosd100...
[14:59:02] <wikibugs>	 06Release-Engineering-Team, 06Data Products, 06Data-Platform-SRE, 10Dumps-Generation, and 3 others: Migrate current-generation dumps to run from our containerized images - https://phabricator.wikimedia.org/T352650#10344183 (10BTullis) Currently, they are both assigned the `hdd` CRUSH rule. ` btullis@cephos...
[15:29:07] <wikibugs>	 (03update) 10dancy: spiderpig api: Add job history pagination support [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/581
[15:31:11] <wikibugs>	 (03merge) 10dancy: spiderpig api: Add job history pagination support [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/581
[16:06:47] <wmf-insecte>	 Project beta-scap-sync-world build #181636: 04FAILURE in 1 min 54 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/181636/
[16:11:33] <wmf-insecte>	 Yippee, build fixed!
[16:11:33] <wmf-insecte>	 Project beta-scap-sync-world build #181637: 09FIXED in 1 min 40 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/181637/
[16:22:17] <Reedy>	 >16:06:10 16:06:10 ['/usr/bin/scap', 'pull', '--no-php-restart', '--no-update-l10n', '--exclude-wikiversions.php', 'deployment-deploy04.deployment-prep.eqiad1.wikimedia.cloud', 'deployment-deploy04.deployment-prep.eqiad1.wikimedia.cloud'] (ran as mwdeploy@deployment-mediawiki14.deployment-prep.eqiad1.wikimedia.cloud) returned [255]: ssh: connect to host deployment-mediawiki14.deployment-prep.eqiad1.wikimedia.cloud port 22: No route to host
[16:29:12] <wikibugs>	 (03update) 10lwatson: Draft: web: improve main page UI [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/575 (https://phabricator.wikimedia.org/T379412)
[16:35:56] <dancy>	 Reedy: Around that time, dcaro said this in #wikimedia-cloud:
[16:35:56] <dancy>	 | there was a small outage on one switch, making the ceph cluster hiccup (and toolforge/cloudvps with it)
[16:39:01] <Reedy>	 ta
[16:39:09] <Reedy>	 next run should probably be fine then
[16:41:02] <dancy>	 nod.. It already recovered
[16:45:56] <wikibugs>	 10GitLab (Pipeline Services Migration🐤), 06collaboration-services, 10Wikidata, 10Wikidata Query UI, and 3 others: move commons-query.wikimedia.org and query.wikidata.org to kubernetes - https://phabricator.wikimedia.org/T350793#10344946 (10Tarrow) @Jelto Thanks for moving this thing to gitlab for doing the...
[17:16:56] <wikibugs>	 10MediaWiki-Releasing, 10MediaWiki-Vendor, 05MW-1.43-release, 13Patch-For-Review: Prune /vendor for REL1_43 - https://phabricator.wikimedia.org/T372319#10345278 (10ABreault-WMF) 05Open→03Resolved
[17:17:07] <wikibugs>	 10GitLab (Pipeline Services Migration🐤), 06collaboration-services, 10Wikidata, 10Wikidata Query UI, and 3 others: move commons-query.wikimedia.org and query.wikidata.org to kubernetes - https://phabricator.wikimedia.org/T350793#10345281 (10Jelto) I cloned the repositories manually from Gerrit to GitLab. Th...
[17:33:03] <wikibugs>	 10Release-Engineering-Team (Priority Backlog 📥), 05Release, 05Train Deployments: 1.44.0-wmf.4 deployment blockers - https://phabricator.wikimedia.org/T375663#10345408 (10Aklapper) 05Open→03Resolved Resolving. There was some discussion about the rate of //ResourceLoader Backend Requests// on https://g...
[17:35:55] <wikibugs>	 (03open) 10dancy: install_world.py: Fix rsync source bug [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/590
[17:35:59] <wikibugs>	 (03update) 10dancy: install_world.py: Fix rsync source bug [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/590
[17:36:37] <wikibugs>	 (03update) 10dancy: install_world.py: Fix rsync source bug [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/590
[17:41:48] <wikibugs>	 (03approved) 10jnuche: install_world.py: Fix rsync source bug [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/590 (owner: 10dancy)
[17:42:09] <wikibugs>	 (03merge) 10dancy: install_world.py: Fix rsync source bug [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/590
[18:09:13] <paladox>	 hashar: hi, https://integration.wikimedia.org/zuul/#q=1093902 seems stuck
[18:09:20] <paladox>	 Has been stuck for 6h+
[18:09:32] <paladox>	 *5:30hr sorry
[18:11:27] <paladox>	 Reloaded it (by reuploading to trigger it to re-do tests). But seems it’s still stuck
[18:22:50] <dancy>	 paladox: Taking a look
[18:22:58] <paladox>	 thanks!!
[18:26:20] <wikibugs>	 10Continuous-Integration-Config, 10Continuous-Integration-Infrastructure, 07Zuul: quibble-composer-mysql-php81-noselenium and quibble-composer-mysql-php81-selenium jobs stuck - https://phabricator.wikimedia.org/T380524 (10dancy) 03NEW
[18:26:57] <wikibugs>	 10Continuous-Integration-Config, 10Continuous-Integration-Infrastructure, 07Zuul: quibble-composer-mysql-php81-noselenium and quibble-composer-mysql-php81-selenium jobs stuck - https://phabricator.wikimedia.org/T380524#10345789 (10dancy)
[18:28:58] <dancy>	 Looks like something that Reedy may have knowledge about.
[18:29:43] <wikibugs>	 10Continuous-Integration-Config, 10Continuous-Integration-Infrastructure, 07Zuul: quibble-composer-mysql-php81-noselenium and quibble-composer-mysql-php81-selenium jobs stuck - https://phabricator.wikimedia.org/T380524#10345808 (10dancy) Possibly linked with T380434.  @Reedy What do you think?
[18:30:20] <Reedy>	 oh...
[18:30:29] <Reedy>	 Do we really need to check if it's in the list first?
[18:30:40] <dancy>	 Seems so.
[18:31:58] <dancy>	 or try .../except KeyError: pass
[18:33:39] <wikibugs>	 (03PS1) 10Reedy: parameter_functions: Only remove CommunityConfiguration from REL1_ if they exist [integration/config] - 10https://gerrit.wikimedia.org/r/1093981 (https://phabricator.wikimedia.org/T380524)
[18:34:55] <wikibugs>	 (03CR) 10CI reject: [V:04-1] parameter_functions: Only remove CommunityConfiguration from REL1_ if they exist [integration/config] - 10https://gerrit.wikimedia.org/r/1093981 (https://phabricator.wikimedia.org/T380524) (owner: 10Reedy)
[18:35:35] <wikibugs>	 (03CR) 10Ahmon Dancy: parameter_functions: Only remove CommunityConfiguration from REL1_ if they exist (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/1093981 (https://phabricator.wikimedia.org/T380524) (owner: 10Reedy)
[18:35:41] <wikibugs>	 (03PS2) 10Reedy: parameter_functions: Only remove CommunityConfiguration from REL1_ if they exist [integration/config] - 10https://gerrit.wikimedia.org/r/1093981 (https://phabricator.wikimedia.org/T380524)
[18:36:04] <wikibugs>	 (03PS3) 10Reedy: parameter_functions: Only remove CommunityConfiguration from REL1_ if they exist [integration/config] - 10https://gerrit.wikimedia.org/r/1093981 (https://phabricator.wikimedia.org/T380524)
[18:38:49] <wikibugs>	 (03CR) 10Reedy: [C:03+2] parameter_functions: Only remove CommunityConfiguration from REL1_ if they exist (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/1093981 (https://phabricator.wikimedia.org/T380524) (owner: 10Reedy)
[18:40:05] <wikibugs>	 (03Merged) 10jenkins-bot: parameter_functions: Only remove CommunityConfiguration from REL1_ if they exist [integration/config] - 10https://gerrit.wikimedia.org/r/1093981 (https://phabricator.wikimedia.org/T380524) (owner: 10Reedy)
[18:42:21] <Reedy>	 !log Reloading Zuul to deploy https://gerrit.wikimedia.org/r/1093981 T380524
[18:42:23] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL
[18:42:24] <stashbot>	 T380524: quibble-composer-mysql-php81-noselenium and quibble-composer-mysql-php81-selenium jobs stuck - https://phabricator.wikimedia.org/T380524
[18:47:44] <paladox>	 thanks!!
[18:50:32] <Reedy>	 Not sure if those jobs need a kick to clear things up...
[18:50:43] <Reedy>	 I guess not, as they've gone :)
[18:52:34] <dancy>	 Looks good.
[18:52:37] <dancy>	 Thanks Reedy!
[18:53:29] <wikibugs>	 10Continuous-Integration-Config, 10Continuous-Integration-Infrastructure, 07Zuul, 13Patch-For-Review: quibble-composer-mysql-php81-noselenium and quibble-composer-mysql-php81-selenium jobs stuck - https://phabricator.wikimedia.org/T380524#10345973 (10Reedy) 05Open→03Resolved a:03Reedy
[18:58:13] <wikibugs>	 (03update) 10lwatson: Draft: web: improve main page UI [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/575 (https://phabricator.wikimedia.org/T379412)
[19:14:52] <wikibugs>	 10Deployments, 10MW-on-K8s: mwscript-k8s gives Invalid value: "<script>": a valid label must be an empty string or consist of alphanumeric characters, '-', '_' or '.', and must start and end with an alphanumeric character - https://phabricator.wikimedia.org/T380533 (10Tgr) 03NEW
[19:15:24] <wikibugs>	 10Phabricator: Rename my Phabricator account - https://phabricator.wikimedia.org/T380532#10346076 (10Pppery)
[19:21:38] <wikibugs>	 10Phabricator: Rename my Phabricator account - https://phabricator.wikimedia.org/T380532#10346098 (10Hex) Thanks @Aklapper! 🥳
[19:21:41] <wikibugs>	 10Phabricator: Rename my Phabricator account - https://phabricator.wikimedia.org/T380532#10346094 (10Aklapper) 05Open→03Resolved a:03Aklapper Done
[19:37:17] <wikibugs>	 10Gerrit, 10VPS-project-Codesearch: Gerrit Projects API listing does not include design/codex-php (Codesearch does not index codex-php) - https://phabricator.wikimedia.org/T380535 (10Krinkle) 03NEW
[19:38:21] <wikibugs>	 10Gerrit, 10VPS-project-Codesearch: Gerrit Projects API listing does not include design/codex-php (Codesearch does not index codex-php) - https://phabricator.wikimedia.org/T380535#10346167 (10Krinkle) Note that on https://gerrit.wikimedia.org/r/admin/repos/q/filter:design/, Gerrit does list `design/codex-php`.
[19:38:29] <wikibugs>	 10Gerrit, 06Release-Engineering-Team, 10VPS-project-Codesearch: Gerrit Projects API listing does not include design/codex-php (Codesearch does not index codex-php) - https://phabricator.wikimedia.org/T380535#10346168 (10Krinkle)
[20:42:28] <wikibugs>	 (03update) 10lwatson: Draft: web: improve main page UI [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/575 (https://phabricator.wikimedia.org/T379412)
[21:06:44] <wikibugs>	 (03update) 10lwatson: Draft: web: improve main page UI [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/575 (https://phabricator.wikimedia.org/T379412)
[21:35:05] <wikibugs>	 10Phabricator, 10WMF-JobQueue, 07Documentation: WMF-JobQueue description is out of date - https://phabricator.wikimedia.org/T380543 (10Reedy) 03NEW
[21:35:38] <wikibugs>	 10Phabricator, 06MediaWiki-Platform-Team, 10WMF-JobQueue, 07Documentation: WMF-JobQueue project description is out of date - https://phabricator.wikimedia.org/T380543#10346491 (10Reedy) p:05Triage→03Low
[22:32:34] <wikibugs>	 10Phabricator, 06MW-Interfaces-Team, 10WMF-JobQueue, 07Documentation: WMF-JobQueue project description is out of date - https://phabricator.wikimedia.org/T380543#10346780 (10Krinkle)
[22:34:17] <wikibugs>	 10Phabricator, 06MW-Interfaces-Team, 10WMF-JobQueue, 07Documentation: WMF-JobQueue project description is out of date - https://phabricator.wikimedia.org/T380543#10346782 (10Krinkle)
[22:37:45] <Krinkle>	 has anyone see projects get excluded from the Gerrit API before? I wonder what could be causing this. Ref T380535 
[22:37:45] <stashbot>	 T380535: Gerrit Projects API listing does not include design/codex-php (Codesearch does not index codex-php) - https://phabricator.wikimedia.org/T380535
[22:51:00] <bd808>	 Krinkle: T380535 seems weird for sure. I would randomly guess that nerd sniping thcipriani or hashar will yield some answer.
[22:51:00] <stashbot>	 T380535: Gerrit Projects API listing does not include design/codex-php (Codesearch does not index codex-php) - https://phabricator.wikimedia.org/T380535
[22:51:22] <wikibugs>	 10Gerrit, 06Release-Engineering-Team, 10VPS-project-Codesearch: Gerrit Projects API listing does not include design/codex-php (Codesearch does not index codex-php) - https://phabricator.wikimedia.org/T380535#10346834 (10bd808) Trying some variations: * https://gerrit.wikimedia.org/r/projects/?p=design/c `lan...
[23:02:12] <wikibugs>	 10Gerrit, 06Release-Engineering-Team, 10VPS-project-Codesearch: Gerrit Projects API listing does not include design/codex-php (Codesearch does not index codex-php) - https://phabricator.wikimedia.org/T380535#10346862 (10thcipriani) A strange datapoint here:  https://gerrit.wikimedia.org/g/ shows `design/code...
[23:04:08] <wikibugs>	 10Gerrit, 06Release-Engineering-Team, 10VPS-project-Codesearch: Gerrit Projects API listing does not include design/codex-php (Codesearch does not index codex-php) - https://phabricator.wikimedia.org/T380535#10346866 (10thcipriani) >>! In T380535#10346862, @thcipriani wrote: > A strange datapoint here: >  >...