[00:19:57] 10Project-Admins: Create Project tag for Superset - https://phabricator.wikimedia.org/T298575 (10odimitrijevic) [00:20:17] 10Project-Admins, 10Data-Engineering: Create Project tag for Superset - https://phabricator.wikimedia.org/T298575 (10odimitrijevic) [01:06:14] 10Project-Admins: Create project tag for Data-Engineering-Radar - https://phabricator.wikimedia.org/T298580 (10odimitrijevic) [01:06:25] 10Project-Admins, 10Data-Engineering: Create project tag for Data-Engineering-Radar - https://phabricator.wikimedia.org/T298580 (10odimitrijevic) [01:07:08] 10Project-Admins, 10Data-Engineering: Create project tag for Data-Engineering-Radar - https://phabricator.wikimedia.org/T298580 (10odimitrijevic) Can the herald to remove the "Data-Engineering" tag when "Data-Engineering-Radar" be implemented with the same time? [02:40:56] PROBLEM - SSH on contint1001.mgmt is CRITICAL: CRITICAL - Socket timeout after 10 seconds https://wikitech.wikimedia.org/wiki/Dc-operations/Hardware_Troubleshooting_Runbook [03:42:06] RECOVERY - SSH on contint1001.mgmt is OK: SSH OK - OpenSSH_6.6 (protocol 2.0) https://wikitech.wikimedia.org/wiki/Dc-operations/Hardware_Troubleshooting_Runbook [04:40:16] 10Phabricator: Rename my account on phabricator from Taher2000 to Dr-Taher - https://phabricator.wikimedia.org/T298574 (10alaa) [05:33:45] 10Phabricator: Rename my account on phabricator from Taher2000 to Dr-Taher - https://phabricator.wikimedia.org/T298574 (10Aklapper) 05Open→03Resolved a:03Aklapper Done: https://phabricator.wikimedia.org/p/Dr-Taher/ [05:46:17] (03PS2) 10Hashar: jjb: quibble full run to generic image [integration/config] - 10https://gerrit.wikimedia.org/r/751392 (https://phabricator.wikimedia.org/T285649) [05:48:21] (03Restored) 10Hashar: Jenkins job validation (DO NOT SUBMIT) [integration/quibble] - 10https://gerrit.wikimedia.org/r/663557 (owner: 10Hashar) [05:48:32] (03CR) 10Hashar: "check experimental" [integration/quibble] - 10https://gerrit.wikimedia.org/r/663557 (owner: 10Hashar) [05:56:29] 10Project-Admins, 10Data-Engineering: Create project tag for Data-Engineering-Radar - https://phabricator.wikimedia.org/T298580 (10Aklapper) 05Open→03Resolved a:03Aklapper Requested public project #data-engineering-radar has been created: https://phabricator.wikimedia.org/project/view/5682/ (In case you... [06:01:47] 10Project-Admins, 10Data-Engineering: Create Project tag for Superset - https://phabricator.wikimedia.org/T298575 (10Aklapper) 05Open→03Resolved a:03Aklapper Requested public project #Superset has been created: https://phabricator.wikimedia.org/project/view/5683/ (In case you need to edit the project its... [06:05:08] (03CR) 10Hashar: [C: 03+2] "Tested on the dummy change https://gerrit.wikimedia.org/r/c/integration/quibble/+/663557 and it passes :]" [integration/config] - 10https://gerrit.wikimedia.org/r/751392 (https://phabricator.wikimedia.org/T285649) (owner: 10Hashar) [06:06:56] (03Merged) 10jenkins-bot: jjb: quibble full run to generic image [integration/config] - 10https://gerrit.wikimedia.org/r/751392 (https://phabricator.wikimedia.org/T285649) (owner: 10Hashar) [06:07:12] (03PS2) 10Hashar: jjb: move wmf-quibble-apache* to generic image [integration/config] - 10https://gerrit.wikimedia.org/r/751396 (https://phabricator.wikimedia.org/T285649) [06:12:58] (03CR) 10Hashar: [C: 03+2] "Jobs updated." [integration/config] - 10https://gerrit.wikimedia.org/r/751396 (https://phabricator.wikimedia.org/T285649) (owner: 10Hashar) [06:15:17] (03Merged) 10jenkins-bot: jjb: move wmf-quibble-apache* to generic image [integration/config] - 10https://gerrit.wikimedia.org/r/751396 (https://phabricator.wikimedia.org/T285649) (owner: 10Hashar) [06:15:29] kostajh: and I have removed the last usage of "releng/quibble-buster-php72-apache" image ;) [06:17:13] will see what happens on a random Wikibase change https://integration.wikimedia.org/ci/job/wmf-quibble-apache-selenium-php72-docker/4022/console [06:17:21] breakfast & [06:39:10] 10MediaWiki-Releasing, 10Upstream: Mediawiki 1.34.2 tarball incompatible with 7zip on windows due to Pax format - https://phabricator.wikimedia.org/T257102 (10Aklapper) Thanks for retesting. Shall we resolve this task then? [06:43:53] hashar: \o/ [07:54:27] 10Beta-Cluster-Infrastructure: Unable to undelete [[File:ACDC test file 1.pdf]] on Beta Wikimedia Commons - https://phabricator.wikimedia.org/T293558 (10Aklapper) [08:21:58] kostajh: somethining I don't get is quibble Api testing job for mediawiki/core targets 9413 [08:22:05] but I don't know from where that config comes from :D [08:22:09] anyway it works [08:22:37] and a Wikibase builds work https://integration.wikimedia.org/ci/job/wmf-quibble-apache-selenium-php72-docker/4022/consoleFull [08:32:51] hashar: "anyway it works" that's the important bit :D [08:32:57] but which job are you referring to specifically? [08:36:00] kostajh: that wmf-quibble-apache job i think [08:47:28] hashar: so this one? https://integration.wikimedia.org/ci/job/mediawiki-quibble-apitests-vendor-php72-docker/24926/consoleFull it is using 9412? [08:48:08] nop https://integration.wikimedia.org/ci/job/wmf-quibble-apache-selenium-php72-docker/4022/consoleFull [08:48:16] which uses the newish quibble-with-apache [08:48:45] which runs quibble with port 9413 [08:49:03] but I can't find out how mediawiki api-testing is made to point to it [08:49:06] rather than 9412 [08:49:07] bah [08:57:33] oh that does not run api testing phase ... [08:58:09] hashar: right, that's in a separate job [08:58:28] what's the next step? [08:58:38] I am trying the other job https://integration.wikimedia.org/ci/job/wmf-quibble-apache-vendor-mysql-php72-docker/4009/console [09:02:04] which has a --skip=api-testing bah [09:02:53] I am simply not paying attention [09:06:07] (03PS1) 10Hashar: Migrate mediawiki-quibble-apitests-vendor-php72-docker to Apache [integration/config] - 10https://gerrit.wikimedia.org/r/751684 (https://phabricator.wikimedia.org/T285649) [09:08:19] ah [09:08:25] I have to switch all jobs to the new image first [09:08:28] (03CR) 10Kosta Harlan: [C: 03+1] Migrate mediawiki-quibble-apitests-vendor-php72-docker to Apache [integration/config] - 10https://gerrit.wikimedia.org/r/751684 (https://phabricator.wikimedia.org/T285649) (owner: 10Hashar) [09:11:40] (03PS2) 10Hashar: Migrate mediawiki-quibble-apitests-vendor-php72-docker to Apache [integration/config] - 10https://gerrit.wikimedia.org/r/751684 (https://phabricator.wikimedia.org/T285649) [09:11:42] (03PS1) 10Hashar: jjb: update Quibble jobs to latest image [integration/config] - 10https://gerrit.wikimedia.org/r/751685 (https://phabricator.wikimedia.org/T285649) [09:12:13] and I should drop that `-docker` suffix from the job names [09:12:24] https://integration.wikimedia.org/ci/job/mediawiki-quibble-apitests-vendor-php72-docker/24931/console [09:13:21] well that seems to work :] [09:14:22] and I have absolutely no idea how the API testing manages to hit apache on port 9413 [09:16:43] hashar: isn't that thanks to https://gerrit.wikimedia.org/r/c/mediawiki/tools/api-testing/+/751444 ? [09:17:10] it uses api testing 1.3.0 from npmjs.org [09:17:28] hm [09:18:21] and mediawiki/core has a tests/api-testing/.api-testing-quibble.json which refers to 9412 [09:18:25] but that file does not seem to be used ;) [09:18:31] ha [09:18:43] so essentially I have no idea how it works [09:21:18] OH [09:22:03] so Quibble ApiTesting reads that mediawiki/core tests/api-testing/.api-testing-quibble.json file, it json_load it then change "base_uri" to use the quibble url [09:22:56] which comes from quibble-with-apache invoking quibble with --web-url=http://127.0.0.1:9413 [09:22:58] ah, that was clever of Quibble [09:23:03] so for mediawiki repositories that is solved :] [09:23:14] no need for a hack such as https://gerrit.wikimedia.org/r/c/mediawiki/tools/api-testing/+/751444 [09:23:25] nor do we need to set QUIBBLE_APACHE=1 for those jobs [09:23:28] niceee [09:24:01] I'm confused, didn't we see that it didn't work yesterday? Or was that speculative? Either way, sure let's revert the patch and see what happens [09:24:18] https://gerrit.wikimedia.org/r/c/mediawiki/tools/api-testing/+/751531 [09:24:29] !log Updating Quibble jobs to use latest image (provides `quibble-with-apache` entrypoint) https://gerrit.wikimedia.org/r/c/integration/config/+/751685/ [09:24:30] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [09:24:31] Quibble ApiTesting should probably emit some log message that it is updating the base_uri [09:24:40] that was for mediawiki/tools/api-testing repo [09:24:56] for which quibble runs "npm run api-testing" directly [09:25:04] rather than relying on its internal ApiTesting class [09:25:12] so yeah different mechanisms :\ [09:25:31] (03CR) 10Hashar: [C: 03+2] jjb: update Quibble jobs to latest image [integration/config] - 10https://gerrit.wikimedia.org/r/751685 (https://phabricator.wikimedia.org/T285649) (owner: 10Hashar) [09:25:39] (03CR) 10Hashar: [C: 03+2] Migrate mediawiki-quibble-apitests-vendor-php72-docker to Apache [integration/config] - 10https://gerrit.wikimedia.org/r/751684 (https://phabricator.wikimedia.org/T285649) (owner: 10Hashar) [09:25:45] mediawiki-quibble-apitests-vendor-php72-docker works ;) [09:27:25] (03Merged) 10jenkins-bot: jjb: update Quibble jobs to latest image [integration/config] - 10https://gerrit.wikimedia.org/r/751685 (https://phabricator.wikimedia.org/T285649) (owner: 10Hashar) [09:27:44] (03Merged) 10jenkins-bot: Migrate mediawiki-quibble-apitests-vendor-php72-docker to Apache [integration/config] - 10https://gerrit.wikimedia.org/r/751684 (https://phabricator.wikimedia.org/T285649) (owner: 10Hashar) [09:28:03] I see [09:32:28] and given the wmf-quibble-apache-selenium job seems to work [09:32:40] we can drop it and migrate wmf-quibble-selenium to use quibble-with-apache [09:32:51] I am giving it a try against mediawiki/core at https://integration.wikimedia.org/ci/job/wmf-quibble-apache-selenium-php72-docker/4024/console [09:33:22] success [09:34:10] but that does not run every selenium tests .. [09:35:48] oh i forgot the dependencies bah [09:36:55] * kostajh watches https://integration.wikimedia.org/ci/job/wmf-quibble-apache-selenium-php72-docker/4026/console [09:37:41] yeah it fails [09:37:52] I think because EXT_DEPENDENCIES is not injected on a manual build [09:37:58] hmm [09:38:22] I triggered an experimental build against a dummy change of core ( https://gerrit.wikimedia.org/r/c/mediawiki/core/+/92621 ) which is in the queue [09:38:31] this way zuul will inject the depnendeices [09:38:40] one thing that would help with this rollout, potentially, is to propagate T296826 to skins/extensions. it would mask flaky tests, but also not result in failed builds that annoy people [09:38:40] T296826: specFileRetries does not seem to apply in extension wdio.conf.js - https://phabricator.wikimedia.org/T296826 [09:38:51] and of course the apache variant is not in experimental bummer [09:39:38] 10Continuous-Integration-Infrastructure, 10Browser-Tests, 10User-zeljkofilipin: specFileRetries does not seem to apply in extension wdio.conf.js - https://phabricator.wikimedia.org/T296826 (10kostajh) >>! In T296826#7540780, @zeljkofilipin wrote: > @kostajh that's an option too. Unfortunately, I don't think... [09:40:42] (03PS1) 10Hashar: zuul: mediawiki/core add experimental job with apache [integration/config] - 10https://gerrit.wikimedia.org/r/751689 (https://phabricator.wikimedia.org/T285649) [09:47:01] oh my god [09:47:16] it is skipped on core or vendor [09:48:16] what is skipped? [09:50:59] (03PS1) 10Hashar: zuul: allow wmf-quibble-apache job for core or vendor [integration/config] - 10https://gerrit.wikimedia.org/r/751690 (https://phabricator.wikimedia.org/T285649) [09:51:01] some zuul filter was off [09:51:49] that stack has way too many level of complexity :-\ [09:53:15] 10Beta-Cluster-Infrastructure, 10Patch-For-Review: Deployment-prep should host its own statsd/graphite server - https://phabricator.wikimedia.org/T241285 (10Majavah) So here's a fun issue: grafana-labs is running on cloudmetrics* hardware. That hardware is running on a private vlan and can't access Cloud VPS d... [09:59:45] I should have not pushed directly bah [10:01:56] (03PS1) 10Hashar: zuul: fix wmf-quibble-apache filtering [integration/config] - 10https://gerrit.wikimedia.org/r/751691 (https://phabricator.wikimedia.org/T285649) [10:09:43] (03CR) 10Hashar: [C: 03+2] zuul: fix wmf-quibble-apache filtering [integration/config] - 10https://gerrit.wikimedia.org/r/751691 (https://phabricator.wikimedia.org/T285649) (owner: 10Hashar) [10:09:50] I guess I am rusty [10:11:33] (03Merged) 10jenkins-bot: zuul: fix wmf-quibble-apache filtering [integration/config] - 10https://gerrit.wikimedia.org/r/751691 (https://phabricator.wikimedia.org/T285649) (owner: 10Hashar) [10:14:50] pff finally https://integration.wikimedia.org/ci/job/wmf-quibble-apache-selenium-php72-docker/4027/ [10:21:57] so far so good [10:25:09] yeah I am surprised [10:25:18] I thought we had a bunch of race conditions here and there [10:33:33] success! [10:36:41] I guess I will do the switch [10:40:57] sounds good to me :) [10:41:15] i'm sure stuff will fail periodically, but not sure it will be at much higher frequency than it already is [10:41:32] anyway, i'm around to switch it() to it.skip() as needed :D [10:41:53] (03PS1) 10Hashar: Migrate Quibble jobs to use Apache [integration/config] - 10https://gerrit.wikimedia.org/r/751697 (https://phabricator.wikimedia.org/T285649) [10:42:04] I think that will do it, will review the diffs [10:42:09] but now I have to prepare lunch ;) [10:43:41] (03CR) 10Kosta Harlan: "\o/" [integration/config] - 10https://gerrit.wikimedia.org/r/751697 (https://phabricator.wikimedia.org/T285649) (owner: 10Hashar) [10:43:43] and there is the legacy job which is ruby based [10:43:47] but I guess I will ignore that one [10:47:57] (03CR) 10Hashar: [C: 03+2] "Lets roll, thank you Kosta for all the support!" [integration/config] - 10https://gerrit.wikimedia.org/r/751697 (https://phabricator.wikimedia.org/T285649) (owner: 10Hashar) [10:48:01] lets be bold [10:48:36] !log CI: switching MediaWiki selenium from php built-in server to Apache # https://gerrit.wikimedia.org/r/751697 [10:48:37] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [10:48:41] kostajh: thank you :] [10:48:48] they seem good enough [10:50:04] (03Merged) 10jenkins-bot: Migrate Quibble jobs to use Apache [integration/config] - 10https://gerrit.wikimedia.org/r/751697 (https://phabricator.wikimedia.org/T285649) (owner: 10Hashar) [10:51:07] nice [10:51:38] thank you to awight for doing a lot of the work for this [10:55:02] (03CR) 10Kosta Harlan: "can we try this one out please?" [integration/config] - 10https://gerrit.wikimedia.org/r/742939 (https://phabricator.wikimedia.org/T284611) (owner: 10Kosta Harlan) [10:59:56] the supervisord work is indeed quite nice [11:01:21] 10Continuous-Integration-Config, 10Quibble, 10Patch-For-Review: Switch all Quibble Selenium jobs to use apache - https://phabricator.wikimedia.org/T285649 (10hashar) [11:02:00] 10Continuous-Integration-Config, 10MW-1.37-notes (1.37.0-wmf.20; 2021-08-23), 10Patch-For-Review: Introduce non-voting jobs with quibble+apache - https://phabricator.wikimedia.org/T276428 (10hashar) 05Open→03Resolved I think that is done, we had experimental jobs running including a wmf-quibble gating jo... [11:03:07] went bold and marked the task solved [11:03:17] kostajh: for adding parsoid there are a few related changes indeed [11:03:36] 10Continuous-Integration-Config, 10Quibble, 10Patch-For-Review: Switch all Quibble Selenium jobs to use apache - https://phabricator.wikimedia.org/T285649 (10hashar) 05Open→03Resolved There are a few left over tasks for tests that fail due to the concurrent requests, they got worked around or marked to b... [11:03:51] I think cscott said it would be fine to test with parsoid@master [11:04:01] then that means we no more test with the parsoid version shipped by mediawiki core [11:04:36] I guess I should just deploy them all [11:04:39] anyway lunch time [11:30:29] enjoy [11:30:41] we should probably send an email to wikitech-l about this change [11:33:01] (03CR) 10Kosta Harlan: "well, this may not be necessary, I'll test a few things. https://gerrit.wikimedia.org/r/c/mediawiki/extensions/GrowthExperiments/+/699705 " [integration/config] - 10https://gerrit.wikimedia.org/r/742939 (https://phabricator.wikimedia.org/T284611) (owner: 10Kosta Harlan) [11:35:46] (03CR) 10Kosta Harlan: zuul: Add VisualEditor/parsoid dependencies to GrowthExperiments (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/742939 (https://phabricator.wikimedia.org/T284611) (owner: 10Kosta Harlan) [11:38:50] 10Continuous-Integration-Config, 10Quibble, 10Platform Engineering, 10MW-1.38-notes (1.38.0-wmf.17; 2022-01-10), 10Platform Team Initiatives (API Integration Tests): "should mark the revert as a bot edit" test flaky with Apache + php-fpm - https://phabricator.wikimedia.org/T298514 (10kostajh) Tagging #pl... [12:18:35] 10Continuous-Integration-Infrastructure, 10Browser-Tests, 10User-zeljkofilipin: specFileRetries does not seem to apply in extension wdio.conf.js - https://phabricator.wikimedia.org/T296826 (10zeljkofilipin) a:03zeljkofilipin [13:36:08] addshore: hi , do you have any doc / link for mw cli? [13:36:19] https://www.mediawiki.org/wiki/Cli [13:37:38] that is for Sai from the web team [13:37:45] coool! [13:37:49] they are willing to build a visual regression system [13:38:12] nice [13:38:14] so potentially they would need an easy way to spawn a mediawiki system out, load it with data, take screenshot [13:38:29] then compare the visual rendering against a known baseline (prod probably) [13:38:34] yeah that is a fun project! [13:38:48] so I hinted at quibble, but it is not really human friendly [13:38:55] I felt like mw cli might be the way to go [13:38:57] yeah, I'd hope that mwcli should let them do it in a few commands :) [13:39:01] also happy new year! [13:39:06] happy new year! [14:04:40] PROBLEM - SSH on contint1001.mgmt is CRITICAL: CRITICAL - Socket timeout after 10 seconds https://wikitech.wikimedia.org/wiki/Dc-operations/Hardware_Troubleshooting_Runbook [14:18:07] (03Abandoned) 10Hashar: Jenkins job validation (DO NOT SUBMIT) [integration/quibble] - 10https://gerrit.wikimedia.org/r/663557 (owner: 10Hashar) [14:29:15] (03CR) 10Hashar: [C: 03+2] "Sounds good :]" [integration/quibble] - 10https://gerrit.wikimedia.org/r/738061 (https://phabricator.wikimedia.org/T226869) (owner: 10Kosta Harlan) [14:31:55] 10Continuous-Integration-Config, 10Quibble, 10Platform Engineering, 10MW-1.38-notes (1.38.0-wmf.17; 2022-01-10), and 2 others: "should mark the revert as a bot edit" test flaky with Apache + php-fpm - https://phabricator.wikimedia.org/T298514 (10hashar) I have send https://gerrit.wikimedia.org/r/c/mediawik... [14:44:16] (03Merged) 10jenkins-bot: BrowserTests: Option to run npm install in parallel [integration/quibble] - 10https://gerrit.wikimedia.org/r/738061 (https://phabricator.wikimedia.org/T226869) (owner: 10Kosta Harlan) [14:54:56] (03CR) 10Hashar: [C: 03+2] "I originally thought we could find something easier that does not have to involve the low level os.dup or os.dup2, but that one seems to w" [integration/quibble] - 10https://gerrit.wikimedia.org/r/693456 (owner: 10Awight) [15:02:26] (03CR) 10Hashar: "quibble.backend._stream_relay seems to achieve the same behavior?" [integration/quibble] - 10https://gerrit.wikimedia.org/r/693457 (owner: 10Awight) [15:06:54] (03CR) 10Awight: Expand redirection to capture logging (031 comment) [integration/quibble] - 10https://gerrit.wikimedia.org/r/693457 (owner: 10Awight) [15:11:34] (03Merged) 10jenkins-bot: Introduce utility to redirect stdout and stderr [integration/quibble] - 10https://gerrit.wikimedia.org/r/693456 (owner: 10Awight) [15:13:42] 10MediaWiki-Releasing, 10Upstream: MediaWiki 1.34.2 release tarball incompatible with 7zip on Windows due to Pax format - https://phabricator.wikimedia.org/T257102 (10Krinkle) [15:14:18] (03CR) 10Hashar: [C: 03+1] "Sorry I have misread the intent. Looks like the patch needs to be rebased :/" [integration/quibble] - 10https://gerrit.wikimedia.org/r/693457 (owner: 10Awight) [15:15:38] (03PS8) 10Awight: Expand redirection to capture logging [integration/quibble] - 10https://gerrit.wikimedia.org/r/693457 [15:16:22] (03CR) 10Hashar: [C: 03+2] Expand redirection to capture logging [integration/quibble] - 10https://gerrit.wikimedia.org/r/693457 (owner: 10Awight) [15:17:36] 10GitLab (Auth & Access): Create top level 'sre' group on Gitlab - https://phabricator.wikimedia.org/T298620 (10jbond) [15:34:36] (03CR) 10Kosta Harlan: "This would also be nice to include with Quibble 1.3.0; it's safe in that it's behind a command flag, so if it doesn't work out, it's a jjb" [integration/quibble] - 10https://gerrit.wikimedia.org/r/747904 (owner: 10Kosta Harlan) [16:06:56] RECOVERY - SSH on contint1001.mgmt is OK: SSH OK - OpenSSH_6.6 (protocol 2.0) https://wikitech.wikimedia.org/wiki/Dc-operations/Hardware_Troubleshooting_Runbook [16:11:13] 10Quibble, 10MediaWiki-Core-Tests, 10Browser-Tests, 10Patch-For-Review: Run browser tests in parallel - https://phabricator.wikimedia.org/T226869 (10hashar) [16:11:21] 10Continuous-Integration-Config, 10Quibble, 10Patch-For-Review: Switch all Quibble Selenium jobs to use apache - https://phabricator.wikimedia.org/T285649 (10hashar) [16:12:20] 10MediaWiki-Releasing, 10Upstream: MediaWiki 1.34.2 release tarball incompatible with 7zip on Windows due to Pax format - https://phabricator.wikimedia.org/T257102 (10Krinkle) 05Open→03Resolved a:03Reedy Resolved, as per [Reedy's edit](https://www.mediawiki.org/w/index.php?title=Template%3ADownloadMediaW... [16:16:31] (03PS1) 10Ahmon Dancy: rsync_cdbs fix [tools/scap] - 10https://gerrit.wikimedia.org/r/751763 (https://phabricator.wikimedia.org/T297326) [16:19:35] (03CR) 10Ahmon Dancy: [C: 03+2] rsync_cdbs fix [tools/scap] - 10https://gerrit.wikimedia.org/r/751763 (https://phabricator.wikimedia.org/T297326) (owner: 10Ahmon Dancy) [16:20:39] (03Merged) 10jenkins-bot: rsync_cdbs fix [tools/scap] - 10https://gerrit.wikimedia.org/r/751763 (https://phabricator.wikimedia.org/T297326) (owner: 10Ahmon Dancy) [16:27:07] (03CR) 10Krinkle: [C: 03+1] rsync_cdbs fix [tools/scap] - 10https://gerrit.wikimedia.org/r/751763 (https://phabricator.wikimedia.org/T297326) (owner: 10Ahmon Dancy) [16:41:13] 10Quibble, 10MediaWiki-Core-Tests, 10Browser-Tests, 10Patch-For-Review: Run browser tests in parallel - https://phabricator.wikimedia.org/T226869 (10hashar) As of this morning, CI exposes MediaWiki through Apache which allow concurrent requests (T285649) we should thus be able to get webdriver.io to run t... [16:58:41] (03PS3) 10Kosta Harlan: BrowserTests: Support splitting projects into two groups [integration/quibble] - 10https://gerrit.wikimedia.org/r/747904 (https://phabricator.wikimedia.org/T226869) [17:13:30] (03PS1) 10Gehel: Review access change [wikimedia-event-utilities] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/751542 [17:15:06] (03CR) 10Joal: [C: 03+2] "Merging for Search to gain access :)" [wikimedia-event-utilities] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/751542 (owner: 10Gehel) [17:16:13] (03CR) 10Joal: [V: 03+2 C: 03+2] Review access change [wikimedia-event-utilities] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/751542 (owner: 10Gehel) [17:31:40] !log Deploying Zuul change https://gerrit.wikimedia.org/r/c/integration/config/+/751697 to get rid of the wmf-quibble-apache jobs # T285649 [17:31:42] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [17:31:42] T285649: Switch all Quibble Selenium jobs to use apache - https://phabricator.wikimedia.org/T285649 [17:31:46] (03PS1) 10Ahmon Dancy: update_submodules: Don't use utils.cd() [tools/scap] - 10https://gerrit.wikimedia.org/r/751776 [17:31:52] (03CR) 10Hashar: "Deployed! I forgot :-(" [integration/config] - 10https://gerrit.wikimedia.org/r/751697 (https://phabricator.wikimedia.org/T285649) (owner: 10Hashar) [17:37:11] (03PS2) 10Ahmon Dancy: update_submodules: Don't use utils.cd() [tools/scap] - 10https://gerrit.wikimedia.org/r/751776 [17:59:34] 10Quibble, 10MediaWiki-Core-Tests, 10Browser-Tests, 10Patch-For-Review, 10User-zeljkofilipin: Run browser tests in parallel - https://phabricator.wikimedia.org/T226869 (10zeljkofilipin) [18:42:02] (03PS1) 10Zabe: General small code cleanups [tools/scap] - 10https://gerrit.wikimedia.org/r/751780 [18:56:14] 10Quibble, 10MediaWiki-Core-Tests, 10Browser-Tests, 10Patch-For-Review, 10User-zeljkofilipin: Run browser tests in parallel - https://phabricator.wikimedia.org/T226869 (10Krinkle) @kostajh If I understand correctly, this last patch would split at the job/quibble level, and thus not share a common db or w... [19:11:06] (03CR) 10Thcipriani: [C: 03+2] "Good point about relative directories. nice catch." [tools/scap] - 10https://gerrit.wikimedia.org/r/751776 (owner: 10Ahmon Dancy) [19:11:44] (03Merged) 10jenkins-bot: update_submodules: Don't use utils.cd() [tools/scap] - 10https://gerrit.wikimedia.org/r/751776 (owner: 10Ahmon Dancy) [19:15:34] !log run `sudo chown -R jenkins-deploy:wikidev public/dists/bullseye-deployment-prep/` on deployment-deploy03 [19:15:35] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [19:24:52] (03CR) 10Ahmon Dancy: "The changes look ok to me. I will wait a bit to give Tyler a chance to review as well." [tools/scap] - 10https://gerrit.wikimedia.org/r/751780 (owner: 10Zabe) [19:25:26] (03CR) 10Ahmon Dancy: "Please ping me in a day or two if you haven't gotten a +2 by then." [tools/scap] - 10https://gerrit.wikimedia.org/r/751780 (owner: 10Zabe) [19:30:23] 10Quibble, 10MediaWiki-Core-Tests, 10Browser-Tests, 10MW-1.38-notes (1.38.0-wmf.17; 2022-01-10), and 2 others: Run browser tests in parallel - https://phabricator.wikimedia.org/T226869 (10kostajh) >>! In T226869#7599620, @Krinkle wrote: > @kostajh If I understand correctly, this last patch would split at t... [19:38:43] 10Release-Engineering-Team (Next), 10Patch-For-Review, 10Release, 10Train Deployments: 1.38.0-wmf.16 deployment blockers - https://phabricator.wikimedia.org/T293957 (10mmodell) [19:39:17] 10Release-Engineering-Team (Next), 10Release, 10Train Deployments: 1.38.0-wmf.17 deployment blockers - https://phabricator.wikimedia.org/T293958 (10mmodell) [19:42:50] (03PS1) 10Ahmon Dancy: Add --abort-git-am-on-fail option to scap apply-patches [tools/scap] - 10https://gerrit.wikimedia.org/r/751792 [20:15:58] 10Gerrit, 10Privacy, 10Upstream: Gerrit loads font from fonts.googleapis.com and fonts.gstatic.com - https://phabricator.wikimedia.org/T240264 (10hashar) @QChris upstreamed patch https://gerrit-review.googlesource.com/273397 has been released with Gerrit 3.3.9. [20:44:42] 10Phabricator, 10translatewiki.net: Remove trailing whitespace from Phabricator message documentation - https://phabricator.wikimedia.org/T294754 (10mmodell) a:03mmodell [21:13:06] PROBLEM - SSH on contint1001.mgmt is CRITICAL: CRITICAL - Socket timeout after 10 seconds https://wikitech.wikimedia.org/wiki/Dc-operations/Hardware_Troubleshooting_Runbook [21:15:11] 10Release-Engineering-Team, 10MW-on-K8s: mediawiki-multiversion image builder should also poll private and security patches git repositories - https://phabricator.wikimedia.org/T298165 (10Dzahn) deployed Ahmon's change, first only on codfw, which was good because there was a little fix needed in the ferm rules... [21:18:58] 10Release-Engineering-Team, 10MW-on-K8s, 10serviceops-radar: mediawiki-multiversion image builder should also poll private and security patches git repositories - https://phabricator.wikimedia.org/T298165 (10Dzahn) [21:32:12] (03CR) 10Hashar: [C: 04-1] "I have no idea what excimer is but if we need a lot of configuration I highly advise to move it to mediawiki/core includes/DevelopmentSett" [integration/quibble] - 10https://gerrit.wikimedia.org/r/748314 (https://phabricator.wikimedia.org/T225730) (owner: 10Ladsgroup) [21:36:10] (03CR) 10Hashar: "May you elaborate what php-excimer is and why it would be needed in a CI run?" [integration/config] - 10https://gerrit.wikimedia.org/r/748312 (https://phabricator.wikimedia.org/T225730) (owner: 10Ladsgroup) [21:59:58] 10Release-Engineering-Team, 10MW-on-K8s, 10serviceops-radar: mediawiki-multiversion image builder should also poll private and security patches git repositories - https://phabricator.wikimedia.org/T298165 (10dancy) 05In progress→03Resolved a:03dancy Thanks @Dzahn. That allowed me to configure releases... [22:10:42] 10Gerrit, 10SRE, 10serviceops: replacement for gerrit2001 - https://phabricator.wikimedia.org/T243027 (10Dzahn) [22:14:52] 10Gerrit, 10SRE, 10serviceops: replacement for gerrit2001 - https://phabricator.wikimedia.org/T243027 (10Dzahn) @LSobanski @akosiaris This one is for consideration in a manager meeting with releng. [23:15:28] RECOVERY - SSH on contint1001.mgmt is OK: SSH OK - OpenSSH_6.6 (protocol 2.0) https://wikitech.wikimedia.org/wiki/Dc-operations/Hardware_Troubleshooting_Runbook