[00:41:03] 10GitLab (Project Migration), 10Release-Engineering-Team: Create new GitLab project group: 10nm - https://phabricator.wikimedia.org/T321022 (10Remagoxer) [00:41:05] 10Project-Admins: Create project tag for Ultraviolet - https://phabricator.wikimedia.org/T321023 (10Remagoxer) [00:42:22] 10Project-Admins: Create project tag for Ultraviolet - https://phabricator.wikimedia.org/T321023 (10Remagoxer) [00:42:34] 10GitLab (Project Migration), 10Release-Engineering-Team: Create new GitLab project group: 10nm - https://phabricator.wikimedia.org/T321022 (10Chlod) +1 on this. Confirming as project lead that Remagoxer has been allowed to file this task on behalf of the team. [00:42:46] 10Project-Admins: Create project tag for Ultraviolet - https://phabricator.wikimedia.org/T321023 (10Chlod) +1 on this. Confirming as project lead that Remagoxer has been allowed to file this task on behalf of the team. [01:40:51] heyyy all dunno if you saw the flapping qunit test for mw.loader... see different results on CI gate-and-submit jobs here: https://gerrit.wikimedia.org/r/c/mediawiki/extensions/CentralNotice/+/843589 [06:47:16] AndyRussG: releng usually doesnt. That should be filed against #ci-test-error [07:44:27] <_joe_> jnuche, hashar do you have any idea why https://gerrit.wikimedia.org/r/c/wikimedia/irc/ircservserv-config/+/842952 is failing CI? The only thing I found is a pipelinelib job (why for ircservserv??) that fails because it doesn't find a .dockerignore file [07:44:45] 10Release-Engineering-Team (Priority Backlog đŸ“Ĩ), 10Patch-For-Review, 10Release, 10Train Deployments: 1.40.0-wmf.6 deployment blockers - https://phabricator.wikimedia.org/T320511 (10hashar) [07:44:46] <_joe_> https://integration.wikimedia.org/ci/job/ircservserv-config-pipeline-test/89/console [07:45:06] <_joe_> I assume this has to do with a move of pipelinelib to use buildkit and not my change [07:45:16] <_joe_> can you advise? [08:03:36] !log wipe deployment-cache-(text|upload)06 - T320930 [08:03:38] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [08:03:38] T320930: deployment-cache instances are missing several major features available in production - https://phabricator.wikimedia.org/T320930 [08:03:59] 10Release-Engineering-Team, 10Release Pipeline (Blubber), 10ci-test-error: pipelinelib jobs on gerrit fail in absence of a .dockerignore file - https://phabricator.wikimedia.org/T321035 (10Joe) [08:04:22] 10Release-Engineering-Team, 10Release Pipeline (Blubber), 10ci-test-error: pipelinelib jobs on gerrit fail in absence of a .dockerignore file - https://phabricator.wikimedia.org/T321035 (10Joe) p:05Triage→03Unbreak! Setting as UBN! as many builds will probably fail as a consequence. [08:05:10] 10Release-Engineering-Team, 10Release Pipeline (Blubber), 10ci-test-error: pipelinelib jobs on gerrit fail in absence of a .dockerignore file - https://phabricator.wikimedia.org/T321035 (10elukey) Same problem here: https://integration.wikimedia.org/ci/job/inference-services-pipeline-editquality/239/console [08:06:52] 10Project-Admins: Create project tag for Ultraviolet - https://phabricator.wikimedia.org/T321023 (10Aklapper) 05Open→03Resolved a:03Aklapper Requested public project #Ultraviolet has been created: https://phabricator.wikimedia.org/project/view/6210/ (In case you need to edit the project or project workboa... [08:14:44] _joe_: there is a fix for the .dockerfile issue is in blubber's master, I'm gonna try to create a new version, see if that fixes the problem [08:15:10] <_joe_> jnuche: I guess you'll need to deploy blubberoid afterwards [08:15:32] I think so, haven't done it before, but I'll find out [08:19:56] (03PS1) 10Jaime Nuche: version: 0.11.1 [blubber] - 10https://gerrit.wikimedia.org/r/843870 [08:24:13] (03CR) 10Jaime Nuche: "I tested this changes also without a `.dockerfile` and the build process succeeded. I don't understand it, I must have made a mistake duri" [blubber] - 10https://gerrit.wikimedia.org/r/843520 (https://phabricator.wikimedia.org/T320988) (owner: 10Dduvall) [08:26:46] (03CR) 10Jaime Nuche: [C: 03+2] version: 0.11.1 [blubber] - 10https://gerrit.wikimedia.org/r/843870 (owner: 10Jaime Nuche) [08:29:37] (03Merged) 10jenkins-bot: version: 0.11.1 [blubber] - 10https://gerrit.wikimedia.org/r/843870 (owner: 10Jaime Nuche) [08:32:51] ;) [08:50:53] ok, it looks like the failing pipelines are using the buildkit backend, not blubberoid, so we don't need a new blubberoid version [08:51:22] I'm looking into how to update the references to the new buildkit image with the fix [09:01:05] <_joe_> ah buildkit doesn't use blubberoid at all? [09:01:27] <_joe_> that's surprising. Is there any docs? [09:03:13] 10Release-Engineering-Team (Priority Backlog đŸ“Ĩ), 10Patch-For-Review, 10Release, 10Train Deployments: 1.40.0-wmf.6 deployment blockers - https://phabricator.wikimedia.org/T320511 (10hashar) [09:07:28] _joe_: it doesn't, buildkit is used under the hood by `docker build` via a frontend and doesn't interact with blubberoid [09:07:35] blubberoid is being phased out, in fact [09:07:58] if I'm reading this correctly, all pipelines using pipelinelib are now using the buildkit frontend: https://gerrit.wikimedia.org/r/c/integration/pipelinelib/+/842543/7/src/org/wikimedia/integration/PipelineRunner.groovy#37 [09:08:41] I think there is not documentation yet, my understanding is we are meant to announce this changes "officially" soon [09:08:44] <_joe_> yeah, and that must use blubber directly and not blubberoid? [09:09:02] yes, exactly, blubber implements the buildkit frontend [09:09:08] <_joe_> because this seems related to the blubber issue you just mentioned [09:10:10] right now I'm trying to figure out why the blubber publish CI job hasn't pushed the latest blubber image [09:10:19] (finding out stuff as I go) [09:11:57] 10Beta-Cluster-Infrastructure: On beta cluster my IP is 172.16.0.113 (private range) - https://phabricator.wikimedia.org/T321037 (10Stang) [09:49:59] (03PS1) 10Jaime Nuche: use blubber-buildkit:v0.11.1 [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/843881 [09:50:30] hi folks! When you have a moment could you update T321035 with some info? (just to know how severe the problem is, etc..) [09:50:31] T321035: pipelinelib jobs on gerrit fail in absence of a .dockerignore file - https://phabricator.wikimedia.org/T321035 [09:52:41] (03CR) 10Jaime Nuche: [C: 03+2] use blubber-buildkit:v0.11.1 [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/843881 (owner: 10Jaime Nuche) [09:53:39] (03Merged) 10jenkins-bot: use blubber-buildkit:v0.11.1 [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/843881 (owner: 10Jaime Nuche) [09:57:10] 10Release-Engineering-Team (Priority Backlog đŸ“Ĩ), 10Patch-For-Review, 10Release, 10Train Deployments: 1.40.0-wmf.6 deployment blockers - https://phabricator.wikimedia.org/T320511 (10Urbanecm) >>! In T320511#8324412, @gerritbot wrote: > Change 843536 had a related patch set uploaded (by Urbanecm; author: Has... [10:03:34] _joe_ elukey: the CI problem should be fixed now, can you please confirm you can run your pipelines? [10:03:53] <_joe_> jnuche: <3 checking [10:06:01] <_joe_> jnuche: it worked, but it took suspiciously less time than the previous build [10:06:19] <_joe_> see https://gerrit.wikimedia.org/r/c/wikimedia/irc/ircservserv-config/+/842952 [10:06:26] <_joe_> elukey: can you also confirm? [10:08:07] _joe_: true, but the latest execution time is comparable with previous successful runs: [10:08:07] https://integration.wikimedia.org/ci/job/ircservserv-config-pipeline-test/88/ [10:08:07] https://integration.wikimedia.org/ci/job/ircservserv-config-pipeline-test/87/ [10:08:21] <_joe_> ah ok so it was an hiccup earlier [10:08:25] <_joe_> yeah indeed [10:08:27] <_joe_> cool [10:08:31] <_joe_> thanks a lot :)) [10:08:50] np 👍 [10:13:47] 10Release-Engineering-Team, 10Release Pipeline (Blubber), 10ci-test-error: pipelinelib jobs on gerrit fail in absence of a .dockerignore file - https://phabricator.wikimedia.org/T321035 (10jnuche) The builds were affected by https://phabricator.wikimedia.org/T320988 Sorry you were affected by that. There is... [10:14:12] jnuche: fixed thanks! [10:14:37] :) 👍 [11:29:42] 10Release-Engineering-Team (Priority Backlog đŸ“Ĩ), 10Patch-For-Review, 10Release, 10Train Deployments: 1.40.0-wmf.6 deployment blockers - https://phabricator.wikimedia.org/T320511 (10hashar) @Urbanecm my bad, I forgot to change the revert commit back to Gerrit. Thank you! [12:13:03] (03CR) 10Hashar: "CI triggered for gate-and-submit and did not find any conflict since it does a "git merge -s resolve". When trying to submit the change, " [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/842880 (owner: 10Dduvall) [12:13:44] (03CR) 10Hashar: [C: 03+2] "I have changed the Gerrit merge strategy to allow content merges ( via https://gerrit.wikimedia.org/r/admin/repos/integration/pipelinelib " [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/842880 (owner: 10Dduvall) [12:14:32] jnuche: do you know how integration/pipelinelib is deployed ? [12:15:03] maybe it is a timed git pull [12:15:11] or Jenkins takes care of keeping it up-to-date [12:15:15] (03Merged) 10jenkins-bot: Fix backup of .dockerignore file under custom context directory [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/842880 (owner: 10Dduvall) [12:17:00] hashar: yeah, it should be deployed automatically [12:22:03] great ;) [12:26:56] AndyRussG: test failure there appears to be from getExpiryKeys() calling non-existent timeRemaining in a request idle callback, not mw.loader? [12:38:49] 10Gerrit, 10Upstream: Gerrit's New UI reply dialog ignores Ctrl-Z - https://phabricator.wikimedia.org/T192666 (10hashar) Still happening on our Gerrit 3.4.6. It works with 3.7.0-rc1 which I have checked on upstream instance https://gerrit-review.googlesource.com/ Maybe that was addressed as part of 3.5.0 c... [12:40:37] 10Release-Engineering-Team (GitLab II: Wrath of Kahn 👾), 10Projects-Cleanup, 10Release Pipeline (Blubber): Archive the Blubber gerrit repo - https://phabricator.wikimedia.org/T317820 (10hashar) [12:51:11] (03PS3) 10Jaime Nuche: buildkit: allow entrypoint to run in the image building process [blubber] - 10https://gerrit.wikimedia.org/r/843515 (https://phabricator.wikimedia.org/T319323) [12:54:26] (03CR) 10Jaime Nuche: buildkit: allow entrypoint to run in the image building process (035 comments) [blubber] - 10https://gerrit.wikimedia.org/r/843515 (https://phabricator.wikimedia.org/T319323) (owner: 10Jaime Nuche) [13:08:06] I am finding that on the beta cluster my IP is 172.16.0.113 (an internal IP). Is that expected? When was this change made? [13:09:42] dwalden: mediawiki receives the requests from the frontend cache [13:10:09] and the cache should set a X-Forward-For header with 172.16.0.113, [13:11:21] there is an array setting somewhere to trust those and strip them from the request [13:11:54] I can't remember the setting name though :-( [13:12:38] dwalden: ah that is `$wgCdnServersNoPurge` [13:13:24] wmf-config/reverse-proxy-staging.php [13:13:35] // deployment-cache-text06 [13:13:35] '172.16.1.181', [13:13:35] // deployment-cache-upload06 [13:13:35] '172.16.1.160', [13:13:43] 10Release-Engineering-Team, 10Release Pipeline (Blubber), 10ci-test-error: pipelinelib jobs on gerrit fail in absence of a .dockerignore file - https://phabricator.wikimedia.org/T321035 (10Jdforrester-WMF) [13:13:46] that 172.16.0.113 IP must be added there [13:13:46] 10Release-Engineering-Team (GitLab II: Wrath of Kahn 👾), 10Release Pipeline (Blubber): Blubber fails when a .dockerignore file does not exist in the context directory - https://phabricator.wikimedia.org/T320988 (10Jdforrester-WMF) [13:14:25] deployment-cache-text07.deployment-prep.eqiad1.wikimedia.cloud. [13:14:40] dwalden: please propose a patch for operations/mediawiki-config and I will +2/deploy it [13:16:04] hashar: thanks, I will do [13:25:43] 10Beta-Cluster-Infrastructure: Update wgCdnServersNoPurge for deployment-cache-text07 - https://phabricator.wikimedia.org/T321072 (10dom_walden) [13:30:17] 10Gerrit: Remove Gerrit motd plugin - https://phabricator.wikimedia.org/T321075 (10hashar) [13:31:17] 10Gerrit, 10Release-Engineering-Team (Kanban), 10Patch-For-Review: Install motd plugin - https://phabricator.wikimedia.org/T190810 (10hashar) We have never used the `motd` plugin and I will remove it via T321075 [13:31:53] 10Gerrit: Remove Gerrit motd plugin - https://phabricator.wikimedia.org/T321075 (10hashar) [13:35:17] (03PS1) 10Hashar: Remove motd plugin [software/gerrit] (wmf/stable-3.4) - 10https://gerrit.wikimedia.org/r/843945 (https://phabricator.wikimedia.org/T321075) [13:36:18] (03PS2) 10Hashar: Remove motd plugin [software/gerrit] (wmf/stable-3.4) - 10https://gerrit.wikimedia.org/r/843945 (https://phabricator.wikimedia.org/T321075) [13:37:14] (03PS1) 10Hashar: Remove motd plugin and its config [software/gerrit] (deploy/wmf/stable-3.4) - 10https://gerrit.wikimedia.org/r/843946 (https://phabricator.wikimedia.org/T321075) [13:37:41] (03CR) 10Chad: [C: 03+2] Remove motd plugin [software/gerrit] (wmf/stable-3.4) - 10https://gerrit.wikimedia.org/r/843945 (https://phabricator.wikimedia.org/T321075) (owner: 10Hashar) [13:38:07] (03PS1) 10Hashar: Remove motd plugin [software/gerrit] (wmf/stable-3.5) - 10https://gerrit.wikimedia.org/r/843947 (https://phabricator.wikimedia.org/T321075) [13:38:45] (03PS1) 10Hashar: Remove motd plugin and its config [software/gerrit] (deploy/wmf/stable-3.5) - 10https://gerrit.wikimedia.org/r/843948 (https://phabricator.wikimedia.org/T321075) [13:42:00] (03CR) 10CI reject: [V: 04-1] Remove motd plugin [software/gerrit] (wmf/stable-3.5) - 10https://gerrit.wikimedia.org/r/843947 (https://phabricator.wikimedia.org/T321075) (owner: 10Hashar) [13:42:29] (03CR) 10CI reject: [V: 04-1] Remove motd plugin [software/gerrit] (wmf/stable-3.4) - 10https://gerrit.wikimedia.org/r/843945 (https://phabricator.wikimedia.org/T321075) (owner: 10Hashar) [13:43:33] 10Gerrit, 10Patch-For-Review: Remove Gerrit motd plugin - https://phabricator.wikimedia.org/T321075 (10hashar) @demon you got the `motd` plugin added to Gerrit back in 2018 via T190810 but we never used it. I am thus going to remove it if that sounds good to you ;) [13:43:35] grmmblblb [13:43:48] 00:03:37.445 Error in fail: failed [/usr/bin/python3, /src/tools/download_file.py, "-o", /log/external/openid-consumer/jar/openid4java-1.0.0-src.jar, "-u", "MAVEN_CENTRAL:/org/openid4java/openid4java/1.0.0/openid4java-1.0.0-sources.jar"]: curl: (7) Failed to connect to repo1.maven.org port 443: Connection timed out [13:43:55] will dig that one later tonight [13:46:24] 10Phabricator: Change my phab name - https://phabricator.wikimedia.org/T321008 (10Aklapper) Hi, please see https://www.mediawiki.org/wiki/Phabricator/Help#Creating_your_account - spaces are not allowed [13:52:07] 10Beta-Cluster-Infrastructure, 10Patch-For-Review: Update wgCdnServersNoPurge for deployment-cache-text07 - https://phabricator.wikimedia.org/T321072 (10TheresNoTime) `-cache-text06`/`-cache-upload06` decommissioned and replaced with `*07` in {T320930}, but unsure if some IPs were meant to move too (T320930#83... [13:54:04] (03CR) 10Chad: [C: 03+2] Remove motd plugin and its config [software/gerrit] (deploy/wmf/stable-3.4) - 10https://gerrit.wikimedia.org/r/843946 (https://phabricator.wikimedia.org/T321075) (owner: 10Hashar) [13:54:24] (03Merged) 10jenkins-bot: Remove motd plugin and its config [software/gerrit] (deploy/wmf/stable-3.4) - 10https://gerrit.wikimedia.org/r/843946 (https://phabricator.wikimedia.org/T321075) (owner: 10Hashar) [13:54:28] (03CR) 10Chad: [C: 03+2] Remove motd plugin [software/gerrit] (wmf/stable-3.5) - 10https://gerrit.wikimedia.org/r/843947 (https://phabricator.wikimedia.org/T321075) (owner: 10Hashar) [13:54:34] (03CR) 10Chad: [C: 03+2] Remove motd plugin and its config [software/gerrit] (deploy/wmf/stable-3.5) - 10https://gerrit.wikimedia.org/r/843948 (https://phabricator.wikimedia.org/T321075) (owner: 10Hashar) [13:56:49] hashar: ref dwalden's T321072 above, I inadvertently sniped the patch — https://gerrit.wikimedia.org/r/c/operations/mediawiki-config/+/843944 [13:56:49] T321072: Update wgCdnServersNoPurge for deployment-cache-text07 - https://phabricator.wikimedia.org/T321072 [13:57:38] 10Beta-Cluster-Infrastructure: On beta cluster my IP is 172.16.0.113 (private range) - https://phabricator.wikimedia.org/T321037 (10TheresNoTime) [13:57:41] 10Beta-Cluster-Infrastructure, 10Patch-For-Review: Update wgCdnServersNoPurge for deployment-cache-text07 - https://phabricator.wikimedia.org/T321072 (10TheresNoTime) [13:58:18] (03CR) 10CI reject: [V: 04-1] Remove motd plugin [software/gerrit] (wmf/stable-3.5) - 10https://gerrit.wikimedia.org/r/843947 (https://phabricator.wikimedia.org/T321075) (owner: 10Hashar) [13:58:34] (03Merged) 10jenkins-bot: Remove motd plugin and its config [software/gerrit] (deploy/wmf/stable-3.5) - 10https://gerrit.wikimedia.org/r/843948 (https://phabricator.wikimedia.org/T321075) (owner: 10Hashar) [14:07:10] (03CR) 10Jaime Nuche: [C: 03+1] "LGTM. Tests locally time out, so can't verify" [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/842881 (https://phabricator.wikimedia.org/T318866) (owner: 10Dduvall) [14:20:31] 10Beta-Cluster-Infrastructure: On beta cluster my IP is 172.16.0.113 (private range) - https://phabricator.wikimedia.org/T321037 (10Vgutierrez) p:05Triage→03Medium a:03Vgutierrez [14:20:50] 10GitLab (Misc), 10Release-Engineering-Team (Seen): Gerritlab - https://phabricator.wikimedia.org/T300819 (10demon) 05Open→03Declined This would involve us continuing to add Change-Ids onto commits even on Gitlab? No no, we don't want to recommend that. They're ugly and pointless. [14:25:40] 10GitLab (Integrations), 10Release-Engineering-Team (GitLab II: Wrath of Kahn 👾): GitLab integrations: the Gerrit & Jenkins integration catalog - https://phabricator.wikimedia.org/T319359 (10demon) [14:28:26] 10Beta-Cluster-Infrastructure: On beta cluster my IP is 172.16.0.113 (private range) - https://phabricator.wikimedia.org/T321037 (10Vgutierrez) ` vgutierrez@carrot:~$ curl -v https://en.wikipedia.beta.wmflabs.org/wiki/Main_Page -o /dev/null -s 2>&1 |grep x-client-ip < x-client-ip: 83.35.XXX.XXX ` X-Client-IP ge... [14:31:16] 10Beta-Cluster-Infrastructure: On beta cluster my IP is 172.16.0.113 (private range) - https://phabricator.wikimedia.org/T321037 (10Vgutierrez) but apparently XFF is also being populated like in production, mediaWiki has a list of hardcoded IPs|ranges that it should trust on XFF? [14:34:03] 10Beta-Cluster-Infrastructure: On beta cluster my IP is 172.16.0.113 (private range) - https://phabricator.wikimedia.org/T321037 (10Vgutierrez) hmm ok, this should be fixed by https://gerrit.wikimedia.org/r/c/operations/mediawiki-config/+/843944 as well [14:39:10] 10Beta-Cluster-Infrastructure, 10Patch-For-Review: Update wgCdnServersNoPurge for deployment-cache-text07 - https://phabricator.wikimedia.org/T321072 (10Vgutierrez) no, AFAIK the internal IPs shouldn't be moved, let's deploy https://gerrit.wikimedia.org/r/c/operations/mediawiki-config/+/843944/ [14:43:47] TheresNoTime: https://gerrit.wikimedia.org/r/c/operations/mediawiki-config/+/843944/ looks good to me [14:45:10] (03CR) 10Ahmon Dancy: buildkit: allow entrypoint to run in the image building process (032 comments) [blubber] - 10https://gerrit.wikimedia.org/r/843515 (https://phabricator.wikimedia.org/T319323) (owner: 10Jaime Nuche) [14:46:43] dwalden: ^^ [14:47:24] 10Phabricator: Change Phab name of SPatel - https://phabricator.wikimedia.org/T321008 (10Aklapper) [14:53:45] vgutierrez: Looks good to me [14:58:22] 10Beta-Cluster-Infrastructure, 10Patch-For-Review, 10Platform Team Workboards (MW Expedition): Put Parsoid output into the ParserCache on the beta cluster and testwiki - https://phabricator.wikimedia.org/T320535 (10daniel) p:05Triage→03High [14:59:14] 10Beta-Cluster-Infrastructure, 10Editing-team, 10MediaWiki-Configuration, 10VisualEditor, 10Platform Team Workboards (MW Expedition): Configure VE backend to use Parsoid directly on the beta cluster and testwiki - https://phabricator.wikimedia.org/T320531 (10daniel) p:05Triage→03High [15:00:01] (03CR) 10Ahmon Dancy: [V: 03+1 C: 03+1] "Nice work! I tested with blubber and scap's .pipeline/blubber.yaml." [blubber] - 10https://gerrit.wikimedia.org/r/843515 (https://phabricator.wikimedia.org/T319323) (owner: 10Jaime Nuche) [15:04:31] (03CR) 10Jaime Nuche: buildkit: allow entrypoint to run in the image building process (031 comment) [blubber] - 10https://gerrit.wikimedia.org/r/843515 (https://phabricator.wikimedia.org/T319323) (owner: 10Jaime Nuche) [15:28:09] (03CR) 10Jaime Nuche: buildkit: allow entrypoint to run in the image building process (031 comment) [blubber] - 10https://gerrit.wikimedia.org/r/843515 (https://phabricator.wikimedia.org/T319323) (owner: 10Jaime Nuche) [15:31:35] 10Phabricator, 10Project-Admins, 10Release-Engineering-Team (Radar), 10Security-Team, and 2 others: Move the #acl_security_volunteer policy outside of #acl_security - https://phabricator.wikimedia.org/T305890 (10Nintendofan885) [15:32:16] 10Phabricator, 10Project-Admins, 10Release-Engineering-Team (Radar), 10Security-Team, and 2 others: Move the #acl_security_volunteer policy outside of #acl_security - https://phabricator.wikimedia.org/T305890 (10Nintendofan885) (account renamed in T310999) [15:35:04] hmmm https://gerrit.wikimedia.org/r/c/operations/mediawiki-config/+/843944 should get automagically deployed on deployment-prep at some point or am I missing any manual step? [15:36:40] hmm it looks like it's been deployed already [15:44:18] vgutierrez: the https://integration.wikimedia.org/ci/view/Beta/job/beta-mediawiki-config-update-eqiad/ job deploys changes to config. Jenkins should run that job once the change has merged into operations/mediawiki-config.git. Once the job has pulled the new config down it fires https://integration.wikimedia.org/ci/view/Beta/job/beta-scap-sync-world/ to push the config out to the beta wiki cluster. [15:44:31] 10GitLab (Infrastructure), 10serviceops-collab: Migrate gitlab-test instance to bullseye - https://phabricator.wikimedia.org/T318521 (10LSobanski) [15:44:39] * bd808 wonders if this is reasonably documented on a wiki somewhere... [15:44:53] 10GitLab (Infrastructure), 10serviceops-collab: Setup alerting for GitLab projects size limits - https://phabricator.wikimedia.org/T316553 (10LSobanski) [15:45:01] 10GitLab (Integrations), 10Release-Engineering-Team (GitLab II: Wrath of Kahn 👾): GitLab integrations: the Gerrit & Jenkins integration catalog - https://phabricator.wikimedia.org/T319359 (10demon) [15:45:07] 10GitLab (Administration, Settings & Policy), 10serviceops-collab: Configure a default cleanup policy for GitLab package registry - https://phabricator.wikimedia.org/T315877 (10LSobanski) [15:45:14] 10GitLab (Infrastructure), 10Data-Persistence-Backup, 10serviceops-collab, 10User-brennen: Setup partial backups for GitLab - https://phabricator.wikimedia.org/T316935 (10LSobanski) [15:45:30] 10Phabricator, 10Release-Engineering-Team (Bonus Level 🕹ī¸), 10DBA, 10serviceops-collab, 10Patch-For-Review: sort out mysql privileges for phab1004/phab2002 - https://phabricator.wikimedia.org/T315713 (10LSobanski) [15:45:51] 10GitLab (Project Migration), 10Phabricator, 10Release-Engineering-Team (Bonus Level 🕹ī¸), 10serviceops-collab, and 3 others: Migrate active repositories in Phabricator Differential to GitLab - https://phabricator.wikimedia.org/T191182 (10LSobanski) [15:47:30] (03CR) 10Hashar: "recheck" [software/gerrit] (wmf/stable-3.5) - 10https://gerrit.wikimedia.org/r/843947 (https://phabricator.wikimedia.org/T321075) (owner: 10Hashar) [15:48:04] bd808: yeah.. I've reached that job after checking a previous CR in the same repo [15:48:33] bd808: but beta-mediawiki-config-update-eqiad hasn't been triggered since August 4th [15:48:41] hence the question [15:49:47] hmmm... I guess that would mean that only the once per 10 minutes https://integration.wikimedia.org/ci/view/Beta/job/beta-code-update-eqiad/ job is updating the code and config? [15:51:08] vgutierrez: T314378 turned off the config sync job [15:51:08] T314378: Stop triggering `beta-scap-sync-world` on `beta-mediawiki-config-update-eqiad` completion - https://phabricator.wikimedia.org/T314378 [15:51:57] 10Release-Engineering-Team (Seen), 10serviceops-collab: contint hardware refresh - https://phabricator.wikimedia.org/T294276 (10LSobanski) [15:52:51] 10Gerrit, 10Patch-For-Review: Remove Gerrit motd plugin - https://phabricator.wikimedia.org/T321075 (10hashar) On gerrit2002 (replica) [2022-10-18T15:50:10.886Z] [PluginScanner] INFO com.google.gerrit.server.plugins.PluginLoader : Unloading plugin motd, version 3d174f8 On gerrit1001 (primary) [2022-10-18T1... [15:59:04] (03CR) 10Hashar: [C: 03+2] Remove motd plugin [software/gerrit] (wmf/stable-3.4) - 10https://gerrit.wikimedia.org/r/843945 (https://phabricator.wikimedia.org/T321075) (owner: 10Hashar) [15:59:32] (03CR) 10Hashar: [C: 03+2] Remove motd plugin [software/gerrit] (wmf/stable-3.5) - 10https://gerrit.wikimedia.org/r/843947 (https://phabricator.wikimedia.org/T321075) (owner: 10Hashar) [16:03:13] 10Gerrit, 10Patch-For-Review: Remove Gerrit motd plugin - https://phabricator.wikimedia.org/T321075 (10hashar) [16:03:23] (03CR) 10CI reject: [V: 04-1] Remove motd plugin [software/gerrit] (wmf/stable-3.4) - 10https://gerrit.wikimedia.org/r/843945 (https://phabricator.wikimedia.org/T321075) (owner: 10Hashar) [16:11:35] (03Merged) 10jenkins-bot: Remove motd plugin [software/gerrit] (wmf/stable-3.5) - 10https://gerrit.wikimedia.org/r/843947 (https://phabricator.wikimedia.org/T321075) (owner: 10Hashar) [16:15:43] (03CR) 10Hashar: [C: 03+2] "There is something sketchy with Maven Central, I will have to investigate. Maybe there is a rate limit of some sort 😞" [software/gerrit] (wmf/stable-3.4) - 10https://gerrit.wikimedia.org/r/843945 (https://phabricator.wikimedia.org/T321075) (owner: 10Hashar) [16:28:47] (03CR) 10CI reject: [V: 04-1] Remove motd plugin [software/gerrit] (wmf/stable-3.4) - 10https://gerrit.wikimedia.org/r/843945 (https://phabricator.wikimedia.org/T321075) (owner: 10Hashar) [16:29:16] (03CR) 10Hashar: "grbmbl, I guess I will try again tomorrow." [software/gerrit] (wmf/stable-3.4) - 10https://gerrit.wikimedia.org/r/843945 (https://phabricator.wikimedia.org/T321075) (owner: 10Hashar) [16:38:28] 17:31:31 In CurlDownloader.php line 375: [16:38:29] 17:31:31 [16:38:29] 17:31:31 curl error 6 while downloading https://repo.packagist.org/packages.json: Co [16:38:29] 17:31:31 uld not resolve host: repo.packagist.org [16:38:29] helpful [16:39:21] Presumably a temporary DNS resolution problem. [16:39:49] yeah [16:40:20] i also had some timeout on a CI build while attempting to download from maven central [16:40:33] maybe the WMCS network has some issue [16:41:21] https://grafana.wikimedia.org/d/VAtNh1FWz/cloud-dev-dns-dashboard?orgId=1&from=now-12h&to=now is what I usually look at [17:08:34] 10Gerrit, 10Release-Engineering-Team (Priority Backlog đŸ“Ĩ), 10Scap, 10Patch-For-Review: Automate Gerrit deployment steps - https://phabricator.wikimedia.org/T317412 (10hashar) Fun thing `$GERRIT_SITE/plugins` is a symbolic link to the deployment directory and would thus be owned by `gerrit-deploy`. When w... [17:19:19] (03CR) 10Dduvall: "Code looks great! Nice work, Jaime." [blubber] - 10https://gerrit.wikimedia.org/r/843515 (https://phabricator.wikimedia.org/T319323) (owner: 10Jaime Nuche) [17:24:36] hey releng for fr-tech's smashpig library this gerrit patch https://gerrit.wikimedia.org/r/c/wikimedia/fundraising/SmashPig/+/843587/ hasn't made it over to the github mirror, https://github.com/wikimedia/wikimedia-fundraising-SmashPig any idea what is going on there? I'm trying to update our packagist for it [17:25:57] cstone: looots of replag [17:26:02] I think gerrit was restarted earlier [17:26:18] ahhh okay thanks Reedy ! [17:26:18] https://grafana.wikimedia.org/d/RFLS1GsWk/replication-upstream?orgId=1 [17:26:21] gerrit was restartee earlier, so it's syncing everything which takes a while [17:26:30] Based on past experience, it may take 6-12 hours :( [17:27:20] okay thanks for the update! [17:27:24] Hmm. Gerrit doesn't want to load for me atm... [17:27:42] now it does [17:28:11] (03CR) 10Dduvall: [C: 03+2] buildkit: allow entrypoint to run in the image building process [blubber] - 10https://gerrit.wikimedia.org/r/843515 (https://phabricator.wikimedia.org/T319323) (owner: 10Jaime Nuche) [17:28:56] We should really have packagist pull from git.wikimedia.org and not the totally-terrible GitHub mirrors. [17:30:47] (03PS1) 10Jforrester: Zuul: [wikimedia/fundraising/SmashPig] Add experimental PHP 7.4+ jobs [integration/config] - 10https://gerrit.wikimedia.org/r/844003 [17:30:49] (03Merged) 10jenkins-bot: buildkit: allow entrypoint to run in the image building process [blubber] - 10https://gerrit.wikimedia.org/r/843515 (https://phabricator.wikimedia.org/T319323) (owner: 10Jaime Nuche) [17:32:42] (03CR) 10Jforrester: [C: 03+2] Zuul: [wikimedia/fundraising/SmashPig] Add experimental PHP 7.4+ jobs [integration/config] - 10https://gerrit.wikimedia.org/r/844003 (owner: 10Jforrester) [17:34:34] (03Merged) 10jenkins-bot: Zuul: [wikimedia/fundraising/SmashPig] Add experimental PHP 7.4+ jobs [integration/config] - 10https://gerrit.wikimedia.org/r/844003 (owner: 10Jforrester) [17:38:49] (03PS1) 10Jforrester: Zuul: [wikimedia/fundraising/SmashPig] Use composer-test-php74-only template [integration/config] - 10https://gerrit.wikimedia.org/r/844004 [17:41:09] (03CR) 10CI reject: [V: 04-1] Zuul: [wikimedia/fundraising/SmashPig] Use composer-test-php74-only template [integration/config] - 10https://gerrit.wikimedia.org/r/844004 (owner: 10Jforrester) [17:44:12] James_F: I guess we need to have a look if there's a gerrit packagist plugin to do the pings [17:44:22] Or a gitlab one I guess, when we're mirroring there more actively... [17:44:26] Reedy: Let's not build new things on gerrit, indeed. [17:44:45] I said look (ie does one exist) rather than writing our own :) [17:44:52] But git.wikimedia.org is currently served by Diffusion which we should change first, I guess. :-( [17:45:10] Just adding a new plug-in is more work than it's worth. [17:46:17] (03PS2) 10Jforrester: Zuul: [wikimedia/fundraising/SmashPig] Use composer-test-php74-only template [integration/config] - 10https://gerrit.wikimedia.org/r/844004 [17:46:36] * James_F will leave that stuff well enough alone for RelEng to think about. :-) [17:48:47] (03CR) 10Jforrester: [C: 03+2] Zuul: [wikimedia/fundraising/SmashPig] Use composer-test-php74-only template [integration/config] - 10https://gerrit.wikimedia.org/r/844004 (owner: 10Jforrester) [17:50:52] (03Merged) 10jenkins-bot: Zuul: [wikimedia/fundraising/SmashPig] Use composer-test-php74-only template [integration/config] - 10https://gerrit.wikimedia.org/r/844004 (owner: 10Jforrester) [17:51:09] !log Zuul: [wikimedia/fundraising/SmashPig] Use composer-test-php74-only template [17:51:10] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [17:53:52] 10Release-Engineering-Team (Deployment Training Requests): Deployment training request for Sergio Gimeno - https://phabricator.wikimedia.org/T320722 (10Sgs) [17:54:11] 10GitLab (CI & Job Runners), 10Release-Engineering-Team, 10serviceops-collab: Define access to external resources for GitLab CI Runners - https://phabricator.wikimedia.org/T320730 (10dduvall) Follow up from the meeting re: === Images that BuildKit uses for internal operations === Our Blubber BuildKit front... [18:00:31] James_F, Reedy: gitlab has an "integration" for packagist that does basically the same things as setting up a github webhook. Once we have moved things from gerrit to gitlab it should be possible to update packagist to refer to our gitlab as the canonical for specific published packages rather than using the github mirror as we commonly do today. [18:08:30] it will be a whole project though for sure. There doesn't appear to be an edit endpoint listed at https://packagist.org/apidoc :/ [18:14:41] 10GitLab (CI & Job Runners), 10Release-Engineering-Team, 10serviceops-collab: Define access to external resources for GitLab CI Runners - https://phabricator.wikimedia.org/T320730 (10dduvall) Current contents of `docker/dockerfile-copy:v0.1.9@sha256:e8f159d3f00786604b93c675ee2783f8dc194bb565e61ca5788f6a6e9d3... [18:40:25] (03PS1) 10Dduvall: version: 0.12.0 [blubber] - 10https://gerrit.wikimedia.org/r/844049 [18:44:47] (03CR) 10Dduvall: [C: 03+2] version: 0.12.0 [blubber] - 10https://gerrit.wikimedia.org/r/844049 (owner: 10Dduvall) [18:45:56] 10Release-Engineering-Team (GitLab II: Wrath of Kahn 👾), 10Release Pipeline (Blubber): Blubber fails when a .dockerignore file does not exist in the context directory - https://phabricator.wikimedia.org/T320988 (10dduvall) 05In progress→03Resolved [18:47:29] (03Merged) 10jenkins-bot: version: 0.12.0 [blubber] - 10https://gerrit.wikimedia.org/r/844049 (owner: 10Dduvall) [18:48:53] 10GitLab (Project Migration), 10Release-Engineering-Team (GitLab II: Wrath of Kahn 👾): Create repo in GitLab for shared pipeline code - https://phabricator.wikimedia.org/T319322 (10dduvall) 05In progress→03Resolved The kokkuri project's `.gitlab-ci.yml` illustrates (and tests) the `.kokkuri:build-image` jo... [18:59:35] (03PS1) 10Subramanya Sastry: Extract common styles from wiki-specific styles [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/844051 [18:59:37] (03PS1) 10Subramanya Sastry: WIP: Extract more common styles out. [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/844052 [19:13:53] !log devtools: unbreak puppet on `deploy-1004.devtools.eqiad1.wikimedia.cloud` by applying `profile::mediawiki::scap_client::is_master: true` # T319681 [19:13:55] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [19:13:56] T319681: Puppet failure on deploy-1004.devtools.eqiad1.wikimedia.cloud - https://phabricator.wikimedia.org/T319681 [19:14:27] dancy: you have filed that task a few weeks ago about puppet breakage and thanks to your finding that unbroke it ;) [19:15:01] that doesn't solve the real issue (lack of hiera lookup for role in WMCS) [19:17:06] (03CR) 10Hashar: [C: 03+2] Remove motd plugin [software/gerrit] (wmf/stable-3.4) - 10https://gerrit.wikimedia.org/r/843945 (https://phabricator.wikimedia.org/T321075) (owner: 10Hashar) [19:24:51] (03Merged) 10jenkins-bot: Remove motd plugin [software/gerrit] (wmf/stable-3.4) - 10https://gerrit.wikimedia.org/r/843945 (https://phabricator.wikimedia.org/T321075) (owner: 10Hashar) [19:27:43] rabbit hole #3904: scap does not run the checks scripts :( [19:27:49] 10Gerrit, 10Patch-For-Review: Remove Gerrit motd plugin - https://phabricator.wikimedia.org/T321075 (10hashar) 05Open→03Resolved a:03hashar [19:31:30] an old question again: any expectation to keep your home dir when we migrate servers? in this case, phabricator [19:32:01] usually it is "of course not" until you don't keep them that one time.. then it's "omg, my files are gone" :) [19:32:59] also no quick way to check which files are NOT puppetized.. though you can guess [19:34:32] mutante: I appreciate the work you do to preserve $HOMEs every time I lose my $HOME on a cloud server that is reimaged :) [19:36:52] bd808: aww, ok! I'll keep doing it and not even try to look at the contents.. [19:37:35] staying within a DC. so 1001 goes to 1004, 2001 goes to 2002 etc [19:38:05] mutante: i think we discussed preserving mukunda's homedir there - i see there are few others with maybe-useful things, though that's probably the main one that's significant. [19:38:20] depends on the server role, I guess phab falls somewhere in the middle. I, for example, would expect to keep my $HOME on a deploy* box or a cloudcontrol* one but am totally fine on losing it on a random mw* or a cloudvirt* server [19:39:07] yea, makes sense. mostly have been doing it this way. deploy = definitely, mw = no [19:39:15] bastions..yea [19:39:18] brennen: if you're relying on things in someone else's home dir that's a very obvious sign that it should be puppetized :-) [19:39:26] taavi: you don't say. :) [19:39:58] though there's also some admin & query history there that may be good to retain. [19:40:02] brennen: ACK! though just copying all of them is probably easier than trying to look at each one [19:40:08] yeah, makes sense. [19:40:59] i think we shouldn't need any of the old deploy script stuff out of a homedir at this point - that should all be handled by scap, but you never know. [19:42:58] I guess the easiest solution would be to take a tarball of /home and put it in /root of the new server or something like that. that way you have a backup that you can restore if things break but will notice if something depends on someone's home dir [19:45:01] i'll puppetize another rsync module for "/srv/homes. then manually create one .tar.gz per home and move it there [19:45:21] I do NOT want to do messy stuff like stop puppet and manually edit firewall and rsyncd [19:46:01] and we can not simply use rsync over ssh..because agent forwarding [19:47:17] so it's more than it might seem. neither /root nor /srv/ would be in bacula by default [19:51:40] at $DAYJOB-1 our fix for $HOME madness was saving things in git, but the prod egress rules make that hard here [19:57:02] <^demon> bd808, mutante: `git init $HOME --separate-git-dir=/some/path/bacula/would/backup` ;-) [19:58:32] ^demon: I'm more interested in `ssh somewhere; git clone my-home-stuff`, but yeah your hack would have some minor value I suppose [19:59:36] I'm afraid puppet and git would fight over who is managing the files [19:59:53] <^demon> Probably :D [20:00:11] we can just tell bacula to backup /home though [20:00:15] putting $HOME stuff in ops/puppet puts it in too many places that I never actually go (like every random mw server) and requires me to get a root to +2 things [20:01:51] i did finally get around to dropping a basic bash & vim config into puppet [20:02:11] worth it, but yeah, finding a +2 etc. is kind of... i dunno, it'd be cool if there were a better pattern for it. [20:02:33] IPFS [20:02:52] at least it's usually fairly simple to get someone to +2 a home patch [20:03:05] private git server where if you've got a repo it gets cloned would be kind of nifty [20:08:38] brennen: that was basically what I built for $DAYJOB-1 with the twist of the get fetch being manual so that we didn't add everyone's $HOME to every box they had access to. Needing a non-public git server would be one of the pain points here. I could see that getting abused for other things and it all spinning out of control. :) [20:09:09] heh, yeah, indeed. [20:10:47] do you actually try to find a +2 by adding reviewers or do you assume that won't work anyways and you have to direct ping [20:11:24] also there is a puppet deploy window [20:11:30] which seems almost never used [20:11:46] while at the same time I keep hearing that you can't get stuff merged [20:13:42] mutante: depends on the area, but usually I add reviewers and then ping on irc if it's urgent or if it's been sitting there for a while without any action [20:14:22] yep, depends on the area, agreed [20:27:57] (03PS2) 10Subramanya Sastry: Extract common styles from wiki-specific styles [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/844051 [20:27:59] (03PS1) 10Subramanya Sastry: Update puppeteer version (and express & semver) [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/844058 [20:30:10] when copying my own home dir, I notice: /home/dzahn/phab1001-home-twentyafterfour.tar.gz haha [20:34:26] (03PS1) 10Subramanya Sastry: Followup to 2ec82555: Update README [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/844062 [20:35:30] (03Abandoned) 10Subramanya Sastry: WIP: Extract more common styles out. [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/844052 (owner: 10Subramanya Sastry) [20:37:15] (03CR) 10Subramanya Sastry: Extract common styles from wiki-specific styles (031 comment) [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/844051 (owner: 10Subramanya Sastry) [20:40:40] (03CR) 10Subramanya Sastry: Extract common styles from wiki-specific styles (031 comment) [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/844051 (owner: 10Subramanya Sastry) [20:41:49] (03CR) 10Arlolra: [C: 03+2] Update puppeteer version (and express & semver) [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/844058 (owner: 10Subramanya Sastry) [20:42:35] (03Merged) 10jenkins-bot: Update puppeteer version (and express & semver) [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/844058 (owner: 10Subramanya Sastry) [20:47:32] (03PS2) 10Subramanya Sastry: Followup to 2ec82555: Update README [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/844062 [20:47:36] (03PS3) 10Subramanya Sastry: Extract common styles from wiki-specific styles [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/844051 [20:48:50] (03CR) 10Arlolra: Extract common styles from wiki-specific styles (031 comment) [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/844051 (owner: 10Subramanya Sastry) [20:50:04] (03CR) 10Arlolra: [C: 03+2] Followup to 2ec82555: Update README [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/844062 (owner: 10Subramanya Sastry) [20:50:47] (03CR) 10Subramanya Sastry: Extract common styles from wiki-specific styles (031 comment) [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/844051 (owner: 10Subramanya Sastry) [20:50:49] (03Merged) 10jenkins-bot: Followup to 2ec82555: Update README [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/844062 (owner: 10Subramanya Sastry) [20:57:53] (03CR) 10Subramanya Sastry: Extract common styles from wiki-specific styles (031 comment) [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/844051 (owner: 10Subramanya Sastry) [20:59:09] (03PS4) 10Subramanya Sastry: Extract common styles from wiki-specific styles [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/844051 [20:59:58] (03CR) 10Subramanya Sastry: Extract common styles from wiki-specific styles (031 comment) [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/844051 (owner: 10Subramanya Sastry) [21:00:49] (03CR) 10Subramanya Sastry: Extract common styles from wiki-specific styles (031 comment) [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/844051 (owner: 10Subramanya Sastry) [21:03:51] 10Beta-Cluster-Infrastructure, 10MediaWiki-Page-history: Edits are incorrectly marked as "updated since your last visit" in page history on betacommons - https://phabricator.wikimedia.org/T307173 (10Pols12) Duplicate of T144679 / T218511? [21:09:28] (03PS1) 10Dduvall: buildkit: Include given value in ParseExtraOptions error message [blubber] - 10https://gerrit.wikimedia.org/r/844064 [21:16:53] (03CR) 10Ahmon Dancy: [C: 03+2] buildkit: Include given value in ParseExtraOptions error message [blubber] - 10https://gerrit.wikimedia.org/r/844064 (owner: 10Dduvall) [21:19:29] (03Merged) 10jenkins-bot: buildkit: Include given value in ParseExtraOptions error message [blubber] - 10https://gerrit.wikimedia.org/r/844064 (owner: 10Dduvall) [21:49:00] (03PS1) 10Subramanya Sastry: Update CSS for knwiki and nowiki [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/844068 [21:56:17] (03CR) 10Subramanya Sastry: [C: 04-1] "Don't merge yet. I am looking at the cite extension repo and consolidating styles." [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/844051 (owner: 10Subramanya Sastry) [22:17:22] (03PS5) 10Subramanya Sastry: Extract common styles from wiki-specific styles [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/844051 [22:17:24] (03PS2) 10Subramanya Sastry: Update CSS for knwiki and nowiki [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/844068 [22:45:13] (03CR) 10Subramanya Sastry: "This is good enough for now." [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/844051 (owner: 10Subramanya Sastry) [23:04:51] (03CR) 10Arlolra: [C: 03+2] Extract common styles from wiki-specific styles [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/844051 (owner: 10Subramanya Sastry) [23:05:42] (03Merged) 10jenkins-bot: Extract common styles from wiki-specific styles [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/844051 (owner: 10Subramanya Sastry) [23:17:17] (03CR) 10Arlolra: Update CSS for knwiki and nowiki (032 comments) [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/844068 (owner: 10Subramanya Sastry) [23:27:43] 10GitLab (Project Migration), 10Release-Engineering-Team (GitLab II: Wrath of Kahn 👾), 10User-dduvall: Migrate Blubber project to GitLab - https://phabricator.wikimedia.org/T301168 (10dduvall) [23:27:58] 10GitLab (Project Migration), 10Release-Engineering-Team (GitLab II: Wrath of Kahn 👾): Build and Run Blubber test variant on GitLab untrusted runners - https://phabricator.wikimedia.org/T307536 (10dduvall) 05Open→03In progress p:05Triage→03Medium a:03dduvall [23:29:52] 10Phabricator: Change Phab name of SPatel - https://phabricator.wikimedia.org/T321008 (10Sneha) Hello, thanks for sending over the rules. After some thought I have decided to leave the name as is as it would be difficult for people who are already interacting with me to switch over to the new one. Thanks for you... [23:31:46] 10Phabricator: Change Phab name of SPatel - https://phabricator.wikimedia.org/T321008 (10JJMC89) 05Open→03Invalid