[01:55:29] 10Beta-Cluster-Infrastructure, 10MediaWiki-Search, 10PageImages, 10Readers-Web-Backlog, and 3 others: PageImages ignores MediaWiki:Bad image list, (uses Pageimages-denylist_test instead) displaying search results that are inappropriate for some readers - https://phabricator.wikimedia.org/T306246 (10Johnuniq... [02:33:28] 10Beta-Cluster-Infrastructure, 10MediaWiki-Search, 10PageImages, 10Readers-Web-Backlog, and 3 others: PageImages ignores MediaWiki:Bad image list, (uses MediaWiki:Pageimages-denylist instead) displaying search results that are inappropriate for some readers - https://phabricator.wikimedia.org/T306246 (10Ahe... [04:54:42] 10Continuous-Integration-Infrastructure, 10OOUI: Demos page for OOUI in php is broken - https://phabricator.wikimedia.org/T297035 (10Dylsss) [07:11:41] 10Beta-Cluster-Infrastructure, 10Abstract Wikipedia team, 10Patch-For-Review: Create a Beta Cluster version of Wikifunctions.org - https://phabricator.wikimedia.org/T284162 (10ori) a:05Jdforrester-WMF→03ori [08:22:12] 10Beta-Cluster-Infrastructure: *.beta.wmflabs.org Certificate has expired (April 2022 edition) - https://phabricator.wikimedia.org/T306492 (10dom_walden) [08:31:59] 10Beta-Cluster-Infrastructure, 10Quality-and-Test-Engineering-Team (QTE), 10SRE, 10Traffic, and 2 others: [epic] The SSL certificate for Beta cluster domains fails to properly renew & deploy - https://phabricator.wikimedia.org/T293585 (10dom_walden) [08:32:05] 10Beta-Cluster-Infrastructure: *.beta.wmflabs.org Certificate has expired (April 2022 edition) - https://phabricator.wikimedia.org/T306492 (10dom_walden) [09:53:39] 10Gerrit, 10wikitech.wikimedia.org: Wikitech->Gerrit account block and unblock has stopped working - https://phabricator.wikimedia.org/T306297 (10hashar) We should had all accounts fixed via T216605 which used the following script: {P8606} It finds any local username (`gerrit:XXX`) which have an upper case l... [10:05:52] 10Project-Admins: Request new tag: #Search-Console-access-request - https://phabricator.wikimedia.org/T306500 (10SCherukuwada) [10:08:35] 10Project-Admins: Request new tag: #Search-Console-access-request - https://phabricator.wikimedia.org/T306500 (10jcrespo) For the record, SRE is aware of this change (and supports it). Right now, #sre-access-requests is used for it (mixing SSH requests and Google Console ones), which has caused confusion with h... [10:15:17] 10Project-Admins: Request new tag: #Search-Console-access-request - https://phabricator.wikimedia.org/T306500 (10Aklapper) [10:16:15] 10Project-Admins: Request new tag: #Search-Console-access-request - https://phabricator.wikimedia.org/T306500 (10Aklapper) [10:26:20] 10GitLab (Administration, Settings & Policy), 10Release-Engineering-Team (Doing), 10Security-Team, 10ContentSecurityPolicy, and 4 others: Define a Content Security Policy for GitLab - https://phabricator.wikimedia.org/T285363 (10hashar) 05In progress→03Resolved [10:28:21] 10Project-Admins: Request new tag: #Search-Console-access-request - https://phabricator.wikimedia.org/T306500 (10Aklapper) Glad to see this, as this has been a [constant source of confusion](https://meta.wikimedia.org/w/index.php?title=Tech&oldid=22000536#Adding_Portuguese_Wikinews_to_the_Google_News_feed_via_S... [10:28:28] 10Project-Admins: Request new tag: #Search-Console-access-request - https://phabricator.wikimedia.org/T306500 (10Aklapper) 05Open→03Resolved a:03Aklapper Requested public project #search-console-access-request has been created: https://phabricator.wikimedia.org/project/view/5882/ (In case you need to edi... [10:29:24] 10Project-Admins: Request new tag: #Search-Console-access-request - https://phabricator.wikimedia.org/T306500 (10jcrespo) That's actually the intended goal :-). Lots of documenting pending to review now! [10:31:59] 10Project-Admins, 10Discovery, 10User-Luke081515: create project for tickets related to "Google Search Console" (formerly 'Google Webmaster Tools') - https://phabricator.wikimedia.org/T132373 (10Aklapper) a:05Luke081515→03None [10:32:14] 10Project-Admins: Request new tag: #Search-Console-access-request - https://phabricator.wikimedia.org/T306500 (10Aklapper) [10:32:20] 10Project-Admins, 10Discovery, 10User-Luke081515: create project for tickets related to "Google Search Console" (formerly 'Google Webmaster Tools') - https://phabricator.wikimedia.org/T132373 (10Aklapper) [10:34:20] 10Project-Admins: Request new tag: #Search-Console-access-request - https://phabricator.wikimedia.org/T306500 (10Aklapper) (For the records, I also silently updated the project tags of [22 existing search console tickets](https://phabricator.wikimedia.org/maniphest/?ids=303513,302625,302508,300004,298262,277065... [10:47:07] 10Scap (Scap3-MediaWiki-MVP), 10MediaWiki-Configuration: Scap should not rely on extension-list, instead pass --extension-dir to mergeMessageFileList.php - https://phabricator.wikimedia.org/T125678 (10hashar) We still rely on `operations/mediawiki-config` having the list of all extension.json / skin.json in `w... [11:08:46] 10Project-Admins: Request new tag: #Search-Console-access-request - https://phabricator.wikimedia.org/T306500 (10jcrespo) Thank you again, I was thinking of doing the same, you were faster and more efficient being able to do it silently! [12:25:08] 10Beta-Cluster-Infrastructure, 10Abstract Wikipedia team, 10Patch-For-Review: Create a Beta Cluster version of Wikifunctions.org - https://phabricator.wikimedia.org/T284162 (10Jdforrester-WMF) >>! In T284162#7864309, @Jdforrester-WMF wrote: > In terms of getting things updated, `profile::docker::runner::serv... [12:26:41] Is there some magic we can add to blubber.yaml that will make it tag images with latest when publishing new ones? [12:37:39] We have https://gerrit.wikimedia.org/r/plugins/gitiles/mediawiki/services/function-orchestrator/+/refs/heads/master/.pipeline/config.yaml#21 that's meant to do it, but https://docker-registry.wikimedia.org/wikimedia/mediawiki-services-function-orchestrator/tags/ doesn't have a latest tag… [12:52:41] 10MediaWiki-Releasing, 10MW-1.38-release: Write release announcement for 1.38.0-rc.0 - https://phabricator.wikimedia.org/T302913 (10Reedy) [13:07:06] 10Continuous-Integration-Config, 10MW-1.35-release, 10MW-1.36-release, 10MW-1.37-release, and 2 others: Make PHP 8.0 voting on currently supported MW release branches - https://phabricator.wikimedia.org/T274965 (10Reedy) [13:43:16] 10GitLab (CI & Job Runners), 10Release-Engineering-Team (Doing), 10Release Pipeline, 10Security-Team, and 2 others: Figure out the future of (or replacements for) PipelineLib in a GitLab world - https://phabricator.wikimedia.org/T287211 (10hashar) [13:44:24] 10Scap: scap deploy --init on deployment server fails on first puppet run - https://phabricator.wikimedia.org/T257317 (10hashar) [13:44:26] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1)), 10Patch-For-Review, 10Technical-Debt: Move integration/docroot.git deployment to scap - https://phabricator.wikimedia.org/T256005 (10hashar) [13:47:19] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Seen): Install php-yaml for Translate - https://phabricator.wikimedia.org/T189244 (10hashar) 05Open→03Resolved a:03hashar Closing since php-yaml is on CI. For production deployment and managing the roll out, please file another task and... [13:50:20] 10MediaWiki-Releasing, 10MW-1.38-release: tests/phpunit/unit/includes/Settings/Source/fixtures/bad.json is an invalid JSON file - https://phabricator.wikimedia.org/T306524 (10Reedy) [13:50:31] 10MediaWiki-Releasing, 10MediaWiki-Release-Tools, 10MW-1.38-release: tests/phpunit/unit/includes/Settings/Source/fixtures/bad.json is an invalid JSON file - https://phabricator.wikimedia.org/T306524 (10Reedy) [13:52:43] 10MediaWiki-Releasing, 10MediaWiki-Release-Tools, 10MW-1.38-release: tests/phpunit/unit/includes/Settings/Source/fixtures/bad.json is an invalid JSON file - https://phabricator.wikimedia.org/T306524 (10Reedy) I'm guessing #scap doesn't handle this, nor does it specifically care unless you try and sync that f... [13:59:54] (03PS1) 10Reedy: Skip 'bad.json' [tools/release] - 10https://gerrit.wikimedia.org/r/784680 (https://phabricator.wikimedia.org/T306524) [14:00:42] (03PS2) 10Reedy: make-release/scap_lint.py: Skip 'bad.json' [tools/release] - 10https://gerrit.wikimedia.org/r/784680 (https://phabricator.wikimedia.org/T306524) [14:01:08] (03CR) 10Reedy: [C: 03+2] "hacks galore" [tools/release] - 10https://gerrit.wikimedia.org/r/784680 (https://phabricator.wikimedia.org/T306524) (owner: 10Reedy) [14:01:46] (03Merged) 10jenkins-bot: make-release/scap_lint.py: Skip 'bad.json' [tools/release] - 10https://gerrit.wikimedia.org/r/784680 (https://phabricator.wikimedia.org/T306524) (owner: 10Reedy) [14:02:04] 10MediaWiki-Releasing, 10MW-1.38-notes, 10MW-1.38-release: Release 1.38.0-rc.0 - https://phabricator.wikimedia.org/T302912 (10Reedy) [14:02:07] 10MediaWiki-Releasing, 10MediaWiki-Release-Tools, 10MW-1.38-release, 10Patch-For-Review: tests/phpunit/unit/includes/Settings/Source/fixtures/bad.json is an invalid JSON file - https://phabricator.wikimedia.org/T306524 (10Reedy) 05Open→03Resolved p:05Triage→03High a:03Reedy [14:12:08] 10MediaWiki-Releasing, 10MediaWiki-Release-Tools, 10MW-1.38-release, 10Patch-For-Review: tests/phpunit/unit/includes/Settings/Source/fixtures/bad.json is an invalid JSON file - https://phabricator.wikimedia.org/T306524 (10Legoktm) Can we rename the file so it doesn't have a .json extension? I think there i... [14:12:18] 10GitLab (Administration, Settings & Policy), 10Release-Engineering-Team (Doing), 10Security-Team, 10ContentSecurityPolicy, and 3 others: Define a Content Security Policy for GitLab - https://phabricator.wikimedia.org/T285363 (10sbassett) [14:14:18] 10MediaWiki-Releasing, 10MediaWiki-Release-Tools, 10MW-1.38-release, 10Patch-For-Review: tests/phpunit/unit/includes/Settings/Source/fixtures/bad.json is an invalid JSON file - https://phabricator.wikimedia.org/T306524 (10Legoktm) Example: https://gerrit.wikimedia.org/r/plugins/gitiles/mediawiki/core/+/ref... [14:16:16] 10MediaWiki-Releasing, 10MediaWiki-Release-Tools, 10MW-1.38-release, 10Patch-For-Review: tests/phpunit/unit/includes/Settings/Source/fixtures/bad.json is an invalid JSON file - https://phabricator.wikimedia.org/T306524 (10Reedy) `bad.notjson` Was added in {9a4af2566438e1b2350a02e37046ee2b67a54d88} by @ddu... [14:17:30] 10Beta-Cluster-Infrastructure: *.beta.wmflabs.org Certificate has expired (April 2022 edition) - https://phabricator.wikimedia.org/T306492 (10bd808) I thought this would have been fixed by T273956#7786422... [14:18:10] 10Beta-Cluster-Infrastructure, 10Quality-and-Test-Engineering-Team (QTE), 10SRE, 10Traffic, and 2 others: [epic] The SSL certificate for Beta cluster domains fails to properly renew & deploy - https://phabricator.wikimedia.org/T293585 (10bd808) [14:20:07] 10Beta-Cluster-Infrastructure: *.beta.wmflabs.org Certificate has expired (April 2022 edition) - https://phabricator.wikimedia.org/T306492 (10Majavah) >>! In T306492#7868178, @bd808 wrote: > I thought this would have been fixed by T273956#7786422... Last time I looked into an acme-chief issue on deployment-prep... [14:53:17] 10Release-Engineering-Team (Next), 10Structured Data Engineering, 10Structured-Data-Backlog (Current Work), 10Wiki-Setup (Delete / Redirect): Close and delete TestCommons from production - https://phabricator.wikimedia.org/T213295 (10CBogen) >>! In T213295#7860991, @Jdforrester-WMF wrote: >>>! In T213295#7... [14:59:58] 10Release-Engineering-Team (Next), 10Structured Data Engineering, 10Structured-Data-Backlog (Current Work), 10Wiki-Setup (Delete / Redirect): Close and delete TestCommons from production - https://phabricator.wikimedia.org/T213295 (10Jdforrester-WMF) 05Stalled→03Open >>! In T213295#7868318, @CBogen wro... [15:01:15] (03PS1) 10Reedy: Revert "make-release/scap_lint.py: Skip 'bad.json'" [tools/release] - 10https://gerrit.wikimedia.org/r/784706 (https://phabricator.wikimedia.org/T306524) [15:01:22] (03CR) 10Reedy: [C: 04-2] "Not yet" [tools/release] - 10https://gerrit.wikimedia.org/r/784706 (https://phabricator.wikimedia.org/T306524) (owner: 10Reedy) [15:03:34] 10MediaWiki-Releasing, 10MW-1.38-release: Write release announcement for 1.38.0-rc.0 - https://phabricator.wikimedia.org/T302913 (10Reedy) 05Open→03Resolved p:05Triage→03Medium a:03Jdforrester-WMF [15:03:38] 10MediaWiki-Releasing, 10MW-1.38-notes, 10MW-1.38-release: Release 1.38.0-rc.0 - https://phabricator.wikimedia.org/T302912 (10Reedy) [15:05:03] 10MediaWiki-Releasing, 10MW-1.38-notes, 10MW-1.38-release: Release 1.38.0-rc.0 - https://phabricator.wikimedia.org/T302912 (10Reedy) 05Open→03Resolved p:05Triage→03Medium a:03Reedy [15:05:07] 10MediaWiki-Releasing, 10MW-1.38-release: Release MW 1.38.0 - https://phabricator.wikimedia.org/T302893 (10Reedy) [15:06:46] 10MediaWiki-Releasing, 10Documentation, 10MW-1.38-notes, 10MW-1.38-release, 10MW-1.39-notes (1.39.0-wmf.6; 2022-04-04): Finish up RELEASE-NOTES for 1.38.0 - https://phabricator.wikimedia.org/T302911 (10Jdforrester-WMF) 05Open→03Resolved a:03Jdforrester-WMF They're bit-identical (up until the rc.0 c... [15:06:50] 10MediaWiki-Releasing, 10MW-1.38-release: Release MW 1.38.0 - https://phabricator.wikimedia.org/T302893 (10Jdforrester-WMF) [15:07:18] Reedy: now I get to blow test up [15:08:46] 10MediaWiki-Releasing, 10MW-1.38-release: Release MW 1.38.0 - https://phabricator.wikimedia.org/T302893 (10Reedy) 05Open→03In progress [16:19:37] 10Beta-Cluster-Infrastructure: *.beta.wmflabs.org Certificate has expired (April 2022 edition) - https://phabricator.wikimedia.org/T306492 (10AlexisJazz) https://upload.wikimedia.beta.wmflabs.org/wikipedia/commons/thumb/c/c5/My_test_file.png/112px-My_test_file.png upload.wikimedia.beta.wmflabs.org still broken. [16:24:32] 10Beta-Cluster-Infrastructure: *.beta.wmflabs.org Certificate has expired (April 2022 edition) - https://phabricator.wikimedia.org/T306492 (10Zabe) >>! In T306492#7868793, @AlexisJazz wrote: > https://upload.wikimedia.beta.wmflabs.org/wikipedia/commons/thumb/c/c5/My_test_file.png/112px-My_test_file.png > > uplo... [16:24:36] oh, ^demon, long time no see [16:25:14] !log root@deployment-cache-upload06:~# touch /srv/trafficserver/tls/etc/ssl_multicert.config && systemctl reload trafficserver-tls.service [16:25:15] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [16:32:33] 10Release-Engineering-Team (Next), 10Scap: Allow Scap to push to Gerrit without operator creds - https://phabricator.wikimedia.org/T306425 (10thcipriani) [16:33:11] 10Release-Engineering-Team (Radar), 10serviceops: Pushes to docker-registry are too slow - https://phabricator.wikimedia.org/T306201 (10thcipriani) [16:37:21] 10Continuous-Integration-Infrastructure, 10Jenkins, 10Release-Engineering-Team (Seen), 10Quibble: Jenkins collapsible sections are deeply nested in Quibble output - https://phabricator.wikimedia.org/T303056 (10thcipriani) p:05Triage→03Low [16:43:02] 10Release-Engineering-Team (Priority Backlog 📥), 10Scap, 10SRE, 10Python3-Porting: git-fat needs to be ported to Python 3 - https://phabricator.wikimedia.org/T279509 (10thcipriani) In our team meeting we talked about the possibility of migrating git-fat (600 lines of python2 → python3) vs. making the neede... [16:45:21] 10Phabricator, 10Release-Engineering-Team (Next), 10Wikimedia-Phabricator-Extensions: Label cut-off in Phabricator report tables - https://phabricator.wikimedia.org/T301024 (10thcipriani) p:05Triage→03Low [16:48:17] 10Phabricator, 10Release-Engineering-Team (🌱 Spring Cleaning — April 2022): Puppet failure on phabricator-stage-1001.devtools - https://phabricator.wikimedia.org/T299997 (10thcipriani) p:05Triage→03Low a:03brennen [16:55:36] 10Phabricator, 10Release-Engineering-Team (🌱 Spring Cleaning — April 2022): Puppet failure on phabricator-stage-1001.devtools - https://phabricator.wikimedia.org/T299997 (10Dzahn) >>! In T299997#7744063, @hashar wrote: > I am not sure Phabricator ever worked on that instance. Based on T268964 and us fixing it... [16:56:56] Project beta-scap-sync-world build #48169: 04FAILURE in 2 min 15 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/48169/ [17:19:16] Yippee, build fixed! [17:19:17] Project beta-scap-sync-world build #48170: 09FIXED in 20 min: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/48170/ [17:25:32] Project beta-scap-sync-world build #48171: 04FAILURE in 4 min 32 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/48171/ [17:25:52] 10GitLab (Infrastructure), 10DC-Ops, 10SRE, 10ops-eqiad, 10serviceops: Q3:(Need By: TBD) rack/setup/install gitlab100[3|4] and gitlab-runner100[2|3|4] - https://phabricator.wikimedia.org/T301177 (10Dzahn) Tyler, Brennen, added you here per our meeting today. So that you can see status of the physical hos... [17:33:04] Project beta-scap-sync-world build #48172: 04STILL FAILING in 5 min 49 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/48172/ [17:39:01] Project beta-scap-sync-world build #48173: 04STILL FAILING in 4 min 15 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/48173/ [17:44:41] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Seen): Install php-yaml for Translate - https://phabricator.wikimedia.org/T189244 (10Nikerabbit) Thanks. There is no need from our side to have it in production right now. [17:46:33] Project beta-scap-sync-world build #48174: 04STILL FAILING in 1 min 53 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/48174/ [17:56:09] Yippee, build fixed! [17:56:09] Project beta-scap-sync-world build #48175: 09FIXED in 1 min 27 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/48175/ [18:16:48] 10GitLab (Infrastructure), 10DC-Ops, 10SRE, 10ops-codfw: Q3:(Need By: TBD) rack/setup/install gitlab200[2|3] and gitlab-runner200[2|3|4] - https://phabricator.wikimedia.org/T301183 (10Papaul) [19:14:36] 10Beta-Cluster-Infrastructure, 10Abstract Wikipedia team, 10Patch-For-Review: Create a Beta Cluster version of Wikifunctions.org - https://phabricator.wikimedia.org/T284162 (10Jdforrester-WMF) [19:15:05] (03CR) 10Reedy: [C: 03+2] Revert "make-release/scap_lint.py: Skip 'bad.json'" [tools/release] - 10https://gerrit.wikimedia.org/r/784706 (https://phabricator.wikimedia.org/T306524) (owner: 10Reedy) [19:16:20] (03Merged) 10jenkins-bot: Revert "make-release/scap_lint.py: Skip 'bad.json'" [tools/release] - 10https://gerrit.wikimedia.org/r/784706 (https://phabricator.wikimedia.org/T306524) (owner: 10Reedy) [19:16:42] 10Beta-Cluster-Infrastructure, 10Abstract Wikipedia team, 10Patch-For-Review: Create a Beta Cluster version of Wikifunctions.org - https://phabricator.wikimedia.org/T284162 (10Jdforrester-WMF) OK, I've manually rev'ed the version of the images used so these now work from the Beta Cluster boxes with the lates... [19:34:43] 10Phabricator, 10Release-Engineering-Team (🌱 Spring Cleaning — April 2022): Puppet failure on phabricator-stage-1001.devtools - https://phabricator.wikimedia.org/T299997 (10hashar) From phabricator-stage-1001 , there is no database: ` MariaDB [(none)]> show databases; +--------------------+ | Database... [19:41:23] 10Release-Engineering-Team (Seen), 10User-AKlapper: Update [[mw:Release_Manager_(Wikimedia)]] - https://phabricator.wikimedia.org/T301971 (10greg) Just spoke with Tyler about this: he has the authority to make changes to those as he sees fit. The historical context for the first (and the see also on it) is whe... [19:58:21] 10Release-Engineering-Team (Next), 10Security-Team: Determine a better way to track Wikimedia production security patches - https://phabricator.wikimedia.org/T295925 (10sbassett) >>! In T295925#7858369, @thcipriani wrote: > I have no opinions about whether this replaces {T276237} or happens in addition to usin... [21:05:30] 10GitLab (Integrations), 10Release-Engineering-Team (Radar), 10Wikimedia-Interwiki-links: Evaluate an interwiki to WMF GitLab - https://phabricator.wikimedia.org/T305755 (10valerio.bozzolan) I've seen the `gitlab:` interwiki prefix was created! Now let's wait for the cache update. [23:21:41] (03PS1) 10Zoranzoki21: Zuul: [mediawiki/extensions/RegularTooltips] Add basic quibble CI [integration/config] - 10https://gerrit.wikimedia.org/r/784779 [23:48:31] (03CR) 10Zoranzoki21: "Before merging this, please force-merge these open patches: https://gerrit.wikimedia.org/r/q/project:mediawiki/extensions/RegularTooltips+" [integration/config] - 10https://gerrit.wikimedia.org/r/784779 (owner: 10Zoranzoki21)