[00:16:12] 10Release-Engineering-Team (Priority Backlog šŸ“„), 05Release, 05Train Deployments: 1.44.0-wmf.18 deployment blockers - https://phabricator.wikimedia.org/T382369#10585457 (10bd808) [00:22:21] Project beta-update-databases-eqiad build #82875: 04FAILURE in 2 min 20 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/82875/ [00:27:48] 00:22:16 Wikimedia\Rdbms\DBQueryError from line 1230 of /srv/mediawiki-staging/php-master/includes/libs/rdbms/database/Database.php: Error 1049: Unknown database 'testcommonswiki' [01:08:45] (03PS2) 10Reedy: zuul: Basic CI for ArticleSummaries extension [integration/config] - 10https://gerrit.wikimedia.org/r/1123063 (https://phabricator.wikimedia.org/T386476) [01:09:18] (03CR) 10Reedy: [C:03+2] zuul: Basic CI for ArticleSummaries extension [integration/config] - 10https://gerrit.wikimedia.org/r/1123063 (https://phabricator.wikimedia.org/T386476) (owner: 10Reedy) [01:10:38] (03Merged) 10jenkins-bot: zuul: Basic CI for ArticleSummaries extension [integration/config] - 10https://gerrit.wikimedia.org/r/1123063 (https://phabricator.wikimedia.org/T386476) (owner: 10Reedy) [01:11:38] !log Reloading Zuul to deploy https://gerrit.wikimedia.org/r/1123063 T386476 [01:11:40] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [01:11:40] T386476: [summaries] Create a new extension for simple summaries experiment - https://phabricator.wikimedia.org/T386476 [01:22:21] Project beta-update-databases-eqiad build #82876: 04STILL FAILING in 2 min 21 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/82876/ [01:24:22] 10Beta-Cluster-Infrastructure: Wikimedia\Rdbms\DBQueryError from line 1230 of /srv/mediawiki-staging/php-master/includes/libs/rdbms/database/Database.php: Error 1049: Unknown database 'testcommonswiki' - https://phabricator.wikimedia.org/T387417 (10Reedy) 03NEW [01:25:09] 10Beta-Cluster-Infrastructure: Wikimedia\Rdbms\DBQueryError from line 1230 of /srv/mediawiki-staging/php-master/includes/libs/rdbms/database/Database.php: Error 1049: Unknown database 'testcommonswiki' - https://phabricator.wikimedia.org/T387417#10585585 (10Reedy) p:05Triageā†’03High [01:27:46] 10Beta-Cluster-Infrastructure: Wikimedia\Rdbms\DBQueryError from line 1230 of /srv/mediawiki-staging/php-master/includes/libs/rdbms/database/Database.php: Error 1049: Unknown database 'testcommonswiki' - https://phabricator.wikimedia.org/T387417#10585592 (10Reedy) [01:28:57] 10Beta-Cluster-Infrastructure, 10JsonConfig, 10Wikimedia-Site-requests: Wikimedia\Rdbms\DBQueryError from line 1230 of /srv/mediawiki-staging/php-master/includes/libs/rdbms/database/Database.php: Error 1049: Unknown database 'testcommonswiki' - https://phabricator.wikimedia.org/T387417#10585593 (10Reedy) Alm... [01:32:38] 10Beta-Cluster-Infrastructure, 10JsonConfig, 10Wikimedia-Site-requests: Wikimedia\Rdbms\DBQueryError from line 1230 of /srv/mediawiki-staging/php-master/includes/libs/rdbms/database/Database.php: Error 1049: Unknown database 'testcommonswiki' - https://phabricator.wikimedia.org/T387417#10585601 (10Reedy) ^ I... [01:46:55] 10Continuous-Integration-Config, 10Wikimedia-Site-requests, 07Logos: CI on mediawiki-config should assert that the logos.php is generated by logos/manage.py - https://phabricator.wikimedia.org/T341412#10585635 (10Pppery) This really should be done - the files have diverged again which is causing havoc for an... [01:50:51] 10Beta-Cluster-Infrastructure, 10JsonConfig, 10Wikimedia-Site-requests, 13Patch-For-Review: Wikimedia\Rdbms\DBQueryError from line 1230 of /srv/mediawiki-staging/php-master/includes/libs/rdbms/database/Database.php: Error 1049: Unknown database 'testcommo... - https://phabricator.wikimedia.org/T387417#10585637 [01:51:09] beta-update-databases-eqiad should be fixed... [01:58:02] 10Release-Engineering-Team (Priority Backlog šŸ“„): "MediaWiki branch and publish WMF single-version image" job on releases-jenkins seems to pause for ~20 minutes during each run - https://phabricator.wikimedia.org/T387423 (10bd808) 03NEW [01:58:18] 10Release-Engineering-Team (Priority Backlog šŸ“„), 07Epic, 10Quality-and-Test-Engineering-Team (Test Infrastructure): Pretrain (nĆ©e Group -1) QTE validation environment - https://phabricator.wikimedia.org/T369112#10585690 (10bd808) [01:58:19] 10Release-Engineering-Team (Priority Backlog šŸ“„): "MediaWiki branch and publish WMF single-version image" job on releases-jenkins seems to pause for ~20 minutes during each run - https://phabricator.wikimedia.org/T387423#10585691 (10bd808) [02:29:08] 10Beta-Cluster-Infrastructure, 10JsonConfig, 10Wikimedia-Site-requests, 13Patch-For-Review: Wikimedia\Rdbms\DBQueryError from line 1230 of /srv/mediawiki-staging/php-master/includes/libs/rdbms/database/Database.php: Error 1049: Unknown database 'testcommo... - https://phabricator.wikimedia.org/T387417#10585711 [02:30:36] 10Beta-Cluster-Infrastructure, 10JsonConfig, 10Wikimedia-Site-requests: Wikimedia\Rdbms\DBQueryError from line 1230 of /srv/mediawiki-staging/php-master/includes/libs/rdbms/database/Database.php: Error 1049: Unknown database 'testcommonswiki' - https://phabricator.wikimedia.org/T387417#10585713 (10bvibber... [02:31:20] Yippee, build fixed! [02:31:20] Project beta-update-databases-eqiad build #82877: 09FIXED in 11 min: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/82877/ [02:34:33] 10Beta-Cluster-Infrastructure, 10JsonConfig, 10Wikimedia-Site-requests: Wikimedia\Rdbms\DBQueryError from line 1230 of /srv/mediawiki-staging/php-master/includes/libs/rdbms/database/Database.php: Error 1049: Unknown database 'testcommonswiki' - https://phabricator.wikimedia.org/T387417#10585727 (10bvibber... [02:39:38] 10Beta-Cluster-Infrastructure, 10JsonConfig, 10Wikimedia-Site-requests: Wikimedia\Rdbms\DBQueryError from line 1230 of /srv/mediawiki-staging/php-master/includes/libs/rdbms/database/Database.php: Error 1049: Unknown database 'testcommonswiki' - https://phabricator.wikimedia.org/T387417#10585734 (10bvibber... [04:53:02] 10Beta-Cluster-Infrastructure, 10JsonConfig, 10Wikimedia-Site-requests: Wikimedia\Rdbms\DBQueryError from line 1230 of /srv/mediawiki-staging/php-master/includes/libs/rdbms/database/Database.php: Error 1049: Unknown database 'testcommonswiki' - https://phabricator.wikimedia.org/T387417#10585869 (10Reedy)... [08:35:19] 10Gerrit, 06collaboration-services, 10Projects-Cleanup, 10Wikidata, 10Wikidata Query UI: Archive wikidata/query/gui Gerrit repository - https://phabricator.wikimedia.org/T387199#10586060 (10Jelto) 05Openā†’03Resolved p:05Triageā†’03Medium a:03Jelto I set https://gerrit.wikimedia.org/r/c/wikidat... [08:35:28] 10Gerrit, 06collaboration-services, 10Projects-Cleanup, 10Wikidata, 10Wikidata Query UI: Archive wikidata/query/gui Gerrit repository - https://phabricator.wikimedia.org/T387199#10586065 (10Jelto) [08:35:32] 10GitLab (Pipeline Services MigrationšŸ¤), 06collaboration-services, 10Wikidata, 10Wikidata Query UI, and 3 others: move query.wikidata.org to kubernetes - https://phabricator.wikimedia.org/T350793#10586066 (10Jelto) [08:40:21] 10Continuous-Integration-Config, 10MediaWiki-extensions-WikibaseClient, 10MediaWiki-extensions-WikibaseRepository, 10Wikidata, and 3 others: [SPIKE][Infra] Re-start Wikibase test coverage reporting - https://phabricator.wikimedia.org/T288396#10586070 (10ArthurTaylor) excellent - thanks for the review / dep... [08:46:27] 10Continuous-Integration-Config, 10MediaWiki-extensions-WikibaseClient, 10MediaWiki-extensions-WikibaseRepository, 10Wikidata, and 3 others: [SPIKE][Infra] Re-start Wikibase test coverage reporting - https://phabricator.wikimedia.org/T288396#10586109 (10ArthurTaylor) I've created T387434 to track the issue... [08:47:40] 10GitLab (Pipeline Services MigrationšŸ¤), 06collaboration-services, 10Wikidata, 10Wikidata Query UI, and 3 others: move query.wikidata.org to kubernetes - https://phabricator.wikimedia.org/T350793#10586126 (10Jelto) [09:09:32] (03CR) 10Hashar: [C:03+2] jjb: Update bare PHP jobs (non-Quibble) to latest versions [integration/config] - 10https://gerrit.wikimedia.org/r/1123027 (owner: 10Jforrester) [09:11:11] (03Merged) 10jenkins-bot: jjb: Update bare PHP jobs (non-Quibble) to latest versions [integration/config] - 10https://gerrit.wikimedia.org/r/1123027 (owner: 10Jforrester) [09:37:35] (03approved) 10jnuche: buildkit: Update BuildKit dependency to v0.20 [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/120 (https://phabricator.wikimedia.org/T386947) (owner: 10dduvall) [09:37:46] (03approved) 10jnuche: llbtest: Moved llbtest to its own project/module [repos/releng/blubber] (review/buildkit-v0.20-3a8f) - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/121 (owner: 10dduvall) [10:37:09] gitlab needs a short maintenance break [10:43:55] GitLab is back, maintenance finished [11:14:34] 10GitLab (Pipeline Services MigrationšŸ¤), 06Editing-team: Migrate Citoid/Zotero Pipeline Repos to GitLab - https://phabricator.wikimedia.org/T344736#10586528 (10Mvolz) [13:12:41] (03open) 10esanders: ESLint: Replace wikimedia/client-es5 with wikimedia/client [repos/ci-tools/libup] - 10https://gitlab.wikimedia.org/repos/ci-tools/libup/-/merge_requests/70 [13:22:39] (03PS1) 10JMeybohm: helm-linter: Update helm and helmfile [integration/config] - 10https://gerrit.wikimedia.org/r/1123363 (https://phabricator.wikimedia.org/T387376) [13:22:43] (03PS1) 10JMeybohm: Update helm-linter to 0.7.0 [integration/config] - 10https://gerrit.wikimedia.org/r/1123364 (https://phabricator.wikimedia.org/T387376) [14:21:15] (03CR) 10Jelto: [C:03+1] "lgtm" [integration/config] - 10https://gerrit.wikimedia.org/r/1123363 (https://phabricator.wikimedia.org/T387376) (owner: 10JMeybohm) [14:51:58] (03CR) 10Jelto: [C:03+1] "lgtm" [integration/config] - 10https://gerrit.wikimedia.org/r/1123364 (https://phabricator.wikimedia.org/T387376) (owner: 10JMeybohm) [15:02:44] (03PS2) 10Jforrester: Docker: [helm-linter] Update helm and helmfile [integration/config] - 10https://gerrit.wikimedia.org/r/1123363 (https://phabricator.wikimedia.org/T387376) (owner: 10JMeybohm) [15:03:07] (03PS2) 10Jforrester: jjb: [helm-lint] Update to use helm-linter image 0.7.0 [integration/config] - 10https://gerrit.wikimedia.org/r/1123364 (https://phabricator.wikimedia.org/T387376) (owner: 10JMeybohm) [15:03:30] (03CR) 10Jforrester: "LGTM; happy to land/deploy/build once the dependencies have been merged." [integration/config] - 10https://gerrit.wikimedia.org/r/1123363 (https://phabricator.wikimedia.org/T387376) (owner: 10JMeybohm) [15:28:35] FIRING: DatasourceError: Queue (Jenkins jobs + Zuul functions) - https://grafana.wikimedia.org/alerting/grafana/b9a8470a-ebab-46f7-9be2-22b5e74a528b/view - https://wikitech.wikimedia.org/wiki/Monitoring/DatasourceError - https://alerts.wikimedia.org/?q=alertname%3DDatasourceError [15:29:37] FIRING: [2x] DatasourceNoData: - https://alerts.wikimedia.org/?q=alertname%3DDatasourceNoData [15:33:35] RESOLVED: DatasourceError: Queue (Jenkins jobs + Zuul functions) - https://grafana.wikimedia.org/alerting/grafana/b9a8470a-ebab-46f7-9be2-22b5e74a528b/view - https://wikitech.wikimedia.org/wiki/Monitoring/DatasourceError - https://alerts.wikimedia.org/?q=alertname%3DDatasourceError [15:39:37] RESOLVED: [2x] DatasourceNoData: - https://alerts.wikimedia.org/?q=alertname%3DDatasourceNoData [15:40:51] (03CR) 10Hashar: Docker: [helm-linter] Update helm and helmfile (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/1123363 (https://phabricator.wikimedia.org/T387376) (owner: 10JMeybohm) [15:41:45] (03CR) 10JMeybohm: Docker: [helm-linter] Update helm and helmfile (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/1123363 (https://phabricator.wikimedia.org/T387376) (owner: 10JMeybohm) [15:56:07] Project beta-scap-sync-world build #195663: 04FAILURE in 1 min 6 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/195663/ [15:56:53] 00:01:06.328 15:56:07 The service mesh is unavailable, which can lead to unexpected results. [15:56:53] pff [15:56:57] who knows [15:57:23] Therefore, the script will not be executed. If you are *very* sure your script will not need the service mesh at all, you can run it again with MESH_CHECK_SKIP=1 [15:57:40] that is right there the most context less message ever. I have genuiely now idea from where it comes from [15:57:43] s/now/no/ [15:57:57] 10Phabricator: 'Unhandled Exception ("Error")' displayed when attempting to filter the Phabricator activity feed by IDs/PHIDs - https://phabricator.wikimedia.org/T387479 (10A_smart_kitten) 03NEW [16:00:32] 10Beta-Cluster-Infrastructure, 06Release-Engineering-Team: Beta update job fails: The service mesh is unavailable, which can lead to unexpected results. - https://phabricator.wikimedia.org/T387480 (10hashar) 03NEW [16:00:45] 10Beta-Cluster-Infrastructure, 06Release-Engineering-Team: Beta update job fails: The service mesh is unavailable, which can lead to unexpected results. - https://phabricator.wikimedia.org/T387480#10587621 (10hashar) p:05Triageā†’03Unbreak! [16:03:54] I am off due to kids [16:06:01] Project beta-scap-sync-world build #195664: 04STILL FAILING in 1 min 3 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/195664/ [16:09:14] the change that introduced `The service mesh is unavailable, which can lead to unexpected results` is being reverted as we speak [16:09:29] just FYI [16:11:37] (03merge) 10dduvall: buildkit: Update BuildKit dependency to v0.20 [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/120 (https://phabricator.wikimedia.org/T386947) [16:11:39] (03update) 10dduvall: llbtest: Moved llbtest to its own project/module [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/121 [16:11:52] (03merge) 10dduvall: llbtest: Moved llbtest to its own project/module [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/121 [16:16:10] Project beta-scap-sync-world build #195665: 04STILL FAILING in 1 min 7 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/195665/ [16:16:58] follow-up to the message i sent here yesterday re emails from phabriactor being delayed, after looking into it, i've found a number of phab comments that i don't appear to have received an email for at all. i've got no idea if it's a problem with my email account or a problem on the phabricator side, though. has anyone else noticed missing phabricator emails recently? [16:20:25] Project beta-update-databases-eqiad build #82891: 04FAILURE in 24 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/82891/ [16:22:33] (03open) 10dduvall: version: 1.1.0 [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/122 [16:26:07] Project beta-scap-sync-world build #195666: 04STILL FAILING in 1 min 7 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/195666/ [16:27:31] (03merge) 10dduvall: version: 1.1.0 [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/122 [16:36:50] Yippee, build fixed! [16:36:50] Project beta-scap-sync-world build #195667: 09FIXED in 1 min 49 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/195667/ [16:48:27] 10GitLab-Application-Security-Pipeline, 06Security-Team: Craft more mediawiki-specific and php semgrep rule sets - https://phabricator.wikimedia.org/T342468#10588025 (10acooper) To split this up (discussion between me and @sbassett) # Research the existing PHP rulesets that are in semgrep - default rules # Res... [17:10:28] (03open) 10jforrester: releases: Update eslint-config-wikimedia to 0.29.1 [repos/ci-tools/libup-config] - 10https://gitlab.wikimedia.org/repos/ci-tools/libup-config/-/merge_requests/63 [17:10:47] (03merge) 10jforrester: releases: Update eslint-config-wikimedia to 0.29.1 [repos/ci-tools/libup-config] - 10https://gitlab.wikimedia.org/repos/ci-tools/libup-config/-/merge_requests/63 [17:25:11] 06Project-Admins: Create project tag for RoadToWiki - https://phabricator.wikimedia.org/T387500 (10Gopavasanth) 03NEW [17:31:28] Yippee, build fixed! [17:31:28] Project beta-update-databases-eqiad build #82892: 09FIXED in 11 min: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/82892/ [19:25:03] maintenance-disconnect-full-disks build 679756 integration-agent-docker-1048 (/: 25%, /srv: 98%, /var/lib/docker: 43%): OFFLINE due to disk space [19:27:14] (03open) 10aklapper: Revert "Expose the Edit Task Priority dropdown field only to trusted users" [repos/phabricator/phabricator] (wmf/stable) - 10https://gitlab.wikimedia.org/repos/phabricator/phabricator/-/merge_requests/84 (https://phabricator.wikimedia.org/T363337) [19:28:22] (03merge) 10aklapper: Revert "Expose the Edit Task Priority dropdown field only to trusted users" [repos/phabricator/phabricator] (wmf/stable) - 10https://gitlab.wikimedia.org/repos/phabricator/phabricator/-/merge_requests/84 (https://phabricator.wikimedia.org/T363337) [19:30:03] maintenance-disconnect-full-disks build 679757 integration-agent-docker-1048 (/: 25%, /srv: 52%, /var/lib/docker: 43%): RECOVERY disk space OK [20:32:17] 10Release-Engineering-Team (Radar), 06Data-Engineering: Create a GitLab CI/CD Component project for WMF CI/CD templates and components - https://phabricator.wikimedia.org/T382430#10588908 (10brennen) > I added Release-Engineering-Team just as an FYI and in case they have advice for us. RelEng, feel free to put... [20:37:21] 10Phabricator: phabricator account rename - https://phabricator.wikimedia.org/T387516#10588914 (10Aklapper) 05Openā†’03Resolved a:03Aklapper Done. [20:40:17] 10GitLab, 10Release-Engineering-Team (Radar): Retire /cloudvps-repos, merge to /repos - https://phabricator.wikimedia.org/T387062#10588920 (10brennen) > I do think having the /toolforge-repos bucket makes sense both from the automation side and for helping discover code for Toolforge tools. It could have been... [20:43:03] 06Project-Admins, 06Security-Team, 10Vulnerability Management, 07Security: Proposed Security Tags for Phabricator - https://phabricator.wikimedia.org/T387508#10588923 (10Aklapper) +#Project-Admins as this is about creating Phabricator projects, per https://www.mediawiki.org/wiki/Phabricator/Creating_and_re... [20:46:14] (03CR) 10Subramanya Sastry: "I might self +2 this tomorrow." [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/1122282 (owner: 10Subramanya Sastry) [20:47:29] Is someone here who has admin on https://phabricator.wmcloud.org ? [20:48:58] (03update) 10pppery: Use MyLanguage [repos/phabricator/extensions] (wmf/stable) - 10https://gitlab.wikimedia.org/repos/phabricator/extensions/-/merge_requests/44 [20:49:15] mutante: apart from yourself? [20:49:22] 06Project-Admins, 06Security-Team, 10Vulnerability Management, 07Security: Proposed Security Tags for Phabricator - https://phabricator.wikimedia.org/T387508#10588936 (10Aklapper) There are a bunch of probably Security-related projects which seem entirely unused: * https://phabricator.wikimedia.org/maniphe... [20:49:36] (03close) 10pppery: Use MyLanguage [repos/phabricator/extensions] (wmf/stable) - 10https://gitlab.wikimedia.org/repos/phabricator/extensions/-/merge_requests/44 [20:51:43] (03open) 10pppery: Use MyLanguage [repos/phabricator/extensions] (wmf/stable) - 10https://gitlab.wikimedia.org/repos/phabricator/extensions/-/merge_requests/46 [20:56:29] p858snake|cloud: yea, cant receive mail so no password reset :p [20:56:47] 06Project-Admins, 06Security-Team, 10Vulnerability Management, 07Security: Proposed Security Tags for Phabricator - https://phabricator.wikimedia.org/T387508#10588947 (10Bawolff) Perhaps XSS should be split up into i18n-xss and other xss because the two have really different risk profiles so its a bit conf... [20:57:32] mutante: you could probably do it from the command line since you set the instance up from memory [20:57:44] mutante: i'm around [20:58:32] let me try if I can get shell, brb [20:58:55] mutante: k, if not i just did a reset not too long ago for someone i think, lemme know [21:00:13] A_smart_kitten: I don't think I've had the feeling of missing mail so far. Got specific examples? [21:00:34] thanks all! I was able to use "auth recover" [21:03:28] I dont think outgoing mail from cloud VPS has worked in the past? [21:05:12] my memory is fuzzy. maybe we had something set up in devtools at one time? but not for quite a while, at least, and maybe never. [21:09:56] andre: i did have a few examples of comments that didn't get emailed to me, but then i found them in my inbox later on (even though i could swear i'd checked for them earlier?). so it might have been my mail client playing up. if you don't hear similar complaints from anyone else then that's probably what it was [21:10:23] A_smart_kitten, ah, good that you found them. Because email issues are harder to debug :D :D :D [21:11:22] I would be surprised to get email from a cloud instance. [21:11:51] now let me try to add a banner to the phab test instance that says it's a test instance [21:12:16] not sure yet if I can do that in UI, puppet or it would need a deploy.. but let's see [21:13:39] FIRING: DatasourceError: Queue (Jenkins jobs + Zuul functions) - https://grafana.wikimedia.org/alerting/grafana/b9a8470a-ebab-46f7-9be2-22b5e74a528b/view - https://wikitech.wikimedia.org/wiki/Monitoring/DatasourceError - https://alerts.wikimedia.org/?q=alertname%3DDatasourceError [21:14:25] but .. is it actionable? [21:14:56] I wonder if a damn content panel on the frontpage could be enough [21:15:47] but yeah a "test only" logo is also good, nice [21:16:56] andre: that was the firs tthing I found.. edit the Logo "wordmark" heh [21:17:02] nice one [21:18:39] RESOLVED: DatasourceError: Queue (Jenkins jobs + Zuul functions) - https://grafana.wikimedia.org/alerting/grafana/b9a8470a-ebab-46f7-9be2-22b5e74a528b/view - https://wikitech.wikimedia.org/wiki/Monitoring/DatasourceError - https://alerts.wikimedia.org/?q=alertname%3DDatasourceError [21:18:54] FIRING: DatasourceError: Queue (Jenkins jobs + Zuul functions) - https://grafana.wikimedia.org/alerting/grafana/b9a8470a-ebab-46f7-9be2-22b5e74a528b/view - https://wikitech.wikimedia.org/wiki/Monitoring/DatasourceError - https://alerts.wikimedia.org/?q=alertname%3DDatasourceError [21:19:15] imho a typical example of the drawbacks of data-based modern monitoring [21:20:50] in Icinga with a shell command you could run it yourself and see what is failing. now you get meta issues and aren't sure if it's real or not [21:22:24] andre: so.. I made the header bar red and changed that logo text.. how to get one of those panels, do you know? [21:29:30] RESOLVED: DatasourceError: Queue (Jenkins jobs + Zuul functions) - https://grafana.wikimedia.org/alerting/grafana/b9a8470a-ebab-46f7-9be2-22b5e74a528b/view - https://wikitech.wikimedia.org/wiki/Monitoring/DatasourceError - https://alerts.wikimedia.org/?q=alertname%3DDatasourceError [21:30:40] mutante, I like that. [21:31:04] Panels... I think that needs a dashboard at https://phabricator.wmcloud.org/dashboard/ and then adding a panel from https://phabricator.wmcloud.org/dashboard/panel/ . But might be overkill [21:31:33] andre: ok! cool. Well then let me leave it as is for today and see if the bug reporter has a comment [21:31:46] also I am not sure if that config might be overwritten by a deploy [21:32:02] Pink! No Red!!!1 ;) [21:32:07] nah, thanks, I like it [21:32:14] it's maroon to me :) [21:33:06] brennen: you think every phab deploy would reset ui.* settings like the logo text.. if I made them in the UI? [21:41:50] whoever understands what's [not] reading which settings is welcome to update https://phabricator.wikimedia.org/T239355 :P [21:48:09] omg, right :) [21:50:36] I look into the fixed_settings.yaml and what is literally the first line? the ui.logo wordmarkText I just edited, haha [21:51:06] not going to add puppet code that uses different json file if in cloud :p [21:51:36] but hey, as log as we never deploy all is good, so should be fine ;) [21:52:26] "# Values set here should only be default settings that apply to all installs. " [21:57:17] my vague mental model of this is that what's in the db overrides what's in config files. [22:01:41] ah! ok. well, let's just see what happens. it was enough to do.and it will be obvious enough if it reverts or not [22:02:10] (if we deploy to that) [22:10:48] (03merge) 10aklapper: Use MyLanguage [repos/phabricator/extensions] (wmf/stable) - 10https://gitlab.wikimedia.org/repos/phabricator/extensions/-/merge_requests/46 (owner: 10pppery)