[01:26:19] 10Release-Engineering-Team, 10MassMessage, 10User-DannyS712, 10ci-test-error (WMF-deployed Build Failure): Tests failing for the master branch of MassMessage - https://phabricator.wikimedia.org/T291762 (10DannyS712) p:05Triage→03High [01:31:18] 10Release-Engineering-Team, 10MassMessage, 10User-DannyS712, 10ci-test-error (WMF-deployed Build Failure): Tests failing for the master branch of MassMessage - https://phabricator.wikimedia.org/T291762 (10DannyS712) Manual tests on the beta cluster suggest that "A@en.wikipedia.org" is now considered invali... [02:15:10] 10Release-Engineering-Team, 10MassMessage, 10User-DannyS712, 10ci-test-error (WMF-deployed Build Failure): Tests failing for the master branch of MassMessage - https://phabricator.wikimedia.org/T291762 (10DannyS712) So in https://gerrit.wikimedia.org/r/c/mediawiki/extensions/MassMessage/+/723704 I added a... [02:38:48] PROBLEM - PHD should be supervising processes on phab1001 is CRITICAL: PROCS CRITICAL: 2 processes with UID = 497 (phd) https://wikitech.wikimedia.org/wiki/Phabricator [02:40:54] RECOVERY - PHD should be supervising processes on phab1001 is OK: PROCS OK: 4 processes with UID = 497 (phd) https://wikitech.wikimedia.org/wiki/Phabricator [05:49:46] 10Continuous-Integration-Infrastructure, 10Patch-For-Review: Fold most of the tox images into tox-buster - https://phabricator.wikimedia.org/T291292 (10hashar) Regarding tox-pywikibot, I agree. There are still changes open and jobs that need to be deployed / verified to work then yes we can mark this one resol... [08:38:34] PROBLEM - PHD should be supervising processes on phab1001 is CRITICAL: PROCS CRITICAL: 2 processes with UID = 497 (phd) https://wikitech.wikimedia.org/wiki/Phabricator [08:40:30] RECOVERY - PHD should be supervising processes on phab1001 is OK: PROCS OK: 20 processes with UID = 497 (phd) https://wikitech.wikimedia.org/wiki/Phabricator [11:14:29] 10Phabricator: Phabricator search times out - https://phabricator.wikimedia.org/T291775 (101234qwer1234qwer4) [11:23:37] 10Phabricator: Searching for "gerrit" in global Phabricator search leads to upstream request timeout (too many results?) - https://phabricator.wikimedia.org/T258803 (101234qwer1234qwer4) I can reproduce the following error message while logged in: {F34655062} This is different to the plain text error message I j... [11:24:34] 10Phabricator: Searching for "gerrit" in global Phabricator search leads to upstream request timeout (too many results?) - https://phabricator.wikimedia.org/T258803 (101234qwer1234qwer4) [11:31:46] 10Phabricator, 10Traffic: Phabricator search times out - https://phabricator.wikimedia.org/T291775 (10RhinosF1) Is Phab behind envoy? The plain error rather than 'Wikimedia Error' sounds simmilar to {T287983} [11:36:12] 10Phabricator, 10Traffic: Phabricator search times out - https://phabricator.wikimedia.org/T291775 (101234qwer1234qwer4) "Wikimedia error"? Don't think this appears on Phab. T258803#7378611, where I had mentioned this task, appears to be the design of a typical Phab error. [11:41:01] 10Phabricator, 10Traffic: Phabricator search times out - https://phabricator.wikimedia.org/T291775 (10RhinosF1) >>! In T291775#7378639, @1234qwer1234qwer4 wrote: > "Wikimedia error"? Don't think this appears on Phab. T258803#7378611, where I had mentioned this task, appears to be the design of a typical Phab e... [13:49:33] 10Project-Admins: Create #Croatian-Sites tag - https://phabricator.wikimedia.org/T291751 (10FriedrickMILBarbarossa) Razuman i objektivan prijedlog. [13:49:49] 10Project-Admins: Create #Croatian-Sites tag - https://phabricator.wikimedia.org/T291751 (10FriedrickMILBarbarossa) A reasonable and objective proposal. [14:48:50] 10Phabricator, 10Release-Engineering-Team, 10Traffic: Phabricator search times out - https://phabricator.wikimedia.org/T291775 (10Marostegui) p:05Triage→03Medium It does eventually work for me (aka: no timeouts, but it does take a looong time). I have found this query: ` | 440482799 | phuser |... [15:57:32] (03PS1) 10Majavah: zuul: [labs/toollabs] Drop stretch glue [integration/config] - 10https://gerrit.wikimedia.org/r/723759 [16:05:50] 10Continuous-Integration-Infrastructure, 10Cloud-Services: Stop using integration/composer and then archive the repo - https://phabricator.wikimedia.org/T249949 (10Majavah) [16:46:36] 10Release-Engineering-Team (Doing), 10GitLab (Project Migration), 10User-brennen: Early adoption signup for WMF GitLab - https://phabricator.wikimedia.org/T282842 (10Chlod) Hello! We at [[ https://en.wikipedia.org/wiki/Wikipedia:RedWarn | RedWarn ]] would love to signup for early adoption. We currently host... [17:00:33] 10Beta-Cluster-Infrastructure: "Sender address rejected: Domain not found" for emails sent from the beta cluster - https://phabricator.wikimedia.org/T291679 (10Chlod) >>! In T291679#7376088, @Majavah wrote: > Fun question: why is that being sent out from cloudinfra mx:es instead of deployment-prep's own mx boxes... [17:01:08] 10Beta-Cluster-Infrastructure: "Sender address rejected: Domain not found" for emails sent from the beta cluster - https://phabricator.wikimedia.org/T291679 (10Chlod)