[01:11:57] PROBLEM - PHD should be supervising processes on phab1001 is CRITICAL: PROCS CRITICAL: 2 processes with UID = 497 (phd) https://wikitech.wikimedia.org/wiki/Phabricator [01:13:55] RECOVERY - PHD should be supervising processes on phab1001 is OK: PROCS OK: 18 processes with UID = 497 (phd) https://wikitech.wikimedia.org/wiki/Phabricator [04:09:36] (03PS1) 10Subramanya Sastry: Ensure resourcemodule scripts apply properly on Parsoid HTML [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/713089 [06:03:27] (03PS1) 10QChris: Allow “Gerrit Managers” to import history [extensions/MobileFrontendContentProvider] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/713101 [06:03:29] (03CR) 10QChris: [V: 03+2 C: 03+2] Allow “Gerrit Managers” to import history [extensions/MobileFrontendContentProvider] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/713101 (owner: 10QChris) [06:03:31] (03PS1) 10QChris: Import done. Revoke import grants [extensions/MobileFrontendContentProvider] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/713102 [06:03:33] (03CR) 10QChris: [V: 03+2 C: 03+2] Import done. Revoke import grants [extensions/MobileFrontendContentProvider] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/713102 (owner: 10QChris) [11:17:43] PROBLEM - Work requests waiting in Zuul Gearman server on contint2001 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [150.0] https://www.mediawiki.org/wiki/Continuous_integration/Zuul https://grafana.wikimedia.org/dashboard/db/zuul-gearman?panelId=10&fullscreen&orgId=1 [12:25:17] 10Release-Engineering-Team (Seen), 10MW-on-K8s, 10Platform Engineering Roadmap, 10User-Daniel: Convert static mediawiki configuration to form more suitable for containers - https://phabricator.wikimedia.org/T263166 (10daniel) [12:25:37] 10Continuous-Integration-Config, 10Release-Engineering-Team (Seen), 10Scap, 10MW-on-K8s, and 5 others: Define variant Wikimedia production config in compiled, static files - https://phabricator.wikimedia.org/T223602 (10daniel) [12:33:22] RECOVERY - Work requests waiting in Zuul Gearman server on contint2001 is OK: OK: Less than 100.00% above the threshold [90.0] https://www.mediawiki.org/wiki/Continuous_integration/Zuul https://grafana.wikimedia.org/dashboard/db/zuul-gearman?panelId=10&fullscreen&orgId=1 [14:01:50] 10Phabricator: Evaluate adding "In progress" status to Phabricator. - https://phabricator.wikimedia.org/T288956 (10joanna_borun) [14:37:44] 10Phabricator, 10User-DannyS712: Combine Danmichaelo's Herald rules H240, H241, and H242 - https://phabricator.wikimedia.org/T238891 (10Aklapper) 05Open→03Resolved a:03Aklapper I sent a private email to Dan on 2021-07-11; no reply so far either. Thus **I have disabled Dan's three Herald rules H240, H241,... [14:42:00] 10Release-Engineering-Team (Doing), 10Wikidata, 10Wikidata-Query-Service, 10Discovery-Search (Current work): wikidata-query-rdf-maven-release-docker build is too slow and always times out - https://phabricator.wikimedia.org/T287445 (10Gehel) 05Open→03Resolved [14:46:28] 10Project-Admins, 10VPS-Projects: Create a tag for the project wikicommunityhealth - https://phabricator.wikimedia.org/T288963 (10CristianCantoro) [15:29:07] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team: Request acces to deployment-prep - https://phabricator.wikimedia.org/T288967 (10EAkinloose) [15:35:33] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team: Request acces to deployment-prep - https://phabricator.wikimedia.org/T288967 (10thcipriani) p:05Triage→03Medium a:03thcipriani [15:36:08] 10Release-Engineering-Team (Doing): Request acces to deployment-prep - https://phabricator.wikimedia.org/T288967 (10thcipriani) [15:39:38] 10Release-Engineering-Team (Doing): Request acces to deployment-prep - https://phabricator.wikimedia.org/T288967 (10thcipriani) 05Open→03Resolved Hi @EAkinloose you're now a member of the `deployment-prep` project! [15:42:32] (03PS1) 10Ladsgroup: jjb: [wikidata] check out to production branch in build [integration/config] - 10https://gerrit.wikimedia.org/r/713285 (https://phabricator.wikimedia.org/T266703) [15:52:37] (03CR) 10Ladsgroup: [C: 03+2] "Deployed already" [integration/config] - 10https://gerrit.wikimedia.org/r/713285 (https://phabricator.wikimedia.org/T266703) (owner: 10Ladsgroup) [15:53:55] (03Merged) 10jenkins-bot: jjb: [wikidata] check out to production branch in build [integration/config] - 10https://gerrit.wikimedia.org/r/713285 (https://phabricator.wikimedia.org/T266703) (owner: 10Ladsgroup) [18:48:40] x [19:31:42] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team, 10SRE Observability: beta logstash servers run out of disk space - https://phabricator.wikimedia.org/T288989 (10dom_walden) [19:35:02] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team, 10SRE Observability: beta logstash servers run out of disk space - https://phabricator.wikimedia.org/T288989 (10thcipriani) [19:35:04] 10Beta-Cluster-Infrastructure, 10SRE Observability, 10Wikimedia-Logstash, 10observability: logstash-beta.wmflabs.org does not receive any mediawiki events - https://phabricator.wikimedia.org/T233134 (10thcipriani) [19:35:38] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team, 10SRE Observability: beta logstash servers run out of disk space - https://phabricator.wikimedia.org/T288989 (10thcipriani) > In the long-term, it would be good to make logstash on beta more reliable. That seems to be tracked on {T233134} [20:22:22] 10Continuous-Integration-Config, 10Code-Health, 10Platform Team Initiatives (API Integration Tests): API integration tests should skip tests according to flags exposed by the SiteInfo API module - https://phabricator.wikimedia.org/T243976 (10DannyS712) [20:30:40] 10Phabricator, 10User-DannyS712: Rename H310 "OTRS" -> "Znuny" - https://phabricator.wikimedia.org/T289001 (10DannyS712) [20:33:42] 10Phabricator, 10User-DannyS712: Rename H310 "OTRS" -> "Znuny" - https://phabricator.wikimedia.org/T289001 (10Zabe) [20:42:11] 10Phabricator, 10User-DannyS712: Rename H310 "OTRS" -> "Znuny" - https://phabricator.wikimedia.org/T289001 (10Aklapper) 05Open→03Resolved a:03Aklapper Thanks, done! [20:48:13] 10Phabricator, 10User-DannyS712: Rename H310 "OTRS" -> "Znuny" - https://phabricator.wikimedia.org/T289001 (10Zabe) @Aklapper The Herald rule seems outdated as it requires a task to have the #acl_security tag. [20:53:50] 10Phabricator, 10User-DannyS712: Rename H310 "OTRS" -> "Znuny" - https://phabricator.wikimedia.org/T289001 (10Aklapper) Hmm, indeed. I wonder what it is supposed to do. Maybe it's meant to be #Security instead of #acl_security (because {T244165} and {T245201})? Or should be "Security | is any of | Software sec... [20:54:51] 10Phabricator, 10User-DannyS712: Rename H310 "OTRS" -> "Znuny" - https://phabricator.wikimedia.org/T289001 (10DannyS712) >>! In T289001#7286743, @Aklapper wrote: > Hmm, indeed. I wonder what it is supposed to do. > Maybe it's meant to be #Security instead of #acl_security (because {T244165} and {T245201})? > O... [22:05:43] 10Release-Engineering-Team (Doing), 10Patch-For-Review, 10Release, 10Train Deployments, 10User-jeena (Sprint 7/28-8/10): 1.37.0-wmf.18 deployment blockers - https://phabricator.wikimedia.org/T281159 (10jeena) 05Open→03Resolved [22:12:16] 10Release-Engineering-Team (Doing), 10Patch-For-Review, 10Release, 10Train Deployments, 10User-jeena (Sprint 7/28-8/10): 1.37.0-wmf.18 deployment blockers - https://phabricator.wikimedia.org/T281159 (10Zabe) [22:15:19] 10Phabricator: Evaluate adding "In progress" status to Phabricator. - https://phabricator.wikimedia.org/T288956 (10Aklapper) Thanks for filing this. I'd love to see more input on this proposal, for example from other teams if they see a similar need, and from the #release-engineering-team. Sharing some backgrou... [22:59:42] (03CR) 10Jeena Huneidi: [C: 03+2] "As a suggestion, you might want to run the tests again in gate-and-submit in case other things have merged between the test run and the +2" [integration/config] - 10https://gerrit.wikimedia.org/r/711731 (https://phabricator.wikimedia.org/T287787) (owner: 10Accraze) [23:00:52] (03Merged) 10jenkins-bot: inference-services: added draftquality pipeline [integration/config] - 10https://gerrit.wikimedia.org/r/711731 (https://phabricator.wikimedia.org/T287787) (owner: 10Accraze) [23:08:52] !log Reloading Zuul to deploy https://gerrit.wikimedia.org/r/c/integration/config/+/711731 [23:08:54] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL