[09:25:32] 10serviceops, 10SRE, 10Services, 10Wikibase-Quality-Constraints, and 3 others: Deploy Shellbox instance (shellbox-constraints) for Wikidata constraint regexes - https://phabricator.wikimedia.org/T285104 (10Addshore) >>! In T285104#7193129, @Ladsgroup wrote: > The main person working on this is Kunal and he... [09:41:31] 10serviceops, 10SRE, 10Services, 10Wikibase-Quality-Constraints, and 3 others: Deploy Shellbox instance (shellbox-constraints) for Wikidata constraint regexes - https://phabricator.wikimedia.org/T285104 (10Ladsgroup) Yeah, we're looking at it :D It will take a bit of time, there some open questions like LV... [11:39:52] 10serviceops, 10MW-on-K8s, 10SRE: Evaluate nginx-controller as an Ingress - https://phabricator.wikimedia.org/T286197 (10aborrero) Sharing a bit our experience @ WMCS with ingress-nginx: > What is the general architecture? Basically you deploy a kubernetes Deployment with a tailored NGINX that is able to p... [12:11:20] 10serviceops, 10SRE, 10Patch-For-Review: bring 43 new mediawiki appserver in eqiad into production - https://phabricator.wikimedia.org/T279309 (10Dzahn) [12:27:10] 10serviceops, 10SRE, 10Patch-For-Review: bring 43 new mediawiki appserver in eqiad into production - https://phabricator.wikimedia.org/T279309 (10Dzahn) [15:29:06] 10serviceops, 10Lift-Wing, 10Kubernetes, 10Machine-Learning-Team (Active Tasks): Discussion: dedicated directory in the deployment-chart repository for ML services - https://phabricator.wikimedia.org/T286791 (10elukey) [17:16:03] 10serviceops, 10Lift-Wing, 10Kubernetes, 10Machine-Learning-Team (Active Tasks): Discussion: dedicated directory in the deployment-chart repository for ML services - https://phabricator.wikimedia.org/T286791 (10ACraze) > We should probably create a separate `ml-services` directory, in which we'll place (in... [17:39:53] 10serviceops, 10Wikimedia-Logstash, 10observability, 10GitLab (Initialization), and 2 others: Logging for GitLab - https://phabricator.wikimedia.org/T274462 (10colewhite) @brennen Thank you for the info! I've got a mostly-working set of patches nearing readiness for review. Is it possible to configure th... [17:42:04] 10serviceops, 10Wikimedia-Logstash, 10observability, 10GitLab (Initialization), and 2 others: Logging for GitLab - https://phabricator.wikimedia.org/T274462 (10brennen) > Is it possible to configure the nginx component to emit ECS-compatible access logs natively? Good question; I'll check. My guess is th... [18:03:29] Unsure if this is the right channel to ask, so feel free to point me in another direction. I'm wondering about DNS Discovery endpoints. [18:04:01] Since they are not accessible outside of a prod environment, what would one use say instead of https://api-rw.discovery.wmnet/w/api.php in a staging environment for access to an external wiki? Ive seen a couple of different endpoints in values-staging.yaml in some helm charts so unsure of what to use! [18:09:45] 10serviceops, 10Wikimedia-Logstash, 10observability, 10GitLab (Initialization), and 2 others: Logging for GitLab - https://phabricator.wikimedia.org/T274462 (10brennen) Ok, [[https://docs.gitlab.com/omnibus/settings/logs.html#using-a-custom-nginx-log-format|it looks like]] we just need to set `nginx['log_f... [18:28:26] 10serviceops, 10Technical-blog-posts, 10Datacenter-Switchover: Story idea for Blog: June 2021 DC Switchover - https://phabricator.wikimedia.org/T286080 (10srodlund) @Legoktm I decided to move this into a Google doc for editing before moving this over to the blog. Can you take a quick look and accept/decline... [18:59:31] 10serviceops, 10Wikimedia-Logstash, 10observability, 10GitLab (Initialization), and 2 others: Logging for GitLab - https://phabricator.wikimedia.org/T274462 (10brennen) Working on a patch; it's a bit fiddly because the omnibus config wants to just jam the value of `nginx[log_format]` inside a single-quoted...