[08:27:01] 10serviceops, 10SRE, 10Service-deployment-requests: New Service Request - Calculator Service - https://phabricator.wikimedia.org/T273807 (10Joe) 05Open→03Invalid Closing as invalid because I don't think we need this anymore [08:30:02] 10serviceops, 10Continuous-Integration-Infrastructure, 10SRE: Undeploy patch to use old PHP serialization in PHP 7.4 - https://phabricator.wikimedia.org/T318918 (10Joe) p:05Triage→03High [08:51:57] 10serviceops: Ensure configcluster bootstraps cleanly - https://phabricator.wikimedia.org/T318699 (10Clement_Goubert) `configcluster` needs quite a few hacks to work as a one-host cluster without the pki infrastructure in place. https://gerrit.wikimedia.org/r/c/operations/puppet/+/790657 will probably necessitat... [08:52:55] 10serviceops: Ensure that all appserver-related roles can be cleanly applied on bootstrap - https://phabricator.wikimedia.org/T318671 (10Clement_Goubert) [[ https://gerrit.wikimedia.org/r/plugins/gitiles/operations/puppet/+/refs/heads/sandbox/cgoubert/pontoon-sops-appservers/ | Working branch for pontoon "hacks" ]] [08:55:55] 10serviceops: Ensure role::mediawiki::appserver bootstraps cleanly - https://phabricator.wikimedia.org/T319168 (10Clement_Goubert) [08:56:36] 10serviceops: Ensure role::mediawiki::appserver bootstraps cleanly - https://phabricator.wikimedia.org/T319168 (10Clement_Goubert) 05Open→03In progress p:05Triage→03Medium [08:56:38] 10serviceops: Ensure that all appserver-related roles can be cleanly applied on bootstrap - https://phabricator.wikimedia.org/T318671 (10Clement_Goubert) [10:26:26] 10serviceops, 10Infrastructure-Foundations: Make gVisor packages available via apt.wikimedia.org - https://phabricator.wikimedia.org/T316879 (10Joe) p:05Triage→03High [11:31:32] 10serviceops, 10SRE, 10Thumbor, 10Patch-For-Review, 10User-jijiki: Investigate systemd hardening to replace Firejail for Thumbor - https://phabricator.wikimedia.org/T212941 (10jijiki) 05Open→03Invalid Thumbor is being migrated to k8s, making this task invalid :) [11:31:42] 10serviceops, 10SRE, 10Thumbor, 10User-jijiki: Upgrade Thumbor to Bullseye - https://phabricator.wikimedia.org/T216815 (10jijiki) [11:43:52] 10serviceops, 10Deployments: Add a parse* host to the scap canary checks? - https://phabricator.wikimedia.org/T246728 (10jijiki) @Jdforrester-WMF, 4 parse* hosts are configured as canaries in parsoid-canaries in `scap::dsh::groups`, is this what this task was about? [11:46:49] https://phabricator.wikimedia.org/T252743 is that task still something we would like to explore? [11:46:55] _joe_ ^ [13:09:52] <_joe_> uhm, I guess not given we're moving to k8s? [13:10:07] <_joe_> put it in the icebox for now [13:13:57] cool [13:19:04] 10serviceops, 10Deployments: Add a parse* host to the scap canary checks? - https://phabricator.wikimedia.org/T246728 (10Jdforrester-WMF) 05Open→03Resolved a:03jijiki >>! In T246728#8279296, @jijiki wrote: > @Jdforrester-WMF, 4 parse* hosts are configured as canaries in parsoid-canaries in `scap::dsh::gr... [13:31:40] 10serviceops, 10Parsoid, 10SRE, 10User-brennen, 10Wikimedia-production-error: wt2html: Out of memory crashers - https://phabricator.wikimedia.org/T236833 (10jijiki) @ssastry please let us know if there is anything more to be done in this task, if nor, we can resolve it [13:51:47] 10serviceops, 10SRE: Appservers rising GET latency might have triggered LVS pages - https://phabricator.wikimedia.org/T238973 (10jijiki) 05Open→03Resolved a:03jijiki Please reopen if needed [13:57:11] 10serviceops, 10serviceops-collab, 10GitLab (CI & Job Runners), 10Patch-For-Review, and 2 others: Deploy buildkitd to trusted GitLab runners - https://phabricator.wikimedia.org/T308271 (10Jelto) [13:59:58] 10serviceops, 10SRE: Increase of varnish-be failed fetches error due to "http format error" - https://phabricator.wikimedia.org/T235254 (10jijiki) 05Open→03Resolved a:03jijiki no activity, closing for now [14:41:33] 10serviceops, 10Release-Engineering-Team, 10Scap, 10observability: logstash_checker should be able to check for error for any php version - https://phabricator.wikimedia.org/T235490 (10jijiki) [15:13:08] 10serviceops, 10Parsoid, 10SRE, 10User-brennen, 10Wikimedia-production-error: wt2html: Out of memory crashers - https://phabricator.wikimedia.org/T236833 (10ssastry) Actually, we want to keep some task around to do another sprint on tackling more of our memory usage related issues at some point. Do you p... [15:47:13] 10serviceops, 10Release-Engineering-Team, 10Scap, 10observability: logstash_checker should be able to check for error for any php version - https://phabricator.wikimedia.org/T235490 (10dancy) a:03dancy [17:16:35] 10serviceops, 10Campaign-Tools, 10Foundational Technology Requests: [Request for Comment] Campaigns Geolocation API proposal - https://phabricator.wikimedia.org/T312677 (10ldelench_wmf) 05Open→03Resolved a:03ldelench_wmf Hi all @Joe @jcrespo, going to resolve this since our contract with Pelias/Geocode... [19:01:04] lunch, back in ~45 [19:44:29] 10serviceops, 10Release-Engineering-Team, 10Scap, 10observability: logstash_checker should be able to check for error for any php version - https://phabricator.wikimedia.org/T235490 (10dancy) 05Open→03Invalid Things seem to have changed a lot since this ticket was filed. In production scap calls `/usr... [19:57:59] back