[05:51:37] 10serviceops: System OOM causes random mmap() failure rather than oom-killer - https://phabricator.wikimedia.org/T298573 (10Aklapper) [08:12:13] 10serviceops, 10MW-on-K8s, 10SRE-swift-storage, 10Shellbox: Support large files in Shellbox - https://phabricator.wikimedia.org/T292322 (10Joe) Updating myself: looks like the error comes from the fact mwmaint is *not* using remote shellbox to execute `scripts/retrieveMetaData.sh` - see https://logstash.wi... [09:06:26] 10serviceops: Test running php7.2 and php7.4 in parallel on the beta cluster - https://phabricator.wikimedia.org/T295578 (10Joe) p:05Triage→03Medium [09:48:37] 10serviceops, 10Prod-Kubernetes, 10Kubernetes: setup/install kubestage100[34] - https://phabricator.wikimedia.org/T293729 (10ops-monitoring-bot) cookbooks.sre.hosts.decommission executed by aokoth@cumin1001 for hosts: `kubestage1001.eqiad.wmnet` - kubestage1001.eqiad.wmnet (**PASS**) - Downtimed host on Ic... [11:34:04] 10serviceops, 10Prod-Kubernetes, 10Kubernetes: setup/install kubestage100[34] - https://phabricator.wikimedia.org/T293729 (10ops-monitoring-bot) cookbooks.sre.hosts.decommission executed by aokoth@cumin1001 for hosts: `kubestage1002.eqiad.wmnet` - kubestage1002.eqiad.wmnet (**PASS**) - Downtimed host on Ic... [13:37:09] 10serviceops, 10SRE, 10Kubernetes, 10Patch-For-Review: Migrate to helm v3 - https://phabricator.wikimedia.org/T251305 (10Jelto) [15:09:47] 10serviceops, 10SRE, 10Toolhub, 10Patch-For-Review, 10Service-deployment-requests: New Service Request Toolhub - https://phabricator.wikimedia.org/T280881 (10akosiaris) >>! In T280881#7556653, @bd808 wrote: >>>! In T280881#7555760, @akosiaris wrote: >> @bd808, any news on those? > > It was not clear to... [17:28:08] 10serviceops, 10CFSSL-PKI, 10Infrastructure-Foundations, 10Prod-Kubernetes, and 2 others: Automate issuing of TLS certificates in kubernetes clusters - https://phabricator.wikimedia.org/T294560 (10JMeybohm) [17:28:18] 10serviceops, 10Prod-Kubernetes, 10Kubernetes: Provision TLS certificates for k8s services in istio-system namespace - https://phabricator.wikimedia.org/T295385 (10JMeybohm) 05Open→03Resolved //3. Create Certificate objects during Namespace creation (in admin_ng)// it is [17:35:34] 10serviceops, 10DC-Ops, 10SRE, 10ops-codfw: Q2:(Need By: TBD) rack/setup/install mc20[38-55] - https://phabricator.wikimedia.org/T294962 (10wiki_willy) a:03Papaul [17:57:46] 10serviceops, 10Parsoid-Tests, 10SRE, 10Traffic, and 2 others: Make testreduce web UI publicly accessible on the internet - https://phabricator.wikimedia.org/T266509 (10Dzahn) @ssastry @Arlolra I self-merged that traffic change and https://parsoid-rt-tests.wikimedia.org/static/style.css is NOT 404 anymor... [18:05:39] 10serviceops, 10Parsoid-Tests, 10SRE, 10Parsoid (Tracking), 10Patch-For-Review: Move testreduce away from scandium to a separate Buster Ganeti VM - https://phabricator.wikimedia.org/T257906 (10ssastry) [18:06:42] 10serviceops, 10Parsoid-Tests, 10SRE, 10Traffic, and 2 others: Make testreduce web UI publicly accessible on the internet - https://phabricator.wikimedia.org/T266509 (10ssastry) 05Open→03Resolved Perfect! It works now. Thanks! [18:07:01] 10serviceops, 10Parsoid-Tests, 10SRE, 10Traffic, and 2 others: Make testreduce web UI publicly accessible on the internet - https://phabricator.wikimedia.org/T266509 (10Dzahn) Great! thanks for confirming. and sorry for the delay in between [18:36:55] 10serviceops, 10Prod-Kubernetes, 10Toolhub, 10Kubernetes: Maintenance environment needed for running one-off commands - https://phabricator.wikimedia.org/T290357 (10bd808) Bug found in temp solution: the Elasticsearch connection needs to use TLS and also skip verifying the remote cert. See https://github.c... [22:10:46] 10serviceops, 10Gerrit, 10SRE: replacement for gerrit2001 - https://phabricator.wikimedia.org/T243027 (10Dzahn) [22:14:56] 10serviceops, 10Gerrit, 10SRE: replacement for gerrit2001 - https://phabricator.wikimedia.org/T243027 (10Dzahn) @LSobanski @akosiaris This one is for consideration in a manager meeting with releng. [23:24:09] 10serviceops, 10MW-on-K8s, 10SRE-swift-storage, 10Shellbox: Support large files in Shellbox - https://phabricator.wikimedia.org/T292322 (10tstarling) I was not able to reproduce that error. ` [2240][tstarling@mwmaint1002:/home/oblivian]$ mwscript eval.php --wiki=enwiki --ignore-errors > $command = MediaWi...