[00:12:59] 10serviceops, 10Observability-Logging, 10SRE, 10Wikimedia-Logstash, 10observability: ensure httpd error logs from "misc apps" (krypton) end up in logstash - https://phabricator.wikimedia.org/T216090 (10lmata) Thank you for the update this will help for backlog priorities setting. [02:13:05] 10serviceops, 10MW-on-K8s, 10SRE-swift-storage, 10Shellbox, and 2 others: Support large files in Shellbox - https://phabricator.wikimedia.org/T292322 (10tstarling) > 52 seconds in Shellbox\Client::computeHmac over 3 calls, I guess all signatures for the remote shellbox calls I benchmarked the SHA-256 HMAC... [08:46:33] 10serviceops, 10MW-on-K8s, 10SRE-swift-storage, 10Shellbox, and 2 others: Support large files in Shellbox - https://phabricator.wikimedia.org/T292322 (10Joe) >>! In T292322#7627149, @tstarling wrote: >> 52 seconds in Shellbox\Client::computeHmac over 3 calls, I guess all signatures for the remote shellbox... [12:26:35] 10serviceops, 10DC-Ops, 10Prod-Kubernetes, 10SRE, and 3 others: decommission kubestage100[12]-eqiad - https://phabricator.wikimedia.org/T299142 (10Aklapper) [14:51:44] this is a redirect from wikimedia-sre-foundations: hi! i'm the engineering manager for trust and safety tools and i'm wondering if someone can help me locate a private config value for https://www.mediawiki.org/wiki/Extension:MediaModeration [14:54:14] mepps: hey! what exactly are you looking for? [14:54:58] taavi i'm looking for the value of wgMediaModerationPhotoDNASubscriptionKey [14:55:21] i'm trying to figure out if it's current with our PhotoDNA subscription [14:56:14] you appear to have shell access in the `restricted` group, so you should be able to read it directly from /srv/mediawiki/private/PrivateSettings.php on mwmaint1002.eqiad.wmnet [14:57:47] great thanks taavi! [14:59:07] perfect, I found what I needed. Thank you so much! [17:06:54] 10serviceops, 10Prod-Kubernetes, 10Kubernetes: setup/install kubernetes10[18-21] - https://phabricator.wikimedia.org/T293728 (10JMeybohm) [17:07:42] 10serviceops, 10Prod-Kubernetes, 10Kubernetes: setup/install kubernetes10[18-21] - https://phabricator.wikimedia.org/T293728 (10akosiaris) a:03akosiaris [19:52:09] 10serviceops, 10Release-Engineering-Team (Seen): contint hardware refresh - https://phabricator.wikimedia.org/T294276 (10hashar) [23:41:35] 10serviceops, 10MW-on-K8s, 10Release Pipeline: Pushes to docker-registry fail for images with compressed layers of size >1GB - https://phabricator.wikimedia.org/T288198 (10dancy) We're running into this again today. I tried the same workaround as before (removing a recent but inactive mediawiki checkout) bu... [23:57:03] 10serviceops, 10DC-Ops, 10SRE, 10ops-codfw, 10Kubernetes: (Need By: TBD) rack/setup/install kubernetes20[19|2(012)] - https://phabricator.wikimedia.org/T299470 (10RobH) [23:58:04] 10serviceops, 10DC-Ops, 10SRE, 10ops-codfw, 10Kubernetes: (Need By: TBD) rack/setup/install kubernetes20[19|2(012)] - https://phabricator.wikimedia.org/T299470 (10RobH)