[05:41:38] <wikibugs>	 10serviceops, 10CX-cxserver, 10RESTBase Sunsetting, 10Language-Team ( Language-2023-October-December): Make cxserver call parsoid endpoints on MediaWiki, instead of going through RESTbase - https://phabricator.wikimedia.org/T344982 (10santhosh) a:03santhosh
[06:13:50] <wikibugs>	 10serviceops, 10CX-cxserver, 10RESTBase Sunsetting, 10Language-Team ( Language-2023-October-December), 10Patch-For-Review: Make cxserver call parsoid endpoints on MediaWiki, instead of going through RESTbase - https://phabricator.wikimedia.org/T344982 (10santhosh) @daniel, @MSantos  What would be web API...
[09:46:39] <wikibugs>	 10serviceops, 10DC-Ops, 10SRE, 10ops-codfw: kubernetes2010 down - https://phabricator.wikimedia.org/T347267 (10Clement_Goubert) Hi @Jhancock.wm just a heads up, I rebooted kubernetes2010 to change the CPU power management BIOS setting that was set to BIOS control instead of OS control, which meant we could...
[09:51:03] <dcausse>	 fyi I just resumed a flink test job (will have to backfill a couple days of edits), should make at most 12 concurrent requests on mw-api-int@eqiad, please lemme know if it causes issues and I'll stop it
[10:05:41] <wikibugs>	 10serviceops, 10Prod-Kubernetes: PodSecurityPolicies will be deprecated with Kubernetes 1.21 - https://phabricator.wikimedia.org/T273507 (10elukey) From the documentation that I've read the PSP controller has been replaced by the PSA (Pod Security Admission), that implements three classes of [[ https://kuberne...
[10:20:47] <claime>	 dcausse: ack
[10:22:23] <claime>	 dcausse: Seems to be doing about 150-200 rps, latency is holding up correctly
[10:33:40] <wikibugs>	 10serviceops, 10Content-Transform-Team-WIP, 10RESTBase Sunsetting, 10Wikifeeds, 10Epic: Switchover outgoing wikifeeds parsoid requests - https://phabricator.wikimedia.org/T347027 (10Clement_Goubert) >>! In T347027#9210229, @Jgiannelos wrote: > If i understand correctly one potential explanation could be...
[14:03:44] <godog>	 claime: cheers re: the review for https://gerrit.wikimedia.org/r/c/operations/deployment-charts/+/963024 is there a guide or tips on how to deploy _mediawiki-common_ changes?
[14:12:28] <claime>	 godog: https://wikitech.wikimedia.org/wiki/MediaWiki_On_Kubernetes#No_image_build_deployment_(helmfile_only) should do the trick
[14:14:33] <godog>	 claime: cheers!
[14:23:27] <claime>	 godog: There's mw-jobrunner missing from that command but we don't care about that, it's not used
[14:34:26] <godog>	 ack
[14:35:45] <godog>	 deploying as we speak
[15:18:02] <claime>	 godog: I'm getting an unrecognized format error when I try to reproduce T347926 
[15:18:11] <claime>	 Do you manage to get to the excimer ui?
[15:18:56] <claime>	 Ah, the 404 is from the browser console
[15:19:12] <claime>	 Yeah, doesn't work for me
[15:19:39] <godog>	 claime: mmhh you get the format error for the url in the task? yeah I get the same, though I don't think that url is going to ever work
[15:20:40] <claime>	 No, I go to https://en.wikipedia.org/wiki/Energy_density_Extended_Reference_Table, turn on debug, toggle Excimer UI
[15:20:56] <claime>	 Then I click on the link it gives in the extension menu
[15:21:08] <claime>	 That gives me an Unrecognized format error
[15:21:33] <claime>	 if I toggle webdeveloper tools in ff, then reload the performance.w.o page
[15:21:42] <claime>	 https://performance.wikimedia.org/excimer/profile/55121a16b475c057
[15:21:47] <claime>	 Then I get a XHR 404
[15:23:17] <godog>	 mmhh ok clearly either not related or not fixed by the redis egress
[15:25:11] <godog>	 hah Krinkle is not here
[15:27:34] <godog>	 I just yanked my misinformation attempt on the task
[15:27:57] <claime>	 *yoink*
[15:29:51] <godog>	 lolz
[15:29:54] <godog>	 meeting, bbiab
[15:56:39] <claime>	 godog: going afk, we can take a look at what's happening between k8s and arclamp tomorrow if you want
[16:10:01] <godog>	 claime: cheers! yes
[18:16:22] <wikibugs>	 10serviceops, 10Abstract Wikipedia team, 10function-evaluator: Split the monolithic function-evaluator service up in production so we have differently-scalable pods for python 3.7 vs. python 3.8 vs. … - https://phabricator.wikimedia.org/T343389 (10Jdforrester-WMF)
[18:17:19] <wikibugs>	 10serviceops, 10Abstract Wikipedia team, 10function-evaluator, 10Patch-For-Review: Split the monolithic function-evaluator service up in production so we have differently-scalable pods for python vs. node - https://phabricator.wikimedia.org/T343388 (10Jdforrester-WMF) 05Open→03In progress
[18:17:27] <wikibugs>	 10serviceops, 10Abstract Wikipedia team, 10function-evaluator, 10Patch-For-Review: Split the monolithic function-evaluator service up in production so we have differently-scalable pods for python vs. node - https://phabricator.wikimedia.org/T343388 (10Jdforrester-WMF) a:03Jdforrester-WMF
[21:17:28] <wikibugs>	 10serviceops, 10Dumps-Generation, 10MediaWiki-Platform-Team: Migrate WMF production from PHP 7.4 to PHP 8.1 - https://phabricator.wikimedia.org/T319432 (10Milimetric) Hi, #data_products owns dumps now, and so I think we're responsible for the snapshot hosts mentioned in the description here.  Do we have a ti...
[22:22:58] <wikibugs>	 10serviceops, 10Parsoid (Tracking), 10Patch-For-Review: Upgrade nodejs on testreduce1001 - https://phabricator.wikimedia.org/T345220 (10ssastry) Reg the database used for rt-testing T266509 documents what was done for testreduce1001. The db there was local and all of us were given grants for the local db. Do...
[23:50:45] <wikibugs>	 10serviceops, 10AQS2.0, 10Cassandra, 10SRE, 10Service-deployment-requests: AQS 2.0 differentially private pageviews deploy API - https://phabricator.wikimedia.org/T343855 (10Htriedman) Hi all! I've made updates to the codebase to better comply with @Eevans' feedback, resulting in a greatly simplified int...