[01:16:34] <wikibugs>	 10serviceops, 10SRE: Package php 7.4 for wikimedia production - https://phabricator.wikimedia.org/T293449 (10Legoktm)
[01:32:07] <wikibugs>	 10serviceops: Migrate WMF Production from PHP 7.2 to PHP 7.4 - https://phabricator.wikimedia.org/T271736 (10Legoktm)
[01:32:16] <wikibugs>	 10serviceops, 10SRE: Package php 7.4 for wikimedia production - https://phabricator.wikimedia.org/T293449 (10Legoktm) 05Open→03Resolved All packages listed have been uploaded, I ran core's parser tests and PHPUnit tests against the new PHP 7.4 packages and all passed. Note that for everything, you need to...
[05:01:11] <_joe_>	 legoktm: oh you already built all packages? 
[05:01:25] <_joe_>	 <3
[05:01:45] <_joe_>	 I'll take a look at the puppet code today then
[10:36:06] <wikibugs>	 10serviceops: Build MediaWiki images for kubernetes based on php 7.4 - https://phabricator.wikimedia.org/T293996 (10Joe)
[10:36:26] <wikibugs>	 10serviceops, 10Release-Engineering-Team: Build MediaWiki images for kubernetes based on php 7.4 - https://phabricator.wikimedia.org/T293996 (10Joe)
[13:49:12] <ottomata>	 hiya is this incorrect now?
[13:49:13] <ottomata>	 https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate/Administration#Recreate_all_k8s_pods_(AKA_full_service_restart)
[13:49:18] <ottomata>	 helmfile -e eqiad sync --args --recreate-pods
[13:49:24] <ottomata>	   Error: unknown flag: --recreate-pods
[13:51:02] <_joe_>	 ottomata: yes it is
[13:51:48] <_joe_>	 I made it work as follows: helmfile -e eqiad --state-values-set  roll_restart=1 sync
[13:52:07] <_joe_>	 I added a way to set recreatePods: true via the cli
[13:55:17] <ottomata>	 k coo thank you will update docs
[13:56:26] <_joe_>	 ottomata: not 100% sure that hack was propagated to the eventgate charts though, lemme check
[13:56:46] <_joe_>	     recreatePods: {{ if (hasKey .Environment.Values "roll_restart") }}{{ eq .Environment.Values.roll_restart "1" }}{{ else }}false{{end}}
[13:56:48] <_joe_>	 yep
[16:59:58] <legoktm>	 _joe_: yep, rebuilding everything was mostly straightforward
[17:20:17] <wikibugs>	 10serviceops, 10Analytics, 10Analytics-Kanban, 10Data-Engineering, 10Event-Platform: Enable envoy tls proxy logging from eventgate - https://phabricator.wikimedia.org/T291856 (10Ottomata) 05Open→03Resolved
[17:59:57] <wikibugs>	 10serviceops, 10Citoid, 10VisualEditor, 10Editing-team (FY2021-22 Kanban Board), 10User-JosefineHellrothLarssonWMSE: Automatic citation generation using ISBN on Wikipedia doesn't work - https://phabricator.wikimedia.org/T294010 (10Dzahn)
[18:01:42] <mutante>	 citoid was somewhat broken because the key it uses to access WorldCat expired/stopped working
[18:01:59] <mutante>	 they created a new key, I replaced it in private repo, they re-deployed, works again
[18:09:40] <wikibugs>	 10serviceops, 10Citoid, 10VisualEditor, 10Editing-team (FY2021-22 Kanban Board), 10User-JosefineHellrothLarssonWMSE: Automatic citation generation using ISBN on Wikipedia doesn't work - https://phabricator.wikimedia.org/T294010 (10Mvolz) Thank you to @Dazhn in ops for rotating the keys! It looks all fixe...
[18:18:00] <wikibugs>	 10serviceops, 10MW-on-K8s, 10SRE, 10MW-1.37-notes (1.37.0-wmf.20; 2021-08-23), and 2 others: Make HTTP calls work within mediawiki on kubernetes - https://phabricator.wikimedia.org/T288848 (10Legoktm) Thanks to other activity, I realized my patch didn't cover MultiHttpClient, which is used by Echo for cros...
[20:55:52] <wikibugs>	 10serviceops, 10Performance-Team, 10Developer Productivity: Update php-wmerrors page to include request ID - https://phabricator.wikimedia.org/T291192 (10Krinkle) For posterity:  | Before | After |--|-- | {F34644964 height=225} | {F34705242 height=230}
[22:54:40] <bd808>	 https://phabricator.wikimedia.org/T294072 -- Kubernetes emitting ProbeWarning events for toolhub-main container -- I haven't looked at this much beyond a web search. If anybody has a "Oh yeah, you need to X in your chart" solution that would be awesome.
[23:00:56] <wikibugs>	 10serviceops, 10Prod-Kubernetes, 10Kubernetes: setup/install kubestage100[34] - https://phabricator.wikimedia.org/T293729 (10Dzahn) Want help with this? I / we could put OS and role on it, see if any puppet issues, then meet with you to go through the actual adding-to-the-cluster part in a shared session. We...