[06:45:50] 10serviceops, 10SRE, 10Patch-For-Review: Rebuild production Stretch images with GNUTLS/OpenSSL updates for LE issue chain update - https://phabricator.wikimedia.org/T291458 (10Joe) 05In progress→03Resolved [12:50:49] _joe_: I've been poking at different solutions for T263437 and the fanciest one is to have a 'remote collation' via shellbox. [12:51:09] so I have a question for you - what cat I expect to be available in shellbox container? [12:51:37] can I run a MW maintenance script there? can I have php but no MW? [12:52:31] or it's just shell and some binary that uses libicu? [13:03:59] <_joe_> php uses libicu [13:04:14] <_joe_> for some functions in iconv() [13:04:45] <_joe_> and yes, having a binary built with the other version of ICU on a remote container was an idea moritzm and I did consider some time ago [13:07:22] yeah, essentially it would be a rebuild of PHP against a more recent ICU (plus rebuilds of our PHP addons against to rebuilt PHP) [13:11:29] <_joe_> and answering your other question [13:11:39] <_joe_> no mediaiwki in shellbox [13:11:52] <_joe_> but you can send it php functions to eval() IIRC [13:14:05] ok. gotcha. [13:14:26] it just depends how fancy the code's gonna look in MW for doing this [13:14:44] no access to MW - a little less fancy. [13:14:59] I'll share the plan tomorrow after I discuss it all with Tim later today [13:18:48] <_joe_> sure [13:19:15] <_joe_> so for an example of using shellbox to eval php code, see what the constraints shellbox is doing [13:23:19] cool, there's even an example! [13:23:28] thank you [13:31:55] 10serviceops, 10Citoid: zotero paging / serving 5xxes after CPU spikes - https://phabricator.wikimedia.org/T291707 (10Mvolz) >> >> In terms of a get endpoint, would swagger docs suffice? I started to do something like that but never got around to finishing it :/ https://github.com/zotero/translation-server/i... [14:27:47] 10serviceops, 10MediaWiki-General, 10SRE, 10MW-1.35-notes (1.35.0-wmf.28; 2020-04-14), and 5 others: Some pages will become completely unreachable after PHP7 update due to Unicode changes - https://phabricator.wikimedia.org/T219279 (10Pchelolo) Renaming users completed. There's 4 accounts across all sites... [15:59:02] 10serviceops, 10Platform Engineering: Rename articles and users to prepare for PHP 7.3 unicode changes - https://phabricator.wikimedia.org/T292552 (10Pchelolo) [15:59:56] _joe_: So, when are we upgrading to php 7.3? ^^ I need to repeat this whole process again before the upgrade [16:00:02] with page renaming [16:00:10] <_joe_> Pchelolo: yeah I saw [16:00:23] <_joe_> good thing now we have that super refined system that allows us to do such overrides :D [16:01:02] <_joe_> 'ß' => 'SS', is the huge one [16:02:53] 10serviceops, 10Platform Engineering: Rename articles and users to prepare for PHP 7.3 unicode changes - https://phabricator.wikimedia.org/T292552 (10Cabayi) I've just responded to a rename request arising from this. It doesn't appear that any explanation was given to the user affected, just an edit summary le... [16:02:57] up. there's a bunch of them which change to multichar characters [16:03:17] <_joe_> that's a very used construct in gernam [16:03:21] I don't actually know if we support sometihng like this and what assubmptions will this break [16:03:21] <_joe_> *german [16:03:49] <_joe_> that should be take care of by iconv/mbstring [16:03:59] <_joe_> but php's handling of unicode is legendarily bad [16:04:21] <_joe_> I'd ask tim for a refresher, it's too much time I don't look into it for me to remember all the nuances [16:09:53] 10serviceops, 10Platform Engineering: Rename articles and users to prepare for PHP 7.3 unicode changes - https://phabricator.wikimedia.org/T292552 (10Pchelolo) This particular series of renames has not been done yet and will not be done for awhile. The one that's being done is related to T219279. In an unfort... [16:10:16] 10serviceops, 10Platform Engineering: Rename articles and users to prepare for PHP 7.3 unicode changes - https://phabricator.wikimedia.org/T292552 (10Pchelolo) [16:57:20] 10serviceops, 10MediaWiki-General, 10SRE, 10MW-1.35-notes (1.35.0-wmf.28; 2020-04-14), and 5 others: Some pages will become completely unreachable after PHP7 update due to Unicode changes - https://phabricator.wikimedia.org/T219279 (10Pchelolo) Script run finished. We've has some AbuseFilter violations: -... [17:00:56] 10serviceops, 10MediaWiki-General, 10SRE, 10MW-1.35-notes (1.35.0-wmf.28; 2020-04-14), and 5 others: Some pages will become completely unreachable after PHP7 update due to Unicode changes - https://phabricator.wikimedia.org/T219279 (10Pchelolo) In any case it seems like the pages we've failed to rename are... [17:04:46] _joe_: and, https://gerrit.wikimedia.org/r/c/operations/mediawiki-config/+/726623 can be deloyed now and shouldn't break anything [17:05:50] <_joe_> Pchelolo: probably we need to do it now? [17:06:44] <_joe_> it's a bit late here though [17:07:05] <_joe_> but until we merge that change, these users will be unreachable :) [17:07:06] I'll do it, no worries [17:07:22] <_joe_> <3 [17:07:32] reachable if they use the capitalized letter from the start [17:07:42] but yeah, better to do it sooner [17:07:50] <_joe_> right [17:14:46] 10serviceops, 10MediaWiki-General, 10SRE, 10MW-1.35-notes (1.35.0-wmf.28; 2020-04-14), and 5 others: Some pages will become completely unreachable after PHP7 update due to Unicode changes - https://phabricator.wikimedia.org/T219279 (10AntiCompositeNumber) >>! In T219279#7402408, @Pchelolo wrote: > Renaming... [17:19:17] 10serviceops, 10MediaWiki-General, 10SRE, 10MW-1.35-notes (1.35.0-wmf.28; 2020-04-14), and 5 others: Some pages will become completely unreachable after PHP7 update due to Unicode changes - https://phabricator.wikimedia.org/T219279 (10Pchelolo) > Should they be renamed to something else, like was done with... [17:19:33] 10serviceops, 10MediaWiki-General, 10SRE, 10MW-1.35-notes (1.35.0-wmf.28; 2020-04-14), and 5 others: Some pages will become completely unreachable after PHP7 update due to Unicode changes - https://phabricator.wikimedia.org/T219279 (10Tamzin) Was just about to ask this. While rare, there //are// cases of a... [17:27:24] 10serviceops, 10MediaWiki-General, 10SRE, 10MW-1.35-notes (1.35.0-wmf.28; 2020-04-14), and 5 others: Some pages will become completely unreachable after PHP7 update due to Unicode changes - https://phabricator.wikimedia.org/T219279 (10Pchelolo) > with usertalk notes pointing them to Special:GlobalRenameReq... [17:31:14] 10serviceops, 10MediaWiki-General, 10SRE, 10MW-1.35-notes (1.35.0-wmf.28; 2020-04-14), and 5 others: Some pages will become completely unreachable after PHP7 update due to Unicode changes - https://phabricator.wikimedia.org/T219279 (10Legoktm) >>! In T219279#7403003, @Pchelolo wrote: > If someone could be... [17:32:58] 10serviceops, 10MediaWiki-General, 10SRE, 10MW-1.35-notes (1.35.0-wmf.28; 2020-04-14), and 5 others: Some pages will become completely unreachable after PHP7 update due to Unicode changes - https://phabricator.wikimedia.org/T219279 (10Tamzin) >>! In T219279#7403097, @Pchelolo wrote: >> with usertalk notes... [17:36:51] 10serviceops, 10MediaWiki-General, 10SRE, 10MW-1.35-notes (1.35.0-wmf.28; 2020-04-14), and 5 others: Some pages will become completely unreachable after PHP7 update due to Unicode changes - https://phabricator.wikimedia.org/T219279 (10Urbanecm) >>! In T219279#7403110, @Tamzin wrote: >>>! In T219279#7403097... [17:42:41] 10serviceops, 10MediaWiki-General, 10SRE, 10MW-1.35-notes (1.35.0-wmf.28; 2020-04-14), and 5 others: Some pages will become completely unreachable after PHP7 update due to Unicode changes - https://phabricator.wikimedia.org/T219279 (10Tamzin) Ah. That's a shame. You'd think after two renames I'd know that.... [17:42:54] 10serviceops, 10Platform Engineering: Rename articles and users to prepare for PHP 7.3 unicode changes - https://phabricator.wikimedia.org/T292552 (10Pchelolo) [18:16:32] 10serviceops, 10MediaWiki-General, 10SRE, 10MW-1.35-notes (1.35.0-wmf.28; 2020-04-14), and 5 others: Some pages will become completely unreachable after PHP7 update due to Unicode changes - https://phabricator.wikimedia.org/T219279 (10Pchelolo) Ok, we're done with removal of overrides. Now production upper... [18:30:26] 10serviceops, 10MW-on-K8s, 10SRE, 10Traffic, and 2 others: Serve production traffic via Kubernetes - https://phabricator.wikimedia.org/T290536 (10Krinkle) [18:48:47] 10serviceops, 10MW-on-K8s, 10Shellbox: Support large files in Shellbox - https://phabricator.wikimedia.org/T292322 (10Legoktm) @fgiunchedi I'd appreciate your input on how this would potentially interact with swift, specifically: * Can we create separate credentials for a Shellbox to get read-only access to... [19:36:04] 10serviceops, 10MediaWiki-General, 10SRE, 10MW-1.35-notes (1.35.0-wmf.28; 2020-04-14), and 5 others: Some pages will become completely unreachable after PHP7 update due to Unicode changes - https://phabricator.wikimedia.org/T219279 (10Pchelolo) 05Open→03Resolved a:03Pchelolo Ok, re-run the script. Al... [21:25:19] 10serviceops, 10DC-Ops, 10SRE, 10ops-eqiad: Q2: (Need By: TBD) rack/setup/install kubestage100[34].eqiad.wmnet - https://phabricator.wikimedia.org/T290894 (10Jclark-ctr) a:05Jclark-ctr→03Cmjohnson kubestage1003 B1 U21 Port29 Cableid# 201333910847 kubestage1004 D3 U37 Port 32 Cableid#1943 [21:25:34] 10serviceops, 10DC-Ops, 10SRE, 10ops-eqiad: Q2: (Need By: TBD) rack/setup/install kubestage100[34].eqiad.wmnet - https://phabricator.wikimedia.org/T290894 (10Jclark-ctr)