[00:51:42] <ori>	 what would it take to have a portable performance test with a workload that approximates WMF production?
[00:56:19] <ori>	 I'm thinking about this in light of the mw-k8s roll out. I assume it makes it even more complicated to run experiments and measure things directly on app servers.
[00:59:48] <ori>	 I think at one point, MaxSem had a repo with a basic mediawiki instance with scribunto/luasandbox and maybe a few other extensions, and an export of the Barack Obama article from enwiki and its various dependencies
[02:28:09] <Krinkle>	 ori: yeah, I think upstream php.net also had a benchmark of sorts, but MediaWiki's been suspiciously absent from the last few release pages that include benchmarks. I reached out to the php 8.0 release manager (Sara Golemon, pollita), and I think I know who to reach out to for next time.
[02:32:44] <Krinkle>	 a "good" setup with e.g. apcu, memc, php-fpm, luasandbox, various MW extensions, and parsercache/maincache enabled. and then benchmarkParse.php with opcache.enable_cli=1 for measuring "edits" and e.g. the same Obama page behind parser cache to measure "page views" would be great as two metrics, and to then be able to iterate on that between MW releases and/or PHP releases. 
[02:32:59] <Krinkle>	 want to file a task?
[03:26:36] <ori>	 sure
[04:13:25] <ori>	 T347660
[04:13:25] <stashbot>	 T347660: Portable performance test representative of Wikimedia's production environment - https://phabricator.wikimedia.org/T347660
[04:13:38] <ori>	 not sure I picked the right tags, please edit as you see fit