[07:59:38] 10serviceops, 10MediaWiki-extensions-Linter, 10Platform Engineering, 10WMF-JobQueue: Linter jobs are running slowly - https://phabricator.wikimedia.org/T299302 (10Legoktm) p:05Triage→03High [08:00:14] 10serviceops, 10MediaWiki-extensions-Linter, 10Platform Engineering, 10WMF-JobQueue: Linter jobs are running slowly - https://phabricator.wikimedia.org/T299302 (10Legoktm) This was also reported at https://en.wikipedia.org/wiki/Wikipedia_talk:Linter#Linter_slow [08:11:27] 10serviceops, 10MediaWiki-extensions-Linter, 10Platform Engineering, 10WMF-JobQueue: Linter jobs are running slowly - https://phabricator.wikimedia.org/T299302 (10Joe) I think the task title is inaccurate. Specifically: * The processing rate remained the same * The processing *time* remained the same, eve... [08:36:07] 10serviceops, 10MediaWiki-extensions-Linter, 10Platform Engineering, 10WMF-JobQueue, 10Patch-For-Review: Linter jobs are running slowly - https://phabricator.wikimedia.org/T299302 (10Joe) We're now reducing the number of backlogged items at a rate of 25k/minute. At this pace, the backlog should be back n... [08:45:11] 10serviceops, 10MediaWiki-extensions-Linter, 10Platform Engineering, 10WMF-JobQueue, 10Patch-For-Review: Linter jobs are running slowly - https://phabricator.wikimedia.org/T299302 (10Legoktm) Some graphs for posterity: >>! In T299302#7624516, @Joe wrote: > Specifically: > * The processing rate remained... [17:42:16] 10serviceops, 10MediaWiki-extensions-Linter, 10Platform Engineering, 10WMF-JobQueue, 10Patch-For-Review: Linter jobs are running slowly - https://phabricator.wikimedia.org/T299302 (10Joe) 05Open→03Resolved a:03Joe The backlog has been recovered; tomorrow I'll lower the concurrency for such jobs.