[09:13:44] I see that openjdk-11 is set to never migrate out of unstable ( https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=1023237 ) which may explain why the bug hasn't been fixed [09:16:58] <_joe_> Emperor: I think it's ok to just work around it indeed [09:34:44] openjdk-11 sees regular updates in sid, though. it's used as the basis for the backport to oldstable (and some Ubuntu releases with Java 11) [09:36:11] they tend to require new dependencies for their test suite fairly often, I think we've updated jtreg in oldstable/stable multiple times at this point [09:36:27] and the next Java 11 release will require yet another version bump [09:42:32] I do think it'd be worth poking the java team about https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=955619 and/or marking it as RC and affecting other versions too (if I read the CI logs right, openjdk-17-jre-headless has the same issue), particularly given the fix isn't hard [09:48:37] 10serviceops, 10MediaWiki-DjVu, 10Shellbox, 10Wikimedia-production-error: RuntimeException: firejail is enabled, but cannot be found - https://phabricator.wikimedia.org/T352515 (10hashar) [09:53:32] if we reach out, then best to Vladimir Petko , he handles significant parts of the Java maintenance in Debian/Ubuntu these days [10:18:22] <_joe_> hashar: uh i thought we did configure djvu to use shellbox for everything BUT commons [10:23:57] _joe_: I know nothing about shellbox unfortunately :-( [10:25:37] that task I filed was someone uploading a djvu file to frwikisource and MediaWiki tries to run djvudump on it from the local context [10:25:50] I don't understand much more :-\ [10:25:54] <_joe_> hashar: sure I got it [10:26:08] <_joe_> I'm not contesting it happened, I'm surprised it did :P [10:26:19] _joe_: https://gerrit.wikimedia.org/r/c/mediawiki/core/+/720143 apparently tried that but got reverted [10:27:13] <_joe_> taavi: oh ok i missed that second part [10:28:16] <_joe_> Amir1: ^^ we might need to reintroduce that patch and find out what was wrong there [10:31:54] 10serviceops, 10MediaWiki-DjVu, 10Shellbox, 10Wikimedia-production-error: RuntimeException: firejail is enabled, but cannot be found - https://phabricator.wikimedia.org/T352515 (10Joe) p:05Triage→03High [10:43:00] 10serviceops, 10MediaWiki-DjVu, 10Shellbox, 10Wikimedia-production-error: RuntimeException: firejail is enabled, but cannot be found - https://phabricator.wikimedia.org/T352515 (10Joe) The problem is apparently https://phabricator.wikimedia.org/T289228#7588412 [10:57:36] _joe_: Volans knows the detals [10:57:51] <_joe_> Amir1: uh what? [10:57:54] <_joe_> volans: then you :P [10:57:58] Ah actually nvm [10:58:10] I thought it was about yesterday's patch [10:58:14] lol [10:58:15] <_joe_> Amir1: I wanted to understand [10:58:21] I know nothing about this one :D [10:58:27] <_joe_> is the problem that caused the revert contained to CLI? [10:58:39] <_joe_> because in that case I'd reintroduce the code behind a feature flag [10:58:51] <_joe_> and disable it by default on cli [10:59:09] It was two years ago. I need to dig. I don't remember 🤦‍♂️ [10:59:22] <_joe_> I'm sorry to ask you but it's pretty important [10:59:55] <_joe_> this must have slipped through the cracks when kunal left [11:01:44] Sure I'll do it right now once I wake up properly [11:10:10] 10serviceops, 10MediaWiki-DjVu, 10Shellbox, 10Wikimedia-production-error: RuntimeException: firejail is enabled, but cannot be found - https://phabricator.wikimedia.org/T352515 (10Joe) p:05High→03Unbreak! Changing to UBN! because even if the frequency is low enough right now, this is a user-visible error. [12:19:49] 10serviceops, 10MediaWiki-DjVu, 10Shellbox, 10Wikimedia-production-error: RuntimeException: firejail is enabled, but cannot be found - https://phabricator.wikimedia.org/T352515 (10Joe) So the context is that there was a problem on CLI when running maint scripts with the move of DjVu to shellbox. One quick... [13:03:02] 10serviceops, 10Data-Engineering (Sprint 5), 10Event-Platform: [Event Platform] eventgate-wikimedia occasionally fails to produce events due schema fetch errors - https://phabricator.wikimedia.org/T350713 (10lbowmaker) 05Open→03Resolved [13:03:17] 10serviceops, 10MediaWiki-DjVu, 10Shellbox, 10Wikimedia-production-error: RuntimeException: firejail is enabled, but cannot be found - https://phabricator.wikimedia.org/T352515 (10Joe) According to logstash, this has happened 9 times in the last month, all on wikisource. So it is a user-facing problem but... [13:25:42] 10serviceops, 10Data-Platform-SRE, 10Discovery-Search (Current work): Enable mediawiki.cirrussearch.page_rerender.v1 on all public wikis - https://phabricator.wikimedia.org/T351503 (10pfischer) [15:56:09] 10serviceops, 10MediaWiki-DjVu, 10Shellbox, 10Structured-Data-Backlog, 10Wikimedia-production-error: RuntimeException: firejail is enabled, but cannot be found - https://phabricator.wikimedia.org/T352515 (10MSantos) Adding #structured-data-backlog as per https://www.mediawiki.org/wiki/Developers/Maintainers [15:58:51] 10serviceops, 10Dumps-Generation, 10Infrastructure-Foundations, 10SRE-tools, 10IPv6: Some Service Operations clusters apparently do not support IPv6 - https://phabricator.wikimedia.org/T271142 (10akosiaris) [16:02:50] 10serviceops, 10Dumps-Generation, 10Infrastructure-Foundations, 10SRE-tools, 10IPv6: Some Service Operations clusters apparently do not support IPv6 - https://phabricator.wikimedia.org/T271142 (10akosiaris) @Volans, since dumpsdata[1001-1003].eqiad.wmnet and snapshot[1005-1010].eqiad.wmnet are no longe... [16:29:24] ugh [16:29:29] I totally forgot that it was reverted [16:29:34] sorry :( [16:34:59] 10serviceops, 10Dumps-Generation, 10Infrastructure-Foundations, 10SRE-tools, 10IPv6: Some Service Operations clusters apparently do not support IPv6 - https://phabricator.wikimedia.org/T271142 (10Volans) @akosiaris I see that: * `mw[1349-1413]` * `mw[2259-2376]` * `mc[2042-2055]` * `parse[2001-2020]` a... [16:54:06] <_joe_> legoktm: not your fault heh [17:00:39] <_joe_> legoktm: I tried actualizing the patch adding a feature guard