[07:48:06] <wikibugs>	 (03PS1) 10Hashar: tox.ini: whitelist_externals -> allowlist_externals [integration/config] - 10https://gerrit.wikimedia.org/r/955870 (https://phabricator.wikimedia.org/T345695)
[08:01:02] <wikibugs>	 (03PS2) 10Hashar: tox.ini: whitelist_externals -> allowlist_externals [integration/config] - 10https://gerrit.wikimedia.org/r/955870 (https://phabricator.wikimedia.org/T345695)
[08:55:49] <btullis>	 hashar: Thanks for your answers. I'll give it some thought.
[09:02:13] <hashar>	 btullis: which answer? :]
[09:03:16] <btullis>	 hashar: The one about blubber not having an easy way to use variables, but maybe being able to use map merging.
[09:10:49] <hashar>	 btullis: ah yeah that one
[09:10:59] <hashar>	 then the !!merge / >>   is only a draft in the Yaml 1.1 spec
[09:11:06] <hashar>	 and it is not always implemented
[11:15:25] <wikibugs>	 10Phabricator, 10Release-Engineering-Team (Radar), 10collaboration-services: upgrade phab (phorge) hosts to bullseye - https://phabricator.wikimedia.org/T334519 (10LSobanski) We've been running Phorge for two weeks now so it's a good time to revisit this task. The devtools Phorge instance is running Bullseye...
[12:04:58] <wikibugs>	 (03CR) 10Hashar: [C: 03+2] tox.ini: whitelist_externals -> allowlist_externals [integration/config] - 10https://gerrit.wikimedia.org/r/955870 (https://phabricator.wikimedia.org/T345695) (owner: 10Hashar)
[12:05:09] <wikibugs>	 (03CR) 10Hashar: [C: 03+2] dockerfiles: install python3 pip from source v23.2.1 [integration/config] - 10https://gerrit.wikimedia.org/r/955780 (https://phabricator.wikimedia.org/T345607) (owner: 10Hashar)
[12:06:08] <wikibugs>	 (03Merged) 10jenkins-bot: tox.ini: whitelist_externals -> allowlist_externals [integration/config] - 10https://gerrit.wikimedia.org/r/955870 (https://phabricator.wikimedia.org/T345695) (owner: 10Hashar)
[12:06:20] <wikibugs>	 (03Merged) 10jenkins-bot: dockerfiles: install python3 pip from source v23.2.1 [integration/config] - 10https://gerrit.wikimedia.org/r/955780 (https://phabricator.wikimedia.org/T345607) (owner: 10Hashar)
[12:11:57] <hashar>	 !log Building dockerfiles for pip v23.2.1 upgrade | https://gerrit.wikimedia.org/r/955780
[12:11:58] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL
[12:12:13] <wikibugs>	 (03PS1) 10Hashar: jjb: switch tox jobs to pip v23.2.1 [integration/config] - 10https://gerrit.wikimedia.org/r/955919 (https://phabricator.wikimedia.org/T345607)
[12:12:15] <wikibugs>	 (03PS1) 10Hashar: jjb: switch zuul-cloner job to pip v23.2.1 [integration/config] - 10https://gerrit.wikimedia.org/r/955920 (https://phabricator.wikimedia.org/T345607)
[12:12:56] <wikibugs>	 (03PS7) 10Hashar: dockerfiles: upgrade tox to 4.8.0 [integration/config] - 10https://gerrit.wikimedia.org/r/955397 (https://phabricator.wikimedia.org/T345695)
[12:43:19] <wikibugs>	 10Continuous-Integration-Config, 10MediaWiki-Core-Tests, 10Browser-Tests, 10User-zeljkofilipin: Jenkins selenium job should fail when all tests are skipped - https://phabricator.wikimedia.org/T324480 (10Jdforrester-WMF)
[13:01:28] <wikibugs>	 (03PS1) 10Sophivorus: Add new extension ReadAloud [integration/config] - 10https://gerrit.wikimedia.org/r/955930
[13:02:28] <wikibugs>	 (03PS2) 10Jforrester: Zuul: [mediawiki/extensions/ReadAloud] Add basic CI [integration/config] - 10https://gerrit.wikimedia.org/r/955930 (owner: 10Sophivorus)
[13:02:34] <wikibugs>	 (03CR) 10Jforrester: [C: 03+2] Zuul: [mediawiki/extensions/ReadAloud] Add basic CI [integration/config] - 10https://gerrit.wikimedia.org/r/955930 (owner: 10Sophivorus)
[13:03:39] <wikibugs>	 (03CR) 10Jforrester: [C: 03+2] "Deployed." [integration/config] - 10https://gerrit.wikimedia.org/r/955053 (https://phabricator.wikimedia.org/T345660) (owner: 10Jforrester)
[13:04:42] <wikibugs>	 (03Merged) 10jenkins-bot: Zuul: [mediawiki/extensions/ReadAloud] Add basic CI [integration/config] - 10https://gerrit.wikimedia.org/r/955930 (owner: 10Sophivorus)
[13:05:25] <James_F>	 !log Zuul: [mediawiki/extensions/ReadAloud] Add basic CI 
[13:05:30] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL
[13:05:57] <wikibugs>	 (03Merged) 10jenkins-bot: jjb: Move wmf-quibble jobs from npm7 to npm8 again [integration/config] - 10https://gerrit.wikimedia.org/r/955053 (https://phabricator.wikimedia.org/T345660) (owner: 10Jforrester)
[13:23:55] <icinga-wm>	 PROBLEM - Check systemd state on doc2002 is CRITICAL: CRITICAL - degraded: The following units failed: rsync-doc-host-data-sync.service https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state
[13:25:18] <wikibugs>	 10Continuous-Integration-Config, 10Wikidata, 10Wikidata Query Builder, 10Wikidata Query UI, and 6 others: [QB] [WDQS-GUI] Move build scripts from CI to the repository - https://phabricator.wikimedia.org/T328543 (10noarave) @hashar we would appreciate any feedback on the open patches. thank you!
[13:28:07] <wikibugs>	 10Release-Engineering-Team (Priority Backlog 📥), 10Release, 10Train Deployments: 1.41.0-wmf.26 deployment blockers - https://phabricator.wikimedia.org/T343728 (10Lucas_Werkmeister_WMDE) If you see any `wfDeprecated()` warnings regarding `serialize()` or `unserialize()` methods (specifically, on the Wikibase-...
[13:49:56] <wikibugs>	 (03PS1) 10Hashar: jjb: update rest of Java 11 jobs to latest image [integration/config] - 10https://gerrit.wikimedia.org/r/955942 (https://phabricator.wikimedia.org/T338952)
[13:50:26] <wikibugs>	 (03CR) 10Hashar: [C: 03+2] jjb: update rest of Java 11 jobs to latest image [integration/config] - 10https://gerrit.wikimedia.org/r/955942 (https://phabricator.wikimedia.org/T338952) (owner: 10Hashar)
[13:51:59] <wikibugs>	 (03Merged) 10jenkins-bot: jjb: update rest of Java 11 jobs to latest image [integration/config] - 10https://gerrit.wikimedia.org/r/955942 (https://phabricator.wikimedia.org/T338952) (owner: 10Hashar)
[13:52:31] <hashar>	 !log Updated Java and Stretch > Buster  for SonarQube based jobs | https://gerrit.wikimedia.org/r/c/integration/config/+/955942/ | T338952
[13:52:33] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL
[13:52:34] <stashbot>	 T338952: mwaddlink fails to build because of a missing public key - https://phabricator.wikimedia.org/T338952
[13:53:32] <hashar>	 GRRR
[13:54:21] <hashar>	 too late :)
[14:17:28] <wikibugs>	 (03PS1) 10Hnowlan: zuul: add editor-analytics [integration/config] - 10https://gerrit.wikimedia.org/r/955948 (https://phabricator.wikimedia.org/T336391)
[14:18:36] <wikibugs>	 (03CR) 10CI reject: [V: 04-1] zuul: add editor-analytics [integration/config] - 10https://gerrit.wikimedia.org/r/955948 (https://phabricator.wikimedia.org/T336391) (owner: 10Hnowlan)
[14:20:55] <icinga-wm>	 RECOVERY - Check systemd state on doc2002 is OK: OK - running: The system is fully operational https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state
[14:20:59] <wikibugs>	 (03PS1) 10Hnowlan: jjb: add editor-analytics [integration/config] - 10https://gerrit.wikimedia.org/r/955953 (https://phabricator.wikimedia.org/T336391)
[14:52:01] <Lucas_WMDE>	 I have a feeling that CI builds are “Waiting for the completion of castor-save-workspace-cache” a bit longer than usual lately… would it be possible to give castor more resources? (no idea if that even makes sense tbh)
[14:52:05] <Lucas_WMDE>	 e.g. https://integration.wikimedia.org/ci/job/wmf-quibble-selenium-php74-docker/57475/console was in that state for three minutes
[14:54:40] <wikibugs>	 (03CR) 10Lucas Werkmeister (WMDE): [C: 03+1] "Wikidata team is fine with this chain (T180228#9062805)" [integration/config] - 10https://gerrit.wikimedia.org/r/946972 (https://phabricator.wikimedia.org/T220035) (owner: 10Jforrester)
[15:08:04] <wikibugs>	 10Release-Engineering-Team (Priority Backlog 📥), 10Scap, 10Patch-For-Review: scap backport: prompt before merging if another deploy is ongoing - https://phabricator.wikimedia.org/T345247 (10CodeReviewBot) jnuche opened https://gitlab.wikimedia.org/repos/releng/train-dev/-/merge_requests/27  backport tests: a...
[15:08:44] <wikibugs>	 10Release-Engineering-Team (Priority Backlog 📥), 10Scap, 10Patch-For-Review: scap backport: prompt before merging if another deploy is ongoing - https://phabricator.wikimedia.org/T345247 (10CodeReviewBot) jnuche opened https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/179  backport: serialize c...
[15:13:31] <hashar>	 Lucas_WMDE: the job doesn't run concurrently (I can't remember why)
[15:13:40] <hashar>	 and it transfers the whole cache of the job, so maybe those have grown 
[15:13:59] <hashar>	 and indeed there are a lot of them :
[15:14:00] <hashar>	 )
[15:15:21] <hashar>	 the caches are stored on integration-castor05.integration.eqiad1.wikimedia.cloud
[15:15:34] <hashar>	 and `iotop -o` shows rsync using 99% of the available disk io
[15:18:04] <hashar>	 and if I remember well the data is written to an attached volume
[15:18:34] <hashar>	 and of course each time I head to https://grafana.wmcloud.org/d/0g9N-7pVz/cloud-vps-project-board  it is missing the dashboard I am looking for (this time disk io usage)
[15:18:35] <hashar>	 :)
[15:19:44] <hashar>	 ah found it g3.cores8.ram36.disk20
[15:19:58] <hashar>	 it lacks the 4 x increase of disk io that other instancess have
[15:20:11] <hashar>	 so openstack throttles the disk io made to the shared volume / ceph
[15:27:17] <wikibugs>	 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team: Move castor instance to 4xiops disk flavor - https://phabricator.wikimedia.org/T345924 (10hashar)
[15:28:13] <wikibugs>	 (03PS2) 10Jforrester: Zuul: [mediawiki/extensions/Wikibase] Drop legacy Ruby selenium testing [integration/config] - 10https://gerrit.wikimedia.org/r/946972 (https://phabricator.wikimedia.org/T220035)
[15:28:28] <wikibugs>	 (03PS3) 10Jforrester: Zuul: [mediawiki/extensions/Wikibase] Drop legacy Ruby selenium testing [integration/config] - 10https://gerrit.wikimedia.org/r/946972 (https://phabricator.wikimedia.org/T220035)
[15:28:38] <wikibugs>	 (03CR) 10Jforrester: [C: 03+2] Zuul: [mediawiki/extensions/Wikibase] Drop legacy Ruby selenium testing [integration/config] - 10https://gerrit.wikimedia.org/r/946972 (https://phabricator.wikimedia.org/T220035) (owner: 10Jforrester)
[15:31:10] <wikibugs>	 (03Merged) 10jenkins-bot: Zuul: [mediawiki/extensions/Wikibase] Drop legacy Ruby selenium testing [integration/config] - 10https://gerrit.wikimedia.org/r/946972 (https://phabricator.wikimedia.org/T220035) (owner: 10Jforrester)
[15:31:52] <James_F>	 !log Zuul: [mediawiki/extensions/Wikibase] Drop legacy Ruby selenium testing for T220035
[15:31:54] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL
[15:31:55] <stashbot>	 T220035: Drop Ruby Selenium CI jobs; we don't support them any more - https://phabricator.wikimedia.org/T220035
[15:33:13] <wikibugs>	 (03PS2) 10Jforrester: Zuul: [mediawiki/skins/MinervaNeue] Drop legacy Ruby selenium testing [integration/config] - 10https://gerrit.wikimedia.org/r/946973 (https://phabricator.wikimedia.org/T220035)
[15:33:20] <wikibugs>	 (03PS3) 10Jforrester: Zuul: [mediawiki/skins/MinervaNeue] Drop legacy Ruby selenium testing [integration/config] - 10https://gerrit.wikimedia.org/r/946973 (https://phabricator.wikimedia.org/T220035)
[15:33:24] <wikibugs>	 (03CR) 10Jforrester: [C: 03+2] Zuul: [mediawiki/skins/MinervaNeue] Drop legacy Ruby selenium testing [integration/config] - 10https://gerrit.wikimedia.org/r/946973 (https://phabricator.wikimedia.org/T220035) (owner: 10Jforrester)
[15:34:45] <wikibugs>	 10Continuous-Integration-Infrastructure, 10Cloud-VPS (Quota-requests): Request a flavor with elevated iops for integration cache storage - https://phabricator.wikimedia.org/T345925 (10hashar)
[15:34:49] <wikibugs>	 (03Merged) 10jenkins-bot: Zuul: [mediawiki/skins/MinervaNeue] Drop legacy Ruby selenium testing [integration/config] - 10https://gerrit.wikimedia.org/r/946973 (https://phabricator.wikimedia.org/T220035) (owner: 10Jforrester)
[15:35:01] <wikibugs>	 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team: Move castor instance to 4xiops disk flavor - https://phabricator.wikimedia.org/T345924 (10hashar)
[15:35:03] <wikibugs>	 10Continuous-Integration-Infrastructure, 10Cloud-VPS (Quota-requests): Request a flavor with elevated iops for integration cache storage - https://phabricator.wikimedia.org/T345925 (10hashar)
[15:35:22] <wikibugs>	 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team: Move castor instance to 4xiops disk flavor - https://phabricator.wikimedia.org/T345924 (10hashar) a:03hashar > So I guess the easiest is to create a duplicate of the currently used flavor with the 4xiops: g3.cores8.ram36.disk20.4xiops.  Fil...
[15:35:49] <hashar>	 Lucas_WMDE: thank you for the bug report :)  I have file da request to have more disk IO for the castor job :)
[15:36:13] <hashar>	 I don't think it is any urgent, the job has been behaving like that for years
[15:36:29] <hashar>	 (which is something I have missed when I rebuild everything to have 4 x disk io bah)
[15:37:20] <wikibugs>	 (03PS2) 10Jforrester: Zuul: Archive mediawiki/ruby/api and mediawiki/selenium [integration/config] - 10https://gerrit.wikimedia.org/r/946974 (https://phabricator.wikimedia.org/T242293)
[15:37:25] <wikibugs>	 (03PS3) 10Jforrester: Zuul: Archive mediawiki/ruby/api and mediawiki/selenium [integration/config] - 10https://gerrit.wikimedia.org/r/946974 (https://phabricator.wikimedia.org/T242293)
[15:38:45] <wikibugs>	 (03CR) 10CI reject: [V: 04-1] Zuul: Archive mediawiki/ruby/api and mediawiki/selenium [integration/config] - 10https://gerrit.wikimedia.org/r/946974 (https://phabricator.wikimedia.org/T242293) (owner: 10Jforrester)
[15:41:14] <wikibugs>	 (03PS4) 10Jforrester: Zuul: Archive mediawiki/ruby/api and mediawiki/selenium [integration/config] - 10https://gerrit.wikimedia.org/r/946974 (https://phabricator.wikimedia.org/T242293)
[15:46:05] <wikibugs>	 (03PS5) 10Jforrester: Zuul: Archive mediawiki/selenium [integration/config] - 10https://gerrit.wikimedia.org/r/946974 (https://phabricator.wikimedia.org/T242293)
[15:46:12] <wikibugs>	 (03CR) 10Jforrester: [C: 03+2] Zuul: Archive mediawiki/selenium [integration/config] - 10https://gerrit.wikimedia.org/r/946974 (https://phabricator.wikimedia.org/T242293) (owner: 10Jforrester)
[15:47:34] <wikibugs>	 (03Merged) 10jenkins-bot: Zuul: Archive mediawiki/selenium [integration/config] - 10https://gerrit.wikimedia.org/r/946974 (https://phabricator.wikimedia.org/T242293) (owner: 10Jforrester)
[15:52:45] <wikibugs>	 10Release-Engineering-Team (Priority Backlog 📥), 10Scap: scap backport sometimes crashes when running with two stacked patches - https://phabricator.wikimedia.org/T343967 (10dancy) 05Open→03Resolved a:03dancy
[15:54:18] <wikibugs>	 (03PS2) 10Jforrester: jjb: Drop now-unused Ruby/Selenium jobs [integration/config] - 10https://gerrit.wikimedia.org/r/946975 (https://phabricator.wikimedia.org/T220035)
[15:55:49] <wikibugs>	 (03CR) 10Jforrester: [C: 03+2] jjb: Drop now-unused Ruby/Selenium jobs [integration/config] - 10https://gerrit.wikimedia.org/r/946975 (https://phabricator.wikimedia.org/T220035) (owner: 10Jforrester)
[15:56:11] <Daimona>	 James_F: thanks for the release. Shall we spawn LibUp? I can help with the manual fixes & reviews.
[15:56:41] <James_F>	 Daimona: Sadly we can't, LibUp's been down since the start of June.
[15:56:50] <James_F>	 (Yay. :-()
[15:56:53] <Daimona>	 WTF?!
[15:56:54] <wikibugs>	 (03Merged) 10jenkins-bot: jjb: Drop now-unused Ruby/Selenium jobs [integration/config] - 10https://gerrit.wikimedia.org/r/946975 (https://phabricator.wikimedia.org/T220035) (owner: 10Jforrester)
[15:57:30] <James_F>	 The perils of solo-maintainers getting busy and being in the middle of a re-write and re-platform.
[15:57:42] <Daimona>	 Is there a task?
[15:57:49] <James_F>	 Maybe.
[15:57:58] <wikibugs>	 (03PS2) 10Jforrester: Dockerfiles: Drop quibble-buster-php74-bundle, finally unused [integration/config] - 10https://gerrit.wikimedia.org/r/946976 (https://phabricator.wikimedia.org/T220035)
[15:58:04] <wikibugs>	 (03CR) 10Jforrester: [C: 03+2] "Finally!" [integration/config] - 10https://gerrit.wikimedia.org/r/946976 (https://phabricator.wikimedia.org/T220035) (owner: 10Jforrester)
[15:58:47] <James_F>	 https://phabricator.wikimedia.org/T341417 is what triggered the breakage, I think.
[15:59:16] <wikibugs>	 (03Merged) 10jenkins-bot: Dockerfiles: Drop quibble-buster-php74-bundle, finally unused [integration/config] - 10https://gerrit.wikimedia.org/r/946976 (https://phabricator.wikimedia.org/T220035) (owner: 10Jforrester)
[15:59:47] <Daimona>	 I see, thanks
[15:59:47] <James_F>	 {{done}}
[15:59:55] <James_F>	 https://phabricator.wikimedia.org/T345930
[16:34:07] <wikibugs>	 (03PS1) 10Hashar: utils/jjb-diff.sh: emit a changelog for JJB changes [integration/config] - 10https://gerrit.wikimedia.org/r/955971
[16:34:30] <hashar>	 so instead of breaking every single tox jobs on a friday afternoon
[16:35:01] <hashar>	 I have decided to enhance the output of ./utils/jjb-diff.sh and make it craft a changelog of changed/modified/deleted jobs which can be copy pasted in a commit message
[16:35:03] <hashar>	 with ansi coloring!
[16:35:30] <wikibugs>	 (03CR) 10CI reject: [V: 04-1] utils/jjb-diff.sh: emit a changelog for JJB changes [integration/config] - 10https://gerrit.wikimedia.org/r/955971 (owner: 10Hashar)
[16:37:36] <wikibugs>	 (03CR) 10Jforrester: "Fancy!" [integration/config] - 10https://gerrit.wikimedia.org/r/955971 (owner: 10Hashar)
[16:38:44] <wikibugs>	 (03PS2) 10Hashar: utils/jjb-diff.sh: emit a changelog for JJB changes [integration/config] - 10https://gerrit.wikimedia.org/r/955971
[16:40:20] <wikibugs>	 (03CR) 10Hashar: "Example output with https://gerrit.wikimedia.org/r/c/integration/config/+/955972 which deletes/modify/"add" some jobs in beta https://phab" [integration/config] - 10https://gerrit.wikimedia.org/r/955971 (owner: 10Hashar)
[16:40:41] <hashar>	 James_F: I eventually got fed up of copy pasting the `diff -rq` output and manually editing it in vim :)
[16:40:51] <hashar>	 + that version has colors (and I guess some bugs)
[16:40:52] <James_F>	 :-)
[16:40:59] <James_F>	 Probably.
[16:41:01] <hashar>	 https://phabricator.wikimedia.org/F37672586
[16:41:20] <hashar>	 the colors are terrible, but that is what I use locally instead of whatever the defaults are (green/red I guess)
[16:41:37] <hashar>	 anyway, feel free to play with it :]
[16:41:50] <hashar>	 I am off, next week I update the tox jobs tox v4
[16:41:59] * James_F nods.
[16:42:00] <James_F>	 Have fun!
[16:42:03] <hashar>	 then shift to finally work toward upgrading Gerrit to 3.6/3.7 etc :]
[16:42:06] <hashar>	 merry christmas!
[16:42:15] <James_F>	 Did you see we dropped the Ruby Selenium image?
[16:42:22] <hashar>	 OH ARALLY?
[16:42:28] <James_F>	 Yup. :-)
[16:42:29] <James_F>	 Finally.
[16:42:45] <hashar>	 have you managed to convince last users they were to be dropped?
[16:43:01] <hashar>	 I guess we can then archive the ruby selenium repository finally
[16:43:04] <James_F>	 WMDE agreed that they were about to re-write the UX and didn't want to learn them from scratch.
[16:43:05] <hashar>	 next thing: drop jsduck :]
[16:43:15] <James_F>	 Already archived. :-)
[16:43:21] <James_F>	 And yes, jsduck next.
[16:43:22] <James_F>	 But I still can't get the quibble Bullseye images to build locally. :-(
[16:43:24] * hashar sends some cookies
[16:43:25] <James_F>	 Ah well.
[16:43:42] <hashar>	 you should bubble up that achievement somewhere, that is a great milestone
[16:43:47] <hashar>	 (ruby selenium)
[16:44:02] <hashar>	 jsduck I am tempted to eventually drop it as everything is moved to bullseye
[16:44:12] <hashar>	 with a hard deadline like:  in X months, jsduck is gone.
[16:44:18] <hashar>	 we shall see
[16:44:33] <hashar>	 we can carry the obsolete images for a while, so I guess there is no rush
[16:44:38] <hashar>	 I am off for real now!  /waves
[16:44:42] * James_F waves.
[18:10:48] <wikibugs>	 10GitLab (Integrations), 10Phabricator, 10Release-Engineering-Team (Escape Goats🐐), 10Patch-For-Review: Get GitLab to render `T{\d}+` in MR overviews, comments, etc. as links to Phabricator - https://phabricator.wikimedia.org/T337570 (10CodeReviewBot) dduvall merged https://gitlab.wikimedia.org/repos/relen...
[18:36:47] <wikibugs>	 10Project-Admins: Create project tag for Event-Discovery - https://phabricator.wikimedia.org/T345938 (10ifried)
[18:37:25] <wikibugs>	 10Project-Admins, 10Campaign-Tools: Create project tag for Event-Discovery - https://phabricator.wikimedia.org/T345938 (10ifried)
[20:39:25] <wikibugs>	 10Beta-Cluster-Infrastructure, 10Dumps-Generation, 10MediaWiki-ContentHandler, 10Patch-For-Review: XMLDumps broken on deployment-mwmaint02 due to Jade Extension related content - https://phabricator.wikimedia.org/T345874 (10Ladsgroup) We can also just delete all the pages or clear them or set the content m...