[06:35:17] <wikibugs>	 (03CR) 10CI reject: [V:04-1] Localisation updates from https://translatewiki.net. [extensions/DonationInterface] (REL1_41) - 10https://gerrit.wikimedia.org/r/1041955 (owner: 10L10n-bot)
[06:52:07] <wikibugs>	 06Fundraising-Backlog: Scoping: 2nd Recurring Failure Email in Civi - https://phabricator.wikimedia.org/T365488#9883185 (10MSuijkerbuijk_WMF) @AKanji-WMF confirming that the content doc is now ready with the right sender (Sandra) as per above details
[10:13:31] <wikibugs>	 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Civi related - donor status and donor segment fields in Civi - https://phabricator.wikimedia.org/T367276 (10RLewis) 03NEW
[11:50:59] <wikibugs>	 (03PS29) 10Damilare Adedoyin: Gravy create payment [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1037776 (https://phabricator.wikimedia.org/T364506)
[11:51:23] <wikibugs>	 (03CR) 10CI reject: [V:04-1] Gravy create payment [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1037776 (https://phabricator.wikimedia.org/T364506) (owner: 10Damilare Adedoyin)
[11:52:08] <wikibugs>	 (03PS30) 10Damilare Adedoyin: Gravy create payment [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1037776 (https://phabricator.wikimedia.org/T364506)
[12:02:54] <wikibugs>	 (03PS14) 10Damilare Adedoyin: Add donor creation request [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1041627
[13:46:25] <ejegg>	 Ughhh, trying to delete a batch of *8* contributions in SQL and it's still not happy
[13:46:32] <ejegg>	 been like a minute already
[13:47:31] <wikibugs>	 (03PS1) 10Damilare Adedoyin: Fix dlocal audit fallback error [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1042259
[13:49:39] <ejegg>	 ok, 5 minutes now
[13:49:54] <ejegg>	 that'll be causing queue failmail, won't it
[13:50:10] <ejegg>	 killing the query
[13:58:03] <wikibugs>	 (03CR) 10Ejegg: [C:03+2] Fix dlocal audit fallback error [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1042259 (owner: 10Damilare Adedoyin)
[14:01:05] <ejegg>	 so... I guess I queue up 35k deletes via the API?
[14:04:59] <damilare>	 thanks for the cr ejegg 
[14:12:37] <ejegg>	 sure thing!
[14:18:38] <wikibugs>	 (03Merged) 10jenkins-bot: Fix dlocal audit fallback error [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1042259 (owner: 10Damilare Adedoyin)
[14:22:48] <wikibugs>	 (03PS1) 10Damilare Adedoyin: Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1042272
[14:32:46] <wikibugs>	 (03CR) 10Damilare Adedoyin: [C:03+2] Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1042272 (owner: 10Damilare Adedoyin)
[14:33:29] <wikibugs>	 (03Merged) 10jenkins-bot: Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1042272 (owner: 10Damilare Adedoyin)
[14:59:47] <wikibugs>	 (03PS1) 10Damilare Adedoyin: Fix dlocal audit fallback assumption that all payments are card payments [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1042289
[15:03:42] <wikibugs>	 (03CR) 10Ejegg: [C:03+2] Fix dlocal audit fallback assumption that all payments are card payments [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1042289 (owner: 10Damilare Adedoyin)
[15:10:58] <wikibugs>	 (03PS1) 10Ejegg: Clean up bad donations one by one [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1042293 (https://phabricator.wikimedia.org/T365519)
[15:16:06] <ejegg>	 OK fr-tech those commented-out API helpers seem to work fine ^^^
[15:16:22] <ejegg>	 ah let me smoketest one more time with the weight added
[15:17:54] <wikibugs>	 (03PS8) 10Damilare Adedoyin: Create gravy special page and load components [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1040198 (https://phabricator.wikimedia.org/T364508)
[15:19:59] <wikibugs>	 (03CR) 10CI reject: [V:04-1] Create gravy special page and load components [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1040198 (https://phabricator.wikimedia.org/T364508) (owner: 10Damilare Adedoyin)
[15:21:31] <ejegg>	 oh and I could take that extra logging out
[15:23:11] <wikibugs>	 (03PS2) 10Ejegg: Clean up bad donations one by one [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1042293 (https://phabricator.wikimedia.org/T365519)
[15:29:39] <wikibugs>	 (03Merged) 10jenkins-bot: Fix dlocal audit fallback assumption that all payments are card payments [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1042289 (owner: 10Damilare Adedoyin)
[15:33:58] <wikibugs>	 (03PS1) 10Damilare Adedoyin: Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1042300
[15:36:04] <wikibugs>	 (03PS3) 10Ejegg: Clean up bad donations one by one [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1042293 (https://phabricator.wikimedia.org/T365519)
[15:39:29] <wikibugs>	 (03CR) 10Damilare Adedoyin: [C:03+2] Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1042300 (owner: 10Damilare Adedoyin)
[15:40:16] <wikibugs>	 (03Merged) 10jenkins-bot: Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1042300 (owner: 10Damilare Adedoyin)
[16:01:51] <wikibugs>	 (03CR) 10Damilare Adedoyin: [C:03+2] Clean up bad donations one by one [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1042293 (https://phabricator.wikimedia.org/T365519) (owner: 10Ejegg)
[16:07:19] <wikibugs>	 (03PS1) 10Damilare Adedoyin: Not all card responses contain card_id [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1042304
[16:21:43] <wikibugs>	 (03Merged) 10jenkins-bot: Clean up bad donations one by one [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1042293 (https://phabricator.wikimedia.org/T365519) (owner: 10Ejegg)
[16:24:13] <wikibugs>	 06Fundraising-Backlog: Need to not autocancel recurring iDEAL/SEPA chargebacks - https://phabricator.wikimedia.org/T366769#9885477 (10Dwisehaupt)
[16:31:39] <ejegg>	 thanks for the review damilare !
[16:35:43] <ejegg>	 hmm, I guess I'll wait till after lunch to deploy that
[16:36:00] <ejegg>	 damilare: it's ok if that goes out (in case you need to do another deploy for the audit)
[16:36:13] <ejegg>	 we can just hold off running the extension upgrades till I'm back at the keyboard
[16:47:55] <damilare>	 yep ejegg|food, I just have that one patch but it can wait till you're back
[16:48:06] <damilare>	 https://gerrit.wikimedia.org/r/1042304
[18:11:21] <wikibugs>	 (03PS9) 10Damilare Adedoyin: Create gravy special page and load components [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1040198 (https://phabricator.wikimedia.org/T364508)
[18:13:28] <wikibugs>	 (03CR) 10CI reject: [V:04-1] Create gravy special page and load components [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1040198 (https://phabricator.wikimedia.org/T364508) (owner: 10Damilare Adedoyin)
[18:14:33] <wikibugs>	 (03CR) 10Ejegg: [C:03+2] Not all card responses contain card_id [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1042304 (owner: 10Damilare Adedoyin)
[18:14:38] <wikibugs>	 (03PS2) 10Damilare Adedoyin: Not all card responses contain card_id [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1042304
[18:14:43] <wikibugs>	 (03CR) 10Ejegg: [V:03+2 C:03+2] Not all card responses contain card_id [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1042304 (owner: 10Damilare Adedoyin)
[18:15:12] <wikibugs>	 (03PS1) 10Ejegg: Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1042330
[18:15:18] <wikibugs>	 (03CR) 10Ejegg: [C:03+2] Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1042330 (owner: 10Ejegg)
[18:16:05] <wikibugs>	 (03Merged) 10jenkins-bot: Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1042330 (owner: 10Ejegg)
[18:24:08] <ejegg>	 !log fundraising civicrm upgraded from 955166d1 to 76857844
[18:24:10] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log
[18:24:16] <ejegg>	 ok, gonna kick off the deletions
[18:30:28] <wikibugs>	 06Fundraising-Backlog: Determining from which banner an RML donation originated - https://phabricator.wikimedia.org/T318887#9886140 (10KHaggard) 05Open→03Resolved Chiming in here after syncing with Eric. The data stored in Civi were clarified and Eric was able to get the data requested from Joseph, so we...
[18:32:11] <ejegg>	 seems to be getting through multiple ones per second!
[18:34:23] <ejegg>	 yep, bogon count steadily dropping with no deadlocks so far
[18:34:58] <cstone>	 wooo ejegg 
[18:36:45] <wikibugs>	 14Fundraising Sprint Turtles that are robotic that destroy the whole world with their foot theory, 06Fundraising-Backlog: Adding and storing rml_source data for RML donations reporting - https://phabricator.wikimedia.org/T321163#9886178 (10KHaggard) Hi @AKanji-WMF - sorry for the delay getting back to you.  I...
[18:37:28] <ejegg>	 so it'll be about 8 hours to get them all
[18:56:23] <cstone>	 anilk: what do you think about pulling this into the sprint https://phabricator.wikimedia.org/T341247 ? Mariana is looking at email cancellation stats and I am sure we will want that more in the future but we wont have them unless we are tying cancellations to something
[19:35:22] <wikibugs>	 (03PS1) 10Umherirrender: Use namespaced classes [extensions/CentralNotice] - 10https://gerrit.wikimedia.org/r/1042358
[19:36:06] <wikibugs>	 06Fundraising-Backlog, 10FR-donorservices, 10Recurring-Donations: Enable drop-down menu for DR to indicate recurring cancel reason - https://phabricator.wikimedia.org/T341247#9886377 (10Cstone) @SHust is there a most common cancel reason you want autoselected by default? then the others would be available in...
[19:55:21] <wikibugs>	 (03CR) 10DannyS712: [C:03+2] Use namespaced classes [extensions/CentralNotice] - 10https://gerrit.wikimedia.org/r/1042358 (owner: 10Umherirrender)
[20:01:01] <wikibugs>	 06Fundraising-Backlog, 10FR-donorservices, 10Recurring-Donations: Enable drop-down menu for DR to indicate recurring cancel reason - https://phabricator.wikimedia.org/T341247#9886470 (10SHust) @Cstone if a default reason is required the 'Other and Unspecified' would be the one. Thanks for asking!
[20:06:21] <wikibugs>	 06Fundraising-Backlog, 10wikimediafoundation.org: Update donation links on wikimediafoundation.org to use wmf_ parameters - https://phabricator.wikimedia.org/T367357 (10Pcoombe) 03NEW
[20:06:53] <wikibugs>	 06Fundraising-Backlog, 10Wikimedia-Portals, 07Epic: Update donation links on Portal to use wmf_ parameters - https://phabricator.wikimedia.org/T367358 (10Pcoombe) 03NEW
[20:06:59] <wikibugs>	 06Fundraising-Backlog, 10Wikimedia-Portals: Update donation links on Portal to use wmf_ parameters - https://phabricator.wikimedia.org/T367358#9886506 (10Pcoombe)
[20:07:24] <wikibugs>	 06Fundraising-Backlog, 07Epic, 10MW-1.43-notes (1.43.0-wmf.7; 2024-05-28): Rename utm_ URL parameters through donatewiki and paymentswiki - https://phabricator.wikimedia.org/T351325#9886508 (10Pcoombe)
[20:12:36] <wikibugs>	 (03PS2) 10Ejegg: Don't queue a job for ended autorescue [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1041185
[20:13:01] <wikibugs>	 (03CR) 10CI reject: [V:04-1] Don't queue a job for ended autorescue [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1041185 (owner: 10Ejegg)
[20:14:05] <wikibugs>	 06Fundraising-Backlog, 06Wikipedia-Android-App-Backlog, 06Wikipedia-iOS-App-Backlog: Update donation links in apps to use wmf_ parameters - https://phabricator.wikimedia.org/T367360 (10Pcoombe) 03NEW
[20:14:05] <wikibugs>	 (03PS3) 10Ejegg: Don't send ProcessCaptureRequestJob for ended autorescue [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1041185
[20:16:39] <wikibugs>	 06Fundraising-Backlog, 10FR-donorservices, 10Recurring-Donations: Enable drop-down menu for DR to indicate recurring cancel reason - https://phabricator.wikimedia.org/T341247#9886563 (10Cstone) @SHust For Other and Unspecified would just having no reason make more sense? I think it would align more with our...
[20:16:43] <ejegg>	 cstone: can you remind me where we are changing the contribution_recur status on failed autorescue?
[20:17:09] <wikibugs>	 06Fundraising-Backlog: Update web sidebar donation links to use wmf_ parameters - https://phabricator.wikimedia.org/T367361 (10Pcoombe) 03NEW
[20:21:17] <wikibugs>	 (03Merged) 10jenkins-bot: Use namespaced classes [extensions/CentralNotice] - 10https://gerrit.wikimedia.org/r/1042358 (owner: 10Umherirrender)
[20:25:46] <wikibugs>	 (03PS1) 10Damilare Adedoyin: make sure only Authorized payments are pulled from logs [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1042364
[20:28:13] <wikibugs>	 06Fundraising-Backlog, 07Epic, 10MW-1.43-notes (1.43.0-wmf.7; 2024-05-28): Rename utm_ URL parameters through donatewiki and paymentswiki - https://phabricator.wikimedia.org/T351325#9886611 (10Pcoombe)
[20:29:21] <wikibugs>	 06Fundraising-Backlog, 07Epic, 10MW-1.43-notes (1.43.0-wmf.7; 2024-05-28): Rename utm_ URL parameters through donatewiki and paymentswiki - https://phabricator.wikimedia.org/T351325#9886613 (10Pcoombe) 05Open→03Resolved a:03Pcoombe Closing this, the main work is done and I sent an email to fr-all e...
[20:30:17] <wikibugs>	 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: Civi / Adyen mismatch re: recurring retries - https://phabricator.wikimedia.org/T365519#9886620 (10MBeat33) Thanks so much for the group @Ejegg. @SHust and I will concentrate on reaching out to the one-time donors in it, and trust Civi to email the recurr...
[20:36:05] <cstone>	 ejegg: did you find it, I think its right in the failure part of the recurring charge 
[20:36:31] <cstone>	 or failed as in final status?
[20:41:29] <damilare>	 ejegg: here's the patch to streamline the grep: https://gerrit.wikimedia.org/r/1042364
[20:42:13] <damilare>	 I'd complete the import tomorrow, hopefully that should get the other recurrings in.
[20:46:27] <ejegg>	 cstone: sorry, I saw some processing on the IPN jobs but it seemed like it wasn't doing the right thing. Tried removing it in this patch https://gerrit.wikimedia.org/r/1041185
[20:46:40] <ejegg>	 but are we sending a subscr_cancel to the recurring queue at some point?
[20:46:45] <ejegg>	 looking dami
[20:47:02] <wikibugs>	 (03CR) 10Ejegg: [C:03+2] make sure only Authorized payments are pulled from logs [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1042364 (owner: 10Damilare Adedoyin)
[20:48:10] <cstone>	 ejegg: like it failed with fraud?
[20:51:08] <ejegg>	 cstone no, just it ran out of retries
[20:51:18] <ejegg>	 don't we want to cancel the recurring at that point?
[20:51:48] <ejegg>	 like we used to do after 3 failed charges with the old retry logic
[20:51:53] <cstone>	 ahh okay i see
[20:53:56] <cstone>	 it should be either in the recurring queue or whatever queue we moved it to?
[20:54:20] <ejegg>	 ok, but we would need to send that from the IPN listener, wouldn't we?
[20:54:26] <ejegg>	 Are we actually doing that yet?
[20:55:28] <cstone>	 theres cancel reasons somewhere hmm
[20:55:53] <wikibugs>	 06Fundraising-Backlog, 06Wikipedia-Android-App-Backlog, 06Wikipedia-iOS-App-Backlog: Update donation links in apps to use wmf_ parameters - https://phabricator.wikimedia.org/T367360#9886718 (10Tsevener) Options:  1. iOS changes looking for `utm_source` in campaign urls to `wmf_source` instead. 2. iOS instead...
[20:58:27] <ejegg>	 the only thing I see being pushed to the recurring queue in all of the Adeyn folder is that one subscr_payment when $this->isSuccessfulAutoRescue
[20:59:00] <ejegg>	 so I'm thinking we may have a lot of recurrings that should be cancelled at this point
[20:59:24] <cstone>	 hmmmm
[20:59:42] <ejegg>	 unless we're picking up those final failures on the audit someplace?
[21:00:27] <ejegg>	 anyway, i was looking for that because i was thinking i needed to do one more cleanup step from my boolean bug
[21:01:04] <ejegg>	 i.e. cancel recurrings who got to the end of the line
[21:02:13] <cstone>	 	Payment cannot be rescued: Blocked Card theres ones with cancel reasons like this 
[21:02:17] <cstone>	 but thats the inital
[21:03:50] <ejegg>	 ok, this looks like the ticket: https://phabricator.wikimedia.org/T340159
[21:05:05] <cstone>	 133641227 was cancelled after a bunch of attempts?
[21:05:16] <ejegg>	 ah interesting, let's see how that happened
[21:05:37] <ejegg>	 is that a contribution ID?
[21:06:01] <cstone>	 oooh wait its not cancelled hmm
[21:08:01] <cstone>	 why does it have a cancelled reason
[21:08:17] <cstone>	 no it is cancelled
[21:09:17] <wikibugs>	 (03Merged) 10jenkins-bot: make sure only Authorized payments are pulled from logs [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1042364 (owner: 10Damilare Adedoyin)
[21:09:59] <cstone>	 did it not actually cancel then like you are seeing but we are giving it a cancel reason?
[21:10:13] <cstone>	 wait it says status cancelled but the UI says in progress?
[21:10:46] <ejegg>	 odd
[21:11:09] <ejegg>	 so that looks like an initial attempt
[21:11:11] <ejegg>	 from the log
[21:11:14] <cstone>	 ok i think im just super confused
[21:11:24] <cstone>	 maybe what I thought i searched on adyen was not it
[21:11:26] <ejegg>	 i.e. we got the response back in realtime from the API
[21:11:40] <ejegg>	 I don't think that ever went into 'pending'
[21:11:54] <ejegg>	 yeah, select * from log_civicrm_contribution_recur where id=1298694;
[21:12:36] <ejegg>	 shows that it was in status 2, then flipped to 14 (processing), then to 3
[21:12:42] <cstone>	 ok that one i said failed out on the first api call then on may 7  and was cancelled may 7
[21:13:21] <ejegg>	 so all that happened within a couple sec
[21:13:58] <ejegg>	 yeah, what I want to know is how do we cancel one that goes into autorescue / pending, but after a few tries Adyen tells us they can't make it work
[21:14:05] <ejegg>	 and I think we're just not handling that
[21:14:07] <cstone>	 so are you saying we never actually cancelled it when it fails after all the attenpts?
[21:14:11] <ejegg>	 yeah
[21:14:19] <cstone>	 is adyen actually saying it wont work?
[21:14:32] <ejegg>	 should have been done as part of https://phabricator.wikimedia.org/T340164 maybe
[21:14:59] <ejegg>	 cstone: adyen is giving up after a bunch of tries and saying they're ending the attempt
[21:15:20] <ejegg>	 so I think we don't want to waste our time / reputation by trying to charge again the next month
[21:15:52] <cstone>	 yeah like they send us some end of attempts message?
[21:15:56] <ejegg>	 yeah they do
[21:16:12] <ejegg>	 and for some reason we're currently just sending them a 'cancel auth' API call
[21:16:35] <ejegg>	 which isn't really helpful, so I'm removing it in this patch: https://gerrit.wikimedia.org/r/1041185
[21:17:04] <wikibugs>	 06Fundraising-Backlog, 10FR-donorservices, 10Recurring-Donations: Enable drop-down menu for DR to indicate recurring cancel reason - https://phabricator.wikimedia.org/T341247#9886763 (10AMJohnson) Sorry to hop in @SHust. Feel free to add if I'm missing anything!   @Cstone - Kristie and I put together this li...
[21:17:25] <ejegg>	 I think I'll add a follow-on patch to send that subscr_cancel message
[21:17:30] <ejegg>	 ok, gotta pick up my kid!
[21:44:02] <dwisehaupt>	 i'm doing to shift the thank you sending back to using both frmx hosts evenly.
[21:59:34] <dwisehaupt>	 ok. verified mail is flowing through both as desired.
[22:05:59] <greg-g>	 +1
[22:25:24] <anilk>	 cstone: that would be nice - Yes, Mariana was talking about this in another call today too (cancel stats). Seems like there's good momentum, am just wary of our need to focus on payment integration.  https://phabricator.wikimedia.org/T341247 - XenoRyet what do you think?
[22:35:03] <wikibugs>	 06Fundraising-Backlog: Compliance requirement re:  account validation for ACH - https://phabricator.wikimedia.org/T367078#9886889 (10EMartin) I have spoken to Gr4vy about this requirement and trying to solve for it through our connection to them.
[23:15:03] <wikibugs>	 06Fundraising-Backlog, 10fundraising-tech-ops, 10observability: Shift frack alerting to use alertmanager instead of icinga - https://phabricator.wikimedia.org/T367370 (10Dwisehaupt) 03NEW
[23:26:48] <wikibugs>	 06Fundraising-Backlog, 10FR-donorservices, 10Recurring-Donations: Enable drop-down menu for DR to indicate recurring cancel reason - https://phabricator.wikimedia.org/T341247#9887005 (10Cstone) Thanks for the info @AMJohnson ! We have complete control of how the dropdown works so we can make it do whatever i...
[23:27:36] <wikibugs>	 06Fundraising-Backlog, 10fundraising-tech-ops, 10observability: Shift frack alerting to use alertmanager instead of icinga - https://phabricator.wikimedia.org/T367370#9887010 (10Dwisehaupt) In the puppet-private repo: commit f94d1d4501e54136766722074b6821502213ccc1 staged on `T367370_prom_alerts` branch for...