[00:01:39] 10Fundraising Tech - Chaos Crew: Recurring job triggering recurring failmail - https://phabricator.wikimedia.org/T327174 (10AnnWF) By https://gerrit.wikimedia.org/r/c/wikimedia/fundraising/crm/+/881456, https://gerrit.wikimedia.org/r/c/wikimedia/fundraising/crm/+/881476, and https://gerrit.wikimedia.org/r/c/wiki... [00:02:24] (03CR) 10CI reject: [V: 04-1] Update DonationInterface submodule [core] (fundraising/REL1_39) - 10https://gerrit.wikimedia.org/r/881726 (owner: 10Ejegg) [00:05:34] (03Merged) 10jenkins-bot: Update DonationInterface submodule [core] (fundraising/REL1_35) - 10https://gerrit.wikimedia.org/r/881727 (owner: 10Ejegg) [00:11:07] Hi ejegg: for this swap HR to adyen https://gerrit.wikimedia.org/r/c/mediawiki/extensions/DonationInterface/+/881725/ patch, could we add T327207 to this comment? I tested with https://localhost:9001/index.php?title=Special:GatewayChooser&amount=10&country=HR&recurring=false&payment_method=cc&debug=true, looks good to plus 2 [00:11:08] T327207: Move Croatia to Adyen as default - https://phabricator.wikimedia.org/T327207 [00:24:21] 10Fundraising Sprint Bridge over troubled Wifi, 10Fundraising-Backlog, 10FR-dlocal, 10MediaWiki-extensions-DonationInterface: Add extra field for some countries if create payment with dlocal smartfield - https://phabricator.wikimedia.org/T326976 (10Cstone) a:03Cstone [00:29:37] 10Fundraising Sprint Bridge over troubled Wifi, 10Fundraising-Backlog, 10FR-dlocal, 10MediaWiki-extensions-DonationInterface: Add extra field for some countries if create payment with dlocal smartfield - https://phabricator.wikimedia.org/T326976 (10Cstone) We should see what address fields donors in India... [00:58:20] will do wfan [00:59:01] (03PS4) 10Ejegg: Swap Croatia (HR) to Adyen and EUR [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/881725 (https://phabricator.wikimedia.org/T327207) [01:03:54] that 10 minute timeout was the default value since the explicit timeout was removed [01:04:02] I just added back a 28 minute timeout [01:04:39] (03CR) 10Wfan: "LGTM, tested with https://localhost:9001/index.php?title=Special:GatewayChooser&amount=10&country=HR&recurring=false&payment_method=cc&deb" [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/881725 (https://phabricator.wikimedia.org/T327207) (owner: 10Ejegg) [01:05:26] thanks wfan ! [01:05:37] (03CR) 10Wfan: [C: 03+2] Swap Croatia (HR) to Adyen and EUR [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/881725 (https://phabricator.wikimedia.org/T327207) (owner: 10Ejegg) [01:07:30] (03Merged) 10jenkins-bot: Swap Croatia (HR) to Adyen and EUR [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/881725 (https://phabricator.wikimedia.org/T327207) (owner: 10Ejegg) [01:07:39] ok, I'm going to push out those gatewaychooser and adyen script load order changes [01:10:16] oh shoot, looks like the last payments deploy had all the tests in DonationInterface [01:10:41] I guess someone pointed to the master branch of the submodule? [01:11:52] that makes it hard to tell what exactly is newly going out right now... [01:12:04] !log payments-wiki upgraded from fcb9ab60 to 3cf03933 [01:12:06] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [01:19:49] wfan: want to merge this one too? https://gerrit.wikimedia.org/r/c/wikimedia/fundraising/SmashPig/+/830927 [01:20:02] then I could move a ticket to done [01:20:23] this is merged? [01:21:23] ohhh sorry I still had the window open from before [01:21:26] thanks again! [01:21:37] OK, I will tag SmashPig and update the version number [01:25:45] (03PS1) 10Ejegg: Update SmashPig requirement to 0.8.3.15 [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/881730 [01:25:48] (03CR) 10Ejegg: [C: 03+2] Update SmashPig requirement to 0.8.3.15 [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/881730 (owner: 10Ejegg) [01:26:29] (03CR) 10CI reject: [V: 04-1] Update SmashPig requirement to 0.8.3.15 [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/881730 (owner: 10Ejegg) [01:27:14] (03CR) 10Ejegg: [C: 03+2] "recheck" [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/881730 (owner: 10Ejegg) [01:27:27] (03PS1) 10Ejegg: Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - 10https://gerrit.wikimedia.org/r/881731 [01:29:04] (03Merged) 10jenkins-bot: Update SmashPig requirement to 0.8.3.15 [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/881730 (owner: 10Ejegg) [01:33:31] hmm is there an out of control query [01:33:52] (03PS1) 10Ejegg: Update DonationInterface submodule [core] (fundraising/REL1_35) - 10https://gerrit.wikimedia.org/r/881734 [01:33:57] why cstone ? [01:34:06] oh i see [01:34:08] deadlock emails [01:34:17] let's look [01:34:18] Yeah, seeing Aborting! Previous process (31253) is still alive. Remove lockfile manually if in error: /tmp/donations_queue_consume.lock again, let me check the log file [01:34:41] the recurring fail is deadlock [01:34:55] user 272 is doing some heavy deduping [01:35:00] oh god haha [01:35:03] show processlist haha [01:35:20] couple of the queries are at 1210 seconds 1082 seconds [01:35:35] so those bigguns aren't going to return to the UI [01:35:43] let's terminate em [01:36:27] oh yeah, and the 'full processlist' is just screenfulls of IDs [01:36:37] I think we have 27mins, why so many log as "Reached time limit of 585 seconds" [01:36:58] wfan for the recurring charge job? [01:37:05] yep [01:37:08] hmm, odd [01:37:11] let met look [01:37:13] oh for others [01:37:24] sorry, for orphan slayer [01:37:36] recurring error is a deadlock [01:37:43] ah ok wfan, we have a different timeout in that job [01:37:50] we do not have any log for recurring one yet [01:38:10] ok cstone maybe we just kill the rest of the long dedupe queries? [01:38:22] how are you seeing them in a nice way [01:38:32] just 'show processlist' [01:38:36] ahhh haha [01:38:38] instead of 'show full processlist' [01:38:48] ok im gona update these notes too with that [01:39:02] only way I know they're dedupe in the truncated version is that it's inserting into a civicrm_tmp_e_dedupe_blahblahblah table [01:40:02] (03CR) 10Ejegg: [C: 03+2] Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - 10https://gerrit.wikimedia.org/r/881731 (owner: 10Ejegg) [01:40:42] (03Merged) 10jenkins-bot: Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - 10https://gerrit.wikimedia.org/r/881731 (owner: 10Ejegg) [01:43:20] whats the point of this magic bar on the mac if i cant get it to suggest the emoji i want :P [01:46:00] I was seeing "SELECT COUNT(*) FROM civicrm.civicrm_contribution JOIN civicrm.wmf_contribution_extra ON civicrm_con" from that show processlist and now it's gone, did we kill the job already? [01:46:13] ejegg: I guess im still confused why did that recurring job time out after 10 minutes [01:46:31] yeah wfan [01:47:08] right, there is another failmail as time out after 10 mins~ also feel wired, since we have 27 mins... and I moved the ticket to done already hahahaha, should I move it back? [01:47:50] i think ejegg fixed it? [01:51:17] (03CR) 10Ejegg: [C: 03+2] Update DonationInterface submodule [core] (fundraising/REL1_35) - 10https://gerrit.wikimedia.org/r/881734 (owner: 10Ejegg) [01:54:25] cstone wfan oh yep, that 10 min timeout was just a warning from process-control [01:54:42] because we had deleted the timeout in the yaml and it defaulted to 10 [01:55:00] !log payments-wiki upgraded from 3cf03933 to 3d882ac7 [01:55:02] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [01:56:26] woo, Croatians can now donate via Adyen [01:56:41] ejegg: thanks, another thing do we have https://gerrit.wikimedia.org/r/c/wikimedia/fundraising/process-control/+/880965/ this one deployed, I see jack has Tone down the LockError exception message at process-control [01:57:03] 10Fundraising Sprint Bridge over troubled Wifi, 10Fundraising-Backlog: Move Croatia to Adyen as default - https://phabricator.wikimedia.org/T327207 (10Ejegg) a:03Ejegg [01:58:53] Also thanks for update the timeout to 28 mins, will update this step to that ticket also [02:04:23] wfan ah yeah, someone needs to rebuild the debian package for process-control to deploy that one [02:04:33] I think maybe fr-tech-ops has taken over that task? [02:04:41] It's been a long time since I had to do it [02:04:53] ok then let's move that ticket back to pending deployment~ [02:08:37] 10Fundraising Tech - Chaos Crew, 10fundraising-tech-ops: Recurring job triggering recurring failmail - https://phabricator.wikimedia.org/T327174 (10AnnWF) [02:16:42] (03CR) 10Wfan: [C: 03+2] Replace creation date with booking date for the payments accounting report [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/879690 (https://phabricator.wikimedia.org/T326254) (owner: 10Cstone) [02:37:23] grr, something is definitely chmod -w ing src/civi-sites/wmff/drupal/sites/default [02:37:29] in the install script I bet [02:37:37] I mean, it's a good safety measure [02:37:48] maybe we should rm -f it [02:38:00] oh we do use -f [02:38:07] ehh [02:41:45] (03PS4) 10Ejegg: Preload third party script for google and dlocal [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/881013 (https://phabricator.wikimedia.org/T326975) (owner: 10Wfan) [02:41:57] (03CR) 10Ejegg: [C: 03+2] "Thanks, this works!" [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/881013 (https://phabricator.wikimedia.org/T326975) (owner: 10Wfan) [02:43:35] 10Fundraising Sprint Bridge over troubled Wifi, 10Fundraising Tech - Chaos Crew, 10Fundraising-Backlog, 10FR-dlocal, and 2 others: Make sure gateway script fully loaded first for Dlocal, Adyen Checkout and Google - https://phabricator.wikimedia.org/T326975 (10Ejegg) Oh I see, Amazon doesn't need it because... [02:43:49] (03Merged) 10jenkins-bot: Preload third party script for google and dlocal [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/881013 (https://phabricator.wikimedia.org/T326975) (owner: 10Wfan) [02:58:53] (03PS1) 10Ejegg: Mark CardPaymentProvider as implementing IPaymentProvider [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/881740 [03:04:48] (03PS2) 10Ejegg: Handle card submission in DLocal in DonationInterface [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/881719 (https://phabricator.wikimedia.org/T324290) (owner: 10Damilare Adedoyin) [03:04:50] (03PS1) 10Ejegg: Show fiscal number on DLocal forms where needed [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/881741 [03:05:10] (03PS2) 10Ejegg: Show fiscal number on DLocal forms where needed [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/881741 [03:05:59] (03CR) 10CI reject: [V: 04-1] Handle card submission in DLocal in DonationInterface [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/881719 (https://phabricator.wikimedia.org/T324290) (owner: 10Damilare Adedoyin) [03:06:01] (03CR) 10CI reject: [V: 04-1] Show fiscal number on DLocal forms where needed [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/881741 (owner: 10Ejegg) [03:07:54] (03CR) 10Ejegg: "Thanks for thinking of this! I just saw this as a merge conflict on this other patch to just start with the same fields as the old API ne" [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/881739 (https://phabricator.wikimedia.org/T326976) (owner: 10Cstone) [03:08:17] sure ejegg [03:09:07] (03CR) 10Cstone: [C: 03+2] Show fiscal number on DLocal forms where needed [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/881741 (owner: 10Ejegg) [03:09:11] :) thank you! [03:09:34] OK, I guess we should be testing with Brazil or some other LATAM country, since they don't really do US [03:09:48] I'll add versions of all the old AstroPay links for DLocal [03:09:59] should be an easy copypaste :) [03:10:04] when i added the fiscal number to the IN form that pan explain showed up and i was like oh right that [03:10:31] ahhh [03:10:43] oh hey, those main_page links still have ffname all over [03:10:46] lemme kill that too [03:10:52] (03Merged) 10jenkins-bot: Show fiscal number on DLocal forms where needed [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/881741 (owner: 10Ejegg) [03:12:03] (03PS1) 10Ejegg: Remove obsolete ffname from mainpage links [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/881742 [03:13:03] (03PS2) 10Cstone: WIP: Add address fields for ZA and IN [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/881739 (https://phabricator.wikimedia.org/T326976) [03:13:46] (03PS3) 10Cstone: WIP: Add address fields for ZA and IN [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/881739 (https://phabricator.wikimedia.org/T326976) [03:14:36] oh man, smartfields have annoying tab focus - need to tab twice to get into each of them [03:15:29] hmm i dont see it doing that [03:15:55] oh maybe it's only in FF? Lemme try chrome [03:17:00] (03PS1) 10Ejegg: More DLocal links, remove one obsolete thing [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/881743 [03:21:44] im gona head out ejegg have a good weekend! [03:25:58] (03CR) 10Ejegg: "Looks like we'll need to add all of the variables in the 'authorize' request to the var_map.yaml (even if they are just name: name) in ord" [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/881719 (https://phabricator.wikimedia.org/T324290) (owner: 10Damilare Adedoyin) [03:26:17] you too cstone [03:30:25] (03PS2) 10Ejegg: Mark CardPaymentProvider as implementing IPaymentProvider [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/881740 [03:30:50] (03CR) 10CI reject: [V: 04-1] Mark CardPaymentProvider as implementing IPaymentProvider [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/881740 (owner: 10Ejegg) [03:37:43] oh derp [03:38:34] (03PS3) 10Ejegg: Mark CardPaymentProvider as implementing IPaymentProvider [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/881740 [03:39:30] (03PS2) 10Ejegg: More DLocal links, remove one obsolete thing [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/881743 [04:19:24] (03PS1) 10Wfan: check deadline exist before get timeRemaining from it to avoid undefined [extensions/CentralNotice] - 10https://gerrit.wikimedia.org/r/881385 (https://phabricator.wikimedia.org/T318103) [04:21:25] (03CR) 10CI reject: [V: 04-1] check deadline exist before get timeRemaining from it to avoid undefined [extensions/CentralNotice] - 10https://gerrit.wikimedia.org/r/881385 (https://phabricator.wikimedia.org/T318103) (owner: 10Wfan) [04:25:09] (03PS2) 10Wfan: check deadline exist before get timeRemaining from it to avoid undefined [extensions/CentralNotice] - 10https://gerrit.wikimedia.org/r/881385 (https://phabricator.wikimedia.org/T318103) [04:27:15] (03CR) 10CI reject: [V: 04-1] check deadline exist before get timeRemaining from it to avoid undefined [extensions/CentralNotice] - 10https://gerrit.wikimedia.org/r/881385 (https://phabricator.wikimedia.org/T318103) (owner: 10Wfan) [04:28:23] (03PS3) 10Wfan: check deadline exist before get timeRemaining from it to avoid undefined [extensions/CentralNotice] - 10https://gerrit.wikimedia.org/r/881385 (https://phabricator.wikimedia.org/T318103) [05:16:43] (03PS5) 10Wfan: Add cc as payment_method default in general for old gateway link that contains no payment_method. [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/876044 (https://phabricator.wikimedia.org/T140269) [05:18:22] (03CR) 10CI reject: [V: 04-1] Add cc as payment_method default in general for old gateway link that contains no payment_method. [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/876044 (https://phabricator.wikimedia.org/T140269) (owner: 10Wfan) [10:03:59] 10Fundraising-Backlog: fundraising-dev: email prefs showing internal error after fresh install - https://phabricator.wikimedia.org/T327480 (10jgleeson) [10:04:10] 10Fundraising Tech - Chaos Crew, 10Fundraising-Backlog: fundraising-dev: email prefs showing internal error after fresh install - https://phabricator.wikimedia.org/T327480 (10jgleeson) [10:14:47] (03PS1) 10Jgleeson: Update DonutWiki (local DonateWiki) URL to point to usual donate wiki form. [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/881833 [10:30:57] (03CR) 10Jgleeson: [V: 03+2 C: 03+2] "LGTM!" [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/881742 (owner: 10Ejegg) [10:31:13] (03CR) 10Jgleeson: [V: 03+2 C: 03+2] "New links working good for me, thanks!" [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/881743 (owner: 10Ejegg) [10:41:48] (03CR) 10Jgleeson: [C: 03+2] "I thought we were doing this already on this class. good spot!" [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/881740 (owner: 10Ejegg) [10:42:19] (03Merged) 10jenkins-bot: Mark CardPaymentProvider as implementing IPaymentProvider [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/881740 (owner: 10Ejegg) [10:44:14] (03CR) 10Jgleeson: "Once we get these last couple of apache updates in, can we tag fundraising-dev version 1? Feels like a complete version at that point." [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/877281 (owner: 10Ejegg) [10:46:48] (03CR) 10Jgleeson: "Can we do the TODO now as part of this work? I worry it won't get done if we don't do it now and end up on the TODOs that got away pile." [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/879134 (owner: 10Ejegg) [11:07:26] (03PS3) 10Damilare Adedoyin: WIP: Handle card submission in DLocal in DonationInterface [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/881719 (https://phabricator.wikimedia.org/T324290) [11:08:54] (03CR) 10CI reject: [V: 04-1] WIP: Handle card submission in DLocal in DonationInterface [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/881719 (https://phabricator.wikimedia.org/T324290) (owner: 10Damilare Adedoyin) [11:47:46] (03CR) 10Jgleeson: [C: 03+2] "Working well for me! It took slightly longer than expected to follow it through as the first call to the UnstagingHelper sent in the strin" [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/879138 (owner: 10Ejegg) [11:49:40] (03Merged) 10jenkins-bot: Use ReferenceData to unstage Ingenico submethod [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/879138 (owner: 10Ejegg) [11:53:11] (03PS5) 10Damilare Adedoyin: Handle errors from DLocal SmartForms [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/880528 (https://phabricator.wikimedia.org/T324272) [11:58:19] (03CR) 10Damilare Adedoyin: "Thanks ejegg for the review. I've made the changes and also left a comment about the span rendering inline." [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/880528 (https://phabricator.wikimedia.org/T324272) (owner: 10Damilare Adedoyin) [12:04:26] 10Fundraising Tech - Chaos Crew, 10fundraising-tech-ops: Recurring job triggering recurring failmail - https://phabricator.wikimedia.org/T327174 (10jgleeson) Thanks @AnnWF! [14:49:27] 10Fundraising Tech - Chaos Crew, 10Fundraising-Backlog, 10FR-Docker: fundraising-dev: email prefs showing internal error after fresh install - https://phabricator.wikimedia.org/T327480 (10Aklapper) [15:54:49] 10Fundraising-Backlog, 10fr-donorservices: Not able to cancel recurring donations from Civi - https://phabricator.wikimedia.org/T327517 (10SHust) [15:55:53] 10Fundraising-Backlog, 10fr-donorservices: Not able to cancel recurring donations from Civi - https://phabricator.wikimedia.org/T327517 (10SHust) p:05Triage→03Unbreak! [15:57:20] 10Fundraising-Backlog, 10fr-donorservices: Not able to cancel recurring donations from Civi - https://phabricator.wikimedia.org/T327517 (10SHust) Changed to 'Unbreak Now!' [15:59:04] looking ^ [15:59:55] 10Fundraising-Backlog, 10fr-donorservices: Not able to cancel recurring donations from Civi - https://phabricator.wikimedia.org/T327517 (10jgleeson) Thanks @SHust, we're looking into this now [16:01:33] 10Fundraising-Backlog, 10fr-donorservices: Not able to cancel recurring donations from Civi - https://phabricator.wikimedia.org/T327517 (10SHust) We can't seem to be able to update emails in the contacts as well... Not sure if this is related or not but I did add a dedupe rule 'Address and name (General)'. I'm... [16:03:03] I just asked on Slack if anyone is around to demo/discuss the issue [16:03:09] of the UBN ^ [16:04:40] https://meet.google.com/ksg-mnkt-buh [16:17:43] that 'Database Locked' popup is pretty scary [16:17:54] btw fr-tech the UBN is fixed [16:18:12] it was a runaway query related to a dedupe rule [16:19:50] yeah thanks much jgleeson damilare :) [16:21:07] yeah it was, thankfully we were able to catch it early enough [16:21:22] yep! [16:21:31] yeah great work! [16:21:59] I wonder if we should get an email when one of those "Database Locked" popups happen [16:22:11] sorry I wasn't around sooner... didn't sleep well so had a quick snooze after getting the youth off to school [16:22:15] seems like we did get some related failmails [16:22:28] I wish there were a way to just prevent it from happening.......... [16:22:33] np AndyRussG, it was a quiet day till then [16:22:43] heheh ahh cool [16:23:19] 10Fundraising Tech - Chaos Crew, 10Fundraising-Backlog, 10fr-donorservices: Dedupe query under certain rules no longer generating queries - https://phabricator.wikimedia.org/T326605 (10SHust) https://phabricator.wikimedia.org/T327517 --> related [16:23:41] 10Fundraising-Backlog, 10fr-donorservices: Not able to cancel recurring donations from Civi - https://phabricator.wikimedia.org/T327517 (10jgleeson) This is fixed. Looked to be related to a runaway dedupe rule query ` | 9814612 | civicrm | - | civicrm | Query | 2946 | Sending data | /* User : 272 */INSERT... [16:24:24] wow all those failmails from a dedupe query [16:24:48] 2023-01-20 16:07:37,446 ERROR CRM_Core_Exception: [0: Database lock encountered [16:29:48] Hey fr-tech there was also a runaway dedupe last night [16:30:03] heyy cstone hmmm [16:30:52] hey cstone [16:32:56] it would be good to try and prevent those with some type minimum filter requirements [16:33:38] I feel like I've seen that style of thing before on CRMs [16:34:55] https://www.mediawiki.org/wiki/Cli [16:37:40] 10Fundraising-Backlog, 10Desktop Improvements (Vector 2022), 10MediaWiki-extensions-CentralNotice: Site notice for Vector 2022 is sometimes not possible to dismiss - https://phabricator.wikimedia.org/T327505 (10AndyRussG) [16:37:53] ^ seems worth looking at [16:38:53] 10Fundraising-Backlog, 10fr-donorservices: Not able to cancel recurring donations from Civi - https://phabricator.wikimedia.org/T327517 (10jgleeson) 05Open→03Resolved [16:39:14] 10Fundraising Tech - Chaos Crew, 10Fundraising-Backlog, 10fr-donorservices: Not able to cancel recurring donations from Civi - https://phabricator.wikimedia.org/T327517 (10jgleeson) [17:02:24] 10Fundraising-Backlog, 10Desktop Improvements (Vector 2022), 10MediaWiki-extensions-CentralNotice: Site notice for Vector 2022 is sometimes not possible to dismiss - https://phabricator.wikimedia.org/T327505 (10spatton) My javascript isn't great so someone else should review this but in case it's helpful: I... [18:08:32] 10Fundraising-Backlog, 10Desktop Improvements (Vector 2022), 10MediaWiki-extensions-CentralNotice: Site notice for Vector 2022 is sometimes not possible to dismiss - https://phabricator.wikimedia.org/T327505 (10Pcoombe) 05Open→03Resolved a:03Pcoombe Thanks @spatton, that definitely looks like the issue... [18:08:35] 10Fundraising-Backlog: Adding a new tag for Ingenico transactions to avoid fees - https://phabricator.wikimedia.org/T327533 (10EMartin) [18:26:08] (03PS4) 10Cstone: Add address fields for ZA and IN [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/881739 (https://phabricator.wikimedia.org/T326976) [19:43:14] 10Fundraising Sprint Amazing grep, 10Fundraising Sprint Vwl Cnsrvtn, 10Fundraising Sprint Wibbly Wobbly Timey Wimey, 10Fundraising-Backlog, and 2 others: Figure out storage implications of varchar vs text in possible logging solution - https://phabricator.wikimedia.org/T325789 (10Jgreen) @Eileenmcnaughton... [20:59:58] (03PS6) 10Wfan: Add cc as payment_method default in general for old gateway link that contains no payment_method. [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/876044 (https://phabricator.wikimedia.org/T140269) [21:01:45] (03CR) 10CI reject: [V: 04-1] Add cc as payment_method default in general for old gateway link that contains no payment_method. [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/876044 (https://phabricator.wikimedia.org/T140269) (owner: 10Wfan) [21:09:50] (03PS4) 10Damilare Adedoyin: WIP: Handle card submission in DLocal in DonationInterface [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/881719 (https://phabricator.wikimedia.org/T324290) [21:09:58] 10fundraising-tech-ops: reimage fundraising queue role servers to Bullseye - https://phabricator.wikimedia.org/T327453 (10Dwisehaupt) [21:11:00] (03CR) 10CI reject: [V: 04-1] WIP: Handle card submission in DLocal in DonationInterface [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/881719 (https://phabricator.wikimedia.org/T324290) (owner: 10Damilare Adedoyin) [21:15:08] 10fundraising-tech-ops: reimage fundraising queue role servers to Bullseye - https://phabricator.wikimedia.org/T327453 (10Dwisehaupt) There were some issues with metric collection. With the new prometheus redis exporter some metrics changed names and the previous metric was removed from output. Dashboards were u... [21:17:27] (03PS5) 10Damilare Adedoyin: WIP: Handle card submission in DLocal in DonationInterface [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/881719 (https://phabricator.wikimedia.org/T324290) [21:19:08] (03CR) 10CI reject: [V: 04-1] WIP: Handle card submission in DLocal in DonationInterface [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/881719 (https://phabricator.wikimedia.org/T324290) (owner: 10Damilare Adedoyin) [22:18:25] (03PS7) 10Wfan: Add cc as payment_method default in general for old gateway link that contains no payment_method. [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/876044 (https://phabricator.wikimedia.org/T140269) [22:20:13] (03CR) 10jenkins-bot: Add cc as payment_method default in general for old gateway link that contains no payment_method. [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/876044 (https://phabricator.wikimedia.org/T140269) (owner: 10Wfan) [22:42:49] (03PS6) 10Damilare Adedoyin: WIP: Handle card submission in DLocal in DonationInterface [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/881719 (https://phabricator.wikimedia.org/T324290) [22:44:41] (03CR) 10CI reject: [V: 04-1] WIP: Handle card submission in DLocal in DonationInterface [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/881719 (https://phabricator.wikimedia.org/T324290) (owner: 10Damilare Adedoyin) [22:47:50] (03PS8) 10Wfan: Add cc as payment_method default in general for old gateway link that contains no payment_method. [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/876044 (https://phabricator.wikimedia.org/T140269) [22:50:59] (03CR) 10Damilare Adedoyin: [C: 03+2] "Thanks for this, looks good to me." [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/881739 (https://phabricator.wikimedia.org/T326976) (owner: 10Cstone) [22:52:42] (03Merged) 10jenkins-bot: Add address fields for ZA and IN [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/881739 (https://phabricator.wikimedia.org/T326976) (owner: 10Cstone)