[00:04:23] and the sun has set 40 minutes early [00:04:54] wow [00:05:10] crazy when those forest fires speed up the earth's rotation! [00:05:15] haha [00:05:16] (jk) [00:06:04] also crazy when you can get both forest fire smoke and flooding at the same time........ [00:09:53] yeah haha [00:10:12] weve gotten 7 inches of rain at my weather station since july 1 and thats with 0 rain from the hurriance [00:16:44] ahhh that's a lot [00:25:40] here weather has been suspiciously normal [00:41:41] 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Dedupe failmail - something odd with the api call - https://phabricator.wikimedia.org/T286967 (10Eileenmcnaughton) [01:01:31] I have found 2 problems causing that dedupe failmail [01:01:40] (fixing either one fixes but will try to fix both) [01:02:21] it's all to do with ... 🚂 [01:02:54] 🚂 🚂 🚂 ? [01:02:55] haha uh oh [01:03:02] hopefully not my train address [01:06:39] emojiiiiii [01:09:55] (03CR) 10Ejegg: "let's make this gateway agnostic. also a suggestion for making the code a little more compact." (032 comments) [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/705518 (https://phabricator.wikimedia.org/T286739) (owner: 10Cstone) [01:11:19] thanks for that patch cstone! I got a bit pulled away from work today but I'm back at the keyboard for now, hopefully to figure out the failing tests on my patch [01:11:41] thanks for looking at it ejegg [01:26:30] (03PS1) 10Eileen: Fix failing dedupe job [wikimedia/fundraising/crm/civicrm] - 10https://gerrit.wikimedia.org/r/705520 (https://phabricator.wikimedia.org/T286967) [01:27:00] 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Dedupe failmail - something odd with the api call - https://phabricator.wikimedia.org/T286967 (10Eileenmcnaughton) OK - the error is in the code intended to prevent utf8mb4 queries on dbs that don't support uf8mb4 - fixes coming through https://github.c... [01:29:25] 10Fundraising Sprint Mandatory corn dogs, 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Dedupe failmail - something odd with the api call - https://phabricator.wikimedia.org/T286967 (10Eileenmcnaughton) [01:29:41] 10Fundraising Sprint Mandatory corn dogs, 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10Unplanned-Sprint-Work: Dedupe failmail - something odd with the api call - https://phabricator.wikimedia.org/T286967 (10Eileenmcnaughton) [01:44:02] (03PS3) 10Ejegg: Add processor_contact_id to SmashPig createPayment [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/704884 (https://phabricator.wikimedia.org/T286739) [01:44:47] ok cstone i figured it out. We were setting a value for the recur.invoice_id in the tests and I had assumed it was all null. ^^^ [01:50:37] fix for failmail above (705520) [01:56:02] nice eileen [02:01:04] Yay for both [02:05:10] (03CR) 10Ejegg: [C: 03+2] "Both changes look like definite improvements! Yay for 🚂 test data." [wikimedia/fundraising/crm/civicrm] - 10https://gerrit.wikimedia.org/r/705520 (https://phabricator.wikimedia.org/T286967) (owner: 10Eileen) [02:16:04] (03Merged) 10jenkins-bot: Fix failing dedupe job [wikimedia/fundraising/crm/civicrm] - 10https://gerrit.wikimedia.org/r/705520 (https://phabricator.wikimedia.org/T286967) (owner: 10Eileen) [02:21:43] cstone: https://www.cbc.ca/news/canada/thunder-bay/forest-fires-northwestern-ontario-1.6108003 [02:22:49] need to get a giant tube and just send all the rain north [02:23:16] hmmm and also to remove some greenhouse gasses mebbe [02:23:59] it looks like the border is opening too on august 9th but if we need negative tests to go in and get back probably not worth the like 6 hours wed spend there hah [02:24:29] awww hmmm [02:24:59] yeah I think currently at least those who can travel need negative tests in addition to full vaccination with Canada-approved vaccines [02:24:59] but we'll see ! [02:27:23] (03PS3) 10Cstone: Add invoice_id on new recurring insert [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/705518 (https://phabricator.wikimedia.org/T286739) [02:28:09] (03CR) 10Ejegg: [C: 03+2] "Looks good!" [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/705518 (https://phabricator.wikimedia.org/T286739) (owner: 10Cstone) [02:28:20] ejegg: coding too late on friday I guess and completely missed those extra_recurring_params that was perfect for what I was trying to do hah [02:28:29] ah yeah [02:29:51] eileen: I'm looking at AndyRussG's patch to move over to the wmf registry, and I guess I don't see anything being removed that we'd be likely to miss [02:30:15] any objection to my merging it after reading his response? [02:31:24] ejegg: I feel happy that if AndyRussG has thought that through we should merge [02:31:44] just smoke testing locally first... [02:31:55] ejegg: I did that bit [02:35:21] oh hey, it's not running civibuild locally [02:35:36] wait, are the images in the wmf repo all pre-set-up? [02:36:44] hrm, or did it just bomb out during a composer run? [02:37:18] maybe a disk space issue? [02:38:55] (03Merged) 10jenkins-bot: Add invoice_id on new recurring insert [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/705518 (https://phabricator.wikimedia.org/T286739) (owner: 10Cstone) [02:45:05] ejegg: you have to delete all the images first [02:45:23] I did do that bit [02:45:43] ah ok, i deleted some but not all. will try again [02:46:19] when i skip the composer install steps the following bits seem to be going as usual [02:46:44] ah no, when civibuild runs composer it bombs again [02:46:56] will do the full image nuke [02:48:22] (03PS1) 10Eileen: Submodule update [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/705524 [02:49:59] oh or maybe some local config override that's not getting nuked? [02:51:38] ejegg: yeah we have had intermittent composer issues in civibuild :-( [02:51:58] (03CR) 10Eileen: [C: 03+2] Submodule update [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/705524 (owner: 10Eileen) [02:52:43] hmm, this seems like 'any run of composer bombs out setup' for me, whether in civibuild or elsewhere [02:52:56] maybe because of xdebug=always? [02:54:50] ejegg: huh more details on what happens? [02:55:05] it should be the exact same images that we've been using from Docker Hub [02:55:49] ejegg: if you're about and feel like a quick screenshare I'm also available btw, I know it's late for u, tomorrow is also fine of course :) [02:55:58] thanks! [02:56:18] just trying again after disabling remote_autostart in civicrm xdebug.ini [02:56:40] and... it got past the civibuild composer run [02:56:46] hmmm ok that sounds like it then° [02:56:48] ! [02:56:48] so yah, it was a local config override issue [02:57:33] hmmm I would hope we'd still be able to run composer even if that's set to on, now I'm not sure that I've tried it tho [02:58:02] oh foo, i did just get an error Error: Class name must be a valid object or a string in Civi\Api4\Generic\DAOGetAction->_run() (line 91 of /srv/civi-sites/wmff/civicrm/Civi/Api4/Generic/DAOGetAction.php). [02:58:10] lemme update all the gits [02:59:30] ah that one's been pesky before [02:59:37] ejegg: also maybe destroy the containers and persistent storage? [03:00:15] also... there was a switch just now to use civibuild from a different branch I think? [03:00:31] I think you might not get that one unless your rebase on master tho [03:01:13] ejegg: ah now recalling what would fix that DAO error: removing the vendor directory under civi-sites/wmff (and then of course composer has to run again) [03:01:18] oh yah, i just did a cherry-pick on top of the merged bits [03:01:22] aha, ok, will do [03:01:55] ejegg: to get the new branch of civibuild you could just re-clone the buildkit source [03:02:07] (via setup.sh, i.e. let it delete that src dir) [03:02:21] be aware then that you're actually smoke testing two things in that case... [03:02:46] k, deleted buildkit & wmff/vendor [03:02:50] (03Merged) 10jenkins-bot: Submodule update [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/705524 (owner: 10Eileen) [03:05:26] cooolio [03:09:22] yep, got past the part where it failed the last time [03:09:42] oki yay! [03:09:50] (03PS1) 10Eileen: Merge branch 'master' of https://gerrit.wikimedia.org/r/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/705526 [03:10:26] (03CR) 10Eileen: [C: 03+2] Merge branch 'master' of https://gerrit.wikimedia.org/r/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/705526 (owner: 10Eileen) [03:13:10] ehoops ejegg I must have looked at bad data when i tested that civi patch [03:13:18] (03PS1) 10Cstone: Add invoice_id without overwriting the whole array [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/705527 (https://phabricator.wikimedia.org/T286739) [03:13:24] cstone: oh which one? [03:13:27] oh shoot! [03:13:32] does data know of good or evil? [03:13:43] it helpfully cleaned out the array [03:13:54] eileen: hold up on that deploy a sec! [03:14:03] ejegg: sure [03:14:17] sorry, cstone, i should have looked closer [03:14:18] itll still be okay ejegg its still checking for the new field [03:14:29] ah true [03:14:34] which doesnt exist cause that adyen branch isnt merged [03:14:45] (03PS2) 10Ejegg: Add invoice_id without overwriting the whole array [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/705527 (https://phabricator.wikimedia.org/T286739) (owner: 10Cstone) [03:14:49] (03CR) 10Ejegg: [C: 03+2] Add invoice_id without overwriting the whole array [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/705527 (https://phabricator.wikimedia.org/T286739) (owner: 10Cstone) [03:15:03] ok eileen i guess it's fine to deploy as is [03:15:22] ejegg: so it looks like it won't do something yet because something is missing but it won't break? [03:15:34] haha [03:15:51] eileen right, the breakage won't be triggered till we start sending the new field from the front end [03:16:14] ok - breakage in waiting [03:16:33] heh, but by then we will have deployed that fix [03:17:16] !log civicrm revision changed from 20e9ef6bbb to 819c11307d, config revision is bb405c5232 [03:17:22] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [03:22:30] AndyRussG: whew, ok, setup all worked fine. payments and email pref center seem to load OK too [03:22:39] civi sites unfortunately don't [03:23:03] in the apache error logs I see AH00558: apache2: Could not reliably determine the server's fully qualified domain name, using 172.27.0.8. Set the 'ServerName' directive globally to suppress this message [03:23:12] then AH01906: wmff.localhost:443:0 server certificate is a CA certificate (BasicConstraints: CA == TRUE !?) [03:23:20] then AH01909: wmff.localhost:443:0 server certificate does NOT include an ID which matches the server name [03:23:40] and in the browser it's just a Secure Connection Failed even after accepting the self-signed-ness [03:24:07] so that's firefox, then chromium just says it's an empty response (after clicking to proceed to unsafeness) [03:24:11] lessee chrome [03:24:39] same as chromium [03:24:42] ejegg: huh ok [03:25:05] ejegg: why are you trying on that port? [03:25:22] civi sites port is fixed at... [03:25:34] the port is https://wmff.localhost:32353/civicrm in my browser [03:25:45] I think that forwards to 443 in the container though, right? [03:25:50] nope [03:25:53] and that's where the logs are [03:25:55] oh odd [03:26:08] lemme check those timestamps then [03:26:18] (03Merged) 10jenkins-bot: Add invoice_id without overwriting the whole array [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/705527 (https://phabricator.wikimedia.org/T286739) (owner: 10Cstone) [03:26:38] yep, those :443 errors in the logs are from nowish [03:26:45] nowhish? [03:26:50] oh now-ish heheh [03:27:04] I was like no wish? which wish? [03:27:17] heh [03:27:26] ejegg: for civi sites the config is generated from a template, lemee remember how that works and suggest a place to look, one sec [03:27:55] oh hmm, also a lot of httpd: zend_mm_heap corrupted [03:28:02] in the civi apache logs [03:28:13] ejegg: I get that error [03:28:23] it relates to phpstorm watches [03:28:25] eileen: but the site still loads for you? [03:28:46] lemme try disabling xdebug autostart in civi web too, one sec [03:28:58] ejegg: you'll have to restart the container [03:29:01] or apache [03:30:07] ejegg if you say git status in fundraising-dev is your repo clean? [03:31:09] ejegg: so what I've found is sometimes I have to disable listenting in my IDE to make it work [03:31:29] huh that's really weird and unfortunate [03:31:32] when that turns out to be the case removing all watches seems to help [03:31:32] oho, that did it eileen ! [03:31:46] ok, good to know [03:31:49] Also - I *think* there is a python plugin that causes issues [03:32:00] I guess it's a phpstorm bug [03:32:16] yep, logged in fine now [03:32:20] I found issue logs for it but it's not being treated as active and I didnt provide extra info [03:32:32] (I don't think I knew how best to get it) [03:32:43] ah glad it worked now! [03:32:46] eileen i was finding issues with firephp and xdebug in my non-docker env [03:33:02] hmm [03:33:15] so i've been disabling that locally [03:33:22] The best understanding I have is that it relates to watches in some way [03:33:45] ok [03:33:55] for future reference, for apache issues under civi-sites, look at the files under config/civicrm/amp/apache.d. Those are generated based on a template and cleared out when you run civi setup using setup.sh [03:34:12] anyway, i think i can tell that the acutal pulling of images from the wmf repo works [03:34:24] thanks so much for all the testing and setup work eh!!! [03:34:27] thanks AndyRussG , v helpful [03:35:19] (03PS3) 10Ejegg: Pull images from WMF Registry [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/705017 (owner: 10AndyRussG) [03:36:00] (03CR) 10Ejegg: [C: 03+2] "Thanks for your persistence AndyRussG! Good to have a home for these on WMF territory." [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/705017 (owner: 10AndyRussG) [03:36:40] ejegg: ^ thx much! [03:36:46] :) [03:38:15] (03CR) 10Eileen: [V: 03+2 C: 03+1] "We actually need to v+2 these" [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/705017 (owner: 10AndyRussG) [03:38:34] nothing is automatic in that repo ^^ [03:38:37] ahhh and merge manually [03:38:57] I only see one non-WIP Gerrit change open for Adyen stuff [03:39:00] https://gerrit.wikimedia.org/r/q/project:wikimedia/fundraising/SmashPig+status:open [03:39:12] https://gerrit.wikimedia.org/r/q/project:mediawiki/extensions/DonationInterface+branch:adyen+status:open [03:40:31] (03CR) 10Cstone: [C: 03+2] "Looks good!" [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/704884 (https://phabricator.wikimedia.org/T286739) (owner: 10Ejegg) [03:40:41] (the "Add ability to create new recurring credit card payments" one in DI) [03:41:16] fr-tech open to suggestions on what specifically to focus on now for the Adyen sprink goal [03:44:24] (03PS9) 10Cstone: WIP: Add recurring [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/702766 (https://phabricator.wikimedia.org/T283106) [03:47:37] cstone: any notes on how to test https://gerrit.wikimedia.org/r/c/mediawiki/extensions/DonationInterface/+/702762 ? [03:47:52] set recurring=1 [03:48:19] then you should have a token and a processor_contact_id on the queue msg [03:48:53] although the smashpig patch is needed too [03:49:02] lemme clean up the comments and take that out of WIP too [03:49:19] https://gerrit.wikimedia.org/r/c/wikimedia/fundraising/SmashPig/+/702766 right? [03:49:22] cool thanks!!! [03:50:57] (03Merged) 10jenkins-bot: Add processor_contact_id to SmashPig createPayment [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/704884 (https://phabricator.wikimedia.org/T286739) (owner: 10Ejegg) [03:53:17] (03PS10) 10Cstone: Add ability to create a payment from a saved token [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/702766 (https://phabricator.wikimedia.org/T283106) [03:54:09] yeah AndyRussG with both of those and the lastest civi you should be able to create a new recurring and then charge it [03:54:29] cstone: okok cool trying it out, thanks! [03:54:59] im gona head to bed night everyone [03:55:15] cstone: cya! thx :) [03:59:42] thanks cstone [04:32:27] 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Wmf-donor - new year fields - https://phabricator.wikimedia.org/T280595 (10Eileenmcnaughton) @Dwisehaupt @Jgreen @Ejegg just flaggin that the desired scope of this is likely to have some impact on disk size (but hopefully not on performance ) [07:19:32] (03CR) 10AndyRussG: "Hi! Thanks so much for this!!!" (031 comment) [extensions/DonationInterface] (adyen) - 10https://gerrit.wikimedia.org/r/702762 (https://phabricator.wikimedia.org/T283106) (owner: 10Cstone) [07:19:50] (03CR) 10AndyRussG: Add ability to create a payment from a saved token (031 comment) [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/702766 (https://phabricator.wikimedia.org/T283106) (owner: 10Cstone) [08:14:29] (03PS11) 10Cstone: Add ability to create a payment from a saved token [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/702766 (https://phabricator.wikimedia.org/T283106) [08:15:27] (03CR) 10Cstone: Add ability to create a payment from a saved token (031 comment) [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/702766 (https://phabricator.wikimedia.org/T283106) (owner: 10Cstone) [08:15:39] (03PS1) 10Eileen: Move the custom fields definition to a more logical place [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/705614 (https://phabricator.wikimedia.org/T281268) [08:17:12] (03CR) 10Cstone: "> Patch Set 7:" (031 comment) [extensions/DonationInterface] (adyen) - 10https://gerrit.wikimedia.org/r/702762 (https://phabricator.wikimedia.org/T283106) (owner: 10Cstone) [08:20:24] (03CR) 10jerkins-bot: [V: 04-1] Move the custom fields definition to a more logical place [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/705614 (https://phabricator.wikimedia.org/T281268) (owner: 10Eileen) [08:44:57] (03PS2) 10Eileen: Move the custom fields definition to a more logical place [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/705614 (https://phabricator.wikimedia.org/T281268) [13:08:08] hey damilare hows it goin? [13:08:15] hey fr-tech [13:09:40] Hi jgleeson, I'm well and you? [13:10:02] Just looking through the documentations and added my details to the contact list [13:10:11] good good! [13:12:09] I'm good thanks. Adyen, the payment provider we were discussing yesterday, came back to us via email last night to confirm that the test URL was set up incorrectly in the test console so my plan now is to boot back up the temporary cloud test server we're using at https://jackgleeson.co.uk and then switch over to the macbook and attempt a transaction [13:13:23] ohh great, sounds like some progress on that front [13:13:39] we've struggled to get a test transactions through so far. A mix of nonstandard testing requirements from Apple Pay and the requirement to test from a live staging server (which we don't typically do) have hampered us a little [13:16:13] ah shoot. looks like we're still getting the same error [13:16:26] wow [13:16:33] yeah :( [13:16:53] I'll respond to them now on that email thread to let them know [13:18:42] yhh you should [13:27:49] ok that's sent. I'm gonna pop out to pick up my son from school. be back soon :) [14:56:59] 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10fr-donorservices, 10FR-Email: Recurring donors segmentation criteria Civi/Acoustic - https://phabricator.wikimedia.org/T283798 (10MBeat33) [15:25:37] 10Fundraising-Backlog: Add selection criteria for "Find Contribution" in Civi search - https://phabricator.wikimedia.org/T287020 (10EMartin) [15:36:39] hi fr-tech [15:41:11] hey cstone :) [15:41:21] hows it goin [15:42:05] 10Fundraising-Backlog, 10FR-Ingenico: Swedish donations stuck at status 600 - https://phabricator.wikimedia.org/T246710 (10EMartin) Further to this issue, we are seeing an inordinate amount of transactions in the JP campaign that are not scored but are awaiting settlement at 600 each day. Orphan Rectifier is... [15:43:40] hmm that ticket stands out [15:44:39] 10Fundraising-Backlog, 10FR-Ingenico: Swedish donations stuck at status 600 - https://phabricator.wikimedia.org/T246710 (10EMartin) Examples: likely plausible 7/19/21 15:31 102767507.2 0 JP JPY 335 likely plausible 7/19/21 15:10 102767194.1 0 JP JPY 1040 likely plausible 7/19/21 14:28 102766077.1 0 JP J... [15:45:03] 10Fundraising-Backlog, 10FR-Ingenico: Swedish donations stuck at status 600 - https://phabricator.wikimedia.org/T246710 (10jgleeson) Hi @EMartin could you provide some examples please so we can take a look? Thanks! [15:45:33] ah she beat me to it [15:45:39] heh, nice [15:46:25] geese were back jgleeson they are now moving along though [15:46:29] ejegg: does that sound worthy of pulling into the sprint? [15:46:48] haha cstone what are they doing just being a nuisance? [15:47:13] well they are on the ramp which is fine but not when they mosey on up into the yard and poop all over it [15:47:32] ah yeah that's not cool [15:48:53] my dad has the entire yard surrounded in a string fence which is effective until they either walk up the ramp or the driveway haha [15:49:08] ah they worked it out [15:49:13] clever geese! [15:50:35] we do have the sprinkler to aim at the ramp but these geese are less bold than the ones around earlier in the year [15:58:08] (03CR) 10Ejegg: Adyen Checkout: move antifraud filter run (031 comment) [extensions/DonationInterface] (adyen) - 10https://gerrit.wikimedia.org/r/702763 (https://phabricator.wikimedia.org/T282641) (owner: 10Ejegg) [15:59:22] (03PS12) 10Ejegg: Add ability to create a payment from a saved token [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/702766 (https://phabricator.wikimedia.org/T283106) (owner: 10Cstone) [16:06:10] 10fundraising-tech-ops: remove payments100[1-4] from service and prep for decom - https://phabricator.wikimedia.org/T286044 (10Jgreen) [16:10:03] 10fundraising-tech-ops: remove payments100[1-4] from service and prep for decom - https://phabricator.wikimedia.org/T286044 (10Jgreen) [16:10:13] 10fundraising-tech-ops: remove payments100[1-4] from service and prep for decom - https://phabricator.wikimedia.org/T286044 (10Jgreen) 05Open→03Resolved [16:11:14] (03CR) 10Ejegg: "Looking good! I'mma just test the edge case of 3DS + recurring to see if we need to move that handleCreatedPayment" (032 comments) [extensions/DonationInterface] (adyen) - 10https://gerrit.wikimedia.org/r/702762 (https://phabricator.wikimedia.org/T283106) (owner: 10Cstone) [16:20:47] 10Fundraising-Backlog, 10FR-Ingenico: Swedish donations stuck at status 600 - https://phabricator.wikimedia.org/T246710 (10jgleeson) Hi @EMartin I just looked up the first three on that list and two came back with "Not Authorized" and the other came back with "Card expired" I can go through the others to c... [16:31:45] 10fundraising-tech-ops: Fundraising access request for Joseph Mando - https://phabricator.wikimedia.org/T287026 (10JMando) [16:37:49] 10fundraising-tech-ops: Fundraising access request for Damilare Aderdoyin - https://phabricator.wikimedia.org/T286956 (10Dwisehaupt) [16:38:25] 10fundraising-tech-ops: Fundraising access request for Damilare Aderdoyin - https://phabricator.wikimedia.org/T286956 (10Dwisehaupt) SSL client certificate created and sent via email. Password sent via SMS. [16:48:13] (03PS1) 10Ejegg: Add recurring IDs to getDetails response [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/705723 (https://phabricator.wikimedia.org/T283106) [16:49:35] (03CR) 10Ejegg: [C: 03+2] "This looks great! In I2ce00c2748aa4e9137bd551a0678a228728d60c5 I've used your logic to add the same properties to the getDetails response " [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/702766 (https://phabricator.wikimedia.org/T283106) (owner: 10Cstone) [16:49:44] (03PS2) 10Ejegg: Add recurring IDs to getDetails response [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/705723 (https://phabricator.wikimedia.org/T283106) [16:50:13] (03Merged) 10jenkins-bot: Add ability to create a payment from a saved token [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/702766 (https://phabricator.wikimedia.org/T283106) (owner: 10Cstone) [16:50:47] thanks ejegg ! [16:50:51] thank you! [16:51:24] for the DI patch, I think we DO want to move the bit that adds the tokens to the handleCreatedPayment method [16:51:40] helllooooo fr-tech ejegg cstone jgleeson damilare ! :) [16:51:44] since we don't get the tokens until the getDetails call when there's a redirect [16:51:47] hi AndyRussG ! [16:53:44] 10Fundraising-Backlog, 10FR-Ingenico: Swedish donations stuck at status 600 - https://phabricator.wikimedia.org/T246710 (10EMartin) Hi Jack, Here are more examples from today. Why the delay in either scoring or settling these transactions that show up on our Fredge report? Thanks *Payment attempt date* *O... [16:53:59] ejegg hey thanks for noting that... ^ so just to understand the flow better, in the case of redirect handleCreatedPayment() is called after we come back from 3ds limbo, is that correct? [16:54:15] right AndyRussG [16:54:44] also for iDEAL payments, we would get the tokens after the donor comes back from their bank website [16:56:23] oki... that's all via requests form the client browser, right? the overall site flow is payments -> external site (3ds or ideal banky thing) -> payments, immediate redirect to -> ty page [16:56:27] ? [16:56:34] yep AndyRussG [16:56:45] okok [16:57:30] so in the case of no return, getting this ProcessorContactID is something we need to handle so we can charge recurrings on those, right? [16:57:46] you mentioned the orphan rectifier there, so I guess that's the job that can do it? [16:57:54] hi AndyRussG [16:57:59] right, that would theoretically be the place to do it [16:58:01] hellloooo :) [16:58:24] but actually... the orphan rectifier needs some way to call getDetails [16:58:34] oki maybe we need a task for all that? [16:58:53] and with Adyen, the getDetails call needs an identifier that we only receive on the querystring when the donor comes back [16:59:03] ahhh hmmm maybe then it'd be easier to do it in the response to the IPN call? [16:59:06] so... I don't see it being possible to rectify orphans in our flow [16:59:39] right, although we'd want to hang on to that IPN data for a while and only try capturing a half an hour later or so once we're sure the front end didn't capture it. [17:00:09] so not DIRECTLY in rseponse to the IPN [17:00:10] hummmm that sounds complex [17:00:14] yerp [17:00:23] I'm kinda yerning for a flow chart [17:03:30] 10fundraising-tech-ops: Fundraising access request for Damilare Aderdoyin - https://phabricator.wikimedia.org/T286956 (10Dwisehaupt) [17:08:45] delayed cause moving desk but for ideal the token comes in on an ipn message there is also another api call mentioned to get it too [17:16:22] 10fundraising-tech-ops: Fundraising access request for Damilare Adedoyin - https://phabricator.wikimedia.org/T286956 (10Dwisehaupt) [17:16:36] yeah so... I guess those IPN messages could add info to the pending DB [17:16:48] dang though [17:16:54] that's another order dependent thing [17:17:46] so we would want to store the IPN message whether it got there before or after the info from the front-end pending message [17:18:08] I guess whichever gets there second acts as an update [17:27:19] 10Fundraising-Backlog, 10FR-Docker: Docker dev setup: scope out use cases, requirements and command-line UI for breaking out setup.sh into smaller scripts - https://phabricator.wikimedia.org/T287028 (10AndyRussG) [17:29:46] 10Fundraising-Backlog, 10FR-Docker: Docker dev setup: break out setup.sh into smaller scripts, maybe add a few new ones - https://phabricator.wikimedia.org/T278728 (10AndyRussG) This seems like a big task, with many possible ways forward, so here's a subtask for initial scoping out: {T287028}. Thanks much!!! :) [17:32:08] ejegg: heheh wow ok yeah my flow chart wishes persist now more strongly I guess? :) [17:33:17] yeah, trying to think how this would be possible [17:33:27] :) thanks for noticing this! [17:33:51] well, we haven't had an orphan rectifier for adyen before [17:34:11] I don't think we're considering it necessary for the first campaign launch [17:34:41] easy CR and +2's may await any who dare to click: https://gerrit.wikimedia.org/r/c/wikimedia/fundraising/dev/+/703259 https://gerrit.wikimedia.org/r/c/mediawiki/extensions/DonationInterface/+/703258 [17:35:03] ejegg ^ hmmm why not? because no iDEAL/3DS? [17:35:57] no, we just don't have a way to call a get payment status API to look it up by our order ID [17:36:30] oki but how do we justify that's not needed for initial campaign launch? [17:37:07] I think we [17:37:16] 're going for the same features as we had before [17:38:27] agreed... but so then on the old integration, were there any edge cases we would handle properly (because different flow) that we'll miss now? at least for the first campaign, that doesn't use 3ds or iDEAL, but will have recurring? [17:38:47] (03CR) 10Ejegg: "Any reason this is against the Adyen branch and not master? Not seeing anything adyen-related." [extensions/DonationInterface] (adyen) - 10https://gerrit.wikimedia.org/r/703258 (https://phabricator.wikimedia.org/T266088) (owner: 10AndyRussG) [17:39:20] (03PS2) 10Ejegg: Remove a line in config/payments/LocalSettings.php so tests pass [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/703259 (https://phabricator.wikimedia.org/T266088) (owner: 10AndyRussG) [17:39:23] (03CR) 10Ejegg: [C: 03+2] Remove a line in config/payments/LocalSettings.php so tests pass [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/703259 (https://phabricator.wikimedia.org/T266088) (owner: 10AndyRussG) [17:40:41] 10Fundraising-Backlog, 10FR-Ingenico: Swedish donations stuck at status 600 - https://phabricator.wikimedia.org/T246710 (10EMartin) @jgleeson Jack - your findings are interesting. When I look up one of the transactions you state is "Not Authorized", I clearly see an auth code in the Ingenico console telling m... [17:40:48] AndyRussG: card donors in the old flow could potentially not get back to payments but still have the capture performed by the IPN listener [17:41:12] in the new flow, non-3DS card donors stay on payments-wiki so I don't think there's as much need for an orphan rectifier [17:44:16] hmm [17:44:34] is david out today? [17:49:59] XenoRyet: [17:50:00] ejegg: k still sounds like something to write up and present to stakeholders? [17:50:22] I was in a meeting with David earlier [17:50:27] thanks [17:52:09] also can I just say that going back to email for the new hires is MUCH BETTER than slack [17:54:48] Yea, I prefer the email too, but I'm just a little slack averse in general. [17:56:22] right? [17:56:36] fr-tech cstone ejegg so with the new patch set for https://gerrit.wikimedia.org/r/c/wikimedia/fundraising/SmashPig/+/702766 I do get the new processor_contact_id field in the queue message [17:56:45] so I could +2 that one? [17:57:09] I've forgot what I was doing now [17:57:11] that appears to make it into civi db as invoice_id [17:57:16] AndyRussG: it has ben merged but thanks so much for looking at it [17:57:38] ah great cstone [17:57:40] :) :) [17:57:50] I was going to say, I still get payment failed though [17:57:54] sorry to give you incomplete code to look at [17:58:30] do your recurrings in the db have both an invoice id and a token? [17:58:44] ahhh heh no it's fine, it was not extra work since no matter what I was debugging through it :) [17:58:49] and do you have the latest civi? [18:00:12] cstone: yes I have the latests civi, it's on 23ee8d67b3143 and the civicrm submodule is on 6632256315c [18:00:23] cstone: wait do I need to update SmashPig in the civi vendor directory too? [18:00:28] just cause i had trick code last night that did not behave [18:01:12] I did first drush qc -v to consume the queue message [18:01:22] then drush cvapi job.process_smashpig_recurring contribution_recur_id= [18:01:25] 2 [18:02:05] does 2 have both the token and the invoice_id? [18:03:59] yep [18:04:08] select * from civicrm_contribution_recur where id=2; [18:04:28] | id | contact_id | amount | currency | frequency_unit | frequency_interval | installments | start_date | create_date | modified_date | cancel_date | cancel_reason | end_date | processor_id | payment_token_id | trxn_id | invoice_id | contribution_status_id | is_test | cycle_day | next_sched_contribution_date | failure_count | failure_retry_date | auto_renew | [18:04:30] payment_processor_id | financial_type_id | payment_instrument_id | campaign_id | is_email_receipt | [18:04:50] | 2 | 207 | 4.46 | USD | month | 1 | 0 | 2021-07-20 17:46:45 | 2021-07-20 17:46:45 | 2021-07-20 17:47:38 | NULL | NULL | NULL | 853626803205080K | 2 | 853626803205080K | 2.1 | 8 | 0 | 20 | 2021-07-21 17:48:49 | 1 | NULL | 0 | [18:04:52] 3 | NULL | NULL | NULL | 1 | [18:06:15] payment token id is 2, invoice_id is 2.1 [18:06:33] (and on the one I tried last night, before the new field was getting set, invoice_id was null) [18:07:13] hmm nooo adyen console is differentttt [18:07:36] hah ok its just sidebar [18:08:14] ah btw the apocalypse has indeed reached my home town https://www.cbc.ca/news/canada/montreal/smog-warning-quebec-1.6109364 [18:09:00] yeah it looks like theres fog on the lake and the coast guard just went by like making a high pitched noise which i havent heard them do before [18:09:25] ah wow crazy [18:10:39] AndyRussG: you saw payment failed on 2.1 I see a charge with it in the adyen console that was sucessfull 2.2 wasnt that [18:10:47] er wasn't (im guessing that one is missing the invoice) [18:14:27] 10fundraising-tech-ops, 10Patch-For-Review: Reconfigure fundraising public-reporting server role to fundraising-data - https://phabricator.wikimedia.org/T255435 (10Jgreen) [18:15:32] 10fundraising-tech-ops, 10Patch-For-Review: Reconfigure fundraising public-reporting server role to fundraising-data - https://phabricator.wikimedia.org/T255435 (10Jgreen) [18:16:23] 10Fundraising-Backlog, 10FR-Ingenico: Swedish donations stuck at status 600 - https://phabricator.wikimedia.org/T246710 (10jgleeson) This is odd. The authorization time is 2 hours after the failed attempt I see in our payment logs. Lemme see if @ejegg has any ideas. [18:17:07] ejegg: we've got a payment that apparent was not authorized at time of transaction which is showing as authorized in the ingenico console [18:17:15] apparently [18:17:19] that's pretty funky jgleeson [18:17:24] taking a look [18:17:48] 102749805.1 ejegg [18:18:09] thanks [18:19:01] I can't find a record of the payment on civi either [18:19:27] 10fundraising-tech-ops: Fundraising access request for Joseph Mando - https://phabricator.wikimedia.org/T287026 (10Dwisehaupt) [18:20:17] cstone: right I think the 2.1 was the initial donation, which did go through [18:20:25] ah okay [18:20:32] then 2.2 must be when it tried to charge recurring, which was refused, same as yesterday [18:20:44] but indeed 2.1 is the invoice_id on the one I tried to recur-charge [18:21:11] are you able to recur-charge successfully? [18:21:15] I am [18:21:25] hmmmm [18:21:37] using the same command-line drush flow as I am ^ ? [18:21:41] yeah are you able to debug into the smashpig to get exactly why its failing? [18:21:47] 10Fundraising-Backlog, 10fundraising-tech-ops, 10FR-Tech-Analytics: Fundraising Access for Joseph Mando - https://phabricator.wikimedia.org/T286556 (10Dwisehaupt) [18:21:53] yeah I was about to do that, one sec [18:22:03] If I remember rightly donations only get pushed to the queue when the final status is complete so that makes sense [18:22:07] (it not being therE) [18:22:09] -E [18:22:13] +e [18:22:14] yeah drush cvapi job.process_smashpig_recurring contribution_recur_id=261 for the call AndyRussG [18:23:11] cstone: and also to consume, drush qc -v ? [18:23:32] a longer form of that but yes [18:23:42] the qc [18:24:10] hmmm last night btw I also used php /srv/smashpig/Maintenance/ConsumePendingQueue.php --queue pending [18:24:16] wasn't sure which or neither was right [18:24:31] (trying commands I see in process-control jobs on prod) [18:25:09] jgleeson there's something odd about the IDs in the log line when the donor comes back - [18:25:23] Jul 19 06:14:56 : 102749805:102749805.1 Sending donor details for 102749805.1 to pending queue [18:25:33] is the last line before they are redirected [18:25:57] but then the first line when they come back is Jul 19 06:15:11 : 102749830:102749805.1 setCountry: Country not set. [18:26:03] note the new ct_id [18:26:23] ya [18:26:43] so we're logging the session ID and THAT actually hasn't changed [18:27:40] hm, anyway, the statusCode is 100 there [18:29:17] really unclear how that could have gotten to status 600 [18:30:36] fr-tech I'm going to be late for the sprint meeting [18:30:47] 10-4 [18:30:53] that appointment of my wife's was actually set for today, not yesterday [18:31:18] It starts the same time as our meeting, but I"m just dropping her off and my mother is going to be able to pick her up [18:31:36] so I should be back online by 20 past or so [18:31:57] ejegg: if u need to take more time it's really fine btw eh [18:32:00] thanks ejegg [18:32:54] (ejegg for example I'm sure it'd be fine if you wanted to stay there and just be on the call by phone...) [18:33:21] ejegg: as I was looking at this I'm thinking it would be good to be able to recreate donations that happened on the frontend. like some way of rebuilding the frontend submission and replaying it, only using sandboxes for the api calls made [18:33:41] (or miss the call as needed also of course, really I'm sure it'd be ok!) [18:33:44] do we have a sandbox account for maxmind? [18:34:03] no jgleeson, none for maxmind [18:34:35] and that'd be a lot more logging... [18:34:43] would it ? [18:34:57] I was thinking maybe just the basic submission [18:35:03] nvm I'll drop that idea in a ticket [18:35:12] good luck at the appointment! [18:37:23] fr-tech typically when we dig into something that's not worked as expected we look at the fragments left once it passes through our sysystem without being able to debug at a code level and see the code paths taken clearly. Being able to "replay" a donation albeit it would need some work to capture or recreate the upfront request, would give us more visibility into how the code handled the [18:37:24] donation or process [18:37:58] hmmm [18:38:07] like what exactly do you mean by replay, jgleeson? [18:38:15] exactly that [18:38:42] submit the donation back to our systems but using sandbox endpoints [18:38:54] hmmmm oki [18:38:57] either via a staging version of payments or locally [18:39:21] do we not currently log or store somewhere enuf data to do that? [18:39:22] that way we can follow the transaction through the code and work why odd stuff is happening [18:39:29] we probably do AndyRussG [18:40:10] It's likely we can build up the initial form submission using data we save during our existing flow [18:40:29] maybe not the card data [18:40:37] like it takes all the logs and barfs out a jimmy link? [18:40:49] could be cstone !!! [18:41:05] I like the prepopulated URL shortcut idea [18:41:06] that sounds really helpful [18:41:19] just like for all the times i go to test something and forget to set recurring to true [18:41:25] ha [18:42:08] not having the "real" card/payment process experience is kind of a big gap [18:43:43] cstone: that sounds super useful. [18:44:03] it would hard to simulate that part, which is arguably the most important step in the process, without some clever gateway response lookup which then maps to a set of sandbox payment details that triggers the same outcome e.g. if the trxn was declined due to card expired than we drop in test card details that deliberate return that response [18:44:08] I see that as the tricky part [18:50:16] 10Fundraising-Backlog, 10FR-Ingenico: Swedish donations stuck at status 600 - https://phabricator.wikimedia.org/T246710 (10jgleeson) @EMartin there's some more work needed here to figure out what's happened. Our usual cursory log scanning isn't showing up any obvious answers. I'll let @DStrine prioritise acco... [19:08:21] 10Fundraising Sprint Mandatory corn dogs, 10Fundraising-Backlog, 10FR-AutoTY-Email: Edit to Japanese TY Email - https://phabricator.wikimedia.org/T286706 (10DStrine) 05Open→03Resolved [19:08:40] 10Fundraising Sprint Ketchup Flume Ride, 10Fundraising Sprint Mandatory corn dogs, 10Fundraising-Backlog, 10fundraising sprint Legø Trampoline, 10FR-Docker: Docker dev setup: Set up IPN listeners - https://phabricator.wikimedia.org/T268687 (10DStrine) 05Open→03Resolved [19:08:42] 10Fundraising-Backlog, 10FR-Docker, 10Epic: Epic: feature parity with vagrant on docker - https://phabricator.wikimedia.org/T262971 (10DStrine) [19:08:57] 10Fundraising Sprint Mandatory corn dogs, 10Fundraising-Backlog, 10Wikimedia-Fundraising-Banners, 10donate.wikimedia.org, 10MW-1.37-notes (1.37.0-wmf.15; 2021-07-19): Disable AMEX for JP campaign 2021 - https://phabricator.wikimedia.org/T286657 (10DStrine) 05Open→03Resolved [19:09:48] 10Fundraising Sprint Mandatory corn dogs, 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-Target-Smart: Data Pull: New FY2021 Donors - https://phabricator.wikimedia.org/T284784 (10DStrine) 05Open→03Resolved [19:10:25] 10Fundraising Sprint Mandatory corn dogs, 10Fundraising-Backlog, 10fundraising sprint Legø Trampoline, 10FR-AutoTY-Email, 10FR-Email: Formatting issue with Civi recurring expiry/fail email? - https://phabricator.wikimedia.org/T282582 (10DStrine) 05Open→03Resolved [19:10:56] 10Fundraising Sprint Mandatory corn dogs, 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10fundraising sprint Legø Trampoline, 10Patch-For-Review: Source field not accepting negative amounts - https://phabricator.wikimedia.org/T284196 (10DStrine) 05Open→03Resolved [19:11:21] 10Fundraising Sprint Mandatory corn dogs, 10Fundraising-Backlog, 10fr-donorservices: Japanese-langage monthly converts only getting the second (MC) TY email - https://phabricator.wikimedia.org/T285828 (10DStrine) 05Open→03Resolved [19:12:33] 10Fundraising Sprint Mandatory corn dogs, 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10Unplanned-Sprint-Work: Dedupe failmail - something odd with the api call - https://phabricator.wikimedia.org/T286967 (10DStrine) 05Open→03Resolved [19:13:17] 10Fundraising Sprint Ketchup Flume Ride, 10Fundraising Sprint Mandatory corn dogs, 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, and 2 others: Fix trigger sql issues - https://phabricator.wikimedia.org/T283561 (10DStrine) 05Open→03Resolved [19:13:33] 10Fundraising Sprint Ketchup Flume Ride, 10Fundraising Sprint Mandatory corn dogs, 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, and 5 others: Japanese donor name clean up pass - https://phabricator.wikimedia.org/T281493 (10DStrine) 05Open→03Resolved [19:14:03] 10Fundraising Sprint Mandatory corn dogs, 10Fundraising-Backlog, 10Patch-For-Review: make acoustic mail data searchable through search kit - https://phabricator.wikimedia.org/T285359 (10DStrine) 05Open→03Resolved [19:14:22] 10Fundraising Sprint Mandatory corn dogs, 10Fundraising-Backlog, 10fundraising sprint Legø Trampoline, 10FR-AutoTY-Email, and 2 others: Monthly convert email translation suggestion (Japanese translation) - https://phabricator.wikimedia.org/T283748 (10DStrine) 05Open→03Resolved [19:14:37] 10Fundraising Sprint Mandatory corn dogs, 10Fundraising-Backlog: turn on monthly convert for japan for the pretest on the 29th at 5pm pacific - https://phabricator.wikimedia.org/T285338 (10DStrine) 05Open→03Resolved [19:16:52] 10Fundraising Sprint Mandatory corn dogs, 10Fundraising-Backlog, 10fundraising sprint Legø Trampoline, 10FR-Japan: Deploy new Japanese translations to paymentswiki - https://phabricator.wikimedia.org/T284680 (10DStrine) 05Open→03Resolved [19:18:50] 10Fundraising Sprint Ketchup Flume Ride, 10Fundraising-Backlog, 10fundraising sprint Just in time roller coaster building, 10fundraising sprint Legø Trampoline, 10fr-donorservices: Update contact email address on the ES error screen - https://phabricator.wikimedia.org/T282497 (10DStrine) [19:19:24] 10Fundraising Sprint Mandatory corn dogs, 10Fundraising-Backlog: Pre-production key due to expire - https://phabricator.wikimedia.org/T284518 (10DStrine) 05Open→03Resolved [19:21:47] 10Fundraising Sprint Mandatory corn dogs, 10Fundraising-Backlog, 10fundraising sprint Legø Trampoline: sprint goal: get all standard previous adyen functionality into adyen branch and full test transaction with apple pay - https://phabricator.wikimedia.org/T284603 (10DStrine) 05Open→03Resolved [19:45:13] 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Add selection criteria for "Find Contribution" in Civi search - https://phabricator.wikimedia.org/T287020 (10DStrine) [19:46:31] 10fundraising-tech-ops, 10Patch-For-Review: Reconfigure fundraising public-reporting server role to fundraising-data - https://phabricator.wikimedia.org/T255435 (10Jgreen) [19:47:10] 10fundraising-tech-ops: deploy Let's Encrypt certificates for additional fundraising services - https://phabricator.wikimedia.org/T280034 (10Jgreen) [19:47:22] 10fundraising-tech-ops: deploy Let's Encrypt certificates for additional fundraising services - https://phabricator.wikimedia.org/T280034 (10Jgreen) [19:51:05] 10Fundraising-Backlog, 10fundraising-tech-ops, 10FR-Tech-Analytics: Fundraising Access for Joseph Mando - https://phabricator.wikimedia.org/T286556 (10JMando) Public yubikey: ccccccvkhvbn Public ssh: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC8fG/3nIbCxbVT9KEIhW5bCiccA4JlOtFJx+JEKGNttxTJPJiMjE54DuiuaUWSgwf/UTCt... [19:52:29] 10fundraising-tech-ops, 10Patch-For-Review: Reconfigure fundraising public-reporting server role to fundraising-data - https://phabricator.wikimedia.org/T255435 (10Jgreen) [20:07:46] 10Fundraising-Backlog: Adyen Checkout: Make a rollback plan and test it - https://phabricator.wikimedia.org/T287039 (10AndyRussG) [20:07:56] 10fundraising-tech-ops: remove payments100[1-4] from service and prep for decom - https://phabricator.wikimedia.org/T286044 (10Jgreen) [20:08:00] 10fundraising-tech-ops, 10Patch-For-Review: Reconfigure fundraising public-reporting server role to fundraising-data - https://phabricator.wikimedia.org/T255435 (10Jgreen) [20:08:15] 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: update the docs on the civi-acoustic import and export scripts - https://phabricator.wikimedia.org/T286934 (10DStrine) [20:08:17] 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10fr-donorservices: Ingenico status 190s question - https://phabricator.wikimedia.org/T283524 (10DStrine) [20:09:37] 10fundraising-tech-ops: Fundraising access request for Joseph Mando - https://phabricator.wikimedia.org/T287026 (10Jgreen) 05duplicate→03Resolved [20:09:45] 10Fundraising-Backlog, 10FR-AutoTY-Email: Production of new Auto Recurring Failure Email (multilingual) - https://phabricator.wikimedia.org/T285375 (10DStrine) a:03Eileenmcnaughton [20:10:01] 10Fundraising-Backlog, 10FR-AutoTY-Email: Edit to Thank You Email footer in 13 languages - https://phabricator.wikimedia.org/T285383 (10DStrine) a:03Eileenmcnaughton [20:12:44] 10Fundraising-Backlog, 10FR-Adyen: Adyen Checkout: Make a rollback plan and test it - https://phabricator.wikimedia.org/T287039 (10DStrine) [20:20:09] 10Fundraising-Backlog: Sprint Goal: At least get credit cards working on prod - https://phabricator.wikimedia.org/T287043 (10DStrine) [20:22:01] 10Fundraising-Backlog, 10fundraising Sprint O 2021: Sprint Goal: At least get credit cards working on prod - https://phabricator.wikimedia.org/T287043 (10DStrine) [20:22:03] 10Fundraising-Backlog, 10fundraising Sprint O 2021, 10FR-Adyen: Adyen Checkout: Make a rollback plan and test it - https://phabricator.wikimedia.org/T287039 (10DStrine) [20:22:07] 10Fundraising-Backlog, 10fundraising Sprint O 2021, 10FR-France: Adding tax disambiguation clause to Payments Wiki in France - https://phabricator.wikimedia.org/T286880 (10DStrine) [20:22:09] 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10fundraising Sprint O 2021: update the docs on the civi-acoustic import and export scripts - https://phabricator.wikimedia.org/T286934 (10DStrine) [20:22:11] 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10fundraising Sprint O 2021: Test relationship giving history with search kit - https://phabricator.wikimedia.org/T286742 (10DStrine) [20:22:13] 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10fundraising Sprint O 2021: If check number is edited, contribution cannot be found in search - https://phabricator.wikimedia.org/T286495 (10DStrine) [20:22:15] 10Fundraising Sprint Mandatory corn dogs, 10Fundraising-Backlog, 10fundraising Sprint O 2021, 10FR-Adyen: Set up Adyen Apple pay test environment - https://phabricator.wikimedia.org/T285683 (10DStrine) [20:22:17] 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10fundraising Sprint O 2021, 10FR-Adyen, and 2 others: Adyen Checkout: Handle new shopper reference field - https://phabricator.wikimedia.org/T286739 (10DStrine) [20:22:19] 10Fundraising-Backlog, 10fundraising Sprint O 2021, 10FR-AutoTY-Email: Languages that need soft descriptor to be donate@wikimedia.org - https://phabricator.wikimedia.org/T285499 (10DStrine) [20:22:21] 10Fundraising-Backlog, 10fundraising Sprint O 2021, 10FR-AutoTY-Email: Edit to Thank You Email footer in 13 languages - https://phabricator.wikimedia.org/T285383 (10DStrine) [20:22:23] 10Fundraising-Backlog, 10fundraising Sprint O 2021, 10FR-AutoTY-Email: Production of new Auto Recurring Failure Email (multilingual) - https://phabricator.wikimedia.org/T285375 (10DStrine) [20:22:25] 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10fundraising Sprint O 2021, 10fr-donorservices, 10FR-Email: Recurring donors segmentation criteria Civi/Acoustic - https://phabricator.wikimedia.org/T283798 (10DStrine) [20:22:27] 10Fundraising Sprint Esperantoland, 10Fundraising Sprint File Systems Stage Show, 10Fundraising Sprint Git Rebase Jump, 10Fundraising Sprint Humongous bacteria petting zoo, and 10 others: Some of our CI tests are not running - https://phabricator.wikimedia.org/T285446 (10DStrine) [20:22:29] 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10fundraising Sprint O 2021: Wmf-donor - new year fields - https://phabricator.wikimedia.org/T280595 (10DStrine) [20:22:33] 10Fundraising-Backlog, 10fundraising Sprint O 2021, 10FR-Adyen, 10MediaWiki-extensions-DonationInterface: Adyen Checkout: Fine tune CSS - https://phabricator.wikimedia.org/T283306 (10DStrine) [20:22:35] 10Fundraising Sprint Mandatory corn dogs, 10Fundraising-Backlog, 10fundraising Sprint O 2021, 10fundraising sprint Legø Trampoline, and 2 others: Adyen Checkout: create new recurring iDEAL donations - https://phabricator.wikimedia.org/T284606 (10DStrine) [20:22:37] 10Fundraising Sprint Mandatory corn dogs, 10Fundraising-Backlog, 10fundraising Sprint O 2021, 10FR-Adyen, 10FR-Smashpig: Adyen Checkout: normalize API error codes - https://phabricator.wikimedia.org/T283307 (10DStrine) [20:22:39] 10Fundraising Sprint Mandatory corn dogs, 10Fundraising-Backlog, 10fundraising Sprint O 2021, 10FR-Adyen, 10FR-Smashpig: Adyen Checkout: handle authorization decline reasons - https://phabricator.wikimedia.org/T283117 (10DStrine) [20:22:42] 10Fundraising Sprint Ketchup Flume Ride, 10Fundraising Sprint Mandatory corn dogs, 10Fundraising-Backlog, 10fundraising Sprint O 2021, and 4 others: Adyen Checkout: get available payment methods - https://phabricator.wikimedia.org/T283627 (10DStrine) [20:22:47] 10Fundraising Sprint Ketchup Flume Ride, 10Fundraising Sprint Mandatory corn dogs, 10Fundraising-Backlog, 10fundraising Sprint O 2021, and 4 others: Handle iDEAL submission in Adyen Drop-In web - https://phabricator.wikimedia.org/T282595 (10DStrine) [20:22:53] 10Fundraising Sprint Mandatory corn dogs, 10Fundraising-Backlog, 10fundraising Sprint O 2021, 10fundraising sprint Legø Trampoline, and 4 others: Adyen Checkout: handle new recurring card donations - https://phabricator.wikimedia.org/T283106 (10DStrine) [20:22:59] 10Fundraising Sprint Ketchup Flume Ride, 10Fundraising Sprint Mandatory corn dogs, 10Fundraising-Backlog, 10fundraising Sprint O 2021, and 4 others: Handle 3DSecure for Adyen Checkout - https://phabricator.wikimedia.org/T282730 (10DStrine) [20:23:05] 10Fundraising Sprint Mandatory corn dogs, 10Fundraising-Backlog, 10fundraising Sprint O 2021, 10fundraising sprint Legø Trampoline, and 4 others: Handle fraud filters for Adyen Checkout - https://phabricator.wikimedia.org/T282641 (10DStrine) [20:23:09] 10Fundraising Sprint Mandatory corn dogs, 10Fundraising-Backlog, 10fundraising Sprint O 2021, 10FR-Adyen: Adyen Checkout: IPN listener no longer needs to capture payments - https://phabricator.wikimedia.org/T285962 (10DStrine) [20:23:15] 10Fundraising Sprint Mandatory corn dogs, 10Fundraising-Backlog, 10fundraising Sprint O 2021, 10FR-Adyen, 10MediaWiki-extensions-DonationInterface: Make errors in drop-in card fields look like other errors - https://phabricator.wikimedia.org/T281550 (10DStrine) [20:23:19] 10Fundraising Sprint Ketchup Flume Ride, 10Fundraising Sprint Mandatory corn dogs, 10Fundraising-Backlog, 10fundraising Sprint O 2021, and 5 others: Adyen: try to capture an old-style recurring with rest API - https://phabricator.wikimedia.org/T282302 (10DStrine) [20:23:23] 10Fundraising Sprint Ketchup Flume Ride, 10Fundraising Sprint Mandatory corn dogs, 10Fundraising-Backlog, 10fundraising Sprint O 2021, and 4 others: Time boxed adyen related code organizaiton/planning - https://phabricator.wikimedia.org/T282608 (10DStrine) [20:23:28] 10Fundraising Sprint Mandatory corn dogs, 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10fundraising Sprint O 2021, 10Patch-For-Review: Modification to Fredge Report - https://phabricator.wikimedia.org/T285321 (10DStrine) [20:23:32] 10Fundraising Sprint Ketchup Flume Ride, 10Fundraising Sprint Mandatory corn dogs, 10Fundraising-Backlog, 10fundraising Sprint O 2021, and 2 others: Creating New Donor Advised Fund Import - https://phabricator.wikimedia.org/T283104 (10DStrine) [20:23:36] 10Fundraising Sprint Interstitial ads halfway down the coaster hill, 10Fundraising Sprint Ketchup Flume Ride, 10Fundraising Sprint Mandatory corn dogs, 10Fundraising-Backlog, and 3 others: deprecate and or move wikitech documentation to Mediawiki - https://phabricator.wikimedia.org/T281304 (10DStrine) [20:23:42] 10Fundraising Sprint Ketchup Flume Ride, 10Fundraising Sprint Mandatory corn dogs, 10Fundraising-Backlog, 10fundraising Sprint O 2021, and 5 others: Handle Apple Pay submission in Adyen Components - https://phabricator.wikimedia.org/T282596 (10DStrine) [20:23:46] 10Fundraising Sprint Ketchup Flume Ride, 10Fundraising Sprint Mandatory corn dogs, 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, and 4 others: Benefactor Page Listing Custom field - https://phabricator.wikimedia.org/T281268 (10DStrine) [20:23:50] 10Fundraising Sprint Airline Passenger Experience, 10Fundraising Sprint Bee Wheel, 10Fundraising Sprint Corrugated super slide, 10Fundraising Sprint Downed power line jump rope, and 22 others: Fr-tech chores list - https://phabricator.wikimedia.org/T258527 (10DStrine) [20:23:54] 10Fundraising Sprint Esperantoland, 10Fundraising Sprint File Systems Stage Show, 10Fundraising Sprint Git Rebase Jump, 10Fundraising Sprint Humongous bacteria petting zoo, and 10 others: Update Fundraising tech CI image to use upstream buildkit, no symlink for civ... - https://phabricator.wikimedia.org/T277500 [20:49:17] fr-tech, this is the onboarding dock I mentioned that Dami is working through https://collab.wikimedia.org/wiki/Fundraising/Engineering/Draft:OnboardingDoc [20:49:24] well, one of them... [20:49:27] :) [20:49:53] s/Dami/damilare/ [20:51:13] bye for now fr-tech [21:17:22] :) [21:24:22] 10Fundraising-Backlog, 10fundraising-tech-ops, 10FR-Tech-Analytics: Fundraising Access for Joseph Mando - https://phabricator.wikimedia.org/T286556 (10Dwisehaupt) [21:25:44] 10Fundraising-Backlog, 10fundraising-tech-ops, 10FR-Tech-Analytics: Fundraising Access for Joseph Mando - https://phabricator.wikimedia.org/T286556 (10Dwisehaupt) yubikey and ssh keys added and propagated throughout the hosts. mysql grants updated with password. grants applied to frdev and frdb1003. .my.cnf... [21:28:23] cstone so let's see what's left for recurring... [21:30:51] (03CR) 10Ejegg: [C: 04-1] "OK, looks like we DO need to move the addResponseData bits into the handleCreatedPayment function so it works for 3DS and iDEAL." (031 comment) [extensions/DonationInterface] (adyen) - 10https://gerrit.wikimedia.org/r/702762 (https://phabricator.wikimedia.org/T283106) (owner: 10Cstone) [21:30:59] oh yeah i was testing that change for 3ds locally ejegg it was looking good [21:31:08] great! [21:32:05] giant thunderstorm band is rolling through here so I was just closing everything up then I'll get back to that [21:32:14] exciting [21:33:19] ejegg, we technically have our 1:1 right now, but I didn't have much this time so if you're working on Adyen stuff and want to just keep at it, that's fine by me. [21:33:29] Also happy to jump on the call if you had something. [21:33:42] oops, sure, I guess I don't have anything specific from my end [21:34:06] Cool, yea Adyen was all I was interested in, and we covered that plenty at sprint planning. [21:34:13] ok, cool! [21:46:26] cstone I'mma make another little patch for a new kind of response [21:46:45] Feels like the saved payment methods should have a separate class [21:49:13] 10Fundraising-Backlog, 10fundraising-tech-ops, 10FR-Tech-Analytics: Fundraising Access for Joseph Mando - https://phabricator.wikimedia.org/T286556 (10Dwisehaupt) [21:50:26] 10Fundraising-Backlog, 10fundraising-tech-ops, 10FR-Tech-Analytics: Fundraising Access for Joseph Mando - https://phabricator.wikimedia.org/T286556 (10Dwisehaupt) 05Open→03Resolved Walked through an ssh connection and have independently verified mysql access is working. Closing this out. Please open anot... [21:57:02] oh hmm, storedPaymentMethods for ideal is a bit different [21:57:17] dstrine this is the one of the ones we pulled in that is a bit of a big dev lift - https://phabricator.wikimedia.org/T286965 (although not a big review lift). It is probably > 2 [21:57:17] If we keep it in it should probably be low priority & I can do it if I get to it / have time that can't otherwise be used productively [21:58:23] 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10fundraising Sprint NULL calorie food cart: Wmf-donor - new year fields - https://phabricator.wikimedia.org/T280595 (10Eileenmcnaughton) a:03Eileenmcnaughton [21:59:19] 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10fundraising Sprint NULL calorie food cart, 10FR-Adyen, and 2 others: Adyen Checkout: Handle new shopper reference field - https://phabricator.wikimedia.org/T286739 (10Ejegg) Hmm, here's what we get back for a sandbox iDEAL payment that was tokenized... [22:00:54] (03PS3) 10Eileen: Move the custom fields definition to a more logical place [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/705614 (https://phabricator.wikimedia.org/T281268) [22:45:24] re: conversation earlier, at what point would we have a single log line with the info for a donation that would have what we need to rebuild a url? [22:45:35] would that be in the processor specific payments logs? [22:47:31] dwisehaupt: just thinking about that [22:47:43] so the first hit is often to the gateway form chooser [22:47:48] and it would be nice to get that URL [22:49:05] at that point, we don't have a contribution_tracking_id, but we could log the mediawiki session id (which is logged again later associated with the ct_id) [22:52:19] what i'm seeing super useful are the lines with "Redirecting for transaction:" but that may be too late in the flow since all of them have ct_id's at that point. [22:52:40] yep dwisehaupt that's the best we currently have [22:53:07] but those would be missing for folks who hit errors before we get to the point of sending them to the payment processor [22:53:15] there may be something better in the access logs but those are on the payments hosts only. [22:53:19] right [22:55:53] hrm. [22:55:55] 10Fundraising Sprint Mandatory corn dogs, 10Fundraising-Backlog, 10fundraising Sprint NULL calorie food cart, 10FR-Adyen, 10FR-Smashpig: Adyen Checkout: normalize API error codes - https://phabricator.wikimedia.org/T283307 (10Cstone) Here is an example error response: { "body": { "status": 42... [22:56:19] ok. i'll keep thinking. [22:57:40] this is one of those places where logstash/ELK can do good things. you can piece together portions of the logs and do transforms but still keep separation of data. that would be a pretty major undertaking for us to roll out for our hosts. [23:16:16] 10Fundraising-Backlog, 10fundraising-tech-ops: User needs Terminal access to Fredge - https://phabricator.wikimedia.org/T283871 (10Dwisehaupt) Hello @RKumar_WMF , I just wanted to check back in and see if you were able to get the yubikey or adapter sorted out. [23:36:36] ejegg: it turns out that adding -vv (at the end of the line it seems) does add verbosity to the drupal output - although probably only at bootstrap [23:37:26] - it's not doing it when I run process control but I'm trying the line directly on the command line with -vv at the end