[00:35:26] (03PS1) 10Eileen: Add in subset name resolver [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1059523 [00:54:47] (03CR) 10CI reject: [V:04-1] Add in subset name resolver [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1059523 (owner: 10Eileen) [04:19:37] (03PS5) 10Eileen: Update deduper with fixes merged upstream [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1058727 (https://phabricator.wikimedia.org/T363965) [07:02:11] (03CR) 10Thiemo Kreuz (WMDE): [C:03+2] "The test failure appears to be unrelated. Still the problem needs to be fixed (ideally in a separate patch) to unblock the CI pipeline for" [extensions/FundraisingTranslateWorkflow] - 10https://gerrit.wikimedia.org/r/1059500 (owner: 10Fomafix) [07:13:18] (03CR) 10CI reject: [V:04-1] Use overrideConfigValue instead of setMwGlobals [extensions/FundraisingTranslateWorkflow] - 10https://gerrit.wikimedia.org/r/1059500 (owner: 10Fomafix) [12:36:56] (03PS1) 10Fomafix: Use overrideConfigValue/overrideConfigValues instead of setMwGlobals [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1059880 [13:27:24] 03Fundraising Sprint: ogFunction(), 06Fundraising-Backlog, 10MW-1.43-notes (1.43.0-wmf.17; 2024-08-06), 13Patch-For-Review: Annual Recurring as Post-Payment Option - https://phabricator.wikimedia.org/T368155#10042066 (10Ejegg) >>! In T368155#10033082, @MSuijkerbuijk_WMF wrote: > Posting here the final vari... [13:49:44] 03Fundraising Sprint: ogFunction(), 06Fundraising-Backlog, 07payments-orchestration: Gravy 3DSecure - https://phabricator.wikimedia.org/T367786#10042099 (10Damilare) a:03Damilare [13:57:52] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10FR-Adyen, 10FR-Smashpig, 10Recurring-Donations: Adyen listener sends recurring installment to queue with no recurring ID or token - https://phabricator.wikimedia.org/T371808 (10Ejegg) 03NEW [14:06:58] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10FR-Adyen, 10FR-Smashpig, 10Recurring-Donations: Adyen listener sends recurring installment to queue with no recurring ID or token - https://phabricator.wikimedia.org/T371808#10042140 (10Ejegg) The donation also seems to be recorded already, direct... [14:27:55] 06Fundraising-Backlog, 07payments-orchestration: Gravy ACH (Trustly) - https://phabricator.wikimedia.org/T371810 (10jgleeson) 03NEW [14:29:59] 06Fundraising-Backlog, 07payments-orchestration: Gravy SEPA (Trustly) - https://phabricator.wikimedia.org/T371811 (10jgleeson) 03NEW [14:32:54] 06Fundraising-Backlog, 07payments-orchestration: Gravy Audit/Settlement Processing (Trustly) - https://phabricator.wikimedia.org/T371812 (10jgleeson) 03NEW [14:33:47] 06Fundraising-Backlog, 07payments-orchestration: Gravy Audit/Settlement Processing (Trustly) - https://phabricator.wikimedia.org/T371812#10042231 (10jgleeson) [14:33:48] 03Fundraising Sprint: ogFunction(), 06Fundraising-Backlog, 07payments-orchestration: Gravy Audit/Settlement Processing - https://phabricator.wikimedia.org/T367788#10042232 (10jgleeson) [14:34:51] 03Fundraising Sprint: ogFunction(), 06Fundraising-Backlog, 07payments-orchestration: Gravy Audit/Settlement Processing (Adyen) - https://phabricator.wikimedia.org/T367788#10042238 (10jgleeson) [14:34:58] 06Fundraising-Backlog, 07payments-orchestration: Gravy Audit/Settlement Processing (Trustly) - https://phabricator.wikimedia.org/T371812#10042240 (10jgleeson) [14:34:59] 03Fundraising Sprint: ogFunction(), 06Fundraising-Backlog, 07payments-orchestration: Gravy Audit/Settlement Processing (Adyen) - https://phabricator.wikimedia.org/T367788#10042241 (10jgleeson) [14:36:26] 03Fundraising Sprint: ogFunction(), 06Fundraising-Backlog, 07payments-orchestration: Gravy Audit/Settlement Processing - https://phabricator.wikimedia.org/T367788#10042252 (10jgleeson) [14:38:27] 06Fundraising-Backlog, 07payments-orchestration: Gravy Audit/Settlement Processing (Trustly) - https://phabricator.wikimedia.org/T371812#10042256 (10jgleeson) [14:38:28] 06Fundraising-Backlog, 07payments-orchestration: Gravy Audit/Settlement Processing (Adyen) - https://phabricator.wikimedia.org/T371813 (10jgleeson) 03NEW [14:38:31] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10MW-1.43-notes (1.43.0-wmf.16; 2024-07-30), 13Patch-For-Review: Add Address field, Description of service and PAN for any donation above INR 250k INR /3K USD - https://phabricator.wikimedia.org/T370583#10042255 (10Ejegg) So we want a state dropdown f... [14:38:51] (03PS1) 10Ejegg: Add state list for India [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1059895 (https://phabricator.wikimedia.org/T370583) [14:41:46] (03PS7) 10Jgleeson: Map gravy buyer ID to external_identifier queue message field. [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1056527 (https://phabricator.wikimedia.org/T368039) [14:53:30] (03PS1) 10Ejegg: Add state & postal code to India forms [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1059896 (https://phabricator.wikimedia.org/T370583) [15:17:00] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10FR-dlocal: Dlocal pending txn resolver tried to cancel authorized payment, got an error - https://phabricator.wikimedia.org/T371815 (10Ejegg) 03NEW [16:03:25] 03Fundraising Sprint: ogFunction(), 06Fundraising-Backlog, 10MW-1.43-notes (1.43.0-wmf.17; 2024-08-06), 13Patch-For-Review: Annual Recurring as Post-Payment Option - https://phabricator.wikimedia.org/T368155#10042746 (10MSuijkerbuijk_WMF) @Ejegg I've updated the copy https://docs.google.com/document/d/121z... [17:06:04] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: Local part of Email Address is Blocked - https://phabricator.wikimedia.org/T371838 (10AnnWF) 03NEW [17:06:13] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: Local part of Email Address is Blocked - https://phabricator.wikimedia.org/T371838#10043048 (10AnnWF) p:05Triage→03Low [17:15:44] 14Fundraising Sprint: meow(), 03Fundraising Sprint: ogFunction(), 06Fundraising-Backlog, 07payments-orchestration: Add Gravy UML Diagrams - https://phabricator.wikimedia.org/T369105#10043074 (10AnnWF) Looks good, thanks Jack :) [17:56:39] thanks for the review wfan [17:56:42] ! [17:57:20] np, looks really well~ [18:36:41] 06Fundraising-Backlog, 10FR-Paypal: Really fix PayPal fluctuating subscr_id problem - https://phabricator.wikimedia.org/T371845#10043309 (10Ejegg) [18:37:02] oops, hit enter too quick on that one. needs description [18:40:52] 06Fundraising-Backlog, 10FR-Paypal: Really fix PayPal fluctuating subscr_id problem - https://phabricator.wikimedia.org/T371845#10043313 (10Ejegg) See https://phabricator.wikimedia.org/T355448 Somehow this contact got its recurring subscr_id updated from a S-* one to an I-* one https://civicrm.wikimedia.org/c... [18:41:21] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-Paypal: Really fix PayPal fluctuating subscr_id problem - https://phabricator.wikimedia.org/T371845#10043316 (10Ejegg) [18:43:31] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-Paypal: Really fix PayPal fluctuating subscr_id problem - https://phabricator.wikimedia.org/T371845#10043337 (10Ejegg) [18:52:14] (03PS1) 10Damilare Adedoyin: WIP: Handle Report execution webhook message [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1059932 (https://phabricator.wikimedia.org/T370797) [18:52:32] (03PS29) 10Damilare Adedoyin: Setup listener for transaction event message. [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1056531 (https://phabricator.wikimedia.org/T370797) [18:52:38] (03PS14) 10Damilare Adedoyin: ProcessCaptureRequestJob for authorization messages [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1057937 (https://phabricator.wikimedia.org/T370797) [18:52:43] (03PS8) 10Damilare Adedoyin: Record capture job [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1058580 (https://phabricator.wikimedia.org/T370797) [18:52:46] (03CR) 10CI reject: [V:04-1] WIP: Handle Report execution webhook message [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1059932 (https://phabricator.wikimedia.org/T370797) (owner: 10Damilare Adedoyin) [18:52:54] (03PS10) 10Damilare Adedoyin: Setup Refunds method and maintenance script [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1059078 (https://phabricator.wikimedia.org/T367808) [18:53:07] (03PS5) 10Damilare Adedoyin: Refund job [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1059356 (https://phabricator.wikimedia.org/T370797) [18:53:23] (03PS2) 10Damilare Adedoyin: WIP: Handle Report execution webhook message [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1059932 (https://phabricator.wikimedia.org/T370797) [18:53:47] (03PS3) 10Damilare Adedoyin: WIP: Handle Report execution webhook message [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1059932 (https://phabricator.wikimedia.org/T370797) [18:54:20] (03CR) 10CI reject: [V:04-1] WIP: Handle Report execution webhook message [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1059932 (https://phabricator.wikimedia.org/T370797) (owner: 10Damilare Adedoyin) [18:55:30] (03PS4) 10Damilare Adedoyin: WIP: Handle Report execution webhook message [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1059932 (https://phabricator.wikimedia.org/T370797) [18:56:08] (03CR) 10CI reject: [V:04-1] WIP: Handle Report execution webhook message [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1059932 (https://phabricator.wikimedia.org/T370797) (owner: 10Damilare Adedoyin) [18:57:33] (03PS5) 10Damilare Adedoyin: WIP: Handle Report execution webhook message [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1059932 (https://phabricator.wikimedia.org/T370797) [19:01:14] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10MW-1.43-notes (1.43.0-wmf.16; 2024-07-30), 13Patch-For-Review: Add Address field, Description of service and PAN for any donation above INR 250k INR /3K USD - https://phabricator.wikimedia.org/T370583#10043380 (10Ejegg) Waiting for DLocal to reply t... [19:04:58] 14Fundraising Sprint: ick(), 06Fundraising-Backlog: Update text for recurring upgrade thank you email - https://phabricator.wikimedia.org/T371848 (10Ejegg) 03NEW [19:07:29] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10Recurring-Donations, 07recurring upgrade: Update text for recurring upgrade thank you email - https://phabricator.wikimedia.org/T371848#10043399 (10Ejegg) [19:08:03] 03Fundraising Sprint: ogFunction(), 06Fundraising-Backlog, 10MW-1.43-notes (1.43.0-wmf.17; 2024-08-06), 13Patch-For-Review: Annual Recurring as Post-Payment Option - https://phabricator.wikimedia.org/T368155#10043396 (10Ejegg) @MSuijkerbuijk_WMF one more thing we'll need before this goes live: T371848 [19:14:59] (03PS6) 10Damilare Adedoyin: Handle Report execution webhook message [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1059932 (https://phabricator.wikimedia.org/T370797) [19:21:38] hey damilare it looks like there's some cross over in your patch to the stuff I'm working on [19:21:53] I'm working on https://phabricator.wikimedia.org/T367788 [19:22:30] I noticed in your patch your also hitting the report stuff https://gerrit.wikimedia.org/r/c/wikimedia/fundraising/SmashPig/+/1059932/6/PaymentProviders/Gravy/PaymentProvider.php [19:22:58] ohh sorry jgleeson I had a feeling that might happen [19:23:14] well I just wanted to cover all the message payload cases [19:23:28] hmm [19:23:30] that we would be interested in for that class [19:23:38] https://docs.gr4vy.com/guides/features/webhooks/payload [19:24:08] I haven't setup the job yet though, this just pushes the reoirt url to the queue [19:24:12] report* [19:25:35] I had it in my head we were gonna request these on a schedule [19:26:01] and then I guess they will send us the URL when generated via webhook [19:26:17] so is your piece just getting the IPN and saving the URL to a queue? [19:26:32] damilare: ^ [19:26:37] yep, the payload shows no url is in the initial ipn [19:26:59] so ipn -> execution details -> url [19:28:03] I was going to test the flow after the last patch to confirm that the execution payload is sent on the schedule [19:30:55] so just so I understand where your stuff ends and mine begins. currently the IPN comes in, you go out and fetch/build a URL and then that goes on a queue. I imagine I then consume the queue item, download the file and process it. is that the flow you have in your head damilare ? [19:32:21] yeah that could work jgleeson, my initial thought was that phab was simply for the consume. [19:32:44] which one [19:32:54] the phab you're working on [19:38:39] 06Fundraising-Backlog: India Recurring - Add retry and cancellation flow for failed recurrings - https://phabricator.wikimedia.org/T362191#10043441 (10XenoRyet) [19:40:17] 14Fundraising Sprint: justWork(), 14Fundraising Sprint: meow(), 03Fundraising Sprint: ogFunction(), 06Fundraising-Backlog: Re-try data prior to Auto-Rescue was enabled - https://phabricator.wikimedia.org/T365348#10043442 (10Cstone) a:03Cstone [19:42:02] 14Fundraising Sprint: meow(), 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 13Patch-For-Review: Consolidate error handling in queues - https://phabricator.wikimedia.org/T365418#10043446 (10XenoRyet) [19:42:33] 14Fundraising Sprint: justWork(), 14Fundraising Sprint: meow(), 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 13Patch-For-Review: On import, widen the existing contact lookup to include subset & reversed - https://phabricator.wikimedia.org/T365216#10043447 (10XenoRyet) [19:45:49] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-Paypal: Really fix PayPal fluctuating subscr_id problem - https://phabricator.wikimedia.org/T371845#10043458 (10XenoRyet) p:05Triage→03Medium [19:46:23] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10FR-dlocal: Dlocal pending txn resolver tried to cancel authorized payment, got an error - https://phabricator.wikimedia.org/T371815#10043461 (10XenoRyet) p:05Triage→03Low [19:47:00] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10FR-Adyen, 10FR-Smashpig, 10Recurring-Donations: Adyen listener sends recurring installment to queue with no recurring ID or token - https://phabricator.wikimedia.org/T371808#10043462 (10XenoRyet) p:05Triage→03Low [19:54:34] 06Fundraising-Backlog, 10FR-Tech-Analytics, 10FR-tech-data-integrity: Banner Closed Status Code Increase Year over Year - https://phabricator.wikimedia.org/T371632#10043554 (10XenoRyet) p:05Triage→03High [19:55:08] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10FR-Tech-Analytics, 10FR-tech-data-integrity: Banner Closed Status Code Increase Year over Year - https://phabricator.wikimedia.org/T371632#10043560 (10XenoRyet) [19:58:22] 03Fundraising Sprint: ogFunction(), 06Fundraising-Backlog, 10Recurring-Donations: Implement Post-Payment Monthly Convert variant for testing - https://phabricator.wikimedia.org/T371523#10043588 (10XenoRyet) [20:02:13] PROBLEM - check_redis on frqueue1004 is CRITICAL: CRITICAL: payments-antifraud is 25120 10000 - REDIS 6.0.16 on 127.0.0.1:6379 has 1 databases (db0) with 13 keys, up 75 days 2 hours - memory use is 274.17M (peak 275.80M, 3.51% of max, fragmentation 1.05%), connected_slaves is 4, donations is 33, jobs is 0, jobs-adyen is 1, jobs-dlocal is 0, jobs-paypal is 0, payments-init is 4, pending is 0, recurring is 1, refund is 0, unsubscribe is 0 [20:02:13] cinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frqueue1004&service=check_redis [20:06:44] 06Fundraising-Backlog: Migration of India recurring to an alternate dlocal processor - https://phabricator.wikimedia.org/T371723#10043603 (10Damilare) [20:07:11] PROBLEM - check_redis on frqueue1004 is CRITICAL: CRITICAL: payments-antifraud is 36685 10000 - REDIS 6.0.16 on 127.0.0.1:6379 has 1 databases (db0) with 12 keys, up 75 days 3 hours - memory use is 282.31M (peak 283.79M, 3.61% of max, fragmentation 1.05%), connected_slaves is 4, donations is 13, jobs is 0, jobs-adyen is 6, jobs-dlocal is 0, jobs-paypal is 0, payments-init is 0, pending is 0, recurring is 2, refund is 0, unsubscribe is 0 [20:07:11] cinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frqueue1004&service=check_redis [20:10:36] 06Fundraising-Backlog: Tweak Zendesk API integration - https://phabricator.wikimedia.org/T371705#10043606 (10Damilare) [20:12:11] PROBLEM - check_redis on frqueue1004 is CRITICAL: CRITICAL: payments-antifraud is 47211 10000 - REDIS 6.0.16 on 127.0.0.1:6379 has 1 databases (db0) with 13 keys, up 75 days 3 hours - memory use is 284.37M (peak 292.05M, 3.66% of max, fragmentation 1.06%), connected_slaves is 4, donations is 20, jobs is 0, jobs-adyen is 14, jobs-dlocal is 0, jobs-paypal is 0, payments-init is 9, pending is 0, recurring is 4, refund is 0, unsubscribe is 0 [20:12:11] icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frqueue1004&service=check_redis [20:12:24] 14Fundraising Sprint: justWork(), 14Fundraising Sprint: meow(), 03Fundraising Sprint: ogFunction(), 06Fundraising-Backlog, and 3 others: Make email custom fields editable from contact summary, upstream patch - https://phabricator.wikimedia.org/T366356#10043610 (10Damilare) [20:13:28] 14Fundraising Sprint: justWork(), 14Fundraising Sprint: meow(), 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 13Patch-For-Review: On import, widen the existing contact lookup to include subset & reversed - https://phabricator.wikimedia.org/T365216#10043612 (10Damilare) [20:15:51] ACKNOWLEDGEMENT - check_redis on frqueue1004 is CRITICAL: CRITICAL: payments-antifraud is 47211 10000 - REDIS 6.0.16 on 127.0.0.1:6379 has 1 databases (db0) with 13 keys, up 75 days 3 hours - memory use is 284.37M (peak 292.05M, 3.66% of max, fragmentation 1.06%), connected_slaves is 4, donations is 20, jobs is 0, jobs-adyen is 14, jobs-dlocal is 0, jobs-paypal is 0, payments-init is 9, pending is 0, recurring is 4, refund is 0, unsubscr [20:15:51] Dwisehaupt known fraud wave. https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frqueue1004&service=check_redis [20:23:20] I think I sorted Quim's issue [21:17:11] RECOVERY - check_redis on frqueue1004 is OK: OK: REDIS 6.0.16 on 127.0.0.1:6379 has 1 databases (db0) with 9 keys, up 75 days 4 hours - memory use is 257.81M (peak 324.28M, 3.33% of max, fragmentation 1.06%), connected_slaves is 4, donations is 0, jobs is 0, jobs-adyen is 0, jobs-dlocal is 0, jobs-paypal is 0, payments-antifraud is 0, payments-init is 0, pending is 0, recurring is 2, refund is 0, unsubscribe is 0 https://icinga.wikimedia [21:17:11] bin/icinga/extinfo.cgi?type=2&host=frqueue1004&service=check_redis [22:02:25] (03PS1) 10Eileen: Not for merge Civi5.77-alpha [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1059946 [23:10:01] (03PS1) 10Eileen: Wip query optimal [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1059949 [23:10:01] (03PS1) 10Eileen: [wip] More query [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1059950