[01:42:43] (03PS1) 10Eileen: Move custom field handling from apiv3 to BAO [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1144700 (https://phabricator.wikimedia.org/T379702) [02:02:26] (03CR) 10CI reject: [V:04-1] Move custom field handling from apiv3 to BAO [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1144700 (https://phabricator.wikimedia.org/T379702) (owner: 10Eileen) [02:13:03] 03Fundraising Sprint Impossible shepherds pie, 14Fundraising Sprint: Hot Pot!, 06Fundraising-Backlog: Rearrange adyen audit columns in the settlement report to match the default - https://phabricator.wikimedia.org/T392528#10814619 (10Cstone) I added the three above columns to both the test and production set... [02:32:19] (03PS2) 10Eileen: Move custom field handling from apiv3 to BAO [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1144700 (https://phabricator.wikimedia.org/T379702) [02:32:19] (03PS1) 10Eileen: Switch Omnigroupmember.load to apiv4 [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1144712 (https://phabricator.wikimedia.org/T379702) [02:52:28] (03CR) 10CI reject: [V:04-1] Switch Omnigroupmember.load to apiv4 [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1144712 (https://phabricator.wikimedia.org/T379702) (owner: 10Eileen) [03:04:55] (03PS2) 10Eileen: Switch Omnigroupmember.load to apiv4 [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1144712 (https://phabricator.wikimedia.org/T379702) [03:24:14] (03CR) 10CI reject: [V:04-1] Switch Omnigroupmember.load to apiv4 [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1144712 (https://phabricator.wikimedia.org/T379702) (owner: 10Eileen) [03:33:40] (03PS3) 10Eileen: Switch Omnigroupmember.load to apiv4 [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1144712 (https://phabricator.wikimedia.org/T379702) [03:53:49] (03CR) 10CI reject: [V:04-1] Switch Omnigroupmember.load to apiv4 [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1144712 (https://phabricator.wikimedia.org/T379702) (owner: 10Eileen) [04:35:14] 03Fundraising Sprint Impossible shepherds pie, 14Fundraising Sprint: Hot Pot!, 06Fundraising-Backlog, 07fr-acoustic, 13Patch-For-Review: Develop process for tracking & handling SMS consent records - https://phabricator.wikimedia.org/T379702#10814751 (10Eileenmcnaughton) @bsisolak I have been trying to re... [04:36:47] 06Fundraising-Backlog: Enable Bank transfer in Peru - https://phabricator.wikimedia.org/T393987 (10RKumar_WMF) 03NEW [04:37:04] 06Fundraising-Backlog: Enable Bank transfer in Peru - https://phabricator.wikimedia.org/T393987#10814766 (10RKumar_WMF) Enable bank transfer in Peru via Gr4vy. [04:51:29] (03PS4) 10Eileen: Switch Omnigroupmember.load to apiv4 [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1144712 (https://phabricator.wikimedia.org/T379702) [05:10:19] (03CR) 10CI reject: [V:04-1] Switch Omnigroupmember.load to apiv4 [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1144712 (https://phabricator.wikimedia.org/T379702) (owner: 10Eileen) [05:15:10] (03PS5) 10Eileen: Switch Omnigroupmember.load to apiv4 [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1144712 (https://phabricator.wikimedia.org/T379702) [05:34:40] (03CR) 10CI reject: [V:04-1] Switch Omnigroupmember.load to apiv4 [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1144712 (https://phabricator.wikimedia.org/T379702) (owner: 10Eileen) [05:55:08] (03PS6) 10Eileen: Switch Omnigroupmember.load to apiv4 [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1144712 (https://phabricator.wikimedia.org/T379702) [05:58:09] (03CR) 10Abijeet Patro: [V:03+2] Localisation updates from https://translatewiki.net. [extensions/DonationInterface] (REL1_39) - 10https://gerrit.wikimedia.org/r/1144035 (owner: 10L10n-bot) [06:13:32] (03CR) 10CI reject: [V:04-1] Switch Omnigroupmember.load to apiv4 [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1144712 (https://phabricator.wikimedia.org/T379702) (owner: 10Eileen) [06:18:20] PROBLEM - check_load on frav1003 is CRITICAL: LOAD CRITICAL - total load average: 39.02, 15.49, 9.66 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_load [06:20:09] (03PS7) 10Eileen: Switch Omnigroupmember.load to apiv4 [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1144712 (https://phabricator.wikimedia.org/T379702) [06:28:16] RECOVERY - check_load on frav1003 is OK: LOAD OK - total load average: 3.32, 6.06, 7.55 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_load [06:43:59] (03CR) 10CI reject: [V:04-1] Localisation updates from https://translatewiki.net. [extensions/DonationInterface] (REL1_43) - 10https://gerrit.wikimedia.org/r/1144840 (owner: 10L10n-bot) [06:51:12] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: India failed transactions - https://phabricator.wikimedia.org/T393553#10814873 (10RKumar_WMF) From Adyen" there is no specific pre-requisite requiring you to collect phone numbers from shoppers for these transactions. For your reference, you can find c... [08:39:16] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10MW-1.45-notes (1.45.0-wmf.1; 2025-05-13): Japan credit card processing error - https://phabricator.wikimedia.org/T393939#10815240 (10jgleeson) a:03jgleeson [08:54:18] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: Mass Card Declines Following Japan Email 1 - https://phabricator.wikimedia.org/T394007 (10jgleeson) 03NEW [09:01:16] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: Temporarily turn off AVS checks while Japan campaigns are in progress - https://phabricator.wikimedia.org/T393930#10815382 (10jgleeson) Slack thread on this is [[ https://wikimedia.slack.com/archives/C045WH0QYS2/p1747068729749109 | here ]] [09:20:39] (03PS1) 10Jgleeson: Add Gravy Japan test links [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/1145105 (https://phabricator.wikimedia.org/T394007) [09:24:33] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 13Patch-For-Review: Mass Card Declines Following Japan Email 1 - https://phabricator.wikimedia.org/T394007#10815425 (10jgleeson) JCB is working on a sandbox, so that rules out a payment configuration issue. I was able to donate successfully via sandbox... [09:43:10] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 13Patch-For-Review: Mass Card Declines Following Japan Email 1 - https://phabricator.wikimedia.org/T394007#10815456 (10jgleeson) I'm seeing thousands of errors coming back from the Gravy 3D-Secure service https://service.3dsecure.io/auth: ` { "error... [10:11:22] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 13Patch-For-Review: Mass Card Declines Following Japan Email 1 - https://phabricator.wikimedia.org/T394007#10815534 (10jgleeson) I've reached out to Gravy about this on [[ https://wikimedia.slack.com/archives/C070F1DVBRN/p1747129784453299 | Slack ]]. [10:44:00] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 13Patch-For-Review: Mass Card Declines Following Japan Email 1 - https://phabricator.wikimedia.org/T394007#10815687 (10jgleeson) After discussing the issue with Gravy, it looks like the problem is the JCB 3d-secure settings that were set up in the Gravy... [11:02:48] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 13Patch-For-Review: Mass Card Declines Following Japan Email 1 - https://phabricator.wikimedia.org/T394007#10815763 (10jgleeson) In the meantime, we're going to start redirecting all Japanese donor traffic directly to Adyen whilst we fix the issue at th... [11:24:55] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 13Patch-For-Review: Mass Card Declines Following Japan Email 1 - https://phabricator.wikimedia.org/T394007#10815804 (10jgleeson) Japanese traffic is now being sent directly to Adyen. I've emailed Adyen explaining the issue and will wait for their resp... [12:58:56] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 13Patch-For-Review: Mass Card Declines Following Japan Email 1 - https://phabricator.wikimedia.org/T394007#10816183 (10jgleeson) p:05Triage→03High [13:56:17] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 06FR-donorrelations, 13Patch-For-Review: Mass Card Declines Following Japan Email 1 - https://phabricator.wikimedia.org/T394007#10816465 (10MBeat33) [13:59:46] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10fundraising-tech-ops: Several Silverpop failmail updates this week - https://phabricator.wikimedia.org/T393830#10816493 (10AKanji-WMF) 05Open→03Resolved a:03AKanji-WMF Thanks @Dwisehaupt . Looks like today's sends are good to go, resolving t... [14:10:29] 06Fundraising-Backlog, 06Fundraising-Tech-Roadmap, 06FR-donorrelations: Feature request assessment: Zendesk macro updater - https://phabricator.wikimedia.org/T387503#10816555 (10AKanji-WMF) Just to update, aspirationally this is in the queue to scope more in June 2025. [14:11:35] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10FR-Tech-Analytics, 10FR-tech-data-integrity: Null backend_processor for gravy records in civi - https://phabricator.wikimedia.org/T393477#10816565 (10jgleeson) Quick update: @JMando, we've backfilled the affected records highlighted in your initial... [14:41:23] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: Verify which countries we need a 'fiscal_number' to process a payment on Gravy - https://phabricator.wikimedia.org/T394051 (10jgleeson) 03NEW [14:42:37] (03PS1) 10Jgleeson: Remove MY from countries which require a fiscal number [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1145238 (https://phabricator.wikimedia.org/T394051) [14:47:04] fr-tech, I just pushed up a patch to remove Malaysia from the list of countries requiring a fiscal number https://gerrit.wikimedia.org/r/c/wikimedia/fundraising/SmashPig/+/1145238 [14:47:11] I've mistakenly added it to the config when I originally added the list, and unfortunately, it's not come up whilst testing, so we haven't caught it until now. After tripping up on this same issue yesterday with Japan, I've also created a ticket to double-check the entire list. https://phabricator.wikimedia.org/T394051 [14:48:18] I have to pop out to pick the kids up from school. If possible could someone also deploy that? If not, I'll get back on it when I get back. Thanks in advance! [14:53:28] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10FR-Tech-Analytics, 10FR-tech-data-integrity: Null backend_processor for gravy records in civi - https://phabricator.wikimedia.org/T393477#10816873 (10JMando) @jgleeson thank you! Just confirmed everything looks good in the database from my end. [15:12:02] back. fr-tech I'm gonna self-merge that Malaysia patch to get that out as the campaign is live [15:12:59] I'm here too now jgleeson if you want someone else to do it [15:13:40] (03CR) 10Cstone: [C:03+2] Remove MY from countries which require a fiscal number [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1145238 (https://phabricator.wikimedia.org/T394051) (owner: 10Jgleeson) [15:13:49] thanks cstone !! [15:14:03] I'll get that out [15:14:05] queue the wait! [15:14:09] (03Merged) 10jenkins-bot: Remove MY from countries which require a fiscal number [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1145238 (https://phabricator.wikimedia.org/T394051) (owner: 10Jgleeson) [15:14:29] jgleeson: do we want to move that kind of setting to a yaml file so we dont have to deploy everything? [15:15:26] hmm [15:16:59] so, the 1 hour to deploy, that's due to waiting for CI to merge things? I thought we had our own pipeline in Zuul... [15:17:49] so that list is telling the smashpig validator whether or not we should expect a fiscal number. I guess we could extract it out to a different config format and put it in the smashpig gravy config. Would that mean we still don't need to tag smashpig? [15:18:05] greg-g: we do for 1/4 projects [15:18:18] mw core goes via our own queue [15:18:36] mw extensions / smashpig / civicrm(?) go via the main queue [15:18:44] gotcha [15:18:51] ejegg|afk: found some CI config we might be able to update to send them all to our dedicated queue [15:19:01] we should look at that as it would speed things up [15:19:05] might be worth it [15:19:08] I'll add a ticket now [15:19:30] greg-g: its also because for a change like this we have a more complicated deploy process too for updating the smashpig library [15:21:21] (03PS1) 10Jgleeson: Merge branch 'master' into deployment [wikimedia/fundraising/SmashPig] (deployment) - 10https://gerrit.wikimedia.org/r/1145247 [15:22:23] (03CR) 10Jgleeson: [C:03+2] Merge branch 'master' into deployment [wikimedia/fundraising/SmashPig] (deployment) - 10https://gerrit.wikimedia.org/r/1145247 (owner: 10Jgleeson) [15:23:27] (03CR) 10Jgleeson: [C:04-1] Merge branch 'master' into deployment [wikimedia/fundraising/SmashPig] (deployment) - 10https://gerrit.wikimedia.org/r/1145247 (owner: 10Jgleeson) [15:23:40] (03CR) 10Jgleeson: [C:03+2] Merge branch 'master' into deployment [wikimedia/fundraising/SmashPig] (deployment) - 10https://gerrit.wikimedia.org/r/1144629 (owner: 10Jgleeson) [15:24:41] (03PS2) 10Jgleeson: Merge branch 'master' into deployment [wikimedia/fundraising/SmashPig] (deployment) - 10https://gerrit.wikimedia.org/r/1144629 [15:26:11] cstone: gotcha [15:30:28] 06Fundraising-Backlog: Investigate adding our projects to dedicated fundraising zuul queue - https://phabricator.wikimedia.org/T394060 (10jgleeson) 03NEW [15:35:54] jgleeson: can you remind me whether we have a way to test 3dsecure locally with gravy? [15:36:27] ejegg: it's one of them tricky ones where we test with cards that work in both places [15:36:38] damilare: added some test cards on the adyen console [15:36:47] damilare: could you share them pls? [15:36:50] ok, right, I'll look up the numbers there [15:41:57] I tried the first in the list (3000....1072) and just got auth failed [15:43:20] 4111....1072 auths, but doesn't prompt for 3dsecure [15:45:08] 5232....1072 also auths with no 3dsecure redirect [15:45:26] checking if we have to switch something back on in the gravy sandbox [15:46:42] aha, adyen connection says 3-d secure is not enabled [15:46:59] ok, that's turned on now [15:51:19] hmm, but perhaps lags a bit in taking effect? [15:51:24] still seeing no prompt [15:51:53] ok, got it! [15:52:09] and... errors on redirect back to localhost, let's see what that is [15:52:25] ah, auth declined [15:55:14] ok, got it to work with the 4111...81072 test card [15:55:17] let [15:55:23] s see what the IPNs look like [15:58:25] huh, there's nothing sent to the donations queue from payments-wiki after coming back from the 3d-secure [15:58:32] ok, let's see what the ipn got [16:01:48] right, so the 3d secure one does indeed end up with no backend processor [16:02:09] I guess that's not part of the pending message before we redirect? [16:02:33] But the question is, why don't we get that from the status looked up in the IPN listener [16:03:05] oh hmm, also no credit card submethod [16:03:43] jgleeson: did you notice if the ones you've had to fix on prod were also missing the credit card brand? [16:08:08] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: Temporarily turn off AVS checks while Japan campaigns are in progress - https://phabricator.wikimedia.org/T393930#10817314 (10EMartin) @jgleeson curious as to why this is blocked? [16:15:15] ejegg: I did not notice that but if you wanna dig into one of the backfilled records here's an example https://civicrm.wikimedia.org/civicrm/contact/view/contribution?action=view&reset=1&id=123125532&cid=63841521&context=home [16:15:35] thanks jgleeson [16:15:48] we could probably pull the log traffic for that trxn easily enough to see what came in for it [16:15:55] yep, it's just generic Credit Card, no submethod [16:15:56] and what we sent in the queue message [16:16:11] do you need one with a submethod ejegg ? [16:16:24] brand=submethod? [16:16:32] I thought that was visa/mc etc [16:16:33] jgleeson: cc donations in general have a brand / submethod [16:16:37] yep yep [16:16:48] oh I see what you mean [16:16:52] but in this case, it's another datum that didn't make it to Civi [16:17:25] `logdog -d 20250418 230205284.1` will get you all the logs on that one [16:17:32] so maybe we can add more info to the pending message [16:17:45] but we can definitely use more info from the status message [16:17:56] in the recordCaptureJob [16:18:30] ejegg: here's 180 examples that got backfilled earlier today https://civicrm.wikimedia.org/civicrm/search#/display/Import_2502/Import_2502 [16:18:47] since right now we're only adding the gravy txn ID to the pending message, then sending that along to the donations queue [16:18:54] I love how you can navigate to the records from the import result summary! [16:18:58] k, thanks for that batch [16:28:52] (03PS1) 10Ejegg: Add more fields when recording from Gravy IPN [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1145258 (https://phabricator.wikimedia.org/T393477) [16:29:09] I should both smoketest that and add a unit test ^^^ [16:29:28] (03CR) 10CI reject: [V:04-1] Add more fields when recording from Gravy IPN [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1145258 (https://phabricator.wikimedia.org/T393477) (owner: 10Ejegg) [16:35:30] (03PS1) 10Jgleeson: Remove MY from countries which require a fiscal number [wikimedia/fundraising/SmashPig] (deployment) - 10https://gerrit.wikimedia.org/r/1145261 (https://phabricator.wikimedia.org/T394051) [16:38:13] (03Abandoned) 10Jgleeson: Remove MY from countries which require a fiscal number [wikimedia/fundraising/SmashPig] (deployment) - 10https://gerrit.wikimedia.org/r/1145261 (https://phabricator.wikimedia.org/T394051) (owner: 10Jgleeson) [16:38:30] (03Abandoned) 10Jgleeson: Merge branch 'master' into deployment [wikimedia/fundraising/SmashPig] (deployment) - 10https://gerrit.wikimedia.org/r/1145247 (owner: 10Jgleeson) [16:39:29] (03CR) 10Jgleeson: "recheck" [wikimedia/fundraising/SmashPig] (deployment) - 10https://gerrit.wikimedia.org/r/1144629 (owner: 10Jgleeson) [16:41:01] (03Merged) 10jenkins-bot: Merge branch 'master' into deployment [wikimedia/fundraising/SmashPig] (deployment) - 10https://gerrit.wikimedia.org/r/1144629 (owner: 10Jgleeson) [16:41:39] (03PS1) 10Jgleeson: Merge branch 'master' into deployment [wikimedia/fundraising/SmashPig] (deployment) - 10https://gerrit.wikimedia.org/r/1145263 [16:42:13] (03CR) 10Jgleeson: [C:03+2] Merge branch 'master' into deployment [wikimedia/fundraising/SmashPig] (deployment) - 10https://gerrit.wikimedia.org/r/1145263 (owner: 10Jgleeson) [16:43:34] (03Merged) 10jenkins-bot: Merge branch 'master' into deployment [wikimedia/fundraising/SmashPig] (deployment) - 10https://gerrit.wikimedia.org/r/1145263 (owner: 10Jgleeson) [16:55:04] (03PS2) 10Ejegg: Add more fields when recording from Gravy IPN [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1145258 (https://phabricator.wikimedia.org/T393477) [16:55:36] (03CR) 10CI reject: [V:04-1] Add more fields when recording from Gravy IPN [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1145258 (https://phabricator.wikimedia.org/T393477) (owner: 10Ejegg) [16:56:35] (03PS1) 10Cstone: Update smash-pig to v0.9.6.3 [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1145266 [16:57:03] (03PS3) 10Ejegg: Add more fields when recording from Gravy IPN [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1145258 (https://phabricator.wikimedia.org/T393477) [16:57:33] ok jgleeson|away / cstone / damilare ^^^ should I think get us the missing fields for redirected transactions [16:58:01] just smoketesting the latest version [16:59:04] (03CR) 10Cstone: [C:03+2] Update smash-pig to v0.9.6.3 [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1145266 (owner: 10Cstone) [16:59:27] 14Fundraising Sprint: didAnyoneTryThis(), 14Fundraising Sprint: Hot Pot!, 06Fundraising-Backlog: Create new Benevity import - https://phabricator.wikimedia.org/T359219#10817610 (10Elbar53) I looked over the test import. It looks good. The "workplace giving" and "matched Gift" in the soft credit field are... [17:01:56] (03Merged) 10jenkins-bot: Update smash-pig to v0.9.6.3 [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1145266 (owner: 10Cstone) [17:02:52] ok, took a minute to get the IPN, but it seems to be working. Got submethod, backend processor & backend txn id, and the reconciliation ID into Civi locally [17:03:51] (03PS1) 10Cstone: Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - 10https://gerrit.wikimedia.org/r/1145269 [17:05:04] so let's see, can we add any more info to the pending message as well? [17:05:13] (03CR) 10Cstone: [C:03+2] Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - 10https://gerrit.wikimedia.org/r/1145269 (owner: 10Cstone) [17:05:42] ejegg: this is for the missing data issue? [17:05:50] cstone yep! [17:06:20] (03Merged) 10jenkins-bot: Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - 10https://gerrit.wikimedia.org/r/1145269 (owner: 10Cstone) [17:06:30] This should fix it for payments that get recorded via the IPN, which includes the few I've spot-checked [17:07:06] We could potentially belt-and-suspenders it by adding more info to the pending message, if there is any more available [17:07:26] cstone: so to test locally, it's a bit of a dance. [17:07:51] you'll have to go into the gravy console and point the IPN listener to your local ipntest forwarded port [17:08:18] then use this test card on the local gravy form: 4111111111181072 [17:08:28] which should get you a 3d-secure redirect [17:08:39] then wait a bit and run all the queue consumers [17:08:56] I had to wait a couple minutes for the capture IPN to come in [17:09:06] gonna grab some lunch, back soon! [17:09:11] ok cool ill get this deployed then test [17:18:35] (03PS1) 10Cstone: Update vendor and composer.lock for smash-pig v0.9.6.3 [core] (fundraising/REL1_43) - 10https://gerrit.wikimedia.org/r/1145272 [17:32:19] (03CR) 10Cstone: [C:03+2] Update vendor and composer.lock for smash-pig v0.9.6.3 [core] (fundraising/REL1_43) - 10https://gerrit.wikimedia.org/r/1145272 (owner: 10Cstone) [17:34:26] 10fundraising-tech-ops, 10FR-Tech-Analytics: [Dagster] Determine how to keep acceptable levels of dbt assets - https://phabricator.wikimedia.org/T392747#10817860 (10Dwisehaupt) I just added a cron job to run the above find/rm command every 6 hours. It'll keep the space under control to some degree but is reall... [17:39:08] 14Fundraising Sprint: didAnyoneTryThis(), 14Fundraising Sprint: Hot Pot!, 06Fundraising-Backlog: Create new Benevity import - https://phabricator.wikimedia.org/T359219#10817884 (10MDemosWMF) Thanks @Elbar53! Yep, Eileen just pushed out a fix for that so as long as everything else looks good we can do our... [17:46:00] (03Merged) 10jenkins-bot: Update vendor and composer.lock for smash-pig v0.9.6.3 [core] (fundraising/REL1_43) - 10https://gerrit.wikimedia.org/r/1145272 (owner: 10Cstone) [17:47:44] (03PS1) 10Ejegg: Gravy: send more to pending on redirect [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1145279 (https://phabricator.wikimedia.org/T393477) [17:49:30] ok, ^^ might help for txns that come in via audit or via the rectifier [17:49:52] but we still need the IPN-side fix to get the backend_processor_txn_id [17:49:55] hmm hmm [17:50:19] don't we also want to send a donations queue message when the donor comes back from the 3d-secure flow? [17:51:18] !log payments-wiki upgraded from 92a8cbb8 to 01de91b7 [17:51:19] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [17:51:28] damilare: do you know why we're not sending a donations queue message for gravy 3d-secure CC donations when the donor gets back to the resultswitcher? [17:51:35] ejegg: dami is out today [17:52:41] ah oops [17:53:46] we should be sending a message though? [17:54:44] when it's 3d-secure, we seem to just send the pending one, then when the donor comes back they just bounce to the TY page without us sending a donations queue message [17:54:56] I'll step through that to see why [17:55:11] maybe gravy doesn't actually give us the info we need at that point? [17:55:35] hmm and it then comes in on an ipn (sorry catching up if thats what that ipn work was about) [17:55:43] yep, exactly [17:56:04] so the pending message was missing the backend fields (and submethod) [17:56:28] and then the job to record the capture from the IPN wasn't actually using all the info it gets from the status lookup [17:56:44] basically just adding the gateway_txn_id to the pending message, then sending that to the donations queue [17:57:03] so the first patch was to make the IPN record capture job use the extra fields from the status lookup [17:57:17] and the second patch adds some (but not all) of the missing info to the pending message [18:13:09] ok, yeah, looks like for 3dsecure, the capture comes back as capture-pending [18:13:31] so we don't actually want to send that message to the donations queue from payments-wiki [18:17:27] (03open) 10dwisehaupt: Draft: Upgrade civi to 6.2.0 [repos/fundraising-tech/community-civicrm] - 10https://gitlab.wikimedia.org/repos/fundraising-tech/community-civicrm/-/merge_requests/12 [18:18:31] (03open) 10dwisehaupt: Upgrade civi to 6.2.0 [repos/fundraising-tech/community-civicrm] (labs_build) - 10https://gitlab.wikimedia.org/repos/fundraising-tech/community-civicrm/-/merge_requests/13 [18:19:28] (03close) 10dwisehaupt: Upgrade civi to 6.2.0 [repos/fundraising-tech/community-civicrm] (labs_build) - 10https://gitlab.wikimedia.org/repos/fundraising-tech/community-civicrm/-/merge_requests/13 [18:28:51] (03PS9) 10Ejegg: Donor Portal login page [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1141917 (https://phabricator.wikimedia.org/T388739) [18:30:37] (03PS5) 10Ejegg: Remove transitional code in CiviproxyConnect [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1141918 [18:30:37] (03PS6) 10Ejegg: Extract API4 request in CiviproxyConnect [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1141920 (https://phabricator.wikimedia.org/T388745) [18:30:37] (03PS4) 10Ejegg: Use MW standard HttpRequestFactory to do CiviProxy request [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1141953 (https://phabricator.wikimedia.org/T388745) [18:32:34] (03close) 10dwisehaupt: Draft: Upgrade civi to 6.2.0 [repos/fundraising-tech/community-civicrm] - 10https://gitlab.wikimedia.org/repos/fundraising-tech/community-civicrm/-/merge_requests/12 [18:34:50] (03CR) 10Cstone: [C:03+2] Donor Portal login page [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1141917 (https://phabricator.wikimedia.org/T388739) (owner: 10Ejegg) [18:49:32] (03Merged) 10jenkins-bot: Donor Portal login page [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1141917 (https://phabricator.wikimedia.org/T388739) (owner: 10Ejegg) [19:10:18] 06Fundraising-Backlog, 06FR-donorrelations: Trouble voiding transaction at Gr4vy - https://phabricator.wikimedia.org/T394090 (10AMJohnson) 03NEW [19:25:09] (03CR) 10Cstone: [C:03+2] "thanks!" [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1145279 (https://phabricator.wikimedia.org/T393477) (owner: 10Ejegg) [19:25:35] (03CR) 10Cstone: [C:03+2] "I see the data!" [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1145258 (https://phabricator.wikimedia.org/T393477) (owner: 10Ejegg) [19:26:03] (03Merged) 10jenkins-bot: Add more fields when recording from Gravy IPN [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1145258 (https://phabricator.wikimedia.org/T393477) (owner: 10Ejegg) [19:27:45] (03Merged) 10jenkins-bot: Gravy: send more to pending on redirect [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1145279 (https://phabricator.wikimedia.org/T393477) (owner: 10Ejegg) [19:51:52] (03PS1) 10Ejegg: Merge branch 'master' into deployment [wikimedia/fundraising/SmashPig] (deployment) - 10https://gerrit.wikimedia.org/r/1145320 [19:52:39] (03CR) 10Ejegg: [C:03+2] Merge branch 'master' into deployment [wikimedia/fundraising/SmashPig] (deployment) - 10https://gerrit.wikimedia.org/r/1145320 (owner: 10Ejegg) [19:53:00] (03Merged) 10jenkins-bot: Merge branch 'master' into deployment [wikimedia/fundraising/SmashPig] (deployment) - 10https://gerrit.wikimedia.org/r/1145320 (owner: 10Ejegg) [19:56:09] !log standalone (IPN listener) SmashPig upgraded from 4ac271dd to f96b898e [19:56:11] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [20:14:01] 06Fundraising-Backlog, 06FR-donorrelations: Broken search kit - https://phabricator.wikimedia.org/T394097 (10SHust) 03NEW [20:15:47] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: Verify which countries we need a 'fiscal_number' to process a payment on Gravy - https://phabricator.wikimedia.org/T394051#10818346 (10jgleeson) [20:17:28] 06Fundraising-Backlog: Pending transaction resolver: failure page is displayed and then its resolved - https://phabricator.wikimedia.org/T394098 (10Cstone) 03NEW [20:46:07] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: Verify which countries need a 'fiscal_number' to process a payment on Gravy - https://phabricator.wikimedia.org/T394051#10818474 (10jgleeson) [20:46:14] 06Fundraising-Backlog: Pending transaction resolver - two transactions resolved in the same day - https://phabricator.wikimedia.org/T394103 (10Cstone) 03NEW [20:48:03] fr-tech I found a really simple fix for that broken fredge report [20:48:27] hmm, trying to push it up for review but git cli is hanging [20:48:29] yep? [20:48:34] (03PS1) 10Ejegg: Fix casing of fredge template folder [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1145330 (https://phabricator.wikimedia.org/T353299) [20:48:39] oh ha [20:48:43] ok, there it is! [20:50:04] what's the URL again ejegg [20:50:13] /civicrm/fredge [20:51:00] page loading for me now [20:51:04] woo! [20:51:05] woo [20:51:21] (03CR) 10Jgleeson: [C:03+2] "LGTM" [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1145330 (https://phabricator.wikimedia.org/T353299) (owner: 10Ejegg) [21:00:11] 06Fundraising-Backlog, 06FR-donorrelations: Broken search kit - https://phabricator.wikimedia.org/T394097#10818520 (10Eileenmcnaughton) Too many arguments given for SQL function GROUP_CONCAT {"run":["SearchDisplay","run",{"return":"page:1","savedSearch":{"id":500,"name":"DR_high_level_dedupe_report","label":... [21:12:25] (03Merged) 10jenkins-bot: Fix casing of fredge template folder [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1145330 (https://phabricator.wikimedia.org/T353299) (owner: 10Ejegg) [21:25:08] (03PS1) 10Ejegg: Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1145335 [21:25:09] (03CR) 10Ejegg: [C:03+2] Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1145335 (owner: 10Ejegg) [21:26:05] (03Merged) 10jenkins-bot: Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1145335 (owner: 10Ejegg) [21:27:04] ejegg: cstone greg-g I think this is what we need to get our other projects processing via our dedicated zuul gate https://gerrit.wikimedia.org/r/c/integration/config/+/1145336 [21:27:21] hmm jenkins has other ideas [21:28:13] 06Fundraising-Backlog, 06Fundraising-Tech-Roadmap, 06Traffic, 07fr-acoustic: Acoustic SMS: Domain needed for short links - https://phabricator.wikimedia.org/T379318#10818585 (10greg) @ssingh update on our end. We identified the domain we'd like to use and Chuck R from Legal has already acquired it for this... [21:30:06] ah maybe I can't use that format [21:30:07] 22:26:48 MultipleInvalid: extra keys not allowed @ data['pipelines'][15]['trigger']['gerrit'][1]['project'] [21:34:08] oh, is !! some yaml magic label ? [21:36:31] jgleeson: nice, thanks for making that patch, I was just looking at that jenkins output too :P [21:37:02] hashar should see that patch but might be worth a ping in -releng during european hours to get quicker attention [21:39:32] yeah those tests must need an update. it looks like you can chain those conditions to trigger the rule according to another example in the same file which I shamelessly copied from https://phabricator.wikimedia.org/source/integration-config/browse/master/zuul/layout.yaml$634 [21:40:37] good idea re:hashhar. I'll bug him tomorrow [21:40:41] (03PS5) 10Eileen: 6.3 rc [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1140254 [21:40:48] (03CR) 10Ejegg: [V:03+2 C:03+2] 6.3 rc [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1140254 (owner: 10Eileen) [21:41:54] (03PS3) 10Eileen: Reapply our hack Temporary fix for handling duplicate contacts on import [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1141570 (https://phabricator.wikimedia.org/T374063) [21:42:23] (03CR) 10Ejegg: [V:03+2 C:03+2] Reapply our hack Temporary fix for handling duplicate contacts on import [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1141570 (https://phabricator.wikimedia.org/T374063) (owner: 10Eileen) [21:43:35] (03PS4) 10Eileen: Fixes for 6.2 import mapping changes [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1141571 [21:43:42] (03CR) 10Ejegg: [V:03+2 C:03+2] Fixes for 6.2 import mapping changes [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1141571 (owner: 10Eileen) [21:45:10] (03PS3) 10Eileen: Update mappings in UserJob mgd files [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1141997 [21:46:15] (03CR) 10Ejegg: [C:03+2] Update mappings in UserJob mgd files [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1141997 (owner: 10Eileen) [21:47:08] !log civicrm upgraded from 852c6ee6 to 40d488b8 [21:47:09] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [21:49:23] 06Fundraising-Backlog: Pending transaction resolver - two transactions resolved in the same day - https://phabricator.wikimedia.org/T394103#10818646 (10AMJohnson) @Cstone - If it's helpful at all to know I've taken a few tickets I believe were solved by the PTR recently and I don't think it's settling multiple d... [21:49:38] eileen: that upgrade looked good locally and all the custom stuff I clicked through seems to work [21:49:51] I just deployed a tiny fix to the fredge form [21:50:30] yay thanks ejegg - I guess we will push out in 4 hours [21:51:42] 06Fundraising-Backlog, 07fr-acoustic: Acoustic fields wishlist - discussion - https://phabricator.wikimedia.org/T394089#10818653 (10AKanji-WMF) [21:52:20] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 07Documentation: Audit existing payment error messages - https://phabricator.wikimedia.org/T379197#10818656 (10AKanji-WMF) [21:52:50] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 07Documentation: Audit existing payment error messages - https://phabricator.wikimedia.org/T379197#10818658 (10AKanji-WMF) p:05Low→03Medium [21:54:33] 14Fundraising Sprint: didAnyoneTryThis(), 14Fundraising Sprint: Hot Pot!, 06Fundraising-Backlog: Create new Benevity import - https://phabricator.wikimedia.org/T359219#10818676 (10MDemosWMF) @Eileenmcnaughton Ellen and I just ran another test but found that all of the soft credit types came through as 'm... [21:57:15] (03PS1) 10Ejegg: Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - 10https://gerrit.wikimedia.org/r/1145338 [21:58:16] (03approved) 10dwisehaupt: Upgrade civi to 6.2.0 [repos/fundraising-tech/community-civicrm] (labs_build) - 10https://gitlab.wikimedia.org/repos/fundraising-tech/community-civicrm/-/merge_requests/14 [21:58:18] (03merge) 10dwisehaupt: Upgrade civi to 6.2.0 [repos/fundraising-tech/community-civicrm] (labs_build) - 10https://gitlab.wikimedia.org/repos/fundraising-tech/community-civicrm/-/merge_requests/14 [22:00:12] (03CR) 10Ejegg: [C:03+2] Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - 10https://gerrit.wikimedia.org/r/1145338 (owner: 10Ejegg) [22:02:42] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10FR-Tech-Analytics, 10FR-tech-data-integrity, 10MW-1.45-notes (1.45.0-wmf.2; 2025-05-20): Null backend_processor for gravy records in civi - https://phabricator.wikimedia.org/T393477#10818699 (10Ejegg) OK, we seem to have fixed the root cause of this. [22:08:47] (03PS6) 10Ejegg: Remove transitional code in CiviproxyConnect [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1141918 [22:08:47] (03PS7) 10Ejegg: Extract API4 request in CiviproxyConnect [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1141920 (https://phabricator.wikimedia.org/T388745) [22:08:47] (03PS5) 10Ejegg: Use MW standard HttpRequestFactory to do CiviProxy request [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1141953 (https://phabricator.wikimedia.org/T388745) [22:09:46] 14Fundraising Sprint: didAnyoneTryThis(), 14Fundraising Sprint: Hot Pot!, 06Fundraising-Backlog: Create new Benevity import - https://phabricator.wikimedia.org/T359219#10818705 (10MDemosWMF) Actually I was able to find this in other [[ https://docs.google.com/document/d/1D2AtzjyRWTylq7aUyMfAkRQRCl5K3b-3d... [22:10:56] (03PS6) 10Ejegg: Add getDonorSummary to CiviproxyConnect [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1141921 (https://phabricator.wikimedia.org/T388745) [22:10:56] (03PS12) 10Ejegg: WIP render donor portal main page [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1141923 (https://phabricator.wikimedia.org/T388745) [22:17:24] (03Merged) 10jenkins-bot: Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - 10https://gerrit.wikimedia.org/r/1145338 (owner: 10Ejegg) [22:21:42] 14Fundraising Sprint: didAnyoneTryThis(), 14Fundraising Sprint: Hot Pot!, 06Fundraising-Backlog: Create new Benevity import - https://phabricator.wikimedia.org/T359219#10818723 (10Eileenmcnaughton) @MDemosWMF I realise that the 'normal' soft credit type is configured in the UI and I only updated the soft... [22:27:48] 14Fundraising Sprint: didAnyoneTryThis(), 14Fundraising Sprint: Hot Pot!, 06Fundraising-Backlog: Create new Benevity import - https://phabricator.wikimedia.org/T359219#10818732 (10Eileenmcnaughton) @MDemosWMF - if you check the import source for those records they are "My Rewards" - we have this coded li... [22:48:35] (03PS13) 10Ejegg: WIP render donor portal main page [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1141923 (https://phabricator.wikimedia.org/T388745) [22:48:35] (03PS1) 10Ejegg: WIP alternate scenarios for middle donor portal box [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1145342 (https://phabricator.wikimedia.org/T388745) [22:48:43] gotta go help with dinner [22:51:27] (03CR) 10CI reject: [V:04-1] WIP alternate scenarios for middle donor portal box [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1145342 (https://phabricator.wikimedia.org/T388745) (owner: 10Ejegg) [23:03:54] 03Fundraising Sprint Impossible shepherds pie, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-Email, 07Unplanned-Sprint-Work: Proposal - import master suppression list to CiviCRM & put in a group - https://phabricator.wikimedia.org/T298381#10818869 (10Eileenmcnaughton) [23:05:58] 06Fundraising-Backlog, 06FR-donorrelations: Broken search kit - https://phabricator.wikimedia.org/T394097#10818888 (10Eileenmcnaughton) per slack I've fixed the search - it looks like the underlying cause will be fixed so this doesn't happen to new searches in today's deploy - https://github.com/civicrm/civicr... [23:06:12] 06Fundraising-Backlog, 06FR-donorrelations: Broken search kit - https://phabricator.wikimedia.org/T394097#10818894 (10Eileenmcnaughton) a:03Eileenmcnaughton [23:06:41] 03Fundraising Sprint Impossible shepherds pie, 06Fundraising-Backlog, 06FR-donorrelations: Broken search kit - https://phabricator.wikimedia.org/T394097#10818895 (10Eileenmcnaughton) [23:14:12] (03PS1) 10Eileen: Add support for downloading master suppression list [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1145350 (https://phabricator.wikimedia.org/T298381) [23:15:34] (03PS2) 10Eileen: Add support for downloading master suppression list [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1145350 (https://phabricator.wikimedia.org/T298381) [23:19:00] (03PS3) 10Eileen: Add support for downloading master suppression list [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1145350 (https://phabricator.wikimedia.org/T298381) [23:21:10] (03PS1) 10Eileen: Merge branch 'master' of ssh://gerrit.wikimedia.org:29418/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1145351 [23:27:23] (03CR) 10Eileen: [C:03+2] Merge branch 'master' of ssh://gerrit.wikimedia.org:29418/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1145351 (owner: 10Eileen) [23:27:59] I've merged the civi upgrade to deployment... [23:28:10] 90 mins to deploy [23:56:37] eileen: deploying the civi update in ~60 mins? i'll have the trigger backup stuff prepped and be ready for then. [23:56:49] dwisehaupt: great!