[00:02:23] (03PS1) 10Lars SG: Add Soft Credit search task [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1227467 (https://phabricator.wikimedia.org/T411555) [00:02:50] (03PS4) 10Eileen: Condense fee rows into associated chargebacks (etc) [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1227463 (https://phabricator.wikimedia.org/T409362) [00:03:43] (03CR) 10Eileen: [C:03+2] Add Soft Credit search task [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1227467 (https://phabricator.wikimedia.org/T411555) (owner: 10Lars SG) [00:06:55] cstone: if you get a chance to look at the 2 paypal ones they can be rebased onto master direct if needed [00:08:37] ah okay I was working on getting my test files onto this new comp [00:08:42] jack helpde me getting the debug working [00:09:45] yeah that takes time! [00:10:04] although credit to Andy & Jack - a lot less than it used ot [00:10:12] to [00:10:59] yeah this is without my server chaos of the last laptop haha [00:11:04] well I htink well see if i try again [00:11:08] lol [00:15:08] Having trouble getting the email sent but ignore failmail from SmashPig paypal audit for now [00:15:23] once I've got a clean run I'll hush it [00:17:02] hmm guess this is on prod too but refactor probably fixes? lemme trest that [00:17:05] 2026-01-15 00:20:35,077 ERROR civicrm.wmf.INFO: Civi\WMFQueueMessage\AuditMessage unsupported field country [00:17:05] 2026-01-15 00:20:35,077 ERROR civicrm.wmf.INFO: Civi\WMFQueueMessage\AuditMessage undeclared field original_amount [00:17:11] when running dlocal [00:18:21] cstone: the patch ejegg|away merged to crm fixes [00:18:31] ah okie [00:18:40] yeah i guess i dont even know what branch i am on there [00:18:42] hmm original_amount - that is the wrong field name maybe [00:19:17] hmm what did i have set up here hint: You have divergent branches and need to specify how to reconcile them. [00:19:17] hint: You can do so by running one of the following commands sometime before [00:19:17] hint: your next pull: [00:19:17] hint: [00:19:17] hint: git config pull.rebase false # merge [00:19:17] hint: git config pull.rebase true # rebase [00:19:17] hint: git config pull.ff only # fast-forward only [00:20:34] argh - gotta love git fu [00:20:48] cstone: I will remove that original_amount in a follow on, country is OK [00:21:16] (03Merged) 10jenkins-bot: Add Soft Credit search task [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1227467 (https://phabricator.wikimedia.org/T411555) (owner: 10Lars SG) [00:21:24] yeah its fine it still runs was just getting a baseline cause havent run dlocal in a looong time [00:23:09] (03PS1) 10Eileen: Remove invalid field [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1227471 (https://phabricator.wikimedia.org/T414531) [00:23:31] cstone: ^^ gets rid of that extra field [00:25:18] is my internet broken or is it gerrit [00:25:37] I have the same question... [00:26:02] it loaded! [00:27:37] 06Fundraising-Backlog, 06FR-donorrelations, 07fr-current-sprint, 07payments-orchestration: Handle Gravy Paypal Chargebacks and Refunds from the resolution center - https://phabricator.wikimedia.org/T405404#11527300 (10Eileenmcnaughton) Just noting that at least 1 of the above is actually a fee that needs t... [00:36:46] it was my internet [00:43:14] (03CR) 10Cstone: [C:03+2] "looks good, thanks and to all the file types!" [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1226997 (https://phabricator.wikimedia.org/T414531) (owner: 10Eileen) [00:43:53] (03Merged) 10jenkins-bot: Refactor smashpig dlocal parser in preparation for new report [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1226997 (https://phabricator.wikimedia.org/T414531) (owner: 10Eileen) [00:45:00] (03CR) 10Wfan: [C:03+2] Emit ApiTimings for Gravy API calls [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1223718 (https://phabricator.wikimedia.org/T411673) (owner: 10Jgleeson) [00:45:04] (03CR) 10Wfan: [C:03+2] Emit ApiTimings for Adyen API calls [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1223742 (https://phabricator.wikimedia.org/T411673) (owner: 10Jgleeson) [00:45:10] (03CR) 10Wfan: [C:03+2] Emit ApiTimings for dLocal API calls [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1224792 (https://phabricator.wikimedia.org/T411673) (owner: 10Jgleeson) [00:45:34] (03CR) 10Wfan: [C:03+2] Emit ApiTimings for PayPal API calls [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1224915 (https://phabricator.wikimedia.org/T411673) (owner: 10Jgleeson) [00:48:29] (03CR) 10Wfan: [C:03+2] Add ApiOperation enum to canonicalise API timing operation names [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1224658 (https://phabricator.wikimedia.org/T411673) (owner: 10Jgleeson) [00:48:32] (03CR) 10Wfan: [C:03+2] Add dLocal api methods to ApiOperations enum [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1224785 (https://phabricator.wikimedia.org/T411673) (owner: 10Jgleeson) [00:48:36] (03CR) 10Wfan: [C:03+2] Add PayPal api methods to ApiOperations enum [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1224914 (https://phabricator.wikimedia.org/T411673) (owner: 10Jgleeson) [00:49:08] (03Merged) 10jenkins-bot: Add ApiOperation enum to canonicalise API timing operation names [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1224658 (https://phabricator.wikimedia.org/T411673) (owner: 10Jgleeson) [00:49:10] (03Merged) 10jenkins-bot: Add ApiTimings utility for standardised API timing logs [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1219647 (https://phabricator.wikimedia.org/T411673) (owner: 10Jgleeson) [00:49:32] (03Merged) 10jenkins-bot: Store current payment method in Context [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1223740 (owner: 10Jgleeson) [00:49:32] (03Merged) 10jenkins-bot: Add ApiTimingTrait to standardise API call timing logs [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1220646 (https://phabricator.wikimedia.org/T411673) (owner: 10Jgleeson) [00:49:34] (03Merged) 10jenkins-bot: Emit ApiTimings for Gravy API calls [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1223718 (https://phabricator.wikimedia.org/T411673) (owner: 10Jgleeson) [00:49:36] (03Merged) 10jenkins-bot: Emit ApiTimings for Adyen API calls [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1223742 (https://phabricator.wikimedia.org/T411673) (owner: 10Jgleeson) [00:49:37] (03Merged) 10jenkins-bot: Add dLocal api methods to ApiOperations enum [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1224785 (https://phabricator.wikimedia.org/T411673) (owner: 10Jgleeson) [00:49:42] (03Merged) 10jenkins-bot: Emit ApiTimings for dLocal API calls [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1224792 (https://phabricator.wikimedia.org/T411673) (owner: 10Jgleeson) [00:49:45] (03Merged) 10jenkins-bot: Add PayPal api methods to ApiOperations enum [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1224914 (https://phabricator.wikimedia.org/T411673) (owner: 10Jgleeson) [00:49:55] (03Merged) 10jenkins-bot: Emit ApiTimings for PayPal API calls [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1224915 (https://phabricator.wikimedia.org/T411673) (owner: 10Jgleeson) [00:50:26] hmm wfan did we want them to all merge? [00:51:05] Not all, I will leave the last three for Jack to update next week [00:51:11] well they merged to smashpig master [00:51:23] eileen: did you want any of your patches deployed tonight? [00:51:28] they r in a chain without the last one merged [00:51:42] The chain before the last one will hanging there [00:51:47] cstone: would be nice but world won't end if I have to wait for next week [00:51:49] oh they merged [00:51:58] hah yeah [00:52:38] eileen: wfan just we need to watch the recurring charge job if we deploy smashpig in civi tonight [00:52:43] ha cause the real "last" piece is the paypal one ... [00:53:28] While from now the smashpig is ok to run without error just we will have two time logged [00:54:19] yeah just want to be extra careful with that paypal change that was mid chain [00:54:24] it shouldnt do anything [00:55:28] or did he rebase that out i dont see it actually [00:55:46] 06Fundraising-Backlog, 06FR-donorrelations, 07fr-current-sprint, 07payments-orchestration: Handle Gravy Paypal Chargebacks and Refunds from the resolution center - https://phabricator.wikimedia.org/T405404#11527392 (10Eileenmcnaughton) The last one is the one to focus on because it has not been reversed ht... [00:55:47] ooh i see it [00:58:44] eileen: one thing on the dlocal settlement file im getting them to change the name [00:59:13] but i dont know how long that will take [00:59:23] cstone: ok - that's just the regex string [00:59:46] yeah gravy wanted in a specific format and I asked for that in the ticket then they gave us the format here [00:59:46] one line change - or if we know before & after name we can just make it right now [00:59:58] yeah just a warning if its randomly different [01:00:07] oh.... [01:00:59] ok what did slack do with my group where i asked the question hah [01:02:00] Wikimedia_cross_border_report_YYYYMMDD_HHMMSS.csv ok it will one day be named this maybe [01:02:17] aha - that just rolls off the tongue [01:02:50] yeah hah [01:02:56] but if we ever mention it in public we will ensure that we are locked up at the border when attempting to enter the US next... [01:03:07] i assume they named it that cause thats what dlocal calls it in dlocals docs and i speicifcally asked for that [01:03:11] then dlocal named it settlement [01:03:13] oh dang - I said that on the logged channel [01:03:21] :) [01:03:56] there was payins too that i thought would be in the name [01:04:05] personally settlement has a certain clarity... [01:04:11] right ^^ [01:05:23] so first run through of the Smashpig paypal Audit [01:05:23] Number missing from database: 20 [01:05:23] Missing transactions found in logs: 15 [01:05:23] Missing transactions not found in logs: 5 [01:05:24] But at least 4 of the 5 are fees - so maybe we solved the other problem as a by-product [01:06:43] ahh [01:07:32] that contribution tracking failmail seems to be due to invalid amount [01:07:32] 208000000000000000.00 [01:07:32] I wonder if we should handle that somewhere else.... [01:07:46] hah [01:12:43] https://lab.civicrm.org/dev/core/-/issues/6277 [01:22:33] (03CR) 10Cstone: [C:03+2] Add dlocal parser for settlement file [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1227405 (https://phabricator.wikimedia.org/T414531) (owner: 10Eileen) [01:22:45] (03CR) 10Cstone: [C:03+2] Stop passing up note from Paypal Audit [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1227444 (https://phabricator.wikimedia.org/T409362) (owner: 10Eileen) [01:23:07] (03Merged) 10jenkins-bot: Add dlocal parser for settlement file [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1227405 (https://phabricator.wikimedia.org/T414531) (owner: 10Eileen) [01:23:22] (03Merged) 10jenkins-bot: Stop passing up note from Paypal Audit [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1227444 (https://phabricator.wikimedia.org/T409362) (owner: 10Eileen) [01:27:20] (03CR) 10Wfan: "LGTM overall, thanks for all the works! For the follow up patches 1: do we still going to add apiTiming for Braintree before Venmo fully m" [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1225562 (https://phabricator.wikimedia.org/T411673) (owner: 10Jgleeson) [01:42:17] (03PS1) 10Cstone: Also parse settlement reports [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1227495 (https://phabricator.wikimedia.org/T414531) [01:45:17] (03CR) 10Eileen: "yay thanks" [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1227495 (https://phabricator.wikimedia.org/T414531) (owner: 10Cstone) [02:38:06] FIRING: CoreRouterInterfaceDown: Core router interface down - pfw1-codfw:reth1 (Subnet frack-fundraising-codfw in F5) - https://wikitech.wikimedia.org/wiki/Network_monitoring#Router_interface_down - https://grafana.wikimedia.org/d/fb403d62-5f03-434a-9dff-bd02b9fff504/network-device-overview?var-instance=pfw1-codfw:9804 - https://alerts.wikimedia.org/?q=alertname%3DCoreRouterInterfaceDown [03:51:07] (03CR) 10Cstone: [C:03+2] "This is hanging on a SC row but runs without it." [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1227463 (https://phabricator.wikimedia.org/T409362) (owner: 10Eileen) [03:51:15] (03CR) 10Cstone: [C:03+2] Remove invalid field [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1227471 (https://phabricator.wikimedia.org/T414531) (owner: 10Eileen) [03:51:37] (03Merged) 10jenkins-bot: Condense fee rows into associated chargebacks (etc) [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1227463 (https://phabricator.wikimedia.org/T409362) (owner: 10Eileen) [03:51:44] (03Merged) 10jenkins-bot: Remove invalid field [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1227471 (https://phabricator.wikimedia.org/T414531) (owner: 10Eileen) [04:52:19] (03PS1) 10Cstone: Update smash-pig to v1.1.0 [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1227560 [04:53:51] (03CR) 10Cstone: [C:03+2] Update smash-pig to v1.1.0 [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1227560 (owner: 10Cstone) [05:08:34] (03CR) 10CI reject: [V:04-1] Update smash-pig to v1.1.0 [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1227560 (owner: 10Cstone) [05:18:11] (03PS1) 10Cstone: Fix dlocal audit tests [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1227564 (https://phabricator.wikimedia.org/T414531) [06:38:06] FIRING: CoreRouterInterfaceDown: Core router interface down - pfw1-codfw:reth1 (Subnet frack-fundraising-codfw in F5) - https://wikitech.wikimedia.org/wiki/Network_monitoring#Router_interface_down - https://grafana.wikimedia.org/d/fb403d62-5f03-434a-9dff-bd02b9fff504/network-device-overview?var-instance=pfw1-codfw:9804 - https://alerts.wikimedia.org/?q=alertname%3DCoreRouterInterfaceDown [06:53:02] (03PS1) 10Lars SG: Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1227592 [06:54:07] (03CR) 10Lars SG: [C:03+2] Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1227592 (owner: 10Lars SG) [06:55:03] (03Merged) 10jenkins-bot: Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1227592 (owner: 10Lars SG) [07:02:20] !log civicrm upgraded from 43808405 to 54fb7415 [07:02:22] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [09:43:09] 06Fundraising-Backlog, 10Recurring-Donations: Generate email for failed annual recurring gifts - https://phabricator.wikimedia.org/T405619#11527991 (10TomaszGorski) Hello, I've updated the following languages: Catalan, French (France, Canada), Spanish (Spain, LATAM), Portuguese (Portugal, Brazil), Romanian... [10:38:06] FIRING: CoreRouterInterfaceDown: Core router interface down - pfw1-codfw:reth1 (Subnet frack-fundraising-codfw in F5) - https://wikitech.wikimedia.org/wiki/Network_monitoring#Router_interface_down - https://grafana.wikimedia.org/d/fb403d62-5f03-434a-9dff-bd02b9fff504/network-device-overview?var-instance=pfw1-codfw:9804 - https://alerts.wikimedia.org/?q=alertname%3DCoreRouterInterfaceDown [11:47:41] wfan: thanks for all the review. I still have one patch to push on top of that chain just to rework how we set the paymentMethod but I'll do that next week around the offsite. Thanks again [12:40:04] (03CR) 10Damilare Adedoyin: [C:03+2] Add MinFraud threshold for pending resolver [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1227421 (https://phabricator.wikimedia.org/T408730) (owner: 10Ejegg) [12:59:21] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: contact_id in email link having contact_id=%%CONTACTID%% instead of contact_id=1234 is breaking the queues - https://phabricator.wikimedia.org/T413452#11528611 (10Damilare) Ok, misread the comment, I'd add the feature to discard the bad values on the impo... [13:00:13] (03Merged) 10jenkins-bot: Add MinFraud threshold for pending resolver [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1227421 (https://phabricator.wikimedia.org/T408730) (owner: 10Ejegg) [13:33:17] 03Fundraising Sprint: ARMchair, 14Fundraising Sprint: Vixen, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, and 3 others: Automate some Direct Mail white mail coding - https://phabricator.wikimedia.org/T386031#11528709 (10RLewis) @Lars for the points mentioned in your previous comment about checki... [14:16:18] (03PS1) 10Damilare Adedoyin: Ensure Donation consumer does not break when template strings get into the message contact_id parameters [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1227803 (https://phabricator.wikimedia.org/T413452) [14:33:22] (03PS1) 10Ejegg: Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1227808 [14:33:25] (03CR) 10Ejegg: [C:03+2] Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1227808 (owner: 10Ejegg) [14:33:43] thanks damilare|brb [14:34:17] (03Merged) 10jenkins-bot: Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1227808 (owner: 10Ejegg) [14:36:14] (03CR) 10CI reject: [V:04-1] Ensure Donation consumer does not break when template strings get into the message contact_id parameters [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1227803 (https://phabricator.wikimedia.org/T413452) (owner: 10Damilare Adedoyin) [14:38:06] FIRING: CoreRouterInterfaceDown: Core router interface down - pfw1-codfw:reth1 (Subnet frack-fundraising-codfw in F5) - https://wikitech.wikimedia.org/wiki/Network_monitoring#Router_interface_down - https://grafana.wikimedia.org/d/fb403d62-5f03-434a-9dff-bd02b9fff504/network-device-overview?var-instance=pfw1-codfw:9804 - https://alerts.wikimedia.org/?q=alertname%3DCoreRouterInterfaceDown [14:45:20] 10Fundraising analytics stack, 06collaboration-services, 10GitLab (Project Migration), 06Release-Engineering-Team (Priority Backlog 📥): Move wikimedia/fundraising/analytics from Gerrit to Gitlab - https://phabricator.wikimedia.org/T391404#11529107 (10IAckerman-WMF) Checking in on this :) [14:59:23] np ejegg [15:18:56] !log fundraising civicrm upgraded from 54fb7415 to 8a0e4548 [15:18:58] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [15:39:12] 10Fundraising analytics stack, 06collaboration-services, 10GitLab (Project Migration), 06Release-Engineering-Team (Priority Backlog 📥): Move wikimedia/fundraising/analytics from Gerrit to Gitlab - https://phabricator.wikimedia.org/T391404#11529341 (10AStein-WMF) This is at the top of my list after the gshe... [15:50:33] (03PS1) 10Ejegg: Ensure reported TY email count is always an int [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1227828 (https://phabricator.wikimedia.org/T411439) [15:51:07] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10fundraising-tech-ops, 13Patch-For-Review: Thank you email metrics causing occasional prometheus parsing errors due to lack of value - https://phabricator.wikimedia.org/T411439#11529411 (10Ejegg) a:03Ejegg [15:52:29] 10Fundraising analytics stack, 06collaboration-services, 10GitLab (Project Migration), 06Release-Engineering-Team (Priority Backlog 📥): Move wikimedia/fundraising/analytics from Gerrit to Gitlab - https://phabricator.wikimedia.org/T391404#11529425 (10IAckerman-WMF) Sounds like the right prioritization! [15:56:34] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: Skipping refunds for contributions still in Donations Queue - https://phabricator.wikimedia.org/T412984#11529438 (10Ejegg) This seems to be due to a commit from last January https://gerrit.wikimedia.org/r/c/wikimedia/fundraising/crm/+/1115039 It stops th... [15:59:56] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: Pending Transaction Resolver: Payment is not awaiting approval - current status: pending / timeout - https://phabricator.wikimedia.org/T403958#11529459 (10Ejegg) Confirmed that it's working as intended - the only status that we can actually do anything ab... [16:31:38] (03PS1) 10Ejegg: Set snooze activity source contact to logged in user [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1227844 (https://phabricator.wikimedia.org/T412564) [16:36:11] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 13Patch-For-Review: Snooze activities when DR snooze a contact look like they are created by the contact - https://phabricator.wikimedia.org/T412564#11529668 (10Ejegg) a:03Ejegg [16:39:02] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10fundraising-tech-ops: Error logline about Queue host on Payment adapters - https://phabricator.wikimedia.org/T412519#11529684 (10Ejegg) [16:41:49] 06Fundraising-Backlog, 10fundraising-tech-ops: Error logline about Queue host on Payment adapters - https://phabricator.wikimedia.org/T412519#11529700 (10Ejegg) Seems like a similar ticket was closed by @Jgreen in September: {T405977} But this ticket shows the issues are ongoing. Removing chaos crew tag as thi... [16:48:35] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Mailing Events from Acoustic can be recorded on deleted duplicate contacts - https://phabricator.wikimedia.org/T404404#11529731 (10Ejegg) So just updating contact_ids in the mailing data tables on merge isn't enough, bec... [16:59:06] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Mailing Events from Acoustic can be recorded on deleted duplicate contacts - https://phabricator.wikimedia.org/T404404#11529759 (10Ejegg) Sorry, raw table vs permanent table only makes sense for the unsubscribes & opt-ou... [17:05:15] (03CR) 10Wfan: [C:03+2] Fix dlocal audit tests [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1227564 (https://phabricator.wikimedia.org/T414531) (owner: 10Cstone) [17:05:47] (03CR) 10Damilare Adedoyin: [C:03+2] Fix dlocal audit tests [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1227564 (https://phabricator.wikimedia.org/T414531) (owner: 10Cstone) [17:06:19] 06Fundraising-Backlog, 06Fundraising-Tech-Roadmap, 10FR-Donor-portal, 0725 Dec Q3 Planning: Logout for Donor Portal - https://phabricator.wikimedia.org/T407454#11529821 (10Lars) We will very soon have a Contact::invalidateChecksum action ({T412429}) that will let us use them as one-time login codes. [17:08:12] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: Skipping refunds for contributions still in Donations Queue - https://phabricator.wikimedia.org/T412984#11529824 (10Damilare) @Ejegg that makes sense, I just looked at our implementation. Looks like we may be sending the refund queue message in some insta... [17:08:43] (03CR) 10Wfan: [C:03+2] Ensure reported TY email count is always an int [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1227828 (https://phabricator.wikimedia.org/T411439) (owner: 10Ejegg) [17:08:55] (03PS2) 10Cstone: Fix dlocal audit tests [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1227564 (https://phabricator.wikimedia.org/T414531) [17:24:11] (03CR) 10CI reject: [V:04-1] Update smash-pig to v1.1.0 [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1227560 (owner: 10Cstone) [17:34:12] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: Import creating new Anonymous profiles - https://phabricator.wikimedia.org/T388671#11529951 (10Ejegg) →14Duplicate dup:03T394731 [17:34:15] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-Donation-Processing: Creation of new anonymous records on donation import - https://phabricator.wikimedia.org/T394731#11529953 (10Ejegg) [17:34:56] 06Fundraising-Backlog, 06Fundraising-Tech-Roadmap, 10FR-Donor-portal, 0725 Dec Q3 Planning: For discussion - Sandbox environment for user testing donor portal? - https://phabricator.wikimedia.org/T407861#11529955 (10Ejegg) 05Open→03Resolved a:03Ejegg [17:35:46] 06Fundraising-Backlog: IPs for Trustly SFTP reports - https://phabricator.wikimedia.org/T414833 (10Cstone) 03NEW [17:37:06] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: Names from ACH are all caps - https://phabricator.wikimedia.org/T407659#11529970 (10Ejegg) There's a merge resolver rule to determine the 'better' casing between two name versions - let's see if we can use that in the update path of WMFContact\Save [17:42:47] (03Merged) 10jenkins-bot: Ensure reported TY email count is always an int [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1227828 (https://phabricator.wikimedia.org/T411439) (owner: 10Ejegg) [18:09:53] (03PS1) 10Ejegg: Merge branch 'master' into wmf_deploy [extensions/CentralNotice] (wmf_deploy) - 10https://gerrit.wikimedia.org/r/1227864 [18:09:59] (03CR) 10Ejegg: [C:03+2] Merge branch 'master' into wmf_deploy [extensions/CentralNotice] (wmf_deploy) - 10https://gerrit.wikimedia.org/r/1227864 (owner: 10Ejegg) [18:10:09] (03CR) 10Cstone: "recheck" [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1227564 (https://phabricator.wikimedia.org/T414531) (owner: 10Cstone) [18:10:57] (03CR) 10Wfan: [C:03+2] Fix dlocal audit tests [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1227564 (https://phabricator.wikimedia.org/T414531) (owner: 10Cstone) [18:11:57] 03Fundraising Sprint: ARMchair, 06Fundraising-Backlog, 06Fundraising-Tech-Roadmap, 10MediaWiki-extensions-CentralNotice, 0725 Dec Q3 Planning: Special:HideBanners request from Thank You page shows warnings in console - https://phabricator.wikimedia.org/T411903#11530061 (10Ejegg) Just merged this to wmf_d... [18:20:49] (03PS1) 10Lars SG: Add checksum invalidator extension [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1227869 (https://phabricator.wikimedia.org/T412429) [18:22:46] (03PS2) 10Lars SG: Add checksum invalidator extension [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1227869 (https://phabricator.wikimedia.org/T412429) [18:24:14] (03Merged) 10jenkins-bot: Merge branch 'master' into wmf_deploy [extensions/CentralNotice] (wmf_deploy) - 10https://gerrit.wikimedia.org/r/1227864 (owner: 10Ejegg) [18:27:38] (03CR) 10CI reject: [V:04-1] Fix dlocal audit tests [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1227564 (https://phabricator.wikimedia.org/T414531) (owner: 10Cstone) [18:31:35] aw man [18:32:05] why didnt that break locally [18:35:21] (03PS3) 10Cstone: Fix dlocal audit tests [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1227564 (https://phabricator.wikimedia.org/T414531) [18:38:06] FIRING: CoreRouterInterfaceDown: Core router interface down - pfw1-codfw:reth1 (Subnet frack-fundraising-codfw in F5) - https://wikitech.wikimedia.org/wiki/Network_monitoring#Router_interface_down - https://grafana.wikimedia.org/d/fb403d62-5f03-434a-9dff-bd02b9fff504/network-device-overview?var-instance=pfw1-codfw:9804 - https://alerts.wikimedia.org/?q=alertname%3DCoreRouterInterfaceDown [18:42:18] (03CR) 10Cstone: [C:03+2] "looks good thanks!" [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1225710 (https://phabricator.wikimedia.org/T414387) (owner: 10Lars SG) [18:55:19] (03CR) 10CI reject: [V:04-1] Fix dlocal audit tests [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1227564 (https://phabricator.wikimedia.org/T414531) (owner: 10Cstone) [19:00:50] (03Merged) 10jenkins-bot: Add Double Opt-in email template [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1225710 (https://phabricator.wikimedia.org/T414387) (owner: 10Lars SG) [19:01:28] 03Fundraising Sprint: ARMchair, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-Donor-portal, and 2 others: Add checksum invalidation API action to CiviCRM - https://phabricator.wikimedia.org/T412429#11530207 (10Lars) a:03Lars [19:02:44] 03Fundraising Sprint: ARMchair, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 07Epic, 07fr-current-sprint: Show which contacts have double opted in / still need double opt in in Acoustic - https://phabricator.wikimedia.org/T413812#11530216 (10Lars) a:05Lars→03None [19:07:28] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-Donation-Processing: Large file to import - January DM Activities - https://phabricator.wikimedia.org/T414709#11530251 (10Lars) a:03Lars @MDemosWMF Done [19:10:22] 06Fundraising-Backlog, 10fundraising-tech-ops: IPs for Trustly SFTP reports - https://phabricator.wikimedia.org/T414833#11530274 (10Dwisehaupt) Here are the two public IP ranges we use: 208.80.155.0/27 208.80.152.224/28 Once they have those added, we will need to know what IPs/hostnames we would be connec... [19:41:08] 06Fundraising-Backlog, 10fundraising-tech-ops, 10Observability-Alerting: Shift frack alerting to use prometheus-alertmanager instead of icinga - https://phabricator.wikimedia.org/T367370#11530308 (10Dwisehaupt) We are looking to start firing alerts through alertmanager after the Q3 maintenance window (2026-... [20:17:28] 06Fundraising-Backlog, 10fundraising-tech-ops: IPs for Trustly SFTP reports - https://phabricator.wikimedia.org/T414833#11530389 (10Cstone) Response from the IP range: The first one contains 30 usable IPs (/27) and the second one contains 14 usable IPs (/28). Is your team able to reduce the amount of IPs? If... [20:21:50] 03Fundraising Sprint: ARMchair, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 07Epic, 07fr-current-sprint: Show which contacts have double opted in / still need double opt in in Acoustic - https://phabricator.wikimedia.org/T413812#11530400 (10NNgu-WMF) Hello! Checking in on the status of this t... [20:26:10] 03Fundraising Sprint: ARMchair, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 07Epic, 07fr-current-sprint: Show which contacts have double opted in / still need double opt in in Acoustic - https://phabricator.wikimedia.org/T413812#11530402 (10Lars) @NNgu-WMF Not done yet, but will definitely be... [20:27:14] (03CR) 10Lars SG: [C:03+2] Set snooze activity source contact to logged in user [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1227844 (https://phabricator.wikimedia.org/T412564) (owner: 10Ejegg) [20:44:15] 10fundraising-tech-ops, 06DC-Ops, 06Infrastructure-Foundations, 10ops-eqiad, 06SRE: Eqiad: Fr-tech expansion - https://phabricator.wikimedia.org/T403035#11530455 (10RobH) Correction: >>! In T403035#11518969, @cmooney wrote: > > WMF Mgmt Network Links `E15`: > > |Device 1|Front Port|Logical Int|Device... [20:45:53] (03Merged) 10jenkins-bot: Set snooze activity source contact to logged in user [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1227844 (https://phabricator.wikimedia.org/T412564) (owner: 10Ejegg) [20:50:44] 10fundraising-tech-ops, 06DC-Ops, 06Infrastructure-Foundations, 10ops-eqiad, 06SRE: Eqiad: Fr-tech expansion - https://phabricator.wikimedia.org/T403035#11530466 (10RobH) [20:56:34] 10fundraising-tech-ops, 06DC-Ops, 06Infrastructure-Foundations, 10ops-eqiad, 06SRE: Eqiad: Fr-tech expansion - https://phabricator.wikimedia.org/T403035#11530492 (10RobH) [20:58:29] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Mailing Events from Acoustic can be recorded on deleted duplicate contacts - https://phabricator.wikimedia.org/T404404#11530493 (10Lars) @Ejegg That makes sense to me. [20:59:09] 10fundraising-tech-ops, 06DC-Ops, 06Infrastructure-Foundations, 10ops-eqiad, 06SRE: Eqiad: Fr-tech expansion - https://phabricator.wikimedia.org/T403035#11530494 (10RobH) [21:06:22] 06Fundraising-Backlog, 10fundraising-tech-ops: IPs for Trustly SFTP reports - https://phabricator.wikimedia.org/T414833#11530519 (10Dwisehaupt) The trimmed down IP range would be: ` 208.80.152.230 208.80.152.232 208.80.155.7 208.80.155.17 ` We can use an ipset config to cover our outbound restrictions to their... [22:17:31] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-Donation-Processing, 13Patch-For-Review: NCOA Update import not working - https://phabricator.wikimedia.org/T410574#11530685 (10Lars) @MDemosWMF I just tried importing the first two rows and they worked for me.... [22:30:47] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-Donation-Processing: Direct Mail Activity Import File - December 2025 List - https://phabricator.wikimedia.org/T414391#11530712 (10Lars) [22:34:03] 06Fundraising-Backlog, 06Fundraising-Tech-Roadmap, 10MediaWiki-extensions-CentralNotice, 10Tool-centralnotice-banner-editor, 0725 Dec Q3 Planning: Operationalize Outreachy banner editor project - https://phabricator.wikimedia.org/T412454#11530724 (10aude) Wikimedia NYC is interested in the outreachy tool... [23:05:57] 03Fundraising Sprint: ARMchair, 14Fundraising Sprint: Vixen, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, and 3 others: Automate some Direct Mail white mail coding - https://phabricator.wikimedia.org/T386031#11530788 (10Lars) Thanks @RLewis I wanted to double check that for the Major Gifts Enga...