[00:02:24] (03PS8) 10Eileen: Switch Omnigroupmember.load to apiv4 [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1144712 (https://phabricator.wikimedia.org/T379702) [00:02:25] (03PS4) 10Eileen: Add support for downloading master suppression list [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1145350 (https://phabricator.wikimedia.org/T298381) [00:02:25] (03PS3) 10Eileen: Allow Omnigroupmember.load to handle our Acoustic phone consents [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1145365 (https://phabricator.wikimedia.org/T379702) [00:03:09] (03PS4) 10Eileen: Allow Omnigroupmember.load to handle our Acoustic phone consents [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1145365 (https://phabricator.wikimedia.org/T379702) [00:03:09] (03PS2) 10Eileen: Wip on uploading consents [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1146479 [00:08:41] (03PS5) 10Eileen: Allow Omnigroupmember.load to handle our Acoustic phone consents [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1145365 (https://phabricator.wikimedia.org/T379702) [00:10:28] (03PS3) 10Eileen: Wip on uploading consents [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1146479 [00:22:38] (03CR) 10CI reject: [V:04-1] Wip on uploading consents [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1146479 (owner: 10Eileen) [00:22:44] (03CR) 10CI reject: [V:04-1] Allow Omnigroupmember.load to handle our Acoustic phone consents [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1145365 (https://phabricator.wikimedia.org/T379702) (owner: 10Eileen) [00:29:59] (03CR) 10CI reject: [V:04-1] Wip on uploading consents [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1146479 (owner: 10Eileen) [01:15:15] (03CR) 10Cstone: [C:03+2] Test adding Gravy fields to resolved pending transactions [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1146595 (https://phabricator.wikimedia.org/T393477) (owner: 10Jgleeson) [01:32:36] (03Merged) 10jenkins-bot: Test adding Gravy fields to resolved pending transactions [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1146595 (https://phabricator.wikimedia.org/T393477) (owner: 10Jgleeson) [03:02:15] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10FR-Tech-Analytics, 10FR-tech-data-integrity, 10MW-1.45-notes (1.45.0-wmf.2; 2025-05-20): Null backend_processor for gravy records in civi - https://phabricator.wikimedia.org/T393477#10828579 (10Cstone) Looks like the ones that got backfilled got t... [04:17:10] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 06FR-donorrelations: Mass Card Declines Following Japan Email 1 - https://phabricator.wikimedia.org/T394007#10828604 (10RKumar_WMF) From Adyen: We can give confirmation that both the BIN and MID that were sent originally were the correct ones. The co... [04:45:45] 03Fundraising Sprint Impossible shepherds pie, 14Fundraising Sprint: Hot Pot!, 06Fundraising-Backlog, 07fr-acoustic, 13Patch-For-Review: Develop process for tracking & handling SMS consent records - https://phabricator.wikimedia.org/T379702#10828614 (10Eileenmcnaughton) I have managed to push phone and c... [05:09:49] (03PS1) 10Eileen: Add action to find Consents with civi record & push updates to Acoustic [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1146831 (https://phabricator.wikimedia.org/T379702) [05:27:39] (03CR) 10CI reject: [V:04-1] Add action to find Consents with civi record & push updates to Acoustic [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1146831 (https://phabricator.wikimedia.org/T379702) (owner: 10Eileen) [05:45:07] (03PS2) 10Eileen: Add action to find Consents with civi record & push updates to Acoustic [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1146831 (https://phabricator.wikimedia.org/T379702) [09:53:19] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10FR-Tech-Analytics, 10FR-tech-data-integrity, 10MW-1.45-notes (1.45.0-wmf.2; 2025-05-20): Null backend_processor for gravy records in civi - https://phabricator.wikimedia.org/T393477#10829215 (10jgleeson) @Cstone I just checked the last batch of ba... [10:14:14] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10MW-1.45-notes (1.45.0-wmf.1; 2025-05-13): Japan credit card processing error - https://phabricator.wikimedia.org/T393939#10829260 (10jgleeson) Thanks @EMartin, I've reviewed the files on Mac using the Numbers app, and they are still the same. I've res... [12:56:27] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 06FR-donorrelations: Trouble voiding transaction at Gr4vy - https://phabricator.wikimedia.org/T394090#10829796 (10Damilare) Gravy's is looking into this with Adyen according to the last message on the slack thread. According to the [last update](https:/... [13:35:15] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10FR-Tech-Analytics, 10FR-tech-data-integrity, 10MW-1.45-notes (1.45.0-wmf.2; 2025-05-20): Null backend_processor for gravy records in civi - https://phabricator.wikimedia.org/T393477#10829970 (10jgleeson) Ok I see it @Cstone ! I just kicked off a n... [14:13:54] (03PS1) 10Jgleeson: Update Zendesk tickets tab to also show closed tickets [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1147002 (https://phabricator.wikimedia.org/T374154) [14:21:46] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 06FR-donorrelations, 13Patch-For-Review: "Zendesk TIckets" tab not showing related tickets on for some donors - https://phabricator.wikimedia.org/T374154#10830120 (10jgleeson) @SHust We've figured it out! It wasn't related to the email address after a... [14:25:12] fr-tech, could someone help review a really small civicrm zendesk patch, pls? https://gerrit.wikimedia.org/r/c/wikimedia/fundraising/crm/+/1147002 I've made a slight update to the API call parameters to pull in closed tickets that were previously being missed. I've tested it locally with test and live data, and it now works. Unfortunately, I can't upload screenshots due to PII, but if anyone wants to see it working before [14:25:12] +2ing, I can show you on a call. Thanks in advance! [14:48:51] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 06FR-donorrelations: PayPal 'contribution_info' donation missing from Civi - https://phabricator.wikimedia.org/T387171#10830235 (10Damilare) Hi @MBeat33, thanks for bringing this to our attention, looks like the contribution was imported although it was... [15:02:49] (03CR) 10Cstone: [C:03+2] Update Zendesk tickets tab to also show closed tickets [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1147002 (https://phabricator.wikimedia.org/T374154) (owner: 10Jgleeson) [15:04:26] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: Update SmashPig Gravy listener to use the new transaction payload - https://phabricator.wikimedia.org/T393958#10830308 (10Damilare) a:03Damilare [15:05:43] 06Fundraising-Backlog, 06Fundraising-Tech-Roadmap, 10Wikimedia-Fundraising-CiviCRM, 10FR-Donor-portal, 10FR-email-preferences: Implement recurring donation monthly-to-annual conversion - https://phabricator.wikimedia.org/T388753#10830336 (10AKanji-WMF) Hi @Ejegg - quick question, for the annual recurrin... [15:14:57] thank you cstone! [15:15:43] i forgot i put up a patch on frpm to change the gravy audit could you take a look at that real quick? [15:16:07] sure will do [15:17:37] fileLimit 6 cstone ? [15:18:08] is that cause of the 5 blank ones? [15:19:11] its until we figure out how to ignore user generated reports [15:20:09] ah ok. lgtm then [15:20:34] thanks [15:21:25] (03Merged) 10jenkins-bot: Update Zendesk tickets tab to also show closed tickets [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1147002 (https://phabricator.wikimedia.org/T374154) (owner: 10Jgleeson) [15:21:55] thats how I found that civiimport issue I manually ran the audit last night and it said there were 15k missing transactions [15:23:20] oh wow [15:26:13] PROBLEM - check_load on fransw2003 is CRITICAL: LOAD CRITICAL - total load average: 10.01, 21.67, 14.80 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fransw2003&service=check_load [15:33:16] so after importing the final ~6000 backfilled records today cstone, also also mapping the gateway after you found that bug, I ran a "final" query to confirm they were all fixed and found that there's 200 new ones :S so there's ANOTHER route in somewhere lol [15:34:16] thanks for the review on that pending trxn resolver text too cstone [15:34:32] just caught that in the diff between master => deployment [15:34:36] bah another new one [15:34:53] maybe actually from the audit? [15:35:03] hmmm maybees [15:35:51] cstone: there they are https://civicrm.wikimedia.org/civicrm/search#/display/Gravy_Missing_Backend_Processor_Data [15:36:00] yeah i still have it open from last night too hah [15:36:13] RECOVERY - check_load on fransw2003 is OK: LOAD OK - total load average: 0.14, 4.61, 9.38 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fransw2003&service=check_load [15:36:16] we've fixed over 30k [15:36:17] although i like the search view better [15:36:44] (03PS1) 10Jgleeson: Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1147021 [15:37:01] (03CR) 10Jgleeson: [C:03+2] Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1147021 (owner: 10Jgleeson) [15:38:00] (03Merged) 10jenkins-bot: Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1147021 (owner: 10Jgleeson) [15:38:25] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 06FR-donorrelations: PayPal 'contribution_info' donation missing from Civi - https://phabricator.wikimedia.org/T387171#10830458 (10MBeat33) Many thanks for solving the mystery @Damilare [15:40:42] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 06FR-donorrelations: PayPal 'contribution_info' donation missing from Civi - https://phabricator.wikimedia.org/T387171#10830463 (10jgleeson) This might be one of the records affected by the bug logged in {T394298} Cristiano @ Gravy is currently looking... [15:40:57] looks like some still from the job runners but most from direct which maybe is the audit? [15:43:32] jgleeson: the paypal trxn on that phab was through paypal_ec not gravy paypal [15:44:25] damilare: gravy were also having an issue with some paypal donations not coming in with email or donor info [15:44:41] via their own integration [15:45:28] yh I saw that but this was in decemeber, the donor pii came in on this trxn but the Recurring Donation QC seem to have removed the email [15:46:34] you can use this logdog command to search for it in the logs "logdog -d 202412 225417827.1" [15:46:35] ah ok different then [15:47:03] yepp [15:47:40] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 06FR-donorrelations: "Zendesk TIckets" tab not showing related tickets on for some donors - https://phabricator.wikimedia.org/T374154#10830516 (10jgleeson) The fix for this is now deployed. I've checked the three CIDS on the ticket and can now see the r... [15:48:10] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 06FR-donorrelations: Mass Card Declines Following Japan Email 1 - https://phabricator.wikimedia.org/T394007#10830518 (10EMartin) Jack confirms the numbers used were the same and Adyen's response doesn't explain the issue. Back to the drawing board. [15:49:01] cstone: I'm gonna backfill that last 200 for completeness(ish). we can stil refer back to the list via the import summary [15:49:47] when did we deploy the pending transaction resolver fix maybe these are from that [15:49:58] one captured 1:40 after the auth [15:50:14] hmm I think that went out yesterday [15:50:20] I pushed it out with ejegg|away not being here [15:50:20] cause these are from the 14 [15:50:30] ohhh ok [15:50:38] oh lemme sort by date [15:50:38] so maybe they are fixed [15:51:12] yeah latest from may 15th at 9:19am ignoring the april 1 one at the top... haha that seems like a different issue [15:52:00] need to confirm the one im looking at is from the pending transaction resolver [16:00:47] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 06FR-donorrelations: Transactions settled at Adyen but stuck at Capturing at Gr4vy? - https://phabricator.wikimedia.org/T393112#10830536 (10SHust) Thanks, @Damilare! I'll make sure to follow that thread. [16:22:58] (03CR) 10Wfan: [C:03+2] Add validation to make sure amounts entered through the form are numeric [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1144588 (https://phabricator.wikimedia.org/T392655) (owner: 10Damilare Adedoyin) [16:23:27] (03Merged) 10jenkins-bot: Add validation to make sure amounts entered through the form are numeric [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1144588 (https://phabricator.wikimedia.org/T392655) (owner: 10Damilare Adedoyin) [16:29:27] (03PS1) 10Cstone: Revert "Move custom field handling from apiv3 to BAO" [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1147029 [17:18:56] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10MediaWiki-extensions-CentralNotice, 10MW-1.45-notes (1.45.0-wmf.2; 2025-05-20): No longer able to preview centralnotice banners - https://phabricator.wikimedia.org/T394399#10830721 (10Jdlrobson-WMF) Does this need backporting or is it okay to go out... [17:44:22] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 06FR-donorrelations: PayPal 'contribution_info' donation missing from Civi - https://phabricator.wikimedia.org/T387171#10830822 (10Damilare) Thanks @jgleeson as discussed this is similar but not related to Gr4vy as it's on the direct connection. @MBeat... [18:24:56] (03CR) 10Cstone: [C:03+2] Revert "Move custom field handling from apiv3 to BAO" [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1147029 (owner: 10Cstone) [18:33:28] (03PS1) 10Greg Grossmeier: Merge branch 'master' into wmf_deploy [extensions/CentralNotice] (wmf/1.45.0-wmf.1) - 10https://gerrit.wikimedia.org/r/1147043 [18:34:23] so, re the CN deploy, I just made the cherrypick to the deploy branch ^ and will need review from someone to merge and then test that it works during the deploy, is someone around that can do that? [18:35:00] (03CR) 10CI reject: [V:04-1] Merge branch 'master' into wmf_deploy [extensions/CentralNotice] (wmf/1.45.0-wmf.1) - 10https://gerrit.wikimedia.org/r/1147043 (owner: 10Greg Grossmeier) [18:35:06] well then... [18:36:04] huh why did that fail greg-g [18:36:37] oh i see after the giant test chunk [18:37:07] not sure, I'm going to go ask James_F in -releng since he's online. [18:37:12] the quibble backtrace is weird to me [18:37:16] at the very end [18:37:18] yeah [18:43:02] 06Fundraising-Backlog, 06FR-donorrelations: research request for pending transaction resolver metric - https://phabricator.wikimedia.org/T394539 (10MBeat33) 03NEW [18:43:14] (03Merged) 10jenkins-bot: Revert "Move custom field handling from apiv3 to BAO" [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1147029 (owner: 10Cstone) [19:09:36] cstone: unrelated flaggedrevs breakage, apparently [19:09:43] See -releng [19:10:19] power of CN breaking things [19:13:51] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 06FR-donorrelations: Trouble voiding transaction at Gr4vy - https://phabricator.wikimedia.org/T394090#10831180 (10LWadleigh) Adding a few more examples: Zendesk #1677558 2025-05-13 Transaction ID cead3695-17b1-48b4-843b-52b138f1f0e9 Zendesk #1677798... [19:23:37] now The Exorcist is in my head [19:32:13] PROBLEM - check_load on fransw2002 is CRITICAL: LOAD CRITICAL - total load average: 5.57, 16.00, 15.03 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fransw2002&service=check_load [19:41:18] (03PS1) 10Cstone: Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1147054 [19:42:45] (03CR) 10Cstone: [C:03+2] Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1147054 (owner: 10Cstone) [19:43:33] (03Merged) 10jenkins-bot: Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1147054 (owner: 10Cstone) [19:44:45] !log civicrm upgraded from 2ae29ec9 to 5b155eaa [19:44:47] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [19:44:58] ^ that was a rollback to stop failmail not a new feature friday deploy :P [19:52:11] RECOVERY - check_load on fransw2002 is OK: LOAD OK - total load average: 7.41, 5.23, 8.10 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fransw2002&service=check_load [19:58:48] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10MediaWiki-extensions-CentralNotice, 10MW-1.45-notes (1.45.0-wmf.2; 2025-05-20): No longer able to preview centralnotice banners - https://phabricator.wikimedia.org/T394399#10831289 (10KMorrow-WMF) >>! In T394399#10830721, @Jdlrobson-WMF wrote: > Doe... [20:11:41] (03CR) 10Novem Linguae: "See T394542 for discussion about the CI failure and how to fix." [extensions/CentralNotice] (wmf/1.45.0-wmf.1) - 10https://gerrit.wikimedia.org/r/1147043 (owner: 10Greg Grossmeier) [20:16:12] (03PS1) 10Reedy: Update incorrect PHP namespace in BundleSizeTest [extensions/CentralNotice] (wmf/1.45.0-wmf.1) - 10https://gerrit.wikimedia.org/r/1147060 (https://phabricator.wikimedia.org/T373017) [20:16:34] (03PS2) 10Greg Grossmeier: Merge branch 'master' into wmf_deploy [extensions/CentralNotice] (wmf/1.45.0-wmf.1) - 10https://gerrit.wikimedia.org/r/1147043 [20:18:20] (03CR) 10CI reject: [V:04-1] Update incorrect PHP namespace in BundleSizeTest [extensions/CentralNotice] (wmf/1.45.0-wmf.1) - 10https://gerrit.wikimedia.org/r/1147060 (https://phabricator.wikimedia.org/T373017) (owner: 10Reedy) [20:18:46] (03CR) 10CI reject: [V:04-1] Merge branch 'master' into wmf_deploy [extensions/CentralNotice] (wmf/1.45.0-wmf.1) - 10https://gerrit.wikimedia.org/r/1147043 (owner: 10Greg Grossmeier) [21:19:34] 10fundraising-tech-ops: Fundraising access request for rholt - https://phabricator.wikimedia.org/T394553 (10Dwisehaupt) 03NEW [21:19:43] 10fundraising-tech-ops: Fundraising access request for ksargatzke - https://phabricator.wikimedia.org/T394554 (10Dwisehaupt) 03NEW [21:19:48] 10fundraising-tech-ops: Fundraising access request for cpetrillo - https://phabricator.wikimedia.org/T394555 (10Dwisehaupt) 03NEW [21:20:25] 10fundraising-tech-ops: Determine additional setup needs for new Metabase users - https://phabricator.wikimedia.org/T394434#10831538 (10Dwisehaupt) `rlopez` has an active ssl client cert and only needs a metabase account created. `lgruwell` has an ssl client cert that will need renewing. `rholt` `ksargatzke` a... [21:26:23] 06Fundraising-Backlog, 06FR-donorrelations: research request for pending transaction resolver metric - https://phabricator.wikimedia.org/T394539#10831549 (10Cstone) We also made a phab about this {T394351}, even in our logs we had just been reporting how many were done in total, not the success/fail rate [21:45:57] (03PS1) 10Cstone: WIP: Name gravy reports based on their name [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1147067 (https://phabricator.wikimedia.org/T394132) [21:46:22] (03CR) 10CI reject: [V:04-1] WIP: Name gravy reports based on their name [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1147067 (https://phabricator.wikimedia.org/T394132) (owner: 10Cstone) [21:56:21] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 06FR-donorrelations, 07Unplanned-Sprint-Work: Civi merge is not saving the state when a mailing address is present. - https://phabricator.wikimedia.org/T379684#10831630 (10AKanji-WMF) [22:28:16] 10fundraising-tech-ops: Fundraising access request for rholt - https://phabricator.wikimedia.org/T394553#10831656 (10Dwisehaupt) [22:28:23] 10fundraising-tech-ops: Fundraising access request for ksargatzke - https://phabricator.wikimedia.org/T394554#10831657 (10Dwisehaupt) [22:28:35] 10fundraising-tech-ops: Fundraising access request for cpetrillo - https://phabricator.wikimedia.org/T394555#10831658 (10Dwisehaupt)