[00:16:55] 10fundraising-tech-ops: Fundraising systems Debian Trixie support - https://phabricator.wikimedia.org/T401847#11965890 (10Dwisehaupt) frdev1003 built out and has clean puppet runs except for the ssh copy of the LE cert. May wish to test one more rebuild to exercise the new lvm/raid clearing partman config. Servi... [00:22:27] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 07FR-Audience-Dev: Combine all the ways we send automated civi emails - https://phabricator.wikimedia.org/T415953#11965893 (10Lars) With @ejegg's new WorkflowMessage send wrapper, this has become more feasible. This would also standardize the creation o... [00:25:40] 03Fundraising Sprint: Infinity Pool, 06Fundraising-Backlog, 06Fundraising-Tech-Roadmap, 06FR-donorrelations, and 3 others: Ability to resend emails Civi has already generated - https://phabricator.wikimedia.org/T389693#11965899 (10Lars) @krobinson @SHust All of the transactional emails for donations listed... [00:29:36] 03Fundraising Sprint: Infinity Pool, 06Fundraising-Backlog, 06Fundraising-Tech-Roadmap, 06FR-donorrelations, and 3 others: Ability to resend emails Civi has already generated - https://phabricator.wikimedia.org/T389693#11965901 (10Lars) @CHudson-WMF We've added a new custom field for Email activity types i... [01:34:30] (03PS1) 10Cstone: Add failure count to failed recurring activity [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1295105 [01:49:30] (03PS1) 10Cstone: WIP: Add in retryable and move error handling into activity [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1295107 [02:11:08] (03CR) 10CI reject: [V:04-1] WIP: Add in retryable and move error handling into activity [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1295107 (owner: 10Cstone) [05:35:38] (03CR) 10CI reject: [V:04-1] Localisation updates from https://translatewiki.net. [extensions/DonationInterface] (REL1_46) - 10https://gerrit.wikimedia.org/r/1295155 (owner: 10L10n-bot) [05:54:17] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-WMF-Audit: Figure out how to ensure that all donations are settling - https://phabricator.wikimedia.org/T427238#11966081 (10RKumar_WMF) https://civicrm.wikimedia.org/civicrm/contact/view/contribution?reset=1&action=view&id=141718950 - This is an AC... [06:20:11] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-WMF-Audit: Figure out how to ensure that all donations are settling - https://phabricator.wikimedia.org/T427238#11966112 (10RKumar_WMF) https://civicrm.wikimedia.org/civicrm/contact/view?reset=1&cid=51892697 - Would you be able to tell which one is... [09:57:39] FIRING: HighPaymentFraudMessages: More than 10 payment fraud messages in the past hour [10.5] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentFraudMessages [10:57:39] RESOLVED: HighPaymentFraudMessages: More than 10 payment fraud messages in the past hour [10.4] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentFraudMessages [11:16:30] 06Fundraising-Backlog, 06FR-donorrelations: Followup for donors from T426916 - https://phabricator.wikimedia.org/T427583#11966784 (10ppenloglou) Hey @MBeat33, I was informed about this from your Slack thread. I've created a message template named //[[ https://civicrm.wikimedia.org/civicrm/admin/messageTemplat... [11:35:39] FIRING: HighPaymentsMedianRiskScore: Median payments risk_score is running high [93.5] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentsMedianRiskScore [12:10:39] RESOLVED: HighPaymentsMedianRiskScore: Median payments risk_score is running high [91.8] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentsMedianRiskScore [13:07:20] (03PS10) 10Damilare Adedoyin: Add fraud prediction service to dev stack [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/1275424 (https://phabricator.wikimedia.org/T408750) [13:11:17] (03CR) 10Damilare Adedoyin: Add fraud prediction service to dev stack (031 comment) [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/1275424 (https://phabricator.wikimedia.org/T408750) (owner: 10Damilare Adedoyin) [13:18:47] 03Fundraising Sprint: Infinity Pool, 06Fundraising-Backlog, 06Fundraising-Tech-Roadmap, 06FR-donorrelations, and 3 others: Ability to resend emails Civi has already generated - https://phabricator.wikimedia.org/T389693#11967199 (10CHudson-WMF) Thanks, @Lars Yea, this is good to know. We're not modeling any... [13:26:11] FIRING: NodeDown: Node frav1003 is down. - https://frmon.wikimedia.org/d/000000377/host-overview?orgId=1&var-host=frav1003 - https://alerts.wikimedia.org/?q=alertname%3DNodeDown [13:31:11] FIRING: NodeDown: Node frav1003 has been down for long. - https://frmon.wikimedia.org/d/000000377/host-overview?orgId=1&var-host=frav1003 - https://alerts.wikimedia.org/?q=alertname%3DNodeDown [13:37:33] FIRING: RsyslogBacklog: 3 ryslog files queued up on frlog1002.frack.eqiad.wmnet:9100 - https://alerts.wikimedia.org/?q=alertname%3DRsyslogBacklog [13:41:11] RESOLVED: NodeDown: Node frav1003 is down. - https://frmon.wikimedia.org/d/000000377/host-overview?orgId=1&var-host=frav1003 - https://alerts.wikimedia.org/?q=alertname%3DNodeDown [13:42:33] RESOLVED: RsyslogBacklog: 3 ryslog files queued up on frlog1002.frack.eqiad.wmnet:9100 - https://alerts.wikimedia.org/?q=alertname%3DRsyslogBacklog [13:48:41] RESOLVED: NodeDown: Node frav1003 has been down for long. - https://frmon.wikimedia.org/d/000000377/host-overview?orgId=1&var-host=frav1003 - https://alerts.wikimedia.org/?q=alertname%3DNodeDown [14:30:34] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-Smashpig: Last Test - https://phabricator.wikimedia.org/T427647 (10FR-Tech-Request-Bot) 03NEW [14:44:42] 06Fundraising-Backlog: Delay cancelling monthly recurring until month 3 - https://phabricator.wikimedia.org/T419112#11967808 (10AKanji-WMF) a:05AKanji-WMF→03None Is this still blocked team? [14:54:29] 06Fundraising-Backlog: Delay cancelling monthly recurring until month 3 - https://phabricator.wikimedia.org/T419112#11967848 (10Lars) @AKanji-WMF Not blocked at this point, but not sure how soon we want to implement since we have just done step one (retrying over 15 days) and we might want to see what the effect... [15:02:08] (03CR) 10Lars SG: "Wonder if this should be a custom field so analytics don't have to muck around with strings?" [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1295105 (owner: 10Cstone) [15:20:34] 03Fundraising Sprint: Infinity Pool, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 07fr-current-sprint: Change last donation amount, last donation original currency and last donation currency from foundation to all funds - https://phabricator.wikimedia.org/T426189#11967920 (10Lars) @ppenloglou @N... [16:24:48] 06Fundraising-Backlog, 10Phabricator-Bot-Requests, 06Release-Engineering-Team (Doing 😎): Phabricator Bot Request: Fundraising Tech Bug Reporter - https://phabricator.wikimedia.org/T426459#11968155 (10AKanji-WMF) 05Open→03Resolved Thank you again, this works as hoped for! (and thanks @Dactylantha for... [16:28:15] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-payments-general: Large DM Activity file to import - May 2026 - https://phabricator.wikimedia.org/T427550#11968174 (10MDemosWMF) Got it, thanks! [16:35:32] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Backfill location type for emails for existing contacts using Apple, Google, Amazon, Venmo or PayPal - https://phabricator.wikimedia.org/T420992#11968213 (10Lars) I've done some QA on this and it seems like we've caught... [16:38:44] 10fundraising-tech-ops: Repurpose WMF5520 for antifraud service prototyping - https://phabricator.wikimedia.org/T427663 (10Jgreen) 03NEW [16:45:20] 10fundraising-tech-ops: Repurpose WMF5520 for antifraud service prototyping - https://phabricator.wikimedia.org/T427663#11968231 (10Jgreen) [16:45:50] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-payments-general: Large DM Activity file to import - May 2026 - https://phabricator.wikimedia.org/T427550#11968233 (10Lars) [16:58:07] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-payments-general: Large DM Activity file to import - May 2026 - https://phabricator.wikimedia.org/T427550#11968259 (10Lars) @Dwisehaupt We currently have in PHP: post_max_size => '12M', upload_max_files... [17:12:09] 03Fundraising Sprint: Infinity Pool, 06Fundraising-Backlog, 07fr-current-sprint, 13Patch-For-Review, 07payments-orchestration: Always route Gravy recurring transactions through their original connection - https://phabricator.wikimedia.org/T422416#11968297 (10jgleeson) Moving back to needing review. This... [17:13:54] 03Fundraising Sprint: Infinity Pool, 06Fundraising-Backlog, 07Epic, 07fr-combowiki, 07fr-current-sprint: Native Payments - https://phabricator.wikimedia.org/T415586#11968317 (10jgleeson) I'll add the repo URL I shared last Friday to the ticket description to make this easier to review [17:14:33] 03Fundraising Sprint: Infinity Pool, 06Fundraising-Backlog, 07Epic, 07fr-combowiki, 07fr-current-sprint: Native Payments - https://phabricator.wikimedia.org/T415586#11968318 (10jgleeson) [17:33:36] 06Fundraising-Backlog, 06FR-donorrelations: Followup for donors from T426916 - https://phabricator.wikimedia.org/T427583#11968367 (10MBeat33) Thank you @ppenloglou, I appreciate the hyperlink, and the draft mailing looks good. [17:37:30] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 06FR-donorrelations, 07fr-current-sprint: Improve automatic deduping - https://phabricator.wikimedia.org/T415806#11968370 (10Lars) [18:22:25] 03Fundraising Sprint: Infinity Pool, 06Fundraising-Backlog, 06Fundraising-Tech-Roadmap, 06FR-donorrelations, and 3 others: Ability to resend emails Civi has already generated - https://phabricator.wikimedia.org/T389693#11968457 (10krobinson) This is great, thank you @Lars [18:54:40] (03PS2) 10Ejegg: Add fraud-scoring db setup and config [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/1295075 [19:14:40] 03Fundraising Sprint: Infinity Pool, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 07fr-current-sprint: Change last donation amount, last donation original currency and last donation currency from foundation to all funds - https://phabricator.wikimedia.org/T426189#11968610 (10NNgu-WMF) Thank you... [19:39:11] FIRING: NodeDown: Node frdb1004 is down. - https://frmon.wikimedia.org/d/000000377/host-overview?orgId=1&var-host=frdb1004 - https://alerts.wikimedia.org/?q=alertname%3DNodeDown [19:44:11] FIRING: NodeDown: Node frdb1004 has been down for long. - https://frmon.wikimedia.org/d/000000377/host-overview?orgId=1&var-host=frdb1004 - https://alerts.wikimedia.org/?q=alertname%3DNodeDown [19:49:11] RESOLVED: NodeDown: Node frdb1004 has been down for long. - https://frmon.wikimedia.org/d/000000377/host-overview?orgId=1&var-host=frdb1004 - https://alerts.wikimedia.org/?q=alertname%3DNodeDown [19:49:11] RESOLVED: NodeDown: Node frdb1004 is down. - https://frmon.wikimedia.org/d/000000377/host-overview?orgId=1&var-host=frdb1004 - https://alerts.wikimedia.org/?q=alertname%3DNodeDown [19:52:12] 10fundraising-tech-ops: Fundraising mariadb database server/service tuning - https://phabricator.wikimedia.org/T423950#11968764 (10Jgreen) frdb1004 (soon-to-be-decommed reader) has BIOS adjustment and mariadb tuning applied [20:09:17] (03CR) 10Raimond Spekking: [C:03+2] Localisation updates from https://translatewiki.net. [extensions/CentralNotice] - 10https://gerrit.wikimedia.org/r/1295376 (owner: 10L10n-bot) [20:09:47] (03CR) 10Raimond Spekking: [C:03+2] Localisation updates from https://translatewiki.net. [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1295384 (owner: 10L10n-bot) [20:43:38] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-MGFE: Manual Civi send now Thank You Email for Endowment DAF gifts includes tax information - https://phabricator.wikimedia.org/T427371#11968950 (10MDemosWMF) Thanks for spotting this @RLewis ! [20:44:29] 03Fundraising Sprint: Infinity Pool, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-Donation-Processing, and 2 others: When Civi import shows two contacts exist that match imported data, provide a link to merge them - https://phabricator.wikimedia.org/T426620#11968962 (10MDemosWMF) Sounds good! [23:16:39] FIRING: HighPaymentFraudMessages: More than 10 payment fraud messages in the past hour [15.5] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentFraudMessages [23:25:22] 03Fundraising Sprint: Infinity Pool, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Don't store content of thank you email and annual summary receipts - https://phabricator.wikimedia.org/T421558#11969147 (10Lars) I've also done WMFDataManagement.ArchiveThankYou for the old Email type thank yous of w... [23:26:39] FIRING: HighPaymentsMedianRiskScore: Median payments risk_score is running high [72.7] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentsMedianRiskScore [23:31:39] RESOLVED: HighPaymentsMedianRiskScore: Median payments risk_score is running high [71.0] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentsMedianRiskScore