[00:05:56] (03CR) 10CI reject: [V:04-1] Only check if checksum exist when email updated [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1196546 (https://phabricator.wikimedia.org/T406983) (owner: 10Wfan) [00:22:11] (03PS1) 10Wfan: Align braintree venmo and gravy venmo username [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1199884 (https://phabricator.wikimedia.org/T406153) [00:22:28] (03PS6) 10Wfan: Handle queue differently only send email_checksum if email update [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1195203 (https://phabricator.wikimedia.org/T406983) [00:23:07] (03PS7) 10Wfan: Handle queue differently only send email_checksum if email update [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1195203 (https://phabricator.wikimedia.org/T406983) [00:24:42] (03CR) 10CI reject: [V:04-1] Handle queue differently only send email_checksum if email update [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1195203 (https://phabricator.wikimedia.org/T406983) (owner: 10Wfan) [00:37:34] (03CR) 10CI reject: [V:04-1] Align braintree venmo and gravy venmo username [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1199884 (https://phabricator.wikimedia.org/T406153) (owner: 10Wfan) [00:43:32] (03PS2) 10Wfan: Align braintree venmo and gravy venmo username [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1199884 (https://phabricator.wikimedia.org/T406153) [00:47:41] (03PS4) 10Wfan: Only check if checksum exist when email updated [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1196546 (https://phabricator.wikimedia.org/T406983) [01:24:18] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: Manually settled transactions only coming in on audit files - https://phabricator.wikimedia.org/T408768 (10Cstone) 03NEW [01:24:20] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: Manually settled transactions only coming in on audit files - https://phabricator.wikimedia.org/T408768#11325938 (10Cstone) a:03Cstone [01:51:58] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Non-donors have donor_status_id 100 (should be 1000) since Oct 9 - https://phabricator.wikimedia.org/T408769 (10Lars) 03NEW [01:56:16] (03PS2) 10Cstone: Log the unstaged data when rejected [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1199535 [02:02:32] (03PS2) 10Eileen: Remove drupal variable to setting convert from upgrader [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1199735 [02:02:33] (03CR) 10Ejegg: [C:03+2] Remove drupal variable to setting convert from upgrader [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1199735 (owner: 10Eileen) [02:12:43] (03PS3) 10Eileen: Schedule backfill on recurring gift channel [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1199817 (https://phabricator.wikimedia.org/T406193) [02:12:45] (03CR) 10Ejegg: [C:03+2] Schedule backfill on recurring gift channel [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1199817 (https://phabricator.wikimedia.org/T406193) (owner: 10Eileen) [02:18:19] (03Merged) 10jenkins-bot: Remove drupal variable to setting convert from upgrader [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1199735 (owner: 10Eileen) [02:30:20] (03Merged) 10jenkins-bot: Schedule backfill on recurring gift channel [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1199817 (https://phabricator.wikimedia.org/T406193) (owner: 10Eileen) [03:02:44] (03PS4) 10Cstone: WIP: Add variant for SMS optin [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1193298 (https://phabricator.wikimedia.org/T380106) [03:04:04] (03CR) 10CI reject: [V:04-1] WIP: Add variant for SMS optin [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1193298 (https://phabricator.wikimedia.org/T380106) (owner: 10Cstone) [05:29:17] (03PS1) 10Cstone: WIP: Add second recurring failure email [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1199940 (https://phabricator.wikimedia.org/T365488) [09:30:29] (03PS1) 10Eileen: Merge branch 'master' of https://gerrit.wikimedia.org/r/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1200006 [09:31:25] (03CR) 10Eileen: [C:03+2] Merge branch 'master' of https://gerrit.wikimedia.org/r/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1200006 (owner: 10Eileen) [09:32:11] (03Merged) 10jenkins-bot: Merge branch 'master' of https://gerrit.wikimedia.org/r/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1200006 (owner: 10Eileen) [09:34:39] !log civicrm upgraded from f8802d27 to ed25fa88 [09:34:42] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [12:31:52] 03Fundraising Sprint: UTM_key lime pie, 06Fundraising-Backlog, 10FR-Donor-portal, 13Patch-For-Review: Placeholder - Interim Paypal recurring donors in Donor Portal - https://phabricator.wikimedia.org/T407527#11326954 (10MSuijkerbuijk_WMF) Do we need the Cancel in there if donors manage it through PayPal?... [13:15:32] 10fundraising-tech-ops, 06Infrastructure-Foundations, 10netops: Downgrade pfw1-codfw to Junos 23.4R2-S3 - https://phabricator.wikimedia.org/T393996#11327066 (10Papaul) @Dwisehaupt yes Wednesday 11/5 is ok with me. Let us do 10:00am CT. Thank you. [14:31:01] (03PS1) 10Ejegg: Add source/medium/campaign to more activities [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1200079 (https://phabricator.wikimedia.org/T407644) [15:12:42] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 06FR-donorrelations: Feature Request: Add a “Recurring Active” Indicator on the Manual Merging Screen - https://phabricator.wikimedia.org/T408703#11327741 (10Lars) [15:13:29] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-Donation-Processing: Fidelity address error - https://phabricator.wikimedia.org/T408629#11327745 (10Lars) a:03Lars [15:46:09] PROBLEM - check_mysql on frdb2004 is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 22222 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb2004&service=check_mysql [15:46:13] PROBLEM - check_mysql on frdb2005 is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 22225 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb2005&service=check_mysql [15:47:30] ACKNOWLEDGEMENT - check_mysql on frdb2004 is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 22222 Jeff_Green backups causing replag https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb2004&service=check_mysql [15:47:30] ACKNOWLEDGEMENT - check_mysql on frdb2005 is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 22225 Jeff_Green backups causing replag https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb2005&service=check_mysql [15:48:26] fr-tech would people mind if I combined the donorPortal API endpoints for recurring modification into just one? [15:57:01] 06Fundraising-Backlog, 06Fundraising-Tech-Roadmap, 10Wikimedia-Fundraising-CiviCRM, 10FR-Donor-portal: Change recurring donation frequency from monthly to yearly in the civi UI - https://phabricator.wikimedia.org/T396541#11328096 (10Lars) @AMJohnson I think we can change this upstream in CiviCRM as I don't... [15:57:02] partly just to cut down on the overhead of the parameter documentation :) [15:58:56] 06Fundraising-Backlog, 10fundraising-tech-ops: FR-Tech FY2526Q2 maintenance window - https://phabricator.wikimedia.org/T364184#11328104 (10Dwisehaupt) [16:00:49] 10fundraising-tech-ops, 06Infrastructure-Foundations, 10netops: Downgrade pfw1-codfw to Junos 23.4R2-S3 - https://phabricator.wikimedia.org/T393996#11328131 (10Dwisehaupt) Cool. Let's do it then. [16:01:13] PROBLEM - check_load on fransw2003 is CRITICAL: LOAD CRITICAL - total load average: 83.58, 70.82, 54.53 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fransw2003&service=check_load [16:02:11] PROBLEM - check_load on fransw2002 is CRITICAL: LOAD CRITICAL - total load average: 61.97, 70.22, 56.76 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fransw2002&service=check_load [16:07:11] PROBLEM - check_load on fransw2002 is CRITICAL: LOAD CRITICAL - total load average: 50.82, 68.72, 60.78 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fransw2002&service=check_load [16:16:09] RECOVERY - check_mysql on frdb2004 is OK: Uptime: 68860 Threads: 4 Questions: 8238410 Slow queries: 41 Opens: 1588 Open tables: 1360 Queries per second avg: 119.639 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 6936 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb2004&service=check_mysql [16:16:13] RECOVERY - check_mysql on frdb2005 is OK: Uptime: 68807 Threads: 4 Questions: 7745195 Slow queries: 41 Opens: 1472 Open tables: 1254 Queries per second avg: 112.564 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 12719 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb2005&service=check_mysql [16:21:13] RECOVERY - check_load on fransw2003 is OK: LOAD OK - total load average: 35.72, 39.45, 46.54 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fransw2003&service=check_load [16:22:15] RECOVERY - check_load on fransw2002 is OK: LOAD OK - total load average: 29.78, 33.41, 44.28 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fransw2002&service=check_load [16:25:31] PROBLEM - Host frnetmon1002 is DOWN: PING CRITICAL - Packet loss = 100% [16:26:17]  that's me. sneaking in a reboot that i thought i could get between the checks. [16:26:39] it's already back up. [16:30:09] RECOVERY - Host frnetmon1002 is UP: PING OK - Packet loss = 0%, RTA = 0.45 ms [16:48:49] 03Fundraising Sprint: UTM_key lime pie, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-Donation-Processing, and 2 others: Batch data entry update - Contact edit pop-out - https://phabricator.wikimedia.org/T408258#11328530 (10Lars) @MDemosWMF The quick edit form for organizations is now availa... [17:01:29] @ejegg|food Is there a way to prepopulate email via query string on https://donorpreferences.wikimedia.org/index.php?title=Special:DonorPortal&email=jdlrobson@gmail.com#/login ? [17:07:24] Jdlrobson: it would be possible to add that featuer, but if you are sending a known donor a link from our mailing house you can just populate the link with the contact ID and checksum [17:12:07] 03Fundraising Sprint: UTM_key lime pie, 06Fundraising-Backlog, 10FR-payments-general, 13Patch-For-Review: PaymentsWiki W25 design test - https://phabricator.wikimedia.org/T407241#11328699 (10IAsplund-WMF) @Ejegg Thanks for the beautiful work on the payments wiki page which I'm viewing here: https://ejegg.c... [17:21:46] 03Fundraising Sprint: UTM_key lime pie, 06Fundraising-Backlog, 10FR-payments-general, 13Patch-For-Review: PaymentsWiki W25 design test - https://phabricator.wikimedia.org/T407241#11328783 (10Ejegg) >>! In T407241#11328697, @IAsplund-WMF wrote: > @Ejegg Thanks for the beautiful work on the payments wiki pag... [17:22:10] fr-tech anyone able to review the WP25 stuff? I'd like to get it deployed today if possible [17:22:13] https://gerrit.wikimedia.org/r/1197302 [17:22:19] (links to the other two patches) [17:22:38] (03CR) 10Cstone: [C:03+2] Add assets for WP25 appeal [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1199860 (owner: 10Ejegg) [17:22:43] thanks! [17:26:49] woo, source_enqueued_time is right again [17:27:41] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Checkout source_enqueued_time: 4462-10-03 17:59:48 - https://phabricator.wikimedia.org/T406640#11328793 (10Ejegg) Looks like the fix worked! New records are being created with sensible dates. [17:30:30] (03Merged) 10jenkins-bot: Add assets for WP25 appeal [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1199860 (owner: 10Ejegg) [17:31:10] so fancy ejegg [17:31:20] about time we did something different on this page :P [17:31:20] yeah, quite nice looking! [17:31:30] (03CR) 10Cstone: [C:03+2] Allow raw HTML in appeal [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1198391 (https://phabricator.wikimedia.org/T407241) (owner: 10Ejegg) [17:31:52] (03CR) 10Cstone: [C:03+2] "so fancy!" [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/1197302 (https://phabricator.wikimedia.org/T407241) (owner: 10Ejegg) [17:35:23] thanks! [17:35:35] gonna go grab the car off the charger while that merges [17:42:09] (03PS3) 10Wfan: Align braintree venmo and gravy venmo username [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1199884 (https://phabricator.wikimedia.org/T406153) [17:42:29] @ejegg|brb I was thinking about workflows from mediawiki to donatepreferences and how if we know the user's email address we can make that transition a bit more seamless [17:44:52] ohh right Jdlrobson [17:50:37] (03Merged) 10jenkins-bot: Allow raw HTML in appeal [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1198391 (https://phabricator.wikimedia.org/T407241) (owner: 10Ejegg) [18:10:31] (03PS1) 10Ejegg: Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - 10https://gerrit.wikimedia.org/r/1200127 [18:10:57] (03CR) 10Ejegg: [C:03+2] Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - 10https://gerrit.wikimedia.org/r/1200127 (owner: 10Ejegg) [18:18:59] (03Merged) 10jenkins-bot: Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - 10https://gerrit.wikimedia.org/r/1200127 (owner: 10Ejegg) [18:35:48] !log payments-wiki upgraded from 3db28493 to 0132998e [18:35:51] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [18:35:58] ok, that's the code up, now to get the actual template in there [18:50:33] 10fundraising-tech-ops: Schedule fr-tech reboots for microcode updates - https://phabricator.wikimedia.org/T408742#11329221 (10Dwisehaupt) [18:54:06] 03Fundraising Sprint: UTM_key lime pie, 06Fundraising-Backlog, 10FR-payments-general, 05MW-1.46-notes (1.46.0-wmf.1; 2025-11-05), 13Patch-For-Review: PaymentsWiki W25 design test - https://phabricator.wikimedia.org/T407241#11329228 (10Ejegg) OK, the code change and the template are up on payments-wiki:... [19:01:14] 06Fundraising-Backlog, 10fundraising-tech-ops: FR-Tech FY2526Q2 maintenance window - https://phabricator.wikimedia.org/T364184#11329270 (10AStein-WMF) [19:02:59] 03Fundraising Sprint: UTM_key lime pie, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-Donation-Processing, and 2 others: Batch data entry update - Contact edit pop-out - https://phabricator.wikimedia.org/T408258#11329278 (10MDemosWMF) Great! Thank @Lars ! [19:22:38] 03Fundraising Sprint: UTM_key lime pie, 06Fundraising-Backlog, 10FR-payments-general, 05MW-1.46-notes (1.46.0-wmf.1; 2025-11-05), 13Patch-For-Review: PaymentsWiki W25 design test - https://phabricator.wikimedia.org/T407241#11329317 (10IAsplund-WMF) this looks great and is responsive @Ejegg however it app... [19:46:17] 03Fundraising Sprint: UTM_key lime pie, 06Fundraising-Backlog, 10FR-payments-general, 05MW-1.46-notes (1.46.0-wmf.1; 2025-11-05), 13Patch-For-Review: PaymentsWiki W25 design test - https://phabricator.wikimedia.org/T407241#11329356 (10Pcoombe) The different color is deliberate, see the [Figma file](https... [19:51:35] 03Fundraising Sprint: UTM_key lime pie, 06Fundraising-Backlog, 10FR-payments-general, 05MW-1.46-notes (1.46.0-wmf.1; 2025-11-05), 13Patch-For-Review: PaymentsWiki W25 design test - https://phabricator.wikimedia.org/T407241#11329382 (10ppenloglou) Yes the light blue background is intentional from @RLopez-... [20:06:36] 03Fundraising Sprint: UTM_key lime pie, 06Fundraising-Backlog, 10FR-payments-general, 05MW-1.46-notes (1.46.0-wmf.1; 2025-11-05), 13Patch-For-Review: PaymentsWiki W25 design test - https://phabricator.wikimedia.org/T407241#11329451 (10ppenloglou) Sharing a no tracking, minimal link here that displays WP2... [20:15:13] 10Fundraising analytics stack: Ingest Zendesk data into MinIO - https://phabricator.wikimedia.org/T379121#11329476 (10AStein-WMF) the connector is merged and i materialized a small subset. Waiting on Kristine to lmk her preferred format to review the data [20:15:29] 10Fundraising analytics stack: Ingest Zendesk data into MinIO - https://phabricator.wikimedia.org/T379121#11329478 (10AStein-WMF) 05Open→03Stalled [20:16:42] 03Fundraising Sprint: UTM_key lime pie, 06Fundraising-Backlog, 10FR-payments-general, 05MW-1.46-notes (1.46.0-wmf.1; 2025-11-05), 13Patch-For-Review: PaymentsWiki W25 design test - https://phabricator.wikimedia.org/T407241#11329480 (10IAsplund-WMF) Ok great, thanks all! [20:18:43] 03Fundraising Sprint: UTM_key lime pie, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-Donation-Processing, and 2 others: Batch data entry update - Contact edit pop-out - https://phabricator.wikimedia.org/T408258#11329482 (10Lars) @MDemosWMF For the relationships, I'm working on making it pos... [20:42:07] PROBLEM - check_ipsec on fran1002 is CRITICAL: Strongswan CRITICAL - ok: 0 not-conn: frban1002_v4 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fran1002&service=check_ipsec [20:47:07] PROBLEM - check_ipsec on fran1002 is CRITICAL: Strongswan CRITICAL - ok: 0 not-conn: frban1002_v4 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fran1002&service=check_ipsec [20:47:30] 03Fundraising Sprint: UTM_key lime pie, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-Donation-Processing, and 2 others: Batch data entry update - Contact edit pop-out - https://phabricator.wikimedia.org/T408258#11329626 (10MDemosWMF) @Lars I think seeing the name of the linked record will b... [20:49:01] ^^^ checking that out. it was up and the mount is working. [20:49:32] 03Fundraising Sprint: UTM_key lime pie, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-Donation-Processing, and 2 others: Batch data entry update - Contact edit pop-out - https://phabricator.wikimedia.org/T408258#11329648 (10Lars) @MDemosWMF Sounds good, we'll aim to do all three in the end. [20:52:07] PROBLEM - check_ipsec on fran1002 is CRITICAL: Strongswan CRITICAL - ok: 0 not-conn: frban1002_v4 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fran1002&service=check_ipsec [20:55:02] ACKNOWLEDGEMENT - check_ipsec on fran1002 is CRITICAL: Strongswan CRITICAL - ok: 0 not-conn: frban1002_v4 Dwisehaupt known https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fran1002&service=check_ipsec [21:01:34] (03CR) 10Ejegg: [V:03+2] Add WP25 appeal template [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/1197302 (https://phabricator.wikimedia.org/T407241) (owner: 10Ejegg) [21:02:06] RECOVERY - check_ipsec on fran1002 is OK: Strongswan OK - 1 ESP OK https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fran1002&service=check_ipsec [21:06:36] (03PS1) 10Ejegg: Send activity tracking for recurring pause + cancel [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1200169 (https://phabricator.wikimedia.org/T407644) [21:07:41] (03PS2) 10Ejegg: Add source/medium/campaign to more activities [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1200079 (https://phabricator.wikimedia.org/T407644) [21:09:41] (03CR) 10CI reject: [V:04-1] Send activity tracking for recurring pause + cancel [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1200169 (https://phabricator.wikimedia.org/T407644) (owner: 10Ejegg) [21:10:30] 03Fundraising Sprint: UTM_key lime pie, 06Fundraising-Backlog, 10FR-payments-general, 05MW-1.46-notes (1.46.0-wmf.1; 2025-11-05), 13Patch-For-Review: PaymentsWiki W25 design test - https://phabricator.wikimedia.org/T407241#11329760 (10spatton) I'm so impressed! Thank you @Ejegg for your work on this, and... [21:24:06] (03PS9) 10Ejegg: WIP Send recurring failure email via coworker [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1191089 (https://phabricator.wikimedia.org/T356073) [21:30:38] 03Fundraising Sprint: UTM_key lime pie, 06Fundraising-Backlog, 10FR-payments-general, 05MW-1.46-notes (1.46.0-wmf.1; 2025-11-05), 13Patch-For-Review: PaymentsWiki W25 design test - https://phabricator.wikimedia.org/T407241#11329828 (10Ejegg) @Spatton we need to write one more bit of code in DonationInter... [21:41:26] (03PS10) 10Ejegg: Send recurring failure email via coworker [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1191089 (https://phabricator.wikimedia.org/T356073) [21:43:45] cstone: I split off the part that was failing and ^^ should pass tests for just the emails sent during the recurring charge job [21:48:09] (03PS2) 10Ejegg: Send activity tracking for recurring pause + cancel [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1200169 (https://phabricator.wikimedia.org/T407644) [21:50:22] (03CR) 10CI reject: [V:04-1] Send activity tracking for recurring pause + cancel [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1200169 (https://phabricator.wikimedia.org/T407644) (owner: 10Ejegg) [21:58:52] (03PS3) 10Ejegg: Send activity tracking for recurring pause + cancel [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1200169 (https://phabricator.wikimedia.org/T407644) [22:00:21] (03CR) 10CI reject: [V:04-1] Send activity tracking for recurring pause + cancel [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1200169 (https://phabricator.wikimedia.org/T407644) (owner: 10Ejegg) [22:09:16] ACKNOWLEDGEMENT - check_mysql on payments1006 is CRITICAL: Slave IO: Connecting Slave SQL: Yes Seconds Behind Master: (null) Dwisehaupt paymentsdb origin restart https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=payments1006&service=check_mysql [22:09:16] ACKNOWLEDGEMENT - check_mysql on payments1007 is CRITICAL: Slave IO: Connecting Slave SQL: Yes Seconds Behind Master: (null) Dwisehaupt paymentsdb origin restart https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=payments1007&service=check_mysql [22:09:16] ACKNOWLEDGEMENT - check_mysql on payments1008 is CRITICAL: Slave IO: Connecting Slave SQL: Yes Seconds Behind Master: (null) Dwisehaupt paymentsdb origin restart https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=payments1008&service=check_mysql [22:09:16] ACKNOWLEDGEMENT - check_mysql on payments2005 is CRITICAL: Slave IO: Connecting Slave SQL: Yes Seconds Behind Master: (null) Dwisehaupt paymentsdb origin restart https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=payments2005&service=check_mysql [22:09:16] ACKNOWLEDGEMENT - check_mysql on payments2006 is CRITICAL: Slave IO: Connecting Slave SQL: Yes Seconds Behind Master: (null) Dwisehaupt paymentsdb origin restart https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=payments2006&service=check_mysql [22:10:21] (03PS4) 10Ejegg: Send activity tracking for recurring pause + cancel [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1200169 (https://phabricator.wikimedia.org/T407644) [22:11:35] 03Fundraising Sprint: UTM_key lime pie, 06Fundraising-Backlog, 06Fundraising-Tech-Roadmap, 10Wikimedia-Fundraising-CiviCRM, and 2 others: Move the recurring failure send out of the charge job and check for other active recurrings by email - https://phabricator.wikimedia.org/T356073#11329913 (10Ejegg) [22:12:43] 03Fundraising Sprint: UTM_key lime pie, 06Fundraising-Backlog, 06Fundraising-Tech-Roadmap, 10Wikimedia-Fundraising-CiviCRM, and 2 others: Move the recurring failure send out of the charge job and check for other active recurrings by email - https://phabricator.wikimedia.org/T356073#11329919 (10Ejegg) The p... [22:12:49] (03CR) 10CI reject: [V:04-1] Send activity tracking for recurring pause + cancel [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1200169 (https://phabricator.wikimedia.org/T407644) (owner: 10Ejegg) [22:13:30] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 06FR-donorrelations: Civi failure email not sending due to Mailing error: Failed to write to socket: unknown error - https://phabricator.wikimedia.org/T404203#11329922 (10Ejegg) Patch for part of the fix is ready for review: https://gerrit.wikimedia.org... [22:17:16] 10fundraising-tech-ops: Schedule fr-tech reboots for microcode updates - https://phabricator.wikimedia.org/T408742#11329925 (10Dwisehaupt) [22:36:41] (03PS5) 10Ejegg: Send activity tracking for recurring pause + cancel [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1200169 (https://phabricator.wikimedia.org/T407644) [22:38:48] (03CR) 10CI reject: [V:04-1] Send activity tracking for recurring pause + cancel [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1200169 (https://phabricator.wikimedia.org/T407644) (owner: 10Ejegg) [23:15:27] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Non-donors have donor_status_id 100 (should be 1000) since Oct 9 - https://phabricator.wikimedia.org/T408769#11330040 (10Lars) p:05Triage→03Low a:03Lars [23:16:38] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Non-donors have donor_status_id 100 (should be 1000) since Oct 9 - https://phabricator.wikimedia.org/T408769#11330046 (10Lars) [23:17:06] (03PS8) 10Wfan: Add more lowConfidence payment method sources [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1196140 (https://phabricator.wikimedia.org/T406153) [23:50:20] 10fundraising-tech-ops: Schedule fr-tech reboots for microcode updates - https://phabricator.wikimedia.org/T408742#11330115 (10Dwisehaupt)