[00:15:57] (03CR) 10Lars SG: [C:03+2] Add additional mailing-provider fields for analytics [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1327211 (https://phabricator.wikimedia.org/T435402) (owner: 10Eileen) [00:28:10] (03PS7) 10Wfan: Add a Monthly Convert [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1326359 (https://phabricator.wikimedia.org/T433143) [00:28:30] (03PS2) 10Wfan: Add venmo to combo wiki [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1327174 (https://phabricator.wikimedia.org/T432231) [00:33:36] (03Merged) 10jenkins-bot: Add additional mailing-provider fields for analytics [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1327211 (https://phabricator.wikimedia.org/T435402) (owner: 10Eileen) [00:34:25] 06Fundraising-Backlog, 07fr-combowiki: Update the list of ::fieldNames in data fetched from request and session - https://phabricator.wikimedia.org/T434803#12234994 (10Cstone) We need to add in donatewiki ones too as email doesn't want to change things on their end [00:34:31] 06Fundraising-Backlog, 07fr-combowiki: Update the list of ::fieldNames in data fetched from request and session - https://phabricator.wikimedia.org/T434803#12234995 (10Cstone) a:03Cstone [00:34:53] 03Fundraising Sprint: Ottoman-o-war, 06Fundraising-Backlog, 07fr-combowiki: Update the list of ::fieldNames in data fetched from request and session - https://phabricator.wikimedia.org/T434803#12234996 (10Cstone) [00:39:15] (03PS1) 10Dmiranda: Added employer match helptext underneath employer field [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1327230 (https://phabricator.wikimedia.org/T435132) [00:41:37] (03Merged) 10jenkins-bot: Populated additional mailing fields [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1327218 (https://phabricator.wikimedia.org/T435402) (owner: 10Eileen) [00:43:02] 03Fundraising Sprint: Ottoman-o-war, 06Fundraising-Backlog: Create dedicated app_install_id field in contribution_tracking - https://phabricator.wikimedia.org/T433883#12235023 (10Cstone) It took less then a second when running on staging and also less than a second running on production. This is there now [00:48:36] (03Abandoned) 10Cstone: WIP: Handle Moto webhooks [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1311895 (https://phabricator.wikimedia.org/T417842) (owner: 10Cstone) [00:51:12] (03PS1) 10Lars SG: Trigger update [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1327232 [00:54:42] (03CR) 10Eileen: [C:03+2] Trigger update [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1327232 (owner: 10Lars SG) [00:56:04] (03CR) 10Lars SG: [V:03+2] Trigger update [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1327232 (owner: 10Lars SG) [00:57:11] 06Fundraising-Backlog, 07fr-combowiki, 10FR-Tech onboarding task, 13Patch-For-Review: Combowiki: employer field explain text - https://phabricator.wikimedia.org/T435132#12235063 (10dmiranda) Hi @Cstone! The patch for this ticket is up and ready for review [[ https://gerrit.wikimedia.org/r/c/1327230 | here... [00:57:12] 03Fundraising Sprint: Ottoman-o-war, 06Fundraising-Backlog, 07fr-combowiki, 13Patch-For-Review: Recurring convert in Combowiki - https://phabricator.wikimedia.org/T433143#12235064 (10AnnWF) [00:58:39] (03PS1) 10Lars SG: Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1327233 [00:59:10] 06Fundraising-Backlog, 07fr-combowiki: Recurring convert in Combowiki - pre payment suggestion - https://phabricator.wikimedia.org/T435431 (10AnnWF) 03NEW [00:59:44] 03Fundraising Sprint: Ottoman-o-war, 06Fundraising-Backlog, 07fr-combowiki, 13Patch-For-Review: Recurring convert in Combowiki - post payment - https://phabricator.wikimedia.org/T433143#12235084 (10AnnWF) [00:59:49] (03CR) 10Lars SG: [C:03+2] Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1327233 (owner: 10Lars SG) [01:02:47] 03Fundraising Sprint: Ottoman-o-war, 06Fundraising-Backlog, 10FR-payments-general, 07fr-current-sprint, 10FR-Tech onboarding task: Handle gravy moto webhooks - https://phabricator.wikimedia.org/T432672#12235089 (10Cstone) Whoops I missed this comment, that WIP I made during a call, I abandoned it [01:03:38] (03CR) 10Lars SG: [V:03+2 C:03+2] Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1327233 (owner: 10Lars SG) [01:04:44] !log civicrm upgraded from ba2bc5f4 to 225dc534 [01:04:45] Logged the message at https://wikitech.wikimedia.org/wiki/Fundraising/SAL [01:07:46] wfan: thanks for making that new phab for recurring covert, is it ok if I edit it? [01:08:37] (03PS8) 10Wfan: Add post recurring convert popup modal [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1326359 (https://phabricator.wikimedia.org/T433143) [01:09:05] Sure, I am about to work on that pre recurring suggestion one [01:09:38] Also just realized that we want to call it recurring convert so I updated the popup modal name and rebased to venmo patch since both paypal and venmo use that pre MC popup [01:09:56] Thanks cstone :)~ [01:10:28] yeah i think it should be recurring convert now cause it could be annual or monthly [01:11:05] do you think the pre one as it is now would be a lot of work wfan ? if so we should wait a weke and confirm design wise what we want to do [01:15:39] RESOLVED: SystemdService: Systemd service coworker.service stopped on civi1002.frack.eqiad.wmnet:9100 - https://alerts.wikimedia.org/?q=alertname%3DSystemdService [01:19:43] RESOLVED: RedisQueueSize: Redis Queue contribution_tracking is high: [8705] - https://frmon.wikimedia.org/d/R5m3iU1Wk/queue?orgId=1&from=now-24h&to=now&timezone=utc - https://alerts.wikimedia.org/?q=alertname%3DRedisQueueSize [01:21:34] FIRING: DiskSpace: Disk space WARNING for (instance frpm1002.frack.eqiad.wmnet:9100):/home - https://alerts.wikimedia.org/?q=alertname%3DDiskSpace [01:22:20] 10fundraising-tech-ops: Deprecate and delete FR drupal database - https://phabricator.wikimedia.org/T418628#12235099 (10Dwisehaupt) Database dropped: ` MariaDB [(none)]> drop database drupal; Query OK, 96 rows affected (0.420 sec) ` [01:23:48] 10fundraising-tech-ops: Deprecate and delete FR drupal database - https://phabricator.wikimedia.org/T418628#12235100 (10Dwisehaupt) [01:25:13] RESOLVED: RedisQueueSize: Redis Queue contribution_tracking is Critical: [8705] - https://frmon.wikimedia.org/d/R5m3iU1Wk/queue?orgId=1&from=now-24h&to=now&timezone=utc - https://alerts.wikimedia.org/?q=alertname%3DRedisQueueSize [01:25:53] Sure, the pre one can wait if we need to discuss design, also I noticed even we name it recurring convert, only suggest monthly by default should discuss that too, thanks cstone, and see ya tomorrow~ [01:26:03] thanks wfan ! [01:27:09] RESOLVED: SystemdService: Systemd service coworker.service stopped on civi1002.frack.eqiad.wmnet:9100 - https://alerts.wikimedia.org/?q=alertname%3DSystemdService [01:31:27] 03Fundraising Sprint: Ottoman-o-war, 06Fundraising-Backlog, 10FR-payments-general, 07fr-current-sprint, 13Patch-For-Review: 2nd Recurring Failure Email in Civi - https://phabricator.wikimedia.org/T365488#12235102 (10Cstone) [01:34:18] 03Fundraising Sprint: Ottoman-o-war, 06Fundraising-Backlog, 10FR-payments-general, 07fr-current-sprint, 13Patch-For-Review: 2nd Recurring Failure Email in Civi - https://phabricator.wikimedia.org/T365488#12235103 (10Cstone) Tested it tonight: 500 - sent in 2 mins 1322 in 3 mins It's only sending for wha... [03:21:49] (03PS1) 10Ejegg: Add os, browser, and versions to payment_attempt [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1327239 (https://phabricator.wikimedia.org/T435399) [03:22:24] late entry to the table alter game ^^ [03:31:35] (03PS1) 10Ejegg: Backfill OS / Browser / version on payment_attempt [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1327240 (https://phabricator.wikimedia.org/T435399) [03:47:48] (03PS1) 10Ejegg: Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - 10https://gerrit.wikimedia.org/r/1327241 [03:51:16] (03CR) 10Ejegg: [C:03+2] Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - 10https://gerrit.wikimedia.org/r/1327241 (owner: 10Ejegg) [03:52:53] (03CR) 10Eileen: [C:04-1] "There are some patterns here that I think AI has seen in our code & tried to copy - but which turned out to be not-best-practice" [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1327239 (https://phabricator.wikimedia.org/T435399) (owner: 10Ejegg) [03:52:53] (03Merged) 10jenkins-bot: Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - 10https://gerrit.wikimedia.org/r/1327241 (owner: 10Ejegg) [03:58:49] (03PS4) 10Lars SG: Lead generation queue consumer [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1324962 (https://phabricator.wikimedia.org/T434150) (owner: 10Ejegg) [03:58:56] (03CR) 10Ejegg: [C:03+2] "Modifications look good. Thanks, Lars!" [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1324962 (https://phabricator.wikimedia.org/T434150) (owner: 10Ejegg) [04:00:21] oh hah eileen that's just old-fashioned codegen not AI [04:00:24] lemme fix that script [04:00:54] oh ok - I don't think civix does now? [04:01:31] oh i'm not using civix, just a script that reads the schema in the ML repo [04:03:00] the name is ok on the index though? [04:06:53] (03PS2) 10Ejegg: Add os, browser, and versions to payment_attempt [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1327239 (https://phabricator.wikimedia.org/T435399) [04:06:54] (03PS2) 10Ejegg: Backfill OS / Browser / version on payment_attempt [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1327240 (https://phabricator.wikimedia.org/T435399) [04:08:08] ejegg|afk: looks ok other than accidental white space change [04:11:06] ah rats, lemme fix that too [04:14:05] (03PS3) 10Ejegg: Add os, browser, and versions to payment_attempt [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1327239 (https://phabricator.wikimedia.org/T435399) [04:14:32] ok, the generator script seems to be leaving the rest unchanged [04:14:42] well, trailing newline I think is actually good? [04:14:51] anyway, gotta get to bed! [04:15:21] wait one more thing [04:18:27] !log donorwiki upgraded from a06ae998 to c56b3ad7 [04:18:28] Logged the message at https://wikitech.wikimedia.org/wiki/Fundraising/SAL [04:22:17] (03Merged) 10jenkins-bot: Lead generation queue consumer [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1324962 (https://phabricator.wikimedia.org/T434150) (owner: 10Ejegg) [04:23:31] (03CR) 10Eileen: [C:03+2] Add os, browser, and versions to payment_attempt [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1327239 (https://phabricator.wikimedia.org/T435399) (owner: 10Ejegg) [04:28:06] thanks eileen! [04:28:21] no worries [04:34:10] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 07fr-acoustic: Add & populate new columns to mailing_data_provider_table Content Id & Click Name - https://phabricator.wikimedia.org/T435402#12235164 (10Eileenmcnaughton) Fields are added & being populated - we can consider backfill once @HAhmed-WMF & @... [04:37:28] (03PS9) 10Eileen: Populate new gateway custom field [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1324598 (https://phabricator.wikimedia.org/T434041) [04:38:44] (03CR) 10Lars SG: [C:03+2] Populate new gateway custom field [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1324598 (https://phabricator.wikimedia.org/T434041) (owner: 10Eileen) [04:41:54] (03Merged) 10jenkins-bot: Add os, browser, and versions to payment_attempt [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1327239 (https://phabricator.wikimedia.org/T435399) (owner: 10Ejegg) [04:50:01] (03PS1) 10Eileen: Declare organization_name as used for AuditMessages [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1327243 (https://phabricator.wikimedia.org/T432813) [04:58:39] FIRING: HighPaymentsMedianRiskScore: Median payments risk_score is running high [37.0] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentsMedianRiskScore [04:59:31] (03Merged) 10jenkins-bot: Populate new gateway custom field [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1324598 (https://phabricator.wikimedia.org/T434041) (owner: 10Eileen) [05:08:39] RESOLVED: HighPaymentsMedianRiskScore: Median payments risk_score is running high [37.5] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentsMedianRiskScore [05:21:34] FIRING: DiskSpace: Disk space WARNING for (instance frpm1002.frack.eqiad.wmnet:9100):/home - https://alerts.wikimedia.org/?q=alertname%3DDiskSpace [05:33:48] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-WMF-Audit: New? Cancelled contribution status causing settlement problems - https://phabricator.wikimedia.org/T435156#12235185 (10Eileenmcnaughton) Fixed https://civicrm.wikimedia.org/civicrm/contact/view/contribution?reset=1&action=view&id=1481283... [07:03:16] (03CR) 10Laurabarluzzi: [C:03+2] Declare organization_name as used for AuditMessages [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1327243 (https://phabricator.wikimedia.org/T432813) (owner: 10Eileen) [07:14:36] 03Fundraising Sprint: Ottoman-o-war, 06Fundraising-Backlog: Network Token Enablement Information Request - https://phabricator.wikimedia.org/T435111#12235295 (10RKumar_WMF) 05Open→03Resolved a:03RKumar_WMF Gr4vy informed no action required on our end hence closing this task. Ty. [07:17:39] FIRING: HighPaymentFraudMessages: More than 10 payment fraud messages in the past hour [10.2] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentFraudMessages [07:20:39] FIRING: HighPaymentsMedianRiskScore: Median payments risk_score is running high [76.0] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentsMedianRiskScore [07:27:29] (03Merged) 10jenkins-bot: Declare organization_name as used for AuditMessages [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1327243 (https://phabricator.wikimedia.org/T432813) (owner: 10Eileen) [08:12:39] RESOLVED: HighPaymentFraudMessages: More than 10 payment fraud messages in the past hour [16.1] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentFraudMessages [08:15:39] RESOLVED: HighPaymentsMedianRiskScore: Median payments risk_score is running high [50.3] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentsMedianRiskScore [09:21:34] FIRING: DiskSpace: Disk space WARNING for (instance frpm1002.frack.eqiad.wmnet:9100):/home - https://alerts.wikimedia.org/?q=alertname%3DDiskSpace [10:02:39] FIRING: HighPaymentsMedianRiskScore: Median payments risk_score is running high [30.9] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentsMedianRiskScore [10:07:39] RESOLVED: HighPaymentsMedianRiskScore: Median payments risk_score is running high [30.9] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentsMedianRiskScore [10:51:39] FIRING: HighPaymentFraudMessages: More than 10 payment fraud messages in the past hour [10.4] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentFraudMessages [11:47:32] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-payments-general: GoFundMe integration - https://phabricator.wikimedia.org/T432890#12236418 (10MSuijkerbuijk_WMF) Hi both! - We do **//not //**want monthly donors to get a TYL every month, and we //**do**// want to understand the split between... [11:51:39] RESOLVED: HighPaymentFraudMessages: More than 10 payment fraud messages in the past hour [10.1] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentFraudMessages [11:59:34] 06Fundraising-Backlog, 07fr-combowiki: Important: prevent duplicate contribution tracking message in ComboWiki - https://phabricator.wikimedia.org/T434829#12236492 (10Damilare) a:03Damilare [12:08:39] FIRING: HighPaymentFraudMessages: More than 10 payment fraud messages in the past hour [10.6] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentFraudMessages [12:13:39] RESOLVED: HighPaymentFraudMessages: More than 10 payment fraud messages in the past hour [10.7] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentFraudMessages [12:40:23] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: Failmail alert Validation error during recurring charge, in field: payment_submethod - https://phabricator.wikimedia.org/T435133#12236795 (10Laurabarluzzi) Going forward, we can ignore these specific messages if the payment_mehtod is **eftpos_australia**... [12:42:24] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: Failmail alert Validation error during recurring charge, in field: payment_submethod - https://phabricator.wikimedia.org/T435133#12236797 (10Laurabarluzzi) 05Open→03Resolved [13:21:34] FIRING: DiskSpace: Disk space WARNING for (instance frpm1002.frack.eqiad.wmnet:9100):/home - https://alerts.wikimedia.org/?q=alertname%3DDiskSpace [13:21:52] 03Fundraising Sprint: Ottoman-o-war, 06Fundraising-Backlog, 07fr-combowiki: Update the list of ::fieldNames in data fetched from request and session - https://phabricator.wikimedia.org/T434803#12236991 (10Laurabarluzzi) @Cstone you might want to consider blending this task with {https://phabricator.wikimedia... [13:25:05] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: venmo recurring failing with Payment method has not been successfully stored - https://phabricator.wikimedia.org/T434741#12237016 (10Damilare) Hi @Cstone, yes we did ask Gravy about this on this [[ https://wikimedia.slack.com/archives/C070F1DVBRN/p1785762... [13:31:09] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10fr-tech-maintenance: Failmail ack system - https://phabricator.wikimedia.org/T435410#12237044 (10SBurnett-WMF) Adding to Sprint +1 for visibility so we can discuss at the end of Sprint as a team & decide/brainstorm [13:35:22] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: venmo recurring failing with Payment method has not been successfully stored - https://phabricator.wikimedia.org/T434741#12237056 (10Laurabarluzzi) We asked Gravy in Slack here: https://wikimedia.slack.com/archives/C070F1DVBRN/p1785762839774829 In their... [13:36:34] RESOLVED: DiskSpace: Disk space WARNING for (instance frpm1002.frack.eqiad.wmnet:9100):/home - https://alerts.wikimedia.org/?q=alertname%3DDiskSpace [13:42:09] 06Fundraising-Backlog, 07fr-maintenance: Update fun-dev SSL cert - https://phabricator.wikimedia.org/T435374#12237092 (10SBurnett-WMF) [13:47:00] 03Fundraising Sprint: Ottoman-o-war, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 07fr-current-sprint: Remove un-needed separate endowment/foundation calculated fields from Civi & Acoustic - https://phabricator.wikimedia.org/T418885#12237140 (10AStein-WMF) Hey folks, please let FR-Analytics know... [13:51:43] 03Fundraising Sprint: Ottoman-o-war, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 07fr-current-sprint: Remove un-needed separate endowment/foundation calculated fields from Civi & Acoustic - https://phabricator.wikimedia.org/T418885#12237173 (10Lars) Sorry @AStein-WMF, will do. [13:57:11] FIRING: NodeDown: Node frpm1002 is down. - https://frmon.wikimedia.org/d/000000377/host-overview?orgId=1&var-host=frpm1002 - https://alerts.wikimedia.org/?q=alertname%3DNodeDown [13:59:25] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: venmo recurring failing with Payment method has not been successfully stored - https://phabricator.wikimedia.org/T434741#12237208 (10Laurabarluzzi) 05Open→03In progress p:05Triage→03Medium [14:00:03] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: venmo recurring failing with Payment method has not been successfully stored - https://phabricator.wikimedia.org/T434741#12237215 (10Laurabarluzzi) a:03Laurabarluzzi [14:01:10] FIRING: WidespreadPuppetFailure: Puppet has failed on over 5% of hosts - https://frmon.wikimedia.org/d/dwcgqww/puppet - https://alerts.wikimedia.org/?q=alertname%3DWidespreadPuppetFailure [14:02:11] RESOLVED: NodeDown: Node frpm1002 is down. - https://frmon.wikimedia.org/d/000000377/host-overview?orgId=1&var-host=frpm1002 - https://alerts.wikimedia.org/?q=alertname%3DNodeDown [14:06:10] RESOLVED: WidespreadPuppetFailure: Puppet has failed on over 5% of hosts - https://frmon.wikimedia.org/d/dwcgqww/puppet - https://alerts.wikimedia.org/?q=alertname%3DWidespreadPuppetFailure [14:22:33] FIRING: DiskSpace: Disk space CRITICAL for (instance fran2001.frack.codfw.wmnet:9100):/ - https://alerts.wikimedia.org/?q=alertname%3DDiskSpace [14:23:11] FIRING: NodeDown: Node fran2001 is down. - https://frmon.wikimedia.org/d/000000377/host-overview?orgId=1&var-host=fran2001 - https://alerts.wikimedia.org/?q=alertname%3DNodeDown [14:28:02] 06Fundraising-Backlog, 07fr-combowiki: Recurring convert in Combowiki - pre payment suggestion - https://phabricator.wikimedia.org/T435431#12237386 (10SBurnett-WMF) p:05Triage→03Medium [14:28:11] RESOLVED: NodeDown: Node fran2001 is down. - https://frmon.wikimedia.org/d/000000377/host-overview?orgId=1&var-host=fran2001 - https://alerts.wikimedia.org/?q=alertname%3DNodeDown [14:28:16] FIRING: ContextSwitchingSpike: Host context switching high (instance frmx1002.frack.eqiad.wmnet:9100) - https://alerts.wikimedia.org/?q=alertname%3DContextSwitchingSpike [14:29:15] 03Fundraising Sprint: Ottoman-o-war, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 07fr-current-sprint: Remove un-needed separate endowment/foundation calculated fields from Civi & Acoustic - https://phabricator.wikimedia.org/T418885#12237396 (10Lars) [14:31:31] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 03Civi RoadMap FY 26-27: Make phoneconsents visible on contact - https://phabricator.wikimedia.org/T435277#12237412 (10SBurnett-WMF) [14:32:33] RESOLVED: DiskSpace: Disk space CRITICAL for (instance fran2001.frack.codfw.wmnet:9100):/ - https://alerts.wikimedia.org/?q=alertname%3DDiskSpace [14:33:16] RESOLVED: ContextSwitchingSpike: Host context switching high (instance frmx1002.frack.eqiad.wmnet:9100) - https://alerts.wikimedia.org/?q=alertname%3DContextSwitchingSpike [14:34:50] 06Fundraising-Backlog, 06Fundraising-Tech-Roadmap, 10Wikimedia-Fundraising-CiviCRM, 06FR-donorrelations, 10FR-MGFE: Add global Do not contact button to contact summary - https://phabricator.wikimedia.org/T404989#12237448 (10SBurnett-WMF) @Lars - there is enough clarity around these issues that I would li... [14:36:40] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-payments-general: GoFundMe integration - https://phabricator.wikimedia.org/T432890#12237454 (10MDemosWMF) @MSuijkerbuijk_WMF We could still send a thank you letter from us as well, but since these imports will be done weekly they wouldn't be gettin... [14:38:22] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: venmo recurring failing with Payment method has not been successfully stored - https://phabricator.wikimedia.org/T434741#12237465 (10Laurabarluzzi) I added a SearchKit search that confirms the next scheduled recurring charge dates for these affected payme... [14:40:37] 06Fundraising-Backlog, 07fr-payments-ACH, 07payments-orchestration: Check that Gravy's Trustly failure flow fixes are working as expected - https://phabricator.wikimedia.org/T435378#12237480 (10SBurnett-WMF) @Eileenmcnaughton - could you please check on this? I am calendaring a recheck for 08/24 and moving i... [14:43:45] 03Fundraising Sprint: Ottoman-o-war, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 07fr-current-sprint, and 2 others: Send Leadgen emails to Civi then Acoustic - https://phabricator.wikimedia.org/T434150#12237483 (10CaCogdill-WMF) Amazing!! Thanks so much, Lars and team. FYI @spatton and @SKivleh... [14:58:39] FIRING: HighPaymentsMedianRiskScore: Median payments risk_score is running high [150.0] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentsMedianRiskScore [15:01:17] 06Fundraising-Backlog, 06Fundraising-Tech-Roadmap, 10Wikimedia-Fundraising-CiviCRM, 06FR-donorrelations, 10FR-MGFE: Add global Do not contact button to contact summary - https://phabricator.wikimedia.org/T404989#12237584 (10Lars) @SBurnett-WMF I don't think I'll have time to get to this in the next two s... [15:08:39] RESOLVED: HighPaymentsMedianRiskScore: Median payments risk_score is running high [35.4] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentsMedianRiskScore [15:22:56] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: venmo recurring failing with Payment method has not been successfully stored - https://phabricator.wikimedia.org/T434741#12237667 (10Laurabarluzzi) Since we have to monitor these errors with known affected IDs vs new ones, and we do have a yearly recurrin... [15:28:33] FIRING: DiskSpace: Disk space WARNING for (instance fran2001.frack.codfw.wmnet:9100):/ - https://alerts.wikimedia.org/?q=alertname%3DDiskSpace [15:43:25] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 06FR-donorrelations: Dedupe interface missing the last donation date - https://phabricator.wikimedia.org/T434612#12237851 (10Lars) This has been fixed. [15:44:26] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team: CI build slow and timing out sometimes - https://phabricator.wikimedia.org/T434024#12237867 (10Lars) @BLiviero-WMF or @hashar Who would be able to... [15:49:21] 03Fundraising Sprint: Ottoman-o-war, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-MGFE, and 2 others: Add MGFE requested fields from audience framework refresh - https://phabricator.wikimedia.org/T430012#12237902 (10Lars) @RLewis @DBautista-WMF These fields are now available in Acoustic, wi... [15:53:38] 03Fundraising Sprint: Ottoman-o-war, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-MGFE, and 2 others: Add daf_contact_id to Acoustic export - https://phabricator.wikimedia.org/T432185#12237930 (10Lars) @RLewis @DBautista-WMF Now available in Acoustic: If the contact has an ownership relatio... [15:55:37] (03PS1) 10Panagiotis Penloglou: First test commit by Panos [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1327578 [15:57:48] (03PS1) 10Damilare Adedoyin: Add unit test to confirm the new combo wiki data integrator has the same behaviour as the existing adapters. [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1327579 (https://phabricator.wikimedia.org/T434829) [15:58:14] (03PS2) 10Damilare Adedoyin: Add unit test to confirm the new combo wiki data integrator has the same behaviour as the existing adapters. [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1327579 (https://phabricator.wikimedia.org/T434829) [16:00:11] (03CR) 10CI reject: [V:04-1] Add unit test to confirm the new combo wiki data integrator has the same behaviour as the existing adapters. [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1327579 (https://phabricator.wikimedia.org/T434829) (owner: 10Damilare Adedoyin) [16:00:49] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team: CI build slow and timing out sometimes - https://phabricator.wikimedia.org/T434024#12237995 (10bd808) >>! In T434024#12214917, @BLiviero-WMF wrote:... [16:09:52] (03CR) 10Wfan: [C:03+2] Added employer match helptext underneath employer field [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1327230 (https://phabricator.wikimedia.org/T435132) (owner: 10Dmiranda) [16:10:02] (03PS3) 10Wfan: Add venmo to combo wiki [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1327174 (https://phabricator.wikimedia.org/T432231) [16:10:12] (03PS9) 10Wfan: Add post recurring convert popup modal [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1326359 (https://phabricator.wikimedia.org/T433143) [16:15:07] (03Merged) 10jenkins-bot: Added employer match helptext underneath employer field [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1327230 (https://phabricator.wikimedia.org/T435132) (owner: 10Dmiranda) [16:19:33] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-MGFE: Link and open tracking for CiviMail show as disabled when creating a new mailing, but they are not - https://phabricator.wikimedia.org/T435386#12238132 (10Lars) Not an issue for us any more because the defau... [16:21:39] (03PS3) 10Damilare Adedoyin: Add unit test to confirm the new combo wiki data integrator has the same behaviour as the existing adapters. [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1327579 (https://phabricator.wikimedia.org/T434829) [16:22:01] 03Fundraising Sprint: Ottoman-o-war, 06Fundraising-Backlog, 07fr-combowiki, 10FR-Tech onboarding task, 13Patch-For-Review: Combowiki: employer field explain text - https://phabricator.wikimedia.org/T435132#12238139 (10AnnWF) [16:23:08] 03Fundraising Sprint: Ottoman-o-war, 06Fundraising-Backlog, 07fr-combowiki: Recurring convert in Combowiki - pre payment suggestion - https://phabricator.wikimedia.org/T435431#12238144 (10AnnWF) [16:23:30] (03CR) 10CI reject: [V:04-1] Add unit test to confirm the new combo wiki data integrator has the same behaviour as the existing adapters. [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1327579 (https://phabricator.wikimedia.org/T434829) (owner: 10Damilare Adedoyin) [16:29:30] (03PS4) 10Damilare Adedoyin: Add unit test to confirm the new combo wiki data integrator has the same behaviour as the existing adapters. [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1327579 (https://phabricator.wikimedia.org/T434829) [16:35:33] FIRING: DiskSpace: Disk space CRITICAL for (instance fran2001.frack.codfw.wmnet:9100):/ - https://alerts.wikimedia.org/?q=alertname%3DDiskSpace [16:42:18] 03Fundraising Sprint: Ottoman-o-war, 06Fundraising-Backlog, 07fr-combowiki, 13Patch-For-Review: Important: prevent duplicate contribution tracking message in ComboWiki - https://phabricator.wikimedia.org/T434829#12238213 (10Damilare) [16:45:33] RESOLVED: DiskSpace: Disk space CRITICAL for (instance fran2001.frack.codfw.wmnet:9100):/ - https://alerts.wikimedia.org/?q=alertname%3DDiskSpace [16:47:58] 06Fundraising-Backlog, 10FR-WMF-Audit: Deprecation of PTP and Upgrade to SDP - Adyen - https://phabricator.wikimedia.org/T435114#12238263 (10AKanji-WMF) Should we prioritize for Sprint P, given the Sept 25 deadline? [16:54:54] (03CR) 10Damilare Adedoyin: "Thanks wfan for pushing this patch, I was wondering if there's a way to combine the PayPal/Venmo components as they're quite similar." [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1327174 (https://phabricator.wikimedia.org/T432231) (owner: 10Wfan) [16:56:34] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 06FR-donorrelations: Dedupe interface missing the last donation date - https://phabricator.wikimedia.org/T434612#12238316 (10SHust) Awesome, ty! [16:59:33] 06Fundraising-Backlog, 06Fundraising-Tech-Roadmap, 10Wikimedia-Fundraising-CiviCRM, 06FR-donorrelations, 10FR-MGFE: Add global Do not contact button to contact summary - https://phabricator.wikimedia.org/T404989#12238340 (10AKanji-WMF) p:05High→03Medium [17:04:49] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team: CI build slow and timing out sometimes - https://phabricator.wikimedia.org/T434024#12238362 (10Andrew) It looks to me like quite a lot of our cloud... [17:08:33] RESOLVED: DiskSpace: Disk space WARNING for (instance fran2001.frack.codfw.wmnet:9100):/ - https://alerts.wikimedia.org/?q=alertname%3DDiskSpace [17:26:19] (03CR) 10Damilare Adedoyin: "Thanks wfan, I added some comments on the components and the code removed in the composable. I think we can simplify the logic on the Paym" [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1326359 (https://phabricator.wikimedia.org/T433143) (owner: 10Wfan) [17:49:43] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team: CI build slow and timing out sometimes - https://phabricator.wikimedia.org/T434024#12238655 (10BLiviero-WMF) Added phab subtask for DC Ops to look... [17:56:46] (03PS3) 10Damilare Adedoyin: Backfill OS / Browser / version on payment_attempt [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1327240 (https://phabricator.wikimedia.org/T435399) (owner: 10Ejegg) [17:58:40] (03CR) 10Dmiranda: [C:03+2] "Thanks @dadedoyin@wikimedia.org! LGTM" [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1327240 (https://phabricator.wikimedia.org/T435399) (owner: 10Ejegg) [18:02:56] (03CR) 10Dmiranda: [C:03+2] "Thanks @dadedoyin@wikimedia.org and great test coverage! Approved" [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1327579 (https://phabricator.wikimedia.org/T434829) (owner: 10Damilare Adedoyin) [18:10:45] (03Merged) 10jenkins-bot: Add unit test to confirm the new combo wiki data integrator has the same behaviour as the existing adapters. [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1327579 (https://phabricator.wikimedia.org/T434829) (owner: 10Damilare Adedoyin) [18:23:23] (03Merged) 10jenkins-bot: Backfill OS / Browser / version on payment_attempt [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1327240 (https://phabricator.wikimedia.org/T435399) (owner: 10Ejegg) [18:23:50] 03Fundraising Sprint: Ottoman-o-war, 06Fundraising-Backlog, 10FR-payments-general, 07fr-current-sprint, 10FR-Tech onboarding task: Handle gravy moto webhooks - https://phabricator.wikimedia.org/T432672#12238790 (10dmiranda) 05Open→03In progress a:03dmiranda [18:27:02] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Add a custom field to indicate a donation has been matched by an employer - https://phabricator.wikimedia.org/T435539 (10Lars) 03NEW [19:14:52] (03PS4) 10Wfan: Add venmo to combo wiki [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1327174 (https://phabricator.wikimedia.org/T432231) [19:15:29] (03CR) 10Wfan: "Thanks Dami~ updated" [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1327174 (https://phabricator.wikimedia.org/T432231) (owner: 10Wfan) [19:21:21] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-MGFE: Link and open tracking for CiviMail show as disabled when creating a new mailing, but they are not - https://phabricator.wikimedia.org/T435386#12238975 (10Lars) Turns out there were a bunch of other problems... [19:25:09] 06Fundraising-Backlog: Set up and test Gr4vy's 3DS - https://phabricator.wikimedia.org/T435380#12238985 (10Cstone) We need to coordinate with Rakhi when turning is on to test it carefully and make sure everything behaves as expected [19:48:44] 06Fundraising-Backlog, 10FR-payments-general: Set up and test Gr4vy's 3DS - https://phabricator.wikimedia.org/T435380#12239045 (10SBurnett-WMF) It's not urgent but we need a LOT of testing. [20:59:19] 06Fundraising-Backlog, 07Fundraising-ComboWiki-Dependency, 10donate.wikimedia.org, 07Accessibility, 07fr-current-sprint: Accessibility issues - Donate wiki - https://phabricator.wikimedia.org/T410586#12239334 (10Pcoombe) 05Open→03Resolved I solved this with a javascript change, so the logo elemen... [21:18:43] 06Fundraising-Backlog: Countries falling through gateway chooser ending up with paypal_ec - https://phabricator.wikimedia.org/T435554 (10Cstone) 03NEW [21:19:15] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: Countries falling through gateway chooser ending up with paypal_ec - https://phabricator.wikimedia.org/T435554#12239436 (10Cstone) [21:29:09] (03PS1) 10Lars SG: also include paypal via paypal in legacy_paypal [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1327639 [21:30:10] 03Fundraising Sprint: Ottoman-o-war, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 07fr-current-sprint, and 2 others: Send Leadgen emails to Civi then Acoustic - https://phabricator.wikimedia.org/T434150#12239469 (10spatton) Awesome! Can I tag @ehughes or @Pcoombe to help with this form implement... [21:30:51] (03CR) 10CI reject: [V:04-1] also include paypal via paypal in legacy_paypal [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1327639 (owner: 10Lars SG) [21:37:15] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Maybe we can manage legacy Paypal recurrings or provide links? - https://phabricator.wikimedia.org/T435556 (10Lars) 03NEW [21:41:00] (03PS2) 10Lars SG: also include paypal via paypal in legacy_paypal [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1327639 [21:42:31] (03PS5) 10Wfan: Add venmo to combo wiki [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1327174 (https://phabricator.wikimedia.org/T432231) [21:42:55] (03CR) 10CI reject: [V:04-1] also include paypal via paypal in legacy_paypal [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1327639 (owner: 10Lars SG) [21:45:33] (03PS3) 10Lars SG: also include paypal via paypal in legacy_paypal [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1327639 [21:54:26] (03CR) 10Wfan: [C:03+2] also include paypal via paypal in legacy_paypal [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1327639 (owner: 10Lars SG) [21:57:50] (03Merged) 10jenkins-bot: also include paypal via paypal in legacy_paypal [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1327639 (owner: 10Lars SG) [23:24:15] 03Fundraising Sprint: Ottoman-o-war, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 07fr-current-sprint: Add last otg amount change fields to Acoustic export - https://phabricator.wikimedia.org/T431854#12239711 (10Lars) Don't need a backfill patch, as this is silverpop export only, and will be tak... [23:29:11] FIRING: NodeDown: Node frpm1002 is down. - https://frmon.wikimedia.org/d/000000377/host-overview?orgId=1&var-host=frpm1002 - https://alerts.wikimedia.org/?q=alertname%3DNodeDown [23:34:11] RESOLVED: NodeDown: Node frpm1002 is down. - https://frmon.wikimedia.org/d/000000377/host-overview?orgId=1&var-host=frpm1002 - https://alerts.wikimedia.org/?q=alertname%3DNodeDown [23:45:39] FIRING: HighPaymentsMedianRiskScore: Median payments risk_score is running high [67.5] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentsMedianRiskScore