[00:01:39] RESOLVED: HighPaymentMethodFailures: Average cc payment method failures are high [6.2] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentMethodFailures [00:01:39] RESOLVED: HighPaymentGatewayFailures: Average gravy payment gateway failures are high [6.2] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentGatewayFailures [00:01:39] RESOLVED: HighPaymentSchemeFailures: Average payment method scheme failures are high [6.2] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentSchemeFailures [00:24:36] FIRING: [2x] KafkaBrokerDown: Kafka Broker kafka-jumbo1018 is down: [0] - https://alerts.wikimedia.org/?q=alertname%3DKafkaBrokerDown [00:24:36] FIRING: [2x] KafkaJumboNoData: Kafka Broker hasn't received data from kafka-jumbo1018 in 60 minutes - https://alerts.wikimedia.org/?q=alertname%3DKafkaJumboNoData [01:12:39] FIRING: HighPaymentsMedianRiskScore: Median payments risk_score is running high [91.2] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentsMedianRiskScore [01:17:39] RESOLVED: HighPaymentsMedianRiskScore: Median payments risk_score is running high [41.3] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentsMedianRiskScore [01:21:39] RESOLVED: HighPaymentFraudMessages: More than 10 payment fraud messages in the past hour [10.3] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentFraudMessages [01:35:39] FIRING: HighPaymentFraudMessages: More than 10 payment fraud messages in the past hour [10.8] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentFraudMessages [02:55:40] (03CR) 10Eileen: [C:03+2] Merge branch 'master' of https://gerrit.wikimedia.org/r/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1326052 (owner: 10Eileen) [02:57:42] !log civicrm upgraded from 105395c3 to 52efa44f [02:57:44] Logged the message at https://wikitech.wikimedia.org/wiki/Fundraising/SAL [02:58:59] (03PS1) 10Eileen: Merge branch 'master' of https://gerrit.wikimedia.org/r/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1326086 [02:59:15] (03CR) 10Eileen: [C:03+2] Merge branch 'master' of https://gerrit.wikimedia.org/r/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1326086 (owner: 10Eileen) [02:59:33] (03PS5) 10Eileen: Use the GatewayAccount value, not hard-coding for the vendor IDs [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1324524 (https://phabricator.wikimedia.org/T434041) [03:00:08] (03PS5) 10Eileen: Use the gatewayAccount values, not hard-coding, for the balancing accounts [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1324546 (https://phabricator.wikimedia.org/T434041) [03:00:17] (03Merged) 10jenkins-bot: Merge branch 'master' of https://gerrit.wikimedia.org/r/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1326086 (owner: 10Eileen) [03:00:46] (03PS5) 10Eileen: Add new entity reference custom field linking batches to AccountGateway [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1324595 (https://phabricator.wikimedia.org/T434041) [03:06:00] !log civicrm upgraded from 52efa44f to ced9a157 [03:06:01] Logged the message at https://wikitech.wikimedia.org/wiki/Fundraising/SAL [03:20:39] RESOLVED: HighPaymentFraudMessages: More than 10 payment fraud messages in the past hour [10.2] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentFraudMessages [04:13:30] (03CR) 10Eileen: Use the GatewayAccount value, not hard-coding for the vendor IDs (031 comment) [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1324524 (https://phabricator.wikimedia.org/T434041) (owner: 10Eileen) [04:24:36] FIRING: [2x] KafkaBrokerDown: Kafka Broker kafka-jumbo1018 is down: [0] - https://alerts.wikimedia.org/?q=alertname%3DKafkaBrokerDown [04:24:36] FIRING: [2x] KafkaJumboNoData: Kafka Broker hasn't received data from kafka-jumbo1018 in 60 minutes - https://alerts.wikimedia.org/?q=alertname%3DKafkaJumboNoData [06:28:28] (03PS1) 10Eileen: PHP8.4 - fputcsv should pass escape to avoid deprecation [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1326106 [06:28:45] (03PS1) 10Eileen: Update extensions extended reports & relationship block to latest [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1326107 [07:23:45] 14Fundraising Sprint: Kondo-approved bare room: Sprint L Prospects - https://phabricator.wikimedia.org/T430364#12219788 (10Aklapper) @SBurnett-WMF / @greg: The project tag on this open task got archived; please add an active project tag so this task can be found on an active workboard, or resolve this task - tha... [08:12:54] (03PS1) 10Eileen: Stripe Audit, optionally retrieve contact details and bubble up [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1326211 (https://phabricator.wikimedia.org/T432813) [08:24:36] FIRING: [2x] KafkaBrokerDown: Kafka Broker kafka-jumbo1018 is down: [0] - https://alerts.wikimedia.org/?q=alertname%3DKafkaBrokerDown [08:24:36] FIRING: [2x] KafkaJumboNoData: Kafka Broker hasn't received data from kafka-jumbo1018 in 60 minutes - https://alerts.wikimedia.org/?q=alertname%3DKafkaJumboNoData [08:43:20] (03PS1) 10Eileen: Convert GiveLively to the organization [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1326217 (https://phabricator.wikimedia.org/T432813) [09:04:54] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: INVALID_MESSAGE No payment type found for message [stripe_audit] - https://phabricator.wikimedia.org/T434871#12220320 (10Laurabarluzzi) @Eileenmcnaughton do you plan to work on this? If so i think merging is good, mostly I don't want to have this task rem... [09:24:52] (03CR) 10Ladsgroup: "recheck" [extensions/CentralNotice] (wmf_deploy) - 10https://gerrit.wikimedia.org/r/1325946 (https://phabricator.wikimedia.org/T424357) (owner: 10Ladsgroup) [10:34:39] FIRING: HighPaymentsMedianRiskScore: Median payments risk_score is running high [93.9] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentsMedianRiskScore [10:50:35] (03PS2) 10Eileen: Convert GiveLively to the organization [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1326217 (https://phabricator.wikimedia.org/T432813) [10:52:04] (03PS1) 10Eileen: Uset stripe as the payment method for GiveLively [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1326245 (https://phabricator.wikimedia.org/T432813) [10:53:48] (03PS2) 10Eileen: Use stripe as the payment method for GiveLively [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1326245 (https://phabricator.wikimedia.org/T432813) [10:54:49] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 13Patch-For-Review: INVALID_MESSAGE No payment type found for message [stripe_audit] - https://phabricator.wikimedia.org/T434871#12220799 (10Eileenmcnaughton) @Laurabarluzzi yes - this should work for it https://gerrit.wikimedia.org/r/c/wikimedia/fundra... [10:59:39] RESOLVED: HighPaymentsMedianRiskScore: Median payments risk_score is running high [91.5] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentsMedianRiskScore [11:57:39] FIRING: HighPaymentsMedianRiskScore: Median payments risk_score is running high [52.0] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentsMedianRiskScore [12:02:39] RESOLVED: HighPaymentsMedianRiskScore: Median payments risk_score is running high [52.0] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentsMedianRiskScore [12:24:36] FIRING: [2x] KafkaBrokerDown: Kafka Broker kafka-jumbo1018 is down: [0] - https://alerts.wikimedia.org/?q=alertname%3DKafkaBrokerDown [12:24:36] FIRING: [2x] KafkaJumboNoData: Kafka Broker hasn't received data from kafka-jumbo1018 in 60 minutes - https://alerts.wikimedia.org/?q=alertname%3DKafkaJumboNoData [12:38:39] FIRING: HighPaymentFraudMessages: More than 10 payment fraud messages in the past hour [10.1] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentFraudMessages [12:46:39] FIRING: HighPaymentsMedianRiskScore: Median payments risk_score is running high [56.0] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentsMedianRiskScore [12:46:59] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: Invalid PaymentMethod passed in for Gravy Dlocal Pix in CiviCRM - https://phabricator.wikimedia.org/T435081 (10Damilare) 03NEW [12:48:39] RESOLVED: HighPaymentFraudMessages: More than 10 payment fraud messages in the past hour [10.7] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentFraudMessages [12:50:55] 10fundraising-tech-ops, 06Infrastructure-Foundations, 10netops, 06SRE: Upgrade JunOS on pfw1-eqiad and pfw1-codfw - https://phabricator.wikimedia.org/T434865#12221433 (10Jgreen) [12:53:39] FIRING: HighPaymentFraudMessages: More than 10 payment fraud messages in the past hour [10.8] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentFraudMessages [13:13:33] (03PS1) 10Damilare Adedoyin: Add Pix to SmashPig payment processor with test to fix current failmail [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1326286 (https://phabricator.wikimedia.org/T435081) [13:25:17] (03CR) 10Laurabarluzzi: [C:03+2] Add Pix to SmashPig payment processor with test to fix current failmail [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1326286 (https://phabricator.wikimedia.org/T435081) (owner: 10Damilare Adedoyin) [13:26:54] (03CR) 10Laurabarluzzi: [C:03+2] Provide gateway_txn_id for Trustly reversal_reversed [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1326049 (https://phabricator.wikimedia.org/T434916) (owner: 10Eileen) [13:29:13] (03Merged) 10jenkins-bot: Provide gateway_txn_id for Trustly reversal_reversed [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1326049 (https://phabricator.wikimedia.org/T434916) (owner: 10Eileen) [13:31:04] (03PS8) 10Damilare Adedoyin: Show loading state during payment submission [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1325531 (https://phabricator.wikimedia.org/T434110) [13:40:50] thanks for the cr laurabar [13:42:53] (03CR) 10Laurabarluzzi: PHP8.4 - fputcsv should pass escape to avoid deprecation (031 comment) [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1326106 (owner: 10Eileen) [13:43:42] damilare: thanks for helping with chaos 🙏 [13:44:28] np! [13:44:48] 03Fundraising Sprint: Ottoman-o-war, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-WMF-Audit, 13Patch-For-Review: MG Stripe account - Donation coming through stripe GiveLively not in civi or not clear - https://phabricator.wikimedia.org/T432813#12221802 (10Laurabarluzzi) a:03Eileenmcnaugh... [13:45:35] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 13Patch-For-Review: INVALID_MESSAGE No payment type found for message [stripe_audit] - https://phabricator.wikimedia.org/T434871#12221811 (10Laurabarluzzi) 05Open→03In progress a:03Eileenmcnaughton [13:49:22] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 13Patch-For-Review: [trustly recon Auditor] Required field/s missing from message: gateway_txn_id - https://phabricator.wikimedia.org/T434916#12221828 (10Laurabarluzzi) 05Open→03In progress a:03Eileenmcnaughton [13:51:03] (03Merged) 10jenkins-bot: Add Pix to SmashPig payment processor with test to fix current failmail [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1326286 (https://phabricator.wikimedia.org/T435081) (owner: 10Damilare Adedoyin) [13:53:42] ok I'd deploy this to fix the failmail [13:56:27] (03PS1) 10Damilare Adedoyin: Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1326299 [13:56:39] RESOLVED: HighPaymentsMedianRiskScore: Median payments risk_score is running high [33.7] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentsMedianRiskScore [14:00:48] (03CR) 10Damilare Adedoyin: [C:03+2] Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1326299 (owner: 10Damilare Adedoyin) [14:01:56] (03Merged) 10jenkins-bot: Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1326299 (owner: 10Damilare Adedoyin) [14:08:26] !log civicrm upgraded from ced9a157 to 94367c2d [14:08:28] Logged the message at https://wikitech.wikimedia.org/wiki/Fundraising/SAL [14:14:39] FIRING: HighPaymentGatewayFailures: Average gravy payment gateway failures are high [10.8] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentGatewayFailures [14:14:39] FIRING: HighPaymentMethodFailures: Average cc payment method failures are high [10.8] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentMethodFailures [14:14:39] FIRING: HighPaymentSchemeFailures: Average payment method scheme failures are high [10.8] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentSchemeFailures [14:15:02] 03Fundraising Sprint: Ottoman-o-war, 06Fundraising-Backlog, 07fr-combowiki: combowiki: show the privacy policy - https://phabricator.wikimedia.org/T434081#12221991 (10SBurnett-WMF) https://docs.google.com/document/d/1f8ir5ug1PabtzBYlt0Yxjd5BqtC3M4O3ZoMXtYD8X6g/edit?tab=t.0 - Anil received some clarity from L... [14:24:39] RESOLVED: HighPaymentGatewayFailures: Average gravy payment gateway failures are high [5.9] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentGatewayFailures [14:24:39] FIRING: HighPaymentsMedianRiskScore: Median payments risk_score is running high [45.7] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentsMedianRiskScore [14:24:39] RESOLVED: HighPaymentMethodFailures: Average cc payment method failures are high [5.9] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentMethodFailures [14:24:43] RESOLVED: HighPaymentSchemeFailures: Average payment method scheme failures are high [5.9] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentSchemeFailures [14:26:39] FIRING: HighPaymentSchemeFailures: Average payment method scheme failures are high [12.2] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentSchemeFailures [14:26:39] FIRING: HighPaymentMethodFailures: Average cc payment method failures are high [12.2] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentMethodFailures [14:26:39] FIRING: HighPaymentGatewayFailures: Average gravy payment gateway failures are high [12.2] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentGatewayFailures [14:40:48] 10fundraising-tech-ops: Upgrade to HAProxy v3.2 on role::payments_balancer - https://phabricator.wikimedia.org/T435102 (10Jgreen) 03NEW [14:42:40] 03Fundraising Sprint: Ottoman-o-war, 06Fundraising-Backlog, 10fundraising-tech-ops, 03Civi RoadMap FY 26-27: FR-Tech FY2627Q1 maintenance window - https://phabricator.wikimedia.org/T419557#12222246 (10Jgreen) [14:49:00] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-email-preferences: Clean up snooze cancellation process - https://phabricator.wikimedia.org/T434708#12222278 (10Lars) @AnnWF This one is for the opposite case, where the donor un-snoozes, not where they snooze again. [14:59:21] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Add additional questions to donor portal trouble logging in email - https://phabricator.wikimedia.org/T435107 (10Lars) 03NEW [15:00:11] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-email-preferences, 10FR-Tech onboarding task: Add additional questions to donor portal trouble logging in email - https://phabricator.wikimedia.org/T435107#12222381 (10Lars) @dmiranda This one is similar to the last two, so probably another one y... [15:03:49] 03Fundraising Sprint: Ottoman-o-war, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 03Civi RoadMap FY 26-27, and 2 others: Using Acoustic API to opt users into SMS program via paymentswiki variant form - https://phabricator.wikimedia.org/T423967#12222396 (10Lars) @SKivlehan-WMF Do we need a way to... [15:06:39] RESOLVED: HighPaymentMethodFailures: Average cc payment method failures are high [6.1] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentMethodFailures [15:06:39] RESOLVED: HighPaymentSchemeFailures: Average payment method scheme failures are high [6.1] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentSchemeFailures [15:06:39] RESOLVED: HighPaymentGatewayFailures: Average gravy payment gateway failures are high [6.1] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentGatewayFailures [15:27:18] (03CR) 10Lars SG: [C:03+2] Remove space messing up url [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1326048 (owner: 10Eileen) [15:27:32] (03CR) 10Lars SG: [C:03+2] Add Vendor ID for StripeMg [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1326050 (https://phabricator.wikimedia.org/T432813) (owner: 10Eileen) [15:28:14] (03CR) 10Lars SG: [C:03+2] Also put file path on a separate line [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1324513 (owner: 10Eileen) [15:34:01] (03PS3) 10Ejegg: Count ML filter score towards total risk_score [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1324830 [15:36:03] (03CR) 10CI reject: [V:04-1] Count ML filter score towards total risk_score [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1324830 (owner: 10Ejegg) [15:37:16] 06Fundraising-Backlog: Network Token Enablement Information Request - https://phabricator.wikimedia.org/T435111 (10RKumar_WMF) 03NEW [15:38:43] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: [Aug 14th] Fail Mail (civi1002) run-job: Generate finance batch failed with code 1 - https://phabricator.wikimedia.org/T434914#12222645 (10Laurabarluzzi) 05Open→03In progress p:05Triage→03Medium a:03Eileenmcnaughton [15:38:55] 06Fundraising-Backlog: Deprecation of PTP and Upgrade to SDP - Adyen - https://phabricator.wikimedia.org/T435114 (10RKumar_WMF) 03NEW [15:39:05] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: [Aug 14th] Fail Mail (civi1002) run-job: Generate finance batch failed with code 1 - https://phabricator.wikimedia.org/T434914#12222682 (10Laurabarluzzi) Should be fixed with these two patches: - https://gerrit.wikimedia.org/r/c/wikimedia/fundraising/crm/... [15:40:10] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 13Patch-For-Review: [Aug 14th] Fail Mail (civi1002) run-job: Generate finance batch failed with code 1 - https://phabricator.wikimedia.org/T434914#12222690 (10Laurabarluzzi) [15:46:39] FIRING: SystemdService: Systemd service coworker.service stopped on civi1002.frack.eqiad.wmnet:9100 - https://alerts.wikimedia.org/?q=alertname%3DSystemdService [15:50:10] (03Merged) 10jenkins-bot: Remove space messing up url [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1326048 (owner: 10Eileen) [15:51:34] (03CR) 10Ejegg: Show loading state during payment submission (032 comments) [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1325531 (https://phabricator.wikimedia.org/T434110) (owner: 10Damilare Adedoyin) [15:54:12] (03Merged) 10jenkins-bot: Add Vendor ID for StripeMg [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1326050 (https://phabricator.wikimedia.org/T432813) (owner: 10Eileen) [15:54:15] (03Merged) 10jenkins-bot: Also put file path on a separate line [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1324513 (owner: 10Eileen) [15:54:39] RESOLVED: HighPaymentsMedianRiskScore: Median payments risk_score is running high [70.0] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentsMedianRiskScore [16:04:11] FIRING: NodeDown: Node frqueue1005 is down. - https://frmon.wikimedia.org/d/000000377/host-overview?orgId=1&var-host=frqueue1005 - https://alerts.wikimedia.org/?q=alertname%3DNodeDown [16:09:11] RESOLVED: NodeDown: Node frqueue1005 is down. - https://frmon.wikimedia.org/d/000000377/host-overview?orgId=1&var-host=frqueue1005 - https://alerts.wikimedia.org/?q=alertname%3DNodeDown [16:10:33] (03CR) 10Lars SG: [C:03+2] Update extensions extended reports & relationship block to latest [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1326107 (owner: 10Eileen) [16:11:39] RESOLVED: SystemdService: Systemd service coworker.service stopped on civi1002.frack.eqiad.wmnet:9100 - https://alerts.wikimedia.org/?q=alertname%3DSystemdService [16:24:36] FIRING: [2x] KafkaBrokerDown: Kafka Broker kafka-jumbo1018 is down: [0] - https://alerts.wikimedia.org/?q=alertname%3DKafkaBrokerDown [16:24:36] FIRING: [2x] KafkaJumboNoData: Kafka Broker hasn't received data from kafka-jumbo1018 in 60 minutes - https://alerts.wikimedia.org/?q=alertname%3DKafkaJumboNoData [16:27:43] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 06FR-donorrelations: Dedupe interface missing the last donation date - https://phabricator.wikimedia.org/T434612#12222991 (10Lars) a:03Lars @Shust or @AMouraVargas Do we prefer this to sit below all the other fields... [16:28:39] FIRING: HighPaymentsMedianRiskScore: Median payments risk_score is running high [43.8] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentsMedianRiskScore [16:34:47] (03Merged) 10jenkins-bot: Update extensions extended reports & relationship block to latest [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1326107 (owner: 10Eileen) [16:38:39] FIRING: SystemdService: Systemd service coworker.service stopped on civi1002.frack.eqiad.wmnet:9100 - https://alerts.wikimedia.org/?q=alertname%3DSystemdService [16:40:28] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 06FR-donorrelations: Dedupe interface missing the last donation date - https://phabricator.wikimedia.org/T434612#12223065 (10Lars) And also I assume we can lose the time here, but let me know if not. [16:43:35] (03CR) 10Lars SG: [C:03+2] Use the GatewayAccount value, not hard-coding for the vendor IDs [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1324524 (https://phabricator.wikimedia.org/T434041) (owner: 10Eileen) [16:43:54] (03CR) 10CI reject: [V:04-1] Use the GatewayAccount value, not hard-coding for the vendor IDs [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1324524 (https://phabricator.wikimedia.org/T434041) (owner: 10Eileen) [16:43:54] (03CR) 10CI reject: [V:04-1] Use the gatewayAccount values, not hard-coding, for the balancing accounts [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1324546 (https://phabricator.wikimedia.org/T434041) (owner: 10Eileen) [16:53:39] RESOLVED: HighPaymentsMedianRiskScore: Median payments risk_score is running high [42.3] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentsMedianRiskScore [16:53:39] FIRING: HighPaymentFraudMessages: More than 10 payment fraud messages in the past hour [119.3] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentFraudMessages [17:02:11] FIRING: NodeDown: Node civi1002 is down. - https://frmon.wikimedia.org/d/000000377/host-overview?orgId=1&var-host=civi1002 - https://alerts.wikimedia.org/?q=alertname%3DNodeDown [17:07:11] RESOLVED: [2x] NodeDown: Node civi1002 is down. - https://alerts.wikimedia.org/?q=alertname%3DNodeDown [17:14:09] RESOLVED: SystemdService: Systemd service coworker.service stopped on civi1002.frack.eqiad.wmnet:9100 - https://alerts.wikimedia.org/?q=alertname%3DSystemdService [17:27:40] (03PS1) 10Ejegg: Fix fraud txn email test script [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1326338 [17:27:40] (03PS1) 10Ejegg: Add link to Civi payment_attempt in fraud alert email [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1326339 [17:28:15] fr-tech we can now link to the full payment_attempt row in Civi from the fraud alert email. Anyone want to review ^^^ changes to get that out? [17:28:22] (03CR) 10CI reject: [V:04-1] Add link to Civi payment_attempt in fraud alert email [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1326339 (owner: 10Ejegg) [17:28:25] (03CR) 10CI reject: [V:04-1] Fix fraud txn email test script [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1326338 (owner: 10Ejegg) [17:28:31] ah lemme fix whatever that is [17:29:32] (03PS2) 10Ejegg: Fix fraud txn email test script [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1326338 [17:29:32] (03PS2) 10Ejegg: Add link to Civi payment_attempt in fraud alert email [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1326339 [17:41:39] FIRING: HighPaymentsMedianRiskScore: Median payments risk_score is running high [150.0] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentsMedianRiskScore [17:44:00] 03Fundraising Sprint: Ottoman-o-war, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 03Civi RoadMap FY 26-27, and 2 others: Using Acoustic API to opt users into SMS program via paymentswiki variant form - https://phabricator.wikimedia.org/T423967#12223434 (10SKivlehan-WMF) @Lars If we can yes, we'l... [17:52:40] 03Fundraising Sprint: Ottoman-o-war, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 03Civi RoadMap FY 26-27, and 2 others: Using Acoustic API to opt users into SMS program via paymentswiki variant form - https://phabricator.wikimedia.org/T423967#12223461 (10Lars) @SKivlehan-WMF Sure, what makes th... [17:53:39] RESOLVED: HighPaymentFraudMessages: More than 10 payment fraud messages in the past hour [12.0] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentFraudMessages [17:56:06] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 06FR-donorrelations: Dedupe interface missing the last donation date - https://phabricator.wikimedia.org/T434612#12223485 (10SHust) Hi, @Lars, where it was before would work, and the time is not needed. Ty! [18:01:39] RESOLVED: HighPaymentsMedianRiskScore: Median payments risk_score is running high [40.7] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentsMedianRiskScore [18:24:32] (03PS1) 10Lars SG: Restore last donation date to Deduper interface [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1326346 (https://phabricator.wikimedia.org/T434612) [18:24:39] FIRING: HighPaymentsMedianRiskScore: Median payments risk_score is running high [150.0] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentsMedianRiskScore [18:27:59] (03PS2) 10Lars SG: Restore last donation date to Deduper interface [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1326346 (https://phabricator.wikimedia.org/T434612) [18:33:11] FIRING: NodeDown: Node frdb1008 is down. - https://frmon.wikimedia.org/d/000000377/host-overview?orgId=1&var-host=frdb1008 - https://alerts.wikimedia.org/?q=alertname%3DNodeDown [18:38:11] RESOLVED: NodeDown: Node frdb1008 is down. - https://frmon.wikimedia.org/d/000000377/host-overview?orgId=1&var-host=frdb1008 - https://alerts.wikimedia.org/?q=alertname%3DNodeDown [18:46:00] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Omnigroupmember.load get stuck if csv download is borked - https://phabricator.wikimedia.org/T435128 (10Lars) 03NEW [18:46:05] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Omnigroupmember.load gets stuck if csv download is borked - https://phabricator.wikimedia.org/T435128#12223644 (10Lars) [18:49:01] (03PS1) 10Lars SG: Prevent Omnigroupmember.load from getting stuck if csv download is borked [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1326353 (https://phabricator.wikimedia.org/T435128) [18:50:28] 03Fundraising Sprint: Ottoman-o-war, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 03Civi RoadMap FY 26-27, and 2 others: Using Acoustic API to opt users into SMS program via paymentswiki variant form - https://phabricator.wikimedia.org/T423967#12223652 (10SKivlehan-WMF) @Lars I think some more d... [18:54:39] RESOLVED: HighPaymentsMedianRiskScore: Median payments risk_score is running high [150.0] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentsMedianRiskScore [19:01:21] looking at that recovery patch larssandergreen [19:04:39] (03PS9) 10Damilare Adedoyin: Show loading state during payment submission [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1325531 (https://phabricator.wikimedia.org/T434110) [19:06:09] (03PS2) 10Lars SG: Prevent Omnigroupmember.load from getting stuck if csv download is borked [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1326353 (https://phabricator.wikimedia.org/T435128) [19:06:24] (03CR) 10Ejegg: [C:03+2] "Looks good, matches OmniActivity failure handling." [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1326353 (https://phabricator.wikimedia.org/T435128) (owner: 10Lars SG) [19:07:56] (03PS10) 10Damilare Adedoyin: Show loading state during payment submission [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1325531 (https://phabricator.wikimedia.org/T434110) [19:08:29] 03Fundraising Sprint: Ottoman-o-war, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 03Civi RoadMap FY 26-27, and 2 others: Using Acoustic API to opt users into SMS program via paymentswiki variant form - https://phabricator.wikimedia.org/T423967#12223707 (10Lars) @SKivlehan-WMF Could we do just th... [19:10:51] 06Fundraising-Backlog, 07fr-combowiki, 10FR-Tech onboarding task: Combowiki: employer field explain text - https://phabricator.wikimedia.org/T435132 (10Cstone) 03NEW [19:11:31] (03CR) 10Damilare Adedoyin: "Thanks ejegg for the CR and suggestions, I've now updated the patch to add the fixes." [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1325531 (https://phabricator.wikimedia.org/T434110) (owner: 10Damilare Adedoyin) [19:18:07] (03CR) 10Damilare Adedoyin: [C:03+2] "Thanks, this additional link would be useful in logdiving. Thanks for the test also. LGTM" [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1326339 (owner: 10Ejegg) [19:18:51] (03CR) 10Damilare Adedoyin: [C:03+2] Fix fraud txn email test script [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1326338 (owner: 10Ejegg) [19:19:33] (03Merged) 10jenkins-bot: Fix fraud txn email test script [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1326338 (owner: 10Ejegg) [19:19:34] (03Merged) 10jenkins-bot: Add link to Civi payment_attempt in fraud alert email [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1326339 (owner: 10Ejegg) [19:19:43] (03CR) 10Wfan: [C:03+2] Config for lead-generation queue [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1324773 (https://phabricator.wikimedia.org/T434150) (owner: 10Ejegg) [19:20:22] (03Merged) 10jenkins-bot: Config for lead-generation queue [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1324773 (https://phabricator.wikimedia.org/T434150) (owner: 10Ejegg) [19:21:17] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: Failmail alert Validation error during recurring charge, in field: payment_submethod - https://phabricator.wikimedia.org/T435133 (10Laurabarluzzi) 03NEW [19:23:06] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: Failmail alert Validation error during recurring charge, in field: payment_submethod - https://phabricator.wikimedia.org/T435133#12223776 (10Laurabarluzzi) Asked in Slack if someone has any idea of what might have caused this in Adyen: https://wikimedia.... [19:25:43] (03CR) 10Wfan: [C:03+2] Show loading state during payment submission [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1325531 (https://phabricator.wikimedia.org/T434110) (owner: 10Damilare Adedoyin) [19:25:57] (03CR) 10Lars SG: Ensure low-confidence names do not overwrite existing high confidence names (031 comment) [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1324798 (https://phabricator.wikimedia.org/T434715) (owner: 10Lars SG) [19:26:04] (03Merged) 10jenkins-bot: Prevent Omnigroupmember.load from getting stuck if csv download is borked [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1326353 (https://phabricator.wikimedia.org/T435128) (owner: 10Lars SG) [19:27:07] (03PS1) 10Lars SG: Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1326358 [19:27:39] FIRING: HighPaymentFraudMessages: More than 10 payment fraud messages in the past hour [14.7] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentFraudMessages [19:27:40] (03Merged) 10jenkins-bot: Show loading state during payment submission [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1325531 (https://phabricator.wikimedia.org/T434110) (owner: 10Damilare Adedoyin) [19:28:13] (03PS1) 10Wfan: clean some unused vars [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1326359 [19:28:25] (03CR) 10Lars SG: [C:03+2] Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1326358 (owner: 10Lars SG) [19:29:30] (03Merged) 10jenkins-bot: Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1326358 (owner: 10Lars SG) [19:31:26] !log civicrm upgraded from 94367c2d to 1ce07d30 [19:31:27] Logged the message at https://wikitech.wikimedia.org/wiki/Fundraising/SAL [19:31:39] FIRING: HighPaymentsMedianRiskScore: Median payments risk_score is running high [48.0] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentsMedianRiskScore [19:33:39] FIRING: HighPaymentSchemeFailures: Average payment method scheme failures are high [15.4] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentSchemeFailures [19:33:39] FIRING: HighPaymentMethodFailures: Average cc payment method failures are high [15.4] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentMethodFailures [19:33:39] FIRING: HighPaymentGatewayFailures: Average gravy payment gateway failures are high [15.4] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentGatewayFailures [19:35:42] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Omnigroupmember.load gets stuck if csv download is borked - https://phabricator.wikimedia.org/T435128#12223824 (10Lars) a:03Lars [19:38:42] 06Fundraising-Backlog, 10fundraising-tech-ops, 06Fundraising-Tech-Roadmap: FR-Tech FY2627Q1 Analytics Updates - https://phabricator.wikimedia.org/T433888#12223844 (10AStein-WMF) [19:39:11] (03CR) 10Ejegg: [V:03+2 C:03+2] Add payment-attempts queue consumer [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/1324821 (owner: 10Ejegg) [19:39:51] (03PS6) 10Eileen: Use the GatewayAccount value, not hard-coding for the vendor IDs [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1324524 (https://phabricator.wikimedia.org/T434041) [19:39:51] (03PS6) 10Eileen: Use the gatewayAccount values, not hard-coding, for the balancing accounts [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1324546 (https://phabricator.wikimedia.org/T434041) [19:39:51] (03PS5) 10Eileen: [Ref] Update existing Contribution:pre hook to use listener [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1324575 (https://phabricator.wikimedia.org/T434041) [19:39:52] (03PS6) 10Eileen: Add new entity reference custom field linking batches to AccountGateway [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1324595 (https://phabricator.wikimedia.org/T434041) [19:39:53] (03PS5) 10Eileen: Sync new entity reference custom field with the pre-existing one [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1324596 (https://phabricator.wikimedia.org/T434041) [19:39:55] (03PS5) 10Eileen: Populate new gateway custom field [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1324598 (https://phabricator.wikimedia.org/T434041) [19:39:59] (03PS3) 10Eileen: Form for adding finance batches [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1321221 (https://phabricator.wikimedia.org/T434041) [19:41:16] 03Fundraising Sprint: Ottoman-o-war, 06Fundraising-Backlog: Create dedicated app_install_id field in contribution_tracking - https://phabricator.wikimedia.org/T433883#12223851 (10Cstone) a:03Cstone [19:44:45] 03Fundraising Sprint: Ottoman-o-war, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-WMF-Audit: Trustly - batch not reconciling - 3442702 due to ?double refund? 2ypogPeTncY3TU2f2g9nAr - https://phabricator.wikimedia.org/T433919#12223861 (10Eileenmcnaughton) a:03Eileenmcnaughton [19:46:17] 03Fundraising Sprint: Ottoman-o-war, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-Donor-portal, and 3 others: Get our local civiproxy up to date with upstream - https://phabricator.wikimedia.org/T426078#12223868 (10Ejegg) a:03Ejegg [19:52:01] (03CR) 10Eileen: [C:03+2] Restore last donation date to Deduper interface [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1326346 (https://phabricator.wikimedia.org/T434612) (owner: 10Lars SG) [19:52:09] 03Fundraising Sprint: Ottoman-o-war, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-matching-gifts, and 2 others: Explore DoubleTheDonation integration - https://phabricator.wikimedia.org/T433406#12223877 (10Lars) See Q&A with DtD: https://docs.google.com/document/d/1Qd9wDkBk2UwUXADMEKRpmaEtc... [19:53:27] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: Failmail alert Validation error during recurring charge, in field: payment_submethod - https://phabricator.wikimedia.org/T435133#12223884 (10XenoRyet) p:05Triage→03Low [19:53:39] RESOLVED: HighPaymentMethodFailures: Average cc payment method failures are high [8.3] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentMethodFailures [19:53:39] RESOLVED: HighPaymentSchemeFailures: Average payment method scheme failures are high [8.3] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentSchemeFailures [19:53:39] RESOLVED: HighPaymentGatewayFailures: Average gravy payment gateway failures are high [8.3] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentGatewayFailures [19:54:07] (03CR) 10Lars SG: [C:03+2] Use the GatewayAccount value, not hard-coding for the vendor IDs [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1324524 (https://phabricator.wikimedia.org/T434041) (owner: 10Eileen) [19:55:19] (03CR) 10Eileen: "Good question - I just stuck with making the existing default explicit rather than changing it - changing it might be better - I guess tha" [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1326106 (owner: 10Eileen) [19:55:38] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Always preserve original wmf_ fields from session, even if donor stops and comes back in on another link - https://phabricator.wikimedia.org/T434734#12223886 (10XenoRyet) p:05Triage→03Medium [19:56:16] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Always preserve original wmf_ fields from session, even if donor stops and comes back in on another link - https://phabricator.wikimedia.org/T434734#12223887 (10XenoRyet) p:05Medium→03High [19:57:24] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-email-preferences: Changing other options in email prefs centre while already snoozed re-snoozes - https://phabricator.wikimedia.org/T434711#12223889 (10XenoRyet) p:05Triage→03Medium [19:59:11] FIRING: [2x] NodeDown: Node payments1006 is down. - https://alerts.wikimedia.org/?q=alertname%3DNodeDown [20:01:39] RESOLVED: HighPaymentsMedianRiskScore: Median payments risk_score is running high [44.2] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentsMedianRiskScore [20:03:08] (03CR) 10Eileen: "OK - I was trying to keep the main function basically unchanged but iterating" [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1324575 (https://phabricator.wikimedia.org/T434041) (owner: 10Eileen) [20:04:11] RESOLVED: [2x] NodeDown: Node payments1006 is down. - https://alerts.wikimedia.org/?q=alertname%3DNodeDown [20:05:02] (03CR) 10Lars SG: "Do you want me to +2 this as is or give it a little simplification first? Feels like we might as well avoid the extra queries" [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1324575 (https://phabricator.wikimedia.org/T434041) (owner: 10Eileen) [20:05:52] (03CR) 10Eileen: "nah I can iterate - I guess I was mostly trying to keep it an easy review - but you've got your head into it now!" [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1324575 (https://phabricator.wikimedia.org/T434041) (owner: 10Eileen) [20:09:31] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 13Patch-For-Review: [Aug 14th] Fail Mail (civi1002) run-job: Generate finance batch failed with code 1 - https://phabricator.wikimedia.org/T434914#12223931 (10Eileenmcnaughton) The job just ran - I'll take a look at what the failing items are on it (ie... [20:11:13] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: Invalid PaymentMethod passed in for Gravy Dlocal Pix in CiviCRM - https://phabricator.wikimedia.org/T435081#12223942 (10Damilare) [20:11:56] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: Invalid PaymentMethod passed in for Gravy Dlocal Pix in CiviCRM - https://phabricator.wikimedia.org/T435081#12223948 (10Damilare) [20:13:52] 06Fundraising-Backlog, 10FR-Donation-Processing: Chariot data issue - Email in Name field - https://phabricator.wikimedia.org/T434152#12223953 (10SBurnett-WMF) 05Open→03Declined p:05Triage→03Low [20:14:57] (03PS1) 10Lars SG: Fix managed reconcile error for Navigation [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1326369 (https://phabricator.wikimedia.org/T428474) [20:15:13] (03Merged) 10jenkins-bot: Use the GatewayAccount value, not hard-coding for the vendor IDs [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1324524 (https://phabricator.wikimedia.org/T434041) (owner: 10Eileen) [20:15:14] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10FR-failmail: Add 'Canceled_Reversal' to 'payment_status' options in Job.php - https://phabricator.wikimedia.org/T434019#12223963 (10SBurnett-WMF) [20:15:22] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: Why is this contribution a template contribution - https://phabricator.wikimedia.org/T434718#12223965 (10AKanji-WMF) p:05Triage→03Medium [20:15:52] (03CR) 10Eileen: [C:03+2] Fix managed reconcile error for Navigation [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1326369 (https://phabricator.wikimedia.org/T428474) (owner: 10Lars SG) [20:15:56] 06Fundraising-Backlog, 06Fundraising-Tech-Roadmap: claude-safe doesn't play nice with AppArmor (ubuntu) - https://phabricator.wikimedia.org/T434471#12223976 (10AKanji-WMF) [20:16:13] 06Fundraising-Backlog, 07payments-orchestration: Recurring token migration - Dlocal - https://phabricator.wikimedia.org/T434580#12223978 (10Damilare) [20:16:22] 03Fundraising Sprint: Ottoman-o-war, 06Fundraising-Backlog, 07payments-orchestration: Recurring token migration - Dlocal - https://phabricator.wikimedia.org/T434580#12223980 (10Damilare) [20:16:35] 06Fundraising-Backlog, 10FR-Donation-Processing: Chariot data issue - Individual Name cut off - https://phabricator.wikimedia.org/T434153#12223982 (10SBurnett-WMF) p:05Triage→03Medium [20:16:38] 06Fundraising-Backlog, 10FR-Donation-Processing: Chariot data issue - Individual Name cut off - https://phabricator.wikimedia.org/T434153#12223983 (10Eileenmcnaughton) https://civicrm.wikimedia.org/civicrm/contact/view?reset=1&cid=342583 [20:17:51] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10FR-failmail: Add 'Canceled_Reversal' to 'payment_status' options in Job.php - https://phabricator.wikimedia.org/T434019#12224002 (10AnnWF) Failure reason: Invalid PayPal message: {"charset":"UTF-8","payer_email":"xxxx@xx.com","receiver_email":"tle@wik... [20:18:23] (03Merged) 10jenkins-bot: Use the gatewayAccount values, not hard-coding, for the balancing accounts [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1324546 (https://phabricator.wikimedia.org/T434041) (owner: 10Eileen) [20:18:25] (03CR) 10CI reject: [V:04-1] Fix managed reconcile error for Navigation [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1326369 (https://phabricator.wikimedia.org/T428474) (owner: 10Lars SG) [20:18:29] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: venmo recurring failing with Payment method has not been successfully stored - https://phabricator.wikimedia.org/T434741#12224005 (10Cstone) [20:18:46] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 06FR-donorrelations, 10Recurring-Donations: Trustly subsequent recurring fails with invalid_service_credentials - https://phabricator.wikimedia.org/T434933#12224007 (10Cstone) [20:19:39] 06Fundraising-Backlog, 06Fundraising-Tech-Roadmap, 07FR-Fraud: Fraud service: send messages to queue after response is sent to client - https://phabricator.wikimedia.org/T434250#12224010 (10SBurnett-WMF) [20:19:47] 06Fundraising-Backlog: Network Token Enablement Information Request - https://phabricator.wikimedia.org/T435111#12224012 (10Cstone) We can ask gravy about this on Wednesday [20:20:25] 03Fundraising Sprint: Ottoman-o-war, 06Fundraising-Backlog, 10FR-WMF-Audit: Trustly header row format changed - https://phabricator.wikimedia.org/T434472#12224013 (10SBurnett-WMF) [20:21:03] (03PS6) 10Eileen: [Ref] Update existing Contribution:pre hook to use listener [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1324575 (https://phabricator.wikimedia.org/T434041) [20:21:03] (03PS7) 10Eileen: Add new entity reference custom field linking batches to AccountGateway [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1324595 (https://phabricator.wikimedia.org/T434041) [20:21:04] (03PS6) 10Eileen: Sync new entity reference custom field with the pre-existing one [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1324596 (https://phabricator.wikimedia.org/T434041) [20:21:05] (03PS6) 10Eileen: Populate new gateway custom field [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1324598 (https://phabricator.wikimedia.org/T434041) [20:21:09] (03PS4) 10Eileen: Form for adding finance batches [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1321221 (https://phabricator.wikimedia.org/T434041) [20:21:13] (03PS1) 10Eileen: Wip [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1326370 [20:22:02] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 06FR-donorrelations: CiviCRM Mailing Events Email Does Not Match Contact Email - https://phabricator.wikimedia.org/T434832#12224022 (10Lars) [20:25:13] 03Fundraising Sprint: Ottoman-o-war, 06Fundraising-Backlog: Network Token Enablement Information Request - https://phabricator.wikimedia.org/T435111#12224028 (10SBurnett-WMF) [20:26:22] 06Fundraising-Backlog, 10FR-WMF-Audit: Deprecation of PTP and Upgrade to SDP - Adyen - https://phabricator.wikimedia.org/T435114#12224030 (10SBurnett-WMF) p:05Triage→03Medium [20:26:39] FIRING: HighPaymentsMedianRiskScore: Median payments risk_score is running high [90.4] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentsMedianRiskScore [20:27:24] (03PS1) 10Ejegg: Merge branch 'master' into deployment [wikimedia/fundraising/SmashPig] (deployment) - 10https://gerrit.wikimedia.org/r/1326371 [20:28:14] (03CR) 10Ejegg: [C:03+2] Merge branch 'master' into deployment [wikimedia/fundraising/SmashPig] (deployment) - 10https://gerrit.wikimedia.org/r/1326371 (owner: 10Ejegg) [20:28:50] (03Merged) 10jenkins-bot: Merge branch 'master' into deployment [wikimedia/fundraising/SmashPig] (deployment) - 10https://gerrit.wikimedia.org/r/1326371 (owner: 10Ejegg) [20:30:43] !log standalone (IPN listener) SmashPig upgraded from 3acbe469 to 49c58f98 [20:30:44] Logged the message at https://wikitech.wikimedia.org/wiki/Fundraising/SAL [20:31:11] FIRING: NodeDown: Node payments1005 is down. - https://frmon.wikimedia.org/d/000000377/host-overview?orgId=1&var-host=payments1005 - https://alerts.wikimedia.org/?q=alertname%3DNodeDown [20:31:31] (03PS2) 10Lars SG: Fix managed reconcile error for Navigation [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1326369 (https://phabricator.wikimedia.org/T428474) [20:31:39] RESOLVED: HighPaymentsMedianRiskScore: Median payments risk_score is running high [90.4] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentsMedianRiskScore [20:31:47] (03CR) 10Ejegg: [C:03+2] Fix managed reconcile error for Navigation [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1326369 (https://phabricator.wikimedia.org/T428474) (owner: 10Lars SG) [20:34:43] (03CR) 10Laurabarluzzi: [C:03+2] "I'm fine with keeping it as is, but I think in the future we might need to change it to an empty string (when a version of PHP will requir" [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1326106 (owner: 10Eileen) [20:36:11] RESOLVED: NodeDown: Node payments1005 is down. - https://frmon.wikimedia.org/d/000000377/host-overview?orgId=1&var-host=payments1005 - https://alerts.wikimedia.org/?q=alertname%3DNodeDown [20:36:39] FIRING: HighPaymentSchemeFailures: Average payment method scheme failures are high [16.8] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentSchemeFailures [20:36:39] FIRING: HighPaymentGatewayFailures: Average gravy payment gateway failures are high [16.8] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentGatewayFailures [20:36:39] FIRING: HighPaymentMethodFailures: Average cc payment method failures are high [16.8] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentMethodFailures [20:37:35] (03Merged) 10jenkins-bot: PHP8.4 - fputcsv should pass escape to avoid deprecation [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1326106 (owner: 10Eileen) [20:37:50] (03PS4) 10Ejegg: Count ML filter score towards total risk_score [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1324830 [20:41:39] RESOLVED: HighPaymentGatewayFailures: Average gravy payment gateway failures are high [10.3] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentGatewayFailures [20:41:39] RESOLVED: HighPaymentMethodFailures: Average cc payment method failures are high [10.3] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentMethodFailures [20:41:39] RESOLVED: HighPaymentSchemeFailures: Average payment method scheme failures are high [10.3] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentSchemeFailures [20:46:39] FIRING: HighPaymentsMedianRiskScore: Median payments risk_score is running high [44.2] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentsMedianRiskScore [20:49:13] (03CR) 10CI reject: [V:04-1] Wip [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1326370 (owner: 10Eileen) [20:49:57] 03Fundraising Sprint: Ottoman-o-war, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 03Civi RoadMap FY 26-27, and 2 others: Using Acoustic API to opt users into SMS program via paymentswiki variant form - https://phabricator.wikimedia.org/T423967#12224113 (10SKivlehan-WMF) @Lars, just date makes se... [20:50:22] fr-tech this is the ticket to get the ML fraud score actually contributing to the filter decision: https://gerrit.wikimedia.org/r/1324830 [20:51:25] (03Merged) 10jenkins-bot: Fix managed reconcile error for Navigation [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1326369 (https://phabricator.wikimedia.org/T428474) (owner: 10Lars SG) [20:51:32] I'm going to update SmashPig under DonationInterface to get that new email format up [20:51:39] RESOLVED: HighPaymentsMedianRiskScore: Median payments risk_score is running high [44.6] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentsMedianRiskScore [20:53:33] (03PS1) 10Ejegg: Update SmashPig from v1.2.4.14 -> v1.2.5.14 [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1326374 [20:53:36] (03CR) 10Ejegg: [C:03+2] Update SmashPig from v1.2.4.14 -> v1.2.5.14 [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1326374 (owner: 10Ejegg) [20:56:22] (03PS2) 10Eileen: Stripe Audit, optionally retrieve contact details and bubble up [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1326211 (https://phabricator.wikimedia.org/T432813) [20:56:31] (03PS3) 10Eileen: Convert GiveLively to the organization [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1326217 (https://phabricator.wikimedia.org/T432813) [20:56:38] (03PS3) 10Eileen: Use stripe as the payment method for GiveLively [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1326245 (https://phabricator.wikimedia.org/T432813) [20:57:31] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Always preserve original wmf_ fields from session, even if donor stops and comes back in on another link - https://phabricator.wikimedia.org/T434734#12224126 (10Laurabarluzzi) @Cstone @Damilare @Ejegg I just read through... [21:00:26] (03CR) 10CI reject: [V:04-1] Stripe Audit, optionally retrieve contact details and bubble up [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1326211 (https://phabricator.wikimedia.org/T432813) (owner: 10Eileen) [21:00:26] (03CR) 10CI reject: [V:04-1] Convert GiveLively to the organization [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1326217 (https://phabricator.wikimedia.org/T432813) (owner: 10Eileen) [21:01:07] (03PS3) 10Eileen: Stripe Audit, optionally retrieve contact details and bubble up [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1326211 (https://phabricator.wikimedia.org/T432813) [21:01:09] (03PS1) 10Ejegg: Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - 10https://gerrit.wikimedia.org/r/1326379 [21:01:47] (03CR) 10CI reject: [V:04-1] Stripe Audit, optionally retrieve contact details and bubble up [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1326211 (https://phabricator.wikimedia.org/T432813) (owner: 10Eileen) [21:02:18] (03PS4) 10Eileen: Convert GiveLively to the organization [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1326217 (https://phabricator.wikimedia.org/T432813) [21:03:00] (03CR) 10CI reject: [V:04-1] Convert GiveLively to the organization [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1326217 (https://phabricator.wikimedia.org/T432813) (owner: 10Eileen) [21:04:33] ah dang, I tagged the deploy branch of SmashPig [21:05:25] (03CR) 10Ejegg: [C:04-1] "Oops, tagged the deploy branch of smashpig not master" [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1326374 (owner: 10Ejegg) [21:05:46] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 06FR-donorrelations: CiviCRM Mailing Events Email Does Not Match Contact Email - https://phabricator.wikimedia.org/T434832#12224162 (10Lars) In this case, the donor's email was changed on their Civi record after their... [21:05:52] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 06FR-donorrelations: CiviCRM Mailing Events Email Does Not Match Contact Email - https://phabricator.wikimedia.org/T434832#12224164 (10Lars) a:03Lars [21:06:21] (03CR) 10CI reject: [V:04-1] Update SmashPig from v1.2.4.14 -> v1.2.5.14 [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1326374 (owner: 10Ejegg) [21:08:13] (03PS4) 10Eileen: Stripe Audit, optionally retrieve contact details and bubble up [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1326211 (https://phabricator.wikimedia.org/T432813) [21:08:13] (03PS5) 10Eileen: Convert GiveLively to the organization [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1326217 (https://phabricator.wikimedia.org/T432813) [21:08:13] (03PS4) 10Eileen: Uset stripe as the payment method for GiveLively [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1326245 (https://phabricator.wikimedia.org/T432813) [21:08:57] (03CR) 10CI reject: [V:04-1] Convert GiveLively to the organization [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1326217 (https://phabricator.wikimedia.org/T432813) (owner: 10Eileen) [21:08:58] (03CR) 10CI reject: [V:04-1] Stripe Audit, optionally retrieve contact details and bubble up [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1326211 (https://phabricator.wikimedia.org/T432813) (owner: 10Eileen) [21:09:07] (03CR) 10CI reject: [V:04-1] Uset stripe as the payment method for GiveLively [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1326245 (https://phabricator.wikimedia.org/T432813) (owner: 10Eileen) [21:09:45] (03PS2) 10Ejegg: Update SmashPig from v1.2.4.14 -> v1.2.5.15 [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1326374 [21:09:55] (03CR) 10Ejegg: [C:03+2] Update SmashPig from v1.2.4.14 -> v1.2.5.15 [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1326374 (owner: 10Ejegg) [21:10:27] (03PS5) 10Eileen: Stripe Audit, optionally retrieve contact details and bubble up [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1326211 (https://phabricator.wikimedia.org/T432813) [21:10:28] (03PS6) 10Eileen: Convert GiveLively to the organization [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1326217 (https://phabricator.wikimedia.org/T432813) [21:10:28] (03PS5) 10Eileen: Uset stripe as the payment method for GiveLively [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1326245 (https://phabricator.wikimedia.org/T432813) [21:11:20] (03CR) 10CI reject: [V:04-1] Uset stripe as the payment method for GiveLively [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1326245 (https://phabricator.wikimedia.org/T432813) (owner: 10Eileen) [21:11:39] FIRING: HighPaymentsMedianRiskScore: Median payments risk_score is running high [141.8] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentsMedianRiskScore [21:11:42] (03CR) 10CI reject: [V:04-1] Convert GiveLively to the organization [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1326217 (https://phabricator.wikimedia.org/T432813) (owner: 10Eileen) [21:12:33] (03Merged) 10jenkins-bot: Update SmashPig from v1.2.4.14 -> v1.2.5.15 [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1326374 (owner: 10Ejegg) [21:13:49] (03PS7) 10Eileen: Convert GiveLively to the organization [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1326217 (https://phabricator.wikimedia.org/T432813) [21:14:34] (03CR) 10CI reject: [V:04-1] Convert GiveLively to the organization [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1326217 (https://phabricator.wikimedia.org/T432813) (owner: 10Eileen) [21:16:14] (03PS8) 10Eileen: Convert GiveLively to the organization [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1326217 (https://phabricator.wikimedia.org/T432813) [21:16:14] (03PS6) 10Eileen: Uset stripe as the payment method for GiveLively [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1326245 (https://phabricator.wikimedia.org/T432813) [21:18:36] (03PS1) 10Ejegg: Update composer.lock for library update [core] (fundraising/REL1_43) - 10https://gerrit.wikimedia.org/r/1326385 [21:18:39] (03CR) 10Ejegg: [C:03+2] Update composer.lock for library update [core] (fundraising/REL1_43) - 10https://gerrit.wikimedia.org/r/1326385 (owner: 10Ejegg) [21:18:58] (03CR) 10Eileen: "recheck" [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1324595 (https://phabricator.wikimedia.org/T434041) (owner: 10Eileen) [21:21:39] RESOLVED: HighPaymentsMedianRiskScore: Median payments risk_score is running high [142.1] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentsMedianRiskScore [21:21:45] (03CR) 10Ejegg: "Oh weird, so they're not really card charges even though it's through stripe? I would have said to just put 'cc' in payment_method and lea" [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1326245 (https://phabricator.wikimedia.org/T432813) (owner: 10Eileen) [21:22:30] (03CR) 10Ejegg: [C:03+2] Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - 10https://gerrit.wikimedia.org/r/1326379 (owner: 10Ejegg) [21:22:33] ejegg: yeah those Stripe ones - I guess we don't know how they made the payment to Givelively but it looks like Givelively just deposits it to us [21:23:38] (03PS2) 10Ejegg: Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - 10https://gerrit.wikimedia.org/r/1326379 [21:23:54] (03CR) 10Ejegg: [C:03+2] Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - 10https://gerrit.wikimedia.org/r/1326379 (owner: 10Ejegg) [21:24:23] eileen: but if it's coming in via Stripe doesn't that mean it's a card? [21:25:24] Not 100% sure but they seem to be aggregate paymetns - but cc is easier so maybe absent knowing better I'll go with that :-) [21:26:06] (03Merged) 10jenkins-bot: Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - 10https://gerrit.wikimedia.org/r/1326379 (owner: 10Ejegg) [21:28:09] eileen: ejegg im out of the loop so maybe unhelpful but would these be like the moto and future chariot ones where we dont know about it on the front end at all? [21:28:12] (03PS1) 10Eileen: Alternatively use cc for Stripe GiveLively [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1326388 (https://phabricator.wikimedia.org/T434871) [21:28:39] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-payments-general: GoFundMe integration - https://phabricator.wikimedia.org/T432890#12224230 (10Lars) @MDemosWMF I think the built in P2P thing in Civi is not really what we want (and it is ancient code that I think it rarely used). I think soft cr... [21:28:44] yep - exactly - these are ones that haven't even been getting to Civi until now we knew so little about them [21:29:03] (03CR) 10CI reject: [V:04-1] Alternatively use cc for Stripe GiveLively [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1326388 (https://phabricator.wikimedia.org/T434871) (owner: 10Eileen) [21:29:30] (03CR) 10CI reject: [V:04-1] Update composer.lock for library update [core] (fundraising/REL1_43) - 10https://gerrit.wikimedia.org/r/1326385 (owner: 10Ejegg) [21:30:27] (03PS2) 10Eileen: Alternatively use cc for Stripe GiveLively [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1326388 (https://phabricator.wikimedia.org/T434871) [21:31:04] oh, that composer.lock patch needs to go after the submodule updates merge in I guess [21:31:45] (03PS2) 10Ejegg: Update composer.lock for library update [core] (fundraising/REL1_43) - 10https://gerrit.wikimedia.org/r/1326385 [21:31:49] (03CR) 10Ejegg: Update composer.lock for library update [core] (fundraising/REL1_43) - 10https://gerrit.wikimedia.org/r/1326385 (owner: 10Ejegg) [21:36:25] 06Fundraising-Backlog, 06FR-donorrelations, 10Recurring-Donations: CZK recurring donation amount conversion variability - https://phabricator.wikimedia.org/T435144 (10MBeat33) 03NEW [21:40:23] 06Fundraising-Backlog, 06FR-donorrelations, 10Recurring-Donations: CZK recurring donation amount conversion variability - https://phabricator.wikimedia.org/T435144#12224285 (10MBeat33) [21:41:41] (03Merged) 10jenkins-bot: Update composer.lock for library update [core] (fundraising/REL1_43) - 10https://gerrit.wikimedia.org/r/1326385 (owner: 10Ejegg) [21:52:12] oh hah ejegg are you mid payments deploy? [21:56:46] eileen: would it make more sense to convert it to a payment method we have instead of adding in a new weird stripe one? [21:57:39] RESOLVED: HighPaymentFraudMessages: More than 10 payment fraud messages in the past hour [127.0] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentFraudMessages [22:02:13] 03Fundraising Sprint: Ottoman-o-war, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-matching-gifts, and 2 others: Explore DoubleTheDonation integration - https://phabricator.wikimedia.org/T433406#12224337 (10Ejegg) Note on the suggested thank you page flow from https://doublethedonation.com/a... [22:02:39] cstone: oh did you have something more to deploy? [22:06:41] !log payments-wiki upgraded from a06ae998 to bfc18959 [22:06:42] Logged the message at https://wikitech.wikimedia.org/wiki/Fundraising/SAL [22:14:23] cstone: yeah - so on the follow on I just put 'cc' - on the basis that would be really easy & they don't matter that much - just wanted to see what people thought [22:21:11] FIRING: NodeDown: Node frdata1003 is down. - https://frmon.wikimedia.org/d/000000377/host-overview?orgId=1&var-host=frdata1003 - https://alerts.wikimedia.org/?q=alertname%3DNodeDown [22:26:11] RESOLVED: NodeDown: Node frdata1003 is down. - https://frmon.wikimedia.org/d/000000377/host-overview?orgId=1&var-host=frdata1003 - https://alerts.wikimedia.org/?q=alertname%3DNodeDown [22:30:55] (03PS7) 10Ejegg: Setup for local lead generation testing [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/1324820 (https://phabricator.wikimedia.org/T434150) [22:31:20] (03PS3) 10Ejegg: Update fundraising-ml image to add Jupyter [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/1321209 (https://phabricator.wikimedia.org/T434031) [22:36:17] 06Fundraising-Backlog, 10FR-Donation-Processing: Chariot data issue - omitting 'and' in Fidelity gifts - https://phabricator.wikimedia.org/T434155#12224365 (10Eileenmcnaughton) Pattern is "Susan Smith and Peter Jones" - we should make sure Chariot are also looking into it as they should ultimately be responsib... [22:36:41] FIRING: [2x] NodeDown: Node frban1002 is down. - https://alerts.wikimedia.org/?q=alertname%3DNodeDown [22:40:31] 06Fundraising-Backlog: Actually populate screen_height and screen_width in contribution_tracking - https://phabricator.wikimedia.org/T435147 (10Cstone) 03NEW [22:41:41] RESOLVED: NodeDown: Node frban1002 is down. - https://frmon.wikimedia.org/d/000000377/host-overview?orgId=1&var-host=frban1002 - https://alerts.wikimedia.org/?q=alertname%3DNodeDown [22:55:31] 03Fundraising Sprint: Ottoman-o-war, 06Fundraising-Backlog, 10fundraising-tech-ops, 03Civi RoadMap FY 26-27: FR-Tech FY2627Q1 maintenance window - https://phabricator.wikimedia.org/T419557#12224409 (10Dwisehaupt) [22:56:39] FIRING: HighPaymentsMedianRiskScore: Median payments risk_score is running high [150.0] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentsMedianRiskScore [23:01:39] RESOLVED: HighPaymentsMedianRiskScore: Median payments risk_score is running high [150.0] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentsMedianRiskScore [23:02:42] 10fundraising-tech-ops: Switch over to new payments servers - https://phabricator.wikimedia.org/T424582#12224427 (10Dwisehaupt) a:03Dwisehaupt Adding in the servers as is with bookworm for the time being. The migration to trixie will be in their future. [23:04:10] (03PS1) 10Eileen: Chariot Audit - treat Family in individual name like Fund [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1326396 (https://phabricator.wikimedia.org/T434153) [23:12:20] 06Fundraising-Backlog, 10FR-Donation-Processing, 13Patch-For-Review: Chariot data issue - Individual Name cut off - https://phabricator.wikimedia.org/T434153#12224435 (10Eileenmcnaughton) @MDemosWMF thanks - I have a fix - do you want to fix them up - ie create the 'right' contact & re-assign the Soft credit? [23:12:37] 03Fundraising Sprint: Ottoman-o-war, 06Fundraising-Backlog, 10FR-Donation-Processing, 13Patch-For-Review: Chariot data issue - Individual Name cut off - https://phabricator.wikimedia.org/T434153#12224436 (10Eileenmcnaughton) [23:16:50] 03Fundraising Sprint: Ottoman-o-war, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-matching-gifts, and 2 others: Explore DoubleTheDonation integration - https://phabricator.wikimedia.org/T433406#12224441 (10Lars) One potential option to consider is that we can create donations in DtD without... [23:20:07] (03CR) 10Dmiranda: [C:03+2] "Thanks @emcnaughton@wikimedia.org!" [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1326396 (https://phabricator.wikimedia.org/T434153) (owner: 10Eileen) [23:20:45] (03Merged) 10jenkins-bot: Chariot Audit - treat Family in individual name like Fund [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1326396 (https://phabricator.wikimedia.org/T434153) (owner: 10Eileen) [23:43:59] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Managed navigations without domain_id explicitly stated produce duplicates - https://phabricator.wikimedia.org/T435151 (10Lars) 03NEW