[00:16:12] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 06FR-donorrelations, 13Patch-For-Review: Venmo issues from first round of testing - https://phabricator.wikimedia.org/T409599#12015654 (10Cstone) Coming back to this now, gravy did eventually get back to us on Amber's test transactions that were both... [00:16:58] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 06FR-donorrelations, 13Patch-For-Review: Venmo issues from first round of testing - https://phabricator.wikimedia.org/T409599#12015655 (10Cstone) [00:18:07] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 07payments-orchestration: Manually settled transactions only coming in on audit files - https://phabricator.wikimedia.org/T408768#12015657 (10Cstone) I think this has been resolved by all the updates to the audit file processing in the settlement work a... [01:18:25] (03PS2) 10Cstone: Handle three decimal currencies [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1298952 (https://phabricator.wikimedia.org/T428458) [01:21:09] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: Adyen weekly settlement report was only half the file - https://phabricator.wikimedia.org/T419200#12015699 (10Cstone) a:05Cstone→03None [01:26:11] (03PS1) 10Cstone: Fix comment for example paypal recurring message [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1301463 [03:01:44] (03PS2) 10Cstone: Fix comment for example paypal recurring message [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1301463 [03:15:21] (03PS5) 10Cstone: Handle double currency conversion [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1296931 (https://phabricator.wikimedia.org/T426098) [03:32:41] (03CR) 10CI reject: [V:04-1] Handle double currency conversion [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1296931 (https://phabricator.wikimedia.org/T426098) (owner: 10Cstone) [05:49:28] FIRING: OOM: OOM killer active on fransw1003.frack.eqiad.wmnet:9100 - https://alerts.wikimedia.org/?q=alertname%3DOOM [05:54:28] RESOLVED: OOM: OOM killer active on fransw1003.frack.eqiad.wmnet:9100 - https://alerts.wikimedia.org/?q=alertname%3DOOM [13:34:39] FIRING: HighPaymentGatewayFailures: Average gravy payment gateway failures are high [25.6] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentGatewayFailures [13:34:39] FIRING: HighPaymentMethodFailures: Average cc payment method failures are high [25.6] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentMethodFailures [13:34:39] FIRING: HighPaymentSchemeFailures: Average payment method scheme failures are high [25.6] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentSchemeFailures [13:49:39] RESOLVED: HighPaymentGatewayFailures: Average gravy payment gateway failures are high [6.2] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentGatewayFailures [13:49:39] RESOLVED: HighPaymentSchemeFailures: Average payment method scheme failures are high [6.2] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentSchemeFailures [13:49:39] RESOLVED: HighPaymentMethodFailures: Average cc payment method failures are high [6.2] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentMethodFailures [22:11:39] FIRING: HighPaymentsMedianRiskScore: Median payments risk_score is running high [41.2] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentsMedianRiskScore [22:26:39] RESOLVED: HighPaymentsMedianRiskScore: Median payments risk_score is running high [41.0] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentsMedianRiskScore