[01:39:43] FIRING: DiskSpace: Disk space WARNING for (instance civi1002.frack.eqiad.wmnet:9100):/tmp - https://alerts.wikimedia.org/?q=alertname%3DDiskSpace [05:39:44] FIRING: DiskSpace: Disk space WARNING for (instance civi1002.frack.eqiad.wmnet:9100):/tmp - https://alerts.wikimedia.org/?q=alertname%3DDiskSpace [05:43:16] FIRING: ContextSwitchingSpike: Host context switching high (instance frdb1007.frack.eqiad.wmnet:9100) - https://alerts.wikimedia.org/?q=alertname%3DContextSwitchingSpike [05:53:16] RESOLVED: ContextSwitchingSpike: Host context switching high (instance frdb1007.frack.eqiad.wmnet:9100) - https://alerts.wikimedia.org/?q=alertname%3DContextSwitchingSpike [06:03:28] FIRING: OOM: OOM killer active on fransw1003.frack.eqiad.wmnet:9100 - https://alerts.wikimedia.org/?q=alertname%3DOOM [06:08:28] RESOLVED: OOM: OOM killer active on fransw1003.frack.eqiad.wmnet:9100 - https://alerts.wikimedia.org/?q=alertname%3DOOM [06:29:44] RESOLVED: DiskSpace: Disk space WARNING for (instance civi1002.frack.eqiad.wmnet:9100):/tmp - https://alerts.wikimedia.org/?q=alertname%3DDiskSpace [10:48:39] FIRING: HighPaymentsMedianRiskScore: Median payments risk_score is running high [102.4] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentsMedianRiskScore [10:53:39] RESOLVED: HighPaymentsMedianRiskScore: Median payments risk_score is running high [102.4] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentsMedianRiskScore [10:57:39] FIRING: HighPaymentFraudMessages: More than 10 payment fraud messages in the past hour [10.5] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentFraudMessages [11:12:39] FIRING: HighPaymentsMedianRiskScore: Median payments risk_score is running high [54.8] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentsMedianRiskScore [11:32:39] RESOLVED: HighPaymentsMedianRiskScore: Median payments risk_score is running high [50.8] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentsMedianRiskScore [12:17:39] RESOLVED: HighPaymentFraudMessages: More than 10 payment fraud messages in the past hour [10.4] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentFraudMessages [18:28:54] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: List of ids exceeds max_allowed_packet when batch_merge remaining ids is less than limit - https://phabricator.wikimedia.org/T434398 (10Lars) 03NEW [18:33:41] (03PS1) 10Lars SG: Always use min contact id in batch_merge [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1323816 (https://phabricator.wikimedia.org/T434398) [18:49:53] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 13Patch-For-Review: List of ids exceeds max_allowed_packet when batch_merge remaining ids is less than limit - https://phabricator.wikimedia.org/T434398#12198582 (10Lars) Two upstream PRs to chunk the inserts ([[ https... [19:17:39] FIRING: HighPaymentFraudMessages: More than 10 payment fraud messages in the past hour [11.0] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentFraudMessages [19:46:39] FIRING: HighPaymentsMedianRiskScore: Median payments risk_score is running high [52.0] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentsMedianRiskScore [19:56:39] RESOLVED: HighPaymentsMedianRiskScore: Median payments risk_score is running high [50.1] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentsMedianRiskScore [21:12:39] RESOLVED: HighPaymentFraudMessages: More than 10 payment fraud messages in the past hour [12.6] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentFraudMessages [21:16:39] FIRING: HighPaymentFraudMessages: More than 10 payment fraud messages in the past hour [10.3] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentFraudMessages [21:21:39] RESOLVED: HighPaymentFraudMessages: More than 10 payment fraud messages in the past hour [10.1] - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentFraudMessages