[00:07:12] <wikibugs>	 (03CR) 10CI reject: [V:04-1] Slight improvement in setting handlingin adyen tests [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306765 (https://phabricator.wikimedia.org/T427339) (owner: 10Eileen)
[00:09:00] <wikibugs>	 (03CR) 10CI reject: [V:04-1] Add handling for DepositCorrections [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306766 (https://phabricator.wikimedia.org/T427339) (owner: 10Eileen)
[00:21:52] <wikibugs>	 (03PS3) 10Eileen: Add handling for DepositCorrections [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306766 (https://phabricator.wikimedia.org/T427339)
[00:40:52] <wikibugs>	 (03CR) 10CI reject: [V:04-1] Add handling for DepositCorrections [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306766 (https://phabricator.wikimedia.org/T427339) (owner: 10Eileen)
[00:52:13] <wikibugs>	 (03PS2) 10Eileen: Restructure array construction [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306482 (https://phabricator.wikimedia.org/T427339)
[00:52:13] <wikibugs>	 (03PS2) 10Eileen: Update audit tests to permit flatter directory structure [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306483 (https://phabricator.wikimedia.org/T427339)
[00:52:13] <wikibugs>	 (03PS3) 10Eileen: Slight improvement in setting handlingin adyen tests [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306765 (https://phabricator.wikimedia.org/T427339)
[00:52:14] <wikibugs>	 (03PS4) 10Eileen: Add handling for DepositCorrections [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306766 (https://phabricator.wikimedia.org/T427339)
[01:10:03] <wikibugs>	 (03CR) 10CI reject: [V:04-1] Restructure array construction [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306482 (https://phabricator.wikimedia.org/T427339) (owner: 10Eileen)
[01:10:28] <wikibugs>	 (03CR) 10CI reject: [V:04-1] Update audit tests to permit flatter directory structure [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306483 (https://phabricator.wikimedia.org/T427339) (owner: 10Eileen)
[01:11:46] <wikibugs>	 (03CR) 10CI reject: [V:04-1] Add handling for DepositCorrections [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306766 (https://phabricator.wikimedia.org/T427339) (owner: 10Eileen)
[01:11:50] <wikibugs>	 (03CR) 10CI reject: [V:04-1] Slight improvement in setting handlingin adyen tests [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306765 (https://phabricator.wikimedia.org/T427339) (owner: 10Eileen)
[01:49:48] <wikibugs>	 (03PS1) 10Eileen: Merge branch 'master' of https://gerrit.wikimedia.org/r/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1306803
[01:52:18] <wikibugs>	 06Fundraising-Backlog, 10fundraising-tech-ops, 07FR-Fraud: Run fraud service via WSGI - https://phabricator.wikimedia.org/T430663#12074282 (10Dwisehaupt) I have a wsgi config setup and working with basic test scripts on frproto1001. You can access the test script using: `wget localhost:8080/test` If you acce...
[02:05:30] <wikibugs>	 03Fundraising Sprint: Kondo-approved bare room, 03Fundraising Sprint: Loud carpet, 06Fundraising-Backlog, 07Epic: SFTP reports required for Checkout.com - https://phabricator.wikimedia.org/T430762#12074285 (10Dwisehaupt) @Eileenmcnaughton here is the pubkey to pass on to checkout.com: `ssh-ed25519 AAAAC3Nz...
[02:08:40] <wikibugs>	 10fundraising-tech-ops: Deactivate fundraising accounts for yolorunshola - https://phabricator.wikimedia.org/T430768 (10Dwisehaupt) 03NEW
[02:11:10] <wikibugs>	 10fundraising-tech-ops: Deactivate fundraising accounts for yolorunshola - https://phabricator.wikimedia.org/T430768#12074296 (10Dwisehaupt)
[02:16:13] <wikibugs>	 10fundraising-tech-ops: Deactivate fundraising accounts for yolorunshola - https://phabricator.wikimedia.org/T430768#12074299 (10Dwisehaupt)
[02:16:51] <wikibugs>	 10fundraising-tech-ops: Deactivate fundraising accounts for yolorunshola - https://phabricator.wikimedia.org/T430768#12074300 (10Dwisehaupt) 05Open→03Resolved a:03Dwisehaupt Revoked ssl client cert and pushed out the change. Deactivated metabase account. No other access present.
[02:37:47] <wikibugs>	 03Fundraising Sprint: Kondo-approved bare room, 03Fundraising Sprint: Loud carpet, 06Fundraising-Backlog, 07Epic: SFTP reports required for Checkout.com - https://phabricator.wikimedia.org/T430762#12074308 (10Eileenmcnaughton) OK - I had a go at creating a phab https://dashboard.checkout.com/support/reques...
[02:58:10] <wikibugs>	 (03CR) 10Eileen: [C:03+2] Merge branch 'master' of https://gerrit.wikimedia.org/r/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1306803 (owner: 10Eileen)
[03:21:57] <wikibugs>	 (03CR) 10Eileen: Generalize Calculated Data to allow multiple source tables (032 comments) [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306365 (https://phabricator.wikimedia.org/T426818) (owner: 10Lars SG)
[03:26:04] <wikibugs>	 (03CR) 10Eileen: [C:03+2] "A couple of comments - but I think one will shake itself out through the chain & the other can be addressed further up the chain - they do" [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306365 (https://phabricator.wikimedia.org/T426818) (owner: 10Lars SG)
[03:44:04] <wikibugs>	 (03CR) 10CI reject: [V:04-1] Generalize Calculated Data to allow multiple source tables [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306365 (https://phabricator.wikimedia.org/T426818) (owner: 10Lars SG)
[03:50:34] <wikibugs>	 (03CR) 10Eileen: Add new overall and OTG donor segment and status fields for audience framework refresh (031 comment) [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306427 (https://phabricator.wikimedia.org/T426818) (owner: 10Lars SG)
[03:53:06] <wikibugs>	 (03PS1) 10Eileen: Revert "Make WMFDonor calculated-field tests independent of run date" [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306807
[04:23:32] <wikibugs>	 (03CR) 10Eileen: "Pushing through this revert because we need tests to work & the patch broke them" [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306807 (owner: 10Eileen)
[04:23:51] <wikibugs>	 (03CR) 10Eileen: [C:03+2] Revert "Make WMFDonor calculated-field tests independent of run date" [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306807 (owner: 10Eileen)
[04:24:49] <wikibugs>	 (03PS4) 10Lars SG: Generalize Calculated Data to allow multiple source tables [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306365 (https://phabricator.wikimedia.org/T426818)
[04:24:49] <wikibugs>	 (03PS2) 10Lars SG: Add new overall and OTG donor segment and status fields for audience framework refresh [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306427 (https://phabricator.wikimedia.org/T426818)
[04:24:49] <wikibugs>	 (03PS2) 10Lars SG: Add recurring donor status fields from civicrm_contribution_recur triggers [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306428 (https://phabricator.wikimedia.org/T426818)
[04:24:50] <wikibugs>	 (03PS2) 10Lars SG: Show new segments and statuses on the Segment admin page [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306429 (https://phabricator.wikimedia.org/T426818)
[04:24:51] <wikibugs>	 (03PS4) 10Lars SG: Add last_otg_donation_date [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306366 (https://phabricator.wikimedia.org/T426818)
[04:30:21] <wikibugs>	 (03PS3) 10Eileen: Restructure array construction [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306482 (https://phabricator.wikimedia.org/T427339)
[04:30:21] <wikibugs>	 (03PS3) 10Eileen: Update audit tests to permit flatter directory structure [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306483 (https://phabricator.wikimedia.org/T427339)
[04:30:21] <wikibugs>	 (03PS4) 10Eileen: Slight improvement in setting handlingin adyen tests [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306765 (https://phabricator.wikimedia.org/T427339)
[04:30:22] <wikibugs>	 (03PS5) 10Eileen: Add handling for DepositCorrections [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306766 (https://phabricator.wikimedia.org/T427339)
[04:45:12] <wikibugs>	 (03CR) 10CI reject: [V:04-1] Add recurring donor status fields from civicrm_contribution_recur triggers [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306428 (https://phabricator.wikimedia.org/T426818) (owner: 10Lars SG)
[04:45:13] <wikibugs>	 (03CR) 10CI reject: [V:04-1] Add last_otg_donation_date [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306366 (https://phabricator.wikimedia.org/T426818) (owner: 10Lars SG)
[04:45:50] <wikibugs>	 (03CR) 10CI reject: [V:04-1] Show new segments and statuses on the Segment admin page [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306429 (https://phabricator.wikimedia.org/T426818) (owner: 10Lars SG)
[04:48:08] <wikibugs>	 (03PS1) 10Lars SG: Make WMFDonor calculated-field tests independent of run date [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306810 (https://phabricator.wikimedia.org/T426818)
[04:55:04] <wikibugs>	 (03CR) 10Lars SG: Add new overall and OTG donor segment and status fields for audience framework refresh (031 comment) [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306427 (https://phabricator.wikimedia.org/T426818) (owner: 10Lars SG)
[04:57:24] <wikibugs>	 (03CR) 10Eileen: [C:03+2] Generalize Calculated Data to allow multiple source tables [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306365 (https://phabricator.wikimedia.org/T426818) (owner: 10Lars SG)
[05:01:07] <wikibugs>	 (03PS1) 10Eileen: Chariot: fixes for matching gifts [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306811 (https://phabricator.wikimedia.org/T419044)
[05:06:50] <wikibugs>	 (03CR) 10CI reject: [V:04-1] Make WMFDonor calculated-field tests independent of run date [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306810 (https://phabricator.wikimedia.org/T426818) (owner: 10Lars SG)
[05:23:08] <wikibugs>	 (03PS3) 10Lars SG: Add recurring donor status fields from civicrm_contribution_recur triggers [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306428 (https://phabricator.wikimedia.org/T426818)
[05:23:08] <wikibugs>	 (03PS3) 10Lars SG: Show new segments and statuses on the Segment admin page [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306429 (https://phabricator.wikimedia.org/T426818)
[05:23:08] <wikibugs>	 (03PS5) 10Lars SG: Add last_otg_donation_date [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306366 (https://phabricator.wikimedia.org/T426818)
[05:32:24] <wikibugs>	 (03PS5) 10Lars SG: Generalize Calculated Data to allow multiple source tables [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306365 (https://phabricator.wikimedia.org/T426818)
[05:32:24] <wikibugs>	 (03PS3) 10Lars SG: Add new overall and OTG donor segment and status fields for audience framework refresh [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306427 (https://phabricator.wikimedia.org/T426818)
[05:32:24] <wikibugs>	 (03PS4) 10Lars SG: Add recurring donor status fields from civicrm_contribution_recur triggers [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306428 (https://phabricator.wikimedia.org/T426818)
[05:32:25] <wikibugs>	 (03PS4) 10Lars SG: Show new segments and statuses on the Segment admin page [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306429 (https://phabricator.wikimedia.org/T426818)
[05:32:28] <wikibugs>	 (03PS6) 10Lars SG: Add last_otg_donation_date [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306366 (https://phabricator.wikimedia.org/T426818)
[05:32:32] <wikibugs>	 (03PS1) 10Lars SG: Make WMFDonor calculated-field tests independent of run date [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306833 (https://phabricator.wikimedia.org/T426818)
[05:36:30] <wikibugs>	 (03CR) 10Lars SG: [C:03+2] Restructure array construction [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306482 (https://phabricator.wikimedia.org/T427339) (owner: 10Eileen)
[05:39:40] <wikibugs>	 (03PS2) 10Lars SG: Make WMFDonor calculated-field tests independent of run date [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306833 (https://phabricator.wikimedia.org/T426818)
[05:39:40] <wikibugs>	 (03PS6) 10Lars SG: Generalize Calculated Data to allow multiple source tables [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306365 (https://phabricator.wikimedia.org/T426818)
[05:39:40] <wikibugs>	 (03PS4) 10Lars SG: Add new overall and OTG donor segment and status fields for audience framework refresh [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306427 (https://phabricator.wikimedia.org/T426818)
[05:39:41] <wikibugs>	 (03PS5) 10Lars SG: Add recurring donor status fields from civicrm_contribution_recur triggers [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306428 (https://phabricator.wikimedia.org/T426818)
[05:39:42] <wikibugs>	 (03PS5) 10Lars SG: Show new segments and statuses on the Segment admin page [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306429 (https://phabricator.wikimedia.org/T426818)
[05:39:43] <wikibugs>	 (03PS7) 10Lars SG: Add last_otg_donation_date [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306366 (https://phabricator.wikimedia.org/T426818)
[05:43:01] <wikibugs>	 (03CR) 10CI reject: [V:04-1] Localisation updates from https://translatewiki.net. [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1306587 (owner: 10L10n-bot)
[05:53:02] <wikibugs>	 (03CR) 10CI reject: [V:04-1] Make WMFDonor calculated-field tests independent of run date [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306833 (https://phabricator.wikimedia.org/T426818) (owner: 10Lars SG)
[05:53:28] <jinxer-wm>	 FIRING: OOM: OOM killer active on fransw1002.frack.eqiad.wmnet:9100   - https://alerts.wikimedia.org/?q=alertname%3DOOM
[05:56:28] <wikibugs>	 (03Merged) 10jenkins-bot: Restructure array construction [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306482 (https://phabricator.wikimedia.org/T427339) (owner: 10Eileen)
[05:58:28] <jinxer-wm>	 RESOLVED: OOM: OOM killer active on fransw1002.frack.eqiad.wmnet:9100   - https://alerts.wikimedia.org/?q=alertname%3DOOM
[09:21:41] <wikibugs>	 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: Acoustic job throwing omni mystery errors - https://phabricator.wikimedia.org/T430784 (10Damilare) 03NEW
[09:22:36] <wikibugs>	 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: Acoustic job throwing omni mystery errors - https://phabricator.wikimedia.org/T430784#12074937 (10Damilare)
[09:28:28] <wikibugs>	 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: Acoustic job throwing omni mystery errors - https://phabricator.wikimedia.org/T430784#12074958 (10Damilare) Looks like this might have been caused by missing action URL and Name in the passed recipient object to get the activity type.
[09:37:39] <jinxer-wm>	 FIRING: HighPaymentsMedianRiskScore: Median payments risk_score is running high [102.6]   - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentsMedianRiskScore
[09:40:04] <wikibugs>	 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: Failing Trustly recurring charges - https://phabricator.wikimedia.org/T430789 (10Damilare) 03NEW
[09:57:39] <jinxer-wm>	 RESOLVED: HighPaymentsMedianRiskScore: Median payments risk_score is running high [101.2]   - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentsMedianRiskScore
[10:32:51] <wikibugs>	 (03PS1) 10Damilare Adedoyin: Gravy maintenance script to allow fetching of tokens by status. [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1306891
[10:54:06] <wikibugs>	 (03PS1) 10Damilare Adedoyin: Skip Lead Gen - Email from activity load job [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306893 (https://phabricator.wikimedia.org/T430784)
[10:58:57] <wikibugs>	 (03PS2) 10Damilare Adedoyin: Gravy maintenance script to allow fetching of tokens by status. [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1306891
[11:10:10] <damilare>	 jgleeson: please can you help review my crm task to skip the activity causing the failmails: https://gerrit.wikimedia.org/r/1306893
[11:10:58] <jgleeson>	 will do damilare 
[11:12:40] <damilare>	 thanks!
[11:18:12] <wikibugs>	 (03CR) 10Jgleeson: [C:03+2] "LGTM! thanks" [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306893 (https://phabricator.wikimedia.org/T430784) (owner: 10Damilare Adedoyin)
[11:20:31] <damilare>	 thanks!
[11:36:44] <wikibugs>	 (03Merged) 10jenkins-bot: Skip Lead Gen - Email from activity load job [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306893 (https://phabricator.wikimedia.org/T430784) (owner: 10Damilare Adedoyin)
[11:44:58] <wikibugs>	 (03PS1) 10Damilare Adedoyin: Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1306904
[11:48:00] <wikibugs>	 (03CR) 10Damilare Adedoyin: [C:03+2] Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1306904 (owner: 10Damilare Adedoyin)
[11:48:55] <wikibugs>	 (03Merged) 10jenkins-bot: Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1306904 (owner: 10Damilare Adedoyin)
[12:05:11] <jinxer-wm>	 FIRING: [6x] NodeDown: Node frauth2002 is down.   - https://alerts.wikimedia.org/?q=alertname%3DNodeDown
[12:10:11] <jinxer-wm>	 FIRING: [14x] NodeDown: Node frauth2002 is down.   - https://alerts.wikimedia.org/?q=alertname%3DNodeDown
[12:15:11] <jinxer-wm>	 FIRING: [14x] NodeDown: Node frauth2002 is down.   - https://alerts.wikimedia.org/?q=alertname%3DNodeDown
[12:20:11] <jinxer-wm>	 RESOLVED: [14x] NodeDown: Node frauth2002 is down.   - https://alerts.wikimedia.org/?q=alertname%3DNodeDown
[12:21:11] <jinxer-wm>	 FIRING: [12x] NodeDown: Node frauth2002 is down.   - https://alerts.wikimedia.org/?q=alertname%3DNodeDown
[12:26:11] <jinxer-wm>	 FIRING: [14x] NodeDown: Node frauth2002 is down.   - https://alerts.wikimedia.org/?q=alertname%3DNodeDown
[12:27:39] <jinxer-wm>	 FIRING: HighPaymentFraudMessages: More than 10 payment fraud messages in the past hour [10.1]   - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentFraudMessages
[12:31:11] <jinxer-wm>	 RESOLVED: [14x] NodeDown: Node frauth2002 is down.   - https://alerts.wikimedia.org/?q=alertname%3DNodeDown
[12:32:11] <jinxer-wm>	 FIRING: [11x] NodeDown: Node frauth2002 is down.   - https://alerts.wikimedia.org/?q=alertname%3DNodeDown
[12:37:11] <jinxer-wm>	 FIRING: [14x] NodeDown: Node frauth2002 is down.   - https://alerts.wikimedia.org/?q=alertname%3DNodeDown
[12:42:11] <jinxer-wm>	 FIRING: [14x] NodeDown: Node frauth2002 is down.   - https://alerts.wikimedia.org/?q=alertname%3DNodeDown
[12:47:11] <jinxer-wm>	 RESOLVED: [14x] NodeDown: Node frauth2002 is down.   - https://alerts.wikimedia.org/?q=alertname%3DNodeDown
[12:47:39] <jinxer-wm>	 RESOLVED: HighPaymentFraudMessages: More than 10 payment fraud messages in the past hour [10.0]   - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentFraudMessages
[12:47:41] <jinxer-wm>	 FIRING: [9x] NodeDown: Node frauth2002 is down.   - https://alerts.wikimedia.org/?q=alertname%3DNodeDown
[12:48:39] <jinxer-wm>	 FIRING: HighPaymentFraudMessages: More than 10 payment fraud messages in the past hour [11.0]   - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentFraudMessages
[12:52:41] <jinxer-wm>	 FIRING: [14x] NodeDown: Node frauth2002 is down.   - https://alerts.wikimedia.org/?q=alertname%3DNodeDown
[12:57:41] <jinxer-wm>	 RESOLVED: [14x] NodeDown: Node frauth2002 is down.   - https://alerts.wikimedia.org/?q=alertname%3DNodeDown
[12:59:11] <jinxer-wm>	 FIRING: [12x] NodeDown: Node frauth2002 is down.   - https://alerts.wikimedia.org/?q=alertname%3DNodeDown
[13:04:11] <jinxer-wm>	 FIRING: [14x] NodeDown: Node frauth2002 is down.   - https://alerts.wikimedia.org/?q=alertname%3DNodeDown
[13:09:11] <jinxer-wm>	 RESOLVED: [14x] NodeDown: Node frauth2002 is down.   - https://alerts.wikimedia.org/?q=alertname%3DNodeDown
[13:10:11] <jinxer-wm>	 FIRING: [11x] NodeDown: Node frauth2002 is down.   - https://alerts.wikimedia.org/?q=alertname%3DNodeDown
[13:15:11] <jinxer-wm>	 FIRING: [14x] NodeDown: Node frauth2002 is down.   - https://alerts.wikimedia.org/?q=alertname%3DNodeDown
[13:16:39] <jinxer-wm>	 FIRING: HighPaymentsMedianRiskScore: Median payments risk_score is running high [81.2]   - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentsMedianRiskScore
[13:18:44] <wikibugs>	 (03PS3) 10Jgleeson: Extract gateway selection into a reusable GatewayRouter [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1306917 (https://phabricator.wikimedia.org/T430534)
[13:20:11] <jinxer-wm>	 RESOLVED: [14x] NodeDown: Node frauth2002 is down.   - https://alerts.wikimedia.org/?q=alertname%3DNodeDown
[13:21:11] <jinxer-wm>	 FIRING: [10x] NodeDown: Node frauth2002 is down.   - https://alerts.wikimedia.org/?q=alertname%3DNodeDown
[13:26:11] <jinxer-wm>	 FIRING: [14x] NodeDown: Node frauth2002 is down.   - https://alerts.wikimedia.org/?q=alertname%3DNodeDown
[13:31:11] <jinxer-wm>	 FIRING: [14x] NodeDown: Node frauth2002 is down.   - https://alerts.wikimedia.org/?q=alertname%3DNodeDown
[13:31:22] <jinxer-wm>	 FIRING: PfwCoreBGPDown: ...
[13:31:28] <jinxer-wm>	 Fundraising Firewall core BGP session down between pfw1-eqiad and cr1-eqiad (208.80.154.200) - group Production - https://wikitech.wikimedia.org/wiki/Network_monitoring#BGP_status - https://grafana.wikimedia.org/d/ed8da087-4bcb-407d-9596-d158b8145d45/bgp-neighbors-detail?orgId=1&var-site=eqiad&var-device=pfw1-eqiad:9804&var-bgp_group=Production&var-bgp_neighbor=cr1-eqiad - https://alerts.wikimedia.org/?q=alertname%3DPfwCoreBGPDown
[13:31:51] <jinxer-wm>	 FIRING: CoreRouterInterfaceDown: Core router interface down - pfw1-eqiad:xe-0/2/0 (Core: cr1-eqiad:xe-3/1/7 {#delete_me_and_replace_with_two_cables1}) - https://wikitech.wikimedia.org/wiki/Network_monitoring#Router_interface_down - https://grafana.wikimedia.org/d/fb403d62-5f03-434a-9dff-bd02b9fff504/network-device-overview?var-instance=pfw1-eqiad:9804 - https://alerts.wikimedia.org/?q=alertname%3DCoreRouterInterfaceDown
[13:36:11] <jinxer-wm>	 RESOLVED: [14x] NodeDown: Node frauth2002 is down.   - https://alerts.wikimedia.org/?q=alertname%3DNodeDown
[13:36:14] <jinxer-wm>	 RESOLVED: PfwCoreBGPDown: ...
[13:36:20] <jinxer-wm>	 Fundraising Firewall core BGP session down between pfw1-eqiad and cr1-eqiad (208.80.154.200) - group Production - https://wikitech.wikimedia.org/wiki/Network_monitoring#BGP_status - https://grafana.wikimedia.org/d/ed8da087-4bcb-407d-9596-d158b8145d45/bgp-neighbors-detail?orgId=1&var-site=eqiad&var-device=pfw1-eqiad:9804&var-bgp_group=Production&var-bgp_neighbor=cr1-eqiad - https://alerts.wikimedia.org/?q=alertname%3DPfwCoreBGPDown
[13:36:39] <wikibugs>	 (03PS8) 10Jgleeson: WIP: Add Gravy SecureFields Component to ComboWiki [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1305906 (https://phabricator.wikimedia.org/T428019)
[13:36:39] <jinxer-wm>	 RESOLVED: HighPaymentsMedianRiskScore: Median payments risk_score is running high [57.9]   - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentsMedianRiskScore
[13:36:51] <jinxer-wm>	 RESOLVED: CoreRouterInterfaceDown: Core router interface down - pfw1-eqiad:xe-0/2/0 (Core: cr1-eqiad:xe-3/1/7 {#delete_me_and_replace_with_two_cables1}) - https://wikitech.wikimedia.org/wiki/Network_monitoring#Router_interface_down - https://grafana.wikimedia.org/d/fb403d62-5f03-434a-9dff-bd02b9fff504/network-device-overview?var-instance=pfw1-eqiad:9804 - https://alerts.wikimedia.org/?q=alertname%3DCoreRouterInterfaceDown
[13:37:11] <jinxer-wm>	 FIRING: [12x] NodeDown: Node frauth2002 is down.   - https://alerts.wikimedia.org/?q=alertname%3DNodeDown
[13:39:35] <wikibugs>	 (03CR) 10CI reject: [V:04-1] WIP: Add Gravy SecureFields Component to ComboWiki [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1305906 (https://phabricator.wikimedia.org/T428019) (owner: 10Jgleeson)
[13:40:02] <wikibugs>	 03Fundraising Sprint: Kondo-approved bare room: Sprint K Priorities - https://phabricator.wikimedia.org/T430722#12076029 (10Damilare) 05Open→03Resolved
[13:41:41] <wikibugs>	 03Fundraising Sprint: Kondo-approved bare room, 03Fundraising Sprint: Loud carpet, 06Fundraising-Backlog, 07Epic: Epic: Enable checkout.com through gravy - https://phabricator.wikimedia.org/T430569#12076033 (10Damilare)
[13:42:11] <jinxer-wm>	 FIRING: [14x] NodeDown: Node frauth2002 is down.   - https://alerts.wikimedia.org/?q=alertname%3DNodeDown
[13:47:11] <jinxer-wm>	 RESOLVED: [14x] NodeDown: Node frauth2002 is down.   - https://alerts.wikimedia.org/?q=alertname%3DNodeDown
[13:48:11] <jinxer-wm>	 FIRING: [11x] NodeDown: Node frauth2002 is down.   - https://alerts.wikimedia.org/?q=alertname%3DNodeDown
[13:50:21] <wikibugs>	 03Fundraising Sprint: Kondo-approved bare room, 06Fundraising-Backlog, 07Fundraising-ComboWiki-Dependency, 03Civi RoadMap FY 26-27, 07fr-combowiki: Use GatewayRouter to select the payment gateway in ComboWiki - https://phabricator.wikimedia.org/T430821 (10jgleeson) 03NEW
[13:53:11] <jinxer-wm>	 FIRING: [14x] NodeDown: Node frauth2002 is down.   - https://alerts.wikimedia.org/?q=alertname%3DNodeDown
[13:58:11] <jinxer-wm>	 RESOLVED: [14x] NodeDown: Node frauth2002 is down.   - https://alerts.wikimedia.org/?q=alertname%3DNodeDown
[13:58:39] <jinxer-wm>	 RESOLVED: HighPaymentFraudMessages: More than 10 payment fraud messages in the past hour [10.8]   - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentFraudMessages
[13:59:11] <jinxer-wm>	 FIRING: [11x] NodeDown: Node frauth2002 is down.   - https://alerts.wikimedia.org/?q=alertname%3DNodeDown
[14:04:00] <wikibugs>	 (03PS2) 10Ejegg: Payments service config to point to fraud service [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/1305135 (https://phabricator.wikimedia.org/T429605)
[14:04:01] <wikibugs>	 (03PS1) 10Ejegg: WIP update fundraising-ml image [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/1306935
[14:04:11] <jinxer-wm>	 FIRING: [14x] NodeDown: Node frauth2002 is down.   - https://alerts.wikimedia.org/?q=alertname%3DNodeDown
[14:05:12] <wikibugs>	 (03CR) 10Lars SG: "recheck" [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306365 (https://phabricator.wikimedia.org/T426818) (owner: 10Lars SG)
[14:09:11] <jinxer-wm>	 FIRING: [14x] NodeDown: Node frauth2002 is down.   - https://alerts.wikimedia.org/?q=alertname%3DNodeDown
[14:14:01] <wikibugs>	 (03PS2) 10Ejegg: WIP update fundraising-ml image [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/1306935
[14:14:11] <jinxer-wm>	 RESOLVED: [14x] NodeDown: Node frauth2002 is down.   - https://alerts.wikimedia.org/?q=alertname%3DNodeDown
[14:14:41] <jinxer-wm>	 FIRING: [14x] NodeDown: Node frauth2002 is down.   - https://alerts.wikimedia.org/?q=alertname%3DNodeDown
[14:19:41] <jinxer-wm>	 FIRING: [14x] NodeDown: Node frauth2002 is down.   - https://alerts.wikimedia.org/?q=alertname%3DNodeDown
[14:24:41] <jinxer-wm>	 RESOLVED: [14x] NodeDown: Node frauth2002 is down.   - https://alerts.wikimedia.org/?q=alertname%3DNodeDown
[14:26:11] <jinxer-wm>	 FIRING: [12x] NodeDown: Node frauth2002 is down.   - https://alerts.wikimedia.org/?q=alertname%3DNodeDown
[14:31:11] <jinxer-wm>	 FIRING: [14x] NodeDown: Node frauth2002 is down.   - https://alerts.wikimedia.org/?q=alertname%3DNodeDown
[15:20:03] <wikibugs>	 (03PS3) 10Ejegg: WIP update fundraising-ml image [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/1306935
[15:27:32] <wikibugs>	 (03PS4) 10Ejegg: WIP update fundraising-ml image [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/1306935
[15:37:41] <jinxer-wm>	 FIRING: EndpointResultWarning: Endpoint check for minFraud on payments1012 is WARNING   - https://alerts.wikimedia.org/?q=alertname%3DEndpointResultWarning
[15:42:41] <jinxer-wm>	 FIRING: [7x] EndpointResultWarning: Endpoint check for minFraud on payments1005 is WARNING   - https://alerts.wikimedia.org/?q=alertname%3DEndpointResultWarning
[15:57:41] <jinxer-wm>	 FIRING: [8x] EndpointResultWarning: Endpoint check for minFraud on payments1005 is WARNING   - https://alerts.wikimedia.org/?q=alertname%3DEndpointResultWarning
[16:02:41] <jinxer-wm>	 FIRING: [10x] EndpointResultWarning: Endpoint check for minFraud on payments1005 is WARNING   - https://alerts.wikimedia.org/?q=alertname%3DEndpointResultWarning
[16:06:23] <wikibugs>	 (03PS5) 10Ejegg: Update fundraising-ml image [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/1306935
[16:08:55] <wikibugs>	 (03PS6) 10Ejegg: Update fundraising-ml image [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/1306935
[16:48:19] <wikibugs>	 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10FR-payments-general: Failing Trustly recurring charges - https://phabricator.wikimedia.org/T430789#12077371 (10SBurnett-WMF) p:05Triage→03High
[16:48:39] <wikibugs>	 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10FR-payments-general, 10FR-Smashpig: Failing Trustly recurring charges - https://phabricator.wikimedia.org/T430789#12077376 (10Fundraising-Task-Bot)
[17:12:08] <wikibugs>	 03Fundraising Sprint: Loud carpet, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Add special log table for previous segments & statuses for Analytics - https://phabricator.wikimedia.org/T430865 (10Lars) 03NEW
[18:09:49] <wikibugs>	 (03PS1) 10Ejegg: WIP replace unmaintained NameParser with fork [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306973 (https://phabricator.wikimedia.org/T425578)
[18:10:21] <wikibugs>	 (03CR) 10CI reject: [V:04-1] WIP replace unmaintained NameParser with fork [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306973 (https://phabricator.wikimedia.org/T425578) (owner: 10Ejegg)
[18:55:44] <wikibugs>	 03Fundraising Sprint: Kondo-approved bare room, 03Fundraising Sprint: Loud carpet, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, and 2 others: Implement new audience framework in CiviCRM and export to Acoustic - https://phabricator.wikimedia.org/T426818#12077999 (10Lars) @Eileenmcnaughton: On you...
[18:58:28] <ejegg>	 arghhh the wsgi config breaks pycharm debugging
[20:02:41] <jinxer-wm>	 FIRING: [10x] EndpointResultWarning: Endpoint check for minFraud on payments1005 is WARNING   - https://alerts.wikimedia.org/?q=alertname%3DEndpointResultWarning
[20:32:14] <wikibugs>	 (03CR) 10Ejegg: [C:04-1] "Looks like the user creation fails on mac as the host uid is outside of the allowed range. Also not working to debug in pycharm" [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/1306935 (owner: 10Ejegg)
[20:33:59] <ejegg>	 damilare: are you around another few minutes?
[20:34:14] <ejegg>	 I'm just curious if I can fix the 2 issues with wsgi before throwing it all out
[20:35:18] <ejegg>	 looks like the -r flag to useradd would let me create an account with uid 501
[20:37:00] <wikibugs>	 (03PS7) 10Ejegg: Update fundraising-ml image [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/1306935
[20:37:33] <ejegg>	 damilare: if you have a chance to try re-running setup.sh with ^^^ I'd be curious if that lets you make a request
[20:41:19] <ejegg>	 oh wait isn't there a way to make a derived image in docker-compose.yml
[20:41:38] <ejegg>	 maybe that would be an easy way to just add the user creation step
[20:46:28] <ejegg>	 ok sweet, i think dockerfile_inline might make this work
[20:47:17] <damilare>	 ejegg: sure
[20:51:58] <wikibugs>	 (03PS8) 10Ejegg: Update fundraising-ml image [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/1306935
[20:52:12] <ejegg>	 ok, ^^^ works to create the user for me locally
[20:52:17] <ejegg>	 let me see if it lets me debug
[20:52:43] <ejegg>	 do you want to see if that works for you?
[20:52:51] <ejegg>	 shouldn't even need to re-run setup.sh
[20:53:07] <ejegg>	 just docker compose down fundraising-ml && docker compose up fundraising-ml
[20:53:15] <damilare>	 cool, testing it now
[20:54:14] <damilare>	 its failing on the groupadd step: 0.089 groupadd: GID '20' already exists
[20:54:27] <ejegg>	 ohhhh
[20:54:48] <ejegg>	 ok, let me make it skip that step if a matching group exists
[20:58:09] <wikibugs>	 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Add last recurring amount change and last otg amount change fields to Civi & Acoustic - https://phabricator.wikimedia.org/T430877 (10Lars) 03NEW
[21:03:08] <wikibugs>	 (03PS9) 10Ejegg: Update fundraising-ml image [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/1306935
[21:03:23] <ejegg>	 I /think/ that should do it ^^^
[21:04:24] <ejegg>	 you would want to rerun setup.sh --fundraising-ml in this case though
[21:05:07] <wikibugs>	 03Fundraising Sprint: Loud carpet, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Add last recurring amount change and last otg amount change fields to Civi & Acoustic - https://phabricator.wikimedia.org/T430877#12078217 (10Lars)
[21:05:09] <damilare>	 checking
[21:05:22] <wikibugs>	 03Fundraising Sprint: Loud carpet, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Add last recurring amount change and last otg amount change fields to Civi & Acoustic - https://phabricator.wikimedia.org/T430877#12078230 (10Lars) a:03Lars
[21:07:38] <ejegg>	 dang, debugger is still not happy
[21:07:50] <ejegg>	 oh wait maybe i need to re-run the interpreter setup with the new image
[21:07:51] <damilare>	 thanks!
[21:07:57] <damilare>	 that worked
[21:08:34] <damilare>	 I wonder if we should move that to the mac config if its unique to mac users
[21:12:14] <ejegg>	 both systems need that build step
[21:12:24] <ejegg>	 it's only the -r flag that mac users need
[21:13:08] <ejegg>	 and i think maybe adding it in the docker-compose rather than setup.sh should run it under pycharm's debugger too
[21:14:21] <ejegg>	 just trying to figure out how to hit the debugged flask script rather than the wsgi server
[21:15:11] <ejegg>	 argh, i redid the interpreter config and now it doesn't see any of the libraries
[21:15:23] <ejegg>	 right, because they're in a venv in this new image
[21:15:36] <ejegg>	 how much do we really need to emulate prod???
[21:16:10] <ejegg>	 gotta be a way to make pycharm use the venv
[21:16:59] <damilare>	 what if we bind mount the venv, so its accessible outside the container
[21:17:12] <damilare>	 that should make pycharm reach it, no?
[21:17:18] <ejegg>	 oh hmm
[21:17:35] <ejegg>	 let me try just a different interpreter setup now
[21:20:39] <jinxer-wm>	 FIRING: HighPaymentGatewayFailures: Average gravy payment gateway failures are high [6.0]   - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentGatewayFailures
[21:20:39] <jinxer-wm>	 FIRING: HighPaymentMethodFailures: Average cc payment method failures are high [6.0]   - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentMethodFailures
[21:20:39] <jinxer-wm>	 FIRING: HighPaymentSchemeFailures: Average  payment method scheme failures are high [6.0]   - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentSchemeFailures
[21:24:48] <ejegg>	 annoyingly pycharm seems to have cached some old version of the container
[21:25:39] <jinxer-wm>	 RESOLVED: HighPaymentSchemeFailures: Average  payment method scheme failures are high [5.3]   - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentSchemeFailures
[21:25:39] <jinxer-wm>	 RESOLVED: HighPaymentMethodFailures: Average cc payment method failures are high [5.3]   - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentMethodFailures
[21:25:39] <jinxer-wm>	 RESOLVED: HighPaymentGatewayFailures: Average gravy payment gateway failures are high [5.3]   - https://alerts.wikimedia.org/?q=alertname%3DHighPaymentGatewayFailures
[21:31:29] <wikibugs>	 (03PS12) 10Damilare Adedoyin: Send data to the fraud service [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1304144 (https://phabricator.wikimedia.org/T429605) (owner: 10Ejegg)
[21:32:08] <wikibugs>	 (03CR) 10Damilare Adedoyin: [C:03+2] "I can see the result in the logs now, I corrected the url in the commit message because I had to use the 9001 port in the url and not 5000" [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1304144 (https://phabricator.wikimedia.org/T429605) (owner: 10Ejegg)
[21:32:17] <wikibugs>	 (03PS1) 10Lars SG: Add last_recurring_amount_change and accompanying change date fields [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306984 (https://phabricator.wikimedia.org/T430877)
[21:33:20] <wikibugs>	 (03PS9) 10Ejegg: Send attempt outcomes to fraud service [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1305758 (https://phabricator.wikimedia.org/T429605)
[21:33:52] <wikibugs>	 (03Merged) 10jenkins-bot: Send data to the fraud service [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1304144 (https://phabricator.wikimedia.org/T429605) (owner: 10Ejegg)
[21:35:35] <damilare>	 thanks for all the work on this ejegg and have a good break!
[21:39:46] <ejegg>	 thanks damilare|away !!!
[21:51:27] <wikibugs>	 (03PS9) 10Jgleeson: WIP: Add Gravy SecureFields Component to ComboWiki [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1305906 (https://phabricator.wikimedia.org/T428019)
[21:53:57] <wikibugs>	 (03CR) 10CI reject: [V:04-1] WIP: Add Gravy SecureFields Component to ComboWiki [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1305906 (https://phabricator.wikimedia.org/T428019) (owner: 10Jgleeson)
[21:54:50] <wikibugs>	 (03PS4) 10Jgleeson: Extract gateway selection into a reusable GatewayRouter [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1306917 (https://phabricator.wikimedia.org/T430534)
[22:02:09] <wikibugs>	 (03PS6) 10Eileen: Add handling for DepositCorrections [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306766 (https://phabricator.wikimedia.org/T427339)
[22:21:55] <wikibugs>	 (03CR) 10Cstone: [C:03+2] Chariot: fixes for matching gifts [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306811 (https://phabricator.wikimedia.org/T419044) (owner: 10Eileen)
[22:39:30] <eileen>	 thanks cstone ^^
[22:42:22] <wikibugs>	 (03Merged) 10jenkins-bot: Chariot: fixes for matching gifts [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306811 (https://phabricator.wikimedia.org/T419044) (owner: 10Eileen)
[23:04:13] <wikibugs>	 (03PS1) 10Eileen: Chariot: also add matching gift to individual from org [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306990 (https://phabricator.wikimedia.org/T419044)
[23:06:56] <eileen>	 dwisehaupt: I don't seem to have the permissions I expect on files downloaded by the `chariot_audit_download` to `/var/spool/audit/chariot/incoming/` (I was trying to run the command directly so as not to trigger failmail noise)
[23:15:18] <wikibugs>	 (03CR) 10Cstone: [C:03+2] Update audit tests to permit flatter directory structure [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306483 (https://phabricator.wikimedia.org/T427339) (owner: 10Eileen)
[23:16:48] <dwisehaupt>	 looking
[23:18:53] <dwisehaupt>	 ok. so i see that the 20260625081209-Groundswell file is owned by you (which is odd) and all the others are jenkins:www-data
[23:19:14] <dwisehaupt>	 none of them are group writable. which matches what i see in /var/spool/audit/braintree/incoming/
[23:20:23] <dwisehaupt>	 that groundswell file is older and all the newer ones have the jenkins:www-data perms with mode 644 
[23:25:14] <wikibugs>	 (03CR) 10CI reject: [V:04-1] Chariot: also add matching gift to individual from org [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306990 (https://phabricator.wikimedia.org/T419044) (owner: 10Eileen)
[23:34:36] <wikibugs>	 (03Merged) 10jenkins-bot: Update audit tests to permit flatter directory structure [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306483 (https://phabricator.wikimedia.org/T427339) (owner: 10Eileen)
[23:37:26] <eileen>	 dwisehaupt: yeah - probably the difference is whether I ran the job or the command direct
[23:37:43] <dwisehaupt>	 yeah. 
[23:39:57] <wikibugs>	 (03PS2) 10Eileen: Chariot: also add matching gift to individual from org [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1306990 (https://phabricator.wikimedia.org/T419044)
[23:52:49] <wikibugs>	 06Fundraising-Backlog, 10fundraising-tech-ops, 07FR-Fraud: Run fraud service via WSGI - https://phabricator.wikimedia.org/T430663#12078499 (10Dwisehaupt) wsgi setup is working and making progress, however, we are unable to set the `CONFIG_PATH` env in a way that is passing it down to the script. I have the s...