[00:24:44] <wikibugs>	 (03PS9) 10Wfan: Complete technical work to enable Venmo through Braintree [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/939796 (https://phabricator.wikimedia.org/T334430)
[00:25:39] <wikibugs>	 (03PS7) 10Wfan: Add refund script for braintree [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/942513 (https://phabricator.wikimedia.org/T342788)
[00:25:47] <wikibugs>	 (03PS4) 10Wfan: Unit test for audit parse venmo [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/942532 (https://phabricator.wikimedia.org/T340801)
[00:25:57] <wikibugs>	 (03PS6) 10Wfan: Unit Test for Braintree Refund [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/942718 (https://phabricator.wikimedia.org/T342788)
[00:33:24] <wikibugs>	 (03PS2) 10Wfan: Enable monthly convert from DI for braintree [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/945015 (https://phabricator.wikimedia.org/T342594)
[00:34:39] <wikibugs>	 10Fundraising Sprint Owner of a Lonely Product, 10Fundraising-Backlog, 10MediaWiki-extensions-DonationInterface, 10FR-Email: Make unsubscribe work in EmailPreferences, delete Unsub extension - https://phabricator.wikimedia.org/T223330 (10AnnWF) a:03AnnWF
[02:06:30] <wikibugs>	 (03PS7) 10Cstone: Pass additional params from Payments to thank you page URL [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/931993 (https://phabricator.wikimedia.org/T340058) (owner: 10Jgleeson)
[02:07:58] <wikibugs>	 (03CR) 10CI reject: [V: 04-1] Pass additional params from Payments to thank you page URL [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/931993 (https://phabricator.wikimedia.org/T340058) (owner: 10Jgleeson)
[02:10:19] <wikibugs>	 (03PS8) 10Cstone: Pass additional params from Payments to thank you page URL [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/931993 (https://phabricator.wikimedia.org/T340058) (owner: 10Jgleeson)
[02:14:34] <wikibugs>	 10Fundraising Sprint Owner of a Lonely Product, 10Fundraising-Backlog, 10Patch-For-Review: Pass additional params from Payments to thank you page URL - https://phabricator.wikimedia.org/T340058 (10Cstone) a:03Cstone
[02:32:04] <wikibugs>	 (03CR) 10Cstone: [C: 03+2] "Looks good!" [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/944966 (https://phabricator.wikimedia.org/T342713) (owner: 10Damilare Adedoyin)
[02:33:37] <wikibugs>	 (03Merged) 10jenkins-bot: Fix design issue in Hebrew post-payment monthly convert [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/944966 (https://phabricator.wikimedia.org/T342713) (owner: 10Damilare Adedoyin)
[03:31:04] <wikibugs>	 10Fundraising Tech - Chaos Crew, 10Fundraising-Backlog, 10fr-donorservices: Problems donating via PayPal from France 07/24 - https://phabricator.wikimedia.org/T342652 (10Cstone) I dug into the logs more, this happened most on the email send days and then trails off here are some numbers:  | Date | Amount | |...
[03:41:18] <wikibugs>	 10Fundraising Tech - Chaos Crew, 10Fundraising-Backlog, 10fr-donorservices: Problems donating via PayPal from France 07/24 - https://phabricator.wikimedia.org/T342652 (10Cstone) I dug into the logs more it's happening more than I thought. This happened most on the email send days and then trails off, althoug...
[12:58:30] <wikibugs>	 10Fundraising-Backlog: Thank you page loading on native application on iOS - https://phabricator.wikimedia.org/T343534 (10Damilare)
[13:02:54] <wikibugs>	 (03CR) 10Damilare Adedoyin: [C: 03+1] "Thanks for all the work on this wfan. Looks good to me, a few things and this would be good to go." [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/939796 (https://phabricator.wikimedia.org/T334430) (owner: 10Wfan)
[14:44:33] <wikibugs>	 10Fundraising-Backlog, 10Wikipedia-iOS-App-Backlog: Thank you page loading on native application on iOS - https://phabricator.wikimedia.org/T343534 (10AKanji-WMF)
[14:44:56] <wikibugs>	 10Fundraising-Backlog, 10Wikipedia-iOS-App-Backlog: Thank you page loading on native application on iOS - https://phabricator.wikimedia.org/T343534 (10AKanji-WMF) https://wikimedia.slack.com/archives/C04LFS8JUDA/p1691159680332899
[15:37:12] <icinga-wm>	 PROBLEM - check_redis on frqueue1004 is CRITICAL: CRITICAL: payments-antifraud is 24925 10000 - REDIS 6.0.16 on 127.0.0.1:6379 has 1 databases (db0) with 10 keys, up 17 days 19 hours - memory use is 53.38M (peak 1.17G, 1.03% of max, fragmentation 1.59%), connected_slaves is 3, donations is 6, jobs is 0, jobs-adyen is 6, jobs-dlocal is 0, jobs-paypal is 0, payments-init is 0, pending is 0, recurring is 0, refund is 0, unsubscribe is 0 htt
[15:37:12] <icinga-wm>	 ga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frqueue1004&service=check_redis
[15:42:18] <icinga-wm>	 PROBLEM - check_redis on frqueue1004 is CRITICAL: CRITICAL: payments-antifraud is 32771 10000 - REDIS 6.0.16 on 127.0.0.1:6379 has 1 databases (db0) with 12 keys, up 17 days 19 hours - memory use is 72.41M (peak 1.17G, 1.27% of max, fragmentation 1.43%), connected_slaves is 3, donations is 6, jobs is 0, jobs-adyen is 3, jobs-dlocal is 2, jobs-paypal is 0, payments-init is 3, pending is 0, recurring is 0, refund is 0, unsubscribe is 0 htt
[15:42:18] <icinga-wm>	 ga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frqueue1004&service=check_redis
[15:47:12] <icinga-wm>	 PROBLEM - check_redis on frqueue1004 is CRITICAL: CRITICAL: payments-antifraud is 38643 10000 - REDIS 6.0.16 on 127.0.0.1:6379 has 1 databases (db0) with 8 keys, up 17 days 19 hours - memory use is 91.04M (peak 1.17G, 1.50% of max, fragmentation 1.35%), connected_slaves is 3, donations is 0, jobs is 0, jobs-adyen is 0, jobs-dlocal is 2, jobs-paypal is 0, payments-init is 0, pending is 0, recurring is 0, refund is 0, unsubscribe is 0 http
[15:47:12] <icinga-wm>	 a.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frqueue1004&service=check_redis
[15:50:17] <icinga-wm>	 ACKNOWLEDGEMENT - check_redis on frqueue1004 is CRITICAL: CRITICAL: payments-antifraud is 38643 10000 - REDIS 6.0.16 on 127.0.0.1:6379 has 1 databases (db0) with 8 keys, up 17 days 19 hours - memory use is 91.04M (peak 1.17G, 1.50% of max, fragmentation 1.35%), connected_slaves is 3, donations is 0, jobs is 0, jobs-adyen is 0, jobs-dlocal is 2, jobs-paypal is 0, payments-init is 0, pending is 0, recurring is 0, refund is 0, unsubscribe i
[15:50:17] <icinga-wm>	 haupt known. https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frqueue1004&service=check_redis
[16:17:12] <icinga-wm>	 RECOVERY - check_redis on frqueue1004 is OK: OK: REDIS 6.0.16 on 127.0.0.1:6379 has 1 databases (db0) with 9 keys, up 17 days 19 hours - memory use is 111.90M (peak 1.17G, 1.76% of max, fragmentation 1.29%), connected_slaves is 3, donations is 0, jobs is 0, jobs-adyen is 0, jobs-dlocal is 0, jobs-paypal is 1, payments-antifraud is 0, payments-init is 0, pending is 0, recurring is 1, refund is 0, unsubscribe is 1 https://icinga.wikimedia.
[16:17:12] <icinga-wm>	 in/icinga/extinfo.cgi?type=2&host=frqueue1004&service=check_redis
[17:29:29] <wikibugs>	 (03PS2) 10Wfan: Add &variant=monthlyConvert to venmo monthly convert link [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/945000 (https://phabricator.wikimedia.org/T342594)
[17:30:54] <wikibugs>	 (03CR) 10Cstone: [V: 03+2 C: 03+2] Add &variant=monthlyConvert to venmo monthly convert link [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/945000 (https://phabricator.wikimedia.org/T342594) (owner: 10Wfan)
[18:11:35] <wikibugs>	 10Fundraising Tech - Chaos Crew, 10Fundraising-Backlog, 10fr-donorservices: Problems donating via PayPal from France 07/24 - https://phabricator.wikimedia.org/T342652 (10AMJohnson) Apologies this is a long note but I wanted to try to provide as much detail as I could.   To summarize, **I was able to recreate...