[00:02:10] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[00:07:12] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[00:12:10] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[00:13:29] <wikibugs>	 (03Merged) 10jenkins-bot: Fix bad array join [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1175616 (https://phabricator.wikimedia.org/T400786) (owner: 10Eileen)
[00:17:10] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[00:22:08] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[00:27:12] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[00:32:10] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[00:37:12] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[00:42:12] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[00:47:10] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[00:52:10] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[00:57:11] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[01:02:09] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[01:07:11] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[01:12:11] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[01:17:11] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[01:22:11] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[01:27:11] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[01:32:09] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[01:37:11] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[01:42:11] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[01:47:09] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[01:52:11] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[01:57:11] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[02:02:09] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[02:07:11] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[02:12:11] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[02:17:09] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[02:22:11] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[02:27:11] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[02:32:11] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[02:37:11] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[02:42:09] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[02:47:11] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[02:52:11] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[02:57:11] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[03:02:11] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[03:07:13] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[03:12:11] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[03:17:11] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[03:22:11] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[03:27:11] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[03:32:11] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[03:37:09] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[03:42:11] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[03:46:17] <wikibugs>	 (03PS4) 10Eileen: Combine CiviCRM vendor with main vendor using composer-merge-plugin [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1174877
[03:47:09] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[03:48:15] <wikibugs>	 (03CR) 10CI reject: [V:04-1] Combine CiviCRM vendor with main vendor using composer-merge-plugin [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1174877 (owner: 10Eileen)
[03:52:11] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[03:57:11] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[04:02:11] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[04:07:09] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[04:12:11] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[04:17:11] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[04:22:05] <wikibugs>	 (03PS1) 10Eileen: Merge branch 'master' of https://gerrit.wikimedia.org/r/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1175628
[04:22:11] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[04:22:51] <wikibugs>	 (03CR) 10Eileen: [C:03+2] Merge branch 'master' of https://gerrit.wikimedia.org/r/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1175628 (owner: 10Eileen)
[04:23:59] <eileen>	 !log civicrm upgraded from f202b616 to e591fe72
[04:24:00] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log
[04:27:11] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[04:32:11] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[04:37:09] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[04:42:11] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[04:47:09] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[04:52:09] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[04:53:15] <icinga-wm>	 PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: ipset_error 3 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages
[04:57:11] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[04:58:15] <icinga-wm>	 PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: ipset_error 4 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages
[05:02:11] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[05:03:17] <icinga-wm>	 PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: ipset_error 2 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages
[05:07:09] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[05:08:17] <icinga-wm>	 PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: ipset_error 6 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages
[05:12:11] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[05:13:17] <icinga-wm>	 PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: ipset_error 6 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages
[05:17:11] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[05:18:17] <icinga-wm>	 PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: ipset_error 2 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages
[05:22:11] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[05:23:15] <icinga-wm>	 PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: ipset_error 2 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages
[05:27:11] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[05:28:17] <icinga-wm>	 PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: ipset_error 3 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages
[05:32:11] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[05:33:17] <icinga-wm>	 PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: ipset_error 4 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages
[05:37:09] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[05:38:17] <icinga-wm>	 PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: ipset_error 2 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages
[05:42:09] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[05:43:19] <icinga-wm>	 PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: ipset_error 4 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages
[05:47:11] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[05:48:17] <icinga-wm>	 PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: ipset_error 2 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages
[05:52:09] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[05:53:15] <icinga-wm>	 RECOVERY - check_log_messages on frav1003 is OK: OK https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages
[05:57:09] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[06:02:11] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[06:07:09] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[06:12:09] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[06:17:11] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[06:22:11] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[06:27:09] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[06:32:11] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[06:37:11] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[06:37:18] <wikibugs>	 (03CR) 10Abijeet Patro: [V:03+2] Localisation updates from https://translatewiki.net. [extensions/DonationInterface] (REL1_39) - 10https://gerrit.wikimedia.org/r/1175318 (owner: 10L10n-bot)
[06:42:11] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[06:47:11] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[06:52:11] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[06:57:11] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[07:02:11] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[07:07:11] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[07:12:09] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[07:17:09] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[07:22:09] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[07:27:09] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[07:32:09] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[07:32:11] <icinga-wm>	 PROBLEM - check_load on fransw2002 is CRITICAL: LOAD CRITICAL - total load average: 101.34, 53.40, 28.13 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fransw2002&service=check_load
[07:37:09] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[07:37:13] <icinga-wm>	 RECOVERY - check_load on fransw2002 is OK: LOAD OK - total load average: 1.55, 23.05, 22.31 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fransw2002&service=check_load
[07:42:11] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[07:47:09] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[07:52:09] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[07:57:11] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[08:02:09] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[08:07:11] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[08:07:49] <wikibugs>	 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 06FR-donorrelations: Settled Adyen Donation - Settled Gravy Donation - Not Appearing in Civi - https://phabricator.wikimedia.org/T395340#11059801 (10RKumar_WMF) PII Syncing is now available for our PayPal connector. From now on, any transactions missing...
[08:12:11] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[08:17:09] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[08:22:10] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[08:27:08] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[08:32:12] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[08:36:28] <wikibugs>	 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 06FR-donorrelations: Civi: multiple issues with recurring donations - https://phabricator.wikimedia.org/T399339#11059880 (10AKanji-WMF) Hi @Ejegg and @Eileenmcnaughton  - I don't know if this is something that can be triggered as it is an automated recu...
[08:37:12] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[08:42:10] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[08:47:10] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[08:52:12] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[08:57:10] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[09:02:10] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[09:07:10] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[09:12:12] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[09:17:12] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[09:22:10] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[09:27:12] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[09:32:10] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[09:37:10] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[09:42:12] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[09:47:12] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[09:52:12] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[09:57:12] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[10:02:12] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[10:07:12] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[10:12:10] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[10:17:12] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: Cant connect to local server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[10:58:14] <wikibugs>	 03Fundraising Sprint: Omakase, 06Fundraising-Backlog, 07fr-acoustic, 07fr-current-sprint: July 30th: Removing Data Axle CE fields from Civi - License Expiring - https://phabricator.wikimedia.org/T395961#11060325 (10RLewis) @MDemosWMF - thanks for checking on this, i have the donors with the DA data we need...
[11:17:10] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 27439 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[11:22:12] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 27739 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[11:27:10] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 23980 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[11:32:12] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 22947 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[11:37:12] <icinga-wm>	 PROBLEM - check_mysql on frdb1003 is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 23247 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[12:43:27] <wikibugs>	 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10fundraising-tech-ops: dLocal Upcoming SFTP Security Update - https://phabricator.wikimedia.org/T399031#11060609 (10Jgreen)
[12:45:13] <wikibugs>	 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10fundraising-tech-ops: dLocal Upcoming SFTP Security Update - https://phabricator.wikimedia.org/T399031#11060614 (10Jgreen) 05Open→03Resolved Our sftp client has good overlap with their supported ciphers/kex/mac, we should not be affected by th...
[12:57:10] <icinga-wm>	 RECOVERY - check_mysql on frdb1003 is OK: Uptime: 9539 Threads: 5 Questions: 12369366 Slow queries: 16 Opens: 2839 Open tables: 2501 Queries per second avg: 1296.715 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 8517 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1003&service=check_mysql
[13:07:33] <wikibugs>	 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: time out for omin upload - https://phabricator.wikimedia.org/T398498#11060669 (10jgleeson) a:05jgleeson→03None
[13:26:20] <wikibugs>	 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 06FR-donorrelations: some Gravy contribs missing PII (PayPal, trustly) - https://phabricator.wikimedia.org/T395375#11060703 (10jgleeson) Gravy has had mixed success backfilling the missing PII, primarily due to the authorisations of most of the highligh...
[13:27:02] <wikibugs>	 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: Gravy Paypal donations imported without name or email address - https://phabricator.wikimedia.org/T394298#11060708 (10jgleeson) Gravy has backfilled the missing PII of the affected transaction in the ticket description.   They've also added a "refresh" fe...
[13:27:37] <wikibugs>	 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 06FR-donorrelations: some Gravy contribs missing PII (PayPal, trustly) - https://phabricator.wikimedia.org/T395375#11060710 (10jgleeson) a:03jgleeson
[13:44:49] <wikibugs>	 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 06FR-donorrelations: Civi: multiple issues with recurring donations - https://phabricator.wikimedia.org/T399339#11060823 (10Ejegg) @SHust if 2,815 of the donors have already received the automated failure email, do we really want to send it again?
[13:47:43] <wikibugs>	 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 06FR-donorrelations: Civi: multiple issues with recurring donations - https://phabricator.wikimedia.org/T399339#11060832 (10Ejegg) There is an API action to send the failure email, so even if it's not possible to do via the UI it should be fairly easy t...
[13:58:37] <wikibugs>	 (03PS2) 10Damilare Adedoyin: Load vue-router in DI extension. [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1175573
[14:01:26] <wikibugs>	 (03CR) 10CI reject: [V:04-1] Load vue-router in DI extension. [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1175573 (owner: 10Damilare Adedoyin)
[14:08:12] <wikibugs>	 (03PS1) 10Ejegg: Add 'Original Country' field for recurring [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1175905 (https://phabricator.wikimedia.org/T392376)
[14:10:58] <wikibugs>	 (03CR) 10CI reject: [V:04-1] Add 'Original Country' field for recurring [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1175905 (https://phabricator.wikimedia.org/T392376) (owner: 10Ejegg)
[14:25:21] <jgleeson>	 ejegg: if the donor changes the address related to the card, will the old one still work? and thinking further, should we just drop the tax_id if it does switch?
[14:25:37] <jgleeson>	 re:keeping original country
[14:30:06] <ejegg>	 jgleeson: we would keep sending the original country with the payment token
[14:30:16] <ejegg>	 we're not sending full addresses with tokens, are we?
[14:30:35] <jgleeson>	 I don't think so ejegg 
[14:30:47] <jgleeson>	 but I guess my question is, is the country frozen to the token
[14:30:59] <jgleeson>	 sounds odd if so
[14:31:21] <jgleeson>	 s/odd/wrong/
[14:31:28] <jgleeson>	 from a card network perspective
[14:31:42] <ejegg>	 jgleeson: I don't think the token needs the constant country, just our mapping of Tax IDs
[14:31:58] <ejegg>	 since Grayv needs a different api field name for each country
[14:32:21] <jgleeson>	 ok so this is just to keep gravy's API happy
[14:32:28] <jgleeson>	 their validation
[14:32:52] <ejegg>	 yeppers
[14:33:03] <ejegg>	 well, at this point it's breaking on our side even before making the API call
[14:33:20] <ejegg>	 Processor failed to create new payment with response:Can't map fiscal number to Gravy Tax ID
[14:33:26] <wikibugs>	 (03PS2) 10Ejegg: Add 'Original Country' field for recurring [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1175905 (https://phabricator.wikimedia.org/T392376)
[14:34:04] <ejegg>	 i was originally thinking we'd just omit the tax ID if the donor country changes to a country with no ID mapping
[14:34:23] <ejegg>	 but if the token is for a payment method that requires it (like Pix) then it would still fail
[14:34:26] <ejegg>	 just at the gravy side
[14:34:30] <ejegg>	 errr, i THINK
[14:34:41] <ejegg>	 maybe we don't need to send the tax ID again with the token?
[14:43:01] <wikibugs>	 (03PS3) 10Damilare Adedoyin: Load vue-router in DI extension. [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1175573
[15:19:03] <wikibugs>	 03Fundraising Sprint: Omakase, 06Fundraising-Backlog, 13Patch-For-Review, 07payments-orchestration: Setup fallback default currency logic on Gravy PayPal - https://phabricator.wikimedia.org/T400996#11061292 (10Damilare) a:03Damilare
[15:27:43] <wikibugs>	 03Fundraising Sprint: Omakase, 06Fundraising-Backlog, 07fr-current-sprint: We are incorrectly saving the Benevity fee to the scheme fee on the matched donations I think - https://phabricator.wikimedia.org/T400858#11061327 (10MDemosWMF) @Eileenmcnaughton Trying to understand this one - I think at the end of t...
[15:43:54] <wikibugs>	 06Fundraising-Backlog, 10FR-Smashpig: Make BagOStuff cache adapter compatible with MediaWiki >=1.45 - https://phabricator.wikimedia.org/T401219 (10Ejegg) 03NEW
[15:44:15] <ejegg>	 ok, now there's a phab I'll stop distracting myself with ^^^
[15:44:30] <ejegg>	 and get back to thinking about the pending table
[15:44:45] <ejegg>	 err, after one more patch on that original country thing
[15:58:03] <wikibugs>	 (03PS9) 10Ejegg: Get real donor data for Vue portal from server-side call [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1175127 (https://phabricator.wikimedia.org/T388745)
[15:58:44] <wikibugs>	 (03CR) 10Damilare Adedoyin: [C:03+2] "LGTM! We can add a unit test for this on a follow on patch." [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1175127 (https://phabricator.wikimedia.org/T388745) (owner: 10Ejegg)
[15:58:56] <wikibugs>	 (03PS4) 10Ejegg: Add a missing message to donorPortal list [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1175184
[15:59:39] <ejegg>	 thanks damilare !
[15:59:54] <damilare>	 np
[16:00:39] <damilare>	 ejegg: I've been able to load the vue-router module on the extension here: https://gerrit.wikimedia.org/r/c/mediawiki/extensions/DonationInterface/+/1175573
[16:00:56] <ejegg>	 oh awesome, i'll pull that down shortly
[16:01:11] <ejegg>	 well, let me grab some lunch first
[16:01:13] <damilare>	 however looks like core doesn't mind us adding it to the resources list
[16:01:51] <damilare>	 here's the thread on slack: https://wikimedia.slack.com/archives/C03DKGSEPL2/p1754341681256249?thread_ts=1754338994.830609&cid=C03DKGSEPL2
[16:02:05] <ejegg>	 oh wow, that callback to get the export wrapper is clever
[16:02:58] <damilare>	 yep that's similar to how it's done for vue on core
[16:03:11] <ejegg>	 ahh
[16:08:29] <wikibugs>	 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 06FR-donorrelations: Civi: multiple issues with recurring donations - https://phabricator.wikimedia.org/T399339#11061616 (10SHust) @Ejegg Thanks for the update! Mariana mentioned wanting to send to the entire list: //“we’ve lost many, and just one email...
[16:10:13] <wikibugs>	 (03CR) 10Wfan: [C:03+2] "I see, since https://gerrit.wikimedia.org/r/c/mediawiki/core/+/985355 assign "" so do the same could be fine, thanks" [extensions/CentralNotice] - 10https://gerrit.wikimedia.org/r/1175528 (https://phabricator.wikimedia.org/T401004) (owner: 10Ejegg)
[16:11:02] <ejegg|food>	 thanks wfan!
[16:12:01] <wfan>	 np, thanks for the fix :)
[16:38:13] <wikibugs>	 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: Currency mismatch in CiviCRM Recurring contribution page - https://phabricator.wikimedia.org/T401228 (10Damilare) 03NEW
[16:55:06] <wikibugs>	 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 06FR-donorrelations: Gravy to Civi missing contribs, March - June - https://phabricator.wikimedia.org/T398887#11061845 (10greg) p:05Medium→03High (Reprioritzing as high to match the joint gravy&wmf tracking sheet)
[17:18:47] <wikibugs>	 (03CR) 10Ejegg: [V:03+2 C:03+2] "Images are published!" [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/1175567 (https://phabricator.wikimedia.org/T396171) (owner: 10Jgleeson)
[17:19:27] <wikibugs>	 (03PS4) 10Ejegg: More steps to get civiproxy working with one-f [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/1174807
[17:21:09] <wikibugs>	 (03PS1) 10Ejegg: Fix recurring modify QC script [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/1175923
[17:33:53] <wikibugs>	 (03PS1) 10Ejegg: WIP Add cash_santander [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1175925
[17:38:24] <wikibugs>	 (03PS4) 10Damilare Adedoyin: Load vue-router in DI extension. [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1175573
[17:38:33] <wikibugs>	 (03CR) 10Ejegg: [C:03+2] Load vue-router in DI extension. [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1175573 (owner: 10Damilare Adedoyin)
[17:44:18] <wikibugs>	 (03PS1) 10Ejegg: Revert "Add vue router package to fundraising mediawiki" [core] (fundraising/REL1_43) - 10https://gerrit.wikimedia.org/r/1175926
[17:53:08] <wikibugs>	 (03CR) 10Jgleeson: [C:03+2] "low risk LGTM" [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1175184 (owner: 10Ejegg)
[17:54:26] <wikibugs>	 (03CR) 10Jgleeson: [C:03+2] "Ran ok for me!" [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/1175923 (owner: 10Ejegg)
[17:54:40] <ejegg>	 thanks jgleeson !
[17:55:00] <ejegg>	 oh I guess I had that on top of a slightly less trivial patch
[17:55:07] <ejegg>	 feel free to rebase away, or merge the parent
[17:55:34] <jgleeson>	 I figured damilare might be best to test the civiproxy stuff due to the mac updates
[17:56:34] <wikibugs>	 (03CR) 10CI reject: [V:04-1] Revert "Add vue router package to fundraising mediawiki" [core] (fundraising/REL1_43) - 10https://gerrit.wikimedia.org/r/1175926 (owner: 10Ejegg)
[17:57:16] <ejegg>	 k, cool
[17:57:45] <ejegg>	 oh i guess that revert will fail till the patch to do it in DI is actually merged
[18:03:57] <ejegg>	 we are getting more cash_santander failmails
[18:07:53] <jgleeson>	 ejegg: that patch is WIP so I didn't +2
[18:10:28] <ejegg>	 ah yeah, it doesn't actually work
[18:10:33] <ejegg>	 that's why it's still WIP :(
[18:10:44] <ejegg>	 so I need to ask in the dlocal slack channel
[18:10:55] <ejegg>	 but I've been pulled in to office hrs for the moment
[18:14:41] <jgleeson>	 oh right
[18:15:58] <wikibugs>	 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 06FR-donorrelations: 3DS failures in CAD June 25-26 - https://phabricator.wikimedia.org/T397943#11062239 (10greg) Discussed in Office Hours with Rakhi, we can close and monitor with Gravy in our ongoing calls.
[18:22:28] <jgleeson>	 fr-tech, we just got the docker images deployed by releng to pull in the new php.ini debug config includes which are added in this fundraising-dev patch. Does anyone who hasn't built the new images locally wanna give it a spin on this patch please? https://gerrit.wikimedia.org/r/c/wikimedia/fundraising/dev/+/1175567 you should just be able to run `./setup.sh up` to see the new images get built
[18:24:12] <jgleeson>	 (`./setup up`) is just an OS-aware wrapper of `docker compose up`
[18:30:59] <wikibugs>	 (03CR) 10Ejegg: [C:04-1] "Doesn't actually work this way - gets an bad value validation error from gravy's API" [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1175925 (owner: 10Ejegg)
[18:43:22] <wikibugs>	 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10MediaWiki-extensions-DonationInterface: cash_santander not supported under Gravy - https://phabricator.wikimedia.org/T401249 (10Ejegg) 03NEW
[18:43:31] <wikibugs>	 (03PS1) 10Ejegg: Disable Santander bank transfers in MX via Gravy [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1175937 (https://phabricator.wikimedia.org/T401249)
[18:44:46] <wikibugs>	 (03CR) 10Damilare Adedoyin: [C:03+2] More steps to get civiproxy working with one-f [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/1174807 (owner: 10Ejegg)
[18:44:50] <wikibugs>	 (03CR) 10Damilare Adedoyin: [V:03+2 C:03+2] More steps to get civiproxy working with one-f [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/1174807 (owner: 10Ejegg)
[18:45:47] <wikibugs>	 (03CR) 10Jgleeson: [C:03+2] Disable Santander bank transfers in MX via Gravy [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1175937 (https://phabricator.wikimedia.org/T401249) (owner: 10Ejegg)
[18:50:50] <wikibugs>	 (03CR) 10Wfan: [C:03+2] Add 'Original Country' field for recurring [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1175905 (https://phabricator.wikimedia.org/T392376) (owner: 10Ejegg)
[19:00:34] <wikibugs>	 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10MediaWiki-extensions-DonationInterface, 13Patch-For-Review, 07payments-orchestration: Old DLocal MX bank transfers not supported under Gravy - https://phabricator.wikimedia.org/T401249#11062355 (10Ejegg)
[19:05:38] <wikibugs>	 06Fundraising-Backlog, 10FR-Tech-Analytics: Access to Metabase for consultant Eoin Campbell. - https://phabricator.wikimedia.org/T401251#11062384 (10IAckerman-WMF)
[19:08:13] <wikibugs>	 (03PS1) 10Jgleeson: Update BuildGravyDonationFromLogs to use different date field [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1175939 (https://phabricator.wikimedia.org/T400479)
[19:08:33] <wikibugs>	 (03Merged) 10jenkins-bot: Add 'Original Country' field for recurring [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1175905 (https://phabricator.wikimedia.org/T392376) (owner: 10Ejegg)
[19:08:42] <wikibugs>	 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 06FR-donorrelations, 13Patch-For-Review: Source of Truth Unclear: Boleto Donation Mismatch Between Gravy, dLocal, and Civi - https://phabricator.wikimedia.org/T400479#11062389 (10jgleeson) a:05Damilare→03jgleeson
[19:09:16] <wikibugs>	 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 06FR-donorrelations, 13Patch-For-Review: Source of Truth Unclear: Boleto Donation Mismatch Between Gravy, dLocal, and Civi - https://phabricator.wikimedia.org/T400479#11062395 (10jgleeson) @SHust we're gonna try and manually import this one to bring t...
[19:10:58] <wikibugs>	 06Fundraising-Backlog: RML Country information not making it into Civi from Acoustic - https://phabricator.wikimedia.org/T400786#11062398 (10SHust) @Eileenmcnaughton, it looks like the patch that was deployed isn’t correcting the country field for contacts who had previously signed up and received today’s email...
[19:13:59] <damilare>	 jgleeson: for T400479, I was discussing with Gravy and we noticed 67 other similar transactions
[19:14:01] <stashbot>	 T400479: Source of Truth Unclear: Boleto Donation Mismatch Between Gravy, dLocal, and Civi - https://phabricator.wikimedia.org/T400479
[19:14:07] <damilare>	 conversation here: https://wikimedia.slack.com/archives/C070F1DVBRN/p1753968107594489
[19:15:16] <damilare>	 I thought they would come in the audit but looks like they plan on using the webhook
[19:15:49] <wikibugs>	 (03PS1) 10Ejegg: Add MX bank transfer links [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/1175940
[19:16:05] <jgleeson>	 I don't think they'd come in via webhook now?
[19:17:06] <jgleeson>	 oh I see DT's post about 'transaction.updated'
[19:17:11] <jgleeson>	 is that one of the ones we are ignoring>?
[19:17:15] <jgleeson>	 ->
[19:18:38] <damilare>	 I don't think so
[19:19:36] <damilare>	 we listen to all transaction messages 
[19:19:40] <jgleeson>	 damilare: do we know if older trxns that are manually updated by gravy come in on the nightly audit
[19:20:12] <jgleeson>	 ah, so the one I looked at today had not been imported
[19:20:46] <jgleeson>	 so if it was updated and a webhook was sent, we didn't do anything with it, it seems
[19:21:07] <damilare>	 they might not have sent the webhook yet
[19:21:13] <damilare>	 let me confirm with DT
[19:21:25] <wikibugs>	 06Fundraising-Backlog: RML Country information not making it into Civi from Acoustic - https://phabricator.wikimedia.org/T400786#11062424 (10Eileenmcnaughton) @SHust so it's working when newly collected but not backfilling the old ones?
[19:22:08] <wikibugs>	 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 06FR-donorrelations, 13Patch-For-Review: Source of Truth Unclear: Boleto Donation Mismatch Between Gravy, dLocal, and Civi - https://phabricator.wikimedia.org/T400479#11062426 (10jgleeson) Dami chatted with Gravy on Slack about this one [[ https://wik...
[19:26:23] <wikibugs>	 (03Merged) 10jenkins-bot: Get real donor data for Vue portal from server-side call [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1175127 (https://phabricator.wikimedia.org/T388745) (owner: 10Ejegg)
[19:29:07] <wikibugs>	 (03Merged) 10jenkins-bot: Add data-nosnippet attr on CN div [extensions/CentralNotice] - 10https://gerrit.wikimedia.org/r/1175528 (https://phabricator.wikimedia.org/T401004) (owner: 10Ejegg)
[19:44:10] <wikibugs>	 (03CR) 10Damilare Adedoyin: [C:03+2] Update BuildGravyDonationFromLogs to use different date field [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1175939 (https://phabricator.wikimedia.org/T400479) (owner: 10Jgleeson)
[19:44:18] <jgleeson>	 thanks damilare !
[19:44:24] <damilare>	 np
[19:44:41] <wikibugs>	 (03Merged) 10jenkins-bot: Update BuildGravyDonationFromLogs to use different date field [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1175939 (https://phabricator.wikimedia.org/T400479) (owner: 10Jgleeson)
[19:46:05] <wikibugs>	 (03Merged) 10jenkins-bot: Load vue-router in DI extension. [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1175573 (owner: 10Damilare Adedoyin)
[19:46:06] <wikibugs>	 (03Merged) 10jenkins-bot: Add a missing message to donorPortal list [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1175184 (owner: 10Ejegg)
[20:00:42] <wikibugs>	 06Fundraising-Backlog: RML Country information not making it into Civi from Acoustic - https://phabricator.wikimedia.org/T400786#11062551 (10SHust) @Eileenmcnaughton I signed up with a test email today, after the RML went live, and noticed the country field in Acoustic wasn’t populated with “XX. We won’t see the...
[20:07:05] <wikibugs>	 (03CR) 10Ejegg: [C:03+2] Revert "Add vue router package to fundraising mediawiki" [core] (fundraising/REL1_43) - 10https://gerrit.wikimedia.org/r/1175926 (owner: 10Ejegg)
[20:08:01] <wikibugs>	 (03PS6) 10Damilare Adedoyin: Add login template in vue with tests [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1166927
[20:10:36] <wikibugs>	 (03Merged) 10jenkins-bot: Disable Santander bank transfers in MX via Gravy [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1175937 (https://phabricator.wikimedia.org/T401249) (owner: 10Ejegg)
[20:20:31] <wikibugs>	 (03Merged) 10jenkins-bot: Revert "Add vue router package to fundraising mediawiki" [core] (fundraising/REL1_43) - 10https://gerrit.wikimedia.org/r/1175926 (owner: 10Ejegg)
[20:22:40] <ejegg>	 dami with that login template commit is there a way to make it show the login template via URL params? Or does it need that naviagation guard patch too?
[20:23:09] <ejegg>	 I see the styles are loaded and the header looks different, but no place to enter an email address
[20:23:23] <ejegg>	 oh hmm, that setPageTitle with a message object is deprecated
[20:24:17] <wikibugs>	 (03PS1) 10Ejegg: Fix deprecation warning on DonorPortal [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1175945
[20:25:11] <wikibugs>	 (03CR) 10Ejegg: "Looks good at first glance - just want to hold those new pause-related strings till a later patch?" [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1166927 (owner: 10Damilare Adedoyin)
[20:26:25] <damilare>	 checking it out ejegg
[20:32:09] <ejegg>	 oh I just needed to add #/login
[20:32:14] <ejegg>	 and I see the pretty picture
[20:32:36] <damilare>	 yepp that's it
[20:32:54] <wikibugs>	 (03PS7) 10Damilare Adedoyin: Add login template in vue with tests [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1166927
[20:34:24] <ejegg>	 cool cool, seems to be getting the link request onto the queue
[20:34:39] <ejegg>	 hmm, but I need to fix something in civi-land to make it send it to mailcatcher
[20:34:48] <ejegg>	 CRM_Core_Exception]                                                         Outbound mail has been disabled.
[20:35:05] <wikibugs>	 (03PS8) 10Damilare Adedoyin: Add login template in vue with tests [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1166927
[20:35:15] <ejegg>	 lemme see if that's affecting the local TY mails too
[20:35:34] <ejegg>	 i feel like there are at least 2 mailer systems civi can use
[20:36:06] <ejegg>	 right, send-mails.sh works
[20:36:17] <ejegg>	 let's see where the other system needs to be configured
[20:36:19] <damilare>	 yh mailcatcher was acting really weird, where I receive it after a number of tries
[20:38:10] <ejegg>	 oh hah mailcatcher does have a steady stream of failmail from the proxied test IPN listener
[20:38:19] <ejegg>	 all for gravy things with bad auth headers
[20:38:34] <ejegg>	 lemme just comment out the auth check in code so they stop retrying
[20:39:56] <ejegg>	 oh right, fr-tech they're asking us to send the automated recurring failure (again) to the group of google / apple pay recurring gravy donors 
[20:41:13] <ejegg>	 eileen: we have the donors in a searchkit here: https://civicrm.wikimedia.org/civicrm/search#/display/Cancelled_Google_Apple_Gravy_recurrings
[20:42:06] <ejegg>	 and the FailureEmail::send message just needs ContributionRecurID if I'm reading it correctly
[20:44:10] <ejegg>	 so i know there's a way to do that with api call chaining, but i'm almost inclined to just generate a long shell script to call wmf-cv once for each send
[20:46:15] <ejegg>	 damilare: ok, so the new link queue consumer uses CRM_Utils_Mail::send to send mail
[20:47:05] <ejegg>	 while the TY mailer uses our custom MailFactory::singleton()->send
[20:47:24] <ejegg>	 let's see where the Utils mail configuration is
[20:48:15] <ejegg>	 hmm, I'll need to relocate soon and might be a while
[20:50:35] <damilare>	 hmm I wonder why do we have 2 mailing systems in civi
[20:52:21] <ejegg>	 I guess when we started out the built-in one didn't do everything we needed for the TY emails
[20:55:54] <wikibugs>	 (03PS4) 10Damilare Adedoyin: Add API to fetch DonorSummary [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1167680
[20:58:03] <wikibugs>	 (03CR) 10CI reject: [V:04-1] Add API to fetch DonorSummary [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1167680 (owner: 10Damilare Adedoyin)
[21:01:00] <wikibugs>	 (03PS1) 10Jgleeson: Merge branch 'master' into deployment [wikimedia/fundraising/SmashPig] (deployment) - 10https://gerrit.wikimedia.org/r/1175949
[21:02:36] <wikibugs>	 (03PS5) 10Damilare Adedoyin: Add API to fetch DonorSummary [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1167680
[21:02:58] <wikibugs>	 (03CR) 10Jgleeson: [C:03+2] Merge branch 'master' into deployment [wikimedia/fundraising/SmashPig] (deployment) - 10https://gerrit.wikimedia.org/r/1175949 (owner: 10Jgleeson)
[21:03:32] <wikibugs>	 (03Merged) 10jenkins-bot: Merge branch 'master' into deployment [wikimedia/fundraising/SmashPig] (deployment) - 10https://gerrit.wikimedia.org/r/1175949 (owner: 10Jgleeson)
[21:05:23] <wikibugs>	 (03CR) 10CI reject: [V:04-1] Add API to fetch DonorSummary [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1167680 (owner: 10Damilare Adedoyin)
[21:17:01] <wikibugs>	 06Fundraising-Backlog, 06FR-donorrelations: Ask Civi to welcome PII from Gravy Sync / refresh - https://phabricator.wikimedia.org/T401257 (10MBeat33) 03NEW
[21:20:30] <wikibugs>	 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 06FR-donorrelations: Ask Civi to welcome PII from Gravy Sync / refresh - https://phabricator.wikimedia.org/T401257#11062767 (10greg)
[21:25:57] <wikibugs>	 (03PS6) 10Damilare Adedoyin: Add API to fetch DonorSummary [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1167680
[21:28:27] <wikibugs>	 (03CR) 10CI reject: [V:04-1] Add API to fetch DonorSummary [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1167680 (owner: 10Damilare Adedoyin)
[21:29:57] <wikibugs>	 (03PS7) 10Damilare Adedoyin: Add API to fetch DonorSummary [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1167680
[21:30:39] <wikibugs>	 (03PS5) 10Damilare Adedoyin: WIP: Add vue navigation guard to check checksum validity [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1167615
[21:32:43] <wikibugs>	 (03CR) 10CI reject: [V:04-1] WIP: Add vue navigation guard to check checksum validity [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1167615 (owner: 10Damilare Adedoyin)
[21:36:35] <wikibugs>	 (03PS9) 10Damilare Adedoyin: Add login template in vue with tests [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1166927
[21:38:44] <wikibugs>	 (03PS10) 10Damilare Adedoyin: Add login template in vue with tests [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1166927
[21:40:09] <wikibugs>	 (03CR) 10Damilare Adedoyin: "Thanks ejegg for the review, I've made changes according to your suggestions." [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1166927 (owner: 10Damilare Adedoyin)
[21:41:38] <wikibugs>	 (03CR) 10CI reject: [V:04-1] Add login template in vue with tests [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1166927 (owner: 10Damilare Adedoyin)
[21:41:53] <jgleeson>	 !log SmashPig upgraded from a7e897ec to 83293ee1
[21:41:55] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log
[21:42:10] <wikibugs>	 (03PS11) 10Damilare Adedoyin: Add login template in vue with tests [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1166927
[21:42:28] <wikibugs>	 (03PS8) 10Damilare Adedoyin: Add API to fetch DonorSummary [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1167680
[23:30:04] <wikibugs>	 06Fundraising-Backlog, 10fundraising-tech-ops, 10Wikimedia-Fundraising-CiviCRM, 13Patch-For-Review: Review Redis session handler locking - https://phabricator.wikimedia.org/T400848#11063038 (10Eileenmcnaughton) After testing https://github.com/civicrm/civicrm-core/pull/33354 appears to work  Locally I adde...
[23:37:50] <wikibugs>	 (03PS1) 10Eileen: Update Session handler based on upstreaming [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1175967 (https://phabricator.wikimedia.org/T400848)
[23:48:16] <wikibugs>	 06Fundraising-Backlog, 10fundraising-tech-ops, 10Wikimedia-Fundraising-CiviCRM, 13Patch-For-Review: Review Redis session handler locking - https://phabricator.wikimedia.org/T400848#11063088 (10Eileenmcnaughton) @Jgreen I need to work with you on next steps here - from what I can tell the session.save_handl...