[00:06:17] <icinga-wm>	 PROBLEM - check_puppetrun on fran1001 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 5 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[python3-prometheus-client] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fran1001&service=check_puppetrun
[00:07:15] <icinga-wm>	 PROBLEM - check_puppetrun on frmx1001 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 5 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[python3-prometheus-client] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frmx1001&service=check_puppetrun
[00:08:33] <dwisehaupt>	 those appear to be caused by puppet trying to remove a package while the packge db is held open by another process
[00:10:21] <icinga-wm>	 PROBLEM - check_puppetrun on payments1008 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 8 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[python3-prometheus-client] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=payments1008&service=check_puppetrun
[00:11:17] <icinga-wm>	 RECOVERY - check_puppetrun on fran1001 is OK: OK: Puppet is currently enabled, last run 3 minutes ago with 0 failures https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fran1001&service=check_puppetrun
[00:12:17] <icinga-wm>	 RECOVERY - check_puppetrun on frmx1001 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frmx1001&service=check_puppetrun
[00:15:23] <icinga-wm>	 RECOVERY - check_puppetrun on payments1008 is OK: OK: Puppet is currently enabled, last run 3 minutes ago with 0 failures https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=payments1008&service=check_puppetrun
[00:19:06] <wikibugs>	 (03PS5) 10Jgleeson: UPI donations queue consumer [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/895897 (https://phabricator.wikimedia.org/T330724) (owner: 10Ejegg)
[00:23:28] <wikibugs>	 10Fundraising Sprint Everything I Merge I Merge For You, 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-India, and 3 others: Support DLocal recurring UPI payments in Civi SmashPig recurring charge job - https://phabricator.wikimedia.org/T324301 (10jgleeson) >>! In T324301#8682928, @jgleeson w...
[00:23:57] <jgleeson>	 cstone: ejegg already added the india-date adjustment in the new queue consumer! https://gerrit.wikimedia.org/r/c/wikimedia/fundraising/crm/+/895897/5/drupal/sites/default/civicrm/extensions/wmf-civicrm/Civi/Queue/UpiDonationsQueueConsumer.php#138
[00:24:13] <jgleeson>	 I just discovered it
[00:33:00] <wikibugs>	 (03CR) 10CI reject: [V: 04-1] UPI donations queue consumer [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/895897 (https://phabricator.wikimedia.org/T330724) (owner: 10Ejegg)
[01:01:39] <cstone>	 oh ho, nice sorry dono how I missed that ping I was on the computer the whole time
[01:03:17] <cstone>	 rain was exciting when I got here but it doesn't need to rain like its upstate NY
[07:59:34] <wikibugs>	 10Fundraising-Backlog, 10MediaWiki-extensions-CentralNotice: CentralNotice banners being shown too many times - https://phabricator.wikimedia.org/T331671 (10Crosbiesmith) This is happening to me constantly.  I have all banners disabled except 'Maintenance' and 'Special'.  I always visit Wikipedia logged in....
[20:23:17] <wikibugs>	 10Fundraising-Backlog: Ingenico/Worldline addition of Initial Scheme Transaction ID to avoid recurring declines - https://phabricator.wikimedia.org/T331754 (10Aklapper) @EMartin: Please add project tags as project tags - thanks!
[21:52:49] <wikibugs>	 10Fundraising-Backlog, 10MediaWiki-extensions-CentralNotice: CentralNotice banners being shown too many times - https://phabricator.wikimedia.org/T331671 (10Sophivorus) Same happening to me. Banners shown on every single page load, causing layout shifts, even on projects where I disabled all banners via prefer...