[01:02:55] 10Puppet, 10Continuous-Integration-Infrastructure, 10Infrastructure-Foundations: Puppet failure on integration-puppetmaster-02.integration.eqiad1.wikimedia.cloud - https://phabricator.wikimedia.org/T290422 (10Andrew) Strange -- after I made my changes last week I doublechecked that puppet was working properl... [01:57:33] 10Puppet, 10Continuous-Integration-Infrastructure, 10Infrastructure-Foundations: Puppet failure on integration-puppetmaster-02.integration.eqiad1.wikimedia.cloud - https://phabricator.wikimedia.org/T290422 (10Andrew) 05Open→03Resolved a:03Andrew I still don't know what this was but I regenerated all th... [13:13:54] volans: the error message sounds more like Ruby than Java to me [13:15:50] right, could be ruby too, my hunch would be the same though :) [13:16:59] unless they have some backend where this is failing and some where it works because of different environment, but that would be pretty weird on their side [13:17:05] given has been going on for days AFAIK [13:17:21] feel free to comment [14:30:02] volans: you were right! [14:30:24] the statograph upload worked fine if the values were rounded [14:30:49] and they always fail if you add more digits? [14:35:17] they do document the field as: number [14:35:58] yep "value: number " is what the docs say. [14:36:22] Haven't tried always adding more digits. [14:37:08] I'd say we can round to N decimals and be done with it, with N > 6 and N <15 [14:40:12] 10Puppet, 10puppet-compiler, 10Infrastructure-Foundations, 10SRE, and 2 others: replace all puppet crons with systemd timers - https://phabricator.wikimedia.org/T273673 (10Dzahn) migrated zuul_repack (zuul::merger) on contint* servers [14:40:29] It works consistently with n=10, fails consistently with n=11. [14:41:13] 10Puppet, 10puppet-compiler, 10Infrastructure-Foundations, 10SRE, and 2 others: replace all puppet crons with systemd timers - https://phabricator.wikimedia.org/T273673 (10Ladsgroup) Thanks! I added the patch to drop it. [14:44:24] topranks: weird it worked with more than those in your example, but all the last digits were the same (if that matters) [14:44:39] anyway, let's do round 9? to be on the safe side? [14:45:20] yeah makes sense [15:49:03] 10Puppet, 10Cloud-Services, 10Infrastructure-Foundations, 10SRE, and 2 others: Create a cron to clean clientbucket every day or hour - https://phabricator.wikimedia.org/T165885 (10jbond) >>! In T165885#7314759, @elukey wrote: > @jbond sure! Question - is there a problem with the /var/log/camus directories...