[01:17:34] Is it just me or is https://pageviews.toolforge.org/topviews/?project=en.wikipedia.org loading crazy slowly [01:17:47] past dates aren't loading at all for me [09:23:41] Anybody here who may take a look at replag/s5 10+ hours currently. Thanks [10:48:10] !log cloudinfra shutdown and delete ntp-01 and ntp-02 running stretch, replaced by -03 and -04 [10:48:13] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Cloudinfra/SAL [11:38:02] !log cloudinfra generate new profile::mariadb::grants::cloudinfra::repl_pass, previous one seems to have been lost in the 2020-06-04 labs/private incident [11:38:04] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Cloudinfra/SAL [11:57:15] Amir1: are there any docs I can follow to clone the new cloudinfra db hosts from the existing ones? [12:37:13] managed to do that by myself, I think [14:02:36] !log tools.notwikilambda Checked out WSOAuth master again (T298351) [14:02:40] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.notwikilambda/SAL [14:22:50] !log tools.notwikilambda kubectl create -f ~/k8s/update/deployment.yaml # resume automatic updates except for extensions/PluggableAuth (T299934) [14:22:54] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.notwikilambda/SAL [15:12:54] Weird. Using a "~/" path for mysql_read_default_file seems to have stopped working in my bot a few days ago, I had to change it to expand that to the actual path. [15:16:08] anomie: looks like your bot is using `qsub` directly and not our `jsub` wrapper? I imagine that means that your jobs are getting scheduled on our new debian 10 based nodes (those exist now but haven't been announced yet), so it's using a different mysql client version or similar [15:22:23] taavi: Cool, now I'm tempted to restart the rest of my bot's jobs to get them on Debian 10 too. I'll let you know if I run into any other issues. [17:14:48] !log cloudinfra encapi db switchover: cloudinfra-db01 -> cloudinfra-db03 [17:14:51] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Cloudinfra/SAL [17:51:57] bare qsub will handle jobs on both the stretch and buster grids without preference. [17:52:48] you can use `-hard -l release=buster` to force it to one or the other [17:54:10] !log cvn switching to project-local nfs server puppet-diffs-nfs-1 [17:54:12] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Cvn/SAL [18:47:24] !log twl switching to project-local nfs server twl-nfs-1 [18:47:26] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Twl/SAL [18:47:31] !log cvn switching to project-local nfs server cvn-nfs-1 [18:47:32] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Cvn/SAL [19:28:00] !log fastcci switching to project-local nfs server fastcci-nfs-1 [19:28:03] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Fastcci/SAL [19:32:55] !log fastcci rebooting VMs to catch up with new nfs mountpoints [19:32:57] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Fastcci/SAL [20:16:23] Hello, why is dupdet tool in tool labs not available (error 503)? I even make a simple file without php, test.html, it says 404 not found [20:47:46] gry: it looks like that tool has only one maintainer: https://toolhub.wikimedia.org/search?q=dupdet&ordering=-score&page=1&page_size=12 [20:48:31] andrewbogott, does it? the page you linked writes one 'Author' and says nothing about 'maintainer' to me [20:49:45] you're right, it has a couple of maintainers https://toolsadmin.wikimedia.org/tools/id/dupdet [20:50:23] I can try to restart it but that's about the extent of my knowledge [20:50:26] andrewbogott, correct, I'm the Svetlana from that list. I'm logged in to the tool, and trying to get its service to load. [20:50:36] I've already restarted its webservice and that didn't help. [20:50:39] ah, ok [20:50:44] then you know a lot more than I do :) [21:12:22] it is suspicious, I write "https://dupdet.toolforge.org/65765.php" the file does not exist, it says service not available [21:12:28] should say 404 [21:22:30] I stopped webservice completely, waited a minute and started it again; seems to work now [22:43:08] and now it started timing out [22:43:17] what is the best place to ask for help from other toolforge users? [23:33:28] hi sDrewth