[00:14:15] <MirahezeRelay>	 <pixldev, replying to theoneandonlylegroom> Dont robots.txt exist?
[00:49:19] <MirahezeRelay>	 <originalauthority, replying to pixldev> Search Engines aren't obliged to respect robots.txt; Google generally does but it isn't required to.