# Robots.txt file # For domain: http://thefti.com # All robots will spider the domain User-agent: * Disallow: # Disallow directory /templates User-agent: * Disallow: /templates # Disallow directory /aspstats User-agent: * Disallow: /aspstats # Disallow directory /aspnet_client User-agent: * Disallow: /aspnet_client