# robots.txt # # This file is to prevent the crawling and indexing of certain parts # of your site by web crawlers and spiders run by sites like Yahoo! # and Google. By telling these "robots" where not to go on your site, # you save bandwidth and server resources. User-agent: * Crawl-delay: 10 # Directories Disallow: /2int/ Disallow: /armyops/ Disallow: /egay/ Disallow: /family/ Disallow: /files/ Disallow: /friends/ Disallow: /herb/ Disallow: /mp3/ Disallow: /v3/