# /robots.txt for http://www.wholesaledistributionofamerica.com # $Id: robots.txt,v 1.28 2007/08/26 07:33:51 skinner Exp $ # # This is a file retrieved by webwalkers a.k.a. spiders that # conform to a defacto standard. # See # # The webmaster for this site is: # D. Skinner #
cubadomains@gmail.com
# Mail feedback to: wholesaledistributionofamerica@gmail.com # Comments about this site to the webmaster should be posted at # # # Format is: # User-agent: # Disallow: | # Flag Date By Reason # $l1- 19940810 ds finally understood what the file was for! # $l2- 20000718 ds updated to new exclusion rules # $l3- 20020312 ds site specific file posted # $l4- 20041103 ds robots template file archived # $l5- 20070826 ds file revised for wholesale site # # Welcome to Wholesale Distribution of America robots.txt. # # Asimov would be proud. # following prevents access to /misc/ for spiders # ------------------------------------------------------------------ User-agent: * Disallow: /_private/ Disallow: /back-up/ Disallow: /cgi-bin/ Disallow: /images/ Disallow: /In_Process/ Disallow: /index_files/ Disallow: /stats/ Disallow: /temp/