############################### # # User-agent: * # # list folders robots are not allowed to index # Disallow: /newsite/absolutebmxe/ Disallow: /newsite/admin/ Disallow: /newsite/jobs/ Disallow: /newsite/include/ Disallow: /aspnet_client/ Disallow: /bin/ Disallow: /cgi-bin/ Disallow: /rsdb/ Disallow: /stats/ Disallow: /_database/ Disallow: /App_Data/ Disallow: /rsdb/ Disallow: /FCKeditor/ Disallow: /DOCS/ # # list specific files robots are not allowed to index # Disallow: /newSite/SendMailNewSite.asp Disallow: /defaultTest.asp # # ###############################