# robots.txt file for codeforward.com # general crawlers User-agent: * Disallow: /aspnet_client Disallow: /CGI-BIN Disallow: /database Disallow: /errors Disallow: /ftp