# Robots.txt - Exclude robots from crawling National Semiconductor's site User-agent: * Disallow: /cgi-bin Disallow: /ads-cgi Disallow: /search Disallow: /profile Disallow: /order Disallow: /wwwlib Disallow: /userprice Disallow: /ftp Disallow: /notifications Disallow: /appinfo/webench/registration/signon.cgi Disallow: /appinfo/webench/scripts/ Disallow: /appinfo/webench/power/SS/ Disallow: /Commerce/ Disallow: /fserver/ Disallow: /JS/searchDocument.do Disallow: /webench5 Disallow: /temp Disallow: /pfn