# robots.txt for http://search.duke.edu # # Contains directions for robots. # See http://info.webcrawler.com/mak/projects/robots/norobots.html # # Last updated 16-Jan-98 User-agent: * Disallow: /bin/ Disallow: /cgi-bin/ Disallow: /htbin/ Disallow: /images/ Disallow: /icons/ Disallow: /OLD/ Disallow: /Harvest/ Disallow: /regular/ Disallow: /htdig/