# a sample robots exclusion file that excludes all # but the most significant robots from visiting your site # the default Disallow rule permits all of your web to be # crawled by the allowed agents, you will want to change this # see http://info.webcrawler.com/mak/projects/robots/exclusion.html # for further details # Note that the blank lines between sections are significant # Do not disallow anything from the University Search engine User-agent: EUCS-Ultraseek-Others Disallow: User-agent: EUCS-Ultraseek Disallow: # tell all other robots to go away User-agent: * Disallow: /